WO2023053325A1

WO2023053325A1 - Information processing device, information processing system, information processing method, and non-transitory computer-readable medium

Info

Publication number: WO2023053325A1
Application number: PCT/JP2021/036093
Authority: WO
Inventors: 憲由平本
Original assignee: 日本電気株式会社
Priority date: 2021-09-30
Filing date: 2021-09-30
Publication date: 2023-04-06

Abstract

An information processing device (10) according to the present invention comprises: an image acquisition unit (12) that acquires a captured image of a user who visited a first store; a user identification unit (13) that identifies the user on the basis of the captured image; a selection unit (15) that selects, on the basis of user information associated with the user and relationship information expressing the business relationships between each of a plurality of stores and the first store, at least one set of sales promotion information associated with at least one store among the plurality of stores as recommended sales promotion information associated with a recommended store; and an output control unit (16) that outputs the recommended sales promotion information.

Description

Information processing device, information processing system, information processing method, and non-transitory computer-readable medium

The present disclosure relates to an information processing device, an information processing system, an information processing method, and a non-temporary computer-readable medium, and particularly an information processing device, an information processing system, an information processing method, and a non-temporary computer that output sales promotion information of a store. Relating to readable media.

In recent years, technology has been developed to provide customers with personalized service information. For example, Patent Literature 1 describes a service providing system that determines service content for a customer based on customer information specified based on biological characteristics and product information. Further, for example, in Patent Document 2, in a service providing system that provides a service according to an object related to a captured image, service information is read based on a combination of a recognized object (such as a vehicle) and a recognized person. It is described that the

Japanese Patent Application Laid-Open No. 2001-236417 JP 2018-110023 A

Here, in recent years, attention has been focused on companies that develop their businesses in a multifaceted manner. For example, a cosmetics manufacturer not only manufactures cosmetics and sells them at directly managed street stores, but also sells them at department stores and large-scale commercial facilities, sells at franchise stores, fitness businesses, esthetic businesses, and various other businesses throughout the group. is deployed in For example, a vehicle manufacturer not only manufactures and sells vehicles, but also develops various businesses such as maintenance and inspection of vehicles, operation of service stations, restaurants, and stadiums. There is also a need to increase the profits of the entire group, and for that reason, it is required to enclose customers in the company's own group and affiliated groups.

In view of the above-mentioned problems, the purpose of the present disclosure is to provide an information processing device, an information processing system, an information processing method, and a non-temporary computer-readable medium that make it easy to retain customers in the company's own group or affiliated group. be.

An information processing device according to an aspect of the present disclosure includes:
an image acquiring means for acquiring a photographed image of a user who has visited the first store;
user identifying means for identifying the user based on the captured image;
related to at least one store among the plurality of stores based on user information related to the user and relationship information indicating a business relationship between each of the plurality of stores and the first store; selection means for selecting at least one promotional information to be the recommended promotional information associated with the recommended store;
and output control means for outputting the recommended sales promotion information.

An information processing system according to one aspect of the present disclosure includes:
an information processing device;
a terminal that provides information to the user who visited the first store;
The information processing device is
an image acquisition means for acquiring a photographed image of the user who visited the first store;
user identifying means for identifying the user based on the captured image;
related to at least one store among the plurality of stores based on user information related to the user and relationship information indicating a business relationship between each of the plurality of stores and the first store; selection means for selecting at least one promotional information to be the recommended promotional information associated with the recommended store;
and output control means for outputting the recommended sales promotion information to the terminal.

An information processing method according to an aspect of the present disclosure includes:
Acquiring a photographed image of a user who has visited the first store,
identifying the user based on the captured image;
related to at least one store among the plurality of stores based on user information related to the user and relationship information indicating a business relationship between each of the plurality of stores and the first store; selecting at least one promotional information as a recommended promotional information associated with the recommended store;
Output the recommended sales promotion information.

According to one aspect of the disclosure, a non-transitory computer-readable medium includes:
an image acquisition process for acquiring a photographed image of a user who has visited the first store;
user identification processing for identifying the user based on the captured image;
related to at least one store among the plurality of stores based on user information related to the user and relationship information indicating a business relationship between each of the plurality of stores and the first store; a selection process of selecting at least one promotional information to be the recommended promotional information associated with the recommended store;
A program for causing a computer to execute an output control process for outputting the recommended sales promotion information is stored.

With the present disclosure, it is possible to provide an information processing device, an information processing system, an information processing method, and a non-temporary computer-readable medium that facilitate customer retention in the company's own group or affiliated group.

1 is a block diagram showing the configuration of an information processing apparatus according to a first embodiment; FIG. 4 is a flow chart showing the flow of an information processing method according to the first embodiment; 2 is a block diagram showing the overall configuration of an information processing system according to a second embodiment; FIG. 2 is a block diagram showing the configuration of a face authentication device according to a second embodiment; FIG. 9 is a flowchart showing the flow of face information registration processing according to the second embodiment; 9 is a flow chart showing the flow of face authentication processing according to the second embodiment; FIG. 8 is a block diagram showing the configuration of a user terminal according to the second embodiment; FIG. 8 is a block diagram showing the configuration of a store terminal according to the second embodiment; FIG. FIG. 7 is a block diagram showing the configuration of a server according to the second embodiment; FIG. FIG. 11 is a diagram for explaining an example of relationship information according to the second embodiment; FIG. FIG. 11 is a diagram showing an example of the data structure of a usage history DB according to the second embodiment; FIG. FIG. 11 is a sequence diagram showing the flow of member registration processing according to the second embodiment; FIG. 10 is a diagram showing an example of display on a user terminal according to the second embodiment; FIG. FIG. 11 is a sequence diagram showing the flow of information provision processing according to the second embodiment; FIG. 11 is a sequence diagram showing the flow of usage history registration processing according to the second embodiment; FIG. 11 is a diagram for explaining a purchase cycle according to the second embodiment; FIG. FIG. 11 is a diagram showing an example of display of the store terminal according to the second embodiment; FIG. 11 is a block diagram showing the configuration of a server according to a third embodiment; FIG. FIG. 12 is a sequence diagram showing the flow of opportunity loss calculation processing according to the third embodiment; FIG. 11 is a block diagram showing the configuration of a server according to a fourth embodiment; FIG. FIG. 16 is a sequence diagram showing the flow of information provision processing according to the fourth embodiment; FIG. 14 is a diagram showing an example of display of a store terminal according to the fourth embodiment; FIG. 12 is a block diagram showing the configuration of a server according to the fifth embodiment; FIG. FIG. 14 is a diagram showing an example of the data structure of contract information according to the fifth embodiment; FIG. 22 is a sequence diagram showing the flow of information provision processing according to the fifth embodiment; FIG. 14 is a diagram showing an example of display on a user terminal according to the fifth embodiment; FIG. FIG. 17 is a sequence diagram showing the flow of information sharing processing according to the fifth embodiment;

Below, embodiments of the present disclosure will be described in detail with reference to the drawings. In each drawing, the same reference numerals are given to the same or corresponding elements, and redundant description will be omitted as necessary for clarity of description.

Below, the following terms are defined as follows.
"User information" is information related to the user. "User information" includes at least one of user attribute information and information indicating user preferences. In addition to or instead of the above information, the "user information" may also include the usage history of the user.
“Usage history” is information indicating that the user has used one of a plurality of predetermined stores. The usage history includes payment history.
"Relationship information" indicates business relationships between stores. "There is a business relationship" may indicate, for example, whether the affiliated group to which the store belongs is the same, or whether the store or its affiliated group is in a business alliance relationship or a capital alliance relationship. .
"Sales promotion information" may include basic information about a store, information about products or services offered at the store, or campaign information or special offer information for the product or service.
"Maintenance" is used as a term that includes preparation, inspection, repair, or replacement.
“Personal identification information” is information for identifying the user himself/herself. “Personal identification information” is a user's face image or facial feature information, or a user ID that identifies a user.
"Vehicle status information", also referred to as vehicle status information, may indicate, for example, that a particular part of the vehicle has failed, that a particular function has failed, or that a particular function is malfunctioning.
The "user location information" may be location information of the user terminal, location information of a wearable terminal connected to the user terminal and worn on the user's body, or location information of the user's vehicle. It may be location information.
A "vehicle related contract" is a contract for vehicle services. The "vehicle-related contract" may include a vehicle purchase contract, a vehicle rental/lease contract, a vehicle maintenance contract, or privilege information associated with various contracts.
A "vehicle service" is a service related to a vehicle. For example, "vehicle services" are services related to vehicle inspection, insurance, maintenance, sales, car sharing, or rental cars.
"Contracted store" is a store with which the user has made a contract. For example, "contracted store" may include the store where the user purchased, rented, or leased the vehicle.
"Using (a product or service)" means purchasing a product or service.

<Embodiment 1>
First, Embodiment 1 of the present disclosure will be described. FIG. 1 is a block diagram showing the configuration of an information processing apparatus 10 according to the first embodiment. The information processing device 10 is a computer device that outputs sales promotion information for one or more stores. The information processing device 10 is connected to a network (not shown). A network may be wired or wireless. A user terminal (not shown) used by a user or a shop terminal (not shown) may be connected to the network. The store terminal is a terminal installed at the first store visited by the user or a terminal used by the manager of the first store visited by the user. The store terminal provides information to the user visiting the first store.

The information processing device 10 includes an image acquisition unit 12 , a user identification unit 13 , a selection unit 15 and an output control unit 16 .

The image acquisition unit 12 is also called image acquisition means. The image acquisition unit 12 acquires a photographed image of the user visiting the first store. For example, the image acquisition unit 12 acquires the captured image from the store terminal.

The user identification unit 13 is also called user identification means. The user identification unit 13 identifies a user based on the captured image acquired by the image acquisition unit 12 . For example, the user identifying unit 13 identifies a user ID that identifies a user by face authentication.

The selection unit 15 is also called selection means. The selection unit 15 selects at least one piece of sales promotion information related to at least one store among the plurality of stores based on the user information and relationship information between each of the plurality of stores and the first store, Selected as recommended promotional information for recommended stores. As an example, the selection unit 15 selects, from among a plurality of pieces of sales promotion information related to a plurality of shops, information on products preferred by the user and sold by shops having a business relationship.

The output control unit 16 is also called output control means. The output control unit 16 outputs the recommended sales promotion information related to the recommended store selected by the selection unit 15 . For example, the output control unit 16 may transmit the selected recommended sales promotion information to the store terminal of the first store and cause the store terminal to output (display) it. In this case, the store terminal may display the content of the recommended sales promotion information so that the user can visually recognize it, or the store clerk using the store terminal may verbally inform the user. Note that the destination is not limited to the store terminal, and may be a user terminal.

FIG. 2 is a flow chart showing the flow of the information processing method according to the first embodiment. First, the image acquisition unit 12 of the information processing device 10 acquires a photographed image of the user who visited the first store (S10). Next, the user identification unit 13 identifies the user based on the captured image (S11). Next, based on the user information and the relationship information, the selection unit 15 selects at least one item of sales promotion information related to at least one store among the plurality of stores as recommended sales promotion information for the recommended store (S12). Finally, the output control unit 16 outputs the selected sales promotion information (recommended sales promotion information) to the store terminal or user terminal (S13).

As described above, according to the first embodiment, a user visiting a store is provided with sales promotion information of a store that has a business relationship with the store after being personalized based on the user's attributes and preferences. do. Therefore, it becomes easy to retain customers by encouraging the users to visit the company's own group or the affiliated group of the stores visited while increasing the satisfaction of the users.

<Embodiment 2>
Next, Embodiment 2 of the present disclosure will be described. FIG. 3 is a block diagram showing the overall configuration of an information processing system 1000 according to the second embodiment. The information processing system 1000 is a computer system that provides users with promotional information for one or more stores. In the second embodiment, the information processing system 1000 provides the user with sales promotion information for the store in order to encourage the user to visit a store that has a business relationship with the first store that the user has visited.

The information processing system 1000 includes a face authentication device 100 , an information processing device (hereinafter referred to as a server) 200 , a user terminal 300 and one or more store terminals 400 . Each device and terminal are connected to each other via a network N. FIG. The network N is a wired or wireless communication line.

The user terminal 300 is an information terminal used by the user.

The store terminal 400 is an information terminal installed in each of a plurality of stores that provide in-store services or a terminal used by the manager of each store. An in-store service is a service in which a user visits a store to receive services, and may be, for example, cosmetics sales, vehicle sales, or vehicle maintenance services.
The store terminal 400 visits the store, accepts face authentication for the user who uses the in-store service, and when the face authentication succeeds, provides sales promotion information of its own store or another store according to the user. . In the second embodiment, the store terminal 400 captures at least the face of the user to be face-authenticated, and transmits the face image (hereinafter also referred to as a captured image) to the server 200 . Face authentication is performed by the server 200 and the face authentication device 100 via the shop terminal 400 .
In addition, the store terminal 400 transmits a usage history related to face payment for use of in-store services to the server 200 and causes the server 200 to store the user's usage history.

The face authentication device 100 is an example of a biometric authentication device, and is a computer device that stores facial feature information of a plurality of persons. In addition, the face authentication device 100 has a face authentication function that, in response to a face authentication request received from the outside, compares the face image or face feature information included in the request with the face feature information of each user. In the second embodiment, the face authentication device 100 registers facial feature information of the user at the time of member registration, which will be described later. Then, the face authentication device 100 acquires the face image of the user who visited the first store from the store terminal 400 of the first store via the server 200, and performs face authentication using the face image. The face authentication device 100 then returns the collation result (face authentication result) to the server 200 .

The server 200 is an example of the information processing device 10 described above, and is a computer device that provides the store terminal 400 with sales promotion information for one or more stores selected according to the user. First, the server 200 registers a user as a member in response to a member registration request from the user terminal 300 . When the server 200 receives an information provision request or a face payment request from the store terminal 400, the server 200 executes processing according to the request and the user. The request includes the facial image or facial feature information of the user who visited the first store. Upon receiving the above request, the server 200 extracts the user's facial image or facial feature information from the above request, and requests the face authentication device 100 to perform face authentication for the face area. For example, when receiving an information provision request, the server 200 transmits to the store terminal 400 and displays sales promotion information of one or more stores corresponding to the user identified by face authentication.

The server 200 also collects usage histories related to facial payment from the store terminals 400 of each store and accumulates them in a usage history database (DB).

FIG. 4 is a block diagram showing the configuration of the face authentication device 100 according to the second embodiment. The face authentication device 100 includes a face information DB (DataBase) 110 , a face detection section 120 , a feature point extraction section 130 , a registration section 140 and an authentication section 150 . The face information DB 110 associates and stores a user ID 111 and face feature information 112 of the user ID. The user ID 111 is information for identifying a user, such as an identification number. The facial feature information 112 is a set of feature points extracted from a facial image, and is an example of facial information. Note that the face authentication device 100 may delete the face feature information 112 in the face feature DB 110 in response to a request from the registered user of the face feature information 112 . Alternatively, the face authentication device 100 may delete the facial feature information 112 after a certain period of time has passed since it was registered.

The face detection unit 120 detects a face area included in a registered image for registering face information, and supplies it to the feature point extraction unit 130 . The feature point extraction unit 130 extracts feature points from the face area detected by the face detection unit 120 and supplies face feature information to the registration unit 140 . Further, the feature point extraction unit 130 extracts feature points included in the facial image received from the server 200 and supplies facial feature information to the authentication unit 150 .

The registration unit 140 newly issues a user ID 111 when registering facial feature information. The registration unit 140 associates the issued user ID 111 with the facial feature information 112 extracted from the registered image and registers them in the facial information DB 110 . The authentication unit 150 performs face authentication using the facial feature information 112 . Specifically, the authentication unit 150 collates the facial feature information extracted from the facial image with the facial feature information 112 in the facial information DB 110 . Authentication unit 150 returns to server 200 whether or not the facial feature information matches. Whether the facial feature information matches or not corresponds to the success or failure of the authentication. Note that matching of facial feature information (matching) means a case where the degree of matching is equal to or greater than a predetermined value.

FIG. 5 is a flowchart showing the flow of face information registration processing according to the second embodiment. First, the face authentication device 100 acquires the registered image of the user U included in the face registration request (S21). For example, the face authentication device 100 receives a face registration request via the network N from the server 200 that has received the member registration request from the user terminal 300 . Note that the face authentication device 100 may receive a face registration request directly from the user terminal 300 without being limited to this. Next, face detection section 120 detects a face area included in the registered image (S22). Next, the feature point extraction unit 130 extracts feature points from the face area detected in step S22, and supplies face feature information to the registration unit 140 (S23). Finally, the registration unit 140 issues the user ID 111, associates the user ID 111 with the facial feature information 112, and registers them in the facial information DB 110 (S24). Note that the face authentication device 100 may receive the face feature information 112 from the face registration requester and register it in the face information DB 110 in association with the user ID 111 .

FIG. 6 is a flowchart showing the flow of face authentication processing according to the second embodiment. First, the feature point extraction unit 130 acquires facial feature information for authentication (S31). For example, the face authentication device 100 receives a face authentication request from the server 200 via the network N, and extracts facial feature information from the face image included in the face authentication request in steps S21 to S23. Alternatively, the face authentication device 100 may receive facial feature information from the server 200 . Next, the authentication unit 150 collates the acquired facial feature information with the facial feature information 112 of the facial information DB 110 (S32). If the facial feature information matches, that is, if the degree of matching of the facial feature information is equal to or greater than a predetermined value (Yes in S33), the authentication unit 150 identifies the user ID 111 of the user whose facial feature information matches (S34). . Then, the authenticating unit 150 replies to the server 200 that the face authentication was successful and the identified user ID 111 as the face authentication result (S35). If there is no matching facial feature information (No in S33), the authentication unit 150 returns a face authentication result to the server 200 to the effect that the face authentication has failed (S36).

FIG. 7 is a block diagram showing the configuration of the user terminal 300 according to the second embodiment. User terminal 300 includes camera 310 , storage unit 320 , communication unit 330 , display unit 340 , input unit 350 , and control unit 360 .
The camera 310 is an imaging device that performs imaging under the control of the control unit 360 . The storage unit 320 is a storage device that stores programs for realizing each function of the user terminal 300 . A communication unit 330 is a communication interface with the network N. FIG. The display unit 340 is a display device. The input unit 350 is an input device that receives input from the user. The display unit 340 and the input unit 350 may be configured integrally like a touch panel. The control unit 360 controls hardware of the user terminal 300 .

FIG. 8 is a block diagram showing the configuration of the store terminal 400 according to the second embodiment. Store terminal 400 includes camera 410 , storage unit 420 , communication unit 430 , display unit 440 , input unit 450 , and control unit 460 .
The camera 410 is an imaging device that performs imaging under the control of the control unit 460 . The storage unit 420 is a storage device that stores programs for realizing each function of the store terminal 400 . A communication unit 430 is a communication interface with the network N. FIG. Display unit 440 is a display device. Input unit 450 is an input device that receives an input. The display unit 440 and the input unit 450 may be configured integrally like a touch panel. The control unit 460 controls hardware of the store terminal 400 .

FIG. 9 is a block diagram showing the configuration of the server 200 according to the second embodiment. The server 200 includes a storage section 210 , a memory 220 , a communication section 230 and a control section 240 . The storage unit 210 is a storage device such as a hard disk or flash memory. Storage unit 210 stores program 211 , user DB 212 , store information DB 213 , relationship information 214 , and usage history DB 215 . The program 211 is a computer program in which the processing of the information processing method according to the second embodiment is implemented.

The user DB 212 stores user information of users who are members. Specifically, the user DB 212 stores user information 2122 in association with the user ID 2121 . The user ID 2121 may be issued by the face authentication device 100 when face information is registered. The user information 2122 is information about the user, and may include, for example, user attribute information and information indicating user preferences. The attribute information may include at least one of age, place of residence, gender, family composition, workplace, allergy information, and religious information. Attribute information may include work environment, such as whether the work is indoors or outdoors. The information indicating the user's preference may include information regarding at least one of the user's hobby, the user's field of interest, and the product or service evaluated by the user.

Store information DB213 is a database which memorize|stores various information relevant to a store. Specifically, store information DB213 is provided with store ID2131, affiliate group 2132, and sales promotion information 2133.
Store ID2131 is the information which identifies a store. The affiliated group 2132 is information about the group to which the store belongs. For example, the affiliated group 2132 is a group ID that identifies the group to which the shop belongs. The sales promotion information 2133 includes basic information on the store, information on products or services offered at the store, or campaign information or special treatment information on the product or service.

The relationship information 214 is an example of the relationship information described above. A specific example of the relationship information 214 will now be described with reference to FIG. FIG. 10 is a diagram for explaining an example of the relationship information 214 according to the second embodiment. The relationship information 214 may be information indicating the business relationship between the groups to which each store belongs, for example, relationship degree information that quantifies the strength of the business relationship between the groups. As an example, if the affiliated group is the same store, the relationship degree may be "1", and if the affiliated group is different and there is neither a business alliance nor a capital alliance, the relationship degree may be "0". Also, if affiliated groups are different but have some kind of business alliance or capital alliance, the degree of relationship may be greater than or equal to "0" and less than "1." In this figure, the degree of relationship between group α and group β is "0.5", and the degree of relationship between group α and group γ and between group β and group γ is "0". is.

Instead of or in addition to this, the relationship information 214 may be information indicating the business relationship between stores, for example, relationship degree information that quantifies the strength of the business relationship between stores.

Return to Figure 9 and continue the explanation. The usage history DB 215 stores usage histories of users at one or more stores. The usage history DB 215 stores a user ID 2151 and a usage history 2152 in association with each other. A specific example of the usage history DB 215 will now be described with reference to FIG. 11 .

FIG. 11 is a diagram showing an example of the data structure of the usage history DB 215 according to the second embodiment. The usage history DB 215 records the usage history of the user for each user ID. For example, the usage history includes the date and time of use, the store used, the affiliated store group, the purchased product (or the service used), the quantity, and the amount of money spent.
The usage history of the user may be included in the user information.

Return to Figure 9 and continue the explanation. The memory 220 is a volatile storage device such as a RAM (Random Access Memory), and is a storage area for temporarily holding information when the control unit 240 operates. The communication unit 230 is a communication interface with the network N. FIG.

The control unit 240 is a processor that controls each component of the server 200, that is, a control device. The control unit 240 loads the program 211 from the storage unit 210 into the memory 220 and executes the program 211 . Thereby, the control unit 240 realizes the functions of the user information registration unit 241, the image acquisition unit 242, the user identification unit 243, the usage history extraction unit 244, the first selection unit 245, the output control unit 246, and the usage history registration unit 247. do.

The user information registration unit 241 is also called user information registration means. When the user information registration unit 241 receives the registration image from the user terminal 300 , the user information registration unit 241 transmits a face registration request to the face authentication device 100 . Then, when the face authentication device 100 registers face information and issues a user ID, the user information registration unit 241 registers the user ID in the user DB 212 . When receiving a member registration request from the user terminal 300 , the user information registration unit 241 registers the user information of the user in the user DB 212 in association with the user ID of the user used by the user terminal 300 .

The image acquisition unit 242 is an example of the image acquisition unit 12 described above. When receiving an information provision request or a face payment request from the store terminal 400, the image acquisition unit 242 acquires a face image or face feature information included in the request. The image acquisition unit 242 supplies the facial image or facial feature information to the user identification unit 243 .

The user identification unit 243 is an example of the user identification unit 13 described above. The user identification unit 243 controls face authentication for the face area of the user U included in the face image to identify the user. That is, the user identification unit 243 causes the face authentication device 100 to perform face authentication on the face image acquired from the shop terminal 400 . For example, the user identification unit 243 transmits a face authentication request including the acquired face image to the face authentication device 100 via the network N. FIG. Note that the user specifying unit 243 may extract the face area of the user U from the face image and include the extracted image in the face authentication request. Further, the user identification unit 243 may extract facial feature information from the face area and include the facial feature information in the face authentication request. User identification unit 243 receives the result of face authentication from face authentication device 100 . Thereby, the user identification unit 243 identifies the user's user ID.

The usage history extraction unit 244 is also called usage history extraction means. When receiving an information provision request from the store terminal 400 , the usage history extraction unit 244 extracts the usage history associated with the user ID specified by the user specifying unit 243 from the usage history DB 215 . The usage history extraction unit 244 supplies the extracted usage history to the first selection unit 245 .

The first selection unit 245 is an example of the selection unit 15 described above. The first selection unit 245 selects at least one store from a plurality of stores as a recommended store based on at least the affiliated group 2132 and the relationship information 214 of the store information DB 213 . For example, the first selection unit 245 may select, as recommended stores, stores that belong to a group whose degree of relationship with the affiliated group of the store (first store) visited by the user is equal to or greater than a predetermined threshold. Further, for example, the first selection unit 245 selects, as recommended stores, stores belonging to a group having the highest n (n is a predetermined natural number) degree of relationship with the affiliated group of the first store. may The recommended stores may or may not be selected to include the first store. Also, the business operated by the recommended store may be the same as or different from that of the first store. Operating different businesses may mean that the business fields are different according to predetermined criteria, for example, the first store operates a cosmetics sales business and the recommended store operates a restaurant business. There are cases where When stores with different types of businesses are selected as recommended stores, users can be widely guided to services in other fields of the company's own group or affiliated groups. Therefore, the migratory effect of the entire group can be enhanced.

Then, the first selection unit 245 selects at least one piece of sales promotion information as recommended sales promotion information from a plurality of pieces of sales promotion information related to the recommended store. For example, the first selection unit 245 selects recommended sales promotion information from a plurality of sales promotion information associated with the store ID of the recommended store in the store information DB 213 . The recommended sales promotion information may be selected based on at least one of user information associated with the user ID in the user DB 212 and usage history associated with the user ID in the usage history DB 215 .

It should be noted that the first selection unit 245 may adjust the quantity or quality of recommended sales promotion information to be selected based on the usage history of the specified user at the stores of the affiliated group or affiliated group. For example, the first selection unit 245 determines the amount of recommended sales promotion information based on the usage amount spent by the specified user in the affiliated group of the first store or the user's frequency of visiting stores belonging to the affiliated group. Or you can adjust the quality. As an example, the first selection unit 245 increases the amount of recommended sales promotion information, selects sales promotion information with a high discount rate, or preferentially selects sales promotion information including discount information as the usage amount or visit frequency increases. You can Thus, for example, the more products the user purchases at the affiliated group store or the more the user visits the store, the more useful information the user can obtain. Therefore, it becomes easier for the store to guide the user into the affiliated group of the store.

The output control unit 246 is an example of the output control unit 16 described above. In the second embodiment, the output control unit 246 transmits the sales promotion information selected by the first selection unit 245 to the store terminal 400 of the first store visited by the user, and causes the store terminal 400 to display the information.

The usage history registration unit 247 is also called usage history registration means. When receiving a face payment request from the store terminal 400, the usage history registration unit 247 registers the usage information related to the payment included in the face payment request as a usage history in the usage history DB 215 in association with the user ID.

FIG. 12 is a sequence diagram showing the flow of member registration processing according to the second embodiment. First, the user terminal 300 takes a picture of the user U (S500), and transmits a member registration request including a registration image generated by the picture to the server 200 (S501). Then, the user information registration unit 241 of the server 200 includes the registration image included in the received member registration request in the face registration request and transmits the face registration request to the face authentication device 100 (S502). Then, the face authentication device 100 registers face information (face feature information) of the user U based on the registration image included in the received face registration request (S503). Then, the face authentication device 100 notifies the server 200 of the issued user ID (S504). Also, the user terminal 300 accepts input of user information from the user and transmits the user information to the server 200 (S505). The user information transmitted here includes user attribute information and information indicating user preferences. The user information registration unit 241 of the server 200 associates the notified user ID and user information with each other and registers them in the user DB 212 (S506).

FIG. 13 is a diagram showing an example of display on the user terminal 300 according to the second embodiment. FIG. 13 shows a user information input screen displayed on the display unit 340 of the user terminal 300 at the time of member registration. The screen of FIG. 13 includes an input area for selecting an item of interest to the user and an input area for selecting recommended information as input areas for information indicating the user's preference. there is For example, the user selects "makeup" and "restaurant" as items of interest, and selects "information on sales of cosmetics" and "information on special offers at restaurants" as information to be recommended. In S505, the user terminal 300 transmits the information received from each input area to the server 200 as information indicating the user's preference.

FIG. 14 is a sequence diagram showing the flow of information provision processing according to the second embodiment. First, the store terminal 400 of the first store photographs the user visiting the first store (S510). The store terminal 400 then transmits an information provision request to the server 200 (S511). This information provision request includes a photographed face image and a store ID that identifies the first store. Thereby, the image acquisition unit 242 of the server 200 acquires the user's face image. Next, the user specifying unit 243 of the server 200 transmits a face authentication request for the face area of the user U in the face image to the face authentication device 100 (S512). Then, the face authentication device 100 performs face authentication on the face area of the user U in the face image included in the received face authentication request (S513). Here, it is assumed that there is a user ID for which face authentication has succeeded. The face authentication device 100 transmits to the server 200 a face authentication result including the success of the face authentication and the user ID (S514). The user identification unit 243 of the server 200 identifies the user based on the user ID included in the face authentication result.

Next, the usage history extraction unit 244 of the server 200 extracts the usage history associated with the user ID included in the face authentication result from the usage history DB 215 (S515) and supplies it to the first selection unit 245. Next, the first selection unit 245 identifies the affiliated group of the first store by referring to the store information DB 213 using the store ID that identifies the first store (S516). Next, the first selection unit 245 selects recommended stores from a plurality of stores based on the specified affiliated group and the relationship information 214 (S517). Next, based on the usage history of the user extracted in S515 and the user information associated with the user ID in the user DB 212, the first selection unit 245 selects the recommended store sales promotion information stored in the store information DB 213. , select recommended sales promotion information (S518). Next, the output control unit 246 transmits the recommended sales promotion information of the recommended store to the store terminal 400 of the first store (S519). The store terminal 400 displays the recommended sales promotion information of the recommended store on the display unit 440 (S520).

In the above description, in S517, the affiliated group and the related information 214 are used as the basis for selecting the recommended store, and the usage history and user information are used as the basis for selecting the recommended sales promotion information. However, the present invention is not limited to this. For example, in addition to or instead of this, the usage history and user information may be used as a basis for selecting recommended shops. As an example, when the first store provides vehicle sales and vehicle maintenance services, the first selection unit 245 selects the usage history of the user from among the stores identified based on the affiliated group of the first store and the related information 214 . The recommended shop may be selected based on the maintenance history of the user's vehicle, which is included in the . Then, the first selection unit 245 may select the sales promotion information of the user's favorite service from the sales promotion information of the recommended store based on the usage history and the user information.
Affiliate group and relationship information 214 may also be used as a basis for selecting recommended promotions. For example, the first selection unit 245 selects recommended products or recommended services from the usage history and user information, and based on the affiliated group and relationship information 214, selects promotion information for recommended stores from sales promotion information on recommended products or recommended services. You may choose. As an example, when the first store provides vehicle sales and vehicle maintenance services, the first selection unit 245 first selects the type of maintenance service required based on the user's vehicle maintenance history included in the user's usage history. You may choose. Then, the first selection unit 245 may select, from the selected sales promotion information related to the maintenance service, the sales promotion information of the store having a high degree of relationship with the affiliated group of the first store as the recommended sales promotion information of the recommended store.

FIG. 15 is a sequence diagram showing the flow of usage history registration processing according to the second embodiment. First, the store terminal 400 of the first store takes an image of the user when the user performs facial payment for using the first store (S530). Next, the store terminal 400 transmits a face payment request to the server 200 (S531). The face payment request may include a face image generated by photographing and usage information related to face payment. Then, in the information processing system 1000, processing similar to S512 to S514 is executed.

The usage history registration unit 247 of the server 200 that has received the face authentication result executes payment processing with the store terminal 400 (S535). At this time, the usage history registration unit 247 of the server 200 designates the billing destination as the user. Then, the usage history registration unit 247 of the server 200 registers the usage information as a usage history in the usage history DB 215 in association with the user ID included in the face authentication result (S536).

The information provision request in S511 of FIG. 14 and the face payment request in S531 of FIG. 15 may include the user's face image captured at the same timing, or may use the face authentication result. Alternatively, in S511 of FIG. 14, the store terminal 400 may issue a face payment request together with the information provision request. In such a case, part or all of S530 to S531 in FIG. 15 and S512 to S514 in FIG. 15 may be omitted. As a result, various effects can be obtained, such as saving the trouble of photographing the user's face, reducing the processing load of the information processing system 1000, and suppressing an increase in the user's psychological burden for photographing.

As described above, according to the second embodiment, the server 200 provides the user visiting the first store with the sales promotion information of the store that has a business relationship with the first store according to the user's attributes and preferences. provided after being personalized based on Therefore, it becomes easy to retain customers by encouraging the users to visit the company's own group or the affiliated group of the stores visited while increasing the satisfaction of the users.

Here, in the second embodiment, the first selection unit 245 selects the recommended sales promotion information related to the recommended store based on the usage cycle of products or services used by the user in addition to the user information and usage history. good too. A usage cycle may be referred to as a purchase cycle.

FIG. 16 is a diagram for explaining the purchase cycle according to the second embodiment. The purchase cycle may be predetermined according to the type of product or the type of service. FIG. 16 shows an example of a purchase cycle when the first store visited by the user is a store that sells cosmetics, and server 200 recommends cosmetics to the user. The type of product (cosmetics) may be divided into major items and minor items representing the purpose of use or the site of use, and the purchase cycle may be determined based on at least one of the major items and minor items. As an example, the purchase cycle of a product whose major item is "base makeup" and whose minor item is "foundation" is "four months." On the other hand, the purchase cycle of a product whose major item is "eye makeup" and whose minor item is "eyeliner", "mascara" or "eyebrow" is "three months".

For example, if the user purchased an eyeliner with a three-month purchase cycle three months ago, the first selection unit 245 determines "eyeliner" as the proposed product type. Also, for example, if the user purchased eyeliner three months ago with a purchase cycle of three months, the first selection unit 245 selects the major item "eye makeup" to which the minor item "eyeliner" belongs, It may be determined as the type of product to be proposed.

Then, the first selection unit 245 selects, as the recommended sales promotion information, the sales promotion information regarding the eyeliner from among the sales promotion information regarding various products of the recommended stores. The promotional information about eyeliner may be, for example, information about new eyeliner products, word-of-mouth information, or discount information. Before selecting the recommended sales promotion information, the first selection unit 245 selects stores related to the cosmetics sales business in the same affiliated group as the visited store from among the stores having sales promotion information on eyeliner as recommended stores. good too. In this way, the first selection unit 245 determines the type of product to be proposed based on the purchase cycle and the timing of the previous purchase, and selects the recommended sales promotion information based on the determined type of product. As a result, the server 200 can provide information in accordance with the user's purchase cycle for each product type. The server 200 may transmit the recommended sales promotion information to the store terminal 400 or the user terminal 300 when the user visits the first store, or may transmit the information to the user terminal 300 regardless of whether the user has visited the store. may

Also, when selecting recommended stores and recommended sales promotion information, the first selection unit 245 may select recommended stores and recommended sales promotion information based on sale information of each store instead of or in addition to the usage cycle. .

The store terminal 400 may display the screen shown in FIG. 17 on the display unit 440 when receiving such recommended sales promotion information. FIG. 17 is a diagram showing an example of display on the store terminal 400 according to the fourth embodiment. The display unit 440 displays information on eye makeup sets and lipsticks that are on sale at the stores of the group α as recommended products for the user.
As a result, products or services on sale are preferentially introduced to the user.
In FIG. 17, an illustration of a person's face is displayed on the display unit 440, and information about the product is displayed in the person's face at a position corresponding to the use site of the product. The illustration of a person's face may be a user's registered image or a user's face image at the time of face authentication.

The above examples of FIGS. 16 and 17 are examples of providing sales promotion information for a store that provides cosmetics sales services, but the business field of the store is not limited to this. For example, when providing sales promotion information for a store that provides vehicle maintenance services, the first selection unit 245 selects the type of maintenance (for example, engine oil change or tire change) based on the timing of vehicle purchase or previous maintenance, and the maintenance cycle. ) may be determined. Then, the first selection unit 245 may select recommended sales promotion information based on the determined type of maintenance.

<Embodiment 3>
Next, Embodiment 3 of the present disclosure will be described. Embodiment 3 is characterized in that the server provides appropriate sales promotion information in consideration of the user's opportunity loss.
FIG. 18 is a block diagram showing the configuration of the server 200a according to the third embodiment. The server 200 a has basically the same configuration and functions as the server 200 . However, the server 200a differs from the server 200 in that it includes a storage unit 210a and a control unit 240a instead of the storage unit 210 and the control unit 240. FIG.

The storage unit 210a stores a program 211a instead of the program 211 and a user DB 212a instead of the user DB 212. The program 211a is a computer program in which the processing of the information processing method according to the third embodiment is implemented.

The user DB 212a further stores opportunity loss information 2123 in association with the user ID 2121. The opportunity loss information 2123 is information indicating that the user visited a predetermined store but did not use the store. For example, the opportunity loss information may indicate an opportunity loss rate obtained by dividing the number of times a predetermined store is used by the number of times the predetermined store is visited. Further, for example, the opportunity loss information may indicate an opportunity loss rate when the user who visited the store is specified but the fact that the user visited the store is not recorded.

Here, various methods may be taken as a method of specifying a user who has visited the store. In Embodiment 3, the following "Method 1" is adopted, but the present invention is not limited to this, and "Method 2" or "Method 3" may be adopted.
(Method 1)
For example, when the user visits the first store, the user terminal 300 is configured to transmit the user's facial image or facial feature information taken in advance to the store terminal 400 by short-range wireless communication. The short-range wireless communication may be Bluetooth® or BLE (Bluetooth Low Energy). The shop terminal 400 then transmits to the server 200a a store visit record request including the acquired face image or face feature information. The server 200a specifies the user who has visited the store by controlling the face authentication device 100 to perform face authentication based on the user's face area.
(Method 2)
The user terminal 300 may be configured to transmit the user ID registered in the user terminal 300 in advance to the store terminal 400 by short-range wireless communication when the user visits the first store. In this case, the store terminal 400 transmits a store visit record request including the user ID to the server 200a, whereby the server 200a identifies the user who visited the store.
(Method 3)
The server 200a may identify the user who has visited the store by face authentication using the camera 410 of the store terminal 400, similar to face authentication at the time of information provision or face payment. The camera 410 of the store terminal 400 at this time may be installed in a place other than the cash register of the store.
By adopting "Method 1", "Method 2", or "Method 3", it is possible to record the fact that the user has visited the store even if the user does not visit the cashier of the store, so that the opportunity loss can be easily calculated.

The control unit 240a has an opportunity loss calculation unit 248 and a first selection unit 245a instead of the first selection unit 245.

The opportunity loss calculator 248 is also called an opportunity loss calculator. First, the opportunity loss calculator 248 acquires or generates store visit information indicating that the user has visited the first store from the store visit record request. The store visit information may include a user ID, information on the date and time the user visited the store, and the ID of the store visited.
When "Method 1" or "Method 3" is adopted, the store visit record request may include a facial image or facial feature information, information on the date and time when the user visited the store, and the ID of the store where the user visited the store. In this case, the opportunity loss calculation unit 248 identifies the user ID included in the store visit information from the result of face authentication based on the user's face area, and generates store visit information by matching the user ID with the date and time information and the store ID. On the other hand, when "Method 2" is adopted, the store visit record request may include the user ID, information on the date and time the user visited the store, and the ID of the store where the user visited the store. Then, the opportunity loss calculation unit 248 acquires the store visit record request as it is as store visit information.

Note that the opportunity loss calculation unit 248 may store store visit information as store visit history in the storage unit 210a in association with the user. The visit history may be information included in the user information of the user DB 212 .

Then, the opportunity loss calculation unit 248 generates opportunity loss information from the user's visit history and usage history. For example, the opportunity loss calculator 248 calculates the number of visits to a predetermined store (number of visits) and the number of times of use of the predetermined store (number of uses). The number of times of use may simply be the number of times of use history relating to a predetermined store, or may be the number of times of use history recorded as being used within a predetermined time period from the time of the user's visit to the store. Then, the opportunity loss calculator 248 generates the user's opportunity loss information based on the number of visits and the number of uses. The opportunity loss calculator 248 registers the generated opportunity loss information in the user DB 212 in association with the user ID.

The first selection unit 245a selects recommended sales promotion information related to the recommended store based on the user's opportunity loss information in addition to the user information, the user's usage history and the relationship information 214. For example, for a user who visits a particular store many times but uses it less, it is conceivable that the user is interested in the product or service of that store but has not yet purchased it. Therefore, the first selection unit 245a may preferentially select, as recommended sales promotion information, discount information that encourages purchase of products from a specific store. Further, for example, a user who visits a plurality of shops many times in total but uses them few times may have a personality of wanting to carefully examine the content of the product before purchasing it. Therefore, the first selection unit 245a may preferentially select the detailed information of the product that the user is interested in as the recommended sales promotion information.

In this manner, the first selection unit 245a analyzes the user's situation and personality based on the opportunity loss information and utilizes it for selecting sales promotion information to be provided. can provide.

Here, the opportunity loss calculation processing by the opportunity loss calculation unit 248 will be described. 19 is a sequence diagram illustrating a flow of opportunity loss calculation processing according to the third embodiment; FIG. First, when the user visits the first store, the user terminal 300 transmits the face image of the user stored in advance in the storage unit 320 of the user terminal 300 to the store terminal 400 by short-range wireless communication (S541). ).

The store terminal 400 transmits a visit record request to the server 200a in response to receiving the user's face image from the user terminal 300 (S542). The store visit record request may include the date and time of the visit, the user's face image, and the store ID.

When the server 200a receives a store visit record request, the same processes as S512 to S514 are executed. As a result, the opportunity loss calculation unit 248 of the server 200a can acquire store visit information including the user ID, visit date and time, and store ID in order to identify the user ID.

The opportunity loss calculation unit 248 of the server 200a that has received the face authentication result records the store visit information in the user DB 212 as the user's store visit history (S545). The opportunity loss calculator 248 generates opportunity loss information based on the usage history of the usage history DB 215 and the visit history of the user DB 212 (S546). Then, the opportunity loss calculator 248 updates the opportunity loss information corresponding to the user ID in the user DB 212 (S547).

<Embodiment 4>
Next, Embodiment 4 of the present disclosure will be described. In Embodiment 4, the first store visited by the user is a store that provides services related to beauty, such as a store that sells cosmetics. In the fourth embodiment, the server personalizes product information related to cosmetics or information on preferential treatment of products related to cosmetics to the user, and then provides the user with the information as recommended sales promotion information.

FIG. 20 is a block diagram showing the configuration of the server 200b according to the fourth embodiment. The server 200b differs from the server 200 in that it includes a storage unit 210b and a control unit 240b instead of the storage unit 210 and the control unit 240. FIG.

The storage unit 210b stores a program 211b instead of the program 211. The program 211b is a computer program in which the processing of the information processing method according to the fourth embodiment is implemented.

The control unit 240b has a face state generation unit 249 and a first selection unit 245b instead of the first selection unit 245.

The face state generation unit 249 is also called face state generation means. The face state generation unit 249 generates face state information from the user's face image acquired by the image acquisition unit 242 . The face condition information is information about the condition of the user's face, and includes, for example, information about skin color, skin moisture content, pore condition, or skeleton. The user's face image used for generating face state information is also used for face authentication for identifying the user.

The first selection unit 245b selects recommended sales promotion information related to the recommended store based on the face state information generated by the face state generation unit 249 in addition to the user information, usage history and relationship information 214.

FIG. 21 is a sequence diagram showing the flow of information provision processing according to the fourth embodiment. The steps shown in FIG. 21 have S600 to S601 instead of S518 shown in FIG.

At S600, the face state generation unit 249 of the server 200b generates face state information based on the face image included in the information provision request acquired at S511. The face state generator 249 supplies the face state information to the first selector 245b.

Next, the first selection unit 245b of the server 200b selects recommended sales promotion information from the recommended store sales promotion information stored in the store information DB 213 (S601). At this time, in addition to the usage history of the user extracted in S515 and the user information associated with the user ID in the user DB 212, face state information is used as a basis for selection. Next, the output control unit 246 transmits the recommended sales promotion information of the recommended store to the store terminal 400 of the first store (S519). The store terminal 400 displays the recommended sales promotion information of the recommended store on the display unit 440 (S520).

In the above description, face condition information is used as the basis for selecting recommended sales promotion information, but instead of or in addition to this, face condition information may be used as the basis for selecting recommended stores.

FIG. 22 is a diagram showing an example of the display of the store terminal 400 according to the fourth embodiment. For example, the face condition generation unit 249 generates face condition information indicating that the skin has a low moisture content and is dry, based on the texture and color of the user's skin. Then, the first selection unit 245b selects, as recommended sales promotion information, information on products with a high moisturizing effect sold by stores belonging to the affiliated group or affiliated group of the first store. The store terminal 400 then displays the recommended sales promotion information on the display unit 440 . In FIG. 22, the store terminal 400 displays on the display unit 440 information about moist type cosmetic sets belonging to group β affiliated with group α, which is an affiliated group of the first store. there is

In this way, the server 200b uses the face image for face authentication to grasp the current state of the user's face, and uses the current state of the user's face to select information to be provided. Therefore, the server 200b can provide appropriate information according to the user's situation, thereby improving the user's satisfaction. This makes it easier to enclose users.

<Embodiment 5>
Next, Embodiment 5 of the present disclosure will be described. In Embodiment 5, the first store visited by the user is a store that provides vehicle services, such as a store that sells vehicles. The server provides the user with information on the vehicle service or special treatment information on the vehicle service after personalizing the information for the user. In the fifth embodiment, regardless of whether the user visits the first store or not, the server transmits information about stores that can perform maintenance to the user terminal when receiving a request for maintenance from the user terminal. As a result, for example, when a user breaks down while traveling in a vehicle, it is possible to easily know the existence of a nearby store where maintenance can be performed. In addition, for example, when the user moves after purchasing the vehicle, the user can easily know the store near the home where maintenance is possible.

FIG. 23 is a block diagram showing the configuration of the server 200c according to the fifth embodiment. The server 200 c has basically the same configuration and functions as the server 200 . However, the server 200c differs from the server 200 in that it includes a storage unit 210c and a control unit 240c instead of the storage unit 210 and the control unit 240. FIG.

The storage unit 210c stores a program 211c, a user DB 212c and a store information DB 213c instead of the program 211, user DB 212 and store information DB 213. The program 211c is a computer program in which the processing of the information processing method according to the fifth embodiment is implemented. User DB 212c further stores contract information 2124 in association with user ID 2121 .

The contract information 2124 is information related to the contract related to the user's vehicle, which the user has concluded. FIG. 24 is a diagram showing an example of the data structure of contract information 2124 according to the fifth embodiment. The contract information 2124 records the contract information of the user for each user ID. For example, the contract information includes contract date, contracted store, affiliated group, and contract details. As an example, the user's record for April 1, 2021 includes the fact that the vehicle was purchased at a group α affiliated store A, and the benefit of free repairs for electrical failures for two years at affiliated group α stores. It is recorded that there is

Return to Fig. 23 and continue the explanation. The store information DB 213c further stores available maintenance 2134 in association with the store ID 2131 . The available maintenance 2134 indicates the type of maintenance that the store can currently handle based on the store's parts inventory information, availability of work hours, and the like.

The control unit 240 c has a vehicle state acquisition unit 250 , a contract identification unit 251 and a second selection unit 252 in addition to the configuration of the control unit 240 .

The vehicle state acquisition unit 250 is also called vehicle state acquisition means. The vehicle state acquisition unit 250 receives a vehicle maintenance request from the user terminal 300 . For the maintenance request, the user's identification information, the user's vehicle condition information, and the user's location information are acquired. As described above, vehicle status information may indicate, for example, that a particular part of the vehicle has failed, that a particular function has failed, or that a particular function is malfunctioning. The vehicle state acquisition unit 250 supplies the vehicle state information and the user's location information to the second selection unit 252 .

In Embodiment 5, the identity verification information is the user's facial image or facial feature information, but it may be a user ID instead. When the personal identification information is a face image or facial feature information, the vehicle state acquisition unit 250 supplies the personal identification information to the user identification unit 243 . Thereby, the user identification unit 243 controls face authentication to identify the user.

The contract identification unit 251 is also called contract identification means. Contract identification unit 251 identifies contract information when user identification unit 243 identifies the user who requested maintenance. Then, the contract identification unit 251 identifies the contracted store included in the contract information.

The second selection unit 252 is also called second selection means. The second selection unit 252 selects, as a recommended shop, at least one of the candidate shops, which are shops capable of performing maintenance corresponding to the vehicle condition.

For example, the second selection unit 252 first identifies the type of maintenance based on the vehicle state information.
Next, the second selection unit 252 determines whether or not each shop can perform maintenance corresponding to the vehicle condition based on the maintenance 2134 that can be handled registered in the shop information DB 213c for each of the plurality of shops. . In other words, the second selection unit 252 identifies a candidate shop that can perform maintenance corresponding to the vehicle condition based on the inventory information of parts corresponding to the type of maintenance, availability of work hours, and the like.

Then, the second selection unit 252 selects a recommended store from the candidate stores based on the information about the contracted store included in the contract information and the user's location information. The information about the contracted store may include at least the contracted store name and the location information of the contracted store. For example, the second selection unit 252 selects a recommended store from the candidate stores based on relationship information between each of the plurality of stores and the contracted store and location information of the user. For example, the second selection unit 252 preferentially selects, as a recommended store, stores in affiliated groups of contracted stores or affiliated groups thereof among candidate stores in the vicinity of the user's current location. As a result, it is possible to promote the use of affiliated groups or affiliated groups of contracted stores with transaction histories when maintenance is necessary while ensuring convenience on the user side. Therefore, it becomes easy to enclose the user.

Also, the second selection unit 252 may select a recommended store from the candidate stores based on the contract details and the user's location information in addition to or instead of the information on the contracted store. For example, the second selection unit 252 preferentially selects, as a recommended store, a store at which the contracted service or payment can be received from the candidate stores around the user's current location. As a result, the user can easily grasp the stores that are profitable for him/herself, so that the user's satisfaction is improved.

The output control unit 246 then outputs the information related to the selected recommended shop to the user terminal 300 that requested the maintenance. The information related to the recommended store includes basic information and sales promotion information of the recommended store.

FIG. 25 is a sequence diagram showing the flow of information provision processing according to the fifth embodiment. First, the user terminal 300 transmits a maintenance request to the server 200c (S701). The maintenance request includes user location information, vehicle status information, and a face image of the user as identity verification information. Accordingly, the vehicle state acquisition unit 250 of the server 200c acquires various information included in the maintenance request. Next, the information processing system 1000 executes processing similar to S512 to S514. Thereby, the user identification unit 243 of the server 200c identifies the user ID of the user.

Next, the contract identification unit 251 of the server 200c refers to the user DB 212c and identifies the contract information 2124 associated with the user ID (S702). Next, the second selection unit 252 of the server 200c identifies the type of maintenance based on the vehicle state information (S703). Next, the second selection unit 252 identifies a candidate store that can perform maintenance based on the type of maintenance and the available maintenance 2134 registered in the store information DB 213c (S704). Next, the second selection unit 252 selects a recommended store from the candidate stores based on at least the contract information 2124 and the location information (S705). Then, the output control unit 246 of the server 200c transmits information related to the recommended store to the user terminal 300 (S706). The user terminal 300 displays information related to the recommended store on the display unit 340 (S707).

FIG. 26 is a diagram showing an example of display on the user terminal 300 according to the fifth embodiment. For example, on the display unit 340 of the user terminal 300, the user's current location and the locations of shops recommended for maintenance are displayed on a map. The user terminal 300 may further display route information from the user's current location to a recommended shop for maintenance.

Here, when the user visits the first store, the server 200c may share the user's contract information with the store terminal 400 of the first store. In this case, the contract identification unit 251 identifies a contract related to the vehicle of the user identified by the user identification unit 243, and the output control unit 246 transmits contract information related to the contract to the store terminal 400 of the first store. Output. The output control unit 246 may also output the user information of the user identified by the user identification unit 243 to the store terminal 400 of the first store.

FIG. 27 is a sequence diagram showing the flow of information sharing processing according to the fifth embodiment. In FIG. 27, as an example, when the user visits the first store, the server 200c records the visit and transmits the contract information and the user information to the store terminal 400. FIG. Specifically, first, the same processes as S541 to S542, S512 to S514 and S545 described above are executed. Then, the contract identification unit 251 of the server 200c refers to the user DB 212c and acquires user information and contract information associated with the user ID from the user DB 212c (S711). Then, the output control unit 246 of the server 200c transmits the user information and the contract information to the store terminal 400 (S712).

Therefore, even if the customer visits a store other than the store with which the customer has made transactions in the past, the user information or contract information can be easily handed over to the first store visited. If the business relationship between the contracted store of the user and the visited first store is distant, the output control unit 246 of the server 200c transmits the user information or the contract information to the store terminal of the first store. 400 does not have to be sent. In other words, the output control unit 246 of the server 200c transfers the user information or the contract information to the first store based on the relationship information indicating the business relationship between the user's contracted store and the visited first store. It may be determined whether or not to transmit to the shop terminal 400 . At this time, the output control unit 246 may restrict or prohibit transmission of the user information or the contract information to the store terminal 400 of the first store when the degree of relationship is less than the predetermined threshold. As a result, it is possible to facilitate information sharing between stores while taking into account business risks due to information sharing.

<Other Embodiment 1>
In the second embodiment described above, the server 200 executes the face settlement process after designating the billing destination for the use of the store as the user (for example, S535 in FIG. 15). However, instead of this, the server 200 determines whether or not to charge for use of the store, or the billing destination or the billing amount, based on the relationship between the company to which the user belongs and the first store. you can For example, it is assumed that the company to which the user belongs has concluded a corporate contract with a first store regarding a subscription service for employees of the company as part of its welfare program. In this case, the server 200 does not charge the user for using the store. Instead, the server 200 bills the company to which the user belongs for the usage fee of the subscription service. Also, for example, assume that the company to which the user belongs has concluded a corporate contract with the first store under which the company bears part of the amount spent by employees of the company. In this case, the server 200 bills the company for a portion of the charges for using the store and the rest to the user.

In order to realize the processing based on the relationship between the company to which the user belongs and the first store as described above, the user DB 212 of the storage unit 210 of the server 200 stores the user's affiliation in association with the user ID. A company ID may be stored. The storage unit 210 of the server 200 may further store information on corporate contracts between each company and each store.

In addition, even when the user's family visits the first store, the server 200 charges a fee for using the store based on the relationship between the company to which the user belongs and the first store. or whether or not to be billed or the amount to be billed. In this case, in the user DB 212 of the storage unit 210 of the server 200, the user ID of the user and the user ID of the user's family may be linked.

In this way, by making it possible to execute face payment processing in consideration of the details of corporate contracts, it becomes possible to apply the information processing system 1000 to a new business model of BtoBtoE.

In the above-described embodiment, the hardware configuration is described, but it is not limited to this. The present disclosure can also implement arbitrary processing by causing a processor to execute a computer program.

In the above examples, the program includes instructions (or software code) that, when read into a computer, cause the computer to perform one or more of the functions described in the embodiments. The program may be stored in a non-transitory computer-readable medium or tangible storage medium. By way of example, and not limitation, computer readable media or tangible storage media may include random-access memory (RAM), read-only memory (ROM), flash memory, solid-state drives (SSD) or other memory technology, CDs - ROM, digital versatile disc (DVD), Blu-ray disc or other optical disc storage, magnetic cassette, magnetic tape, magnetic disc storage or other magnetic storage device. The program may be transmitted on a transitory computer-readable medium or communication medium. By way of example, and not limitation, transitory computer readable media or communication media include electrical, optical, acoustic, or other forms of propagated signals.

It should be noted that the present disclosure is not limited to the above embodiments, and can be modified as appropriate without departing from the scope. For example, embodiments 3 and 4 or embodiments 3 and 5 can be combined.

For example, in the above-described embodiments, face authentication is used as a user identification means, but fingerprint, iris, palm, vein authentication, gait, or other biometric authentication may be used instead of face authentication. In this case, the store terminal 400 transmits the captured image of the user captured by the store terminal 400 and the biometric information read by the store terminal 400 to the face authentication device 100 (biometric authentication device) via the server 200. A user ID may be specified by biometric authentication with 100 specified. The identified user ID is returned to server 200 .

Also, in the above-described embodiment, the face authentication device 100 has the face authentication function, but instead of or in addition to the face authentication device 100, the server 200 may have the face authentication function.

Some or all of the above-described embodiments can also be described in the following supplementary remarks, but are not limited to the following.
(Appendix A1)
an image acquiring means for acquiring a photographed image of a user who has visited the first store;
user identifying means for identifying the user based on the captured image;
related to at least one store among the plurality of stores based on user information related to the user and relationship information indicating a business relationship between each of the plurality of stores and the first store; selection means for selecting at least one promotional information to be the recommended promotional information associated with the recommended store;
and output control means for outputting the recommended sales promotion information.
(Appendix A2)
The user information includes at least one of attribute information of the user, information indicating the preference of the user, and usage history indicating that the user has used one of the plurality of stores. The information processing device according to A1.
(Appendix A3)
The selection means is
selecting the at least one store as the recommended store from the plurality of stores based on the relationship information;
The information processing apparatus according to appendix A1 or A2, wherein the at least one piece of sales promotion information is selected as the recommended sales promotion information from a plurality of sales promotion information related to the recommended store based on the user information.
(Appendix A4)
a face state generating means for generating face state information regarding the state of the user's face from the photographed image;
The information processing according to any one of Appendices A1 to A3, wherein the selection means selects the recommended sales promotion information related to the recommended store based on the user information, the relationship information, and the facial state information. Device.
(Appendix A5)
The information processing apparatus according to any one of appendices A1 to A3, wherein the recommended store operates in a different type of business from the first store.
(Appendix A6)
The selection means selects the recommended sales promotion information related to the recommended store based on a cycle corresponding to the type of product purchased by the user or a cycle corresponding to the type of service used by the user. The information processing device according to any one of A5.
(Appendix A7)
Store visit information indicating that the user has visited the first store is acquired, and based on the number of times the user has visited the first store and the number of times the user has used the first store, Further comprising opportunity loss calculation means for generating opportunity loss information,
The selection means selects the recommended sales promotion information related to the recommended store based on the user information, the relationship information, and the opportunity loss information of the user. information processing equipment.
(Appendix A8)
The selection means selects based on the amount of money spent by the user in the group to which the first store belongs or the frequency of visits of the user to one or more stores belonging to the group. The information processing apparatus according to any one of Appendices A1 to A7, which adjusts the amount or quality of information.
(Appendix A9)
an information processing device;
a terminal that provides information to the user who visited the first store;
The information processing device is
an image acquisition means for acquiring a photographed image of the user who visited the first store;
user identifying means for identifying the user based on the captured image;
related to at least one store among the plurality of stores based on user information related to the user and relationship information indicating a business relationship between each of the plurality of stores and the first store; selection means for selecting at least one promotional information to be the recommended promotional information associated with the recommended store;
An information processing system comprising output control means for outputting the recommended sales promotion information to the terminal.
(Appendix A10)
The information processing system according to appendix A9, further comprising a biometric authentication device that acquires the captured image from the terminal and performs biometric authentication using the captured image.
(Appendix A11)
Acquiring a photographed image of a user who has visited the first store,
identifying the user based on the captured image;
related to at least one store among the plurality of stores based on user information related to the user and relationship information indicating a business relationship between each of the plurality of stores and the first store; selecting at least one promotional information as a recommended promotional information associated with the recommended store;
An information processing method for outputting the recommended sales promotion information.
(Appendix A12)
an image acquisition process for acquiring a photographed image of a user who has visited the first store;
user identification processing for identifying the user based on the captured image;
related to at least one store among the plurality of stores based on user information related to the user and relationship information indicating a business relationship between each of the plurality of stores and the first store; a selection process of selecting at least one promotional information to be the recommended promotional information associated with the recommended store;
A non-transitory computer-readable medium storing a program for causing a computer to execute an output control process for outputting the recommended sales promotion information.
(Appendix B1)
contract identifying means for identifying a contract related to the user's vehicle when information about the state of the user's vehicle and location information of the user are obtained from a user terminal used by the user;
selection means for selecting, as a recommended store, at least one of stores capable of maintenance corresponding to the state based on information about the contracted store, which is the store with which the contract has been made, and location information of the user; ,
and output control means for outputting information related to the recommended store to the user terminal.
(Appendix B2)
The information processing apparatus according to Appendix B1, wherein the contracted store includes a store where the user purchased, rented, or leased the vehicle.
(Appendix B3)
The selection means selects a store capable of maintenance corresponding to the state based on relationship information indicating a business relationship between each of the plurality of stores and the contracted store and location information of the user. The information processing apparatus according to appendix B1 or B2, wherein the recommended store is selected from.
(Appendix B4)
The selection means selects the recommended shop from shops capable of performing maintenance corresponding to the condition based on the information on the contracted shop, the location information of the user, and the contract details on the vehicle. The information processing device according to any one of B3.
(Appendix B5)
The selection means is
Identifying the type of maintenance based on the information about the state,
The information processing according to any one of appendices B1 to B4, for each of a plurality of stores, determining whether or not maintenance corresponding to the state is possible based on inventory information of parts corresponding to the type of maintenance. Device.
(Appendix B6)
an image acquiring means for acquiring a photographed image of a user who has visited the first store;
User identification means for identifying a user based on the captured image,
The contract identifying means identifies a contract related to the vehicle of the identified user,
The information processing apparatus according to any one of appendices B1 to B5, wherein the output control means outputs contract information related to the contract to a terminal of the first store.
(Appendix B7)
an information processing device;
and a user terminal used by the user,
The information processing device is
contract identifying means for identifying a contract related to the vehicle of the user when information about the state of the user's vehicle and location information of the user are obtained from the user terminal;
selection means for selecting, as a recommended store, at least one of stores capable of maintenance corresponding to the state based on information about the contracted store, which is the store with which the contract has been made, and location information of the user; ,
An information processing system comprising output control means for outputting information related to the recommended store to the user terminal.
(Appendix B8)
When information about the state of the user's vehicle and the location information of the user are obtained from a user terminal used by the user, identifying a contract related to the vehicle of the user,
selecting at least one store as a recommended store from among stores capable of performing maintenance corresponding to the state, based on information about the contracted store, which is the store with which the contract has been made, and location information of the user;
An information processing method for outputting information related to the recommended store to the user terminal.
(Appendix B9)
Contract identification processing for identifying a contract related to the vehicle of the user when information about the state of the user's vehicle and location information of the user are obtained from a user terminal used by the user;
a selection process of selecting at least one store as a recommended store from among stores capable of maintenance corresponding to the state, based on information about the contracted store, which is the store with which the contract has been made, and location information of the user; ,
A non-temporary computer-readable medium storing an output control process for outputting information related to the recommended store to the user terminal and a program for causing a computer to execute the information.

10, 200, 200a, 200b, 200c Information processing device (server)
15 selection unit 100 face authentication device 110 face information DB
111 User ID
112 facial feature information 120 face detection unit 130 feature point extraction unit 140 registration unit 150

authentication unit

210,

210a storage unit

211, 211a, 211b,

211c program

212, 212a, 212c user DB
2121 User ID
2122 User information 2123 Opportunity loss information 2124 Contract information 213, 213c Store information DB
2131 Store ID
2132 affiliated group 2133 sales promotion information 2134 available maintenance 214 related information 215 usage history DB
2151 User ID
2152 usage history 220 memory 230

communication unit

240, 240a, 240b, 240c control unit 241 user

information registration unit

12, 242

image acquisition unit

13, 243 user identification unit 244 usage

history extraction unit

245, 245a, 245b

first selection unit

16, 246 output control unit 247 usage history registration unit 248 opportunity loss calculation unit 249 face state generation unit 250 vehicle state acquisition unit 251 contract identification unit 252 second selection unit 300 user terminal 310 camera 320 storage unit 330 communication unit 340 display unit 350 input unit 360 control unit 400 store terminal 410 camera 420 storage unit 430 communication unit 440 display unit 450 input unit 460 control unit 1000 information processing system

Claims

an image acquiring means for acquiring a photographed image of a user who has visited the first store;
user identifying means for identifying the user based on the captured image;
related to at least one store among the plurality of stores based on user information related to the user and relationship information indicating a business relationship between each of the plurality of stores and the first store; selection means for selecting at least one promotional information to be the recommended promotional information associated with the recommended store;
and output control means for outputting the recommended sales promotion information.
The user information includes at least one of attribute information of the user, information indicating the preference of the user, and a usage history indicating that the user has used one of the plurality of stores. Item 1. The information processing apparatus according to item 1.
The selection means is
selecting the at least one store as the recommended store from the plurality of stores based on the relationship information;
The information processing apparatus according to claim 1 or 2, wherein said at least one piece of sales promotion information is selected as said recommended sales promotion information from a plurality of pieces of sales promotion information related to said recommended store based on said user information.
a face state generating means for generating face state information regarding the state of the user's face from the photographed image;
The information according to any one of claims 1 to 3, wherein the selection means selects the recommended sales promotion information related to the recommended store based on the user information, the relationship information, and the face condition information. processing equipment.
The information processing apparatus according to any one of claims 1 to 3, wherein the recommended store operates in a different type of business from the first store.
2. The selection means selects the recommended sales promotion information related to the recommended store based on a cycle corresponding to a type of product purchased by the user or a cycle corresponding to a type of service used by the user. 6. The information processing device according to any one of items 1 to 5.
Store visit information indicating that the user has visited the first store is acquired, and based on the number of times the user has visited the first store and the number of times the user has used the first store, Further comprising opportunity loss calculation means for generating opportunity loss information,
7. The selection means selects the recommended sales promotion information related to the recommended store based on the user information, the relationship information, and the opportunity loss information of the user. The information processing device described.
The selection means selects based on the amount of money spent by the user in the group to which the first store belongs or the frequency of visits of the user to one or more stores belonging to the group. The information processing apparatus according to any one of claims 1 to 7, wherein the amount or quality of information is adjusted.
an information processing device;
a terminal that provides information to the user who visited the first store;
The information processing device is
an image acquisition means for acquiring a photographed image of the user who visited the first store;
user identifying means for identifying the user based on the captured image;
related to at least one store among the plurality of stores based on user information related to the user and relationship information indicating a business relationship between each of the plurality of stores and the first store; selection means for selecting at least one promotional information to be the recommended promotional information associated with the recommended store;
An information processing system comprising output control means for outputting the recommended sales promotion information to the terminal.
The information processing system according to claim 9, further comprising a biometric authentication device that acquires the captured image from the terminal and performs biometric authentication using the captured image.
Acquiring a photographed image of a user who has visited the first store,
identifying the user based on the captured image;
related to at least one store among the plurality of stores based on user information related to the user and relationship information indicating a business relationship between each of the plurality of stores and the first store; selecting at least one promotional information as a recommended promotional information associated with the recommended store;
An information processing method for outputting the recommended sales promotion information.
an image acquisition process for acquiring a photographed image of a user who has visited the first store;
user identification processing for identifying the user based on the captured image;
related to at least one store among the plurality of stores based on user information related to the user and relationship information indicating a business relationship between each of the plurality of stores and the first store; a selection process of selecting at least one promotional information to be the recommended promotional information associated with the recommended store;
A non-transitory computer-readable medium storing a program for causing a computer to execute an output control process for outputting the recommended sales promotion information.