WO2018230356A1 - Information presentation system - Google Patents

Abstract

This information presentation system (10) is provided with: a product identification information acquisition device (100) which acquires, from each of a plurality of products that are sequentially grasped by a customer who is shopping, identification information for identifying the products in a real shop; a profiling server (200) which acquires, as purchase candidate information, a result obtained by identifying each of the plurality of products by using the identification information acquired from the product identification information acquisition device (100), acquires customer profile information that indicates a customer's psychological state estimated on the basis of at least a part of the purchase candidate information, and acquires sales section-related information for reflecting the customer profiling information to the sales section of the real shop; and an information presentation device (300) which acquires and presents the sales section-related information.

Description

Information presentation system

The present invention relates to a technique for presenting information related to customers in retail stores.

In a retail store such as a supermarket, a shopping cart or the like having a display for presenting special sales information at the store to a shopper is proposed (see Patent Document 1).

JP 2004-106827 A

However, the information provided on the display of Patent Document 1 may be useless on the spot for each shopper visiting the store for various purposes. In this case, the shopper's interest is not paid to the information displayed on the display, and a mechanism including a shopping cart capable of providing such information is not effectively utilized.

Therefore, the present invention provides an information presentation system that presents more useful information according to each customer.

An information presentation system according to an aspect of the present invention provides a product identification information acquisition unit that acquires identification information for identifying a product from each of a plurality of products that are sequentially held by a customer who is shopping in an actual store. When the identification information is acquired from the product identification information acquisition unit, a result obtained by identifying each of the plurality of products using the identification information is acquired as purchase candidate information, and based on at least a part of the purchase candidate information Profiling server that acquires customer profile information indicating the estimated psychological state of the customer and identifies the sales floor related information for reflecting the customer profile information to the sales floor of the actual store, and information presentation that acquires and presents the sales floor related information Device.

Note that these comprehensive or specific aspects may be realized by a system, a method, an integrated circuit, a computer program, or a recording medium such as a computer-readable CD-ROM, and the system, method, integrated circuit, and computer program. Also, any combination of recording media may be realized.

The information presentation system of the present invention can present more useful information according to each customer.

FIG. 1 is a block diagram showing a configuration of an information presentation system in the embodiment. FIG. 2A is a diagram illustrating an example of a product holder in the embodiment. FIG. 2B is a diagram illustrating another example of the product holder in the embodiment. FIG. 2C is a diagram illustrating another example of the product holder in the embodiment. FIG. 2D is a diagram illustrating an example of the information presentation device in the embodiment. FIG. 3A is a diagram illustrating a concept of the evaluation grid method (registered trademark). FIG. 3B is a diagram illustrating an example of a deep psychological model in the embodiment. FIG. 3C is a diagram illustrating another example of the deep psychological model in the embodiment. FIG. 4 is a sequence diagram for explaining a procedure of an operation example of the information presentation system in the embodiment. FIG. 5 is a diagram for explaining a concept of a procedure for product identification from transmission of product identification information in the embodiment. FIG. 6 is an example of a screen presented to the customer by the information presentation device in the embodiment. FIG. 7 is a sequence diagram for explaining another example of the procedure of the operation example of the information presentation system in the embodiment. FIG. 8 is a sequence diagram for explaining still another example of the procedure of the operation example of the information presentation system in the embodiment. FIG. 9 is a sequence diagram for explaining still another example of the procedure of the operation example of the information presentation system in the embodiment.

(Background to obtaining one embodiment of the present invention)
The present inventor has found that the following problems occur with respect to a shopping cart including a display described in the “Background Art” section.

The information displayed on the display of the shopping cart is an extension of an electronic version of a newspaper insert, which is a dynamic change that changes over time. However, a product that a customer visiting a store seeks is not necessarily a product that is placed in an advertisement. Therefore, the information displayed on such a display is perceived as information that is not of interest to oneself depending on the customer, and may have the impression that attention is not paid or is bothersome.

On the other hand, as a method of sales promotion tailored to each customer's purpose of visit or store usage, the customer may be interested based on the information on the purchased products read at the time of payment with the POS (point of sales) system There has been proposed a method of issuing discount coupons for highly productive products. However, some customers forget or lose this discount coupon before the next visit. Further, the customer does not necessarily want the target product during the validity period of the discount ticket. Because of this background, the response rate to this discount ticket is unlikely to rise to a certain extent.

As described above, the provision of information to customers and the use of information related to customers in retail stores have not produced sufficient beneficial effects for both customers and store operators.

In order to solve such a problem, an information presentation system according to an aspect of the present invention is for identifying a product from each of a plurality of products that are sequentially held by a customer who is shopping at an actual store. When acquiring the product identification information acquisition device for acquiring the identification information and the identification information from the product identification information acquisition device, the result obtained by identifying each of the plurality of products using the identification information is acquired as purchase candidate information, A profiling server that acquires customer profile information indicating a customer's psychological state estimated based on at least a part of purchase candidate information, and identifies sales floor related information for reflecting the customer profile information in the sales floor of the actual store, and a sales floor And an information presentation device that acquires and presents related information.

This makes it possible to obtain a store configuration according to the customer's psychological state in the store. In such stores, it is easy to improve the quality of the customer's shopping experience, and an increase in store sales can also be expected.

For example, the profiling server may acquire customer profile information using purchase candidate information indicating a predetermined number or type of items of merchandise from among the candidate purchase information in the order in which the customer started to hold slowly. In addition, for example, the profiling server may acquire the customer profile information using the purchase candidate information indicating the products whose purchase start time is within a predetermined retroactive time among the purchase candidate information.

This makes it possible to estimate a more accurate psychological state based on a product that is likely to be selected in a psychological state close to the current psychological state among the products held by the customer. In addition, it is possible to avoid using information on a product that has been held in a psychological state that is likely to be different from the customer's current psychological state for estimation of the current psychological state.

For example, the profiling server may acquire the customer profile information by using the purchase candidate information indicating the products whose purchase order is late among the purchase candidate information with a higher weight.

As a result, among products held by customers, products that are more likely to reflect the current psychological state of the customer are used with greater emphasis in estimating the psychological state, and a more accurate psychological state is used. Can be estimated.

For example, the profiling server is a customer profile that indicates the psychological state of other customers who have been at the sales floor within a predetermined time from the current time before the customer enters the actual store and starts holding a plurality of products. Other sales floor related information that has been specified to reflect the information on the sales floor may be transmitted to the information presentation device in order to present the customer.

This allows customers who have just entered each store to be presented with recommended products that reflect the psychological state of the customer base at that time. If this customer matches this customer segment, it is possible to present sales floor related information according to the psychological state from the early stage of shopping behavior.

For example, the sales floor related information may indicate a product that has been purchased in the above psychological state, and the information presentation device may present the sales floor related information to the customer at the sales floor of the actual store.

This makes it possible to present information for making a purchase proposal according to the customer's psychological state to the customer who is shopping at the sales floor. In other words, information on products that are likely to be of interest to the customer can be selected on the spot and provided to the customer. Therefore, the quality of the customer's shopping experience at this store can be further improved. In addition, further increase in store sales can be expected.

For example, the sales floor related information is information indicated by at least one of an image and a sound associated with the psychological state, and the information presentation device presents at least one of the image and the sound to the customer at the sales floor of the actual store. Related information may be presented.

This makes it possible to provide video or audio for production according to the customer's psychological state to customers shopping at the sales floor. And the quality of the customer's shopping experience at this store can be further improved.

For example, the product identification information acquisition device further detects the release of the product held by the customer and recognizes the product, and the profiling server acquires the return information on the released product from the product identification information acquisition device. Then, customer profile information may be acquired based on at least part of the purchase candidate information regarding the product that the customer has started to hold and return information.

This makes it possible to easily and accurately estimate the reason why the customer changed the candidate product to be purchased. The reason estimated in this way can be used as a material for studying the assortment of stores or the improvement or development of products of manufacturers, and can lead to an increase in sales of stores or manufacturers.

For example, the profiling server may acquire customer profile information using a deep psychological model created in advance by the evaluation grid method (registered trademark) for each product sold in a real store.

This makes it possible to estimate the psychological state of the customer at the time of purchasing each product, for example, the purpose of purchasing the product, based on the evaluation of each product actually performed by the consumer. Therefore, it is easy to obtain higher accuracy than the conventional estimation using POS data or registration information of store members.

For example, in the deep psychology model, there is a deep psychology model according to the sex and age of the customer sample, and the profiling server acquires personal attribute information indicating at least one of the sex and age of the customer, and the personal attribute information Customer profile information indicating a psychological state estimated using a deep psychological model corresponding to at least one of gender and age may be acquired.

Thereby, it is possible to execute an estimation that makes it easier to obtain higher accuracy according to customer attributes such as sex or age group for the above psychological state.

For example, the product identification information acquisition unit may be provided in a product holder for holding a product by placing the product on the customer.

In this way, by providing the product identification information acquisition device in the tool for placing the product selected and held by the customer in the actual store, the product is more natural and more reliable in the behavior of the customer during shopping. Information for identifying can be acquired.

For example, the information presentation device may include at least one of an information terminal that a customer carries or wears in an actual store and a digital signage installed in the actual store.

Thus, information according to the psychological state of the customer who is shopping while moving in the actual store can be more surely entered into the eyes of the customer.

Note that these comprehensive or specific aspects may be realized by a system, a method, an integrated circuit, a computer program, or a recording medium such as a computer-readable CD-ROM, and the system, method, integrated circuit, and computer program. Alternatively, it may be realized by any combination of recording media.

Hereinafter, embodiments will be specifically described with reference to the drawings. Each of the following embodiments shows a comprehensive or specific example. The numerical values, shapes, materials, constituent elements, arrangement positions and connection forms of the constituent elements, steps, order of steps, and the like shown below are merely examples, and are not intended to limit the present invention. In addition, among the constituent elements in the following embodiments, constituent elements that are not described in the independent claims indicating the highest concept are described as optional constituent elements.

(Embodiment 1)
[1. Configuration example]
The information presentation system in the embodiment will be described with reference to FIGS. 1 to 2D.

FIG. 1 is a block diagram showing a configuration of an information presentation system in the embodiment.

The information presentation system 10 in the embodiment is based on information on the behavior of a customer who is shopping, for example, in a self-service actual store (hereinafter also simply referred to as a store) in a retail business such as a supermarket or a convenience store. Propose purchases to customers.

“The self-service method here is widely used in retail stores as described above, and should be understood to basically satisfy the following conditions. One is that the customer can know the price of each product by setting a predetermined price such as a price tag or uniform for all products. In addition, customers can freely select products to be purchased from among the displayed products, and the selected products can be placed and held in a basket, cart, tray, etc., rented by the store, Or you can cancel the selection. Furthermore, the settlement of the purchased product is carried out by bringing the retained product to a checkout office equipped with a register near the exit.

However, the idea of the present invention can be applied even to stores where these conditions are not strictly met. These conditions are shown for the purpose of presenting a specific example of the situation in which the information presentation system of the present invention is used, and is not intended to limit the present invention. For example, the product to be purchased may be held using a bag brought by the customer, or may be simply held by hand. In addition, the settlement may be performed by a method that does not use a settlement office having a register. In addition, any of the above conditions is also included in the concept of the self-service method in the present disclosure even when assistance or management by store clerk is involved.

The information presentation system 10 includes a product identification information acquisition device 100, a profiling server 200, and an information presentation device 300.

The product identification information acquisition unit 100 acquires by reading identification information for identifying the product from each of a plurality of products that the customer who is shopping starts sequentially.

The product identification information acquisition device 100 includes a sensor 110 and a transmission unit 120.

The sensor 110 acquires identification information for identifying the product from each product that the customer who is shopping in the store starts holding.

The transmission unit 120 transmits the identification information acquired by the product identification information acquisition unit 100 to the profiling server 200 described later.

Such a product identification information acquisition device 100 is carried or worn by a customer who is shopping, for example, and moves in the store together with the customer. More specifically, is it provided in a product holder for holding the product by placing the product on the customer, such as an in-store shopping basket as shown in FIG. 2A or a cart as shown in FIG. 2B? Or an information terminal such as a smartphone or a tablet computer used by a customer as shown in FIG. 2C. In FIG. 2B, illustration of a part of the frame below the cart and a part including the wheels is omitted. A shopping basket and a cart are examples of a product holder in the present embodiment. Another example of the product holder is a tray. The product identification information acquisition device 100 is provided in the product holder, and can acquire information for identifying the product more naturally and with higher certainty in the behavior of the customer during shopping.

The shopping basket illustrated in FIG. 2A includes a sensor 111 as an example of the sensor 110. The cart shown in FIG. 2B includes, as an example of the sensor 110, a sensor 112 that is directed to a place where a product is placed. The information terminal shown in FIG. 2C includes a sensor (image sensor) 113 that constitutes a built-in camera as an example of the sensor 110.

The sensor 110 is an optical sensor for reading, for example, a barcode attached to a product. Alternatively, the sensor 110 may be an RF reader for reading RFID (radio frequency identification) from an RF (radio frequency) tag attached to a product, for example. The bar code or RFID indicates a product identification code such as a JAN (Japan article number) code. Or sensor 110 may be an image sensor for acquiring the appearance picture of goods. The information indicated by the barcode or RFID and the appearance image of the product are examples of identification information for identifying the product in this embodiment.

For example, each time a customer selects a product at the sales floor, the customer causes the sensor 110 to read the barcode attached to the product, and then places it in the shopping basket (start of holding the product). The acquired identification information is wirelessly transmitted to the profiling server 200 by the transmission unit 120 (not shown in FIG. 2A) included in the shopping cart. In a series of processes from reading to transmission of identification information, a microcontroller or processor (not shown) included in the product identification information acquisition unit 100 reads a predetermined program stored in a storage device (not shown). It is done by executing. When the information terminal shown in FIG. 2C is owned by the user, the user installs a program (app) provided by the store in order to cause the profiling server 200 to transmit identification information to the information terminal, and starts up in the store. May be used.

The profiling server 200 identifies each product that the customer has started holding using the identification information acquired from the product identification information acquisition unit 100, and acquires the result obtained by this identification as purchase candidate information. Further, the profiling server 200 acquires customer profile information indicating the customer's psychological state estimated based on the purchase candidate information. The profiling server 200 further specifies sales floor related information for reflecting the customer profile information on the sales floor of the actual store. The profiling server 200 that processes information in this way can be realized by using, for example, a server computer installed in a store or a cloud server outside the store.

The profiling server 200 includes a reception unit 210, an identification unit 220, an estimation unit 230, a deep psychological model 240, and a transmission unit 250 as functional components.

The profiling server 200 acquires the product identification information transmitted from the product identification information acquisition unit 100 via the receiving unit 210.

The identification unit 220 identifies each product that the customer has started to hold using the product identification information acquired from the product identification information acquisition unit 100. For example, when the product identification information is a product identification code, the identification unit 220 searches the product identification code in a database (not shown) of the product identification code to identify the product. When the product identification information is an appearance image of the product, for example, the identification unit 220 may perform character recognition on this image to identify the product, or perform image recognition using a model obtained by machine learning. It may be executed to identify the product. The result obtained by executing the identification is passed to the estimation unit 230 as information indicating the product that the customer has started to hold (hereinafter referred to as purchase candidate information).

The estimation unit 230 acquires customer profile information indicating a customer's psychological state estimated based on purchase candidate information. In order to acquire customer profile information, the estimation unit 230 uses the deep psychological model 240.

The deep psychological model 240 is created in advance by, for example, the evaluation grid method (registered trademark) for each product sold in an actual store. FIG. 3A is a diagram illustrating the concept of the evaluation grid method.

The evaluation grid method is an investigation method for clarifying the hierarchy (cognitive structure) of evaluation concepts that consumers have with respect to products through interviews and obtaining the purpose (psychological state) of consumers who select this product. In the example of FIG. 3A, the cognitive structure that a consumer who is a sample of this survey has about a brand of chocolate is shown. The cognitive structure is represented from left to right in a hierarchical structure from subordinate concept to superordinate concept, and the rightmost column shows the reason why the consumer chooses this chocolate or the purpose of the consumer when choosing it. Such a survey is conducted using a plurality of consumers as samples. The psychological state of selecting each product for each consumer attribute can be obtained as a result of the survey by counting for each attribute category such as the sex and age of the sample. If you can obtain information indicating the attributes of customers who start holding products at the store floor (hereinafter also referred to as personal attribute information), by using a deep psychological model according to the customer attributes, It is possible to estimate the psychological state of the customer in the sales floor with higher accuracy.

The deep psychological model 240 in the present embodiment associates each product with a psychological state for selecting each product among the results of the evaluation grid method performed on each product.

FIG. 3B shows an example of the data structure of the deep psychological model obtained in the example of FIG. 3A. Here, the example of FIG. 3B is a deep psychological model for the classification of women in their 30s. Note that the cognitive structure included in the deep psychological model is not limited to the psychological state of selecting a product as in this example. For example, the contents of the hierarchy of the left column as seen in FIG. 3A may also be included.

Furthermore, according to this example, the estimation unit 230 that obtains the chocolate of the brand as the identification information of the product that a certain customer has started to hold, and obtains information that the customer is a woman in her 30s. With reference to the psychological model, information in the column of “psychological state” is acquired as customer profile information.

FIG. 3C shows another example of the data structure of the deep psychological model. In the example of FIG. 3C, a score related to the psychological state is attached to each product. Such a score is based, for example, on the results of a questionnaire or interview targeting consumers. Using the deep psychological model illustrated in FIG. 3C, the estimating unit 230 acquires customer profile information indicating the customer's psychological state as follows.

Suppose a customer starts holding AAA vegetable juice, BBB coffee, and CCC blend tea one by one. The estimation unit 230 that has acquired the purchase candidate information indicating these products acquires the scores of these three points with reference to the deep psychological model of FIG. 3C, and calculates the average value of the scores for each psychological state. Specifically, it is as follows.

I want to feel happy: (0.0 + 0.8 + 0.6) /3=0.466
I want to get well: (0.7 + 0.0 + 0.0) /3=0.233
I want to relax: (0.4 + 0.9 + 0.9) /3=0.733
I want to refresh: (0.6 + 0.8 + 0.7) /3=0.700

Next, the estimation unit 230 acquires customer profile information such that the psychological state of “I want to relax” showing the highest value among the calculated average values is treated as the estimated current psychological state of the customer. .

Thus, the customer's psychological state may be estimated based on a plurality of products that the customer has started holding. The method of estimating a customer's psychological state based on a plurality of products is not limited to the above example, and various modifications conceived by those skilled in the art are possible.

The estimation unit 230 further specifies sales floor related information for reflecting the acquired customer profile information on the sales floor of the store. The identified sales floor related information is transmitted to the information presentation device 300 via the transmission unit 250.

An example of sales floor related information is information indicating recommended products recommended to customers who have started holding the products indicated by the identification information at the sales floor. In other words, according to the acquisition of customer profile information indicating the current psychological state of the customer who has started holding a certain product, purchase a product that has been purchased in this psychological state as a product that matches the customer's current mood. It is information to recommend.

To find a product with a purchase record from the psychological state, for example, the deep psychological model shown in FIG. 3B may be traced from right to left. Or the database which can search goods from the combination of the phrase which shows a psychological state, or also the classification | category of a customer may be used. A product whose conditions such as a combination of phrases indicating psychological states and customer classifications more closely match is a recommended product. When the estimation unit 230 specifies such recommended products, the estimation unit 230 further specifies sales floor related information. The number of recommended products is not limited to one. A plurality of products may be specified as recommended products.

The specification of the sales floor related information according to this example by the estimation unit 230 is, for example, the specification of advertisement video or audio used for various media of this product, or information indicated using video or audio edited appropriately. It is. Or the information shown using the image | video or audio | voice prepared separately for these media may be sufficient. For example, information related to recommended products, such as the location or price of the product at the store, may be specified at the actual store and highly useful to the customer.

The estimation unit 230 specifies sales floor-related information by specifying data such as an advertisement video of a recommended product, for example, in an internal storage device or an external server of the profiling server 200, acquires the data, and obtains the data. The information is transmitted to 300 (transmission of sales floor related information). Alternatively, the estimation unit 230 may process such data, or generate such data from information (display location or price at the same store) that is the basis of the data. In the present embodiment, the generation of the data by the estimation unit 230 in this way is also referred to as identification of sales floor related information.

Other examples of sales floor related information will be described later.

The information presentation apparatus 300 acquires the sales floor related information specified by the estimation unit 230 from the profiling server 200. Then, the information presentation device 300 presents the acquired sales floor related information to the customer. In the above example, an advertisement video or the like of a recommended product recommended for purchase by the customer is presented to the customer.

The information presentation device 300 includes a receiving unit 310 and an output unit 320.

The information presentation apparatus 300 receives the sales floor related information transmitted from the profiling server 200 and, in the above example, the signal indicating at least one of video and audio indicating the recommended product via the receiving unit 310.

The output unit 320 outputs at least one of video and audio indicating the recommended product based on the signal received via the receiving unit 310 and presents it to the customer.

Such an information presentation device 300 is carried or worn by a customer who is shopping, for example, and moves in the store together with the customer. More specifically, a product holder for holding the product by placing the product by the customer such as an in-store shopping cart as shown in FIG. 2A or an in-store cart as shown in FIG. 2B is provided. Or an information terminal such as a smart phone or a tablet computer used by a customer as shown in FIG. 2C. Or the information presentation apparatus 300 may be implement | achieved by the digital signage installed in the sales floor of a store as shown in FIG. 2D.

In addition, when the information presentation apparatus 300 is digital signage, product recommendation information is selectively transmitted from the profiling server 200 to the information presentation apparatus 300 in a position close to a level where the customer receives information presentation. In this case, the profiling server 200 grasps the position of the customer by using, for example, information indicating the position in the store further transmitted from the product identification information acquisition device 100 or by estimating from the product information and time based on the identification information. Is done.

The shopping basket shown in FIG. 2A includes a display 321 of liquid crystal or EL (electroluminescence) as an example of the output unit 320. The cart shown in FIG. 2B includes a liquid crystal or EL display 322 a and a speaker 322 b as an example of the output unit 320. The information terminal illustrated in FIG. 2C includes a display 323a and a speaker 323b as examples of the output unit 320. The digital signage shown in FIG. 2D includes a liquid crystal or EL display 324 a and a speaker 324 b as an example of the output unit 320.

Through these output units 320, information indicating recommended products is presented to the customer using at least one of video and audio.

[2. Procedures until presentation of sales floor related information to customers]
Next, an example of the procedure of an operation example of the information presentation system 10 configured as described above, which operates in a real store, from when the customer selects a product until the sales floor related information is presented to the customer Will be described. FIG. 4 is a sequence diagram for explaining this procedure. The sequence shown in this sequence diagram starts when the sensor 110 is ready to acquire product identification information from the product, such as holding the product's bar code that the customer picks up to start holding it over the sensor 110. To do.

In the following description of the procedure, the operation of each component of the product identification information acquisition unit 100 is indicated as the operation of the product identification information acquisition unit 100. Similarly, the operation by the function of each component of the profiling server 200 is shown as the operation of the profiling server 200, and the operation by the function of each component of the information presentation device 300 is shown as the operation of the information presentation device 300.

First, the product identification information acquisition unit 100 acquires product identification information from the product that the customer starts to hold (step S401). The acquired product identification information is transmitted to the profiling server 200 (step S402). FIG. 5 is a diagram for explaining the concept of the procedure from step S402 to step S403.

The product identification information acquired by the product identification information acquisition unit 100 is transmitted toward the profiling server 200. The character string in the left balloon in FIG. 5 is an example of log data including a series of product identification information acquired and transmitted by the product identification information acquisition unit 100. The profiling server 200 processes the acquired product identification information to identify the product that the customer has started to hold indicated in the product identification information (step S403), as illustrated in the right balloon of FIG. Get the data. Purchase candidate information is indicated by the data thus obtained.

The purchase candidate information includes a product identification code of each product, a product name obtained by checking the product identification code in a database, and a record in which the state and time difference of each product are associated with each other.

The state of each product indicates whether the customer has started or released the holding of the product of each record. In this example, “hold” indicates the start of the hold, and “return” indicates the release of the hold. Such recognition of the state of the product may be performed by periodically scanning the product placed on the product holder if the sensor 110 of the product identification information acquisition unit 100 is an RF reader, for example. Alternatively, if the sensor 110 is a bar code reader, it may be performed by an explicit operation such as pressing a predetermined button immediately before the customer reads the bar code of the product to be returned to the shelf. Such information on “return” of the once held product is used, for example, to exclude the product information returned by the customer from the information used as the material for selecting the recommended product.

The time difference indicates the time elapsed from the time when the customer first started holding one of the products until the customer started holding the other product or released the held product. The calculation of this time is performed based on, for example, product identification information. More specifically, for example, the product identification information is acquired based on the time when the product identification information acquisition unit 100 acquires or transmits the product identification information.

There are various uses for such time difference information. For example, it may be used to narrow down purchase candidate information used to acquire customer profile information indicating the psychological state of each customer. This application will be described later using an example. In addition, it may be used for grasping the outline of the movement route of each customer in the store. In addition, if a certain amount of information is collected from the shopping behavior of a plurality of customers, it can be statistically grasped, or the tendency of the order of selection of products in the shopping behavior, or with the passage of time after the shopping behavior is started It can be used to estimate recommended products based on the tendency of products that change and are likely to be purchased.

Note that the time difference information is not limited to the illustrated example, and may be, for example, a time difference from the start or release time of the product indicated by the immediately preceding record.

In addition, the purchase candidate information may not include time difference information. However, even when time difference information is not included, the purchase candidate information data indicates the time order of identification of each product by the product identification information acquisition unit 100, that is, the order in which the customer starts or cancels the retention of the product. May be. Such an order is indicated by, for example, the order of records or the number assigned to each record.

The profiling server 200 that acquired the purchase candidate information acquires customer profile information indicating the psychological state of the customer estimated using the deep psychological model 240 based on the purchase candidate information (step S404).

Next, the profiling server 200 specifies sales floor related information for reflecting the acquired customer profile information on the sales floor of the actual store, and transmits it to the information presentation apparatus 300 (steps S405 and S406).

The information presentation device 300 presents the received sales floor related information to the customer (step S407). In the above example, at least one of video and audio including recommended product information indicated by the received sales floor related information is output.

FIG. 6 shows an example of a screen presented to the customer by the information presentation apparatus 300 in step S407. In this example, an image of a product of a drip coffee is shown as a recommended product. Such recommended products are displayed on the information presentation apparatus 300 in the following flow, for example.

First, a customer who is shopping in a store picks up a chocolate product and causes the sensor 110 to read it (step S401). The identification information read by the sensor 110 is transmitted to the profiling server 200 (step S402).

In the profiling server 200, this product is identified using this identification information (step S403), and purchase candidate information is acquired. Next, using the deep psychological model 240, customer profile information indicating the current psychological state estimated for the customer who purchases the chocolate indicated by the purchase candidate information is acquired (step S404).

Further, the profiling server 200 specifies sales floor related information for reflecting the customer profile information on the sales floor of the store (step S405). In the above example, a drip coffee product that has been purchased in the psychological state of the customer who purchases this chocolate is identified as a recommended product, and sales floor related information indicating this product is transmitted to the information presenting apparatus 300 (steps). S406).

The information presentation device 300 presents the sales floor related information to the customer holding the chocolate.

As described above, the information presentation system 10 can provide information for recommending the purchase of a product according to the customer's psychological state using information on the current shopping behavior of the customer in the store. .

Note that the products recommended for purchase as described above may be selected from all the products handled in the store, or may be selected from some products such as advertisements.

Further, as another example of specifying the sales floor related information presented to the customer, it is possible to specify the information indicated by the image and / or sound according to the estimated psychological state of the customer. The sales floor related information in this case may not particularly indicate a specific product. For example, when the deep psychological model 240 is used to estimate that the customer is in a psychological state of “I want to relax”, the estimation unit 230 may indicate that the person in this psychological state is interested. The sales floor related information is specified by specifying data such as an image with a high image using an internal storage device of the profiling server 200 or an external server. Then, this data is transmitted from the profiling server 200 to the information presentation device 300 (transmission of sales floor related information), and images and the like are output by the information presentation device 300 so that the sales floor related information is presented to customers in the sales floor.

Each psychological state and video or audio presented to a person in each psychological state are associated with each other in advance and managed in a database. This association may be made based on the result of an evaluation grid method performed on video or audio, for example.

Further, the sales floor related information may be information indicating both the recommended product and a product other than the specific product. That is, the information presentation apparatus 300 may simultaneously present to the customer both the image of the product and the image other than the product according to the psychological state estimated by holding the product of the customer in the sales floor.

The basic operation of the process for recommending a product to the customer based on the current shopping process in the actual store by the customer of the information presentation system 10 is described above using an example. For example, each time a customer picks up a product and causes the sensor 110 of the product identification information acquisition device 100 to read the product, a series of steps in FIG. 4 may be performed.

This makes it possible to propose purchase products that are more likely to match the customer's psychological state, or provide images, etc., based on the purchase prospective items selected by customers shopping at the sales floor. Therefore, the quality of the customer's shopping experience at this store can be further improved, for example, by obtaining a greater sense of accomplishment for the purpose of shopping. At the same time, store sales can be expected to increase further.

In the above example, one recommended product is selected for the start of holding one product, but the operation of the information presentation system 10 is not limited to this example. As described above, the customer's psychological state may be estimated based on a plurality of products that the customer has started to hold, and the sales floor related information may be transmitted once. FIG. 7 is a sequence diagram for explaining the procedure of such an operation example of the information presentation system 10.

In the sequence diagram of FIG. 7, compared with the sequence diagram of FIG. 4, steps S701 to S703 are added between steps S403 and S404. However, steps S701 to S703 are the same as steps S401 to S403 in terms of content and operation subject. Therefore, the description about step S701 to step S703 is omitted.

In the profiling server 200, using the deep psychological model 240, the customer's psychological state is estimated based on information on a plurality of products that the customer has started to hold. For example, a product with a track record of being purchased in this psychological state. Identified. Then, sales floor related information indicating this product is transmitted from the profiling server 200. The information presentation device 300 receives the product recommendation information and presents it to the customer.

In addition, the customer's psychological state may be estimated based on purchase candidate information indicating products satisfying a predetermined condition among products held by the customer. The predetermined condition here refers to the purchase used for the psychological state based on the timing of the start of holding the product in order to accurately estimate the psychological state of the customer that may change with the passage of time or the progress of shopping behavior. This is a condition for selecting candidate information. Therefore, in the estimation of the customer's psychological state in the profiling server 200, all of the purchase candidate information that has been acquired for one shopping behavior from the customer's entry to just before the checkout may be used, or only a part is used. In some cases. Hereinafter, operation | movement of the information presentation system 10 which estimates a psychological state in this way is demonstrated along a specific example.

FIG. 8 is a sequence diagram for explaining a procedure of an operation example of the information presentation system 10 that estimates a customer's psychological state based on purchase candidate information indicating products satisfying a predetermined condition.

In the operation shown in the sequence diagram of FIG. 8, the product identification information acquisition unit 100 sequentially acquires four items of product identification information (steps S401A, S401B, S401C, and S401D) and transmits them to the profiling server 200 (step S402A). , S402B, S402C, S402D). In FIG. 8, illustration of step S401C and step S402C is omitted.

The profiling server 200 executes product identification and acquires purchase candidate information every time product identification information is acquired. The procedure so far corresponds to four repetitions of the cycle from step S401 to step S403 in FIG. 4 or FIG. Details of each procedure are omitted.

Next, the profiling server 200 selects the purchase candidate information indicating a predetermined number, in this example, three products, from among the already acquired purchase candidate information in the order in which the customer started to hold the latest (step S804). Then, customer profile information is acquired using the selected purchase candidate information (step S805). The procedure after Step S805 corresponds to Step 404 and subsequent steps in FIG. 4 or FIG. 7, and details of each procedure are omitted. Since the purchase candidate information indicates the order of starting to hold the product, the profiling server 200 can sort such purchase candidate information.

In this operation example, customer profile information is acquired using purchase candidate information indicating a product whose holding is started later, that is, the current psychological state of the customer is estimated. This takes into account that the customer's psychological state changes during shopping behavior. That is, this makes it possible to estimate a more accurate psychological state based on a product that is highly likely to be selected in a psychological state close to the current psychological state.

In the above example, the purchase candidate information is selected based on the number of products. However, the purchase candidate information may be selected based on the number of types of products instead of the number. Alternatively, when the number exceeds a certain number, purchase candidate information may be selected based on the number of types. Thereby, estimation of a customer's psychological state with many purchase points by bulk purchase etc. can be performed more accurately, for example.

In addition, when the purchase candidate information indicates the time difference or time of the start of the holding of each product, the profiling server 200 can select the purchase candidate information using this time difference or time. FIG. 9 is a sequence diagram for explaining the procedure of such an operation example of the information presentation system 10. Of the procedures in the operation example shown in FIG. 9, procedures common to the procedures in the operation example shown in FIG. 8 are denoted by common reference numerals. That is, the operation example of FIG. 9 is different in step S904 performed by the profiling server 200, and the others are common, and detailed description other than step S904 is omitted here.

In step S904, the profiling server 200, among the purchase candidate information that has already been acquired, purchases that indicate products within 5 minutes retroactive from the current time within the predetermined retroactive time when the customer started holding. Select candidate information. Accordingly, it is possible to avoid using information on a product that has been held in a psychological state that is likely to be different from the customer's current psychological state for estimation of the current psychological state.

It should be noted that the starting point of retroactive time is not limited to the current time, and may be the time when the last product is held, for example. Alternatively, when the holding of the product is not started within a predetermined time from the current time, the start time of holding the last product may be used as a starting point of the retroactive time.

Further, the conditions used in the operation example described with reference to FIGS. 8 and 9 may be used in combination. For example, the profiling server 200 may estimate the customer's psychological state by selecting purchase candidate information indicating up to three products that have been held within 5 minutes.

Further, the profiling server 200 may weight the purchase candidate information used for the customer's psychological state according to the order in which holding of the products indicated by the purchase candidate information is started. More specifically, the profiling server 200 acquires customer profile information by using the purchase candidate information indicating the product whose order in which the customer has started to be held, with a higher weight, among the purchase candidate information used for the customer's psychological state. May be. For example, the score of the deep psychological model shown in FIG. 3C may be used by multiplying a product with an earlier start of holding by a lower coefficient. As a result, the psychological state related to the product that has been held closer to the current time is more strongly reflected by the estimation of the customer's current psychological state.

Or, weighting according to the length of retroactive time may be made. For example, the coefficient by which the score of the deep psychological model in FIG. 3C is multiplied is 1.0 for 1 minute before the current time, 0.8 for over 1 minute, 0.8 for over 2 minutes, over 2 for over 3 minutes before 0.6. As a result, the psychological state related to the product that has been held closer to the current time is more strongly reflected by the estimation of the customer's current psychological state.

So far, the information presentation system 10 has been described above using examples. The information presentation system 10 in the present embodiment is not limited to the above example.

For example, the information presentation device 300 may receive information as the sales floor related information, not the data such as the video indicating the recommended product, but the information indicating the name or the location of the data file such as the video. In this case, the information presentation apparatus 300 acquires data such as video using such sales floor related information, and presents the sales floor related information to the customer by reproducing the acquired video and the like. The data such as the video may be stored in a storage device included in the information presentation apparatus 300, or may be stored in an external server or the like with which the information presentation apparatus 300 can communicate.

Further, the product identification information acquisition device 100 may be a device group that is installed on a wall, a ceiling, or a fixture in a store and can detect a series of customer shopping behaviors. Specifically, cameras (image sensors) installed at a plurality of locations in the store may be used.

In this case, the behavior of the customer including the start of holding the product is captured by a plurality of cameras so as to include an image for identifying the product and the customer, and transmitted to the profiling server 200. Customers may use their bags to hold merchandise. In addition, the device group may include other types of sensors such as an RF reader for acquiring information for identifying a product or a customer in place of the camera or used in combination with the camera. That is, in this case, in order to grasp the shopping behavior of each customer individually, the product identification information acquisition unit 100 acquires information for identifying each customer. This information plays a role instead of information for identifying the individual of the product identification information acquisition unit 100. The profiling server 200 further includes a customer identification unit for performing identification of each customer using this information. Further, the profiling server 200 performs a series of processes while associating each identified customer with a product that is held or returned. In addition, when a product is purchased, the purchase result may be associated with each customer.

Further, for example, at least one of the product identification information acquisition device 100 and the information presentation device 300 may be provided in a so-called wearable device such as smart glasses worn by a customer. For example, the product identification information acquisition device 100 may be a camera included in a smart glass, and the information presentation device 300 may be a display included in the smart glass.

Also, the sales floor related information may be presented to the customer as a so-called augmented reality that is displayed over the scene in the store. For example, it may be displayed so that an arrow pointing to the display place of the recommended product can be seen over the passage. When the customer is in a range where the displayed product can be seen, a frame that appears to surround the product may be displayed.

Further, although the purchase candidate information shown in FIG. 5 includes only a record of product identification information related to holding of a product during shopping behavior of one customer, the form of data storage is not limited to this. For example, a form in which a plurality of purchase candidate information tables shown in FIG. 5 are connected may be used. In this case, it is understood that the line having “0s” in the time difference column is the start of shopping behavior of one customer. Each record may include information for identifying each customer. This information may be acquired from the customer's belongings such as the customer himself / herself or a smart phone or a membership card, or may be information stored or generated by an individual product identification information acquisition device 100 used by each customer. Good.

(Embodiment 2)
In the information presentation system 10 described above, information on the start or release of the holding of products is collected in time series from the shopping behavior of each customer in the store using the product identification information acquisition device 100. Among these pieces of information, the information related to the release of the holding of the product, that is, the information related to the “return” of the product can also be used in the profiling server 200 to specify the sales floor related information presented to the customer.

First, as described above, it is used to exclude information on products returned by customers from information used for selecting recommended products. As a result, customer profile information that more accurately estimates the psychology of the customer can be obtained. Further, for example, customer profile information may be acquired based on a difference between a returned product and a product for which holding has been started thereafter. A more specific example will be described with reference again to FIG. 3C showing an example of the data structure of the deep psychological model.

Suppose a customer returns AAA vegetable juice that they have already held and starts holding CCC blended tea. The estimation unit 230 that has acquired the purchase candidate information and return information indicating each product acquires the scores of these two products with reference to the deep psychological model in FIG. 3C, and calculates the difference between the scores for each psychological state. Specifically, it is as follows.

I want to feel happy: 0.6-0.0 = 0.6
I want to be fine: 0.0-0.7 = -0.7
I want to relax: 0.9-0.4 = 0.5
I want to refresh: 0.7-0.6 = 0.1

Next, the estimation unit 230 calculates customer profile information such that the psychological state of “I want to feel happy” indicating the largest value among the calculated differences is handled as the estimated current psychological state of the customer. get.

Thereafter, the estimation unit 230 identifies sales floor related information indicating recommended products for customers in a psychological state of “I want to feel happy” and transmits the information to the information presentation unit 230.

The behavior of reselecting a product as described above may reflect an intention to select a product that matches the current mood or physical condition that the customer has reconfirmed. Thus, by using the return information generated by releasing the holding of the product, it is possible to estimate the psychological state that is the reason why the product for which the customer has started holding is selected.

In the above example, the psychological state in which the customer has selected the product is estimated based on the largest value among the differences. However, a plurality of values, for example, the largest value and the next largest value may be used.

Also, the scores of a plurality of types of products that have been held after the product has been returned may be used. In addition, as described above, the product for which the difference between the scores is taken may be selected based on the category of the returned product and the newly started product. In the above example, since all categories are beverages, “CCC blended tea” is selected as an object for which a difference is taken. However, in the case of a detergent other than “CCC blend tea”, the difference may not be taken. In addition, the product for which the score difference is taken may be limited to a product that has been held within a predetermined time after the product is returned.

In this way, the profiling server 200 acquires return information related to the released product from the product identification information acquisition unit 100, and at least the return information and purchase candidate information related to the product that the customer has started holding after the return. Customer profile information may be obtained based on a portion.

(Other embodiments)
In each of the above embodiments, the psychological state of a customer who selects a product is explained mainly with a difference for each product. There may be a tendency for changes in the time of day. For example, the psychological condition of customers who buy a product in the morning or evening tends to be relaxed, and the psychological condition of customers who buy a product in the day may be strong. It is grasped by analysis.

In view of this point, among the sales floor related information output by the profiling server 200 and presented to the customer by the information presentation device 300, the information indicating the recommended product is, for example, an advertisement of the same product, depending on the time zone. There may be changes in the content of appeal.

Further, in the above embodiment, the sales floor related information is not presented to the customer until each customer starts holding the product.

However, it is known that each retail store has a tendency to sell products different from other stores, and even one store has a tendency to sell products by time. Considering this point, even if a newly entered customer is presented with information related to the sales floor presented to other customers at the store at that time or within a predetermined retroactive time, Good.

This makes it possible for each customer to present sales floor-related information that matches the psychological state at an early stage of shopping behavior, and can further improve the quality of the shopping experience. As a result, it will lead to improved sales for the store.

In addition, when the candidate purchase information used for estimating the psychological state as described above is selected in light of the conditions related to the start of holding the product, when there is no product that satisfies the condition, it is presented to other customers as described above. The sales floor related information may be presented.

In the above embodiment, each component may be configured by dedicated hardware or may be realized by executing a software program suitable for each component. Each component may be realized by a program execution unit such as a CPU (central processing unit) or a processor reading and executing a software program recorded on a recording medium such as a hard disk or a semiconductor memory. Here, the software program for realizing the profiling server of the above embodiment is the following program.

That is, the program causes the computer to acquire the identification information from a product identification information acquisition unit that acquires identification information for identifying the product from the product that the customer who is shopping starts in the actual store. The result obtained by identifying the product using the identification information is acquired as purchase candidate information, the customer profile information indicating the psychological state of the customer estimated based on the purchase candidate information is acquired, and the customer profile information is stored in the actual store. A process of acquiring sales floor related information to be reflected in the sales floor is executed.

As described above, the information presentation system according to one or more aspects has been described based on the embodiment. However, the present invention is not limited to this embodiment. Unless it deviates from the meaning of the present invention, various modifications conceived by those skilled in the art may be included in the scope of the present invention.

The present invention can be used in a system that provides information based on the behavior of a customer who is shopping at a store to hold a product as a purchase candidate to the customer or the store operator.

DESCRIPTION OF SYMBOLS 10 Information presentation system 100 Commodity identification information acquisition device 110, 111, 112, 113 Sensor 120 Transmission part 200 Profiling server 210 Reception part 220 Identification part 230 Estimation part 240 Deep psychological model 250 Transmission part 300 Information presentation apparatus 310 Reception part 320 Output part

Claims (12)

1. In a real store, a product identification information acquisition unit for acquiring identification information for identifying the product from each of a plurality of products that the customer who is shopping sequentially starts holding,
   When the identification information is acquired from the product identification information acquisition unit, a result obtained by identifying each of the plurality of products using the identification information is acquired as purchase candidate information, and at least a part of the purchase candidate information is obtained. Profiling server for obtaining customer profile information indicating the psychological state of the customer estimated based on the information, and identifying sales floor related information for reflecting the customer profile information to the sales floor of the actual store;
   An information presentation system comprising: an information presentation device that acquires and presents the sales floor related information.
2. The profiling server is
   Of the purchase candidate information, the customer profile information is acquired using purchase candidate information indicating a predetermined number or type of products from the slowest order in which the customer started holding,
   The information presentation system according to claim 1.
3. The profiling server is
   Of the purchase candidate information, the customer profile information is acquired using purchase candidate information indicating products whose time when the customer started holding is within a predetermined retroactive time;
   The information presentation system according to claim 1 or 2.
4. The profiling server is
   Among the purchase candidate information, the customer profile information is obtained using higher weight as purchase candidate information indicating a product whose order in which the customer started holding is slower,
   The information presentation system according to any one of claims 1 to 3.
5. The profiling server is
   After the customer enters the actual store and before starting to hold the plurality of products,
   In order to cause the customer to present other sales floor related information that has been specified in order to reflect the customer profile information indicating the psychological state of the other customer in the sales floor within a predetermined time from the current time to the sales floor. The information presentation system according to claim 1, which is transmitted to the information presentation device.
6. The sales floor related information indicates a product that has been purchased in the psychological state,
   The information presentation system according to any one of claims 1 to 5, wherein the information presentation device presents the sales floor related information to the customer at a sales floor of the actual store.
7. The sales floor related information is information indicated by at least one of an image and a sound associated with the psychological state,
   The information presentation system according to any one of claims 1 to 6, wherein the information presentation device presents the sales floor related information by presenting at least one of the image and sound to the customer at a sales floor of the actual store. .
8. The product identification information acquisition device further detects release of the product held by the customer, and recognizes the product,
   The profiling server is
   When the return information related to the product whose holding has been released is acquired from the product identification information acquisition unit, the customer profile information based on at least a part of the purchase candidate information related to the product that the customer has started holding thereafter and the return information The information presentation system according to any one of claims 1 to 7.
9. 9. The profiling server acquires the customer profile information using a deep psychological model created in advance by an evaluation grid method (registered trademark) for each product sold in the actual store. Information presentation system given in any 1 paragraph.
10. In the deep psychological model, there is a deep psychological model according to the sex and age of the customer sample,
    The profiling server is
    Obtaining personal attribute information indicating at least one of the sex and age of the customer;
    The information presentation system according to claim 9, wherein customer profile information indicating the psychological state estimated using the deep psychological model corresponding to at least one of gender and age indicated by the personal attribute information is acquired.
11. The information presentation system according to any one of claims 1 to 10, wherein the product identification information acquisition unit is provided in a product holder for the customer to hold the product by placing the product.
12. The said information presentation apparatus contains at least one of the information terminal which the said customer carries or wears in the said actual store, and the digital signage installed in the said actual store. Information presentation system.

Images