JP6810561B2 - Purchasing support system - Google Patents

Description

The present invention relates to a purchasing support technique via a product display shelf.

As described in Patent Documents 1 and 2, a technique for displaying advertising information or the like to consumers to promote purchasing motivation has been proposed.

JP-A-2015-88166 JP-A-2015-1562111

However, although the conventional techniques as described in Patent Documents 1 and 2 grasp the behavior of the consumer by picking up the product or detecting the line of sight, they detect only a part of the behavior. It was not possible to provide information suitable for the psychology and behavior of consumers because they did not have a comprehensive understanding of consumer psychology and purchasing motivation.

Therefore, an object of the present invention is a purchasing support system that grasps the user's pre-shelf psychology and pre-shelf behavior with respect to the product display shelf, comprehensively analyzes the purchasing motivation of consumers, and provides purchasing support through the product display shelf. Is to provide.

(1) The purchasing support system of the present invention acquires a product display shelf, a first sensor device that acquires a face image of a consumer located in front of the shelf, and a consumer's movement with respect to the product displayed on the product display shelf. A product display shelf system including a second sensor device, a sensing unit provided on the product display shelf, and an output unit provided on the product display shelf to display predetermined contents, and the product display shelf system. It is connected via a network, receives each sensor detection information acquired by the sensing unit, determines the purchase intention of the consumer, and provides the consumer located in front of the shelf with the content according to the purchase intention. It has a management device that performs distribution processing for displaying on the output unit.

The management device identifies the pre-shelf psychological pattern based on the consumer's facial expression and line of sight detected from the face image, and identifies and identifies the pre-shelf behavior pattern based on the consumer's movement toward the product. An analysis control unit that determines a consumer's purchasing motivation pattern corresponding to the shelf-front psychological pattern and the shelf-front behavior pattern, and a storage unit that stores purchase support information associated with the content for each of the plurality of purchasing motivation patterns. It has a content control unit that selects the content based on the determined consumer's willingness to purchase pattern and performs distribution processing for displaying the content on the output unit.

(2) In the above (1), the sensing unit may further include a third sensor device for detecting the movement of the goods displayed on the product display shelf, and the analysis control unit may include the second sensor device and the second sensor device. The sensor detection information of the third sensor device can be combined to specify whether or not the consumer has picked up a specific product as the pre-shelf behavior pattern.

(3) In the above (1) or (2), the content control unit selects and selects the content according to the consumer's pre-shelf psychological pattern, the pre-shelf behavior pattern, and the purchasing motivation, respectively. It can be configured to perform a distribution process for displaying a plurality of the contents on the output unit.

(4) In the above (1) to (3), the analysis control unit extracts the consumer attributes including the gender and age group of the consumer from the face image based on a predetermined face recognition process, and the face image. And the user profile information associated with the consumer attribute is generated and stored in the storage unit, and the user profile information stored in the storage unit is specified by performing pattern matching based on the face image to identify the product. The user profile information that identifies the visit history to the store where the display shelf is installed and the purchase history of the products displayed on the product display shelf acquired from a predetermined sales management system that manages the sales history of the store. Can be associated with and stored. Then, the content control unit selects the content based on any one or a combination of the gender, the age group, the store visit history, and the purchase history of the consumer based on the user profile information. , It can be configured to perform a distribution process for displaying on the output unit.

(5) In the above (1) to (3), the analysis control unit generates user profile information associated with the face image and stores it in the storage unit, and performs pattern matching based on the face image. The user profile information stored in the storage unit is specified, and the purchase history of the product displayed on the product display shelf acquired from a predetermined sales management system that manages the sales history of the store is associated with the user profile information. Can be remembered. Then, based on the result of the distribution process for displaying on the output unit and the purchase history, the result of the distribution process leading to the purchase of the product is displayed on the consumer's pre-shelf psychological pattern, the pre-shelf behavior pattern, and the like. And it can be configured to further include a learning control unit that evaluates each purchase intention.

(6) In the above (1) to (5), the output unit can be configured to include a first display device and a second display device for displaying the predetermined content. Then, the second display device can be configured as a monitor unit in which a plurality of display devices are unitized side by side. At this time, the content control unit performs a distribution process for displaying one or more of the contents on the first display device and the second display device, and also on each display device of the second display device. It can be configured to perform a distribution process for displaying different contents.

According to the present invention, it is possible to grasp the user's pre-shelf psychology and pre-shelf behavior with respect to the product display shelf, comprehensively analyze the consumer's purchasing motivation, and provide purchasing support through the product display shelf.

It is a block diagram of the purchase support system through the product display shelf of 1st Embodiment. It is a figure which shows the configuration example of the monitor unit installed in the product display shelf of 1st Embodiment. It is a block diagram of the product display shelf system and the management device which constitute the purchase support system of 1st Embodiment. It is a figure for demonstrating the sensing unit function, the analytics unit function, and the output unit function included in the purchase support method of 1st Embodiment. It is a figure which shows an example of the user profile of 1st Embodiment. It is a figure which shows the control example of the distribution content based on the user behavior (consumer behavior) of 1st Embodiment. It is a figure which shows an example of the shelf-front psychoanalysis and the shelf-front behavior analysis of the first embodiment. It is a figure which shows an example of the purchase motivation analysis result based on the shelf-front psychology and the shelf-front behavior of the first embodiment, and the distribution content pattern with respect to the purchase motivation analysis result. It is a figure which shows the processing flow of the purchase support system through the product display shelf of 1st Embodiment. It is a figure which shows an example of the purchase support method at the time of applying the purchase support system through the product display shelf of 1st Embodiment to a "cosmetics section". It is a figure which shows an example of the purchase support method at the time of applying the purchase support system through the product display shelf of 1st Embodiment to a "game corner". It is a figure which shows an example of the purchase support method at the time of applying the purchase support system through the product display shelf of 1st Embodiment to a "lunch box corner". It is a figure which shows an example of the purchase support method at the time of applying the purchase support system through the product display shelf of 1st Embodiment to a "clothes corner". It is a figure which shows an example of the purchase support method at the time of applying the purchase support system through the product display shelf of 1st Embodiment to a "meat corner".

Hereinafter, embodiments will be described with reference to the drawings.

(First Embodiment)
1 to 14 are views showing the first embodiment. FIG. 1 is a configuration diagram of a purchasing support system (hereinafter referred to as a purchasing support system) via a product display shelf of the present embodiment. The purchasing support system is configured to include a product display shelf system 100 and a management device 300, and is connected wirelessly or by wire via a network such as an IP network.

As shown in FIG. 1, the product display shelf system 100 includes a shelf main body 1 extending in the height (Z direction) and product display parts 2A, 2B, and 2C extending forward from the shelf main body 1. It is based on the product display shelves that are sold. The plurality of product display portions 2A, 2B, and 2C are arranged at predetermined intervals so as to be separated in the height direction. The product display portions 2A, 2B, and 2C have a predetermined width (X direction) and depth (Y direction), and project from the shelf body portion 1 in the Y direction. The product display portions 2A, 2B, and 2C may be provided so that the upper surfaces of the product display portions 2A, 2B, and 2C are inclined downward with respect to the height direction. The product display shelf shown in FIG. 1 is an example, and may be a shelf on which a product display area having at least a predetermined width and depth is formed.

As illustrated in FIG. 1, the product display shelf system 100 includes a camera 110A (corresponding to the first sensor device), a motion sensor 110B (corresponding to the second sensor device), and a capacitance sensor 110C (corresponding to the third sensor device). A sensing unit 110 such as (corresponding to), an output unit 120 such as a display device 120A, a monitor unit 120B, a speaker 120C, and an incense generator 120D, and a control unit 130 are provided.

The camera 110A is a photographing device that photographs a user (consumer) in front of the shelf, and captures a still image or a moving image of the user. The motion sensor 110B is a non-contact type motion sensor provided with a distance image sensor using infrared rays or a laser, and can detect the distance to an object in the image. The distance image sensor includes a "Light Coding (pattern irradiation method)" method and a "TOF (Time of Flight)" method, and measures the distance by irradiating infrared rays or a laser and reading the reflection. In combination with a camera that detects the position of an object separately from the distance image sensor, for example, the movement of a person is detected based on the position and distance.

The camera 110A and the motion sensor 110B are provided on the upper part of the product display shelf in order to photograph at least the upper body of the user located in front of the shelf. On the other hand, the capacitance sensor 110C is provided on the upper surface of the product display portions 2A, 2B, 2C on which the product is placed. The capacitance sensor 110C is a capacitance type proximity sensor, and a product is placed on the capacitance sensor 110C. When the user picks up the placed product, the capacitance changes, so that it is possible to detect the presence or absence of the placed product on the product display shelf.

In the present embodiment, by combining the motion sensor 110B and the capacitance sensor 110C, it is possible to accurately grasp that the user has picked up the product as a pre-shelf action. It is also possible to grasp that the user has picked up the product by using any one of the camera 110A, the motion sensor 110B, and the capacitance sensor 110C. For example, the product picked up by the user's image taken by the camera 110A can be detected, the product can be detected as an object by the motion sensor 110B, and the action of the product moving with the user can be detected. By detecting the presence or absence of a product with the 110C, it is possible to grasp that the user has picked up the product in front of the shelf. It is also possible to arbitrarily combine the sensor detection information of the sensing unit 110 to know that the user has picked up the product.

Next, the display device 120A is provided on the upper part of the product display shelf and displays the content distributed from the management device 300. On the other hand, as shown in FIG. 2, the monitor unit 120B is a unit in which a plurality of small display devices M1 to M8 are arranged side by side. As shown in FIG. 1, the monitor unit 120B is provided on the end faces of the product display portions 2A, 2B, and 2C, and is arranged facing the user located in front of the shelf.

The speaker 120C outputs the reproduced voice data (music, BGM, sound effect, etc.). The audio data includes audio that accompanies the content (video, image, text information, advertisement information) displayed on the display device 120A and the monitor unit 120B, and audio that has nothing to do with the content. The incense generator 120D outputs the scents of cosmetics and perfumes, the scents of foods, and the like. For example, it is possible to install a fragrance (raw material) that is the source of the scent and to send out the scent with a blower such as a fan. A plurality of fragrances (raw materials) may be installed in advance, and for example, a plurality of fragrances may be switched and transmitted according to the analysis results of the user's pre-shelf psychology, pre-shelf behavior, and purchasing motivation described later.

The control unit 130 connects to the management device 300 via a network, transmits the sensor detection information of the sensing unit 110 to the management device 300, and receives the content (including the output control information) provided by the management device 300.

FIG. 3 is a block diagram of the product display shelf system 100 and the management device 300 that constitute the purchasing support system. The management device 300 of the present embodiment can be connected to one or more product display shelf systems 100.

As described above, the product display shelf system 100 includes a sensing unit 110, an output unit 120, and a control unit 130, and the control unit 130 includes a control device 131, a communication device 132, and a storage device 133. The communication device 132 controls communication with the management device 300 via the network. The storage device 133 stores information necessary for control by the control unit 130 and various information transmitted from the management device 300.

The sensor control unit 131A of the control device 131 controls each sensor device of the sensing unit 110 and collects sensor detection information output from each sensor device. The sensor detection information is transmitted to the management device 300 via the communication device 132. The output control unit 131B receives the content and the output control information distributed from the management device 300, and performs output control for each output device of the output unit 120.

The management device 300 includes a communication device 310, a control device 320, and a storage device 330. The communication device 310 controls communication with the product display shelf system 100. The storage device 330 stores various information such as information necessary for control by the control device 320 and sensor detection information transmitted from the product display shelf system 100.

The control device 320 includes an analysis control unit 321 and a content control unit 322, and a learning control unit 323. FIG. 4 is a diagram for explaining the sensing unit function, the analytics unit function, and the output unit function included in the purchasing support method of the present embodiment. The sensing unit function and the output unit function are realized by the product display shelf system 100, and the analytics unit function is realized by the management device 300.

As shown in FIG. 4, the analysis control unit 321 performs each process of user identification processing, pre-shelf psychoanalysis processing, pre-shelf behavior analysis processing, and purchasing motivation analysis processing.

The user identification process is a user profile registration / update process, and the face recognition process is performed using the image data of the user captured by the camera 110A to specify (register) the user. For example, the gender and age group of the user can be analyzed by face recognition technology and registered as a user profile. At this time, it is possible to perform pattern matching with the face image of the already registered user profile and determine whether it is a new user or a repeater. In the case of a repeater, the store visit history such as the number of store visits is registered / updated as a user profile.

FIG. 5 is a diagram showing an example of a user profile. The user profile includes the user's face image data, gender, age group, facial expression, line of sight, product pick-up information, staying time, number of store visits, purchase history, and the like. The analysis control unit 321 grasps the user's gender, age group, facial expression, and line of sight by face recognition technology, and registers them in the user profile. In addition, it is possible to register information on picking up the product based on the behavior analysis in front of the shelf, which will be described later, the staying time in front of the shelf detected by using the sensing unit 110 as a motion sensor, and the number of visits to the store described above.

A known technique can be applied to the face recognition technique executed by the analysis control unit 321. For example, it is possible to analyze a face image using feature points and patterns to detect gender, age group, facial expression, and the like. In addition, the positions of the eyes (iris, cornea, pupil) of the user's facial image taken by a visible camera or an infrared camera are detected, and the images are displayed on the product display units 2A, 2B, and 2C based on the detected eye positions. It is possible to grasp the specific product that the user is looking at. The products displayed in the product display units 2A, 2B, and 2C and the position information of the products can be stored in the storage device 330 in advance.

The purchase history can be acquired from the sales management system (POS system). For example, a user's face image is acquired at the time of cash register clearing, and the sales management system sets the cash register clearing result (information identifying the purchased product) and the user's face image as a set, and either through the product display shelf system 100 or directly. Can be transmitted to the management device 300. The user's face image may be transmitted to the management device 300 separately from the sales management system. For example, at the time of checkout, the cashier can take a face image of the user and send it to the management device 300 in synchronization with the timing when the POS information is transmitted from the cashier to the sales management system. The management device 300 can associate the two with each other based on the time stamp of the POS information acquired from the sales management system and the time stamp of the acquired user's face image.

The analysis control unit 321 can search for a user profile using the user's face image attached to the cash register clearing result (POS information), and store the purchased product as a purchase history in the corresponding user profile.

The pre-shelf psychoanalysis process analyzes the user's pre-shelf psychology with respect to the product of the product display shelf system 100 based on the facial expression and the movement of the line of sight of the user specified by the above-mentioned face recognition process.

In the pre-shelf behavior analysis process, the user's behavior detected by the motion sensor 110B and the movement of the product detected by the capacitance sensor 110C are combined, and the user picks up the product (product picking information). ) Is analyzed. Information picked up by the product is grasped as an action in front of the shelf. Further, as described above, the position information of the product placed in the product display shelf system 100 can be stored in the storage device 330 in advance, and the position information of the product detected by the capacitance sensor 110C is also stored in advance. It is remembered. Therefore, it is possible to identify which product is actually picked up. As the product picking information registered in the user profile, for example, it is possible to grasp the picking behavior of a specific product such as "picking up the product A".

The purchasing motivation analysis process is a process of analyzing a user's purchasing motivation by using the shelf-front psychoanalysis result by the shelf-front psychoanalysis process and the shelf-front behavior analysis result by the shelf-front behavior analysis process. The details of each analysis process of pre-shelf psychology, pre-shelf behavior, and purchasing motivation will be described later.

FIG. 6 is a diagram showing a control example of the distributed content based on the user behavior (consumer behavior). The content control unit 322 extracts the content and output control information to be provided to the product display shelf system 100 by using the user identification result, the shelf front psychoanalysis result, the shelf front behavior analysis result, and the purchasing motivation analysis result in combination. To deliver.

As shown in FIG. 6, when the user comes in front of the product display shelf system 100 (in front of the shelf), it is grasped that the user exists in front of the shelf based on the sensor detection information of the motion sensor 110B. At this time, the camera 110A captures a face image of the user, identifies the user using the face recognition information, and grasps the facial expression and the line of sight of the user.

First, the user profile is specified by matching with the user's face image. When a user profile exists, as a known user, product candidates are extracted using the purchase history of the user profile, and the content (product information) related to the extracted product candidates is selected and transmitted to the product display shelf system 100. To do. On the other hand, if the user profile does not exist, it is assumed that the user is a new user, product candidates suitable for the gender and age group grasped from the user's face image are extracted, and the content related to the extracted product candidates is selected for the product. It is transmitted to the display shelf system 100.

As described above, the content distribution based on the specified user profile is based on any one or a combination of two or more of the gender, age group, store visit history and purchase history of the consumer (user) based on the user profile. Can be configured to perform distribution processing for display on the output unit. For example, in the case of female repeaters who visit the store 5 times or more, we provide priority reservation information for limited products and profitable information that allows us to receive higher discounts than female repeaters and male users who visit the store less than 5 times. Can be done.

Information to be provided to the product display shelf system 100 is stored in the storage unit 330 of the management device 300, and this information is provided as content. For example, candidate products can be selected in advance for products in the purchase history, or candidate products for each gender or age group can be selected in advance, and content information to be distributed can be accumulated. ..

Next, based on the user's line-of-sight information, it can be grasped that the product B is being viewed, for example. Therefore, it is possible to identify the product that the user is looking at based on the line-of-sight information, extract the product description information and the advertisement information of the specified product B, and transmit the product to the product display shelf system 100. At this time, the output (display) control information is transmitted to the product display shelf system 100 so that the effect (emphasis or decoration) is displayed in the display of the product description information and the advertisement information related to the product B actually viewed by the user. Can be sent.

In addition, as a user behavior in front of the shelf, it is possible to grasp whether or not the product has been picked up. Based on the product picked up information, the content related to the picked up product A is extracted and sent to the product display shelf system 100, or the profitable information related to the picked up product A is extracted and the product. It can be transmitted to the display shelf system 100. The profitable information is, for example, information that recommends a product C that is profitable (a discount can be applied or a combination effect is high) when purchased at the same time as the product A.

Next, in the present embodiment, the user's purchasing motivation is analyzed based on the shelving psychology based on the facial expression and the line of sight and the shelving behavior based on the product picking information, and the content related to the analyzed purchasing motivation is extracted. It is transmitted to the product display shelf system 100. Content distribution and display control based on the user's purchasing motivation are, for example, switching the displayed content to content that encourages purchasing motivation, displaying the displayed content by effect processing, and playing music or voice. Or, additional display of profitable information, etc. are included.

As described above, in the present embodiment, based on the user action in front of the shelf of the product display shelf system 100, the user not only displays advertisements and profitable information but also grasps the psychology in front of the shelf and the behavior in front of the shelf of the user. Fine-tuned content distribution and display control suitable for the purchase motivation of.

In order to comprehensively grasp the user's psychology in front of the shelves and willingness to purchase, one sensor device is insufficient, and the product display shelf system 100 of the present embodiment includes a sensing unit 110 including a plurality of sensor devices. It comprehensively grasps the user's psychology in front of the shelf and willingness to purchase.

The purchasing support system of the present embodiment is a sensing unit 110 provided with a plurality of sensor devices without depending on one sensor device, and can perform consumer attributes (profile), pre-shelf psychology (psychological situation), and pre-shelf behavior. It is grasped and transmitted to the management device 300, and the analytics unit of the management device 300 analyzes the psychological state and behavior of the user in front of the shelf of the product display shelf system 100 to comprehensively extract the purchase motivation of the user. Then, it is possible to provide content that encourages purchasing in response to the purchasing motivation comprehensively grasped from the user's psychological state and behavior via the output unit 120 of the product display shelf system 100, and promote the user's purchasing behavior. it can.

FIG. 7 is a diagram showing an example of the pre-shelf psychoanalysis and the pre-shelf behavior analysis of the present embodiment. In the pre-shelf psychology analysis, the user's facial expression analysis and gaze analysis are performed using the captured image, and the user's pre-shelf psychology is analyzed from both the user's facial expression and the line of sight. In the facial expression analysis, for example, facial expression feature points such as bright, hesitant, and expressionless are patterned in advance, and it is determined whether the user's facial expression is "bright", "stray", or "expressionless". In addition to this, various facial expression analyzes such as "joy", "surprise", "anger", and "sadness" can be performed.

In the line-of-sight analysis, if the positions of the eyes (iris, cornea, pupil) of the user's face image detected as described above are within a predetermined range for a predetermined time, the line of sight is concentrated on one point. Or, if the position deviates from the predetermined range for a predetermined time and the position fluctuates vertically and horizontally, it can be determined that the image is dispersed.

The pre-shelf psychology is pre-patterned by the combination of the facial expression analysis result and the line-of-sight analysis result, and as shown in FIG. 7A, the pre-shelf psychology patterns A to E are stored in the storage device 330 in advance. There is. The analysis control unit 321 extracts a preset pre-shelf psychology pattern using the facial expression analysis result and the line-of-sight analysis result, and identifies the user's pre-shelf psychology.

As described above, the pre-shelf behavior analysis combines the user behavior detected by the motion sensor 110B and the movement of the product detected by the capacitance sensor 110C to take the user's product hand (pre-shelf behavior). Pattern) is specified. For example, it is possible to specify that a product has not been picked up, a specific product has been picked up, a specific product picked up has been returned to the shelf, and the like.

FIG. 8 is a diagram showing an example of a purchase motivation analysis result based on the pre-shelf psychology and the pre-shelf behavior of the present embodiment and a distribution content pattern for the purchase motivation analysis result. As shown in FIG. 8, the purchasing motivation is pre-patterned by the combination of the specified pre-shelf psychological pattern and the pre-shelf behavior pattern, and each patterned analysis result is stored in the storage device 330 in advance. There is. The analysis control unit 321 extracts a preset purchase motivation analysis result pattern using the pre-shelf psychological pattern and the pre-shelf behavior pattern, and identifies the user's purchase motivation.

The content control unit 322 extracts the content corresponding to the purchase intention of the user specified by the analysis control unit 321 from the content group, and transmits the content to the product display shelf system 100. The storage device 330 stores in advance a distribution content pattern (purchase support information) in which the purchase motivation analysis result and the content to be distributed are linked, and the content control unit 322 uses the purchase motivation analysis result to distribute the content. The pattern is specified, the corresponding content is extracted from the content group stored in the storage device 330, and transmitted to the product display shelf system 100.

For each content included in the content group, for example, a plurality of content 1 can be prepared for each product, and the distribution content pattern corresponding to the analysis result 1 can be individually set for each product. Therefore, the content control unit 322 extracts, for example, the content 1 corresponding to the analysis result 1, but extracts the content 1 corresponding to the specific product picked up by the user specified by the analysis control unit 321 from the content group. And can be transmitted to the product display shelf system 100.

FIG. 9 is a diagram showing a processing flow of the purchasing support system via the product display shelf of the present embodiment. As shown in FIG. 9, the product display shelf system 100 controls the operation of the sensing unit 110, collects (acquires) the sensor detection result in real time (S101), and transmits it to the management device 300 as sensing information (S102). ..

The product display shelf system 100 (control unit 130) detects that the user approaching the product display shelf system 100 has entered the predetermined range, and triggers that the user is detected in front of the shelf. It can also be configured to control the operation of the sensing unit 110 and control the transmission of sensing information to the management device 300.

The management device 300 uses the photographed image of the user received from the product display shelf system 100, and matches the face image of the user profile already stored (registered) with the face image of the user to obtain the user profile. Whether or not there is registration is determined (S301). When the user profile does not exist (NO in S302), the management device 300 assumes that the user is a new user, calculates the gender and age group from the user's face image (S303), and newly registers the profile (S304).

When the user profile already exists (YES in S302) and when the user profile is newly registered, the management device 300 extracts the content based on the user profile (S311).

Next, in step S305, the user's pre-shelf psychology described above is specified, and the content corresponding to the specified pre-shelf psychology is extracted (S306). After the pre-shelf psychology is identified or when the pre-shelf behavior is detected together with the identification of the pre-shelf psychology (YES in S307), the user's pre-shelf behavior is specified (S308). After that, the purchase motivation of the user based on the specified pre-shelf psychology and pre-shelf behavior is determined (S309), and the content based on the determined purchase motivation is extracted (S310). At this time, as described above, it is also possible to extract the content related only to the pre-shelf behavior specified in step S308.

The management device 300 controls the distribution of each content extracted in relation to the user profile, the pre-shelf psychology, the pre-shelf behavior, and the purchase motivation (S312). For example, a distribution process for displaying the extracted content on a single display or a plurality of displays is performed.

Specifically, each content is displayed individually on each small display device of the monitor unit 120B, and as described in FIG. 6, the user profile, the pre-shelf psychology, the pre-shelf behavior, and the willingness to purchase are displayed in chronological order. Each content can be switched and displayed in order. Further, different contents can be displayed on each of the display device 120A and the monitor unit 120B, and different contents can be displayed on each of the plurality of small display devices M1 to M8 constituting the monitor unit 120B. The small display devices M1 to M8 of the above can be used as one display unit, and the contents can be divided and displayed in the small display devices M1 to M8.

Further, since the monitor unit 120B has a plurality of small display devices arranged side by side, it is possible to display a plurality of narrative contents on each small display device.

The product display shelf system 100 displays the content received from the management device 300 on the output unit 120, outputs sounds such as music, voice, and sound effects from the speaker 120C, and outputs scent from the incense generator 120D. Control is performed (S103). The control information of these display and output controls can be received together with or independently of the contents distributed from the management device 300.

After the distribution process in step S312, the management device 300 determines whether or not the user in front of the product display shelf has left the predetermined shelf front area based on the sensing information received from the product display shelf system 100 (S313). ), If not separated, the process returns to step S305, and based on the sensing information that changes in real time, the content extraction and distribution processing based on the pre-shelf psychology, the pre-shelf behavior, and the purchase motivation are repeated. Although the motion sensor 110B is used as a motion sensor, the motion sensor 110B is not limited to this, and may be configured to include a separate motion sensor such as an infrared sensor.

On the other hand, when it is determined that the user in front of the product display shelf has left the predetermined shelf front area, the user profile of the user specified in step S301 is updated. For example, the pre-shelf psychology specified in step S305 and the pre-shelf behavior specified in step S308 are registered in the user profile (S314). Further, the purchased product is registered in the purchase history of the user profile based on the product purchase information acquired from the sales management system (S315). Then, after registering / updating the user profile, it waits until a user (consumer) is detected in the shelf front area based on the sensing information (S316). As described above, the shelf front area is a range in which it can be detected that a user is in front of the shelf.

Further, in the user profile update process in steps S314 and S315, the content and output control information (content distribution result) actually distributed to the product display shelf system 100 can be stored in the storage device 330 in association with the user profile. it can. This process can be performed by the content control unit 322.

Next, returning to FIG. 4, the machine learning function of the present embodiment will be described. The learning control unit 323 can extract the content pattern that led to the purchase of the product, the user behavior pattern that led to the purchase of the product, and the like by using the purchase history and the content distribution result of the user profile stored in the storage device 330. it can.

For example, the content A delivered to the user who was viewing the product A is compared with the number of purchases of the product A, and when the number of purchases is equal to or greater than a predetermined number, the content A is determined to be effective in promoting purchase. be able to. On the other hand, when the number of purchases is less than a predetermined number, it can be determined that the content A has no effect on the purchase promotion.

In addition, the effect of each content is analyzed in detail in combination with facial expressions, gaze, product pick-up information, gender, age group, and staying time, and the learning control unit 323 uses the user profile, pre-shelf psychology, pre-shelf behavior, and Machine learning can be performed, such as changing the combination of each content extracted in relation to purchasing motivation. In addition, the purchase motivation analysis result can be updated / deleted, and a new purchase analysis result can be generated and added.

10 to 14 are diagrams showing an example of a purchasing support method to which the purchasing support system of the present embodiment is applied. FIG. 10 is a diagram showing an example of a purchasing support method when the purchasing support system is applied to the “cosmetics section”.

In the example of FIG. 10, the texture of the cosmetics picked up by the user is superimposed on the face image of the user taken by the camera 110A to display the situation when the user uses it (AR technology), or a tester (AR technology). The scent of the product picked up by the scent generator 120D) is output. Further, when the user is a repeater based on the user profile, discount information according to the number of visits can be output.

FIG. 11 is a diagram showing an example of a purchasing support method when the purchasing support system is applied to the “game corner”. In the example of FIG. 11, an appropriate popular game ranking is displayed based on the specified gender and age group, a simulated play video of the game (product) that the user is watching is displayed, and related goods are displayed. I'm playing. Further, as the voice output, the voice of the game character can be output.

FIG. 12 is a diagram showing an example of a purchasing support method when the purchasing support system is applied to the “lunch box corner”. In the example of FIG. 12, the nutrition and calories of the lunch box being viewed are displayed, the cooking process of each lunch box is sequentially displayed on each small display device of the monitor unit 120B when looking over the shelf, and a moving image is displayed. It is displayed on the display device 120A.

FIG. 13 is a diagram showing an example of a purchasing support method when the purchasing support system is applied to the “clothes corner”. In the example of FIG. 13, accessories and clothes information suitable for the specified gender and age group are displayed, and coordination information and the like are displayed based on the purchase history of the user profile. In addition, the clothes and size information of different colors of the clothes being viewed are displayed, and the image of the clothes and accessories picked up by the user is superimposed on the whole body image of the user taken by the camera 110A, and the user wears it. It is possible to display the situation at the time of this (AR technology).

FIG. 14 is a diagram showing an example of a purchasing support method when the purchasing support system is applied to the “meat corner”. In the example of FIG. 14, the scent of roasted meat is output from the incense generator 120D, the sound of roasting meat is output from the speaker 120C, and the nutritional information of the meat being viewed or picked up is used. It displays calories and cooking recipes.

Further, in each of the purchasing support methods illustrated in FIGS. 10 to 14, not only the advertisement and the profitable information are displayed based on the user action in front of the shelf of the product display shelf system 100, but also the psychology in front of the shelf of the user and By grasping the behavior in front of the shelves, it is possible to perform fine-tuned content distribution and display control suitable for the user's willingness to purchase.

Although the embodiment has been described above, the control unit 130 of the product display shelf system 100 may be connected to the sensing unit 110 and the output unit 120 wirelessly or by wire to be physically provided outside the product display shelf. It is possible.

Further, the management device 300 distributes the content to the product display shelf system 100 via the network, but the content data is not limited to this, and for example, the content data is collectively collected from the management device 300 to the product display shelf system 100 at a predetermined timing. The content can be stored in advance on the control unit 130 side. In this case, the management device 300 may generate and extract output control information of each content and transmit it to the product display shelf system 100 without transmitting the content data (actual data such as images, videos, and character information). it can. The control unit 130 can extract the contents stored in advance in the storage device 133 based on the received output control information and control the output of the output unit 120.

In addition to the above, the management device 300 includes a display device such as a liquid crystal display, a CPU that controls the entire device (each part), a memory (main storage device), a mouse, a keyboard, a touch panel, a scanner, and the like. An operation input means, a printer, an output means such as a speaker, an auxiliary storage device (hardware, etc.), and the like can be provided.

Further, each function of the present invention can be realized by a program, a computer program prepared in advance for realizing each function is stored in the auxiliary storage device, and a control unit such as a CPU is stored in the auxiliary storage device. By reading the program into the main storage device and executing the program read into the main storage device by the control unit, the computer device can operate the functions of each part of the present invention. On the other hand, each function of the present invention can be configured by an individual control device, and can be configured by connecting a plurality of control devices directly or via a network.

Further, the above program can be provided to a computer in a state of being recorded on a computer-readable recording medium. Computer-readable recording media include optical discs such as CD-ROMs, phase-changing optical discs such as DVD-ROMs, magneto-optical disks such as MO (Magnet Optical) and MD (Mini Disk), floppy (registered trademark) disks, and the like. Examples include magnetic disks such as removable hard disks, compact flash (registered trademarks), smart media, SD memory cards, and memory cards such as memory sticks. In addition, a hardware device such as an integrated circuit (IC chip or the like) specially designed and configured for the purpose of the present invention is also included as a recording medium.

1: Shelf body 2A, 2B, 2C: Product display 100: Product display shelf system 110: Sensing unit 110A: Camera 110B: Motion sensor 110C: Capacitance sensor 120: Output unit 120A: Display device 120B: Monitor unit 120C : Speaker 120D: Incense generator 130: Control unit 131: Control device 131A: Sensor control unit 131B: Output control unit 132: Communication device 133: Storage device 300: Management device 310: Communication device 320: Control device 321: Analysis control unit 322: Content control unit 323: Learning control unit 330: Storage device

Claims (6)

Product display shelves and
Sensing provided on the product display shelf, including a first sensor device that acquires a consumer's face image located in front of the shelf and a second sensor device that acquires the consumer's movement with respect to the product displayed on the product display shelf. With the unit
A product display shelf system equipped with an output unit provided on the product display shelf and displaying predetermined contents, and
It is connected to the product display shelf system via a network, receives each sensor detection information acquired by the sensing unit, determines the purchase intention of the consumer, and makes the purchase intention to the consumer located in front of the shelf. It has a management device that performs a distribution process for displaying the content according to the above on the output unit.
The management device
The pre-shelf psychological pattern is specified based on the consumer's facial expression and line of sight detected from the face image, and the pre-shelf behavior pattern is specified based on the consumer's movement toward the product. And the analysis control unit that determines the consumer's willingness to buy pattern corresponding to the pre-shelf behavior pattern.
A storage unit that stores purchase support information associated with the content for each of the plurality of purchase motivation patterns.
A content control unit that selects the content based on the determined consumer's willingness to purchase pattern and performs distribution processing for displaying the content on the output unit.
A purchasing support system characterized by having. The sensing unit further includes a third sensor device that detects the movement of the product displayed on the product display shelf.
The analysis control unit is characterized in that the sensor detection information of the second sensor device and the third sensor device is combined to specify whether or not the consumer has picked up a specific product as the shelf front behavior pattern. The purchasing support system according to claim 1. The content control unit selects the content according to the consumer's pre-shelf psychological pattern, the pre-shelf behavior pattern, and the purchasing motivation pattern, and displays the selected plurality of the selected contents on the output unit. The purchase support system according to claim 1 or 2, wherein the delivery processing of the above is performed. The analysis control unit extracts consumer attributes including the gender and age group of consumers from the face image based on a predetermined face recognition process, and obtains the face image and user profile information associated with the consumer attributes. Along with generating and storing in the storage unit, pattern matching based on the face image is performed to identify the user profile information stored in the storage unit, and a store visit history to a store in which a product display shelf is installed and a store visit history. The purchase history of the products displayed on the product display shelf acquired from the predetermined sales management system that manages the sales history of the store is stored in association with the specified user profile information.
The content control unit selects the content based on any one or a combination of the gender, the age group, the store visit history, and the purchase history of the consumer based on the user profile information, and the content is described. The purchasing support system according to any one of claims 1 to 3, wherein a distribution process for displaying on an output unit is performed. The analysis control unit generates user profile information associated with the face image and stores it in the storage unit, and performs pattern matching based on the face image to store the user profile information stored in the storage unit. The purchase history of the products displayed on the product display shelf, which is specified and acquired from a predetermined sales management system that manages the sales history of the store, is stored in association with the user profile information.
Based on the result of the distribution process for displaying on the output unit and the purchase history, the result of the distribution process that led to the purchase of the product is the consumer's pre-shelf psychological pattern, the pre-shelf behavior pattern, and the said. The purchasing support system according to any one of claims 1 to 3, further comprising a learning control unit that evaluates each purchase intention. The output unit includes a first display device and a second display device that display the predetermined content.
The second display device is a monitor unit in which a plurality of display devices are unitized side by side.
The content control unit performs a distribution process for displaying one or a plurality of the contents on the first display device and the second display device, and the contents different from each display device of the second display device. The purchase support system according to any one of claims 1 to 5, wherein a distribution process for displaying the above is performed.