JP2018045454A - Purchase support system - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a purchase support system that grasps in-front-of-shelf mentality and in-front-of-shelf action of users, and analyzes affinity for buying of consumers comprehensively, thus supporting purchase through merchandise display shelves.SOLUTION: A purchase support system according to an embodiment of the present invention comprises: a merchandise display shelf system; and a management device. The merchandise display shelf system includes: a sensing unit including a first sensor instrument for obtaining a face image of a consumer located in front of a merchandise display shelf, and also including a second sensor instrument for obtaining motion of the consumer with respect to merchandise on the merchandise display shelf; and an output unit for displaying predetermined content. The management device receives each sensor detection information obtained by the sensing unit, distinguishes affinity for buying of the consumer, and supplies content, depending on the affinity for buying, to be displayed on the output unit, for the consumer located in front of the shelf. The management device determines a mentality pattern in front of the shelf on the basis of facial expression and a gaze direction of the consumer, having been detected from the face image, and determines an action pattern in front of the shelf on the basis of the motion of the consumer with respect to the merchandise, thus distinguishing a pattern of affinity for buying of the consumer depending on each of the mentality and action patterns.SELECTED DRAWING: Figure 4

Description

  The present invention relates to a purchase support technology via a merchandise display shelf.

  As described in Patent Documents 1 and 2, techniques for promoting advertising by displaying advertisement information and the like to consumers have been proposed.

Japanese Patent Laying-Open No. 2015-88166 JP2015-156211A

  However, the conventional techniques as described in Patent Documents 1 and 2 grasp the consumer's behavior by picking up a product or detecting a line of sight, but only a part of the behavior is detected. There was no comprehensive understanding of consumer psychology and willingness to purchase, and it was not possible to provide information suitable for consumer psychology and behavior.

  SUMMARY OF THE INVENTION Accordingly, an object of the present invention is to provide a purchasing support system that grasps a user's pre-shelf psychology and pre-shelf behavior with respect to a merchandise display shelf, comprehensively analyzes consumers' purchase intentions, and performs purchase support via the merchandise display shelf. Is to provide.

(1) The purchase support system of the present invention acquires a commodity display shelf, a first sensor device that acquires a consumer's face image located in front of the shelf, and a consumer's movement with respect to the commodity displayed on the commodity display shelf. A product display shelf system including a sensing unit provided on the product display shelf, and an output unit provided on the product display shelf and displaying predetermined content, and the product display shelf system, Connected via a network, receive each sensor detection information acquired by the sensing unit to determine the consumer's willingness to purchase, the content according to the purchasing intention to the consumer located in front of the shelf And a management device that performs distribution processing for display on the output unit.

  The management device identifies a pre-shelf psychological pattern based on a consumer's facial expression and line of sight detected from the face image, and identifies a pre-shelf behavior pattern based on a consumer's movement with respect to the product An analysis control unit for determining a consumer's purchase intention pattern corresponding to the pre-shelf psychological pattern and the pre-shelf behavior pattern; and a storage unit for storing purchase support information in which the content is associated with each of the plurality of purchase intention patterns A content control unit that performs distribution processing for selecting the content based on the determined consumer's purchase intention pattern and displaying the content on the output unit.

(2) In the above (1), the sensing unit may further include a third sensor device that detects the movement of the product displayed on the product display shelf, and the analysis control unit includes the second sensor device and By combining sensor detection information of the third sensor device, it can be configured to specify whether the consumer has picked up a specific product as the behavior pattern before the shelf.

(3) In the above (1) or (2), the content control unit selects and selects the content according to the consumer's pre-shelf psychological pattern, the pre-shelf behavior pattern, and the purchase motivation, respectively. A delivery process for displaying a plurality of the contents on the output unit can be performed.

(4) In the above (1) to (3), the analysis control unit extracts a consumer attribute including a sex and an age group of a consumer from the face image based on a predetermined face recognition process, and the face image And the user profile information associated with the consumer attribute is generated and stored in the storage unit, and the user profile information stored in the storage unit is specified by performing pattern matching based on the face image, The user profile information in which the store visit history to the store where the display shelf is installed and the purchase history of the product displayed on the product display shelf acquired from a predetermined sales management system for managing the store sales history are specified Can be stored in association with The content control unit selects the content based on any one or a combination of the gender, the age group, the store visit history, and the purchase history of the consumer based on the user profile information. , A delivery process for displaying on the output unit can be performed.

(5) In the above (1) to (3), the analysis control unit generates user profile information associated with the face image, stores the user profile information in the storage unit, and performs pattern matching based on the face image. The user profile information stored in the storage unit is specified, and a purchase history of a product displayed on a product display shelf acquired from a predetermined sales management system that manages a sales history of a store is associated with the user profile information Can be remembered. And based on the result of the delivery process for displaying on the output unit and the purchase history, the result of the delivery process that led to the purchase of the product is the consumer's pre-shelf psychological pattern, the pre-shelf behavior pattern, And it can comprise so that the learning control part evaluated for every said purchase will may be further provided.

(6) In the above (1) to (5), the output unit may be configured to include a first display device and a second display device that display the predetermined content. The second display device can be configured as a monitor unit in which a plurality of display devices are arranged side by side. At this time, the content control unit performs distribution processing for displaying each of the one or a plurality of the contents on the first display device and the second display device, respectively, and on each display device of the second display device. A distribution process for displaying different contents can be performed.

  ADVANTAGE OF THE INVENTION According to this invention, a consumer's willingness to purchase is grasped | ascertained by grasping | ascertaining a user's pre-shelf psychology and pre-shelf action with respect to a merchandise display shelf, and the purchase support via a merchandise display shelf can be performed.

It is a lineblock diagram of a purchase support system via a goods display shelf of a 1st embodiment. It is a figure which shows the structural example of the monitor unit installed in the goods display shelf of 1st Embodiment. 1 is a configuration block diagram of a merchandise display shelf system and a management device that constitute a purchase support system of a first embodiment. It is a figure for demonstrating the sensing unit function, the analytic unit function, and the output unit function which are contained in the purchase assistance method of 1st Embodiment. It is a figure which shows an example of the user profile of 1st Embodiment. It is a figure which shows the example of control of the delivery content based on the user action (consumer action) of 1st Embodiment. It is a figure which shows an example of the psychological analysis before shelf and the behavior analysis before shelf of 1st Embodiment. It is a figure which shows an example of the delivery content pattern with respect to the purchase willingness analysis result based on the shelf front psychology and the shelf front action of 1st Embodiment, and a purchase willingness analysis result. It is a figure which shows the processing flow of the purchase assistance system via the goods display shelf of 1st Embodiment. It is a figure which shows an example of the purchase assistance method at the time of applying the purchase assistance system via the goods display shelf of 1st Embodiment to the "cosmetics department." It is a figure which shows an example of the purchase assistance method at the time of applying the purchase assistance system via the goods display shelf of 1st Embodiment to a "game corner." It is a figure which shows an example of the purchase assistance method at the time of applying the purchase assistance system via the merchandise display shelf of 1st Embodiment to the "lunch corner". It is a figure which shows an example of the purchase assistance method at the time of applying the purchase assistance system via the goods display shelf of 1st Embodiment to the "clothing corner". It is a figure which shows an example of the purchase assistance method at the time of applying the purchase assistance system via the merchandise display shelf of 1st Embodiment to the "meat corner".

  Hereinafter, embodiments will be described with reference to the drawings.

(First embodiment)
1 to 14 are diagrams showing a first embodiment. FIG. 1 is a configuration diagram of a purchase support system (hereinafter referred to as a purchase support system) via a product display shelf according to the present embodiment. The purchase support system includes the product display shelf system 100 and the management device 300, and is connected wirelessly or wired via a network such as an IP network.

  As shown in FIG. 1, the product display shelf system 100 includes a shelf main body 1 that extends in the height (Z direction) and product display portions 2A, 2B, and 2C that extend forward from the shelf main body 1. Based product display shelves. The plurality of merchandise display portions 2A, 2B, 2C are spaced apart from each other in the height direction at a predetermined interval. The product display parts 2A, 2B, 2C have a predetermined lateral width (X direction) and depth (Y direction), and protrude from the shelf main body part 1 in the Y direction. The product display parts 2A, 2B, 2C can also be provided such that the upper surfaces of the product display parts 2A, 2B, 2C are inclined downward with respect to the height direction. The product display shelf shown in FIG. 1 is an example, and may be a shelf in which a product display area having at least a predetermined width and depth is formed.

  As illustrated in FIG. 1, the commodity display shelf system 100 includes a camera 110A (corresponding to a first sensor device), a motion sensor 110B (corresponding to a second sensor device), and a capacitance sensor 110C (third sensor device). A display unit 120A, a monitor unit 120B, a speaker 120C, an incense generator 120D, and an output unit 120, and a control unit 130.

  The camera 110 </ b> A is a photographing device that photographs a user (consumer) in front of the shelf, and photographs a user's still image or moving image. The motion sensor 110B is a non-contact type motion sensor including a distance image sensor using infrared rays or a laser, and can detect a distance to an object in the image. As the distance image sensor, there are a “Light Coding (pattern irradiation method)” method and a “TOF (Time of Flight)” method, and the distance is measured by irradiating infrared rays or a laser and reading the reflection. In combination with a camera that detects the position of an object separately from the distance image sensor, for example, the movement of a person is detected based on the position and distance.

  The camera 110 </ b> A and the motion sensor 110 </ b> B are provided on the upper part of the product display shelf in order to photograph at least the upper body of the user located in front of the shelf. On the other hand, the capacitance sensor 110C is provided on the upper surface on which the product is placed in the product display units 2A, 2B, 2C. The capacitance sensor 110C is a capacitance type proximity sensor, and a product is placed on the capacitance sensor 110C. When the user picks up the product placed on the hand, the capacitance changes, so that the presence or absence of the product placed on the product display shelf can be detected.

  In the present embodiment, the combination of the motion sensor 110B and the capacitance sensor 110C makes it possible to accurately grasp that the user has picked up the product as a pre-shelf action. It is also possible to grasp that the user has picked up the product using any one of the camera 110A, the motion sensor 110B, and the capacitance sensor 110C. For example, the product picked up in the user's image taken by the camera 110A is detected, the product is detected as an object by the motion sensor 110B, and the action of the product moving with the user is detected. By detecting the presence or absence of a product at 110C, it is possible to grasp that the user has picked up the product in front of the shelf. It is also possible to grasp that the user has picked up the product by arbitrarily combining the sensor detection information of the sensing unit 110.

  Next, the display device 120 </ b> A is provided on the upper part of the merchandise display shelf and displays content distributed from the management device 300. On the other hand, as shown in FIG. 2, the monitor unit 120B is a unit in which a plurality of small display devices M1 to M8 are arranged side by side. As shown in FIG. 1, the monitor unit 120 </ b> B is provided on the end surface of the product display portions 2 </ b> A, 2 </ b> B, and 2 </ b> C and is disposed facing the user located in front of the shelf.

  The speaker 120C outputs reproduced audio data (music, BGM, sound effects, etc.). The audio data includes audio associated with content (video, image, text information, advertisement information) displayed on the display device 120A and the monitor unit 120B and audio unrelated to the content. The incense generating device 120D outputs a scent of cosmetics and perfume, a scent of food, and the like. For example, it is possible to configure so that a fragrance (raw material) from which a scent originates is installed and the scent is sent out by a blower such as a fan. A plurality of fragrances (raw materials) may be installed in advance, and for example, a plurality of scents may be switched and sent in response to the analysis results of the user's pre-shelf psychology, pre-shelf behavior, and purchase intention.

  The control unit 130 is connected to the management apparatus 300 via a network, transmits the sensor detection information of the sensing unit 110 to the management apparatus 300, and receives content (including output control information) provided from the management apparatus 300.

  FIG. 3 is a configuration block diagram of the commodity display shelf system 100 and the management apparatus 300 that constitute the purchase support system. Note that the management apparatus 300 of this embodiment can be connected to one or a plurality of product display shelf systems 100.

  The commodity display shelf system 100 includes the sensing unit 110, the output unit 120, and the control unit 130 as described above, and the control unit 130 includes the control device 131, the communication device 132, and the storage device 133. The communication device 132 performs communication control with the management device 300 via the network. The storage device 133 stores information necessary for control by the control unit 130 and various information transmitted from the management device 300.

  The sensor control unit 131A of the control device 131 controls each sensor device of the sensing unit 110 and collects sensor detection information output from each sensor device. The sensor detection information is transmitted to the management device 300 via the communication device 132. The output control unit 131B receives content distributed from the management apparatus 300 and output control information, and performs output control on each output device of the output unit 120.

  The management device 300 includes a communication device 310, a control device 320, and a storage device 330. The communication device 310 performs communication control with the merchandise display shelf system 100. The storage device 330 stores various information such as information necessary for control by the control device 320 and sensor detection information transmitted from the product display shelf system 100.

  The control device 320 includes an analysis control unit 321, a content control unit 322, and a learning control unit 323. FIG. 4 is a diagram for explaining a sensing unit function, an analytic unit function, and an output unit function included in the purchase support method of the present embodiment. The sensing unit function and the output unit function are realized by the merchandise display shelf system 100, and the analytic unit function is realized by the management device 300.

  As illustrated in FIG. 4, the analysis control unit 321 performs each process of a user specifying process, a pre-shelf psychological analysis process, a pre-shelf behavior analysis process, and a purchase motivation analysis process.

  The user identification process is a user profile registration / update process, which performs a face recognition process using the user image data captured by the camera 110A to identify (register) the user. For example, the user's gender and age group can be analyzed by face recognition technology and registered as a user profile. At this time, it is possible to determine whether the user is a new user or a repeater by performing pattern matching with the face image of the already registered user profile. In the case of a repeater, store visit history such as the number of visits is registered and updated as a user profile.

  FIG. 5 is a diagram illustrating an example of a user profile. The user profile includes user face image data, gender, age group, facial expression, line of sight, merchandise information, staying time, number of visits, purchase history, and the like. The analysis control unit 321 grasps the gender, age group, facial expression, and line of sight of the user using face recognition technology, and registers them in the user profile. Further, it is possible to register information on the product based on the behavior analysis before the shelf described later, the stay time before the shelf detected by using the sensing unit 110 as a human sensor, and the number of visits described above.

  A known method can be applied to the face recognition technique executed by the analysis control unit 321. For example, gender, age group, facial expression, etc. can be detected by analyzing a face image using feature points and patterns. Further, the position of the eyes (iris, cornea, pupil) of the user's face image taken with a visible camera or infrared camera is detected, and displayed on the product display units 2A, 2B, 2C based on the detected eye position. It is possible to grasp a specific product viewed by the selected user. In addition, each product displayed on the product display units 2A, 2B, and 2C and position information of the product can be stored in the storage device 330 in advance.

  The purchase history can be acquired from a sales management system (POS system). For example, the face image of the user is acquired at the time of checkout settlement, and the sales management system sets the checkout settlement result (information for identifying the purchased product) and the face image of the user as a set via the product display shelf system 100 or directly. To the management device 300. The user's face image may be transmitted to the management apparatus 300 separately from the sales management system. For example, the face image of the user can be taken at the cash register and transmitted to the management device 300 in synchronization with the timing at which the POS information is transmitted from the cash register to the sales management system at the checkout. The management apparatus 300 can associate the two based on the time stamp of the POS information acquired from the sales management system and the acquired time stamp of the face image of the user.

  The analysis control unit 321 can search the user profile using the user's face image associated with the cashier settlement result (POS information), and store the purchased product as a purchase history in the corresponding user profile.

  The pre-shelf psychological analysis process analyzes the user's pre-shelf psychology for the product of the product display shelf system 100 based on the user's facial expression and line-of-sight movement identified by the face recognition process described above.

  The pre-shelf behavior analysis process combines the user behavior detected by the motion sensor 110B and the movement of the product detected by the capacitance sensor 110C, and the user picks up the product (information on the product hand). ). The information collected by the merchandise hand is grasped as a pre-shelf action. Further, as described above, the position information of the product placed on the product display shelf system 100 can be stored in the storage device 330 in advance, and the position information of the product detected by the capacitance sensor 110C is also stored in advance. It is remembered. For this reason, it is possible to specify which product is the product actually picked up. As the information on the product hand registered in the user profile, for example, it is possible to grasp the action taken on the hand for a specific product such as “I picked up the product A”.

  The purchase motivation analysis process is a process of analyzing the user's purchase motivation using the pre-shelf psychological analysis result by the pre-shelf psychological analysis process and the pre-shelf behavior analysis result by the pre-shelf behavior analysis process. The details of each analysis process of the pre-shelf psychology, the pre-shelf behavior, and the purchase motivation will be described later.

  FIG. 6 is a diagram illustrating an example of distribution content control based on user behavior (consumer behavior). The content control unit 322 extracts the content and output control information to be provided to the product display shelf system 100 by using the user identification result, the pre-shelf psychological analysis result, the pre-shelf behavior analysis result, and the purchase intention analysis result in combination. To deliver.

  As shown in FIG. 6, when the user comes in front of the merchandise display shelf system 100 (in front of the shelf), the user knows that the user is in front of the shelf based on the sensor detection information of the motion sensor 110B. At this time, a user's face image is image | photographed with camera 110A, a user's facial expression and eyes | visual_axis are grasped | ascertained, specifying a user using face recognition information.

  First, a user profile is specified by matching with a user's face image. When a user profile exists, as a known user, a product candidate is extracted using the purchase history of the user profile, content (product information) related to the extracted product candidate is selected and transmitted to the product display shelf system 100 To do. On the other hand, if a user profile does not exist, it is assumed that the user is a new user, product candidates suitable for the gender and age group grasped from the user's face image are extracted, and content related to the extracted product candidates is selected and the product is selected. It transmits to the display shelf system 100.

  As described above, content distribution based on the specified user profile is based on one or a combination of one or more of the gender, age group, visit history, and purchase history of the consumer (user) based on the user profile. Can be configured to perform distribution processing for displaying on the output unit. For example, for female repeaters who have visited the store more than 5 times, offer preferential reservation information for limited items or offer discounted deals over female repeaters and male users who have visited less than 5 times You can do it.

  Note that information to be provided to the merchandise display shelf system 100 is stored in the storage unit 330 of the management apparatus 300, and such information is provided as content. For example, content information to be distributed can be accumulated by selecting candidate products for the product in the purchase history in advance, or selecting candidate products for each gender and age group in advance. .

  Next, based on the user's line-of-sight information, for example, it can be understood that the product B is being viewed. Therefore, the product viewed by the user can be specified based on the line-of-sight information, and the product description information and advertisement information of the specified product B can be extracted and transmitted to the product display shelf system 100. At this time, output (display) control information is sent to the product display shelf system 100 so as to display an effect (emphasis or decoration) in the display of product description information and advertisement information related to the product B actually viewed by the user. Can be sent.

  In addition, it is possible to grasp whether the product is picked up as a user action before the shelf. Based on the information picked up by the product hand, the content related to the product A picked up is extracted and transmitted to the product display shelf system 100, or the profit information related to the product A picked up is extracted and the product is extracted. Or transmitted to the display shelf system 100. The profit information is, for example, information that recommends a product C that is advantageous when it is purchased together with the product A (a discount can be applied or a combination effect is high).

  Next, in this embodiment, based on the pre-shelf psychology by facial expression and line of sight and the pre-shelf behavior by the product information, the user's purchase intention is analyzed, and the content related to the analyzed purchase intention is extracted. It transmits to the commodity display shelf system 100. Content distribution and display control based on the user's willingness to purchase, for example, can switch the displayed content to content that encourages the willingness to purchase, display the displayed content after effect processing, and play music and audio. Or additional display of deals.

  As described above, in this embodiment, based on the user action in front of the shelf of the product display shelf system 100, not only the advertisement and the profit information are displayed, but the user's mentality in front of the shelf and the action in front of the shelf are grasped, and the user Detailed content distribution and display control suitable for customers' willingness to purchase.

  One sensor device is insufficient to comprehensively grasp the user's pre-shelf psychology and willingness to purchase, and the product display shelf system 100 of this embodiment includes a sensing unit 110 including a plurality of sensor devices. And comprehensively grasp the user's pre-shelf psychology and willingness to purchase.

  The purchase support system according to the present embodiment is not dependent on a single sensor device, but is a sensing unit 110 including a plurality of sensor devices. The consumer attribute (profile), pre-shelf psychology (psychological situation), and pre-shelf behavior are determined. It is grasped and transmitted to the management apparatus 300, and the analytic unit of the management apparatus 300 analyzes the psychological state and behavior of the user in front of the shelves of the product display shelf system 100 to comprehensively extract the user's willingness to purchase. Then, it is possible to provide the content that prompts the purchase to the purchase motivation comprehensively grasped from the user's psychological state and behavior through the output unit 120 of the merchandise display shelf system 100 to promote the purchase behavior of the user. it can.

  FIG. 7 is a diagram illustrating an example of the pre-shelf psychological analysis and the pre-shelf behavior analysis of the present embodiment. The pre-shelf psychological analysis performs user facial expression analysis and line-of-sight analysis using a photographed image, and analyzes the user's pre-shelf psychology from both the user's facial expression and line of sight. In facial expression analysis, for example, feature points of facial expressions such as bright, confused, and no expression are patterned in advance to determine whether the user's facial expression is “bright”, “confused”, or “no expression”. In addition, various facial expression analysis such as “joy”, “surprise”, “anger”, “sadness” can also be performed.

  In the line-of-sight analysis, if the position of the eyes (iris, cornea, pupil) of the user's face image detected as described above is within a predetermined range for a predetermined time, the line of sight is concentrated on one point. Or if the position fluctuates up, down, left, and right for a predetermined time, it can be determined that it is dispersed.

  The pre-shelf psychology is pre-patterned by a combination of the facial expression analysis result and the line-of-sight analysis result, and the pre-shelf psychological patterns A to E are stored in the storage device 330 in advance as shown in FIG. Yes. The analysis control unit 321 uses the facial expression analysis result and the line-of-sight analysis result to extract a pre-shelf psychological pattern that is set in advance and identifies the user's pre-shelf psychology.

  As described above, the pre-shelf behavior analysis is performed by combining the user behavior detected by the motion sensor 110B and the movement of the merchandise detected by the capacitance sensor 110C. Pattern). For example, it is possible to specify that a product is not picked up, a specific product is picked up, a specific product picked up is returned to the shelf, and the like.

  FIG. 8 is a diagram illustrating an example of a purchase motivation analysis result based on the pre-shelf psychology and the pre-shelf behavior of the present embodiment, and a distribution content pattern for the purchase motivation analysis result. As shown in FIG. 8, the willingness to purchase is pre-patterned by a combination of the specified pre-shelf psychological pattern and pre-shelf behavior pattern, and each analysis result thus patterned is stored in the storage device 330 in advance. Yes. The analysis control unit 321 extracts a purchase intention analysis result pattern set in advance using the pre-shelf psychological pattern and the pre-shelf behavior pattern, and specifies the user's purchase intention.

  The content control unit 322 extracts content corresponding to the user's willingness to purchase specified by the analysis control unit 321 from the content group, and transmits the content to the product display shelf system 100. The storage device 330 stores in advance a distribution content pattern (purchase support information) in which a purchase intention analysis result and a content to be distributed are linked, and the content control unit 322 uses the purchase intention analysis result to distribute content. The pattern is specified, and the corresponding content is extracted from the content group stored in the storage device 330 and transmitted to the merchandise display shelf system 100.

  Each content included in the content group can prepare, for example, a plurality of contents 1 for each product, and a distribution content pattern corresponding to the analysis result 1 can be individually set for each product. Therefore, for example, the content control unit 322 extracts the content 1 corresponding to the analysis result 1, but extracts the content 1 corresponding to the specific product picked up by the user specified by the analysis control unit 321 from the content group. Then, it can be transmitted to the merchandise display shelf system 100.

  FIG. 9 is a diagram showing a processing flow of the purchase support system via the merchandise display shelf of the present embodiment. As shown in FIG. 9, the merchandise display shelf system 100 controls the operation of the sensing unit 110, collects (acquires) the sensor detection results in real time (S101), and transmits them to the management apparatus 300 as sensing information (S102). .

  The product display shelf system 100 (control unit 130) detects that a user approaching the product display shelf system 100 is within a predetermined range, and triggers that a user is detected in front of the shelf. In addition, it may be configured to perform operation control of the sensing unit 110 and transmission control of sensing information to the management apparatus 300.

  The management device 300 uses the user's captured image received from the product display shelf system 100 to match the face image of the user profile that has already been stored (registered) using the user's face image. Whether registration is present is determined (S301). If the user profile does not exist (NO in S302), the management apparatus 300 determines that the user is a new user, calculates gender and age from the user's face image (S303), and newly registers the profile (S304).

  When a user profile already exists (YES in S302) and when a user profile is newly registered, the management apparatus 300 extracts content based on the user profile (S311).

  Next, in step S305, the user's pre-shelf psychology is specified, and content corresponding to the specified pre-shelf psychology is extracted (S306). After the pre-shelf psychology is specified or when the pre-shelf behavior is detected (YES in S307), the user's pre-shelf behavior is specified (S308). Thereafter, the user's willingness to purchase based on the specified pre-shelf psychology and pre-shelf behavior is determined (S309), and content based on the determined purchasing motivation is extracted (S310). At this time, as described above, it is also possible to extract content related only to the pre-shelf behavior specified in step S308.

  The management apparatus 300 performs distribution control of each content extracted in relation to the user profile, the pre-shelf psychology, the pre-shelf behavior, and the purchase intention (S312). For example, a distribution process for displaying the extracted content on a single or a plurality of displays is performed.

  Specifically, each content is individually displayed on each small display device of the monitor unit 120B, or as described with reference to FIG. 6, user profiles, pre-shelf psychology, pre-shelf behavior, and purchase intention In order, each content can be switched and displayed. Further, different contents can be displayed on each of the display device 120A and the monitor unit 120B. Further, different contents can be displayed on each of the plurality of small display devices M1 to M8 constituting the monitor unit 120B. The small display devices M1 to M8 may be used as one display unit, and the content may be partitioned into small display devices M1 to M8 for display.

  In addition, since the monitor unit 120B has a plurality of small display devices arranged side by side, it is also possible to display a plurality of narrative contents on each small display device.

  The merchandise display shelf system 100 displays the content received from the management device 300 on the output unit 120, outputs sounds such as music, voice, and sound effects from the speaker 120C, and outputs scent from the incense generator 120D. Control is performed (S103). These display and output control information can be received together with the content distributed from the management apparatus 300 or alone.

  After the distribution process in step S312, the management apparatus 300 determines whether or not the user in front of the product display shelf has left the predetermined shelf area based on the sensing information received from the product display shelf system 100 (S313). ) If not, the process returns to step S305, and based on the sensing information that changes in real time, the content extraction and distribution processing based on the pre-shelf psychology, the pre-shelf behavior, and the purchase motivation are repeatedly performed. Although the motion sensor 110B is used as a human sensor, the present invention is not limited to this, and a human sensor such as a separate infrared sensor may be provided.

  On the other hand, if it is determined that the user in front of the merchandise display shelf has left the predetermined shelf front area, the user profile of the user specified in step S301 is updated. For example, the pre-shelf psychology specified in step S305 and the pre-shelf behavior specified in step S308 are registered in the user profile (S314). Further, based on the product purchase information acquired from the sales management system, the purchased product is registered in the purchase history of the user profile (S315). Then, after registration / update of the user profile, the process waits until a user (consumer) is detected in the front shelf area based on the sensing information (S316). In addition, as above-mentioned, a shelf front area is a range which can detect that a user exists in front of a shelf.

  In the user profile update process in steps S314 and S315, the content and output control information (content distribution result) actually distributed to the product display shelf system 100 may be stored in the storage device 330 in association with the user profile. it can. This processing can be performed by the content control unit 322.

  Next, returning to FIG. 4, the machine learning function of this embodiment will be described. The learning control unit 323 may extract a content pattern that leads to purchase of a product, a user behavior pattern that leads to purchase of a product, and the like using the purchase history and content distribution result of the user profile stored in the storage device 330. it can.

  For example, the content A distributed to the user who was viewing the product A is compared with the number of purchases of the product A. If the number of purchases is equal to or greater than a predetermined number, it is determined that the content A is effective in promoting purchases. be able to. On the other hand, when the number of purchases is less than the predetermined number, it can be determined that the content A has no effect on purchase promotion.

  In addition, the effect of each content is analyzed in detail in combination with facial expression, line of sight, product information, gender, age group, stay time, and the learning control unit 323 has a user profile, pre-shelf psychology, pre-shelf behavior, and It is possible to perform machine learning such as changing a combination of contents extracted in relation to purchase intention. Further, the purchase intention analysis result can be updated / deleted, or a new purchase analysis result can be generated and added.

  10 to 14 are diagrams illustrating an example of a purchase support method to which the purchase support system of the present embodiment is applied. FIG. 10 is a diagram illustrating an example of a purchase support method when the purchase support system is applied to a “cosmetic department”.

  In the example of FIG. 10, the user's facial image captured by the camera 110A is superimposed on the texture of the cosmetics taken by the user to display the situation when the user uses (AR technology) or a tester ( The scent of the product picked up by the scent generator 120D) is output. In addition, when the user is a repeater based on the user profile, discount information corresponding to the number of visits can be output.

  FIG. 11 is a diagram illustrating an example of a purchase support method when the purchase support system is applied to a “game corner”. In the example of FIG. 11, an appropriate popular game ranking is displayed based on the specified gender and age group, a simulated play video of a game (product) that the user is viewing, and related goods are displayed. It is. In addition, as voice output, the voice of the game character can be output.

  FIG. 12 is a diagram illustrating an example of a purchase support method when the purchase support system is applied to a “lunch box corner”. In the example of FIG. 12, the nutrition and calories of the lunch box being viewed are displayed, the cooking process of each lunch box is sequentially displayed on each small display device of the monitor unit 120B when looking over the shelf, Or displayed on the display device 120A.

  FIG. 13 is a diagram illustrating an example of a purchase support method when the purchase support system is applied to the “clothing corner”. In the example of FIG. 13, accessories and clothes information appropriate for the specified gender and age group are displayed, and coordinate information is displayed based on the purchase history of the user profile. Also, the user can wear different colors and clothing size information of the clothes they are looking at, or superimpose images of clothes and accessories taken by the user on the user's whole body image taken by the camera 110A. It is possible to display the situation at the time (AR technology).

  FIG. 14 is a diagram illustrating an example of a purchase support method when the purchase support system is applied to the “meat corner”. In the example of FIG. 14, the scent of grilled meat is output from the scent generating device 120D, the sound of grilling meat is output from the speaker 120C, the nutrition information of the meat being viewed and the meat taken by the hand, It displays calories and cooking recipes.

  And in each purchase support method illustrated in FIG. 10 to FIG. 14, based on the user action in front of the shelf of the product display shelf system 100, not only simply displaying advertisements and profit information, By grasping the pre-shelf behavior, it is possible to perform fine content distribution and display control suitable for the user's willingness to purchase.

  Although the embodiment has been described above, the control unit 130 of the product display shelf system 100 may be physically or externally connected to the product display shelf by connecting to the sensing unit 110 and the output unit 120 wirelessly or by wire. Is possible.

  In addition, the management apparatus 300 distributes content to the product display shelf system 100 via the network. However, the present invention is not limited to this, and for example, content data is collectively collected from the management apparatus 300 to the product display shelf system 100 at a predetermined timing. And the content can be stored in advance on the control unit 130 side. In this case, the management apparatus 300 may generate and extract output control information for each content and transmit it to the product display shelf system 100 without transmitting content data (actual data such as images, videos, and character information). it can. The control unit 130 can extract the content stored in advance in the storage device 133 based on the received output control information and perform output control of the output unit 120.

  In addition to the above-described hardware configuration, the management device 300 includes a display device such as a liquid crystal display, a CPU that controls the entire device (each unit), a memory (main storage device), a mouse, a keyboard, a touch panel, a scanner, and the like. Operation input means, output means such as a printer and a speaker, an auxiliary storage device (hard disk or the like), and the like can be provided.

  In addition, each function of the present invention can be realized by a program, a computer program prepared in advance for realizing each function is stored in the auxiliary storage device, and a control unit such as a CPU is stored in the auxiliary storage device. By reading the program into the main storage device and executing the program read into the main storage device, the control unit can cause the computer device to operate the functions of the respective units of the present invention. On the other hand, each function of the present invention can be configured by individual control devices, and a plurality of control devices can be connected directly or via a network.

  Further, the program can be provided to a computer in a state where the program is recorded on a computer-readable recording medium. Computer-readable recording media include optical disks such as CD-ROM, phase change optical disks such as DVD-ROM, magneto-optical disks such as MO (Magnet Optical) and MD (Mini Disk), floppy (registered trademark) disks, Examples include magnetic disks such as removable hard disks, memory cards such as compact flash (registered trademark), smart media, SD memory cards, and memory sticks. A hardware device such as an integrated circuit (IC chip or the like) specially designed and configured for the purpose of the present invention is also included as a recording medium.

1: Shelf body 2A, 2B, 2C: Product display unit 100: Product display shelf system 110: Sensing unit 110A: Camera 110B: Motion sensor 110C: Capacitance sensor 120: Output unit 120A: Display device 120B: Monitor unit 120C : Speaker 120D: Incense generating device 130: Control unit 131: Control device 131A: Sensor control unit 131B: Output control unit 132: Communication device 133: Storage device 300: Management device 310: Communication device 320: Control device 321: Analysis control unit 322: Content control unit 323: Learning control unit 330: Storage device

Claims (6)

Product display shelves,
Sensing provided on a merchandise display shelf, including a first sensor device that acquires a facial image of a consumer located in front of the shelves and a second sensor device that acquires consumer movements for the merchandise displayed on the merchandise display shelves Unit,
A product display shelf system provided on the product display shelf and including an output unit for displaying predetermined content;
Connected to the product display shelf system via a network, receives each sensor detection information acquired by the sensing unit to determine a consumer's willingness to purchase, and the consumer who is in front of the shelf A management device that performs a distribution process for causing the output unit to display the content according to
The management device
The pre-shelf psychological pattern is specified based on the consumer's facial expression and line of sight detected from the face image, and the pre-shelf behavior pattern is specified based on the consumer's movement with respect to the product. And an analysis control unit for discriminating a consumer's purchase willing pattern corresponding to the pre-shelf behavior pattern;
A storage unit that stores purchase support information in which the content is associated with each of a plurality of purchase willing patterns;
A content control unit that performs distribution processing for selecting the content based on the determined consumer's purchase willing pattern and displaying the content on the output unit;
A purchase support system characterized by comprising: The sensing unit further includes a third sensor device that detects the movement of the product displayed on the product display shelf,
The analysis control unit identifies whether the consumer has picked up a specific product as the action pattern before the shelf by combining sensor detection information of the second sensor device and the third sensor device. The purchase support system according to claim 1.   The content control unit selects each of the contents according to the consumer's pre-shelf psychological pattern, the pre-shelf behavior pattern, and the purchase willing pattern, and causes the output unit to display the selected plurality of contents. The purchase support system according to claim 1, wherein the distribution processing is performed. The analysis control unit extracts consumer attributes including a sex and an age group of the consumer from the face image based on a predetermined face recognition process, and user profile information associated with the face image and the consumer attribute is extracted. Generating and storing in the storage unit, specifying the user profile information stored in the storage unit by performing pattern matching based on the face image, and a store visit history to a store where a product display shelf is installed; Storing the purchase history of the products displayed on the product display shelf acquired from a predetermined sales management system for managing the sales history of the store in association with the specified user profile information;
The content control unit selects the content based on any one or a combination of two or more of the gender, the age group, the store visit history, and the purchase history of the consumer based on the user profile information, The purchase support system according to any one of claims 1 to 3, wherein a distribution process for displaying on the output unit is performed. The analysis control unit generates user profile information associated with the face image and stores the user profile information in the storage unit, and performs pattern matching based on the face image and stores the user profile information stored in the storage unit. Specifying and storing the purchase history of the product displayed on the product display shelf acquired from a predetermined sales management system for managing the sales history of the store in association with the user profile information,
Based on the result of the distribution process for displaying on the output unit and the purchase history, the result of the distribution process that led to the purchase of the product is the consumer's pre-shelf psychological pattern, the pre-shelf behavior pattern, and the The purchase support system according to claim 1, further comprising a learning control unit that evaluates each purchase intention. The output unit includes a first display device and a second display device for displaying the predetermined content,
The second display device is a monitor unit in which a plurality of display devices are arranged side by side,
The content control unit performs distribution processing for displaying one or a plurality of the contents on each of the first display device and the second display device, and the content is different for each display device of the second display device. The purchase support system according to claim 1, wherein a distribution process for displaying is performed.