JP2012022589A - Method of supporting selection of commodity - Google Patents

Abstract

PROBLEM TO BE SOLVED: To feed back what a user who uses a commodity screen has gazed in a commodity screen, to a display mode in the commodity screen, and show a proper screen image to the user.SOLUTION: When there is no one who gazes at a screen in front of the screen, a commodity list screen 70a is displayed where images 71 of commodities are randomly arranged in the screen and scrolled. When a user approaches and gazes at a specific commodity image in the commodity list screen 70a, the commodity list screen 70a is displayed where the images 71 of the specific commodities in a gaze area 73 including a gaze point are displayed with a gaze area 73a set at the center, the commodity list screen 70a being positioned within the gaze area 73a. If the user continues gazing at the image 71 of the commodity in the gaze area 73a, the image 71 of the commodity is highlighted.

Description

  The present invention relates to digital signage that is provided on a vending machine or an advertisement display board in a facility and displays product information such as a product downloaded from an IP network, and in particular, the degree of customer's attention to the displayed display information. The present invention relates to a product selection support method that can be used by feeding back to a display form of product information.

  There is known a system using digital signage that displays contents related to products received from a communication system on a display device installed in a store, etc., and can advertise and advertise products to customers who visit the store. (For example, refer to Patent Document 1).

  As such a system, digital signage is used for an advertisement display board installed in a facility such as a vending machine or a convenience store installed in each place, and advertisement information of downloaded products (for example, product images, etc.) ) May be displayed on the display screen to promote or advertise the product. By the way, when advertising or promoting a product, it is necessary for the store side to know what the effect of the advertisement or advertising is. Techniques have also been proposed that detect the degree of customer attention (the degree of customer attention for each product).

  As an example, a technique has been proposed in which the degree of attention by a person of a product displayed on a display shelf of the product is calculated and the degree of attention of each product is displayed on a screen (see, for example, Patent Document 2). ).

  In the technique described in Patent Document 2, a camera and a position measurement device are provided on a display shelf, and a person (customer) who pays attention to a product on the display shelf is captured by the camera to acquire an image of the person. The position of this person is detected, and the direction of the face (face direction) and the direction of the line of sight facing the eye are detected from the image of this person, and the detected position, face direction and line of sight of the person are detected. The product that the person on the display shelf is interested in is detected from the direction, and the number of times each product on the display shelf is noticed is counted, and the product is noticed on the display screen for each product. For example, the number of times of attention is displayed as a degree of attention, such as displaying the number of times as a bar graph or a change in the number of times of attention per unit time as a degree of attention.

  As another example, a large-size main display area and one or more small-size sub-display areas are set on the display screen, and images captured by separate cameras are displayed in the main display area and the sub-display area. Detecting the display request level for each of these images of the viewer watching the display screen on which the video is displayed in the main display area and the sub display area, and displaying the video with the highest display request level in the main display area. When the display request level of each video is changed and the display request level of the video displayed in the sub display area is maximized, this video is replaced with the video displayed in the main display area until now. There is also proposed a technique for displaying the image (see, for example, Patent Document 3).

  In the technique described in Patent Document 3, even when the display request level by the viewer is obtained, a person who is in the vicinity of the display screen is imaged with a camera to acquire the face image, and the face is directed from the face image to the display screen. The viewer is recognized as a viewer, and the position coordinates of the viewer's face image are detected, and the direction of the viewer's face and the direction of the eyeball are recognized to detect the gaze direction for each viewer. Detecting the position coordinates of the gaze line on the display screen from the detected face image position coordinates and the line-of-sight direction, and determining the video of interest for each viewer based on the position coordinates of the line-of-sight To do. Then, based on the position coordinates of the face image, the degree of stillness of the viewer's face is detected, and thus how long the viewer is watching a certain video is calculated to calculate the satisfaction level. The degree of display request for each video is obtained by adding satisfaction for all the viewers for each video based on the video of interest and the determined video.

  As a method for measuring the direction of the person's line of sight, another method has been proposed in which the human face is obtained from the horizontal direction (left-right direction) and the vertical direction (up-down direction) of the person's face ( For example, see Patent Document 4).

  In the technique described in Patent Document 4, the face image is acquired from the video of a person captured by a camera, and the face in the face image is obtained with respect to the center position in the vertical direction of the face area that is the face image area. If the location (facial organ center position) that should be at the center position of the region is shifted in the horizontal direction, this is detected as the horizontal orientation of the face, and at a position at a predetermined height from the shoulder in the face image If the position of this part is the reference position and the part that should be at this reference position is at a measurement point that is displaced in the vertical direction, the straight line connecting the estimated center position of this head and this measurement point The angle from the horizontal plane including the center point is detected as the vertical orientation of the face. Then, the orientation of the face is obtained from the detected horizontal direction and vertical direction.

  When the orientation of the face is determined in this way, the orientation of the center of the eyeball relative to the orientation of the face (the direction of the straight line connecting the assumed center position of the head and the center position of the eyeball) is obtained. The direction of the center is the direction of the line of sight. And it becomes the direction of the line of sight of the left and right eyes obtained in this way, and the direction of the line of sight seen by this person can be obtained by weighting and adding the directions of these lines of sight.

JP 2009-194480 A JP 2007-286995 A JP 2006-119408 A JP 2009-104524 A

  As described in Patent Document 1 above, a technology for advertising and advertising a product using digital signage is already known. Techniques for measuring customer attention are also known. As a method for measuring the attention level of a person, for example, Patent Document 4 described above also introduces an example thereof.

  By the way, even if the degree of attention to a customer's product is measured in this way, the measurement result is used only at the store side that sells the product. The image of the displayed product is only to be viewed while keeping the same display state.

  On the customer side, when purchasing a product by looking at the arrangement of products displayed on the vending machine or advertising signage, the customer will select the desired product from the images of many products listed. , The larger the number of displayed product images, the smaller the size of the displayed product image, and it would be time consuming and time consuming for users to find the desired product. There is also the possibility of making a choice.

  In addition, it is possible to increase the size of the display screen and display a large image of each product, but the device becomes larger and expensive, and the user desires that the size of the display screen increases. In order to find a product, there may be a situation where the user moves around in front of the display screen.

  In Patent Document 3, a technique has been proposed in which the viewer's line-of-sight direction is measured and the most noticeable video is enlarged and displayed in the main display area. In vending machines and advertising signage, images of a plurality of products are all displayed at the same size, and an image of one product is not always enlarged and displayed. .

  The present invention has been made in view of the above points, and its purpose is to display a result of gazing on a product screen of a user who uses a product screen displayed on the display screen on this screen. And providing a product selection support method that can provide a user with a suitable screen display.

  To achieve the above object, the present invention photographs a product information recording unit that stores product information, a display unit that displays a product screen representing an image of the product on a display screen, and a user who uses the product screen. An imaging unit, a gaze direction measuring unit that detects a user's gaze direction from a user image captured by the imaging unit, a user position measuring unit that measures the user's position with respect to the display unit, and a product by the user When a user within a predetermined area is detected by the user position measuring unit using a device including a gaze degree calculating unit that calculates a gaze degree for a product image on the screen, the gaze direction measuring unit detects the user within the predetermined area. The direction of gaze on the display screen is detected, the gaze degree for the product image on the product screen displayed on the user's display screen is calculated from the user's position and gaze direction, and the gaze degree in the display screen Images of high-quality products are included Identify the viewing area, highlight the image of the product included in the gaze area, and correspond to the product image based on the degree of gaze on the product image of the user and the product image included in the highlighted gaze area A gaze degree for each product is calculated and recorded in a product information recording unit.

  Further, the present invention is characterized in that the highlighting is an enlarged display of an image of a product with a high gaze degree or a display of detailed information of the product in the vicinity of the image of the product.

  Further, according to the present invention, the highlighted display is an enlarged display of an image of a product with a high gaze degree, and detects the user's line-of-sight direction and the position of the user with respect to the image of the enlarged product, Calculate the degree of user's gaze for the product image, identify the gaze area that contains the image of the product with high gaze degree on the display screen displaying the product image, and view the product image included in the gaze area Is further enlarged and displayed.

  Further, according to the present invention, the highlighting is a display of the detailed information of the product in the image of the product with a high gaze degree, and is selected when specific detailed information is selected from the displayed detailed information Product information corresponding to the detailed information is searched and displayed on the display section so as to be selectable.

  Further, according to the present invention, the display screen is provided with a touch panel, and a purchase determination process of a product corresponding to the touched product image is performed by touching the product image displayed on the product screen. It is characterized by that.

  Further, according to the present invention, the product screen scrolls and displays images of a plurality of products, and when the user is detected within a predetermined area with respect to the signage, the product screen is scrolled from the position of the user and the direction of the user's line of sight. Calculate the user's gaze degree for the product image on the product screen to be displayed, and stop and display the product image with the high gaze degree among the product images on the product screen to scroll display at the center of the product screen It is characterized by.

  Further, the present invention is characterized in that the merchandise information recording unit records the degree of gazing for each product and the sales history of each product, and enables the display unit to display the degree of gazing and sales performance of the product. To do.

  Further, the present invention is characterized in that a selection history of detailed information is recorded in the product information recording unit, and the ranking of the selected detailed information can be displayed on the display unit.

  According to the present invention, it is possible to make the display form on the product screen suitable for the user only by the operation of gazing at the image of the predetermined product on the product screen on which a plurality of product images are displayed. Therefore, it is possible to easily and surely select a desired product on the product screen without taking time and effort for the user.

It is an external appearance perspective view which shows the signage vending machine as a specific example of the signage which performs the goods selection assistance method by this invention. It is an external appearance perspective view which shows the advertisement signage as a specific example of the signage which performs the goods selection assistance method by this invention, and its installation state. It is a schematic explanatory drawing of operation | movement of the signage vending machine shown in FIG. It is a schematic explanatory drawing of operation | movement of the advertisement signage shown in FIG. It is a block diagram which shows a specific example of the block configuration of the advertisement signage shown in FIG. It is a block diagram which shows one specific example of the block configuration of the signage vending machine 1 shown in FIG. It is a figure which shows an example of the gaze data of the goods stored in the spatial information recording part 35 in FIG. 5, FIG. It is a figure which shows notionally the operation | movement of the signage according to the position of the person with respect to signage. It is a figure which shows a part of process flow of 1st Embodiment of the goods selection assistance method by this invention. It is a figure which shows one specific example of the flow of the process performed following the process of FIG. 9A. It is a figure which shows a part of process flow of 2nd Embodiment of the goods selection assistance method by this invention. It is a figure which shows a part of screen flow on the display screen 21 with respect to the processing flow of 3rd Embodiment of the goods selection assistance method by this invention. It is a figure which shows a part of screen flow on the display screen 21 in FIG. 2 with respect to the processing flow of 4th Embodiment of the goods selection assistance method by this invention. It is a figure which shows a part of screen flow on the display screen 21 in FIG. 2 with respect to the processing flow of 5th Embodiment of the goods selection assistance method by this invention. It is a figure which shows a part of screen flow on the display screen 21 in FIG. 2 with respect to the processing flow of 6th Embodiment of the goods selection assistance method by this invention. It is a figure which shows the other specific example of the screen on the display screen 21 in FIG. 2 in 7th Embodiment of the goods selection assistance method by this invention. It is a figure which shows the other specific example of the screen on the display screen 21 in FIG. 2 in 8th Embodiment of the goods selection assistance method by this invention. It is a figure which shows a part of screen flow on the display screen 21 in FIG. 2 with respect to the processing flow of 9th Embodiment of the goods selection assistance method by this invention.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings.

  FIG. 1 is an external perspective view showing a signage vending machine which is a vending machine as a specific example of a signage for executing a product selection support method according to the present invention, wherein 1 is a signage vending machine, 2 is a display screen, 3 is a camera, Reference numeral 4 is an operation unit, 5 is a cash slot, 6 is a card touch unit, 7 is a change outlet, 8 is a product outlet, 9 and 10 are speakers, and 11 is a user.

  In the figure, the signage vending machine 1 is provided with a display screen 2 on which a plurality of product images (not shown) are arranged and displayed on the front surface of the casing. A camera 3 is provided, and an operation unit 4 is provided below the display screen 2, and speakers 9 and 10 are provided on both the left and right sides below the operation unit 4.

  In the display screen 2, when a user 11 having an average height stands in front of the display screen 2 and stands in front of the display screen 2, the line of sight of the user 11 indicates the height position at the center of the display screen 2. The height position is set to point. The display screen 2 is provided with a touch panel (not shown), and any one of the images of the products displayed on the display screen 2 can be selected and specified by a touch operation. 11 can select and purchase a desired product from among products whose images are displayed on the display screen 2.

  In order to view the product image displayed on the display screen 2 from the position of the upper center portion of the display screen 2, the camera 3 stops the user 11 in front of the display screen 2 and the display screen 2. The shooting range (field of view range) is set so that the range including at least the face of the user 11 passing by while viewing the display screen 2 in the front can be shot. The image of the face of the user 11 photographed by the camera 3 is used to obtain the gaze degree of the product on which the image is displayed on the display screen 2. The camera 3 shoots any person within the shooting range, but the face, such as the eyes, nose, and mouth, is a face image obtained by shooting with the camera 3 at a predetermined distance or more away from the signage vending machine 1. In such a case, the person does not become the user 11 who is gazing at the product image displayed on the display screen 2, and the face image is not used for calculating the gaze degree. .

  The image captured by the camera 3 is subjected to image recognition processing to detect the distance between the user 11 and the signage vending machine 1 and detect the position thereof. The distance of the user 11 from the signage vending machine 1 is detected. Accordingly, the display form on the display screen 2 is changed.

  The operation unit 4 is for purchasing a product specified by a touch operation on the display screen 2, and includes a cash insertion slot 5, a card touch unit 6, a change outlet 7, and a product outlet 8. The cash slot 5 is for inserting banknotes and money, and is composed of a banknote slot and a coin slot, although not shown. The card touch unit 6 is an IC card that is equipped with an IC card such as a credit card and handles electronic money for the purchase of goods (hereinafter referred to as an electronic money card). When the card touch unit 6 is touched, the price of the purchased product is paid. By inserting cash at the cash insertion slot 5 or by touching the card touch unit 6 with the card, the charge for the image of the product designated on the display screen 2 is paid, and the inside of the product withdrawal slot 8 When the product is discharged, the user 11 can take out the product from the product takeout port 8, and when there is a change, the change can be received at the change takeout port 7.

  Speakers 9 and 10 provided on the left and right sides on the lower side of the operation unit 4 output a description of a product whose image is displayed on the display screen 2 in stereo sound.

  FIG. 2 is an external perspective view showing an advertisement signage, which is an advertisement display board as a specific example of a signage for executing the product selection support method according to the present invention, and its installation state, wherein 20 is an advertisement display board, and 21 is a display. Screen, 22 is a camera, 23 and 24 are speakers, 25 is a control unit, 26 is a store cash register (a place for paying charges), 26a is a cash register (a machine for paying charges), 27 is a wall, 28 Is a cashier and 29 is a user.

  In this figure, the advertisement signage 20 can be seen by the user 29 in front of or near the cash register 29 where the cashier register 26a in the store is provided and the user 29 pays the fee. Thus, it is attached to the upper part of the wall 27 behind the cash register 29. However, the present invention is not limited to this, and the advertising signage 20 may be attached to a wall at an arbitrary place in the store.

  This advertising signage 20 includes a display screen 21 for displaying images of a plurality of products, a camera 22 provided at the upper center thereof, and a control unit 25 attached to the back side of the display screen 21. Therefore, the display screen 21 is installed at a relatively high position so as not to be invisible. For this reason, the display screen 21 is installed in a slightly inclined state. At the same time, the camera 22 is also tilted downward in accordance with the downward tilt of the display screen 21, and the shooting range (field of view range) is also in front of or near the cash register 26. 29 is set so that a range including at least the face can be photographed.

  Near the camera 22, speakers 23 and 24 are also provided on the left and right sides of the camera 22, and sound for explaining the product on which the product image is displayed on the display screen 2 is output. Further, the image captured by the camera 22 is subjected to image recognition processing to detect the distance between the user 29 and the advertisement signage 20, and the advertisement signage according to the distance of the user 29 from the cash register 26. The display form on the 20 display screens 21 is changed.

  FIG. 3 is a schematic explanatory diagram of the operation of the signage vending machine 1 shown in FIG. 1, in which 11a is the line of sight of the user 11, and the same reference numerals are given to the portions corresponding to those in FIG.

  In the same figure, the camera 3 has its shooting range (here, it is indicated by a broken line in the left-right direction, but there is also a range in the up-down direction. The alternate long and short dash line indicates the direction of the center of the field of view of the camera 3. When the user 11 approaches the signage vending machine 1 and enters the shooting range of the camera 3, as described above, the face of the user 11 taken by the camera 3 is captured. Based on the image, the direction of the line of sight 11a toward the display screen 2 as the gaze direction on the display screen 2 of the user 11 is detected, and based on this, the display screen 2 on which the user 11 is gazing is displayed. An image (not shown) of the displayed product is determined. Based on this determination, the gaze degree of the product corresponding to the image of the product watched by the user 11 is obtained.

  In this way, the gaze degree of the product whose image is displayed on the display screen 2 is obtained, the display form on the display screen 2 is changed according to the gaze degree, and the gaze result of the user 11 on the display screen 2 Is fed back to the display on the display screen 21.

  FIG. 4 is a schematic explanatory diagram of the operation of the advertisement signage 20 shown in FIG. 2, where 29 a is the line of sight of the user 29, and parts corresponding to those in FIG.

  This advertising signage 20 is also the same as the signage vending machine 1 shown in FIG. 3, but in FIG. 4, the camera 22 is shown in the shooting range (here, the horizontal direction is indicated by a broken line, but also in the vertical direction) (The alternate long and short dash line indicates the direction of the center of the field of view of the camera 22), and the user 29 approaches the register 26 and enters the shooting range of the camera 22 at all times. As described above, the direction of the line of sight 29a toward the display screen 21 as the gaze direction of the user 29 on the display screen 21 is detected based on the face image of the user 29 captured by the camera 22. Based on this, an image (not shown) of the product displayed on the display screen 21 that the user 29 is gazing at is determined. Based on this determination, the gaze degree of the product corresponding to the image of the product watched by the user 29 is obtained.

  In this way, the gaze degree of the product whose image is displayed on the display screen 21 is obtained, and the display form on the display screen 21 is changed according to the gaze degree, and the display screen 21 of the user 29 is displayed. The result of gazing at is fed back to the display on the display screen 21.

  Next, the block configuration of the signage vending machine 1 shown in FIG. 1 and the advertising signage 20 shown in FIG. 2 will be described. The block configuration of the signage vending machine 1 is a part of the block configuration of the advertising signage 20. First, the block configuration of the advertisement signage 20 will be described.

  FIG. 5 is a block diagram showing a specific example of the block configuration of the advertisement signage 20 shown in FIG. 2, wherein 30 is an attention level measurement unit, 31 is an imaging unit, 32 is a person position measurement unit, and 33 is a gaze direction measurement unit. , 34 is a gaze position information calculation unit, 35 is a spatial information recording unit, 36 is a gaze degree calculation unit, 37 is a totaling unit, 38 is an input unit, 39 is an output control unit, 40 is an output unit, 41 is a display feedback unit, Reference numeral 42 denotes a display device, 43 denotes a display tabulation unit, 44 denotes a speaker unit, 45 denotes a terminal storage unit, 46 denotes a terminal control unit, 47 denotes a history DB (database) server, 48 denotes a terminal communication unit, and 49 denotes a power supply unit.

  In the figure, the advertisement signage 20 includes a gaze degree measuring unit 30 and a display feedback unit 41 therein. The gaze degree measurement unit 30 has the same configuration as the attention level measurement device described in Patent Document 2 (Japanese Patent Application Laid-Open No. 2007-28695) described above. First, the gaze degree measurement unit 30 will be described. To do.

  The gaze degree measurement unit 30 includes an imaging unit 31 provided with a camera 22 (FIG. 2), a person position measurement unit 32, a gaze direction measurement unit 33, a gaze position information calculation unit 34, a spatial information recording unit 35, The gaze degree calculating unit 36, the totaling unit 37, the input unit 38, the output control unit 39, and the output unit 40 are included.

  In the imaging unit 31, as shown in FIG. 4, the camera 22 (FIG. 2) images the user 29 (FIG. 2), processes the image signal of the moving image obtained by the imaging, and sends it to the gaze direction measuring unit 33. Supply. The person position measurement unit 32 measures the distance from the image signal obtained by the camera 22 to the user 19, thereby acquiring position information indicating the position of the user 29 and supplies the position information to the gaze direction measurement unit 33. . The line-of-sight direction measurement unit 33 extracts an image (face image) of the face portion including the shoulder portion of the user 29 from the image signal supplied from the image pickup unit 31, and the eyes on the face of the user 29. The position of the face is extracted from the face image, and the horizontal and vertical directions of the face with respect to the display screen 21 (FIG. 2) of the user 29 are measured. Based on the position of the pupil in the face image, etc. The line-of-sight direction of the user 29 is measured.

  The spatial information recording unit 35 stores information on the coordinate system on the display screen 21 and information indicating the coordinate range of each product image displayed on the display screen 21 of the advertisement signage 20. The display position coordinates of the product image on the display screen 21 are represented by coordinates in the coordinate system on the display screen 21. In addition, the spatial information recording unit 35 looks at the display screen 21 in front of the data of the degree of gazing for each product displayed on the display screen 21 (hereinafter referred to as product-specific gazing data) or the current advertisement signage 20. Product-specific gaze data (hereinafter referred to as user-specific gaze data) for each product of the user 11 is stored, and the measurement result of the gaze direction measurement unit 33, the gaze position information calculation unit 34, and the gaze degree calculation unit These are updated according to the calculation result at 36.

  The gaze position information calculation unit 34 is based on the gaze direction obtained by the gaze direction measurement unit 33, the eye position of the user 29, and the position information of the user 29 supplied from the person position measurement unit 32. Using the coordinate system on the display screen stored in the information recording unit 35, as described with reference to FIG. 4, the point where the line of sight of the user 29 intersects the display screen 21, that is, the point of interest (attention point). The position coordinates of are calculated.

  The gaze degree calculation unit 36 searches the spatial information recording unit 35 for an image of the product in the coordinate range including the gaze point calculated by the gaze position information calculation unit 34, and calculates the gaze degree for the searched product image. The gaze degree calculation unit 36 supplies the calculated gaze degree to the spatial information recording unit 35, and updates the product-specific gaze data and the user-specific gaze data of the corresponding product stored in the spatial information recording unit 35. To do.

  Here, the gaze data (generic name of product-specific gaze data and user-specific gaze data) is expressed by the number of gazes, the number of times of gaze, the gaze time, etc. since the display of the product image, as will be described later. The degree of gazing of the product is expressed by the number of gazing times and the gazing time. The gaze degree based on the product-specific gaze data is represented by the total number of gazes of the product, the total number of gazes, the total gaze time, etc. The gaze degree of the product based on the user-specific gaze data is the user 29 Is represented by the number of times of gazing and the gazing time for the product from when it is recognized by the advertisement signage 20 until it is no longer recognized. As long as the user is gazing at the product, the degree of attention is updated as time passes and the gaze data is updated in the spatial information recording unit 35.

  In this way, since the degree of gaze is updated for the image of the newly watched product, the latest gaze data is always stored in the spatial information recording unit 35 for each product image. Will be.

  From the user-specific gaze data of the user 29 stored in the spatial information recording unit 35 at this time, predetermined data is output by the output control unit 39 for each product image displayed on the display screen 21 (FIG. 2). This is read and output from the output unit 40 to the display feedback unit 41 as the degree of attention of each product by the user 29.

  Note that the degree of product attention based on the product-specific gaze data may be any of the total number of people in the gaze data, the composition of the number of times of attention, or the total time of interest. It may be a value (for example, a value obtained by summing values obtained by multiplying the number of times of attention and the time of attention for each user). The same applies to the degree of product attention based on the user-specific gaze data. Such calculation is performed by the output control unit 39.

  In the input unit 38, information related to the image of the product displayed on the display screen 21 (ID, position coordinates on the display screen 21, etc.) is input from the display feedback unit 41, and the spatial recording unit 35 via the counting unit 37. To be supplied. The totaling unit 37 holds information related to the product image. The output control unit 39 stores the product image currently displayed on the display screen 21 based on the information related to the product image in the totaling unit 37. Search for gaze degree.

  The gaze data corresponds to the image of the product searched by the spatial information recording unit 35 by searching the image of the product in the coordinate range including the gaze point calculated by the gaze position information calculation unit 34 by the gaze degree calculation unit 36. The gaze data is calculated for the product, and the gaze data is recorded in the spatial information recording unit 35. Every time the user 29 gazes the image of the product, the gaze data at this time is generated and the spatial information recording unit 35 is additionally recorded.

  Next, the display feedback unit 41 includes a display device 42 having a display screen 21 (FIG. 2), a display totaling unit 43, a speaker unit 44 having a speaker 24 (FIG. 2), a terminal storage unit 45, and terminal control. Part 46.

  The terminal control unit 46 is connected to the history DB server 47 via the terminal communication unit 48, and the history DB server 47 stores information on the image of the product displayed on the display screen 21 and the displayed product. Image information is stored. Further, the terminal control unit 46 designates the display position of each product image on the display screen 21, and on the display screen 21, the image of each product is displayed at the designated display position. The display position of the image of each product is also aggregated by the display aggregation unit 43 and supplied to the input unit 38 of the gaze degree measurement unit 20. Thereby, the output control unit 39 in the gaze degree measurement unit 20 can confirm the image of the product currently displayed on the display screen 21 via the totaling unit 37.

  Further, when a new product is displayed on the display screen 21, the image information is stored in the history DB server 47 and the image information is supplied to the terminal control unit 46 via the terminal communication unit 48. . The terminal control unit 46 displays the product image on the display screen 21 of the display device 42 by designating the display position on the display screen 21. In the display totaling unit 43, information relating to the product image to be newly displayed on the display screen 21 is additionally totalized.

  On the display screen 21, there may be a case where the image of each product is displayed by scrolling there, or it may not be displayed. Therefore, unless there is an instruction to stop displaying the product image from an input unit (not shown), The spatial information recording unit in the diopter measurement unit 30 does not delete the product image. When there is an instruction to cancel the display of an image of a certain product, information regarding the image of the product for which the display stop instruction has been issued is deleted from the spatial information recording unit 35.

  The terminal storage unit 45 stores the gaze degree of the product image displayed on the display screen 21 output from the output unit 40 of the gaze degree measurement unit 30. The terminal control unit 46 acquires the degree of gaze of the product image stored in the terminal storage unit 45, and determines how to display the product image on the display screen 21 according to the degree of gaze of each product image. Control. That is, the result of the user's gaze on the display screen 21 is fed back to the display on the display screen 21.

  The terminal storage unit 45 also stores various kinds of voice message information for advertising and the like, and the terminal storage unit 45 is controlled according to the display content on the display screen 21 under the control of the terminal control unit 46. Corresponding message information is called from and supplied to the speaker unit 44. In the speaker unit 44, the message information is converted into audio information, and the message is output as audio from the speaker 24 (FIG. 2).

  When the power is turned on, power is turned on from the power unit 49 to the gaze degree measuring unit 30, the display feedback unit 41, the terminal communication unit 48, the history DB server 47, and the like, and the power is turned off. When the power is turned on, the power supply to these parts is stopped.

  Each unit such as the diopter measurement unit 30, the display feedback unit 41, the terminal communication unit 48, and the history DB server 47 is a control unit except for the camera 22 (FIG. 2), the display device 42, and the speaker unit 44 in the imaging unit 31. 25 (FIG. 2).

  FIG. 6 is a block diagram showing a specific example of the block configuration of the signage vending machine 1 shown in FIG. 1, wherein 50 is an operation feedback unit, 51 is a touch panel unit, 52 is an operation counting unit, 53 is a personal authentication unit, and 54 is A user totaling unit, 55 is a settlement processing unit, 56 is a purchase totaling unit, 57 is a product transporting unit, and 58 is a product storage unit, and parts corresponding to those in FIG. .

  In this figure, the signage vending machine 1 includes an attention level measurement unit 30, a display feedback unit 41, an operation feedback unit 50, a product transport unit 57, a product storage unit 58, a history DB server 47, a terminal communication unit 48, and a power supply unit 49. However, the attention level measurement unit 30, the display feedback unit 41, the history DB server 47, the terminal communication unit 48, and the power supply unit 49 are the same as those provided in the advertisement signage 20 shown in FIG. Since it is a thing, the description is abbreviate | omitted. However, in the signage vending machine 1, the imaging unit 31 in the attention level measuring unit 30 includes the camera 3 shown in FIG. 1, the display device 42 includes the display screen 2, and the speaker unit 44 also includes the speakers 9 and 10. I have.

  The operation feedback unit 50 is a part that detects the operation of the user 11 in the signage vending machine 1 shown in FIG. 1 and executes a process according to the operation. The touch panel unit 51, the personal authentication unit 53, and the payment processing unit 55. And.

  The touch panel unit 51 includes a touch panel provided on the display screen 2 (FIG. 1). The touch panel unit 51 detects a touch operation of the user 11 on the display screen 2 and detects a touch position on the display screen 2. . The touch position data is totaled by the operation totaling unit 52 together with information notifying that a touch operation has been performed. This notification information is supplied to the terminal control unit 46. Upon receiving the notification information, the terminal control unit 52 recognizes that the touch operation by the user 11 has been performed on the display screen 2, acquires touch position data from the operation totaling unit 52, and displays the display feedback unit 41. The display totaling unit 43 collates the position data of the image of each product displayed on the display screen 2 that is being aggregated at that time, and the image of the product for which the touch position on the display screen 2 indicated by the touch position data is applied. Which one is shown is determined. Thereby, the product indicated by the user 11 on the display screen 2 is confirmed.

  Upon confirming the product pointed to by the user 11, the terminal control unit 46 creates a purchase screen for purchasing the confirmed product based on the image information stored in the terminal storage unit 45, and displays it on the display device 42. To be displayed on the display screen 2. In this way, by displaying the purchase screen, the user 11 can know the supported purchase desired product and the purchase amount paid for it.

  The personal recognition unit 53 is provided so that the signage vending machine 1 is a vending machine supporting personal authentication / settlement function such as a card or a mobile phone, and can be used by a user 11 who performs electronic settlement other than purchase by cash. It is. In this case, in the signage vending machine 1 shown in FIG. 1, the card touch unit 6 serves as an operating means for touching the IC card, and the personal recognition unit 53 includes the touch card unit 7. Such an authentication card may have an electronic money function.

  When the user 11 touches the card on the touch card unit 7, the personal recognition unit 53 reads the personal information of the user 11 from the card, performs personal recognition, and determines whether or not the user 11 is a registrant. judge. The recognition results are totaled by the user totaling unit 54 and supplied to the terminal control unit 46 together with the read personal information. The terminal control unit 46 determines whether or not the user 11 who has performed the touch operation detected by the touch panel unit 51 is a registrant based on the recognition result.

  The settlement processing unit 55 includes a cash insertion slot 5, a card touch unit 6, and a change withdrawal slot 7 of the operation unit 4 (FIG. 1), in order to purchase a specified product from the cash insertion slot 5 or the card touch unit 6. When the fee is paid, the paid fee is detected, and when change is required, change is calculated, and the purchase counting unit 56 totals the payment fee and change information. This aggregated information is supplied to the terminal control unit 46. The terminal control unit 46 recognizes from the total information that the user 11 has paid a fee and that there is a change.

  The terminal control unit 46 holds the price data of each product image displayed on the display screen 2, and the user 11 touches the image of the desired purchase product on the display screen 2 from the operation totaling unit 52. Is detected based on the information from the purchase counting unit 56, it is determined whether or not a fee for purchasing the product corresponding to the product image specified by the user 11 has been paid. When it is recognized that there is a change, it is determined whether or not there is change. If change is required, the change is calculated. Then, the terminal control unit 46 supplies the change processing unit 55 with the information for notifying that the fee has been paid and the change amount when the change is necessary through the purchase counting unit 56.

  When the user 11 does not pay the fee required for purchasing the designated product because the payment amount is insufficient, the terminal control unit 46 drives the speaker unit 44 to notify the voice information to that effect. Is read from the terminal storage unit 45, supplied to the speaker unit 44, and a voice message notifying the addition of the payment fee is output from the speakers 9, 10 (FIG. 1). At the same time, similarly, the display device 42 may be controlled to display a similar notification message on the display screen 2.

  When the user 11 performs a touch operation for purchase on the display screen 2, the touch operation is notified from the touch panel unit 51 to the terminal control device 46, and the terminal control unit 46 is paid the fee, and the user When it is determined that the product designated by 11 can be sold, the settlement processing unit 55 and the product storage unit 58 are notified of the fact. When there is change, the settlement processing unit 55 discharges the change so that the user 11 can take out the change from the change outlet 7 (FIG. 1).

  All the products whose images are displayed on the display screen 2 are stored in the product storage unit 58, and the product transport unit 57 stores the products stored in the product storage unit 58 in the product takeout port 8 (FIG. 1). Transport. Therefore, when the user 11 instructs the terminal 11 to sell a product that the user 11 desires to purchase, the product transport unit 57 transports the product stored in the product storage unit 58, and this product from the product takeout port 8. Can be taken out by the user 11.

  When the signage vending machine 1 is a vending machine having a personal authentication function, the terminal control unit 46 further instructs the settlement processing unit 55 and the product transporting unit 57 according to the recognition result of the personal recognition unit 53. give. When the user 11 does not have an authentication function card, the terminal control unit 46 cancels the detection result of the touch panel unit 51 and the information on the payment by the payment processing unit 55, and the payment is made. Returns the payment fee from the change outlet 7 and displays a message to that effect on the display screen 2 or informs the speakers 9 and 10.

  FIG. 7 shows a specific example of gaze data which is the basis of the gaze degree of the product stored in the spatial information recording unit 35 in FIGS. Such gaze data is used for obtaining the gaze degree in the signage vending machine 1 shown in FIG. 1 or the advertising signage 20 shown in FIG. 2, and will be described below with reference to FIG. 2 relating to the advertising signage 20. .

  The degree-of-gaze data shown in FIG. 7 (a) is product-specific gaze data created for each product. Here, product A is shown as an example. It is composed of data such as the attention type such as whether or not the user gazes while passing, and the time (date and time) when the user gazes, and is composed of data for each user 29 gazing at the product A. That is, the watched number “1” relates to the first user 29 who has watched the product A, and the watched number “2” relates to the second user 29 who has watched the product A. In addition, the number of gazes is “1” if the gaze is continued once, and when the user 29 keeps staying within the shooting range of the camera 22 and repeats gaze on the product A, “2” Is. The gaze time is the total amount of time that the user 29 stays within the shooting range of the camera 22 and gazes at the product A.

  In the illustrated example, the user 11 (attention number of people = “1”) who first gazes at the product A has an attention type of “H” (for example, stops and gazes), and displays an image of the product A only once. The gaze time is “1800 msec”. In addition, the user 11 (attention number of people = “2”) who has watched next has the attention type “M” (for example, watching while passing in front of the signage vending machine 1), and watches the image of the product A only once. The gaze time is “500 msec”.

  The gaze data classified by product in FIG. 5 and FIG. 6 is obtained by searching the spatial information recording unit 35 for images of products in the coordinate range including the gaze point calculated by the gaze position information calculating unit 34 by the gaze degree calculating unit 36. , Calculated for the product corresponding to the searched product image and recorded in the spatial information recording unit 35. In this case, when the product at this time is first watched by the user 29, the product-specific gaze data for this product is only data with the number of attention being “1”, but there are already a plurality of n users 29. , The product-specific gaze data up to “n” is stored in the spatial information recording unit 35, and the gaze degree calculation unit 36 newly focuses on the product image (n + 1) th. Gaze data of “n + 1” as the number of people of interest is added to the product-specific gaze data already created and recorded for this product in the spatial information recording unit 35.

  Note that the gaze time is obtained by counting the number of frames of the captured video signal during a period in which the line of sight of the user 29 is directed to the same product image, or by measuring with a timer (not shown). The attention type is determined by detecting the movement of the image of the same user 29 obtained by photographing with the camera 22.

  In addition, the gaze degree based on the product-specific gaze data shown in FIG. 7A is, for example, how the degree of gaze by the user 29 so far for the product image displayed on the display screen 21 is determined by the user. This is used when informing the user 29 or when the user 29 is particularly interested in an image of a product with a high gaze degree.

  Further, the product-specific gaze data shown in FIG. 7A is maintained as it is even if the user 29 is away from the advertising signage 20, and the new user 29 gazes at the product image on the display screen. Then, the product-specific gaze data corresponding to this product is updated.

  FIG. 7B is a diagram illustrating a specific example of user-specific gaze data created for each user 29 that is used to make an image of a product that the user 29 gazes stand out on the display screen 21.

  This user-specific gaze data is created for each user 29 who uses the signage vending machine 1 or the advertising signage 20, and is the gaze position, gaze time, gaze distance, gaze height on the display screens 2 and 21. , And the time (date and time) at which attention was paid. Here, user-specific gaze data for user A is shown.

  In the following, the signage vending machine 1 will be described. The gaze position is represented by an image of the watched product. Here, the user A shows that the product A and the product L are watched. Each time a gaze is performed, the gaze time is registered and updated.

  The gaze time includes “time 2” in which the product area was continuously watched (without looking away) and this “time 2”, and the gaze position was sometimes removed from the product area. Two types of data “time 1” including the time when the product was viewed are registered. The user 11 may watch the product (product A) continuously for a certain period of time, while sometimes shifting his eyes to the surrounding product after starting to watch the product (for example, product A).

  Therefore, by registering not only “Time 2” but also “Time 1” data, the product displayed around the product A is displayed in the time difference between “Time 1” and “Time 2”. It can be estimated that the user is gazing and can be added to the gazing degree data of the products displayed in the vicinity.

  The gaze distance is the distance from the signage vending machine 1 of the user A measured from the image signal obtained by the camera 3, and the gaze height is the height at which the user A is gazing from the image signal. is there.

  For this user A, based on the user-specific gaze data, the display screen 21 is displayed so that the image of the product that the user A is particularly watching is conspicuous or displayed clearly. The display form of the product image at is changed.

  Note that the gaze data for the user A is deleted when the corresponding user A moves away from the signage vending machine 1 and the gaze measurement is not performed.

  Next, an embodiment of a product selection support method using gaze degree feedback executed by the signage described above (signage vending machine 1, advertising signage 20) will be described. First, the concept of the embodiment will be described.

  FIG. 8 is a diagram conceptually showing the operation of signage according to the position of the person with respect to the signage, wherein 60 is a fixture / vending machine, 61 is an advertisement / sale machine, 62 is a remote area, 63 is an approach area, and 64 is a proximity. Area 65 is a purchase area, and 66a to 66e are walking paths.

  In the figure, here, the signage vending machine 1, the advertisement signage 20, and a place where the furniture / vending machine 60 for selling other products are arranged side by side will be described as an example. In addition, when these are named generically, it is called the advertisement / sale machine 61.

  An area far enough away from the advertisement / vending machine 61 and in which a person has little interest in the advertisement / vending machine 61 is referred to as a distant area 62, and is closer to the ad / vending machine 61 than the far area 62. The area approaching the advertisement / selling machine 61 is referred to as the approaching area 63. The area closer to the advertising / selling machine 61 than the approaching area 63 and the person approaching the advertising / selling machine 61 with the intention of purchasing the product is the proximity area 64. That's it. In addition, for example, an area where a person who purchases a product with the signage vending machine 1 exists is referred to as a purchase area 65.

  Each of the areas 62 to 65 can be appropriately set with the size of the area and the distance from the advertisement / sale machine 61. However, the signage vending machine 1 and the advertisement signage 20 have different sizes and distances. In the case of the advertisement signage 20, the purchase area 65 is not provided.

  The case of the signage vending machine 1 will be described as an example. The following operation is performed in each area 62 to 65 within the imaging range (field of view) of the camera 3.

  First, as an example of a person's action, as shown by the walking route 66a, the person walks in the direction of the signage vending machine 1 and is temporarily in the far area 62 while he / she is wondering whether he / she goes to the signage vending machine 1 or not. Enter, but if you are not so interested, you may change direction and exit from the distant area 62. For such a remote area 62, the imaging unit 31 (FIG. 6) tracks the movement (behavior) of the person using the captured image of the camera 3 (FIG. 1), and the action flow line (walking path 66a), action time. Then, the movement information is detected to detect the action distance, and the action information is acquired. Here, the output image of the imaging unit 31 is not used for detection of the gaze degree.

  Next, as an example of the person's behavior, as shown by the walking path 66b, the person walks in the direction of the signage vending machine 1, passes through the far area 62 with some interest in the signage vending machine 1, and approaches the approach area 63. They may enter and stop, but they may lose interest and change direction to exit from the approach area 63 and further from the far area 62. Thus, when a person enters the approach area 63, it is considered that he / she has shown interest in the signage vending machine 1. In such a case, when the person is in the remote area 62, the flow line detection is performed by the signage vending machine 1, but when the person enters the approach area 63, the person is designated as the user 11, The gaze direction measuring unit 33 (FIG. 6) detects the face direction and the gaze direction from the face image of the user 11, and the gaze position information calculating unit 34 (FIG. 6) displays this on the display screen 2 (FIG. 1). While detecting the position of the viewpoint of the user 11, the gaze degree calculating unit 36 uses it based on the position coordinates on the display screen 2 of the image of each product stored in the spatial information recording unit 35 (FIG. 6). FIG. 7 shows the product image in the line-of-sight direction of the user 11, that is, the image of the product in the region including the viewpoint that the user 11 is gazing to calculate the degree of gazing. While updating the product-specific gaze data shown in (a), In Create a user-specific gaze data shown in FIG. 7 (b) for the user 11 records the spatial information recording unit 35. In creating the gaze data, the distance (gaze distance) from the measurement result of the person position measurement unit 32 (FIG. 6) or the direction of the user 11 viewed from the camera 3 to the user 11 is obtained, and a timer or the like is further obtained. Thus, the time after the user 11 enters the approach area 63 (gaze time) is measured, and these measurement results are also used. The gaze data created in this way and recorded in the spatial information recording unit 35 is recorded when the user 11 enters the approach area 63 and is created and recorded in the spatial information recording unit 35. At the same time, it will be updated sequentially.

  Furthermore, as shown in the walking route 66c, when the user 11 enters the proximity distance 64, the user 11 considers that the product displayed on the signage vending machine 1 is interested, and acquires cognitive information such as the face direction and the line of sight, Based on this, the output control unit 39 (FIG. 6) selects a product having a high gaze degree from the user-specific gaze data shown in FIG. 6) is supplied to the terminal control unit 46 of the display feedback unit 41 (FIG. 6). Thereby, the terminal control part 46 controls the display apparatus 42 (FIG. 6), and displays the image of the goods on the display screen 2 (FIG. 1) in the display form according to those gaze degrees.

  Then, when the user 11 enters the purchase area 65d immediately before the signage vending machine 1 and performs purchase behavior of the desired product with the operation unit 4 (FIG. 1), the purchase behavior is measured, and the terminal control unit 46 performs the settlement process. The product 55 can be purchased by controlling the unit 55 and the product transport unit 57 (FIG. 6).

  In addition, even if the user 11 enters the proximity area 64 as in the walking paths 66d and 66e, when the user 11 moves toward the furniture / vending machine 60 or the advertising signage 20, the user 11 can use the camera of the signage vending machine 1. Therefore, the processing operation for the user 11 of the signage vending machine 1 ends at that time.

  Further, as described above, the display form of the product screen of the signage vending machine 1 is controlled based on the gaze degree of the gaze data of the user 11 shown in FIG. 7B, and the gaze result of the user 11 is This is fed back to the display form of the product screen of the signage vending machine 1. On the other hand, the gaze data for each product shown in FIG. 7A is used to notify the gaze tendency of the product by each user 11 up to that time.

  Here, the positions of the areas 62 to 65 with respect to the signage vending machine 1 are set as appropriate, but as an example, the proximity area 64 is within a range of, for example, 1 m from the front of the signage vending machine 1 and is approaching. For example, the area 63 has a range of 1 to 2 m, and the far area 62 has a range of 2 to 3 m, for example. Of course, any of the areas 62 to 64 is within the shooting range (view range) of the camera 3.

  The above is also the same for the advertisement surge 20 shown in FIGS.

  Next, an embodiment of a product selection support method in digital signage according to the present invention will be specifically described with reference to the above-mentioned drawings.

[First Embodiment]
FIG. 9A is a diagram showing a part of the processing flow of the first embodiment of the product selection support method according to the present invention, which relates to the signage vending machine 1 shown in FIGS. 1 and 6, and FIG. Is a flowchart showing the flow of processing in the signage vending machine 1, FIG. 5B is a diagram showing changes in the screen displayed on the display screen 2 of the signage vending machine 1 accompanying the flow of processing in FIG. It is. 70a to 70c are product list screens, 71 and 71a to 71d are product images, 72 is a recommended comment, 73, 73a and 73b 'are gaze areas, 74 is a purchase information column, 75 is a message column, 76 is a cart, 76a is a product display column, 76b is a purchase charge display column, and 76c is a “go to checkout” button.

  9A (a), the signage vending machine 1 is operating (step S1), and the distance measuring device 4 (FIG. 1) measures the distance of the person. 8) Even if the person is in the far area 62 (step S101) and the person is facing the signage vending machine 1 and looking at a part of the display screen 2 (Step S102), as shown in (a) of FIG. 9A (b), the display screen 2 (FIG. 1) of the signage vending machine 1 includes a product list screen 70a in which images 71 of a plurality of products are randomly arranged. When the displayed product image 71 cannot be displayed on one screen, the product list screen 70a is scrolled upward or downward so that the image 71 of each product flows. Further, in the product image 71 on the product list screen 70a, for example, an image 71 of a product with high sales or a product with a high degree of attention based on the product-specific gaze data shown in FIG. "Recommended comment 72" such as "Recommended in set" is added in a balloon.

  The recommended comment 72 may be added to the product image 71 specified at the store, but based on the gaze data for each product shown in FIG. You may make it add to 71.

  A person approaches the signage vending machine 1 while looking at the display screen 2 of the signage vending machine 1, and enters the approach area 63 (FIG. 8) (step S1003), the person position measuring unit 32 (FIG. 6) Then, the line-of-sight direction measuring unit 33 detects the orientation of the person's face from the output image signal of the imaging unit 31 (FIG. 6). At this time, since this person is looking at the display screen 2 of the signage vending machine 1, this person is likely to use the signage vending machine 1. The gaze position information calculation unit 34 and the gaze degree calculation unit 36 detect the gaze area 73, that is, the gaze region 73 from the image of FIG. The gaze data classified by user shown in FIG. 5 is created, and the gaze degree for the image 71 of each product in the gaze area is calculated.

  Note that the gaze area 73 indicates an area in which the person is gazing on the product list screen 70a at this time, and here, the gaze area 73 is distinguished from other areas. This is for the sake of explanation, and these areas are displayed without distinction.

  Then, the display screen 2 is switched to the display of the product list screen 70b shown in (b) of FIG. 9A (b) (step S104). In the product list screen 70b, the product image 71 in the area that the user 11 is gazing at (that is, the gaze area 73 on the product list screen 70a) is placed at the center position of the display screen 2, and each product is displayed. The images 71 are arranged and displayed in a stationary state (step S105). Here, a gaze area 73a is shown so that the image 71 of the merchandise that the user 11 is gazing at, and the merchandise screen 71 is shown in the gaze area 73a. In this way, the image 71 of the product being watched by the user 11 is highlighted.

  Each product image 71 is provided with a purchase information column 74 that represents information indicating that the price of the product can be purchased for 150 yen as detailed information, such as “150 yen selection”. On the upper side of 70b, there is provided a message field 75 in which a message is displayed in a text sentence that informs that a product such as “Please select a product to purchase” can be purchased. By touching the desired product image 71 on the product list screen 70b, the product image 71 can be selected for purchase.

  Further, on the right side of the product list screen 70b, for example, a cart 76 for displaying the images 71 of the products selected on the product list screen 70b together is displayed. The cart 76 includes a product display field 76a for displaying the image 71 of the selected product, a purchase price display field 76b representing the total purchase price of the products for which images are displayed in the product display field 76a, and when purchasing. The button includes a “to checkout” button 76 c that is touch-operated.

  Then, when the user 11 further approaches the signage vending machine 1 and enters the approach area 64 (FIG. 8), the user 11 pays attention to the part where the image 71 of the specific product on the display screen 2 of the signage vending machine 1 is displayed (step). In the meantime, the gaze data of the user 11 as the user A shown in FIG. 7B is updated, and the display screen 2 displays the gaze data in (c) of FIG. 9A (b) based on this gaze data. The product images 71a to 71d in the region 73b on which the user 11 is gazing are displayed with emphasis on the product list screen 70c shown (step S107).

  As described above, by watching the product list screens 70 a to 70 c displayed on the display screen 2 of the user 11, the watch result is fed back to the display screen 2 and the product list screen 70 a displayed on the display screen 2. The image of the product that the user 11 is gazing at ~ 70c is displayed in a state that is easy for the user 11 to see.

  FIG. 9B is a diagram showing a specific example of the flow of processing executed subsequent to the processing of FIG. 9A, and FIG. 9A is a flowchart showing the flow of processing in the signage vending machine 1, and FIG. ) Is a diagram showing changes in the screen displayed on the display screen 2 of the signage vending machine 1 in accordance with the processing flow in FIG. 7A, wherein 77 is a “delete” button, 78 is a purchase confirmation screen, and 79 is Purchase amount display area, 80 is a payment method introduction area, 81 is a “cash” button, 81 b is an “IC card” button, 81 c is a “mobile phone” button, 82 is a “cancel” button, 83 is a purchase product ranking screen, 84 is a product ranking display field, 85 is a point, 86 is an image of a product, and 87 is an “end” button. The same reference numerals are given to portions corresponding to FIG.

  The product list screen 70c shown in (c) of FIG. 9A (b) is displayed (step S108) as shown in (d) of FIG. 9B (b), and the product 11 desired by the user 11 is displayed. When the image 71, for example, the product images 71a and 71b is selected by touch operation (step S109), the selected product images 71a and 71b are highlighted (step S110), and at the same time, in the cart 76, the product is displayed. The images 71a and 71b of the selected product are displayed in the display column 76a, and the total purchase fee (for example, 150 yen) of these products is displayed in the purchase fee display column 76b.

  Then, the user 11 confirms that there is no mistake in the selected product by looking at the cart 76, and touches the “go to checkout” button 76c (step S111). Then, (e) in FIG. 9B (b). The display is switched to the purchase confirmation screen 78 shown in FIG.

  When the display from the product list screen 70c to the purchase confirmation screen 78 is switched, the product is no longer displayed, so that the user-specific gaze data creation / update process shown in FIG. Moreover, the update process of the product-specific gaze data shown in FIG. 7A by the gaze of the user 11 is also terminated.

  In the product list screen 70c shown in FIG. 9B (b) (d), a “delete” button 77 is provided for each product image displayed on the cart 76, and an image 71 of the product selected by mistake or When there is an image 71 of a product to be changed, the product image 71 can be deleted from the cart 76 by touching the “delete” button 77.

  In the purchase confirmation screen 78 shown in FIG. 9B (b) (e), a purchase price display area 79 and a payment method introduction area 80 for the purchased product are displayed. In the purchase price display area 79, the products A, B, C images 71a, 71b, 71c, their respective prices, and their total amount are displayed. In the payment method introduction area 80, cash, an IC card, a mobile phone, etc. are introduced as a method, and these are touch-operated. A “cash” button 81a, an “IC card” button 81b, and a “mobile phone” button 81c are provided for selection.

  On the purchase confirmation screen 78, the product to be purchased and the payment amount are confirmed in the purchase price display area 79 of the purchased product (step S113). In the payment method introduction area 80, a “cash” button 81a, an “IC card” button 81b, “ When one of the “mobile phone” buttons 81c is touched and the amount is paid by the operation unit 4 (FIG. 1) of the signage vending machine 1 (step S114), the merchandise can be received at the merchandise take-out port 8 (step S115).

  The purchase confirmation screen 78 is further provided with a “Cancel” button 82. By touching the “Cancel” button 82, the purchase procedure so far can be canceled. On the screen 2, the screen returns to the display state before the product is selected, for example, the product list screen 70c shown in FIG. 9A (b) (c).

  As described above, the payment method is selected and operated on the purchase confirmation screen 78, and the display screen 2 is switched to a state in which the purchased product ranking screen 83 shown in FIG. 9B (f) is displayed (step S116). .

  In the purchased product ranking screen 83, a product ranking display column 84 indicating a product with a high sales ranking in which the image 71 is displayed in the previous product list screens 70a to 70c is displayed, and the sales ranking is high in the product ranking display column 84. A predetermined number of products 71 are shown in order, and points 85 are displayed on each product 71. This point 85 is a value corresponding to the gaze degree based on the gaze data for each product shown in FIG. 7A, and the value of the point 85 increases as the gaze degree increases (step S117).

  It should be noted that history information (sales volume, sales amount, etc.) such as a gaze degree history for each product and a sales history for each product is temporarily stored in the terminal storage unit 45, and periodically the history DB server 47 (FIG. 5). , FIG. 6), and the terminal control unit 46 (FIGS. 5 and 6) creates a purchased product ranking screen 83 based on the history information. The gaze data relating to the gaze degree for each product shown in FIG. 7A used for creating the purchased product ranking screen 83 is a spatial information record for the product for which the product image 71 is currently displayed on the display screen 2. The product that is recorded in the unit 35 and for which the product image 71 is not currently displayed on the display screen 2 is recorded in the terminal storage unit 45 and the history DB server 47. When creating the ranking screen 83, the terminal control unit 46 has a high gaze degree for the gaze data of all products recorded in the spatial information recording unit 35, the terminal storage unit 45, and the history DB server 47. Search for products.

  Further, the purchase information column 74 may be a “detailed information” button for acquiring detailed information of a product corresponding to the image 71 of the product, and by touching the “detailed information” button, Detailed product information (for example, product type, product name, component, manufacturer, date of manufacture, etc.) can be displayed on the display screen 2. Such detailed information for each product is stored in the history DB server 47 (FIG. 6), and when the sale of the product ends, the purchased product ranking screen instead of the purchased product ranking screen 83 or together with the purchased product ranking screen 83. The detailed information selection ranking may be displayed in a screen format such as 83.

  Here, on the purchased product ranking screen 83, an image 86 of the product purchased by the user 11 is displayed, and an “end” button 87 is also displayed. The “end” button 87 is touch-operated. Then, the display of the purchased product ranking screen 83 is finished, and the display screen 2 returns to the display state of the screen before selecting the product, for example, the product list screen 70c shown in (c) of FIG. 9A (b).

  And if the user 11 leaves | separates from this signage vending machine 1 (step S118), it will return to the display of the goods list screen 70a shown to (A) of FIG. 9A (b). 9B (b) (e) purchase confirmation screen 78 and FIG. 9B (b) (f) purchase product ranking screen 83 is displayed, the user 11 from the signage vending machine 1 Even if it leaves | separates, it will return to the display of the goods list screen 70a shown to (A) of FIG. 9A (b).

  As described above, according to the first embodiment, it is possible to make the image 71 of the product that the user 11 gazes conspicuous and easily check the product that the user 11 is interested in.

[Second Embodiment]
FIG. 10 is a diagram showing a part of the processing flow of the second embodiment of the product selection support method according to the present invention, which relates to the signage vending machine 1 shown in FIGS. 1 and 6, and FIG. Is a flowchart showing the flow of processing in the signage vending machine 1, FIG. 5B is a diagram showing changes in the screen displayed on the display screen 2 of the signage vending machine 1 accompanying the flow of processing in FIG. It is. In addition, 71x, 71x _{1 to} 71x ₅ are product images, 90 is an advertisement screen, 91a is a product list screen, 92 is a product keyword, 93 is a related product screen, and 94 is a “return to list” button. The same reference numerals are given to the portions corresponding to, and duplicate explanations are omitted.

  In the same figure, when there is no person in the proximity area 64 and the proximity area 63 shown in FIG. 8, the display screen 2 of the signage vending machine 1 has an advertisement screen 90 shown in FIG. Is displayed (step S200). Here, as a product category (type), drinks are targeted for sale, and this advertisement screen 90 advertises them.

  When the user 11 moves into the proximity area 63, the signage vending machine 1 detects this based on the measurement results of the imaging unit 31 and the person position measurement unit 32 (FIG. 6), and displays the display screen according to the detection result. 2 displays the product list screen 91a shown in (b) of FIG. 10B (step S201). On the product list screen 91a, images 71 of products that are various drinks are displayed in an aligned and stationary state, and “100 yen purchase” indicating that each product image 71 is purchased by its price and touch operation. Such a purchase information column 74 is displayed. Accordingly, when an image 71 of a product desired to be purchased is touched on the product list screen 91a, a purchase confirmation screen 78 as shown in (e) of FIG. 9B (b) is displayed, and this desired product is purchased. Can do.

  When the user 11 approaches the signage vending machine 1 and enters the approach area 63 (FIG. 8) while looking at the portion of interest on the product list screen 91a (step S202), the user 11 is shown a diagram. The creation of the user-specific gaze data shown in FIG. 7B is started, and the product-specific gaze data shown in FIG. 7A is updated. Then, as shown in (c) of FIG. 10 (b), on the product list screen 91b, based on the user-specific gaze data for the user 11 shown in FIG. The product image 11 of the product being watched is highlighted (step S203), and the product keyword 92 such as category (type), component, price, etc. is displayed as detailed information on the highlighted product image. The product image 71 is highlighted (step S204).

When the user 11 gets closer to the signage vending machine 1 and enters the proximity area 64 (FIG. 8) and pays attention to the image 71 of one of the products 71 highlighted on the product list screen 91b, the display The related product screen 93 shown in (d) of FIG. 10B is displayed on the screen 2 (step S205). In the related product screen 93, the product image 71x watched on the product list screen 91b and the product images 71x _{1 to} 71x ₅ related to the product image are highlighted and displayed in the message column 75. , A message indicating a related product such as “hard water” is displayed.

In such a related product screen 93, in which a user 11 purchases a product desired, the image 71x, one of 71x ₁ ~71x _5, or when a touch operation image 71 of products other than these, FIG. 9B (b (E) of the purchase confirmation screen 78 is displayed (step S206), and the description thereof will be omitted. However, as in the first embodiment, when the purchase procedure is performed, the purchase procedure shown in FIG. As shown in (e), a purchased product ranking screen 83 similar to the purchased product ranking screen 83 shown in (f) of FIG. 9B (b) is displayed (steps S207 and S208). Here, rankings can be displayed from purchase information by gaze / operation even for keywords that are of interest.

  In the related product screen 93, a “return to list” button 94 is provided, and when this is touched, the display is returned to the product list screen 91a shown in (b) of FIG. As a result, the user-specific gaze data shown in FIG. 7B of the user 11 is created anew, and based on this, the product that the user 11 is gazing at is shown in FIG. ) Will be displayed.

  Thus, also in the second embodiment, the same effect as in the first embodiment can be obtained.

[Third Embodiment]
FIG. 11 is a diagram showing a part of the screen flow on the display screen 21 in FIG. 2 for the processing flow of the third embodiment of the product selection support method according to the present invention. 100 is a product list screen, 101 is a product image, 102 is a gazing point, 103a, 103b, and 104 are selected product screens, 105 is a product name, and 106 is related information. Corresponding portions are denoted by the same reference numerals and redundant description is omitted.

  As for the advertising signage 20 (FIG. 2), as in the signage vending machine 1, the display form of the product image on the display screen 21 (FIG. 2) is a diagram of the user 29 who views the display screen 21 (FIG. 2). It changes according to the gaze data classified by user shown in 7 (b).

  On the product list screen 100 shown in FIG. 11A, images 101 of products A, B,..., R are aligned and displayed in a stationary state. This is the same as the display state on the product list screen 91a shown in (b) of FIG.

  When the user 29 gazes at the advertisement signage 20 on the image 101 of the product of interest in the approach area 63 or the proximity area 64, the advertisement signage 20 displays the gaze data for the user 29 shown in FIG. Based on this, the region being watched is determined. Here, it is assumed that the gazing point 102 is in an area including the images 101 of the products A, B, G, and H. Such an area including the gaze point 102 is hereinafter referred to as a gaze area.

  As for the degree of gaze for the products A, B, G, and H in the gaze area where the gaze point 102 is located, the time (gaze time) in the gaze data for each user shown in FIG. As a result, the degree of gazing for such products increases, and as a result, on the display screen 21, the products A, B, G, and G in the gazing area on the product list screen 100 are displayed as shown in FIG. The selected product screen 103a on which the H image 101 is displayed is displayed.

  In the selected product screen 103a, the columns of the images 101 of the products A and G and the columns of the images 101 of the products B and H are arranged horizontally, and are displayed in an enlarged manner as compared with the product list screen 100. . Further, if the user 29 watches the selected product screen 103a on the arrangement side of the images 101 of the products A and G, and the gaze point 101 is on the arrangement side of the images 101 of the products A and G, the product 29 Since the time (time length) in the user-specific gaze data shown in FIG. 7B for A and G is longer than the products B and H, the degree of gaze for these products A and G is increased. As shown in FIG. 11 (c), the images 101 of the products A and G in the gaze area on the selected product screen 103a are horizontally arranged, and are further enlarged and displayed on the selected product screen 103a. The selected product screen 103b is displayed on the display screen 21.

  When the user 29 gazes at the image 101 on the product G side on the selected product screen 103b, the time (time length) in the user-specific gaze data shown in FIG. Since it becomes longer, the degree of gazing at these products G increases, and as a result, as shown in FIG. 11 (d), the image 101 of the selected product G, the product name 105, and the price of the product G are related. A selected product screen 104 on which information 106 is displayed is displayed on the display screen 2.

  When the user 29 confirms the desired product G on the selected product screen 104 and leaves the advertising signage 20, the display screen 21 displays the product list screen 100 as the top screen shown in FIG. Return.

  As described above, in the third embodiment, the image of the displayed product displayed by gazing at the product screen of the user 29 is limited. Finally, the user 29 is interested or purchases the product. A state in which an image of a desired product and its related information are displayed, and the user 29 can easily and reliably confirm the image of the product simply by gazing at the product screen without any operation. It can be. As a result, it becomes possible for the service provider to automatically collect information that can be utilized for marketing, because it is possible to obtain gaze information without proceeding to the purchase stage.

[Fourth Embodiment]
FIG. 12 is a diagram showing a part of the screen flow on the display screen 21 in FIG. 2 for the processing flow of the fourth embodiment of the product selection support method according to the present invention, which is the advertisement signage shown in FIGS. , 101a _{1 to} 101a ₃ , 101b _{1 to} 101b ₃ , 101c _{1 to} 101c ₃ are product images, 110a is a product category selection screen, 110b is a product component selection screen, 110c is a product price selection screen, 111a _{1 to} 111a ₃ are category keywords, 111b _{1 to} 111b ₃ are component keywords, and 111c _{1 to} 111c ₃ are price keywords. The same reference numerals are given to portions corresponding to the above drawings, and redundant descriptions are omitted. To do.

  In the fourth embodiment, the display screen is selected by selecting a keyword indicating a product attribute according to the gaze state of the user 29 (FIG. 2) on the display screen 21 of the advertisement signage 20 (FIG. 2). The products displayed on the screen 21 can be narrowed down to products desired by the user 29.

  Here, the product keywords are product categories, components, prices, etc. that have a hierarchical relationship, where the category is at the highest level, the product components are at the next level, and the product is at the next level. There is a price etc. The product category represents the type of product such as juice, confectionery, mineral water, etc., and “juice”, “confectionery”, and “mineral water” representing the type in this case are keywords of the product category. become. In addition, the component of the product is a component used in this product. For example, taking mineral water as an example, it is hard water, medium hard water, soft water, etc., and these “hard water”, “medium hard water”, “Soft water” is the keyword of the product components. Further, regarding the price of the product, keywords representing the price of the product such as “100 yen”, “120 yen”, and “150 yen” are the keywords of the price of the product.

When the person is not closer to the advertising signage 20 (FIG. 2) than the distant area 62 shown in FIG. 8, the product category selection screen 110a shown in FIG. 12 (a) is displayed on the display screen 21 of the advertising signage 20. ing. The commodity category selection view 110a, the image 101a ₁ items from each of the respective product categories, 101a _2, 101a ₃ and the image 101a ₁ of each of the products, 101a _2, 101a ₃ each as detailed information indicating the category to A keyword 111 is displayed. For example, the product image 101a ₁ displays the keyword 111a ₁ of “juice”, the product image 101a ₂ displays the keyword 111a ₂ of “sweets”, and the product image 101a ₃ displays “ The keyword 111a ₃ “mineral water” is displayed.

Here, it is assumed that images 101a _{1 to} 101a ₃ of products in three categories of “juice”, “candy”, and “mineral water” are displayed, but the present invention is not limited to this.

  Assuming that a person is approaching the advertising signage 20 while paying attention to a category of a predetermined product on the display screen 2, this person becomes a user 29, and this user 29 is an approach area 63 in FIG. Upon entering, the advertisement signage 20 creates gaze data for each user as shown in FIG. 7B for each category on the product category selection screen 110a. If there is a product category in which the gaze degree obtained from the data is equal to or greater than a predetermined value (for example, the gaze time of gaze data for each user in FIG. 7B is equal to or greater than a predetermined time), this product category is selected. Then, a product component selection screen 110b shown in FIG. 12 (b) for selecting a product component as a keyword in the lower layer of the product category is displayed on the display screen 2.

Here, the commodity category selection view 110a shown in FIG. 12 (a), continuing to watch the images 101a ₃ items from category "mineral water" is the user 29, shown in FIG. 7 (b) for the "mineral water" by the attention degree from the user-specific gaze data, product category in the case where the fixation point 102 in the selection screen 110a is in the image 101a ₃ of merchandise category "mineral water", the image 101a ₃ of merchandise of the "mineral water" Is being watched by the user 29, it is assumed that the category “mineral water” as the detailed information is selected on the product component selection screen 110b shown in FIG. Images 101b of different products are searched in the terminal storage unit 45, arranged and displayed.

Here, in the category “mineral water” selected on the product category selection screen 110a, if there are products with three different components “hard water”, “medium hard water”, and “soft water”, the product component selection screen 110b. in, as shown in FIG. 12 (b), the image 101b ₂ and mineral water image 101b ₃ items from the soft water product of medium hard water mineral water image 101b ₁ of the mineral water in the product of hard water is arranged Is displayed. Further, in the images 101b ₁ , 101b ₂ , and 101b ₃ of these products, the keyword 111b ₁ such as “hard water”, the keyword 111b ₂ such as “medium hard water”, and the keyword 111b ₃ such as “soft water” respectively represent the detailed information. Is displayed.

Here, it is assumed that three product images 101b ₁ , 101b ₂ , and 101b ₃ are displayed on the product component selection screen 110b, but the keyword selected so far (here, “mineral water”). Images 101b of all commodities that fall under are displayed.

Then, while the user 29 is in the approaching area 63 (FIG. 8) or is further approaching the advertising signage 20, if the user 29 continues to watch the product image 101 of any component on the product component selection screen 110b, Based on the user-specific gaze data shown in FIG. 7 (b), it is assumed that the detailed information of the product of the component to be watched is selected (at this time, the product with the gaze point 102 being the component “soft water” on the product component selection screen 110b) assumed to be the image 101b ₃₎ of, displays commodity price selection screen 110c shown in FIG. 12 (c), this is the price of a component "soft water" as details are images 101c of the different products sequences Displayed.

Here, in the component “soft water” selected on the product component selection screen 110b, if there are products with three different prices of “120 yen”, “220 yen”, and “320 yen”, FIG. In the product price selection screen 110c shown in FIG. 12C, as shown in FIG. 12C, the image 101c ₁ of the product (soft water mineral water) whose price is 120 yen and the image 101c ₂ of the product whose price is 220 yen and the price are an image 101c ₃ items from 320 yen is displayed is arranged. In addition, on the images 101c ₁ , 101c ₂ , 101c ₃ of these products, a keyword 111c ₁ such as “120 yen”, a keyword 111c ₂ such as “220 yen”, and a keyword 111c ₃ such as “320 yen” are displayed. Is done.

Here, it is assumed that the images 101c ₁ , 101c ₂ , 101c _{3 of the three} products are displayed on the product price selection screen 110c, but the keyword selected so far (here, “mineral water” Images 101c of all products corresponding to “soft water”) are displayed.

Further, when the user 29 continues to watch the product image 101 of any price on the product price selection screen 110c, the product of the price to continue watching is selected based on the user-specific gaze data shown in FIG. 7B. It has been as (this time, the product price selection screen 110c, the gaze point 102 is assumed to be the image 101c in the _third item price "320 yen") ones, the selection item screen 104 shown in FIG. 12 (d) Is displayed. This selected product screen 104 is the same as the selected product screen 104 shown in FIG. 11D, and the product desired by the user 29 on this selected product screen 104 is the same as in the third embodiment shown in FIG. If G is confirmed and it leaves | separates from the advertisement signage 20, on the display screen 21, it will return to the display of the merchandise category selection screen 110a as a top screen shown to Fig.12 (a).

  As described above, in the fourth embodiment, as in the previous third embodiment, the product images displayed by the user 29 gazing on the product screen are limited. An image of a product that is interesting or desired to be purchased and its related information are displayed, and the user 29 can easily view an image of the product simply by gazing at the product screen without any operation. It can be in a state that can be surely and reliably confirmed.

[Fifth Embodiment]
FIG. 13 is a diagram showing a part of the screen flow on the display screen 21 in FIG. 2 for the processing flow of the fifth embodiment of the product selection support method according to the present invention. The signage 20 relates to a product list screen 120a and 120b, 101a to 101d are images of products in the gaze area, and portions corresponding to the previous drawings are denoted by the same reference numerals and redundant description is omitted.

  When the person is not closer to the advertising signage 20 (FIG. 2) than the distant area 62 shown in FIG. 8, the display screen 21 of the advertising signage 20 displays the product list screen 120a shown in FIG. Yes. On the product list screen 120a, the images 101 of all the target products are arranged and displayed in a stationary state. Although not shown, information such as prices is also displayed at the same time.

  Assuming that this person is approaching the advertising signage 20 while paying attention to the category of the predetermined product on the display screen 2, this person becomes the user 29, but this user 29 is the approach area in FIG. Upon entering 63, the advertisement signage 20 creates gaze data for each user as shown in FIG. 7 (b) for each product on the product list screen 120a. If there is a category in which the gaze degree obtained from the data is equal to or greater than a predetermined value (for example, the gaze time of gaze data for each user in FIG. 7B is equal to or greater than a predetermined time), this product category is selected. A product list screen 120b shown in FIG. 12B is displayed on the display screen 2.

  In the product list screen 120b, images 101a to 101d of products in the gaze area including the gazing point 102 on the product list screen 120a shown in FIG. The As a result, the user 29 can confirm a product of interest.

  When there is a product that the user 29 desires to purchase on the product list screen 120b, the user 29 further looks at the product image, for example, the product image 101a, so that the product of the image 101a is displayed. Since the degree of gaze is increased, the selected product screen 104 is displayed as in the embodiment shown in FIGS. 11 and 12, although it is not shown that this product has been selected. As a result, the user 29 can clearly confirm the product desired to be purchased.

  After that, when the user 29 leaves the advertising signage 20, the display screen 21 returns to the display of the product list screen 120a as the top screen shown in FIG.

  As described above, also in the fifth embodiment, as in the third and fourth embodiments, the product image displayed by gazing on the product screen of the user 29 is enlarged and displayed. However, without any operation, it is possible to easily and surely confirm the image of the product simply by gazing at the product screen.

[Sixth Embodiment]
FIG. 14 is a diagram showing a part of the screen flow on the display screen 21 in FIG. 2 for the processing flow of the sixth embodiment of the product selection support method according to the present invention. The signage 20 relates to a product list screen 130a and 130b, 101a to 101g are images of products, and the same reference numerals are given to portions corresponding to the above-mentioned drawings, and redundant description is omitted.

  When the person is not closer to the advertising signage 20 (FIG. 2) than the distant area 62 shown in FIG. 8, a product list screen 130a shown in FIG. 13A is displayed on the display screen 21 of the advertising signage 20. Yes. On the product list screen 130a, images 101 of all target products are displayed in an aligned manner, and information such as price is also displayed at the same time, although not shown.

  In addition, on the product list screen 130a, an image 101 of a product that is particularly focused on sales by a store such as a new product or a product that wants to increase sales is displayed while shaking. Product images 101b, 101e, and 101g are images of such products, and are displayed while shaking.

  Suppose that the user 29 approaches the advertising signage 20 within the approach area 63 (FIG. 8) on the product list screen 130a, and, for example, watches the images 101b and 101e of the two products displayed in a shaking manner alternately. (As a result, the gazing point 102 reciprocates between the images 101b and 101e). Based on the gazing data for each of the product images 101 shown in FIG. 7B, the gaze including the images 101b and 101e at the corners. The product list screen 130b shown in FIG. 14B is displayed on the display screen 21. The product images 101a to 101f included in the gaze region are enlarged and displayed statically.

  On the product list screen 130b, the product images 101a to 101f in the gaze area may be enlarged and displayed to the same size, but as shown in FIG. 14B, the product image 101c in the center part. , 101d may be enlarged and displayed in a larger size than the images 101a, 101b, 101e, 101f of the upper and lower products.

  As described above, also in the sixth embodiment, a product that the user 29 is interested in in an area corresponding to the point of sight can be obtained simply by the user 29 gazing at a plurality of locations on the display screen 21 alternately. It is enlarged and easy to see.

  In addition, although the image 101b, 101e of the product displayed shaking was demonstrated here as an example, it does not necessarily need to shake, and even if the user 29 gazes at the image 101b, 101e of a product alternately, Similarly, a product list screen 130b shown in FIG. 14B is displayed. On the product list screen 130a, when the user 29 points to one place as shown in FIG. 13 (a), the user 29 looks like the product list screen 120b shown in FIG. 13 (b). An enlarged display is made.

[Seventh Embodiment]
FIG. 15 is a diagram showing a specific example of the screen on the display screen 21 in FIG. 2 in the seventh embodiment of the product selection support method according to the present invention, which relates to the advertisement signage 20 shown in FIGS. Yes, 140 is a product list screen, and parts corresponding to those in the previous drawings are given the same reference numerals and redundant description is omitted.

  In the figure, the product list screen 140 is an advertisement on the product area screen such as the product list screen 120a shown in FIG. 13A, in which the user 29 is in the approach area 63 in FIG. This shows a case where the user is approaching the signage 20 and is gazing at an image 101 of a product of interest on the product list screen. Here, it is assumed that the user 29 is gazing alternately at the images 101a and 101b of the two products. In this seventh embodiment, the images 101a and 101b of the two products are both in this case. It starts to shake and is displayed in a shaking state.

  Thereby, the user 29 can confirm that the advertising signage 20 has definitely detected that he / she is watching the images 101a and 101b of these products that he / she is interested in.

  Although not shown, when the product images 101a and 101b are further watched for a predetermined time or more, as shown in FIGS. 13B and 14B, the product images 101a and 101b are assembled. It is enlarged and displayed in a stopped state so that the user 29 can more clearly confirm these products.

[Eighth Embodiment]
FIG. 16 is a diagram showing a specific example of the screen on the display screen 21 in FIG. 2 in the eighth embodiment of the product selection support method according to the present invention, which relates to the advertisement signage 20 shown in FIGS. Yes, 150 is a product list screen, and parts corresponding to the above-mentioned drawings are given the same reference numerals and redundant description is omitted.

  In the figure, the product list screen 140 is an advertisement on the product area screen such as the product list screen 120a shown in FIG. 13A, in which the user 29 is in the approach area 63 in FIG. A case where the user 29 is approaching the signage 20 and is watching the image 101 of the product of interest on the product list screen, where the user 29 is watching the image 101a of one product. In this case, in the eighth embodiment, keywords related to the product are displayed as A, B, C, and D on the image 101a of the product. As described above, the keyword includes the type (category) of the product, the product name, the component, and the price.

  Thus, the eighth embodiment provides the same effects as the seventh embodiment, and allows the user to know related information such as the category, product name, component, price, etc. of the product being watched. Although not shown, when the product image 101a is watched for a predetermined time or more, as shown in FIGS. 13B and 14B, the product image 101a is displayed in an enlarged state. The user 29 can confirm these items more clearly.

[Ninth Embodiment]
FIG. 17 is a diagram showing a part of the screen flow on the display screen 21 in FIG. 2 with respect to the processing flow of the ninth embodiment of the product selection support method according to the present invention. The signage 20 relates to the product list screens 160a and 160b. The parts corresponding to those in the previous drawings are given the same reference numerals, and redundant description is omitted.

  When the person is not closer to the advertising signage 20 (FIG. 2) than the distant area 62 shown in FIG. 8, a product list screen 160a shown in FIG. 17A is displayed on the display screen 21 of the advertising signage 20. Yes. On the product list screen 160a, images 101 of all target products are displayed while scrolling (here, a case of scrolling in the vertical direction is shown, but it may be in the horizontal direction).

  If the user 29 approaches the advertising signage 20 within the approach area 63 (FIG. 8) and gazes alternately at the product images 101a and 101b on the product list screen 160a, for example, as shown in FIG. 7B. A product list screen 160b shown in FIG. 17B is displayed on the display screen 21 based on the gaze data for each product image 101.

  On the product list screen 160b, the images 101a and 101b of the two products that have been watched are enlarged to the same size, and are displayed in a state where the scrolling is stopped and shaken.

  As described above, also in the ninth embodiment, the user 29 is interested only in the image 101 of the predetermined product on the display screen 21, and the product in which the user 29 is interested in the area corresponding to the gaze point. Is easily enlarged and displayed in a shaken state, so that the user 29 can easily confirm that he / she is watching.

  In each of the above embodiments, when a plurality of persons gaze at the display screen of the signage 1, 20, the signage 1, 20 is defined as the user 11, 29 as the foremost person being gaze at. Operates as described above.

DESCRIPTION OF SYMBOLS 1 Signage vending machine 2 Display screen 3 Camera 4 Operation part 5 Cash slot 6 Card touch part 7 Change outlet 8 Goods outlet 9,10 Speaker 11 User 11a Line of sight 20 Advertising display board 21 Display screen 22 Camera 23, 24 Speaker 25 Control unit 26 Store register 27 Wall 28 Cashier 29 User 29a Line of sight 30 Attention measurement unit 31 Imaging unit 32 Human position measurement unit 33 Gaze direction measurement unit 34 Gaze position information calculation unit 35 Spatial information recording unit 36 Gaze degree calculation unit 37 Total Unit 38 Input Unit 39 Output Control Unit 40 Output Unit 41 Display Feedback Unit 42 Display Device 43 Display Total Unit 44 Speaker Unit 45 Terminal Storage Unit 46 Terminal Control Unit 47 History DB Server 48 Terminal Communication Unit 49 Power Supply Unit 50 Operation Feedback Unit 51 Touch Panel Unit 52 Operation Total Unit 5 3 Personal Authentication Section 54 User Counting Section 55 Settlement Processing Section 56 Purchase Counting Section 57 Product Conveyance Section 58 Product Storage Section 60 Furniture / Vending Machine 61 Advertising / Vending Machine 61
62 distant area 63 approaching the area 64 adjacent area 65 purchase area 66a~66e walking route 70a~70c product list screen 71,71a~71d, 71x, 71x ₁ ~71x ₅ items of image 72 recommended comment 73,73a, 73b fixation region 74 Purchase information column 75 Message column 76 Cart 76a Product display column 76b Purchase charge display column 76c “To accounting” button 77 “Delete” button 78 Purchase confirmation screen 79 Purchase amount display area 80 Payment method introduction area 81 “Cash” button 81b “IC” "Card" button 81c "Mobile phone" button 82 "Cancel" button 83 Purchased product ranking screen 84 Product ranking display field 85 Points 86 Product image 87 "Exit" button 90 Advertising screen 91a, 91b Product list screen 92 Product keyword 3-related products screen 94 "Back to the list" button 100 product list screen 101,101a ₁ ~101a ₃ product image 101b ₁ ~101b ₃ of, 101c ₁ ~101c ₃ image 102 of product images 101a~101g watch in the area of goods Points of Interest 103a, 103b, 104 Selected Product Screen 105 Product Name 106 Related Information 110a Product Category Selection Screen 110b Product Component Selection Screen 110c Product Price Selection Screen 111a _{1 to} 111a ₃ Category Keywords 111b _{1 to} 111b ₃ Component Keywords 111c ₁ to 111c ₃ Price keyword 120a, 120b, 130a, 130b Product list screen 140, 150, 160 Product list screen

Claims (8)

A product information recording unit storing product information, a display unit for displaying a product screen representing an image of the product on a display screen, an image capturing unit for capturing a user who uses the product screen, and an image captured by the image capturing unit A gaze direction measuring unit that detects the gaze direction of the user from the image of the user, a user position measuring unit that measures the position of the user with respect to the display unit, and the product screen on the product screen by the user Using a device with a gaze degree calculation unit that calculates a gaze degree for a product image,
When a user within a predetermined area is detected by the user position measurement unit, the gaze direction measurement unit detects the gaze direction of the user toward the display screen,
Calculating a gaze degree for the image of the product on the product screen displayed on the display screen of the user from the position of the user and the line-of-sight direction;
Identifying a gaze area that includes an image of the product with a high gaze degree in the display screen, highlighting an image of the product that is included in the gaze area,
A gaze degree for each product corresponding to the product image is calculated based on the user's gaze degree for the product image and the highlighted product image included in the gaze area, and the product information recording unit stores the gaze degree for each product. A product selection support method characterized by recording. In claim 1,
The highlighting is a display of an image of the product with a high gaze degree in a central area on the display screen, an enlarged display, or a display of detailed information of the product in the vicinity of the image of the product. A featured product selection support method. In claim 1,
The highlighted display is an enlarged display of an image of the product with a high gaze degree,
Detecting the user's line-of-sight direction and the position of the user with respect to the enlarged image of the product, and calculating the degree of gaze of the user with respect to the enlarged image of the product;
The gaze area including the image of the product having a high gaze degree is specified on the display screen displaying the product image in an enlarged manner, and the image of the product included in the gaze area is further enlarged and displayed.
A product selection support method characterized by the above. In claim 1,
The highlighting is a display of detailed information of the product in the image of the product with a high gaze degree,
When specific detailed information is selected from the displayed detailed information, product information corresponding to the selected detailed information is searched and displayed on the display section so as to be selectable. Support method. In claim 1,
The display screen is provided with a touch panel,
A product selection support method comprising: performing a purchase determination process for a product corresponding to the image of the product that has been touch-operated by touching the product image displayed on the product screen. In claim 1,
The product screen scrolls and displays a plurality of images of the product,
When the user is detected within a predetermined area with respect to the signage, the user's gaze on the product image on the product screen that is scroll-displayed from the position of the user and the viewing direction of the user. Calculate the degree,
The product selection support method, wherein the product image with a high gaze degree is stopped and displayed at the center of the product screen among the product images on the product screen to be scroll-displayed. In claim 1,
In the product information recording unit, the degree of gazing for each product and the sales history of each product are recorded,
A product selection support method, characterized in that a gaze degree and a sales performance ranking of a product can be displayed on the display unit. In claim 1,
In the product information recording unit, a selection history of the detailed information is recorded,
The product selection support method, wherein the ranking of the selected detailed information can be displayed on the display unit.

Images