JP2015201115A - Commodity selling device and image display method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To solve the problem in which: a commodity following the interest of a user may not be displayed.SOLUTION: There is provided a commodity selling device in which a user faces the device to perform operations from selection to purchase of a commodity, the commodity selling device including: output means for arranging, in the initial state, images of a plurality of commodities to be sold in the commodity selling device and displaying the images in an image display area; line-of-sight information acquisition means for acquiring line-of-sight information on the line of sight of the user; and output information changing means for changing the details of display to be displayed in the image display area on the basis of the line-of-sight information.

Description

  The present invention relates to a commodity sales apparatus and an image display method.

  2. Description of the Related Art In recent years, vending machines using large liquid crystal monitors and touch panels on which products are displayed are known instead of vending machines on which product models are displayed. In such a vending machine, the display content can be changed by the user operating the touch panel (see, for example, Patent Document 1).

JP 2011-118807 A

  However, in the vending machine described in Patent Literature 1, since the merchandise that the seller wants the customer to purchase is displayed, a different product from the product that the vending machine user is considering purchasing may be displayed. There is sex.

  The present invention has been made in view of the above, and an object of the present invention is to provide a merchandise sales apparatus capable of displaying merchandise in line with the user's interest and an image display method in the merchandise sales apparatus.

  In order to solve the above-described problem, a product sales apparatus according to an aspect of the present invention is a product sales apparatus that performs a face-to-face operation until a user selects and purchases a product. Based on the line-of-sight information, an output unit that arranges images of a plurality of products for sale in a sales apparatus and displays them in an image display area, line-of-sight information acquisition unit that acquires line-of-sight information related to the line of sight of the user, and the image Output information changing means for changing display contents to be displayed in the display area.

  As shown in the above-mentioned product sales apparatus, information indicating user's interest is obtained by acquiring the user's line-of-sight information with the line-of-sight information acquisition means and changing the display content to be displayed in the image display area based on this. The display content can be changed in correspondence with certain line-of-sight information. Therefore, it is possible to display products according to the user's interest.

  Here, the line-of-sight information acquisition means acquires information for specifying an area in which the user gazes out of the image display area, and the output information change means is based on information related to the area that the user first gazes at. Thus, the display content can be changed.

  If there is an image in which the user is interested in the image display area, it is considered that the user often pays attention to the image first. Therefore, by changing the display content based on the information related to the area that the user first gazes at, it is possible to display products more in line with the user's interest.

  Further, the output information changing means may change the display content displayed in the image display area when the user does not pay attention to any area.

  If the user does not pay attention to any area, the user may not be interested in a specific product. Therefore, when the user does not pay attention to any of the areas as described above, it is possible to actively propose products to the user from the product seller side by changing the display contents.

  Further, in the initial state, the output unit arranges images of the plurality of products for each category to which the product belongs and displays the images in the image display region, and the line-of-sight information acquisition unit displays the images in the image display region. The image display area may be partitioned for each category to which the product belongs, and information for specifying which area the user has focused on among the partitioned areas may be acquired as the line-of-sight information.

  In this way, by dividing the image display area for each category to which the product belongs, and changing the display content based on which of the divided areas has been watched, it is not a specific product but a specific category It is possible to display products in accordance with the interests of users who are considering purchasing the products.

  Here, the line-of-sight information acquisition means may be configured to determine that the user has gazed when the line-of-sight of the user remains for a predetermined time or more.

  Among the display contents of the image display area, when the user's interest is increasing with respect to a specific product or category, the user's line of sight remains for a predetermined time or more. By adopting a configuration for changing the display contents, it is possible to display products more in line with the user's interest.

  The line-of-sight information acquisition means acquires second line-of-sight information related to the user's line of sight with respect to the image display area of the output means after changing the display content, and the output information change means includes the second information The display content displayed in the image display area can be changed again based on the line-of-sight information.

  In this way, by acquiring the second line-of-sight information related to the user's line of sight with respect to the image display area after changing the display content, and by changing the display content again based on the second line-of-sight information, Since it is possible to change the display content more finely according to the line of sight, it is possible to display products more in line with the user's interest.

  Moreover, it is set as the aspect further equipped with the purchase information acquisition means which acquires the purchase result of the product by the user who acquired the line-of-sight information by the line-of-sight information acquisition means in association with the display content and the line-of-sight information displayed in the image display area. You can also.

  In this way, in the purchase information acquisition means, the display content and the user's line of sight are directed by acquiring the purchase result of the product by the user who has acquired the line-of-sight information in association with the display content and the line-of-sight information displayed in the image display area. Since the information regarding the correspondence between the given location and the purchase behavior of the user can be acquired in the product sales apparatus, it is possible to realize product display more in line with the user's interest based on this information.

  The present invention can be described as an invention of a product sales apparatus as described above, and can also be described as an invention of an image display method as follows. This is substantially the same invention only in different categories, and has the same operations and effects.

  That is, the image display method according to the present invention is an image display method in a product sales apparatus that performs a face-to-face operation until a user selects and purchases a product, and is sold by the product sales apparatus in an initial state. An output step of arranging a plurality of product images to be displayed in an image display area, a line-of-sight information acquisition step of acquiring line-of-sight information relating to the user's line of sight, and displaying in the image display area based on the line-of-sight information And an output information changing step for changing the display content.

  ADVANTAGE OF THE INVENTION According to this invention, the goods sales apparatus and image display method which can display the goods along a user's interest are provided.

It is a figure explaining the structure of the vending machine which is 1 type of the goods sales apparatus which concerns on embodiment of this invention. It is a functional block diagram explaining the structure of a vending machine. It is a figure which shows the example which divided the display of the vending machine into the several area | region. It is a figure explaining the change of the display content of the display of a vending machine. It is a figure which shows the example of the information stored in an output information storage part. It is a figure which shows the example of the information stored in an output information storage part. It is a figure which shows the example of the information acquired by the purchase information acquisition part. It is a flowchart explaining the image display method in a vending machine. It is a flowchart explaining the image display according to user action.

  DESCRIPTION OF EMBODIMENTS Hereinafter, embodiments for carrying out the present invention will be described in detail with reference to the accompanying drawings. In the description of the drawings, the same elements are denoted by the same reference numerals, and redundant description is omitted.

(Product sales equipment)
FIG. 1 is a diagram illustrating the configuration of a vending machine that is a type of product sales apparatus according to an embodiment of the present invention. In the present invention, the product sales apparatus refers to an apparatus capable of performing a series of operations until the user selects and purchases a product in a face-to-face manner. Examples of such a commodity sales apparatus include vending machines for beverage products or food products, digital signage, and the like. In particular, the product sales apparatus according to the present embodiment includes a configuration in which a user selects a product while browsing a product image output on a display. Here, “a series of operations until the user selects and purchases a product” means that the user selects a specific product from the product list by operating the product sales apparatus, Refers to a series of operations until payment is completed. In addition, the vending machine described in the following embodiment, when the user operates the vending machine, selects the product and finishes payment, discharges the product purchased by the user from the vending machine, A device that allows a user to pick up goods on the spot. Thus, the merchandise sales apparatus may include a function for discharging the merchandise after purchase. In the following embodiments, the user is not limited to a person who purchases a product, and a person who may purchase a product is also referred to as a user.

  As shown in FIG. 1, a vending machine 1 which is a kind of product sales apparatus according to the present embodiment includes a rectangular parallelepiped housing 10 and a display 11 (an image display area is attached to the front surface of the housing 10). Output unit, purchase information acquisition unit), deposit port 12, outlet 13, refund port 114, speaker 15 (output unit), and camera 16 (line-of-sight information acquisition unit).

  A product sold by the vending machine 1 is accommodated in the housing 10. The display 11 has a function of displaying information related to products to be sold. Further, in the vending machine 1, the user selects a product to be purchased with reference to the display 11 and inputs a price related to the purchase of the product from the deposit port 12, whereby the selected product is moved to the outlet 13. The As a result, the user can obtain the product. In addition, refund of the input money or change is performed from the refund port 14.

  In the image display area, the display 11 of the vending machine 1 can display information related to the product, information related to monetary receipt when purchasing the product, and the like in addition to displaying and displaying the image of the product. . In addition, advertisements for products and the like can be displayed. In addition, the display 11 of the vending machine 1 according to the present embodiment is a so-called touch panel, and when a user touches a specific position on the display 11, an instruction (product selection or the like) from the user related to product purchase is automatically performed. It can be recognized on the vending machine 1 side. That is, it has a function of acquiring information related to a user's product. In addition, when the display 11 is not a touch panel, a button for selecting a product or the like is separately provided, and the user's instruction regarding the product purchase can be recognized on the vending machine 1 side by operating the button. it can. The display 11 arranges and displays product images of a plurality of products sold by the vending machine 1 as an initial state when the user does not perform any operation. Thereafter, when the vending machine 1 detects that the user has performed some operation, the display 11 can change the content to be displayed according to the user's operation.

  The speaker 15 has a function of outputting sound, and can output sound set in advance corresponding to the operation when the user is performing a purchase operation of the product, for example.

  The camera 16 is provided above the display 11 and has a function of detecting the user's action by imaging the periphery. In particular, when facing the front surface of the casing 10 of the vending machine 1, the camera 16 acquires information (line-of-sight information) related to the user's line of sight. The vending machine 1 changes the content displayed on the display 11 based on the line-of-sight information acquired by the camera 16. This point will be described later.

  Next, functions of the vending machine 1 will be described with reference to a functional block diagram shown in FIG. As shown in FIG. 2, the vending machine 1 includes a neighborhood information acquisition unit 21, a line-of-sight information acquisition unit 22 (line-of-sight information acquisition unit), an output information generation unit 23 (output information change unit), an output information storage unit 24, and an output. A unit 25 (output means, output information change means) and a purchase information acquisition unit 26 (purchase information acquisition means) are included. In addition, the vending machine 1 physically includes an auxiliary storage device exemplified by a CPU, a RAM and a ROM that are main storage devices, a hard disk, a flash memory, and the like in addition to the components described in FIG. Is configured as a computer system including an input device exemplified by a communication module, a touch panel and a button, an output device such as a display, and the like by loading predetermined computer software on hardware such as a CPU and RAM A series of functions in each device is realized by operating the communication module, the input device, and the output device under the control of the CPU, and reading and writing data in the RAM and the auxiliary storage device. Hereinafter, returning to FIG. 2, the function of each part of the vending machine 1 will be described in detail.

  The neighborhood information acquisition unit 21 has a function of acquiring neighborhood information of the installation position of the vending machine 1. The information on the vicinity of the installation position of the vending machine 1 is, for example, information indicating whether or not a user who is likely to purchase a product is in the vicinity. If the user approaches the vending machine 1, this information is used. Detect. Whether or not the user has approached the vending machine 1 is based on, for example, whether or not the user has approached the radius of the vending machine 1 within 2 m based on an image (moving image or still image) captured by the camera 16. Is judged. Alternatively, the user may approach the vending machine 1 within a radius of 5 m and stop for a predetermined time (for example, 2 seconds). Thus, based on the preset conditions, it is determined from the image captured by the camera 16 whether or not the user has approached. When the user has approached, this information is notified to the output information generation unit 23. Note that the information on the neighborhood of the installation position of the vending machine 1 acquired by the neighborhood information acquisition unit 21 need not be image information. That is, it is good also as a structure which replaces with the camera 16 and acquires the information of a neighborhood by providing the sensor etc. which use infrared light, an ultrasonic wave, etc.

  The line-of-sight information acquisition unit 22 has a function of acquiring line-of-sight information of a user on the front surface of the vending machine 1. The line-of-sight information acquisition unit 22 is realized by a known line-of-sight information acquisition device such as an eye tracking device. In addition, it is good also as a structure in which the gaze information acquisition part 22 acquires a user's gaze information by providing the sensor etc. which replace with the camera 16 using infrared light, an ultrasonic wave, etc. In the present embodiment, a case where line-of-sight information is acquired using the camera 16 will be described.

  Here, the line-of-sight information is information indicating, for example, which area of the display 11 the user has looked at, and is information that specifies the area that the user has watched. Here, “gazing” refers to a state in which the user is particularly interested in watching the display 11. Specifically, the line-of-sight information acquisition unit 22 uses the display of the vending machine 1 based on an image (moving image or still image) captured by the camera 16 for the user detected by the neighborhood information acquisition unit 21. 11, and if so, which area of the display 11 is being watched. Note that whether or not the user is gazing at a specific area from the image captured by the camera 16 is determined by, for example, determining whether the user's line of sight is within a circle having a predetermined radius (for example, 5 cm) for a predetermined time (for example, 0. It can be judged by whether or not it stays for 2 seconds) or more. As another method, the line-of-sight information for a predetermined time (for example, 3 seconds) is acquired after the user starts to look at the display 11, and the area that the user has watched for the longest time in the predetermined time is watched. It can be determined that the area is Moreover, it can also be set as the structure which acquires the information which concerns on a user's pupil, and judges that the user has watched when some change arises in a user's pupil.

  In the line-of-sight information acquired by the line-of-sight information acquisition unit 22, the method for determining whether or not the user has gazed is not limited to the above. For example, there is a method of counting the number of times the user has looked at a specific area and determining that the specific area is watched when the number of times exceeds a predetermined threshold. Another example is a method of determining by combining the number of times the user has viewed and the time of viewing the area (for example, determining that the user has watched when the user has viewed twice or more, for a total of 0.5 seconds or more). As described above, the method for determining whether or not the user has watched can be appropriately selected and changed. Moreover, it is good also as a method of determining whether the user watched according to the display content etc. on the display 11. FIG. For example, when it is determined whether or not the user has focused on the initial screen, a method is used to determine whether or not the user has focused on a specific area user. After the display is changed, the user can specify It is also possible to employ a method of using a method of counting and judging the number of times the area has been viewed.

  As described above, the line-of-sight information acquisition unit 22 determines whether the user is gazing at the display 11 and which region is being gazed from the image captured by the camera 16 based on preset conditions. When the region in which the user is gazing can be identified, this information is notified to the output information generation unit 23.

  When the line-of-sight information acquisition unit 22 determines where the user is looking at the display 11, the line-of-sight information acquisition unit 22 partitions the display 11 into a plurality of areas and out of the areas where the user's line of sight is partitioned. It can be set as the structure which judges which area | region is gazing. FIG. 3 shows an example in which the display 11 of the vending machine 1 in an initial state before the user performs a purchase operation is divided into nine sections (3 rows × 3 columns). In the example shown in FIG. 3, nine regions are referred to as region A to region I, respectively. By dividing the display 11 into a plurality of areas and acquiring information regarding which area the user is gazing at in the line-of-sight information acquisition unit 22, information such as what product the user is interested in is obtained. Can be acquired.

  The user's interest will be specifically described. When the user gazes at the display 11, it is considered that the user is often interested in the displayed product image. For example, in the display 11 shown in FIG. 3, it is assumed that a plurality of images related to tea / water products are arranged in the regions A to C, and a plurality of images related to fruit juice products are arranged in the regions D to F. In G to I, it is assumed that a plurality of coffee-related images are arranged. Here, when the user is considering the purchase of tea / water-based products, the user is likely to gaze at the areas A to C first. Therefore, when a plurality of product images are arranged and displayed on the display 11, information corresponding to the user's interest can be obtained by changing the information presented to the user based on the area that the user first gazes at. Can be presented.

  Except when the user decides to purchase a specific product in advance, when the user views the display 11, the product to be considered for purchase is often recognized by a combination of several categories. it is conceivable that. Specifically, the user recognizes the subject of purchase consideration as, for example, “a tea / water-based“ warm ”product” or “a coffee-based” “slight sugar” “plastic bottle”. Yes. Therefore, the products are classified and classified by combining some of the categories to which the products belong (for example, “warmth / meat”, “tea / water / fruit juice / coffee”, “plastic bottle / can”, etc.) Product images are arranged close to each product (for example, tea / water-based plastic bottle products are placed in region A, tea / water-based can products are placed in region B, etc.) By correlating the display 11 and acquiring line-of-sight information, it becomes easier to estimate the category of the product that the user is interested in.

  The output information generation unit 23 has a function of generating information to be output from the display 11 and the speaker 15 based on information acquired by the neighborhood information acquisition unit 21 and the line-of-sight information acquisition unit 22. That is, when changing the display contents on the display 11, information for changing is generated.

  The output information generated in the output information generation unit 23 based on the information from the neighborhood information acquisition unit 21 is, for example, when the proximity information acquisition unit 21 detects that the user has approached the vending machine 1 from a distance. , Voice information for notifying the user of the existence of the vending machine 1 (for example, announcement of “I welcome you”) and the like. In addition, when a sales promotion campaign for a specific product is performed, the output information can be an image and sound related to the sales promotion campaign that is output when the user approaches. In addition, when outputting some information as the user approaches, it is possible to sell the product without narrowing the options by the user as a specification to return to the initial display sales product list again after the output. To preferred.

  In addition, while the proximity information acquisition unit 21 detects that the user is in the vicinity of the vending machine 1, some information is output regardless of whether or not the user has purchased the product with the vending machine 1. It can also be configured. For example, it is good also as a structure which outputs the image and sound which concern on a sales promotion campaign as output information, even after a user purchases goods. Also, a configuration that displays a question related to a product sold by the vending machine 1 and its related product to the user and obtains some information (for example, asking whether or not the user is interested) from the user. It is good.

  The output information generated in the output information generation unit 23 based on the information from the line-of-sight information acquisition unit 22 is, for example, a user based on information acquired by the line-of-sight information acquisition unit 22 as illustrated in FIG. Refers to information displayed in the area A1 corresponding to the information displayed in the area A by changing the display content on the display 11 when it is determined that the area A is viewed. Such information includes, for example, the same tea / water-based product list as that in the region A, details of the products displayed in the region A, a series of related products, and the like. In addition, an advertisement or the like related to the product displayed in the area A can be displayed. Moreover, it can also be set as the structure which performs an audio | voice output in addition to changing the display content as needed. Note that the size, shape, and the like of the area A1 that displays the changed content can be changed as appropriate.

  In some cases, such as when the user's line of sight is not fixed (a specific area is not watched), the line of sight information acquisition unit 22 may not be able to detect the area that the user is watching. In this case, the output information generation unit 23 may generate information that the user is interested in as output information and send it to the output unit 25. The information that the user is interested in includes, for example, an image and sound of an advertisement for a sales promotion campaign. In addition, when the user's line of sight deviates from the display 11, it may be configured to perform some audio output so that the user turns the line of sight toward the display 11 again.

  In addition, when the user's line of sight is not fixed (a specific area is not watched) or the like, the content of the question that asks the user's preference or the like is generated as output information when the display content that the user is interested in cannot be specified. It can also be set as the aspect which presents the goods which a user is interested by dialog with a user by setting it as the structure which acquires the reply from a user by operation of the display 11 (selection from the choice by a touch panel) by a gaze or a user. . In this case, if a question in the YES / NO format is created so that the user can easily answer, the user's answer rate may increase. As described above, various modes are conceivable as the output information generated in the output information generation unit 23 based on the information from the neighborhood information acquisition unit 21 and the line-of-sight information acquisition unit 22.

  The output information storage unit 24 has a function of storing a correspondence relationship between the user's line-of-sight information and the content displayed in the area A1. Examples of information stored in the output information storage unit 24 are shown in FIGS. In FIG. 5, when the user looks at the display 11 in the initial state shown in FIG. 3, an area A <b> 1 (FIG. 4) is associated with which area the user is gazing at (gazing target) and the area the user is gazing at. The content of the information displayed in (Reference) is associated. For example, when the line-of-sight information acquisition unit 22 detects that the user has gazed at the area A (tea / water system), the tea / water system product list is displayed in the area A1 of the display 11. In this way, the line-of-sight information of the output information storage unit 24 user and the display content on the display after the display change are stored in association with each other. Further, as shown in FIG. 5, output information (here, the advertisement X is displayed after 10 seconds) to be displayed when the user does not pay attention to any area can be stored in association with each other. The content displayed on the display 11 in the initial state is displayed in a state where the user is not interested in a specific category or product. Such display contents that do not correspond to the specific interest are referred to as “first layer display” in the following embodiments.

  The information stored in the output information storage unit 24 can be created based on past user purchase behavior or the like. For example, in FIG. 5, when the user gazes at the coffee products in the areas G to I, not only the coffee products but also the tea products are displayed in the area A1 after the gaze. This is because, according to the purchase behavior of the past user, the user who first focused on the areas G to I may purchase not only coffee products displayed in the areas G to I but also tea products. This is because it is known. As described above, on the merchant side of the product sold by the vending machine 1, the content displayed in the area A1 corresponding to the user's line-of-sight information can be changed as appropriate.

  In FIG. 6, after displaying a plurality of product images (here, products 01 to 03) in the area A1, the display content is changed again based on which product the user has watched among the products displayed in the area A1. The corresponding relationship is shown. As described above, when the display content is changed depending on the product image to be watched, the line-of-sight information acquisition unit 22 divides the area for each image of the product, and distinguishes and acquires the line-of-sight information for each product. It is set as the structure which acquires the information which concerns on the product being watched. Further, as shown in FIG. 6, output information (here, returning to the initial screen) to be displayed when the user does not pay attention to any area can be stored in association with each other. The content displayed in the area A1 of the display 11 is displayed in a state in which the user who has seen the first hierarchy display is interested in a specific category or product. The display content corresponding to such specific interest is referred to as “second layer display” in the following embodiments.

  In addition, as shown in FIG. 4, an icon A2 or the like indicating that the display content is returned to the previous screen is displayed in the area A1, and when the user watches the icon A2, the previous screen (areas A to I) is displayed. It is good also as a structure which returns to the 1st hierarchy display of the display etc. of the initial state in which goods are shown.

  Thus, the output information generation unit 23 refers to the output information storage unit 24 based on the information acquired by the neighborhood information acquisition unit 21 or the line-of-sight information acquisition unit 22, and outputs information (information to be displayed on the display). And voice information).

  The output unit 25 has a function of displaying an image in the image display area of the display 11 and outputting sound from the speaker 15. The output unit 25 causes the display 11 to display an initial image when there is no instruction from the output information generation unit 23. And when changing the display content of the display 11, it has the function to output the output information produced | generated by the output information production | generation part 23. FIG. Specifically, when the display content of the display 11 is changed and audio information is included, audio output by the speaker 15 is executed. Thereby, the information generated by the output information generation unit 23 is output to the outside.

  In addition, when the user performs some operation such as purchasing a product, the output unit 25 can change the display content in association with the operation. For example, when a purchase operation is performed, the initial state can be restored. In addition, although the display content of the display 11 is changed based on the line-of-sight information, if the user does not perform a purchase operation for a predetermined time, the display content of the display 11 can be returned to the initial state.

  The purchase information acquisition unit 26 has a function of acquiring the purchase result of the product by the user who has acquired the line-of-sight information by the line-of-sight information acquisition unit 22 as purchase information in association with the display content and the line-of-sight information displayed in the image display area. The purchase information acquired by the purchase information acquisition unit 26 includes information indicating which area the user has focused on the display content of the display 11 and the purchase result of the product by the user. Here, the purchase result of the product by the user includes not only information for specifying the product selected and purchased by the user, but also information when the user has not made a purchase. Since the user's line of sight corresponds to the display content of the display 11, the purchase information includes the display content of the display 11, that is, the output information generated by the output information generating unit 23. The purchase information acquired by the purchase information acquisition unit 26 may be stored in the vending machine 1 or may be stored in an external device different from the vending machine 1.

  An example of purchase information acquired by the purchase information acquisition unit 26 is shown in FIG. FIGS. 7A to 7C show purchase information for three users 01 to 03, respectively. In the example of purchase information shown in FIG. 7, for each user, information for identifying the user (for example, a user number), the time at which the proximity information acquisition unit 21 detects the approach of the user, and the approach of the user to detect the gaze information acquisition unit 22, the elapsed time since the start of the acquisition of the line-of-sight information, the hierarchy and display content of the display content displayed on the display 11, information indicating the object that the user has focused on the display content, and the series of actions of the user , The attention rank indicating the degree of the area that the user has particularly focused on, and the purchased product (or information indicating no purchase) are associated with each other. Note that it is not necessary to acquire all the items shown in FIG. 7 as purchase information, and a part of the information may be acquired. Note that, when there are a plurality of objects (areas) that the user has watched, for example, the rank is assigned in order from the area that the user has watched more by a predetermined method such as the user's gaze time and the number of times of gaze. It is a thing.

  The purchase information acquired by the purchase information acquisition unit 26 is information indicating the relationship between the display content that the user approaching the vending machine 1 gazes on the display 11 and the actual purchase behavior. For example, FIG. 7A shows that the user 01 is gazing at the area A when first viewing the “initial screen” of the “first layer display”. Then, the display content of the display 11 is changed based on the fact that the user 01 gazes at the area A, and the “tea / water-based merchandise list” which is the “second level display” is displayed in the area A1 (see FIG. 4). It has been shown. On the other hand, it is shown that the user 01 watches the product 02 after watching the product 01 and purchases the product 02 as a result. Further, the display 11 displays “purchaser advertisement for purchaser” of “first layer display” after the user purchases the product, and shows that the user has watched the “product list” in the advertisement. In FIG. 7A, the elapsed time from the start of acquisition of the user's line-of-sight information is recorded for each operation.

  In FIG. 7B, the user 02 refers to the “coffee product list” in the “second level display” and looks at the product 31 and the product 32, but the “initial screen” in the “first level display”. After returning, it indicates that he left the vending machine 1 without purchasing anything. In FIG. 7C, the user 03 refers to the “coffee product list” in the “second level display” and looks at the product 32 and the product 34, but the “initial screen” in the “first level display”. After returning to “”, it is shown that the product 01 has been finally purchased with reference to the “tea / water-based product list”.

  As described above, the purchase information acquired by the purchase information acquisition unit 26 is information indicating a correspondence relationship between the user's line of sight (information watched by the user) and the purchase behavior of the user, and thus approaches the vending machine 1. By collecting and accumulating for each user and using this, it is possible to propose products according to the user's interest. A method of using the purchase information acquired by the purchase information acquisition unit 26 will be described later.

(Output method including image display method)
Next, an output method including an image display method by the vending machine will be described with reference to FIGS. First, an image display method while the user is approaching the vending machine 1 will be described with reference to FIG. Next, a change in image display according to the user's action will be described with reference to FIG.

  First, when the vending machine 1 is in the initial state of the first hierarchy display (S01: output step), product images of a plurality of products are arranged and displayed on the display 11 by the output unit 25. At this time, the camera 16 continuously captures an image, and when the user approaches, the proximity information acquisition unit 21 detects the image. That is, until the proximity information acquisition unit 21 detects that the user is approaching (S02-NO), the display 11 is kept in the initial state.

  Next, when the proximity information acquisition unit 21 detects that the user has approached (S02-YES), the state is changed to a state in which the line-of-sight information of the approaching user is acquired. That is, when the proximity information acquisition unit 21 detects the approach of the user, the information is notified to the line-of-sight information acquisition unit 22 and the output information generation unit 23, so that the line-of-sight information acquisition unit 22 acquires the line-of-sight information of the user. Is started (S03: line-of-sight information acquisition step). At this time, the purchase information acquisition unit 26 starts acquiring purchase information related to the approaching user. Specifically, the user information (such as user 01) described in the first line of the purchase information shown in FIG. 7 and the approach time (line-of-sight information acquisition start time) are recorded. In the following, the purchase information acquisition unit 26 creates the purchase information shown in FIG. 7 by acquiring information about the user's line of sight, the display content (switching) on the display 11, and the user's behavior. . The output information generation unit 23 refers to the output information storage unit 24 and generates output information based on the information that is output when the user approaches. Then, the output unit 25 causes the display 11 and the speaker 15 to output. When some information is output with the approach of the user, it is preferable to return to the display sales product list in the initial state after the output because the product can be sold without narrowing the options by the user.

  The line-of-sight information acquisition unit 22 confirms whether the user is in a gaze state based on the image captured by the camera 16 (S04), and until the user gazes at any area of the display 11 (S04-NO). ), Continue to check the gaze state. If the user does not pay attention to any area of the display 11 for a predetermined time (for example, 15 seconds), it is determined that the display content in which the user is interested is not generated in the initial state, and the sales promotion advertisement is forced. For example, the image display may be changed (S07). As a method of performing such processing, for example, as shown in FIG. 5, in the output information storage unit 24, output information to be displayed when the user does not pay attention to any area is stored in association with each other. And a method of changing the display content after outputting the specific display content for a predetermined time.

  On the other hand, when the line-of-sight information acquisition unit 22 detects that the user has looked at any region (S04-YES), the region that the user has watched is confirmed (S05) and notified to the output information generation unit 23. . The output information generation unit 23 refers to the output information storage unit 24 based on the information notified from the line-of-sight information acquisition unit 22 and outputs to be displayed on the display 11 after the change corresponding to the area watched by the user. Information is generated (S06: output information change step), and the output content of the display 11 is changed by the output unit 25 (S07: output information change step). As a result, the display content related to the second hierarchy display is output to the display 11. At this time, voice information and the like can be output simultaneously.

  Thereafter, in the vending machine 1, the information related to the user's line of sight with respect to the display 11 after the display content is changed by the line-of-sight information acquisition unit 22 is acquired as the second line-of-sight information, and is displayed again based on the second line-of-sight information. It is good also as a structure (S04-S07) which changes the content, and you may change to the state which waits for a user's action (S08). When the display content is changed using the second line-of-sight information, more detailed information can be presented to the user according to the user's interest. In addition, when the user desires to view the display contents in the initial state (for example, by selecting the “return” icon shown in FIG. 4 or the like), the initial state display that is the first hierarchy display is performed again. You can also. In any case, it is possible to continue the acquisition of the line-of-sight information and return to the state where the user's gaze state is detected (S04).

  On the other hand, when it changes to the state which waits for a user's action (S08), until the user acts (S08-NO), the output content after a change is continued. On the other hand, when the user performs a purchase action or leaves from the vending machine 1 (does not purchase the product for a predetermined time) (YES in S08), the vending machine 1 waits for the display contents on the display 11 ( The product list is switched to the initial state (S09), and the initial state is continued until a new user approaches.

  With reference to FIG. 9, an example of changing the display contents when the display contents on the display 11 are changed before switching to the standby state (S09) when the user takes action (S08—YES) will be described. .

  First, the display content is changed according to whether the user has purchased a product (S21). For example, when a product is purchased (S21-YES), the display content after purchase is changed (S22). Examples of display contents after purchase include introduction of other products that are promoted by the vending machine 1, detailed information (raw materials, manufacturing methods, etc.) of purchased products, and campaign advertisements for purchasers. Moreover, when making some proposal with respect to the user who purchased goods, it is possible to change into the display content corresponding to this proposal. For example, for the purpose of collecting information from the user, it is possible to employ display contents (such as an image of a purchased product) that do not move the user from the vending machine 1. While displaying these pieces of information on the display 11, the line-of-sight information acquisition unit 22 acquires the line-of-sight information of the user, so that the user who purchased the product is interested in what information about the purchased product. Collection is possible.

  When the user does not purchase (S21-NO), a display at the time of non-purchase is performed (S23). This non-purchased display can be configured such that the display content is not changed from the state waiting for the user's action (S08), or the display content is forcibly changed when a predetermined time has elapsed. Good.

  Thereafter, when the proximity information acquisition unit 21 detects that the user has moved (away from the vending machine 1) (S24-YES), the display 11 is switched to a standby state (S25 = S09). Further, while the user does not move (S24-NO), the display content of the display 11 is not changed. After the user moves, the display 11 of the vending machine 1 is switched to the standby state, and then the acquisition of a series of purchase information related to the specific user acquired by the purchase information acquisition unit 26 is terminated.

  As described above, according to the product sales apparatus (the vending machine 1) and the image display method according to the present embodiment, the line-of-sight information acquisition unit 22 acquires the line-of-sight information of the user, and the display that is displayed on the display 11 based on the acquired line-of-sight information. By adopting a configuration in which the content is changed, the display content can be changed in accordance with the line-of-sight information that is information indicating the user's interest. Therefore, it is possible to display products according to the user's interest.

  In addition, if there is an image of interest in the image displayed on the display 11, the user is likely to gaze at the image first. Therefore, as in the vending machine 1, by changing the display content based on the information related to the area that the user first gazes at, it is possible to display products more in line with the user's interest.

  And when a user does not watch any area | region, a user may not be interested in a specific goods. Therefore, as in the vending machine 1 described above, when the user does not pay attention to any area, the display content is changed such as displaying an advertisement of a sales promotion campaign. Can be proactively marketed. Various changes can be made to the display on the display 11 such as the number of products (advertisements) to be sold to the user and the display time of the advertisement on the display 11. Also, when displaying an advertisement for a sales promotion campaign, the line-of-sight information acquisition unit 22 is configured such that the user acquires line-of-sight information, and the display content is changed when the user gazes at a specific area. You can also.

  In addition, by dividing the image display area for each category to which the product belongs, and changing the display content based on which of the partitioned areas has been watched, the product of a specific category instead of the specific product It is possible to display products in accordance with the interests of users who are considering purchasing. At this time, it is preferable to arrange so that commodities of a common category are close to each other.

  Moreover, when the user's interest is increasing with respect to a specific product or category among the display contents of the display 11, the user's line of sight remains for a predetermined time or longer. By adopting a configuration in which the display content is changed, it is possible to display products more in line with the user's interest.

  And by providing the structure which acquires the 2nd gaze information which concerns on a user's eyes | visual_axis with respect to the image display area of the display 11 after changing the display content, and changes a display content again based on 2nd eyes | visual_axis information, a user is provided. Since the display content can be changed more finely according to the line of sight of the product, it is possible to display products more in line with the user's interest.

(How to use purchase information)
Next, a method for using the purchase information acquired by the purchase information acquisition unit 26 will be described with reference to FIGS. As described above, the purchase information acquired by the vending machine 1 indicates the relationship between the user's interest and the user's purchase behavior. Display content that promotes product purchase according to the user's line of sight by acquiring, as purchase information, the relationship between the line-of-sight information acquired by the line-of-sight information acquisition unit 22 and the purchase behavior (particularly, purchase result) of the user. It can also be changed. In addition, it is possible to review the types of products displayed in the vending machine 1. How to use such purchase information will be described.

  For example, as shown in FIG. 7A, when the gaze target most watched by the user (gaze rank 1) is the product 02 and the product purchased by the user is the product 02, the user gazes. Since the product = the product purchased by the user, it can be considered that the vending machine 1 is able to propose a product based on the user's interest. Further, FIG. 7A shows information that the user is paying attention to the prize list when the purchaser campaign advertisement is displayed. As described above, even when an advertisement or the like is displayed, the user's line-of-sight information is acquired, so that not only the products displayed on the vending machine 1 but also information related to the contents that the user is likely to be interested in is automatically displayed. It can be acquired on the vending machine 1 side.

  Next, in FIG. 7B, the user pays attention to a specific area (area G) from the initial screen of the first hierarchy display, and displays a list of coffee-based products of the second hierarchy display in the area A of the display 11. Although the product 31 and the product 32 are closely watched, an example in which the user does not purchase the product finally is shown. This example shows that the user was interested in the coffee-based product (there was a purchase intention), but the coffee-based product that the user wanted to purchase was not in the displayed product of the vending machine 1. In other words, since it is considered that the display products of the vending machine 1 are not able to increase the purchase motivation of users who are interested in coffee-based products, the display merchandise is reviewed to improve the purchase motivation. It is possible to do.

  In such a case, as a method of increasing the user's willingness to purchase, for example, a method of newly displaying a product that is not displayed in the current vending machine 1 and is increasing in sales in other vending machines or the like Is mentioned. Also, after looking at a list of coffee-based products, users who do not lead to product purchases (do not move to purchase-related behaviors) propose products in other categories (“How about this product?” The user's preference by asking questions to the user at the stage where the user pays attention to the "Back" icon A2 ("Please inform us of your favorite products in coffee-based. Sugar / fine sugar / sugar-free") For example, a method of directly acquiring information such as from a user. Further, as a result of acquiring information such as user preferences from the user, if the vending machine 1 does not display products corresponding to the user preferences, for example, the neighborhood displaying products according to the user preferences It is also possible to guide the vending machines. However, as a matter of course, it is necessary to obtain information on nearby vending machines in advance and store it in the vending machine 1 or an external device that can communicate with the vending machine 1. In this way, by acquiring the purchase result by the user by the purchase information acquisition unit 26 while acquiring the line-of-sight information by the line-of-sight information acquisition unit 22, what the user is interested in (was), Based on the relationship with the purchase result of the user, the method of selling the product in the vending machine 1 can be examined and changed, and the display and proposal of the product in accordance with the user's interest can be performed.

  Furthermore, in FIG.7 (c), a user gazes at a specific area | region (area | region G) from the initial screen of a 1st hierarchy display, and displays the coffee-type goods list of a 2nd hierarchy display on the area | region A of the display 11, Despite gazing at product 32 and product 34, gazing at another area (area A) from the initial screen of the first hierarchy display, and finally products included in the tea / water-based product list of the second hierarchy display An example of paying attention to 01 is shown. Further, in this example, a product with a gaze rank 2 different from the product 32 that the user has shown most interest (gaze rank 1) is purchased. By acquiring such user purchase information, it can be seen that the product of the gaze rank 1 was not purchased like the user 01 in FIG. Therefore, “why the user did not select a product from the coffee-based product list”, “why did the user purchase a product 01 with a different category instead of the product 32”, and the like can be considered.

  For example, as a reason why the user did not purchase the product from the coffee-based product list, it can be assumed that the assortment of coffee-based products in the vending machine 1 did not match the user's interest. As a reason for purchasing a product from the tea / water-based product list, it can be inferred that a product satisfying the user's interest that was not included in the coffee-based product of the vending machine 1 was displayed as a tea / water-based product. In such a case, when the vending machine 1 does not include sugar-free coffee in the coffee-based product, the user's interest is particularly “sugar-free” among the coffee-based products. Since there was no coffee, it is possible that tea / water products were selected as other sugar-free products. Therefore, considering that the user with such an interest is in the buyer group, for example, when displaying a list of coffee-based products as a method of replacing the products to be displayed or as a second layer display, tea-based products are also A method of improving the display method, such as displaying as an option, can be adopted.

  In conventional vending machines, the number of sales was calculated for each type of product displayed, but information such as which product (category) the user showed interest in before purchasing the product Could not get. Therefore, information related to the case where the user did not purchase the product (for example, information related to why the user did not purchase the product) could not be acquired on the vending machine 1 side. On the other hand, as described above, when it is configured to acquire the purchase information of the user in which the line-of-sight information and the purchase result of the user are associated, more information related to the user's interest can be acquired. Based on the acquired purchase information, it is possible to present a product in line with the user's interest. In particular, by acquiring and utilizing more purchase information related to multiple users, it is possible to acquire information related to more general user interests rather than some limited user interests. It is possible to perform effective product display according to the situation.

  In addition, the utilization method of the purchase information acquired by the purchase information acquisition unit 26 is not limited to the above. For example, it is possible to analyze the user's purchase speed using the elapsed time after the proximity information acquisition unit 21 detects that the user has approached the vending machine 1. Moreover, it is also possible to perform an analysis related to the relevance of each product using the gaze rank.

  Although the embodiment of the present invention has been described above, the commodity sales apparatus (the vending machine 1) and the image display method according to the present invention can be variously modified.

  For example, in the above embodiment, the configuration has been described in which the line-of-sight information acquisition unit 22 detects the line of sight of the user from the image of the camera 16 and estimates the user's interest based on this to change the display content on the display 11. In addition to this, the user may be identified from the image of the camera 16 by face recognition or the like, and the display content may be changed according to the identified user. As such an example, for the user who often does not match the area to be initially observed and the product to be purchased, the display content corresponding to the area to be initially observed and the image of the product that the user often purchases Can be displayed at the same time. Further, the arrangement order of the products in the initial state may be changed according to the user. For example, in the case of a specific user, the coffee-based products may be arranged in the region A.

  In the vending machine 1 of the above embodiment, the configuration in which the output information storage unit 24 is provided in the own machine has been described. However, the output information storage unit 24 is provided in an external device different from the vending machine 1, and It is good also as a structure which acquires information by performing radio | wireless communication between the apparatuses 1. FIG.

  Further, the configuration of the commodity sales apparatus according to the present invention is not limited to the above embodiment. For example, in the above-described embodiment, the configuration in which the user's line of sight is detected from the image of the camera 16 by the line-of-sight information acquisition unit 22 of the vending machine 1 is described. However, the user's line of sight is detected using a unit different from the camera 16. It is good also as a structure. The configuration of the display 11, the deposit port 12, the outlet 13, the refund port 114, the speaker 15, and the like can be changed as appropriate.

  Further, the neighborhood information acquisition unit 21, the line-of-sight information acquisition unit 22 (line-of-sight information acquisition unit), the output information generation unit 23, the output information storage unit, and the output unit 25 included in the vending machine 1 described in the above embodiment. It is also possible to adopt a configuration in which a part of each process is executed by a device (such as a server on the cloud) separate from the vending machine. That is, the merchandise sales apparatus does not necessarily have to be realized as an integrated apparatus, and may be realized as a system in which a plurality of apparatuses are combined.

  In the vending machine 1 described in the above embodiment, the purchase information acquisition unit 26 has a configuration for acquiring purchase information for each user. However, the purchase information acquisition unit 26 may not be provided. Good. Even when the vending machine 1 does not include a purchase information acquisition unit, the output information is changed based on the user's line-of-sight information, so that the line-of-sight information that is information indicating the user's interest can be handled. Thus, it is possible to display products according to the user's interest.

  DESCRIPTION OF SYMBOLS 1 ... Vending machine, 10 ... Housing | casing, 11 ... Display, 15 ... Speaker, 16 ... Camera, 21 ... Neighboring information acquisition part, 22 ... Gaze information acquisition part, 23 ... Output information generation part, 24 ... Output information storage part 25 ... output unit, 26 ... purchase information acquisition unit.

Claims (8)

A product sales apparatus that performs a face-to-face operation until a user selects and purchases a product,
In an initial state, output means for arranging and displaying images of a plurality of products sold by the product sales apparatus in an image display area;
Line-of-sight information acquisition means for acquiring line-of-sight information relating to the line of sight of the user;
Output information changing means for changing display contents to be displayed in the image display area based on the line-of-sight information;
Product sales device comprising The line-of-sight information acquisition means acquires information that identifies an area of the image display area watched by the user,
The merchandise sales apparatus according to claim 1, wherein the output information changing unit changes the display content based on information relating to an area first watched by the user.   The merchandise sales apparatus according to claim 2, wherein the output information changing means changes the display content displayed in the image display area when the user does not pay attention to any area. In the initial state, the output means displays a plurality of images of the products for each category to which the products belong and displays them in the image display area.
The line-of-sight information acquisition means divides the image display area for each category to which the product displayed in the image display area belongs, and specifies information for identifying which area of the divided areas the user is gazing at. The merchandise sales apparatus according to any one of claims 1 to 3, which is acquired as the line-of-sight information.   The merchandise sales apparatus according to any one of claims 2 to 4, wherein the line-of-sight information acquisition unit determines that the user has gazed when the line-of-sight of the user remains for a predetermined time or more. The line-of-sight information acquisition means includes
Obtaining second line-of-sight information relating to the line of sight of the user with respect to the image display area of the output means after changing the display content;
The merchandise sales apparatus according to any one of claims 1 to 5, wherein the output information changing unit changes the display content displayed in the image display area again based on the second line-of-sight information.   Purchasing information acquisition means for acquiring the purchase result of the product by the user who acquired the line-of-sight information by the line-of-sight information acquisition means in association with the display content displayed in the image display area and the line-of-sight information as purchase information. The merchandise sales apparatus as described in any one of Claims 1-6. An image display method in a merchandise sales apparatus that performs a face-to-face operation until a user selects and purchases a product,
In an initial state, an output step of arranging a plurality of product images sold by the product sales apparatus and displaying them in an image display area;
A line-of-sight information acquisition step of acquiring line-of-sight information related to the line of sight of the user;
Based on the line-of-sight information, an output information change step for changing display content displayed in the image display area;
An image display method comprising:

Images