JP2017146942A - Image display device, display control method and display control program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an image display device, a display control method and a display control program that are capable of providing a suitable menu screen.SOLUTION: An image display device comprises a receiving part, a determining part, and a switching part. The receiving part receives an instruction to switch a first menu screen including images of products displayed in a display part to a second menu screen. The determining part determines display contents of the second menu screen on the basis of a gaze of a user on the first menu screen. The switching part switches the menu screen displayed on the display part from the first menu screen to the second menu screen whose display contents have been determined.SELECTED DRAWING: Figure 1

Description

  The present invention relates to an image display device, a display control method, and a display control program.

  In recent years, there is a technique in which a user selects a product from the displayed list by displaying a list of images related to the product on a display unit, and purchases the selected product. As a method for displaying a product list for a user, there is a method that uses a user's line of sight. For example, the product being watched by the user is detected, and the detected product is displayed in another area in the product list screen.

JP 2012-22589 A

  However, in the above-described method, for example, a product list is displayed on one menu screen based on the user's line of sight, but a suitable menu screen is provided based on the user's line of sight when another menu screen is displayed. It is difficult.

  In one aspect, the present invention provides an image display device, a display control method, and a display control program that can provide a suitable menu screen.

  In one aspect, the image display device includes a reception unit, a determination unit, and a switching unit. The accepting unit accepts an instruction to switch the first menu screen including the image related to the product displayed on the display unit to the second menu screen. The determination unit determines the display content of the second menu screen based on the user's line of sight with respect to the first menu screen. The switching unit switches the menu screen displayed on the display unit from the first menu screen to the second menu screen for which the display content is determined.

  A suitable menu screen can be provided.

FIG. 1 is a block diagram illustrating an example of the configuration of the image display apparatus according to the embodiment. FIG. 2 is a diagram illustrating an example of gaze detection. FIG. 3 is a diagram illustrating an example of the product DB. FIG. 4 is a diagram illustrating an example of the movement of the line of sight with respect to the first menu screen. FIG. 5 is a diagram illustrating an example of the second menu screen. FIG. 6 is a diagram illustrating another example of the second menu screen. FIG. 7 is a diagram illustrating an example of a second menu screen when displaying a line-of-sight product. FIG. 8 is a diagram illustrating an example of a second menu screen when displaying a line-of-sight non-restored product. FIG. 9 is a flowchart illustrating an example of image display processing according to the embodiment. FIG. 10 is a diagram illustrating an example of a computer that executes a display control program.

  Hereinafter, embodiments of an image display device, a display control method, and a display control program disclosed in the present application will be described in detail based on the drawings. The disclosed technology is not limited by the present embodiment. Further, the following embodiments may be appropriately combined within a consistent range.

  FIG. 1 is a block diagram illustrating an example of the configuration of the image display apparatus according to the embodiment. The image display apparatus 100 illustrated in FIG. 1 receives an instruction to switch the first menu screen including an image related to a product displayed on the display unit to the second menu screen. The image display device 100 determines the display content of the second menu screen based on the user's line of sight with respect to the first menu screen. The image display apparatus 100 switches the menu screen to be displayed on the display unit from the first menu screen to the second menu screen for which display content is determined. Thereby, the image display apparatus 100 can provide a suitable menu screen.

  The image display apparatus 100 illustrated in FIG. 1 includes a line-of-sight detection unit 111, a display unit 112, a product database (product DB) 120, a determination unit 130, a switching unit 140, and a reception unit 113. Note that the image display apparatus 100 may include various functional units included in a known computer, for example, functional units such as various communication devices and audio output devices, in addition to the functional units illustrated in FIG. As an example of the image display device 100, a ticket vending machine that sells meal tickets at restaurants can be adopted. The image display device 100 can employ not only the above-described ticket vending machine but also a store-installed terminal such as a ticket vending machine, a vending machine, or a multimedia terminal installed in a convenience store store. The image display device 100 can also employ a terminal that can be connected to a network such as a personal computer, a tablet terminal, or a smartphone in addition to the above-described store-installed type terminal.

  For example, the line-of-sight detection unit 111 detects the user's line of sight based on a captured image obtained by capturing the user. The captured image is, for example, an image obtained by capturing an upper body of a user irradiated with infrared rays from an infrared LED (Light Emitting Diode) with an infrared camera. The line-of-sight detection unit 111 may acquire a captured image from an infrared camera (not shown), or the line-of-sight detection unit 111 may include an infrared LED and an infrared camera (not shown). The captured image may not be an image captured by an infrared camera, and may be an image captured by a visible light camera, for example.

  The line-of-sight detection unit 111 may detect other information that can be used in place of the line of sight as the line of sight. For example, the user's face orientation may be determined based on a captured image obtained by capturing the user, and the front direction of the face may be detected as the line-of-sight direction. Further, the orientation of the user's body may be determined based on a captured image obtained by capturing the user, and the front side front direction of the trunk may be detected as the line-of-sight direction. In addition, the user's face orientation is determined using the three-dimensional position information of the user's face measured using a device capable of measuring the distance to the user's face, that is, depth information, and the front direction of the face May be detected as the line-of-sight direction.

  The line-of-sight detection unit 111 detects, for example, a position where infrared rays are reflected on the cornea of the user (corneal reflection) and a position of the user's pupil from captured images captured at predetermined intervals. The line-of-sight detection unit 111 detects the user's line of sight based on the corneal reflection and the position of the pupil. The line-of-sight detection unit 111 outputs the detected line of sight to the determination unit 130. FIG. 2 is a diagram illustrating an example of gaze detection. As shown in FIG. 2, the line-of-sight detection unit 111 detects the line-of-sight position (X1, Y1) at time t1.

  When the user's line of sight moves from time t1 to time t2, the line-of-sight detection unit 111 moves the line-of-sight position (X2, Y2) away from the line-of-sight position (X1, Y1) at the time t2. Is detected. In this case, the line segment connecting the line-of-sight positions (X1, Y1) and (X2, Y2) is the locus of movement of the user's line of sight. When the user's line of sight does not move between time t2 and time t3 and stops, the line-of-sight detection unit 111 detects the same line-of-sight position (X2, Y2) as time t2 at time t3. Here, for example, when the line of sight is detected at the same position a plurality of times within a predetermined time, or when the line of sight is detected at the same position continuously for a predetermined number of times or more, it is determined that the vehicle is stopped. it can. In this case, the line-of-sight position (X2, Y2) is the line-of-sight stop position. Note that the line-of-sight position detected when the line of sight stops is not necessarily the same line-of-sight position as the previous time, and the distance to the line-of-sight position at the previous time may be a predetermined distance or less. In this case, for example, the center of gravity of the plurality of line-of-sight positions may be set as the stop position. The line-of-sight position is, for example, a position on the XY coordinate plane including the screen displayed on the display unit 112. The line-of-sight detection unit 111 outputs the time and the line-of-sight position in association with each other, for example, to the determination unit 130.

  Returning to the description of FIG. 1, the display unit 112 is a display device for displaying various types of information. The display unit 112 is realized by, for example, a liquid crystal display as a display device. The display unit 112 displays various screens such as the first and second menu screens input from the switching unit 140. Here, the first and second menu screens are menu screens for displaying products provided in the store where the image display device 100 is installed. The first menu screen is a menu screen that is displayed first when the user stands in front of the image display device 100, for example. The second menu screen is a menu screen to be displayed next to the first menu screen.

  The accepting unit 113 is an input device that accepts various operations from the user. The reception unit 113 is realized by a touch panel or the like as an input device, for example. In this case, the display device of the display unit 112 and the input device of the reception unit 113 may be integrated. In addition, the reception unit 113 may be realized by a button, a keyboard, a mouse, or the like as an input device, for example. Further, for example, it may be realized by a gesture recognition device or a voice recognition device. For example, when the first menu screen is displayed on the display unit 112, the receiving unit 113 receives a transition operation to the second menu screen. In addition, for example, when the first menu screen or the second menu screen is displayed on the display unit 112, the reception unit 113 receives a selection operation for a product on the screen. The accepting unit 113 outputs an operation input by the user to the switching unit 140.

  The product DB 120 is a database that manages products provided at a store where the image display device 100 is installed. The product DB 120 stores product features for each product. FIG. 3 is a diagram illustrating an example of the product DB. As illustrated in FIG. 3, the product DB 120 includes items such as “product name” and “price”.

  The product DB 120 stores information indicating product features such as product price, raw material, presence / absence of a discount coupon, and the sale time of the product for each product A, B. In FIG. 3, the product DB 120 stores characteristics for each item of the product such as a product name “product A”, a price “1200 yen”, and raw materials “a, b”. Note that the product features stored in the product DB 120 are not limited to the example illustrated in FIG. 3. For example, the product DB 120 may store information indicating whether the product genre, the product color, or the new product is a feature.

  Returning to the description of FIG. 1, the determination unit 130 and the switching unit 140 are configured such that, for example, a CPU (Central Processing Unit), an MPU (Micro Processing Unit), etc. This is realized by being executed as Further, the determination unit 130 and the switching unit 140 may be realized by an integrated circuit such as an ASIC (Application Specific Integrated Circuit) or an FPGA (Field Programmable Gate Array). The determination unit 130 and the switching unit 140 realize or execute the functions and operations of information processing described below. The internal configurations of the determination unit 130 and the switching unit 140 are not limited to the configuration illustrated in FIG. 1, and may be other configurations as long as the information processing described later is performed.

  The determination unit 130 determines display contents to be displayed on the display unit 112 based on the detection result of the line-of-sight detection unit 111. The determining unit 130 includes a specifying unit 131, an extracting unit 132, and a product determining unit 133.

  When the first menu screen is displayed on the display unit 112 and the user's line-of-sight position is input from the line-of-sight detection unit 111, the specifying unit 131 stops the user's line of sight based on the input line-of-sight position. Identify the product Here, the first menu screen is a screen on which, for example, a list of products sold in the store is displayed, and the user stands in front of the display unit 112 of the image display device 100, whereby the line-of-sight detection unit 111 is displayed. Is a screen displayed on the display unit 112 when the user's line of sight is detected.

  FIG. 4 is a diagram illustrating an example of the movement of the line of sight with respect to the first menu screen. Note that the subsequent first menu screen example and second menu screen example including FIG. 4 show examples in which product images are displayed, but the display target need not be limited to this. For example, the display target may be not only a still image of a product but also an image or video with animation. Note that the number of products and images corresponding to the products is not limited, and may be one or more.

  As illustrated in FIG. 4, the first menu screen 10 includes, for example, a plurality of images 11A to 11F related to a plurality of products A to F. The images 11A to 11F include the features of the corresponding products A to F. The images 11A to 11F include, for example, product names and prices of the products A to F. Note that the images 11A to 11F can include not only the above-described product name and price, but also information related to the product such as images showing the appearance of the product, raw materials, and the size of the product. Further, the first menu screen 10 includes a button 12 that receives a transition to the next menu screen.

  The straight line shown in FIG. 4 shows the locus of the line of sight when the line of sight is moving. A circle indicates a stop position when the line of sight is stopped. The size of the circle indicates the stop time of the line of sight, and the stop time is longer as the diameter of the circle is larger. In FIG. 4, the user moves the line of sight while sequentially stopping the products A to D and F. The user moves the line of sight from the product D to the product F without stopping the line of sight on the product E. Moreover, the stop time of the goods F is the longest.

  For example, the specifying unit 131 specifies the products A to D and F whose line of sight is stopped, and notifies the extraction unit 132 of the specified product F as the line-of-sight stopped product. For example, the specifying unit 131 may set a product whose stopping time is a predetermined time or more as a line-of-sight stopped product. Further, the specifying unit 131 may set a line-of-sight product for which the total length of the line-of-sight stop time measured within a predetermined time is equal to or greater than the predetermined time.

  Further, the specifying unit 131 may specify the product E for which the user has not stopped his / her line of sight as the non-line-of-sight product. In this case, the specifying unit 131 notifies the extracting unit 132 of the specified product E as a non-line-of-sight product.

  The extraction unit 132 extracts the features of the line-of-sight stopped product specified by the specifying unit 131. The extraction unit 132 extracts features based on at least one of the stop position, stop time, and locus of the line of sight with respect to the first menu screen 10. In the example shown in FIG. 4, the line of sight is stopped on the product names and prices of the products A, B, and F, but the line of sight is not stopped on the product names of the products C and D, and the line of sight is on the price. Stopped. Since the line of sight is stopped at the prices of the products A to D and F, it is understood that the user is interested in the price of the products. Therefore, the extraction unit 132 may extract the product genres of the products A, B, and F as features. For example, if the first menu screen displays a product of Japanese cuisine, the products A, B, and F are Japanese food products, and the products C, D, and E are Chinese food products, the extraction unit 132. Can extract the genre of “Japanese food” as a feature. In particular, the products A, B, and F have an interest in the prices of the products A, B, and F because the line of sight is stopped not only in the price but also in the product name. Therefore, the extraction unit 132 can extract the prices “1200 yen” and “1100 yen” of the products A, B, and F as features. The extraction unit 132 outputs the extracted one or more features to the product determination unit 133.

  Features extracted by the extraction unit 132 are not limited to the above features. For example, the extraction unit 132 may extract features from a product having the longest stop time. As illustrated in FIG. 4, when the stop time of the product F is the longest, the extraction unit 132 may extract, for example, a keyword included in the product name as a feature. Further, for example, the extraction unit 132 may extract features common to the products A, B, and F having a plurality of stop positions. Note that the feature extracted by the extraction unit 132 is not limited to one. For example, the extraction unit 132 may extract a plurality of features related to a plurality of items such as price and size.

  Returning to the description of FIG. 1, the product determination unit 133 determines the display product to be displayed on the second menu screen based on the features extracted by the extraction unit 132. For example, the product determination unit 133 inquires of the product DB 120 about a product having the genre “Japanese food” that is the feature extracted by the extraction unit 132. Further, for example, the product DB 120 is inquired of a product having prices “1200 yen” and “1100 yen” that are features extracted by the extraction unit 132. Note that the extraction unit 132 may inquire the product DB 120 for products in a range including the extracted features. In this case, the extraction unit 132 may inquire the product DB 120 for a product having a price of “1200 yen” or less.

  The product determination unit 133 receives information on the product having the feature inquired from the product DB 120. For example, when the product determination unit 133 inquires of the product DB 120 about a product of “1200 yen” or less, the product determination unit 133 receives information on the products G, H, and J to M from the product DB 120. The product determination unit 133 determines the received products G, H, and J to M as display products.

  For example, when the number of products received from the product DB 120 is larger than the number of products that can be displayed on the second menu screen, the product determination unit 133 displays a product that has characteristics closer to the characteristics of the line-of-sight stopped product. You may decide to. In addition, the product determination unit 133 may determine, as a display product, a product that the store wants to sell, such as a seasonally limited product or a product that allows the use of a discount coupon, based on the received information about the product. . Here, it is assumed that the product determination unit 133 determines a product different from the product included in the first menu screen 10 as the display product. In addition, in the first menu screen, if the length of time of the line of sight is almost the same for each product, the predetermined product previously determined as the second menu screen is determined as the display product. Also good.

  Note that the product determined by the product determination unit 133 is not limited to a product different from the product included in the first menu screen 10. For example, the user may want to confirm a product that is interested in the first menu screen 10 also on the second menu screen. Therefore, the product determination unit 133 can also determine the line-of-sight stopped product as a display product. In this case, for example, the product determination unit 133 determines the product F with the longest stop time as the display product as the product that the user is interested in on the first menu screen 10. In addition, for example, a product for which the user's line of sight has never stopped may have been overlooked by the user. Therefore, the product determination unit 133 can also determine the product E specified as a non-line-of-sight product by the specifying unit 131 as a display product as a product that the user may have missed.

  The product determination unit 133 may determine the display product based on information other than the movement of the line of sight. For example, even if the product determination unit 133 does not include the feature extracted by the extraction unit 132, a product that the store wants to sell such as a seasonally limited product or a product that can be used with a discount coupon is used as a display product. You may decide.

  The product determination unit 133 determines a product to be highlighted from among the products determined to be displayed on the second menu screen. Note that the product determination unit 133 determines a predetermined product as a display product regardless of the features extracted by the extraction unit 132 for the product displayed on the second menu screen, and includes the predetermined product among the predetermined products. It may be determined on the basis of the feature extracted by the extraction unit 132 which is highlighted. For example, based on the product information received from the product DB 120, the product determination unit 133 determines a product that the store side wants to sell, such as a seasonally limited product or a product that can be used with a discount coupon, as a highlighted product. In addition, the product determination unit 133 may determine a product that highlights a product that has characteristics closer to those of the line-of-sight product. The product determination unit 133 determines, for example, a product whose characteristics more closely match the characteristics of the line-of-sight stopped product as a product to be highlighted. For example, in the case where potatoes are displayed on the first menu screen and soups are displayed on the second menu screen, the product genre of the product F having the longest eye stop time on the first menu screen is “Japanese food”. ”Highlights“ miso soup ”and“ pork soup ”belonging to“ Japanese food ”among the soup products displayed on the second menu screen, and“ egg soup ”and“ acid soup ”belonging to“ Chinese ” "Can be determined not to be highlighted. The product determination unit 133 outputs information about the displayed product and the highlighted product to the switching unit 140.

  For example, the product determination unit 133 may determine a product to be displayed on the first menu screen 10. For example, when the user stands in front of the display unit 112 and the line-of-sight detection unit 111 starts detecting the line of sight of the user, the product determination unit 133 determines a product to be displayed on the first menu screen 10. In this case, the product determination unit 133 determines a predetermined product to be displayed on the first menu screen 10.

  The switching unit 140 switches the screen displayed on the display unit 112. When the first menu screen 10 shown in FIG. 4 is displayed, when the user touches the button 12 for accepting a transition operation to the next menu screen, the switching unit 140 starts from the first menu screen 10 to the first menu screen 10. Switch to the 2 menu screen. FIG. 5 is a diagram illustrating an example of the second menu screen. As illustrated in FIG. 5, the switching unit 140 displays the second menu screen 20 including images 11G, 11H, and 11J to 11M related to the products G, H, and J to M determined by the product determining unit 133 on the display unit 112. To do. The second menu screen 20 may include a “return” button for accepting a transition to the first menu screen and a button 12 for accepting a transition to the next menu screen. As for the screen transition, the operation instruction may be received by any method as long as an instruction to switch the display from the currently displayed screen to another screen can be received. For example, instead of the button format as shown, a screen to be displayed may be selected by a tab.

  The switching unit 140 may highlight and display the product determined to be highlighted by the product determination unit 133 on the display unit 112. FIG. 6 is a diagram illustrating another example of the second menu screen. The switching unit 140 displays the second menu screen 30 in which images 31 and 32 indicating additional information are superimposed on the images 11G and 11J related to the products G and J determined to be highlighted by the product determination unit 133, thereby displaying the product G , Highlight J. Here, the image 31 is an image indicating the additional information “recommended”, and the image 32 is an image indicating the additional information “deal”, for example, there is an available coupon. Note that the switching unit 140 can also highlight the product by changing the size or color of the image related to the product or by blinking the image.

  When the product determination unit 133 determines the line-of-sight stopped product as the display product, the switching unit 140 may display a second menu screen including an image related to the line-of-sight stopped product on the display unit 112. FIG. 7 is a diagram illustrating an example of a second menu screen when displaying a line-of-sight product. For example, the switching unit 140 displays the image 11 </ b> F related to the product F displayed on the first menu screen 10 on the second menu screen 40. At this time, as illustrated in FIG. 7, the switching unit 140 may highlight the product F so as to promote the purchase of the product F that the user is interested in, for example. For example, the highlighting may be displayed on the display unit 112 by superimposing an image 31 indicating additional information on the image 11F, as in FIG. In addition, the display position of the product F on the second menu screen may be the same position as the display position of the product F on the first menu screen, or may be a different position. Here, the switching unit 140 displays the image 11 </ b> F related to the product F having the longest stop time on the second menu screen 40, but includes a plurality of line-of-sight stop products on the second menu screen 40, for example. May be displayed.

  When the product determination unit 133 determines the non-line-of-sight product as a display product, the switching unit 140 displays a second menu screen including an image related to the non-line-of-sight product on the display unit 112. FIG. 8 is a diagram illustrating an example of a second menu screen when displaying a line-of-sight non-restored product. For example, the switching unit 140 displays an image 11E related to the product E on which the line of sight is not stopped on the first menu screen 10 on the second menu screen 50. At this time, as illustrated in FIG. 8, the switching unit 140 may, for example, highlight the product E so that the user does not overlook the product E.

  In addition, the switching unit 140 switches the screen displayed on the display unit 112 according to various operations received by the receiving unit 113, for example. For example, when the standby screen is displayed on the display unit 112, the switching unit 140 switches from the standby screen to the first menu screen 10 when the visual line detection unit 111 detects the user's visual line.

  Next, the operation of the image display apparatus 100 according to the embodiment will be described. FIG. 9 is a flowchart illustrating an example of image display processing according to the embodiment.

  When the user stands in front of the image display device 100, the line-of-sight detection unit 111 starts detecting the line of sight of the user (step S1). When the gaze detection unit 111 starts gaze detection, the switching unit 140 displays the first menu screen on the display unit 112 (step S2). The line-of-sight detection unit 111 detects the user's line-of-sight position with respect to the first menu screen (step S3). The line-of-sight detection unit 111 outputs the detected line-of-sight position to the determination unit 130.

  Based on the line-of-sight position detected by the line-of-sight detection unit 111, the specifying unit 131 of the determining unit 130 specifies the line-of-sight-stopped product from among the products displayed on the first menu screen (step S4). The switching unit 140 determines whether or not the receiving unit 113 has received a transition operation to the next menu screen while the display unit 112 is displaying the first menu screen (step S5). If the switching operation has not been accepted (No at Step S5), the switching unit 140 waits for acceptance of the operation by the user and returns to Step S3. When the switching unit 140 receives the transition operation (step S5: Yes), the switching unit 140 inquires of the determination unit 130 about the product to be displayed on the second menu screen.

  The extraction unit 132 of the determination unit 130 extracts the feature of the line-of-sight stopped product specified by the specifying unit 131 (step S6). The extraction unit 132 extracts a feature displayed at the stop position of the line of sight among the features included in the line-of-sight stopped product. The extraction unit 132 outputs the extracted features to the product determination unit 133.

  The product determination unit 133 determines a product to be displayed on the second menu screen based on the feature extracted by the extraction unit 132 (step S7). The product determination unit 133 acquires information on a product having the same feature as the feature extracted by the extraction unit 132 from the product DB 120. The product determination unit 133 determines a product to be displayed on the second menu screen based on the acquired information about the product. The product determination unit 133 outputs information regarding the determined product to the switching unit 140. The switching unit 140 displays a second menu screen including an image related to the product determined by the product determination unit 133 on the display unit 112 (step S8). Thereby, the image display apparatus 100 can provide a suitable menu screen.

  Thus, the image display apparatus 100 receives an instruction to switch the first menu screen including the image related to the product displayed on the display unit 112 to the second menu screen. Further, the image display device 100 determines the display content of the second menu screen based on the user's line of sight with respect to the first menu screen. In addition, the image display device 100 switches the menu screen displayed on the display unit 112 from the first menu screen to the second menu screen for which display content is determined. As a result, a suitable menu screen can be provided.

  Moreover, the image display apparatus 100 specifies the product for which the line of sight has stopped. In addition, the image display device 100 extracts the characteristics of the specified product. Further, the image display device 100 determines a product different from the specified product based on the extracted features. Further, the image display device 100 switches to the second menu screen including an image related to the determined product. As a result, a suitable menu screen can be provided.

  Further, the image display device 100 determines a product to be highlighted on the second menu screen. As a result, a more suitable menu screen can be provided.

  Further, the image display device 100 determines the product whose line of sight is stopped as the product to be displayed on the second menu screen. As a result, it is possible to provide a menu screen including products for which the user has shown interest.

  Further, the image display device 100 identifies a product whose line of sight is not stopped. Further, the image display device 100 determines a product whose line of sight is not stopped as a product to be displayed on the second menu screen. As a result, it is possible to provide a menu screen that prevents items from being missed.

  Further, the image display apparatus 100 extracts features based on at least one of the line-of-sight stop position, stop time, and locus. As a result, a menu screen corresponding to the feature can be provided. By providing a suitable menu screen as described above, for example, when the product B related to the product A displayed on the first menu screen is displayed on the second menu screen, the user for the product B It is possible to expect the simultaneous purchase behavior of purchasing the product B together with the product A.

  In the above embodiment, the product to be displayed on the second menu screen is determined based on the user's line of sight with respect to the product image displayed on the first menu screen. However, the present invention is not limited to this. For example, when an advertisement such as a recommended product is posted around the display unit 112, a product to be displayed on the second menu screen may be determined based on the line of sight of the advertisement. That is, the specifying unit 131 may specify a line-of-sight-stopped product in which the line of sight has stopped among a plurality of products displayed in the first menu image or a product placed in an advertisement. Note that the advertisement does not necessarily have to be placed around the display unit 112. It is only necessary that the user's line of sight is easy to face, and the user's line of sight can be detected. That is, the advertisement may be posted around the image display device 100 such as a bag or a poster.

  As described above, the image display device 100 identifies the line-of-sight-restored product from among the products displayed around the first menu screen and the display unit 112. In addition, the image display device 100 extracts features based on the line-of-sight product. Further, the image display device 100 determines a product to be displayed on the second menu screen based on the extracted feature. Further, the image display device 100 displays a second menu screen including an image related to the determined product. As a result, a suitable menu screen can be provided.

  In the above embodiment, the product displayed on the first menu screen is a predetermined product, but is not limited to this. For example, a product may be determined based on a product history purchased in the past, features extracted in the past, or the like.

  As described above, the image display apparatus 100 identifies the user by performing the image recognition process using the camera included in the line-of-sight detection unit 111. Note that the user can be specified by communicating with an application downloaded to a mobile terminal such as a smartphone possessed by the user. Further, the user can be specified by reading a card issued by a store such as a point card, for example.

  Further, for example, the image display apparatus 100 inquires and acquires a past product history of the identified user from a history DB (not shown). Further, the image display device 100 extracts the feature of the product included in the acquired product history. Further, the image display device 100 determines a product to be displayed on the first menu screen based on the extracted features. Further, the image display device 100 displays a first menu screen including an image related to the determined product. As a result, a suitable menu screen can be provided.

  Further, when displaying the product for the specified user, the image display device 100 acquires the feature history used for determining the product, and determines the product to be displayed on the first menu screen based on the acquired feature history. To do. As a result, a suitable menu screen can be provided.

  In the above-described embodiment, the first menu screen is a screen that is displayed first when the user stands in front of the image display device 100, but is not limited thereto. For example, it may be a menu screen displayed in response to a transition operation from the user. In this case, the image display apparatus 100 may determine the display content of the first menu screen based on the user's line of sight with respect to the menu screen displayed before the transition to the first menu screen.

  As described above, the image display apparatus 100 receives an instruction to switch from the predetermined menu screen to the first menu screen. Further, the image display device 100 determines the display content of the first menu screen based on the user's line of sight with respect to the predetermined menu screen. Further, the image display device 100 switches from a predetermined menu screen to the first menu screen for which display content is determined. As a result, a suitable menu screen can be provided.

  Further, the image display device 100 determines the display content of the second menu screen based on the user's line of sight with respect to the predetermined menu screen and the first menu screen. As a result, a suitable menu screen can be provided.

  In the above description, an example is described in which an image about a product is displayed on each of the first menu screen and the second menu screen. However, the content to be displayed need not be limited to the product. For example, a list of documents such as books and articles may be displayed on each menu screen. Moreover, the display of each of the first menu screen and the second menu screen does not have to display different objects as shown in FIGS. One separated document may be displayed. In this case, for example, the basic contract is displayed on the first menu screen, and other contracts related to the clauses or paragraphs in the basic contract in which the line-of-sight stop is detected on the first menu screen are displayed on the second menu screen. It may be displayed. In addition, for example, on the first menu screen, an overview explanation catalog including a plurality of items for a certain product is displayed, and detailed information on the item in which the gaze stop is detected on the first menu screen is displayed on the second menu screen. May be the display target.

  In addition, each component of each part illustrated does not necessarily need to be physically configured as illustrated. In other words, the specific form of distribution / integration of each unit is not limited to that shown in the figure, and all or a part thereof may be functionally or physically distributed / integrated in arbitrary units according to various loads or usage conditions. Can be configured. For example, the specifying unit 131 and the extracting unit 132 may be integrated. In addition, the illustrated processes are not limited to the above-described order, and may be performed at the same time as long as the process contents are not contradictory, or may be performed in a different order.

  Furthermore, various processing functions performed by each device may be executed entirely or arbitrarily on a CPU (or a microcomputer such as an MPU or MCU (Micro Controller Unit)). In addition, various processing functions may be executed in whole or in any part on a program that is analyzed and executed by a CPU (or a microcomputer such as an MPU or MCU) or on hardware based on wired logic. Needless to say, it is good.

  By the way, the various processes described in the above embodiments can be realized by executing a program prepared in advance by a computer. Therefore, in the following, an example of a computer that executes a program having the same function as in the above embodiment will be described. FIG. 10 is a diagram illustrating an example of a computer that executes a display control program.

  As illustrated in FIG. 10, the computer 200 includes a CPU 201 that executes various arithmetic processes, an input device 202 that receives data input, and a monitor 203. The computer 200 also includes a medium reading device 204 that reads a program and the like from a storage medium, an interface device 205 for connecting to various devices, and a communication device 206 for connecting to other information processing devices and the like by wire or wirelessly. Have The computer 200 also includes a RAM 207 that temporarily stores various types of information and a hard disk device 208. Each device 201 to 208 is connected to a bus 209.

  The hard disk device 208 stores a display control program having the same functions as the processing units of the line-of-sight detection unit 111, the determination unit 130, and the switching unit 140 illustrated in FIG. The hard disk device 208 stores a product DB 120 and various data for realizing the display control program. The input device 202 receives input of various information such as operation information from a user of the computer 200, for example. The monitor 203 displays various screens such as an output screen for the user of the computer 200, for example. The medium reader 204 reads various data from the storage medium. The interface device 205 is connected to, for example, a printing device. The communication device 206 is connected to, for example, a network (not shown) and exchanges various information with other information processing devices.

  The CPU 201 reads out each program stored in the hard disk device 208, develops it in the RAM 207, and executes it to perform various processes. In addition, these programs can cause the computer 200 to function as the line-of-sight detection unit 111, the determination unit 130, and the switching unit 140 illustrated in FIG.

  Note that the above display control program is not necessarily stored in the hard disk device 208. For example, the computer 200 may read and execute a program stored in a storage medium readable by the computer 200. The storage medium readable by the computer 200 corresponds to, for example, a portable recording medium such as a CD-ROM, a DVD disk, and a USB memory, a semiconductor memory such as a flash memory, a hard disk drive, and the like. Alternatively, the display control program may be stored in a device connected to a public line, the Internet, a LAN, or the like, and the computer 200 may read and execute the display control program therefrom.

  As described above, the following supplementary notes are further disclosed regarding the embodiment including the present example.

(Additional remark 1) The reception part which receives the instruction | indication which switches the 1st menu screen containing the image regarding goods displayed on the display part to a 2nd menu screen,
A determination unit that determines display contents of the second menu screen based on a user's line of sight with respect to the first menu screen;
A switching unit that switches a menu screen to be displayed on the display unit from the first menu screen to the second menu screen on which the display content is determined;
An image display device comprising:

(Supplementary Note 2)
A specifying unit for specifying a product in which the line of sight has stopped,
An extraction unit for extracting features of the product specified by the specification unit;
A product determining unit that determines a plurality of products different from the product specified by the specifying unit based on the features extracted by the extracting unit;
The switching unit is
Switching to the second menu screen including an image related to the product determined by the product determination unit;
The image display device according to appendix 1, wherein

(Supplementary Note 3) The product determination unit
Determining a product to be highlighted on the second menu screen;
The screen display device according to appendix 2, wherein

(Appendix 4) The product determination unit
The product with the line of sight stopped is determined as a product to be displayed on the second menu screen.
The image display device according to appendix 2 or 3, characterized by the above.

(Supplementary Note 5)
Identify the product where the line of sight is not parked,
The product determination unit
The product for which the line of sight is not stopped is determined as a product to be displayed on the second menu screen.
The image display device according to any one of appendices 2 to 4, characterized in that:

(Appendix 6) The extraction unit
Extracting the feature based on at least one of a stop position, a stop time, and a trajectory of the line of sight;
The image display device according to any one of appendices 2 to 5, characterized in that:

(Appendix 7) Accepting an instruction to switch the first menu screen including the image related to the product displayed on the display unit to the second menu screen;
Based on the user's line of sight with respect to the first menu screen, the display content of the second menu screen is determined,
Switching the menu screen to be displayed on the display unit from the first menu screen to the second menu screen on which the display content is determined;
A display control method, wherein a computer executes processing.

(Supplementary note 8)
Identify the product where the line of sight has stopped,
Extract the characteristics of the identified product,
Based on the extracted features, determine a plurality of products different from the specified product,
The switching process is:
Switch to the second menu screen including an image related to the determined product.
The display control method according to appendix 7, characterized by:

(Supplementary Note 9) The process of determining the product determines a product to be highlighted on the second menu screen.
The display control method according to appendix 8, characterized by:

(Additional remark 10) The process which determines the said goods determines the said goods to which the said line of sight was stopped to the goods displayed on the said 2nd menu screen,
The display control method according to appendix 8 or 9, characterized by the above.

(Additional remark 11) The process to specify specifies the goods in which the line of sight does not stop,
The product determination unit determines the product for which the line of sight is not stopped as a product to be displayed on the second menu screen.
The display control method according to any one of appendices 8 to 10, characterized in that:

(Supplementary note 12) The extracting process extracts the feature based on at least one of a stop position, a stop time, and a locus of the line of sight.
The display control method according to any one of appendices 8 to 11, characterized in that:

(Supplementary Note 13) Accepting an instruction to switch the first menu screen including the image related to the product displayed on the display unit to the second menu screen,
Based on the user's line of sight with respect to the first menu screen, the display content of the second menu screen is determined,
Switching the menu screen to be displayed on the display unit from the first menu screen to the second menu screen on which the display content is determined;
A display control program for causing a computer to execute processing.

(Supplementary note 14)
Identify the product where the line of sight has stopped,
Extract the characteristics of the identified product,
Based on the extracted features, determine a plurality of products different from the specified product,
The switching process is:
Switch to the second menu screen including an image related to the determined product.
The display control program according to appendix 13, characterized by:

(Supplementary Note 15) The process for determining the product determines a product to be highlighted on the second menu screen.
The display control program according to supplementary note 14, characterized by:

(Additional remark 16) The process which determines the said goods determines the said goods in which the said line of sight stopped to the goods displayed on the said 2nd menu screen,
The display control program according to appendix 14 or 15, characterized in that:

(Additional remark 17) The process to specify specifies the said goods in which the said line of sight does not stop,
The product determination unit determines the product for which the line of sight is not stopped as a product to be displayed on the second menu screen.
The display control program according to any one of supplementary notes 14 to 16, characterized in that:

(Supplementary note 18) The extracting process extracts the feature based on at least one of a stop position, a stop time, and a locus of the line of sight.
The display control program according to any one of supplementary notes 14 to 17, characterized in that:

DESCRIPTION OF SYMBOLS 100 Image display apparatus 111 Eye-gaze detection part 112 Display part 113 Reception part 120 Goods database 130 Determination part 131 Identification part 132 Extraction part 133 Goods determination part 140 Switching part

Claims (8)

A reception unit that receives an instruction to switch the first menu screen including the image related to the product displayed on the display unit to the second menu screen;
A determination unit that determines display contents of the second menu screen based on a user's line of sight with respect to the first menu screen;
A switching unit that switches a menu screen to be displayed on the display unit from the first menu screen to the second menu screen on which the display content is determined;
An image display device comprising: The determination unit
A specifying unit for specifying a product in which the line of sight has stopped,
An extraction unit for extracting features of the product specified by the specification unit;
A product determining unit that determines a product different from the product specified by the specifying unit based on the features extracted by the extracting unit;
The switching unit is
Switching to the second menu screen including an image related to the product determined by the product determination unit;
The image display apparatus according to claim 1. The product determination unit determines a product to be highlighted on the second menu screen;
The screen display device according to claim 2. The product determination unit further determines the product for which the line of sight is stopped as a product to be displayed on the second menu screen.
The image display device according to claim 2, wherein the image display device is an image display device. The specifying unit specifies the product for which the line of sight is not stopped,
The product determination unit determines the product for which the line of sight is not stopped as a product to be displayed on the second menu screen.
The image display device according to claim 2, wherein the image display device is an image display device. The extraction unit extracts the feature based on at least one of a stop position, a stop time, and a locus of the line of sight;
The image display device according to claim 2, wherein the image display device is an image display device. Receiving an instruction to switch the first menu screen including the image related to the product displayed on the display unit to the second menu screen;
Based on the user's line of sight with respect to the first menu screen, the display content of the second menu screen is determined,
Switching the menu screen to be displayed on the display unit from the first menu screen to the second menu screen on which the display content is determined;
A display control method, wherein a computer executes processing. Receiving an instruction to switch the first menu screen including the image related to the product displayed on the display unit to the second menu screen;
Based on the user's line of sight with respect to the first menu screen, the display content of the second menu screen is determined,
Switching the menu screen to be displayed on the display unit from the first menu screen to the second menu screen on which the display content is determined;
A display control program for causing a computer to execute processing.