JP2014106750A - Image display device and image display method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an image display device and an image display method, which enable image display with excellent visibility in an appropriate display form corresponding to the content of image information even in the case of displaying plural kinds of pieces of image information.SOLUTION: An image display device stores image information G1 in a state where a display attribute that is an attribute representing an indicator of how to cause a user to recognize is given, the image information G1 to be displayed on a screen of a display device 40, stores a recognition attribute that is an attribute representing a recognition form of an image recognized by the user, which is estimated on the basis of detection of movement of a viewpoint 51 (a line of sight) of the user on the screen of the display device 40 in association with a display form HS of the image displayed on the screen, and includes a display control part 16 for selecting the display form HS of the image information G1 to be displayed on the screen on the basis of correlation between the display attribute and recognition attribute, and controlling display of the image information G1 on the screen of the display device 40 in the selected display form HS.

Description

  The present invention relates to an image display device suitable for image display of a plurality of information and an image display method used for the image display device.

  As the above-described image display device, there is known a device that is mounted on an automobile and displays image information related to various driving assistances and image information related to a vehicle state. Such an image display device prevents collisions with various advanced safety systems mounted on automobiles, for example, devices that assist travel along lanes, devices that detect lane departures, pedestrians, and preceding vehicles. It is often used for information output from devices, front and side monitors, night view for detecting pedestrians and obstacles at night, and so on. The image displayed on the image display device through such an advanced safety system is effective in reducing the driving load on the driver or prompting an appropriate driving operation.

  By the way, since the advanced safety system outputs information that needs to be output each time according to the traveling state of the vehicle, the output information of a plurality of systems often overlaps in time. In addition, it is desirable that a plurality of pieces of information that overlap in time be displayed so that more important information is preferentially transmitted to the driver as well as being limited by the size of the display screen. . As this type of technology, for example, Patent Literature 1 describes a technology for displaying a warning in accordance with a comparison of assumed risk levels.

  The apparatus (system) described in Patent Document 1 is a driving state detection unit that detects a driving state of a vehicle, and a dangerous driving state when the driving state of the vehicle is determined to be dangerous from the detected driving state of the vehicle. Determination means for generating information indicating that the In addition, the information display device includes an information display device, and when a plurality of types of information is generated by the determination unit, a display pattern of a warning display indicating each of the plurality of types of information is determined according to a predetermined condition. Display control means for changing to This predetermined pattern is set so that high priority information is highlighted. For this reason, even if a plurality of types of information to be displayed are generated, information with high priority is highlighted based on the pattern set in this way.

JP 2010-247656 A

  According to the image display device described in Patent Literature 1, information having a high priority is highlighted based on the pattern. However, the display format for highlighting differs depending on the information, and it is not easy to set an appropriate display format for the information in accordance with the priority of each time.

  The present invention has been made in view of such circumstances, and the purpose thereof is to display the image in an appropriate display format according to the content of the image information, even when displaying a plurality of types of image information. Another object of the present invention is to provide an image display apparatus and an image display method capable of performing excellent image display.

Hereinafter, means for solving the above-described problems and the effects thereof will be described.
In order to achieve the above object, the image display apparatus according to claim 1 is an image display apparatus that displays image information on a screen, and is a display attribute that indicates an index of how the user wants to recognize the display attribute. A first storage unit that stores image information to be displayed on the screen in a state in which is given, and an attribute indicating an image recognition mode by the user estimated based on detection of movement of the user's line of sight on the screen And a second storage unit that stores the recognition attribute in association with the display format of the image displayed on the screen, and causes the display attribute to be displayed on the screen based on the relationship between the display attribute and the recognition attribute. The gist is to include a display control unit that selects a display format of image information and controls display of the image information on the screen in the selected display format.

  In order to achieve the above object, an image display method according to claim 10 is an image display method for displaying image information on a screen, which is an attribute indicating an indicator of how the user wants to recognize the image attribute. A first storage step for storing image information to be displayed on the screen in a state in which is given, and an attribute indicating an image recognition mode by the user estimated based on detection of movement of the user's line of sight on the screen A second storage step in which a certain recognition attribute is stored in association with the display format of the image displayed on the screen, and an image to be displayed on the screen based on the relationship between the display attribute and the recognition attribute And a step of selecting a display format of information and controlling the display of the image information on the screen in the selected display format.

  Until now, the image display format has been selected from the viewpoint of what type of display draws the driver's attention. However, when the display screen becomes wider or multiple information is displayed on the screen, the movement of the user's line of sight in the image, for example, what display format the user reacts quickly, There has not been enough studies on whether to look at images. However, the information provided by the advanced safety system includes information that needs to be recognized by the user in a short period of time, or includes information that is preferably received by the user. Studies are being conducted to obtain the expected response to images from users.

  According to such a configuration or method, the detected movement of the user's line of sight is associated with the display format of the image. Usually, the movement of the user's line of sight relates to the user's reaction and interest in the image. For example, there are formats in which the user's line of sight reacts quickly, and there are formats in which the viewing time becomes longer. Therefore, the user's reaction and interest (recognition attribute) are associated with the display format of the image corresponding to the movement state of the user's line of sight. For this reason, image information is appropriately displayed based on the display attribute by associating the display attribute attached to the image information with the display format of the image suitable for the expected user response to the image. . As a result, a display format capable of obtaining an expected user response to the image of the image information is appropriately given.

Such association is particularly effective for a display image on a screen on which a lot of image information is displayed.
The image display device according to claim 2 is the image display device according to claim 1, wherein a viewpoint detection device that detects movement of a user's line of sight on a screen, and a user's line of sight detected by the viewpoint detection device. A recognition attribute estimation unit that estimates the recognition attribute based on movement on the screen, and associates the display format of the image at the movement position on the screen of the detected user's line of sight with the estimated recognition attribute And a display attribute processing unit that stores a recognition attribute estimated by the recognition attribute estimation unit and associated with a corresponding display format in the display format processing unit. Is the gist.

  An image display method according to an eleventh aspect of the invention is the image display method according to the tenth aspect of the invention, which is detected by a step of detecting movement of a user's line of sight on a screen and a step of detecting movement of the user's line of sight. An estimation step of estimating the recognition attribute based on movement of the user's line of sight on the screen, a display format of the image at the movement position on the screen of the detected user's line of sight, and the estimated recognition attribute The second storage step stores the recognition attribute estimated by the estimation step and associated with the corresponding display format in the association step.

  According to such a configuration or method, in order to detect the movement of the user's line of sight, the recognition attribute is determined based on the response to the image of the user who actually views the screen. By associating these recognition attributes with the display attributes of the image information, it is possible to display the image information having the display attributes corresponding to the recognition attributes in a display format suitable for the user who actually views the screen. That is, the image displayed on the screen is displayed in a manner that the user wants to recognize.

  An image display device according to a third aspect is the image display device according to the second aspect, in which the display format associated with the recognition attribute estimated by the recognition attribute estimation unit and the second storage unit are stored. Display format stored in association with the recognition attribute in the second storage unit on the condition that the display format associated with the same recognition attribute is different from the estimated recognition The gist is to further include a learning unit that replaces the display format associated with the attribute.

  According to such a configuration, the association between the recognition attribute already stored and the display format is associated with the recognition attribute estimated based on the movement of the user's line of sight detected by the viewpoint detection device. Will be replaced as appropriate. As a result, even if a change occurs in the tendency of the user's line of sight movement on the screen, the display format also corresponds to the change, and the image is displayed on the screen in a manner that the user wants to recognize. Become.

  The image display device according to claim 4 is the image display device according to any one of claims 1 to 3, wherein the first storage unit stores a plurality of pieces of image information together with respective display attributes. The second storage unit stores a plurality of recognition attributes in association with display formats of the corresponding images, and the display control unit stores each of the display attributes of the plurality of image information. The gist is to select a display format corresponding to the most relevant recognition attribute from among the plurality of recognition attributes.

  According to such a configuration, even when a plurality of pieces of image information are displayed at the same time, an appropriate display format can be selected for each piece of image information based on the display attribute. As a result, a plurality of pieces of image information can be displayed in an appropriate display format.

  The image display device according to claim 5 is the image display device according to any one of claims 1 to 4, wherein the second storage unit stores a plurality of different images for one recognition attribute. Display formats are associated, and the display control unit selects different display formats for each display attribute when it is determined that a plurality of display attributes are related to the same recognition attribute at the same time The gist is to do.

  According to such a configuration, when the same recognition information corresponds to a plurality of pieces of image information displayed at the same time, each of the pieces of image information has a plurality of display formats associated with recognition attributes. Different display formats can be selected. Thereby, even if image information having the same display attribute is displayed at the same time, the display format of the image information can be changed to facilitate identification.

  The image display device according to claim 6 is the image display device according to claim 5, wherein one recognition attribute stored in the second storage unit has different display formats of a plurality of different images. Priority is set, and the display control unit determines priority based on the display attribute of the image when it is determined that a plurality of display attributes are related to the same recognition attribute at the same time. The gist is to select the display format of the image in the order of the priority in the order of the degree.

  According to such a configuration, a display format of an image with high priority is selected according to the high priority obtained from the display attribute of the image. As a result, image information having a display attribute with a high priority is displayed in an image format with a high priority, and the display content is expected to be accurately transmitted to the user.

  The image display device according to claim 7 is the image display device according to any one of claims 1 to 6, wherein the display attribute includes a display format to be excluded, and the display control unit The gist is to preferentially select a display format that does not include the excluded display format as the display format corresponding to the attribute.

  According to such a configuration, the image information is displayed excluding the excluded display format because it is not preferable as the display of the image information. As a result, the display of the image information is more appropriately performed.

  The image display device according to claim 8 is the image display device according to any one of claims 1 to 7, wherein the display attributes include “emergency”, “safety”, and “significance”. The gist is that at least two of the attributes are included.

  According to such a configuration, an attribute that is not directly related to the display format can be set as the display attribute. However, “Urgent”, “Safety”, “Severity”, etc. included in the display attribute are related to the mode that the user wants to recognize, that is, the recognition attribute, so it is related to the display format via the recognition attribute. Can do. Thereby, the freedom degree of the item which can be included in a display attribute is raised.

  The image display device according to claim 9 is the image display device according to any one of claims 1 to 8, wherein a priority is set in the display attribute, and the display control unit The gist is to preferentially select the display format from image information having a display attribute having a high priority.

  According to such a configuration, since the display format is preferentially selected from the display information with a high priority of the display attribute, an appropriate display format is applied with the display information with a high priority. . Thereby, the possibility of transmission of display information with high priority to the user is improved.

1 is a block diagram showing a schematic configuration of a system according to a first embodiment that embodies an image display apparatus. The table shown about the example of the attribute which shows the parameter | index how the user attached to the image information in the embodiment wants to recognize. The table which shows the example of the relationship with the recognition attribute estimated from the movement of the user's eyes | visual_axis on the screen in the embodiment. The table which shows the example of the relationship between the request | requirement contained in the display attribute of the image information in the embodiment, and the display format selected. The table which shows the example of the display position corresponding to a display format in the embodiment. The top view which shows the relationship between the display position shown in FIG. 5, and the position in a screen in the embodiment. The schematic diagram which shows an example of the aspect which a user's eyes | visual_axis moves on a screen in the embodiment. The schematic diagram which shows the other example of the aspect which a user's eyes | visual_axis moves on a screen in the embodiment. The table which compares and shows the example of the learning result based on the movement mode on the screen of a user's eyes | visual_axis in the same embodiment. In the same embodiment, the table which shows the relationship between the learning database provided for every user, and a user. The table which shows the example of the display format selected with respect to several image information about 2nd Embodiment which actualized the image display apparatus. The table which shows the example of the parameter contained in a display format about other embodiments which materialized the image display device. The table which shows the attribute given to information, the display format linked | related with the attribute, and an example about other embodiment which actualized the image display apparatus. The table which shows the example of the exclusion matter contained in image information about other embodiments which materialized the image display device. The table which shows the example by which a priority is set to the request | requirement contained in image information about other embodiment which actualized the image display apparatus. The table which shows the example of the display format set according to the priority about other embodiment which actualized the image display apparatus. The table which shows the example in which the screen of a display place is included in a display format about further another embodiment which actualized the image display apparatus.

(First embodiment)
1st Embodiment which actualized the vehicle carrying an image display apparatus is described with reference to FIGS. First, a schematic configuration of the image display apparatus will be described with reference to FIG.

  As shown in FIG. 1, the image display device of this embodiment is mounted on a vehicle 10. The vehicle 10 is equipped with a first vehicle control device 11 and a second vehicle control device 12 that perform various controls relating to driving of the vehicle 10, and a first driving support device 13 that provides various driving assistance to the vehicle 10. The second driving support device 14 is mounted. In addition, the vehicle 10 includes an information arbitration unit 15 that is communicably connected to the first and second vehicle control devices 11 and 12, and the first and second driving support devices 13 and 14, and an information arbitration unit 15. And a display control unit 16 connected to be communicable with each other. The vehicle 10 further includes an information output device 17 that is communicably connected to the display control unit 16 and a viewpoint detection device 18 that is communicably connected to the display control unit 16. In the present embodiment, the image display device includes an information arbitration unit 15, a display control unit 16, an information output device 17, and a viewpoint detection device 18.

  The information output device 17 is a device that outputs images and sounds that can be recognized by the user. The information output device 17 receives the image information G1 from the display control unit 16 and displays an image based on the input image information G1 in a manner that the user can recognize. The information output device 17 includes a display device 40 and an audio device 41. The display device 40 includes, for example, a screen such as a head-up display, a navigation system monitor, and a meter panel. Moreover, the audio | voice apparatus 41 is comprised from the speaker and the buzzer. Note that the image can include at least one of a still image and a moving image. In addition, the voice can include at least one of a simple sound such as an alarm sound and a guidance voice.

  In the present embodiment, the image information G1 input from the display control unit 16 has a display format HS that specifies the display format of the image information G1. That is, the information output device 17 displays the image information G1 on the screen of the display device 40 in the display format HS attached to the image information G1.

  The viewpoint detection device 18 is a device that performs so-called eye tracking that detects movement of the user's line of sight on the screen. The viewpoint detection device 18 is installed near the screen of the display device 40 at a position where the user's eyes 50 can be recognized. The viewpoint detection device 18 tracks the movement of the eyes 50 of the user who is viewing the screen of the display device 40, thereby detecting the portion of the screen where the viewpoint 51 has moved and staying in the shifted portion. The time is detected (step of detecting movement of the user's line of sight). Then, the viewpoint detection device 18 outputs the portion (position) on the screen of the user's viewpoint 51 and the time spent in the portion to the display control unit 16.

  The first and second vehicle control devices 11 and 12 are devices that execute control on one or more of braking, acceleration, steering, and the like of the vehicle 10. The 1st and 2nd vehicle control apparatuses 11 and 12 control a vehicle based on the information regarding the vehicle obtained from the various sensors which are not shown in figure. The first and second vehicle control devices 11 and 12 include an information output unit 20 that is an output device to the outside, and various information (J1 and J2) relating to control is sent to the information arbitration unit 15 via the information output unit 20. Output.

  The first and second vehicle control devices 11 and 12 are, for example, various control devices such as a brake control device that controls a brake actuator of the vehicle 10, an engine control device that controls the engine, a steering control device that controls the steering actuator, and the like. It is constituted by. The first and second vehicle control devices 11 and 12 generate, as image information J1 and J2, information related to various control contents, information related to various data used for control, information related to warnings generated during control, and the like. For example, if it is a brake control device, it outputs information such as the type of brake used and its operating state, and if it is an engine control device, it outputs information such as engine speed and temperature, coolant temperature, If it is a steering control device, it outputs a steering angle and the like.

  The first and second driving assistance devices 13 and 14 are devices that provide various driving assistances to the vehicle 10. The first and second driving support devices 13 and 14 provide driving support based on information on vehicles obtained from various sensors (not shown), information on the surrounding environment of the vehicles, and the like. The first and second driving support devices 13 and 14 are provided with an information output unit 20 that is an output device to the outside, and information (J3 and J4) related to the content of driving support is sent via the information output unit 20 to the information arbitration unit 15. Output to.

  The 1st and 2nd driving assistance devices 13 and 14 are constituted by various support devices, such as a support device which performs follow-up driving support, a support device which performs collision avoidance support, for example. In addition, various advanced safety systems are mentioned as such support devices. The contents of assistance include assistance to assist driving along the lane (lane keeping assistance), assistance to follow the preceding vehicle while maintaining the distance between the vehicles (active cruise control), and collision with objects such as the preceding vehicle and pedestrians. Assistance to avoid this. Furthermore, examples of the support content include support for detecting a deviation from the lane, support for displaying the front and sides that are difficult to see, and support for detecting pedestrians and obstacles at night (night view).

  The first and second driving support devices 13 and 14 generate various information related to driving support as image information J3 and J4. For example, Lane Keep Assist outputs information related to the travel position in the lane, Active Cruise Control outputs information related to travel speed and distance from the preceding vehicle, and Collision Avoidance Support provides collision with the support target part. Outputs information on time, distance, positional relationship, and driving operations for collision avoidance. In addition, for example, the lane departure support outputs information on alerts and warnings for departure from the lane, the monitor display support displays information on the monitor image, and the night view outputs information on the position of the obstacle. . Since such information is output each time according to the traveling state of the vehicle, a plurality of driving support output information often overlaps in time.

The information output unit 20 is provided in each of the first and second vehicle control devices 11 and 12 and the first and second driving support devices 13 and 14.
The information output unit 20 converts various image information output by the apparatus into information in a format that can be transmitted to the information mediation unit 15 and outputs the information. The information output unit 20 includes a requestability adding unit 21 that adds display attributes, which are attributes indicating the display format of the image information, to various image information output by the apparatus.

  The requestability assigning unit 21 displays various display information J1 (J2, J3, or J4) output from the information output unit 20 as a display attribute as an attribute indicating an index of how the image information is to be recognized by the user. Give.

  As shown in the table 22 of FIG. 2, the display attributes include “first to see” (first request) and “long viewing time” as an index indicating how the user wants to be recognized. (Second request), “don't miss” (third request). The presence or absence of the request is set for each of the first to third requests. The request included in the display attribute is not limited to the first to third requests.

  That is, the requestability assigning unit 21 displays the presence / absence of “first request”, presence / absence of “second request”, and “third request” as display attributes in each image information J1 (J2, J3, or J4). The presence or absence of each is given. In addition, only the required request | requirement may be set for each image information J1-J4 among the 1st-3rd request | requirements. Then, the image information J1 (J2, J3, or J4) to which the display attribute is attached by the requestability assigning unit 21 is output from the information output unit 20 to the information arbitration unit 15.

  The first and second vehicle control devices 11 and 12 and the first and second driving support devices 13 and 14 are an arithmetic device (CPU) and a nonvolatile or volatile storage device such as ROM or RAM, respectively. And a microcomputer having the above. The nonvolatile storage device of the microcomputer holds a control program for performing various processes and various parameters used for the various processes. The arithmetic device executes a control program held in the storage device as necessary, and refers to various parameters as necessary during execution of the control program.

  That is, the first and second vehicle control devices 11 and 12 include a vehicle control program for performing vehicle control and a program for adding display attributes to the image information. Various parameters used for the execution processing of the program for adding display attributes to the image information are included. The first and second driving support devices 13 and 14 include a driving support program for driving the vehicle and a program for adding display attributes to the image information. Various parameters used for the execution processing of the program or the program for assigning the display attribute to the image information are included. Therefore, the function of the information output unit 20 and the function of the requestability adding unit 21 are exhibited by executing a program for adding display attributes to image information.

[Configuration for selecting the display format]
Next, a configuration and operation for selecting a display format suitable for image information will be described.
Each of the information arbitration unit 15 and the display control unit 16 includes a microcomputer having an arithmetic device (CPU) and a nonvolatile or volatile storage device such as a ROM or a RAM. The nonvolatile storage device of the microcomputer holds a control program for performing various processes and various parameters used for the various processes. The arithmetic device executes a control program held in the storage device as necessary, and refers to various parameters as necessary during execution of the control program. Next, details and functions of the control program and various parameters necessary for processing of the control program in the information arbitration unit 15 and the display control unit 16 will be described in detail.

  The information arbitration unit 15 adjusts the number of input one or more pieces of image information J1 to J4 to a number that can be displayed on the information output device 17. The information arbitration unit 15 receives one or more pieces of image information J1 to J4 from the first and second vehicle control devices 11 and 12 and the first and second driving support devices 13 and 14. Then, the information output device 17 outputs the image information G1 in which the number of one or more pieces of image information J1 to J4 is adjusted to a displayable number to the display control unit 16. For example, when the number that can be displayed on the information output device 17 is “2”, the information arbitration unit 15 adjusts the maximum number of image information G1 to be output to the display control unit 16 to “2”. That is, when two or less pieces of image information (J1 or the like) are input at the same time, the information arbitration unit 15 outputs the input image information (J1 or the like) as it is to the display control unit 16 as the image information G1. On the other hand, when three or more pieces of image information (J1 or the like) are input at the same time, the information arbitration unit 15 outputs the two pieces of image information G1 and G2 selected based on the importance to the display control unit 16. . The information arbitration unit 15 obtains the priority based on the type of the device that output the image information (J1 etc.), the display attribute included in the image information (J1 etc.), and the obtained higher priority 2 Are extracted as image information G1 and G2. Note that the priority based on the type of the device that output the image information (J1 or the like) and the priority of the display attribute are set in the storage device of the information arbitration unit 15. Hereinafter, for convenience of explanation, one image information G1 will be described as an example, but a plurality of pieces of image information may be used.

  The display control unit 16 determines the display format HS of the image information G1. The display control unit 16 receives the image information G1 from the information arbitration unit 15. The input image information G1 is stored in the storage device (first storage unit) of the display control unit 16 in order to perform predetermined processing in the display control unit 16 (first storage step). The display control unit 16 selects a display format HS appropriate for the input image information G1. The display control unit 16 outputs the selected display format HS to the information output device 17 together with the image information G1.

  The display control unit 16 includes a display format selection unit 30 as a display format processing unit that selects an appropriate display format HS for the image information G1, and a display format list 31 in which the display format HS corresponding to the image information G1 is registered. I have.

The display format list 31 is set and held in the recording device (second storage unit) of the display control unit 16 (second storage step).
As shown in FIG. 3, in the display format list 31, the user's screen estimated based on the result of detecting the movement of the user's line of sight on the screen and the detected movement of the user's line of sight on the screen is displayed. Registered is a table 310 associated with a recognition attribute as an attribute indicating the recognition state. In the table 310, as the three movement states classified from the movement state of the user's line of sight on the screen, “position / display where the viewpoint moved first in the screen is first seen” (first movement state), “ The position / display where the line of sight stays on the screen (second movement state) and the “position / display where the line of sight always passes” (third line of sight state) are mentioned. In the present embodiment, the recognition attribute estimated from the “first movement state” is “view first” (first recognition), and the recognition attribute estimated from the “second movement state” is “viewing”. The time attribute is “long” (second recognition), and the recognition attribute estimated from the “third movement state” is “not missed” (third recognition). In other words, in the table 310, “first movement state” and “first recognition” are associated, “second movement state” and “second recognition” are associated, and “third movement state” ”And“ third recognition ”are associated with each other. The relationship between the movement state set in the table 310 and the assigned attribution is appropriate depending on the type of other images displayed on the display device 40, sound and voice, the traveling environment of the vehicle 10, and the like. The relationship may be changed.

  The display format selection unit 30 obtains a display attribute added to the input image information G1. That is, the display format selection unit 30 determines from the display attributes whether or not “first look” (first request), “long viewing time” (second request), “do not miss” (third request). ) Is obtained. The display format selection unit 30 compares the acquired first to third requests with the recognition attributes (first to third recognitions) registered in the table 310 and relates to the display attributes. Associate a high recognition attribute.

  For example, when the display attribute includes “view first” (first request), the display format selection unit 30 associates “first recognition” in the table 310 as a highly relevant recognition attribute. In addition, when the display attribute includes “long viewing time” (second request), the display format selection unit 30 associates “second recognition” in the table 310 as a highly relevant recognition attribute. Further, the display format selection unit 30 associates “third recognition” in the table 310 as a highly relevant recognition attribute when “not miss” (third request) is included in the display attribute. In the present embodiment, one recognition attribute is associated with one display attribute with a high priority. Also, the first request, the second request, and the third request are in descending order of priority.

Then, the display format selection unit 30 selects the display format HS corresponding to the recognition attribute associated with the display attribute of the image information G1 as the display format of the image information G1.
As shown in the table 301 of FIG. 4, the display format selection unit 30 associates “first format” (HS1) as the display format HS with the image information G1 having “first request”. “Second request” (HS2) is associated as the display format HS with the image information G1 having “request”. Further, the display format selection unit 30 associates “third format” (HS3) as the display format with the image information G1 having “third request”.

  More specifically, the first to third formats HS1 to HS3 shown in the table 301 are determined based on the table 310. That is, referring to the table 310 via the recognition attribute related to the display attribute, the first to third movement states corresponding to the first to third requests for the display attribute are determined. For example, “first movement state” corresponds to “first request”, “second movement state” corresponds to “second request”, and “first request” corresponds to “first request”. "3 movement state" corresponds. Then, based on the “first movement state”, the “first format” (HS1) is determined as “display on the position / display where the viewpoint moved into the screen is first seen”. Further, based on the “second movement state”, the “second format” (HS2) is determined as “display on the position / display where the line of sight stays in the screen”. Furthermore, based on the “third movement state”, the “third format” (HS3) is determined as “display on the position and display through which the line of sight always passes”.

  As shown in the table 311 in FIG. 5, the display positions on the display device 40 are included in the first to third formats HS1 to HS3. For example, “screen center” is set as the display position in the first format HS1, “screen right” is set as the display position in the second format HS2, and the display position is set in the third format HS3. Is set as “bottom right of screen”. That is, the image information G1 is displayed on the display device 40 of the information output device 17 at a position set in the selected first to third formats HS1 to HS3. The display format HS may include parameters other than the display position, for example, size, color, shape, etc. In this embodiment, only the display position is described for convenience of explanation, and other parameters are described. I will omit the explanation.

  Then, the image information G1 and the display format HS selected for the image information G1 are output from the display format selection unit 30 to the information output device 17, and the information output device 17 selects the input image information G1 as the image information G1. Is displayed in the displayed display format HS.

  As shown in FIG. 6, for example, the information output device 17 displays the image information G1 in which the first format HS1 is selected in the area 401 in the center of the screen of the display device 40, and the second format HS2 is selected. The image information G1 is displayed in the area 402 on the right side of the screen of the display device 40, and the image information G1 in which the third format HS3 is selected is displayed in the area 403 on the lower right side of the screen of the display device 40.

  As a result, the image display apparatus according to the present embodiment displays each image information G1 selected from the image information J1 to J4 output by each apparatus in a display format HS suitable for the display attribute of the image information G1. To display.

[Configuration to learn eye movement]
Next, a configuration and operation for learning the movement of the user's line of sight on the screen will be described.
As shown in FIG. 1, the display control unit 16 learns the movement of the user's line of sight on the screen. The display control unit 16 includes a list management unit 32 that manages registration contents of the display format list 31 and a viewpoint learning unit 33 as a recognition attribute estimation unit that learns the movement of the user's line of sight on the screen. Learning starts when the user's viewpoint 51 enters the display device 40.

  Note that the learning may be started from the time when the display in the display device 40 is switched. The information to be learned may include sounds, geographical information, traffic conditions, the number of passengers, driving operations, operations other than driving operations, and the like. The geographical information may include an expressway, a toll booth, a convenience store, and the like, and the traffic situation may include traffic jam information and accident information. The driving operation may include a brake operation delay time, and the operations other than the driving operation may include an air conditioner operation, an audio operation, a direction indicator operation, and the like. Thereby, when such information influences the relationship between the display format and the recognition attribute, the influence can be learned.

  The viewpoint learning unit 33 acquires the position on the screen of the viewpoint 51 of the user viewing the display device 40 and the time during which the viewpoint 51 has stayed at the position from the viewpoint detection device 18, and at that time, the display device 40. The display format HS of the image information G1 displayed on the screen is acquired. Then, the viewpoint learning unit 33 extracts the display format HS corresponding to the position of the viewpoint 51 from the display format HS of the displayed image information G1. Further, the viewpoint learning unit 33 associates the extracted display format HS with the movement of the user's line of sight on the screen. As shown in the table 310 of FIG. 3, when the movement state of the user's line of sight on the screen is classified into three, recognition attributes are estimated from the classified movement states (estimation process). Further, as described above, since the recognition attribute and the display attribute are related, as shown in the table 301 of FIG. 4, the display format HS can be associated with the estimated recognition attribute (association step). .

  The viewpoint learning unit 33 accumulates information in which the recognition attribute is associated with the display format HS, and based on the accumulated information, the display format HS suitable for the recognition attribute that is an attribute indicating an image recognition mode by the user. To learn.

  In the present embodiment, the viewpoint learning unit 33 sets the movement state of the user's line of sight on the screen as “the position / display where the viewpoint that has moved into the screen is first viewed” (first movement state) and “ Are classified into “position / display where the line of sight stays” (second movement state) and “position / display where the line of sight always passes in the screen” (third movement state).

  In FIG. 7, for example, the path of the viewpoint 51 that has been detected by the viewpoint detection apparatus 18 and moved on the screen of the display apparatus 40 is indicated by the line of sight L1. The line of sight L1 is the “starting point” P10 when the viewpoint 51 moved from the outside of the screen to the inside of the screen is first viewed, and the position where it stays for a predetermined time is “staying” P11. “Must see” P12, and the position where the viewpoint 51 goes out of the screen from the screen is “end point” P13. Based on the detected line of sight L1, the viewpoint learning unit 33 classifies the “starting point” P10 into the “first moving state”, classifies the “staying” P11 into the “second moving state”, and “must see” P12 is classified into the “third movement state”. That is, “start point” P10 is associated with “first recognition”, “stay” P11 is associated with “second recognition”, and “must see” P12 is associated with “third recognition”. The viewpoint learning unit 33 accumulates such association information.

  In FIG. 8, for example, the path of the viewpoint 51 that is detected by the viewpoint detection apparatus 18 and moves on the screen of the display apparatus 40 is indicated by the line of sight L2. The line of sight L2 is the “starting point” P20 when the viewpoint 51 moved from the outside of the screen into the screen is first viewed, the position that is always viewed with the plurality of lines of sight L2 is “must see” P21, “Staying” P22, and the position where the viewpoint 51 goes out of the screen from the screen is “end point” P23. Based on the detected line of sight L2, the viewpoint learning unit 33 classifies the “starting point” P20 into the “first movement state”, classifies the “staying” P22 into the “second movement state”, and “must see” P21 is classified as “third movement state”. That is, “start point” P20 is associated with “first recognition”, “stay” P22 is associated with “second recognition”, and “must see” P21 is associated with “third recognition”. Further, the viewpoint learning unit 33 accumulates such association information.

  That is, the viewpoint learning unit 33 learns the display format HS suitable for the recognition attribute based on the association information accumulated in this way. For learning, a known method can be applied. For example, a learning method having a high ratio or a high frequency may be used as a learning result based on accumulated information. Further, the accumulation period of the association information used for learning may be the entire period or a partial period. If the accumulation period is lengthened, the learning result can be stabilized, and if the accumulation period is limited recently, it is possible to quickly cope with a change in the movement tendency of the user's line of sight.

  FIG. 9 shows a table 331 that compares examples of display positions corresponding to the first to third recognitions before and after learning by the viewpoint learning unit 33. Before learning, the display position corresponding to “first recognition” is “center of screen”, the display position corresponding to “second recognition” is “right of screen”, and corresponds to “third recognition”. The display position is “bottom right of screen”. On the other hand, after learning, the display position corresponding to “first recognition” is “upper center of the screen”, the display position corresponding to “second recognition” is “lower right of the screen”, and “third The display position corresponding to “recognition” is “upper left of the screen”. The learning result obtained in this way is held in a learning database managed by the viewpoint learning unit 33. This learning database can be provided in the storage device of the display control unit 16.

  The list management unit 32 reflects the learning result held in the learning database of the viewpoint learning unit 33 in the table 310 of the display format list 31. That is, the list management unit 32 changes the movement state of the user's line of sight on the screen corresponding to the estimated recognition attribute in the table 310 to a position or display for viewing the image obtained from the learning result. Thereby, the display format HS selected for the image information G1 can be changed to the display format HS suitable for the line of sight of the user's line of sight on the screen.

  Note that the list management unit 32 reflects the learning result on the table 310 in accordance with the establishment of a predetermined condition. This is to reduce the influence of the change in the display format on the user, particularly the driver. For example, the predetermined condition may be one or more when the vehicle 10 is stopped, when the difference between the contents of the table 310 and the learning result becomes a certain level or when the user permits. It is done.

[Configuration to learn for each user]
Next, a configuration and operation for learning the movement state of the user's line of sight on the screen for each user will be described.

  The display control unit 16 learns the movement of the user's line of sight on the screen for each of the plurality of users. The display control unit 16 includes a user specifying unit 34 that specifies the user of the vehicle 10, selects the learning database of the specified user, and reflects the learning result of the selected learning database in the display format list 31.

The user specifying unit 34 specifies a user who is a driver of the vehicle 10 through a known method such as an electronic key used for the vehicle 10 or a setting by a user using a setting device.
As illustrated in FIG. 10, the user specifying unit 34 manages a learning database for each user. Note that the learning database for each user may be a separate database or a partial area of one database. The learning database for each user can be provided in the storage device of the display control unit 16.

  Then, the user specifying unit 34 reflects the contents of the specified user learning database in the learning database of the viewpoint learning unit 33 so that the learning of the movement of the selected user's line of sight on the screen is further performed. To do. In addition, when the vehicle is parked or the driver is changed every predetermined time, the learning state of the user is reflected by reflecting the contents of the learning database of the viewpoint learning unit 33 in the corresponding user learning database. Is maintained.

  Further, the user specifying unit 34 reflects the learning result of the specified user's learning database in the table 310 of the display format list 31. Thereby, the display format selection part 30 can select the display format HS suitable for a user for the image information G1 using the table 310 corresponding to a user. Then, the image information G1 is displayed on the display device 40 in the display format HS that conforms to the user's recognition attribute, so that it is expected that the image information G1 is appropriately recognized by the user.

As described above, according to the image display apparatus according to the present embodiment, the effects listed below can be obtained.
(1) Until now, the display format of the image has been selected from the viewpoint of what display format draws the driver's attention. However, when the display screen becomes wider or multiple information is displayed on the screen, the movement of the user's line of sight in the image, for example, what display format the user reacts quickly, There has not been enough studies on whether to look at images. However, the information provided by the advanced safety system includes information that needs to be recognized by the user in a short period of time, or includes information that is preferably received by the user. Studies are being conducted to obtain the expected response to images from users.

  According to such a configuration, the detected movement of the viewpoint 51 (line of sight) of the user is associated with the image display format HS. Normally, the movement of the user's viewpoint 51 (line of sight) is related to the user's reaction and interest in the image. For example, the display format HS includes a format in which the user's line of sight reacts quickly and a format in which the viewing time is increased. Therefore, the user's reaction and interest (recognition attribute) are associated with the image display format HS corresponding to the movement state of the user's viewpoint 51 (line of sight). For this reason, the image information G1 is appropriately displayed based on the display attribute by associating the display attribute attached to the image information G1 with the display format HS of the image suitable for the expected user response to the image. It becomes like this. Thereby, the display format from which the expected user reaction is obtained for the image of the image information G1 is appropriately given.

Such association is particularly effective for a display image on a screen on which a lot of image information G1 is displayed.
(2) According to such a configuration, since the viewpoint detection device 18 detects the movement of the user's line of sight, the recognition attribute is determined based on the reaction to the image of the user who actually views the screen. By associating such a recognition attribute with the display attribute of the image information G1, image information having a display attribute corresponding to the recognition attribute can be displayed in a display format HS suitable for a user who actually views the screen. That is, the image displayed on the screen is displayed in a manner that the user wants to recognize.

  (3) According to such a configuration, the recognition attribute and display in which the association between the recognition attribute already stored and the display format HS is estimated based on the movement of the line of sight of the user detected by the viewpoint detection device 18 is displayed. It is appropriately replaced, that is, corrected by the association with the format HS. As a result, even if a change occurs in the tendency of the user's line of sight movement on the screen, the display format also corresponds to the change, and the image is displayed on the screen in a manner that the user wants to recognize. Become.

(Second Embodiment)
Next, the image display apparatus according to the present embodiment will be described with reference to FIG.
The present embodiment is the same as the configuration of the first embodiment except that the configuration for selecting the display format for two pieces of image information input at the same time is different from the configuration of the first embodiment. Therefore, the following description will focus on the differences, and for convenience of description, detailed description of the same configuration will be omitted.

  In the display format list 31, a table 312 used when the display format HS is selected for the two pieces of image information G1 and G2 is set. In the present embodiment, it is assumed that the importance of the second image information G2 is lower than the importance of the first image information G1.

  The table 312 is selected according to the relationship between the request that is set as required in the display attribute of the first image information G1 and the request that is set as required in the display attribute of the second image information G2. The display format HS to be set is set. For example, when the “first request” is “present” in the first image information G1 and the second image information G2, “first format” is selected as the first image information G1, and the second “Second format” is selected as the image information G2. Here, when the “first format” cannot be selected, the “second format” is selected. When the “first request” is “present” in the first image information G1 and the request is “not present” in the second image information G2, “first format” is selected for the first image information G1, “Standard” is selected as the second image information G2. Note that the display format HS set in the table 312 may be changed according to the type of other images displayed on the display device 40, sound or sound, the traveling environment of the vehicle 10, or the like.

  In addition, when the “second request” is “present” in the first image information G1 and the “first request” is “present” in the second image information G2, the second image information G1 includes “second”. Is selected, and “first format” is selected for the second image information G2. When the “second request” is “present” in the first image information G1 and the request is “not present” in the second image information G2, “second format” is selected as the first image information G1, “Standard” is selected as the second image information G2.

  Further, when the “third request” is “present” in the first image information G1 and the “first request” is “present” in the second image information G2, the “third request” is included in the first image information G1. Is selected, and “first format” is selected for the second image information G2. When the “third request” is “present” in the first image information G1 and the request is “not present” in the second image information G2, “third format” is selected as the first image information G1, “Standard” is selected as the second image information G2.

Therefore, an operation in which the display control unit 16 selects the display format HS for each of the two pieces of image information G1 and G2 based on the table 312 will be described.
When the two pieces of first and second image information G1 and G2 are input, the display control unit 16 acquires the presence or absence of the first to third requests from the display attributes of the image information G1 and G2, and acquires The requested combinations are collated with the table 312 to obtain the display format HS specified for the corresponding combination. For example, when the “second request” is “present” in the first image information G1 and the “first request” is “present” in the second image information G2, the first specified in the combination is used. The “second format” is acquired for the image information G1, and the “first format” is acquired for the second image information G2. In other words, the display control unit 16 selects “second format” as the display format HS for the first image information G1, and selects “first format” as the display format HS for the second image information G2. To do. Then, the first image information G1 and its display format HS are transmitted to the information output device 17, and the second image information G2 and its display format HS “first format” are transmitted. Is done. As a result, the first image information G1 is displayed in the “second format” and the second image information G2 is displayed in the “first format” on the display device 40 of the information output device 17.

As described above, according to the image display device of the present embodiment, in addition to the effects (1) to (3) described in the first embodiment, the effects listed below can be obtained. Become.
(4) According to such a configuration, even when a plurality of pieces of image information G1 and G2 are displayed at the same time, an appropriate display format HS is displayed on each of the image information G1 and G2 based on the display attributes. You will be able to choose. As a result, a plurality of pieces of image information G1, G2 can be displayed in an appropriate display format.

(Other embodiments)
In addition, each said embodiment can also be implemented with the following aspects.
In the second embodiment, the table 312 includes “Yes” for the first to third requests for the first image information, “Yes” for the first request for the second image information, The case where the display format for the first image information and the display format for the second image information are set for the combination in which both the second and third requests are “none” is illustrated. However, the present invention is not limited to this, and other combinations of presence / absence of the first to third requests for the first image information and other combinations of presence / absence of the first to third requests for the second image information. A display format of the first image information and a display format of the second image information may be set. As a result, the convenience of the image display apparatus can be improved.

  In the second embodiment, the case where the display formats of the first image information and the second image information are set is illustrated. However, this is not restrictive, and the display format may be set for three or more pieces of image information. As a result, the convenience of the image display apparatus can be improved.

  In the first embodiment, the case where the first to third requests are associated with the first to third formats is illustrated. However, the present invention is not limited to this, and other display formats may be associated with the first to third requests. For example, the display format corresponding to the first request may include “flashing portion”, and the display format corresponding to the second request is “center display” or “difference in color contrast is large”. May be included, and the display format corresponding to the third request may include “specific mark”. As a result, the convenience of the image display apparatus can be improved.

In each of the above embodiments, the display position parameter included in the display format is exemplified. However, the present invention is not limited to this, and the display format may include parameters other than the display position.
As shown in the table 313 in FIG. 12, the parameters included in the display format may include display size, display color, warning mark, blinking, and the like in addition to the display position. For example, the parameters of the first format may be the display position “center of screen”, the display size “large”, the display color “yellow”, the warning mark “present”, and the blinking “present”. . In addition, the parameters of the second format are as follows: the display position is “right screen”, the display size is “medium”, the display color is “red”, the warning mark is “present”, and the flashing is “not present” Good. Furthermore, even if the display position is “lower right of screen”, the display size is “small”, the display color is “blue”, the warning mark is “present”, and the blinking is “not present” Good. Further, movement and the like may be included as other parameters.

  As described above, when the types of parameters increase, the user's recognition attribute can be set in detail according to the combination of parameters. In other words, the display attribute of the image information can be set so as to be more suitable for the user to recognize based on the finely classified user recognition attribute. As a result, the display format of the image information can be made appropriate for the user.

  In each of the above embodiments, as illustrated in FIG. 2, the case where the requestability set in the display attribute is an aspect that the user wants to recognize is exemplified. However, the present invention is not limited to this, and the display attribute may be set to a mode other than the mode that the user wants to recognize. For example, the image information may be given urgency, seriousness, safety, etc. as requirements. At this time, the urgency, seriousness, safety, etc. given in this way are displayed in a display format in which the urgency, seriousness, safety can be transmitted to the user. That is, urgency, seriousness, and safety are associated with the display format through a recognition mode that the user wants to recognize.

  As shown in the table 302 of FIG. 13, when the request included in the display attribute of the image information is “urgent”, “severity”, or “safety”, a display format related to each is set. Can do. “Urgent” may be associated with the “First Look” display format, “Severity” may be associated with the “Long Viewing Time” display format, and “Safety” may be “Overlooked” It may be associated with the display format “not available”.

  As a result, an attribute that is not directly related to the display format can be set as the display attribute. However, “Urgent”, “Safety”, “Severity”, etc. included in the display attribute are related to the mode that the user wants to recognize, that is, the recognition attribute, so it is related to the display format via the recognition attribute. Can do. That is, the degree of freedom of items that can be included in the display attribute is increased.

As a result, the applicability of the image display device and the degree of configuration freedom can be improved.
In each of the above embodiments, the case where the display attribute is set as the display attribute is exemplified. However, the present invention is not limited to this, and the display attributes that are not desired to be applied to the display of image information may be set as exclusion items in the display attributes.

As shown in the table 303 in FIG. 14, “exclusion / not possible” of “flashing” and “possibility / impossibility of“ red ”may be set as exclusion items.
Thereby, the image information is displayed except for the excluded display format because it is not preferable as the display of the image information. And since the display format in an image display apparatus comes to be made more appropriate, the applicability of an image display apparatus can be improved.

  In each of the above embodiments, the case where the presence / absence of each requirement is set as the display attribute is illustrated. However, the present invention is not limited to this, and not only the presence / absence, but also priority may be set. Further, the display format may be set differently depending on the priority.

  As shown in the table 304 of FIG. 15, for example, priority may be set for the contents of requestability. Priorities “1” to “5” may be set for “first to see” as the content of requirement. In addition, priority levels “1” to “5” may be set for “long viewing time”. Furthermore, priorities “1” to “5” may be set for “do not miss”. As for the priorities “1” to “5”, those having a high priority may be “1”, and those having a low priority may be “5”.

  As shown in the table 314 of FIG. 16, when the first format is priority “1”, the display position is “center of screen” and “warning mark”, and when the priority is “2”, the display position is When “screen center”, the display color is “red”, and the priority is “3”, the display format may be “screen center” and the display color is “yellow”. When the second format is priority “1”, the display position is “screen left” and the display color is “blue”. When the priority is “2”, the display position is “screen left” and the display color. Is “standard color” and the priority is “3”, the display position may be “center of screen” and the display color may be “standard color”. Furthermore, when the third format is priority “1”, the display position is “lower right of screen”, the display color is “flashing”, and when priority is “2”, the display position is “lower right of screen”, When the display color is “warning mark” and the priority is “3”, the display position may be “center of screen” and the display color may be “short text”.

  As a result, the display format is preferentially selected from the display information with the higher priority of the display attribute, so that an appropriate display format is applied to the display information with the higher priority. That is, the possibility of transmitting display information with high priority to the user is improved. In addition, the display format of the image with high priority is selected according to the priority level obtained from the display attribute of the image. Then, image information having a display attribute with a high priority is displayed in an image format with a high priority, and it is expected that display contents are accurately transmitted to the user.

  In other words, it becomes possible to manage the details of the requirement in more detail and display the image information in a more appropriate display format, so that the degree of design freedom can be improved as an image display device. It becomes like this.

  In each of the above embodiments, the case where the display attribute corresponds to one specific display format HS is exemplified. However, the present invention is not limited to this, and the display attributes may correspond to a plurality of display formats corresponding to the recognition attributes required by the display attributes. And you may select the display format matched with a predetermined order, a priority, etc. from these several display formats.

  As a result, when the same recognition information corresponds to multiple image information displayed at the same time, a different display format is selected from the multiple display formats associated with the recognition attributes for each image information. can do. Even when image information having the same display attribute is displayed at the same time, the display format of the image information can be changed to facilitate identification.

  In each of the above embodiments, the case where there is one display device 40, that is, one screen is illustrated. However, the present invention is not limited to this, and there may be a plurality of display devices (screens). When there are a plurality of display devices, the display device to be used may be specified in the display format.

  As shown in the table 315 of FIG. 17, for example, when two display devices are provided as a main monitor and a sub monitor, the first formal wave, the display position is “center of screen”, and the display destination is “main”. “Monitor” and “Sub-monitor” may be used. In the second format, the display position may be “right screen” and the display destination may be “main monitor” only. Further, in the third format, the display position may be “bottom right of screen” and the display destination may be “sub monitor” only.

  In each of the above embodiments, the case where the vehicle 10 is provided with two vehicle control devices, the first and second vehicle control devices 11 and 12, is not limited to this, and the vehicle 10 includes three or more. The vehicle control device may be provided, or one vehicle control device with integrated functions may be provided. As a result, the degree of freedom of configuration of the image display device can be improved.

  In each of the above embodiments, the case where the vehicle 10 is provided with two driving support devices, the first and second driving support devices 13 and 14, is not limited to this, but the vehicle 10 includes three or more driving support devices. The driving support device may be provided, or one driving support device with integrated functions may be provided. As a result, the degree of freedom of configuration of the image display device can be improved.

  In each of the above embodiments, the first and second vehicle control devices 11 and 12 and the first and second driving support devices 13 and 14 are illustrated as being mounted on the vehicle 10, but the vehicle control device In addition, the driving support device may not have all or part of its functions mounted on the vehicle. For example, some of the functions may be provided in a center outside the vehicle, or may be provided in a portable information processing apparatus. In particular, all of the functions of the driving support device can be provided in a portable information processing device such as a smartphone. When the learning function is provided in the center, the relevance between the recognition attribute and the display format can be learned based on the information of a plurality of users, or the learning results of other users can be adopted. be able to. As a result, the degree of freedom of configuration of the image display device can be improved.

  In each of the above embodiments, the case where the display control unit 16 is communicably connected to the information arbitration unit 15 is illustrated, but the communicable connection may be wired communication or wireless communication. Further, the communicable connection between other devices in the vehicle 10 may be wired communication or wireless communication. For example, the wired communication may be a dedicated line communication or a vehicle network communication. As a result, the degree of freedom of configuration of the image display device can be improved.

  In each of the above embodiments, the case where the image display device is configured by the information arbitration unit 15, the display control unit 16, the information output device 17, and the viewpoint detection device 18 is illustrated, but the image display device is configured by the display control unit 16. And the information output device 17 may be included.

  The display control unit 16 of the image display device only needs to include at least the display format selection unit 30 and the display format list 31. Even with only the display format selection unit 30 and the display format list 31, the display control unit 16 can select a display format suitable for the image attribute from the display format list 31 by the display format selection unit 30.

  Furthermore, the information output device 17 of the image display device only needs to include at least the display device 40. Even with only the display device 40, the information output device 17 can display the image information in the designated display format. As a result, the degree of freedom of configuration of the image display apparatus can be improved and the application range can be expanded.

  In each of the above embodiments, the case where the image display device is used in a vehicle is illustrated. However, the present invention is not limited to this, and the image display device may be used for a moving body other than a vehicle, such as a railroad, a ship, or an aircraft. As a result, the application range of the image display apparatus can be expanded.

  DESCRIPTION OF SYMBOLS 10 ... Vehicle, 11 ... 1st vehicle control apparatus, 12 ... 2nd vehicle control apparatus, 13 ... 1st driving assistance apparatus, 14 ... 2nd driving assistance apparatus, 15 ... Information mediation part, 16 ... Display control , 17 ... Information output device, 18 ... Viewpoint detection device, 20 ... Information output unit, 21 ... Requirement assigning unit, 22 ... Table, 30 ... Display format selection unit, 31 ... Display format list, 32 ... List management unit, 33 ... Viewpoint learning unit, 34 ... User specifying unit, 40 ... Display device, 41 ... Audio device, 50 ... Eye, 51 ... Viewpoint, 301-304 ... Table, 310-315 ... Table, 401-403 ... Area, G1 ... First image information, G2 ... second image information, HS ... display format, HS1 ... first format, HS2 ... second format, HS3 ... third format, J1-J4 ... image information, L1, L2 ... Gaze.

Claims (11)

An image display device for displaying image information on a screen,
A first storage unit that stores image information to be displayed on the screen in a state in which a display attribute that is an attribute indicating an index indicating how the user wants to be recognized;
A recognition attribute, which is an attribute indicating an image recognition mode by a user estimated based on detection of movement of the user's line of sight on the screen, is stored in association with the display format of the image displayed on the screen. A second storage unit;
A display control unit that selects a display format of image information to be displayed on the screen based on a relationship between the display attribute and the recognition attribute, and that controls display of the image information on the screen in the selected display format; An image display device comprising: A viewpoint detection device for detecting movement of the user's line of sight on the screen;
A recognition attribute estimation unit that estimates the recognition attribute based on movement of the user's line of sight detected by the viewpoint detection device;
A display format processing unit that associates the display format of the image at the movement position on the screen of the detected user's line of sight with the estimated recognition attribute;
The image display device according to claim 1, wherein the second storage unit stores a recognition attribute estimated by the recognition attribute estimation unit and associated with a corresponding display format by the display format processing unit. The display format associated with the recognition attribute estimated by the recognition attribute estimation unit is different from the display format associated with the same recognition attribute stored in the second storage unit. The image according to claim 2, further comprising: a learning unit that replaces a display format stored in the second storage unit in association with the recognition attribute with a display format associated with the estimated recognition attribute. Display device. The first storage unit stores a plurality of pieces of image information together with respective display attributes,
In the second storage unit, a plurality of recognition attributes are stored in association with display formats of corresponding images, respectively.
The display control unit selects a display format corresponding to a recognition attribute having the highest relevance from among the plurality of recognition attributes for each of the display attributes of the plurality of image information. The image display device according to item. In the second storage unit, a plurality of different image display formats are associated with one recognition attribute,
The display control unit selects a different display format for each display attribute when it is determined that a plurality of display attributes are related to the same recognition attribute at the same time. The image display device according to one item. In one recognition attribute stored in the second storage unit, display formats of a plurality of different images are set with different priorities,
When the display control unit determines that a plurality of display attributes are related to the same recognition attribute at the same time, the display control unit changes the display format of the images in the order of priorities obtained based on the display attributes of the images. The image display device according to claim 5, wherein the image selection devices are selected in order of priority. The display attributes include display formats to exclude,
The image display device according to claim 1, wherein the display control unit preferentially selects a display format that does not include the excluded display format as a display format corresponding to a display attribute. The image display device according to claim 1, wherein the display attributes include at least two attributes among attributes relating to “urgency”, “safety”, and “severity”. The display attribute has a priority,
The image display device according to claim 1, wherein the display control unit preferentially selects the display format from image information having a display attribute having a high priority. An image display method for displaying image information on a screen,
A first storage step of storing image information to be displayed on the screen in a state in which a display attribute that is an attribute indicating an index indicating how the user wants to be recognized;
A recognition attribute, which is an attribute indicating an image recognition mode by a user estimated based on detection of movement of the user's line of sight on the screen, is stored in association with the display format of the image displayed on the screen. A second storage step;
Selecting a display format of image information to be displayed on the screen based on the relationship between the display attribute and the recognition attribute, and controlling display of the image information on the screen in the selected display format. An image display method characterized by the above. Detecting the movement of the user's line of sight on the screen;
An estimation step of estimating the recognition attribute based on the movement of the user's line of sight detected by the step of detecting the movement of the user's line of sight;
An association step of associating a display format of the image at the movement position on the screen of the detected user's line of sight with the estimated recognition attribute;
The image display method according to claim 10, wherein in the second storage step, recognition attributes estimated by the estimation step and associated with a display format corresponding in the association step are stored.

Images