JP6253417B2 - Vehicle information display control device - Google Patents

Description

  The present invention relates to a vehicle information display control device that displays information in a driver's field of view.

  For example, a vehicle information display device that directly displays information in a driver's field of view by displaying information on a windshield or a transparent screen through which the driver can see ahead of the vehicle is called a “head-up display (HUD)”. Its practical application is progressing.

  For example, the following Patent Document 1 includes means for detecting the driver's line-of-sight direction and means for photographing the front of the vehicle, and when the driver looks aside, an image of the front of the vehicle in the driver's line-of-sight direction. A technique for guiding the driver's line of sight in an appropriate direction by displaying the symbol is disclosed. In Patent Document 2 below, a point of an arbitrary color is displayed in the vicinity of the driver's line of sight, and the time until the driver's line of sight moves to the point is measured based on the driver's face image data. Thus, a technique is disclosed in which it is determined whether or not the driver can visually recognize the color of the point, and the color determined to be visually recognized is set as the display color of the HUD.

JP 2008-162550 A JP 2010-23621 A

  In the HUD technology, compatibility between visibility in front of the vehicle and visibility of information display is an issue. For example, if information is displayed very close to the driver's line of sight in order to increase the visibility of the information display, the display becomes an obstacle and the visibility ahead of the vehicle is impaired. Conversely, when information is displayed at a position away from the driver's line of sight, the front of the vehicle is easy to see, but the information display of the HUD is difficult to see. Furthermore, it is necessary for the driver to move his / her line of sight in order to see the display, and the convenience of the HUD is impaired.

  The present invention has been made to solve the above-described problems. In a vehicle information display control apparatus that controls a head-up display that displays information in a driver's field of view, the visibility and information display in front of the vehicle are improved. The object is to enable both visibility.

A vehicle information display control device according to the present invention is a vehicle information display control device that controls a head-up display that displays information in the field of view of a driver of a vehicle, acquires information related to the vehicle status, and relates to the vehicle status. An information display determination unit that determines information to be displayed on the head-up display based on the information, an image processing unit that acquires an image obtained by photographing the front of the vehicle, and a gaze direction detection unit that detects the direction of the driver's gaze When, by performing based rather correction process in the direction of the driver's line of sight to the front of the image of the vehicle, and the virtual field construction unit for creating a virtual view image is an image corresponding to the visual field of the driver, the virtual field of view And a display processing unit that determines a layout of information to be displayed on the head-up display based on the image and the state of the vehicle.

  According to the vehicle information display control device according to the present invention, since the layout of information displayed on the head-up display is determined based on the virtual visual field image corresponding to the visual field of the driver and the situation of the vehicle, from the driver. It is possible to display information on the head-up display in consideration of the visibility in front of the viewed vehicle. Therefore, both the visibility in front of the vehicle and the visibility of information display can be achieved.

It is a figure which shows the structure of the vehicle information display control apparatus which concerns on embodiment of this invention. It is a figure which shows the structure of an image process part. It is a figure which shows the structure of an information display judgment part. It is a figure which shows the structure of a virtual visual field construction part. It is a figure which shows the structure of a display process part. It is a flowchart which shows operation | movement of the vehicle information display control apparatus which concerns on embodiment of this invention. It is a figure which shows an example of the image of a dashboard. It is a figure which shows the example of the display information allocated to HUD. It is a figure which shows the example of the information display by HUD. It is a figure which shows the example of the information display by HUD. It is a figure which shows the example of the information display by HUD. It is a figure which shows the example of the information display by HUD. It is a figure which shows the example of the information display by HUD. It is a figure which shows the example of the information display by HUD. It is a figure which shows the example of the information display by HUD. It is a figure which shows the example of the information display by HUD. It is a figure which shows the example of the information display by HUD. It is a figure which shows the example of the information display by HUD.

  FIG. 1 is a diagram showing a configuration of a vehicle information display control device 100 according to an embodiment of the present invention. The vehicle information display control device 100 controls the operation of the head-up display (HUD) 61 and the non-HUD display 62. As shown in FIG. 1, the vehicle information display control device 100 includes the image processing unit 10, the information display, and the like. A determination unit 20, a gaze direction detection unit 30, a virtual visual field construction unit 40, and a display processing unit 50 are provided.

  The HUD 61 is a display device that displays information in the field of view of the driver of the vehicle, and the non-HUD display 62 is a general display device disposed on the center panel of the vehicle. Although FIG. 1 shows a configuration in which the HUD 61 and the non-HUD display 62 are externally attached to the vehicle information display control device 100, they may be configured as a part of the vehicle information display control device 100.

  The vehicle information display control device 100 is configured using a computer, and each element thereof is realized by the computer operating according to a program. Information stored by each element is stored in a storage medium such as a hard disk, a removable disk, or a memory accessible by the computer.

  The vehicle information display control device 100 according to the present invention is not limited to a device that is always fixed to the vehicle, and may be a portable device that can be detached from the vehicle. A description will be given assuming a fixed state. A vehicle equipped with the vehicle information display control device 100 is referred to as “own vehicle”.

  As shown in FIG. 1, a front vehicle-mounted camera 101, a driver monitoring camera 102, a vehicle-mounted sensor 103, a vehicle-mounted device 104, and a communication device 105 are connected to the vehicle information display control device 100. The front vehicle-mounted camera 101 is a camera that captures the front of the vehicle. The driver monitoring camera 102 is a camera that photographs the driver in order to detect the direction of the driver's line of sight. The in-vehicle sensor 103 is a sensor mounted on the host vehicle, such as a vehicle speed sensor, a direction sensor, or a temperature sensor. The in-vehicle device 104 is a device mounted on the own vehicle such as a navigation device or a multimedia device. The communication device 105 is a device for communicating with the outside, and may be a general-purpose communication device such as a smartphone.

  In the present embodiment, the vehicle information display control device 100 is configured to communicate with the outside using the communication device 105, but the vehicle information display control device 100 may have a communication function. Further, the vehicle information display control device 100 may be configured as a part of the in-vehicle device 104. For example, the vehicle information display control device 100 may be configured as a display unit of a navigation device.

  Hereinafter, the configuration of the vehicle information display control apparatus 100 shown in FIG. 1 will be described with reference to FIGS.

  The image processing unit 10 acquires an image in front of the host vehicle (front image) taken by the front in-vehicle camera 101, and information on the road surface, vehicle, feature, and pedestrian situation in front of the host vehicle from the acquired front image. To extract. In addition, the image processing unit 10 sends the front image captured by the front in-vehicle camera 101 to the virtual visual field construction unit 40.

  The front in-vehicle camera 101 preferably captures the front of the host vehicle from a position close to the driver's line of sight of the host vehicle, and is installed near the top of the windshield of the host vehicle, for example, behind the rearview mirror.

  FIG. 2 is a configuration diagram of the image processing unit 10. As shown in FIG. 2, the image processing unit 10 includes a front image extraction unit 11, a front road surface condition extraction unit 12, a front vehicle situation extraction unit 13, a front feature situation extraction unit 14, and a front pedestrian situation extraction unit 15. The The front image extraction unit 11 extracts a front image from the image signal received from the front vehicle-mounted camera 101 and sends it to the virtual visual field construction unit 40.

  The front road surface condition extraction unit 12 extracts information (front road surface information) indicating the road surface condition ahead of the host vehicle from the front image extracted by the front image extraction unit 11. The forward vehicle situation extraction unit 13 extracts information (forward vehicle information) indicating the situation of the vehicle ahead of the host vehicle from the forward image. The forward feature status extraction unit 14 extracts information (forward feature information) indicating the status of the feature ahead of the host vehicle from the front image. The forward pedestrian situation extraction unit 15 extracts information on the situation of the pedestrian ahead of the host vehicle (forward pedestrian information) from the forward image.

  The forward road surface information, the forward vehicle information, the forward feature information, and the forward pedestrian information include at least information on the position, priority, color, and brightness of each of the road surface, the vehicle, the feature, and the pedestrian. These forward image, forward road surface information, forward vehicle information, forward feature information, and forward pedestrian information are sent to the information display determination unit 20.

  The priority is determined according to the importance or urgency of an object (road surface, vehicle, feature, pedestrian) extracted from the front image. Examples of high importance include pedestrians, vehicles, traffic lights, traffic signs, obstacles, destination buildings, and the higher the importance, the higher the priority. Moreover, even if it is an object of the same kind, the closer the vehicle is to the own vehicle, the higher the degree of urgency because the driver needs to recognize it earlier. The higher the degree of urgency, the higher the priority.

  The information display determination unit 20 is information (display) that is displayed on the HUD 61 and the non-HUD display 62 based on the information acquired from the image processing unit 10 and the information acquired from the external in-vehicle sensor 103, the in-vehicle device 104, and the communication device 105. Information) and its priority. The priority of the display information is also determined according to the importance or urgency of the information. For example, information on travel speed and fuel remaining amount is set to a relatively low priority, and information on surrounding vehicles and pedestrians is set to a relatively high priority.

  As described above, the information acquired by the information display determination unit 20 from the image processing unit 10 is a front image, front road surface information, front vehicle information, front feature information, and front pedestrian information extracted therefrom.

  Information acquired by the information display determination unit 20 from the in-vehicle sensor 103 includes, for example, the host vehicle's traveling speed, accelerator opening, brake strength, steering angle (steering angle), gear setting, and the like. There are sensor information, distance between the vehicle and the surrounding vehicle, surrounding vehicle information indicating the behavior of the surrounding vehicle, weather information indicating temperature, illuminance, rainfall, and the like.

  As information (in-vehicle device information) that the information display determination unit 20 acquires from the in-vehicle device 104, for example, if the in-vehicle device 104 includes a car navigation device, the position information of the own vehicle, the information on the type of road that is running, There is route guidance information. Further, if the in-vehicle device 104 includes a multimedia device, there is information related to the content being reproduced, for example, the title of music or a program.

  Information (communication device information) acquired by the information display determination unit 20 from the communication device 105 includes traffic information and weather information received from an external information distribution service. When the communication device 105 is a smartphone, the communication device information includes event notifications such as incoming calls and e-mails, information on applications running on the smartphone, and the like.

  FIG. 3 is a configuration diagram of the information display determination unit 20. The information display determination unit 20 includes an external environment determination unit 21 that determines the contents of information (display information) to be displayed on the HUD 61 and the non-HUD display 62 and the priority thereof according to the external environment of the host vehicle, and the situation of the host vehicle. The vehicle state determination unit 22 that makes a determination according to the situation, and the in-vehicle device state determination unit 23 that makes a decision according to the state of the in-vehicle device 104 and the communication device 105.

  The external environment determination unit 21 determines the surrounding vehicle status determination unit 211 that determines the status of the vehicle around the host vehicle based on various information acquired by the information display determination unit 20, and determines the status of the road surface in front of the host vehicle. A road surface condition determining unit 212, a feature condition determining unit 213 that determines the condition of a feature in front of the host vehicle, a pedestrian condition determining unit 214 that determines the condition of a pedestrian in front of the host vehicle, and a weather condition around the host vehicle A weather condition determination unit 215 for determining The information used by the weather condition determination unit 215 to determine the weather condition may be the weather information acquired by the in-vehicle sensor 103 or the weather information received by the communication device 105.

  The own vehicle status determination unit 22 determines the status of the driving operation by the driver (accelerator opening, brake strength, steering angle (steering angle), gear setting, direction indicator status, etc.). A driving operation state determination unit 221 and a traveling state determination unit 222 that determines a traveling state of the host vehicle (traveling speed, current position, traveling direction, etc.) are included. The in-vehicle device status determining unit 23 includes an in-vehicle device status determining unit 231 that determines the operating status of the in-vehicle device 104 and a communication device status determining unit 232 that determines the operating status of the communication device 105.

  The external environment determination unit 21, the own vehicle state determination unit 22, and the in-vehicle device state determination unit 23 determine the priority for each piece of information acquired by the information display determination unit 20, and from among these pieces of information, Information to be transmitted is determined and sent to the display processing unit 50 together with the priority as information (display information) to be displayed on the HUD 61 or the non-HUD display 62. In addition, the information on the driving operation and the traveling state of the vehicle (own vehicle state information) acquired by the information display determination unit 20 are also sent to the display processing unit 50.

  Returning to FIG. 1, the line-of-sight direction detection unit 30 detects the direction of the driver's line of sight from the image of the driver taken by the driver monitoring camera 102. Information on the gaze direction of the driver (gaze direction information) detected by the gaze direction detection unit 30 is sent to the virtual visual field construction unit 40 and the display processing unit 50. Further, the line-of-sight direction detection unit 30 may be configured to determine the driver's arousal level (presence or absence of drowsiness) from the movement of the driver's eyes and eyelids.

  The virtual visual field construction unit 40 constructs a virtual visual field of the driver based on the front image acquired from the image processing unit 10 and the visual line direction information acquired from the visual line direction detection unit 30. Specifically, a virtual visual field image that is an image corresponding to the driver's visual field is generated.

  FIG. 4 is a configuration diagram of the virtual visual field construction unit 40. The virtual visual field construction unit 40 stores in-vehicle image information 41 including an image of the dashboard of the host vehicle and information on the dimensions of the dashboard, and includes an image composition unit 42 and a correction processing unit 43. FIG. 7 shows an example of a dashboard image.

  The in-vehicle image information 41 changes depending on the vehicle type on which the vehicle information display control device 100 is mounted. Therefore, when the vehicle information display control device 100 is a portable device, it is necessary to change it for each mounted vehicle type. is there. For example, the vehicle information display control device 100 may store in-vehicle image information 41 of a plurality of vehicle types in advance, or the in-vehicle image information 41 of any vehicle type can be downloaded from an external server using the communication device 105. May be.

  The image composition unit 42 composes the front image acquired from the image processing unit 10 and the dashboard image in consideration of the dimensions of the dashboard. The correction processing unit 43 performs a correction process based on the gaze direction information acquired from the gaze direction detection unit 30 on the synthesized image created by the image synthesis unit 42 to generate a virtual visual field image corresponding to the driver's visual field. .

  Returning to FIG. 1, the display processing unit 50 displays each display information on either the HUD 61 or the non-HUD display 62 based on the display information acquired from the information display determination unit 20, its priority, and the own vehicle status information. Make an assignment. There may be information displayed on both the HUD 61 and the non-HUD display 62. The display processing unit 50 further displays the virtual visual field image generated by the virtual visual field construction unit 40, the visual line direction information acquired from the visual line direction detection unit 30, the priority of each display information, and the own vehicle. The display layout is optimized in consideration of the situation information. The “layout” here includes not only the position where each information is displayed, but also the display size and color scheme, and the size of the display area.

  The HUD 61 and the non-HUD display 62 are controlled by the display processing unit 50 and display each allocated display information in a layout determined by the display processing unit 50. The display processing unit 50 also sets a layout for displaying the non-HUD display 62 display information report, but a description thereof is omitted because it is not relevant to the present invention.

  FIG. 5 is a configuration diagram of the display processing unit 50. The display processing unit 50 includes a display allocation unit 51, a driver characteristic information database 52, a driving operation history database 53, a layout calculation unit 54, and a contrast calculation unit 55.

  The display allocation unit 51 allocates each display information to be displayed on the HUD 61 or the non-HUD display 62 based on the priority and the vehicle status information.

  The driver characteristic information database 52 stores driver characteristic information (for example, age, preference, etc.). The driver characteristic information stored in the driver characteristic information database 52 may be input by the driver operating the vehicle information display control device 100. For example, the vehicle information display control device 100 may be a portable terminal of the driver. (Such as a smartphone) may be accessed to automatically acquire the driver's characteristic information recorded in the portable terminal.

  The driving operation history database 53 stores a driver's operation history for the host vehicle. The operation details are automatically added to the driving operation history database 53 every time the driver operates the own vehicle. The driver's line-of-sight movement history detected by the line-of-sight direction detection unit 30 may also be stored in the driving operation history database 53 as an operation history.

  For each information displayed on the HUD 61, the layout calculation unit 54 performs a process for optimizing the layout when the information is displayed on the HUD 61 in consideration of the priority of the information, the vehicle status information, the virtual visual field image, and the line-of-sight direction information. . The contrast calculation unit 55 obtains the contrast ratio between the display of each information in the layout determined by the layout calculation unit 54 and its background. The layout calculation unit 54 determines the color and size so that the visibility of each information can be secured in consideration of the contrast ratio calculated by the contrast calculation unit 55. Thereby, a highly visible display can be obtained regardless of the scenery in front, the color of the road, the weather, the time zone, and the like.

  Further, when laying out the display of each information, the layout calculation unit 54 prevents each display from overlapping with a high priority object in the driver's field of view. Furthermore, since the field of view of the driver becomes narrower as the vehicle travel speed increases, it is also effective to change the size of the display area of the HUD 61 according to the travel speed.

  In addition, the layout calculation unit 54 includes the characteristic information of each driver stored in the driver characteristic information database 52 and the operation history of each driver stored in the driving operation history database 53 (including the movement of the line of sight). In consideration of the above, the display layout of each information may be changed for each driver. For example, it is conceivable to increase the size of the speed display when the speed excess increases. In addition, there is a difference in the field of view, the speed of movement of the line of sight, and the color that is easy to visually recognize between the elderly and the young, so the display area of the HUD 61 and the display color (generally, depending on the age of the driver) It is conceivable that the elderly will not be able to see the orange color). In addition, for example, in the case of a driver who frequently views the speedometer, the driver's habit may be taken into consideration, for example, the speedometer display is positioned near the line of sight.

  Next, the operation of the vehicle information display control device 100 will be described. FIG. 6 is a flowchart showing the operation.

  For example, when the vehicle information display control device 100 is activated by turning the ignition key of the host vehicle or the like, in the vehicle information display control device 100, the information display determination unit 20 includes the in-vehicle sensor 103, the in-vehicle device 104, and the communication device 105. Various information (vehicle sensor information, surrounding vehicle information, weather information, in-vehicle device information, communication device information) is acquired (step S1).

  Next, the image processing unit 10 acquires a front image from the front in-vehicle camera 101 (step S2). At this time, the front image acquired by the image processing unit 10 is sent to the virtual visual field construction unit 40. Further, the front image and various types of information extracted therefrom (forward image, front road surface information, front vehicle information, front feature information, front pedestrian information) are sent from the image processing unit 10 to the information display determination unit 20.

  Subsequently, the line-of-sight direction detection unit 30 acquires the driver's line-of-sight direction information from the driver's image captured by the driver monitoring camera 102 (step S3). The line-of-sight direction information is sent to the virtual visual field construction unit 40 and the display processing unit 50.

  Next, the information display determination unit 20 determines and determines information (display information) to be displayed on the HUD 61 and the non-HUD display 62 and its priority based on the acquired information (step S4). The determined table information and priority are sent to the display processing unit 50 together with the vehicle status information.

  For each display information, the display processing unit 50 assigns whether to display the display information on the HUD 61 or the non-HUD display 62, and displays the display information assigned to the non-HUD display 62 on the non-HUD display 62 (step S5). ).

  Then, the presence / absence of display information assigned to the HUD 61 is confirmed (step S6). If there is no display information (NO in step S6), the process returns to step S1.

  On the other hand, if there is display information assigned to the HUD 61 (YES in step S6), the virtual visual field constructing unit 40 is based on the forward image acquired from the image processing unit 10 and the visual line direction information acquired from the visual line direction detecting unit 30. Then, a virtual visual field image corresponding to the driver's visual field is generated (step S7).

  Further, the display processing unit 50 considers the virtual visual field image generated by the virtual visual field construction unit 40, the visual line direction information acquired from the visual line direction detection unit 30, the priority of each display information and the vehicle state information, A layout of information to be displayed on the HUD 61 is determined (step S8), and information is displayed on the HUD 61 according to the determined layout (step S9). Then, it returns to step S1.

  Thus, since the layout of the information displayed by the HUD 61 is determined based on the virtual visual field image corresponding to the visual field of the driver and the own vehicle status information, the visibility in front of the vehicle viewed from the driver is taken into consideration. Information display on the head-up display can be performed. Therefore, both the visibility in front of the vehicle and the visibility of information display can be achieved.

  Hereinafter, specific display examples of the HUD 61 by the vehicle information display control device 100 according to the present invention will be shown. FIG. 8 is a diagram illustrating an example of display information assigned to the HUD 61. Here, the display information of the HUD 61 is divided into information that is always displayed, information that is displayed when an event occurs, and information that is displayed when a warning occurs. Information that is always displayed includes travel speed, speed limit, remaining fuel amount, and the like. Examples of information to be displayed when an event occurs include incoming calls, route guidance arrows, lane guidance, distance to a branch, traffic jam information, and multimedia device operation information. Information displayed by the warning display includes, for example, rear-end collision warning (distance reduction), lane departure, obstacle detection, reduced driver alertness, overspeed, overtaking vehicle warning, forgetting to wear a seat belt, parking brake release There is forgetting.

  Here, it is assumed that the information notified by the warning display has the highest priority, the information to be displayed when an event occurs has the next highest priority, and the information to be constantly displayed has a low priority. The priority of each information may change depending on the type of road on which the vehicle is traveling (highway / general road) and the traveling state (high speed traveling / low speed traveling).

  9 to 18 are diagrams showing examples of information display by the HUD 61. FIG. For example, when the host vehicle is traveling on a highway at a high speed, the driver's field of view is narrowed. Therefore, as shown in FIG. 9, the display area (broken rectangle) of the HUD 61 is narrowed to match the field of view. FIG. 9 shows a state in which the HUD 61 is displaying the traveling speed of the host vehicle, an icon indicating the speed limit of the traveling section, a meter (fuel meter) indicating the remaining amount of fuel, and a route guidance arrow. ing. Note that the display area (broken rectangle) is not actually displayed.

  When traveling at high speed, it is preferable to fix the display position of each information so as not to move with respect to the movement of the driver's line of sight. This is because the movement of the line of sight during high-speed traveling is an instantaneous operation, and recognition becomes difficult when the display moves each time. However, when the road is curved in front of the host vehicle, the display area of the HUD 61 may be moved in accordance with the curve direction and the driver's line-of-sight direction as shown in FIG. Similarly, when there is an uphill or downhill ahead of the vehicle, the display area of the HUD 61 may be moved up and down.

  Regarding the layout of the information display, since the inter-vehicle distance is longer when traveling at a high speed than when traveling at a low speed, the information may be displayed on a portion overlapping the front road surface (the road between the host vehicle and the preceding vehicle). Further, the character size may be displayed in a variable manner according to the traveling speed of the vehicle. For example, if the size of the speed display is increased as the traveling speed of the host vehicle increases, the driver can intuitively recognize an increase in the traveling speed, and the prevention of overspeed can be expected.

  Even when traveling on an expressway, when the vehicle is traveling at a low speed due to traffic jams or the like, the driver's field of view is not narrowed, so the display area of the HUD 61 may be enlarged as shown in FIG. Further, when traveling at low speed, the display position of each information may be moved according to the situation. For example, the distance between the vehicles is shortened in a traffic jam, and when information is displayed on the front road surface, the display overlaps with the preceding vehicle. Therefore, it is preferable to move to a position that does not overlap the preceding vehicle as shown in FIG. Further, since the driver's line of sight movement increases when the display area is enlarged, the display size of each display may be larger than that during high-speed driving.

  Further, when it is detected that the inter-vehicle distance with the preceding vehicle has rapidly decreased, a warning (attention for rear-end collision) that emphasizes the preceding vehicle is displayed as shown in FIG. Since the warning display has a higher priority than other information, it is displayed in a more conspicuous manner. For example, information display other than warning display may be erased as shown in FIG.

  Even on ordinary roads such as urban areas, the display area of the HUD 61 should be enlarged or reduced according to the traveling speed of the vehicle. On ordinary roads, there are things that drivers should pay attention to, such as pedestrians, bicycles, and traffic lights. In order to enter the driver's field of view more than the highway, as shown in FIG. 13, the display area of the HUD 61 is slightly wider than when driving on the highway. Further, since the driver's line-of-sight movement increases as the display area increases, the display size of each information is made larger than that during high-speed driving. FIG. 14 shows a state in which the HUD 61 has displayed a warning that calls attention to the pedestrian in addition to the traveling speed of the own vehicle, the speed limit, the fuel meter, and the route guidance arrow.

  Low-priority information such as the traveling speed of the host vehicle, the speed limit, the fuel meter, and the route guidance arrow is moved to a position that does not overlap with a high-priority object such as a preceding vehicle or a pedestrian. When the information display position is moved, the display color of the information is changed according to the color of the scenery overlapping the part to be moved to secure the contrast ratio, and the information display visibility is maintained high.

  In FIG. 12 and FIG. 14, the warning display that calls attention to the vehicle ahead and the pedestrian is a rectangle that surrounds the attention object. However, as shown in FIG. 15, the “balloon” is slightly shifted from the attention object. May be displayed to ensure the visibility of the attention object.

  Further, when traveling at a low speed, the display position of each information may be moved according to the own vehicle or an external situation. For example, when a pedestrian appears on the left hand side of the road from the state of FIG. 14, a warning that calls attention to the pedestrian is displayed as shown in FIG. Move to.

  When the vehicle stops due to a red light or the like, the display area of the HUD 61 may be maximized as shown in FIG. You can also display information that supports the start of your vehicle, such as the status of traffic lights, or information that is low in priority but highly relevant to the scenery ahead, such as the names of features that you can see ahead Good.

  Since the driver can view the non-HUD display 62 when the vehicle is stopped, as shown in FIG. 8, the information that is always displayed and the information that is displayed when an event occurs, etc., have a low relevance to the scenery in front. Information and information with low priority may be displayed only on the non-HUD display 62 without being displayed on the HUD 61. However, it is preferable to display high priority information such as a warning display on the HUD 61 even when the vehicle is stopped.

  In addition, when the vehicle information display control device 100 detects the driver's look aside when the start operation of the own vehicle is not performed even though the signal has turned blue from the time of the stop at the red light and the preceding vehicle has started. The HUD 61 may display a warning prompting the start, or the vehicle information display control device 100 may warn with a voice.

  In addition, when an oncoming vehicle is approaching when turning at an intersection, in addition to a pedestrian or oncoming vehicle that the driver can visually recognize, a bike approaching from behind the oncoming vehicle is detected, as shown in FIG. It is preferable to display a warning display that calls attention to it with a high priority.

  According to the vehicle information display control device 100 of the present embodiment, the layout of the information display by the HUD 61 is determined based on the virtual visual field image corresponding to the driver's visual field and the state of the vehicle. And information display considering both the visibility of the information display. Therefore, both the visibility in front of the vehicle and the visibility of information display can be achieved.

  In the present invention, the embodiments can be appropriately modified and omitted within the scope of the invention.

  DESCRIPTION OF SYMBOLS 100 Vehicle information display control apparatus, 101 Front vehicle-mounted camera, 102 Driver monitoring camera, 103 Vehicle-mounted sensor, 104 Vehicle-mounted apparatus, 105 Communication apparatus, 10 Image processing part, 11 Front image extraction part, 12 Front road surface condition extraction part, 13 Front Vehicle status extraction unit, 14 forward feature status extraction unit, 15 forward pedestrian status extraction unit, 20 information display determination unit, 21 external environment determination unit, 22 own vehicle status determination unit, 23 in-vehicle device status determination unit, 30 gaze direction Detection unit, 40 Virtual visual field construction unit, 41 In-vehicle image information, 42 Image composition unit, 43 Correction processing unit, 50 Display processing unit, 51 Display allocation unit, 52 Driver characteristic information database, 53 Driving operation history database, 54 Layout calculation Part, 55 contrast calculation part, 61 HUD, 62 non-HUD display, 211 laps Vehicle status determination unit, 212 Road surface status determination unit, 213 Feature status determination unit, 214 Pedestrian status determination unit, 215 Weather status determination unit, 221 Driving operation status determination unit, 222 Driving status determination unit, 231 In-vehicle device status determination unit 232 Communication device status determination unit.

Claims (12)

A vehicle information display control device for controlling a head-up display that displays information in the field of view of a driver of a vehicle,
An information display determination unit that acquires information related to the vehicle status and determines information to be displayed on the head-up display based on the information related to the vehicle status;
An image processing unit for acquiring an image of the front of the vehicle;
A line-of-sight detection unit that detects the direction of the driver's line of sight;
By performing based rather correction process in the direction of the sight line of the driver with respect to the front image of the vehicle, a virtual visual field construction unit for creating a virtual view image is an image corresponding to the visual field of the driver,
A vehicle information display control apparatus comprising: a display processing unit that determines a layout of information to be displayed on the head-up display based on the virtual visual field image and the state of the vehicle. The vehicle information display control device according to claim 1, wherein the display processing unit determines a color of information displayed on the head-up display in consideration of a contrast ratio between information displayed on the head-up display and a background thereof. The said display process part changes the position of the information displayed on the said head up display so that the information displayed on the said head up display may not overlap with the specific object in the said driver | operator's visual field. 2. The vehicle information display control device according to 2. 4. The vehicle information display control device according to claim 1, wherein the display processing unit moves a region in which the head-up display performs display in accordance with the movement of the driver's line of sight. 5. The vehicle information display control device according to claim 1, wherein the display processing unit changes a layout of information displayed on the head-up display according to a traveling speed of the vehicle. The vehicle information display control device according to claim 5, wherein the display processing unit narrows a region where the head-up display displays as the traveling speed of the vehicle increases. The vehicle information display control device according to any one of claims 1 to 6, wherein the display processing unit changes a layout of information displayed on the head-up display according to a road type on which the vehicle is traveling. . The vehicle information display control device according to claim 7, wherein the display processing unit narrows a region in which the head-up display displays when the vehicle is traveling on a highway than when traveling on a general road. . The said display process part does not change the relative position with respect to the direction of the said driver | operator's eyes | visual_axis of the information displayed on the said head-up display, when the said vehicle is drive | working a highway. Vehicle information display control device. The vehicle information display control device according to any one of claims 1 to 9, wherein the display processing unit further changes a layout of information displayed on the head-up display based on the characteristic information of the driver. The vehicle information display control device according to any one of claims 1 to 10, wherein the display processing unit further changes a layout of information displayed on the head-up display based on a driving operation history of the driver. . The virtual visual field building unit combines the image in front of the vehicle and the image of the dashboard of the vehicle in consideration of the dimensions of the dashboard, and the front of the vehicle in which the image of the dashboard of the vehicle is combined A virtual visual field image is created by performing the correction process on the image of
The vehicle information display control apparatus according to any one of claims 1 to 11.

Images