JP7172730B2 - Vehicle display control device, vehicle display control method, vehicle display control program - Google Patents

Description

The present disclosure relates to a vehicle display control device, a vehicle display control method, and a vehicle display control program.

2. Description of the Related Art Conventionally, there has been known a head-up display that projects virtual image content representing information related to route guidance of a vehicle onto a projection unit such as a windshield of the vehicle (see, for example, Patent Literature 1).

WO2015/118859

According to this type of head-up display technology, the driver can drive based on the information represented by the projected virtual image content, and can assist the driver in driving. However, when the vehicle is turned right or left, or when the vehicle is changed lanes, for example, the virtual image content is projected so that the driver's line of sight is not the place to be seen, such as the front of the vehicle in the direction of travel, but the virtual image. There is a risk that the user may be unnecessarily guided into the projected portion of the content.

Therefore, the present disclosure provides a vehicular display control device, a vehicular display control method, and a vehicular display control program that can suppress unnecessary guidance of the driver's line of sight into the virtual image content projection unit.

A vehicle display control device according to the present disclosure is a vehicle display control device 20 that controls a head-up display 230 that projects virtual image content representing driving support related information related to vehicle driving support on a projection unit 10, a determination unit 53 for determining whether or not the intention of the driving support related information represented by the virtual image content projected on the projection unit is recognized by the driver; and a guidance unit 54 that guides the driver's line of sight to information other than the driving support related information when it is determined that the information is recognized by the driver.

A vehicle display control method according to the present disclosure is a vehicle display control method for controlling a head-up display 230 that projects virtual image content representing driving support related information related to vehicle driving support on a projection unit 10, a determination process for determining whether or not the intention of the driving support-related information represented by the virtual image content projected on the projection unit is recognized by the driver; and in the determination process, the intention of the driving support-related information is recognized by the driver. and guidance processing for guiding the driver's line of sight to information other than the driving support-related information when it is determined that the driving support related information is detected.

The vehicle display control program according to the present disclosure uses a computer as a vehicle display control device 20 that controls a head-up display 230 that projects virtual image content representing driving support-related information related to vehicle driving support on the projection unit 10. A display control program for a vehicle for functioning, comprising: determination processing for determining whether or not a driver recognizes an intention of the driving support-related information represented by the virtual image content projected on the projection unit; In the processing, when it is determined that the intention of the driving support related information is recognized by the driver, the computer is caused to execute guidance processing for guiding the driver's line of sight to information other than the driving support related information. .

According to the present disclosure, in response to the driver recognizing the intention of the driving support-related information represented by the virtual image content projected on the projection unit, the driver is guided to look at information other than the driving support-related information. As a result, it is possible to prevent the driver's line of sight from being unnecessarily guided into the projection section of the virtual image content.

1 is a diagram schematically showing a configuration example of a vehicle system according to this embodiment; FIG. FIG. 2 is a diagram schematically showing an example of mounting a head-up display according to the present embodiment on a vehicle; FIG. 2 is a diagram schematically showing a configuration example of a control system of the vehicle display control device according to the present embodiment; FIG. 1 is a diagram (part 1) schematically showing a projection example of virtual image content according to the present embodiment; FIG. 2 is a diagram (part 2) schematically showing a projection example of virtual image content according to the present embodiment; FIG. 3 is a diagram (part 3) schematically showing a projection example of virtual image content according to the present embodiment; FIG. 4 is a diagram schematically showing a projection example of virtual image content according to the present embodiment (No. 4); FIG. 5 is a diagram schematically showing a projection example of virtual image content according to the present embodiment (No. 5); FIG. 6 is a diagram schematically showing a projection example of virtual image content according to the present embodiment (No. 6);

An embodiment according to the present disclosure will be described below with reference to the drawings. A vehicle system 1 illustrated in FIG. 1 is used for a mobile object such as a vehicle traveling on a road, and includes an HMI system 2 (HMI: Human Machine Interface), an ADAS locator 3 (ADAS: Advanced Driver Assistance Systems ), a surrounding monitoring sensor 4, a vehicle control ECU 5 (ECU: Electronic Control Unit), a driving support ECU 6 (ECU: Electronic Control Unit), and the like. The HMI system 2, the ADAS locator 3, the surroundings monitoring sensor 4, the vehicle control ECU 5, and the driving support ECU 6 are each connected to, for example, an in-vehicle LAN (LAN: Local Area Network) mounted on the vehicle.

The ADAS locator 3 includes a GNSS receiver 30 (GNSS: Global Navigation Satellite System), an inertial sensor 31, a map database 32, and the like. The map database 32 is hereinafter referred to as a map DB 32 . The GNSS receiver 30 receives positioning signals from multiple satellites. The inertial sensor 31 includes, for example, a gyro sensor and an acceleration sensor. The ADAS locator 3 combines the positioning signal received by the GNSS receiver 30 and the sensing result of the inertial sensor 31 to sequentially locate the vehicle position of the own vehicle on which the vehicle system 1 is mounted. Then, the ADAS locator 3 outputs the determined vehicle position via the in-vehicle LAN. In this case, the vehicle position is represented by a coordinate system consisting of latitude and longitude. In this coordinate system, for example, the X axis indicates longitude and the Y axis indicates latitude. It should be noted that positioning of the vehicle position can be performed, for example, on the basis of mileage information obtained based on the sensing results of a vehicle speed sensor mounted on the vehicle. configuration can be adopted.

The map DB 32 is composed of, for example, a non-volatile memory or the like, and stores map data including various data such as link data, node data, and road shape data. The link data includes link identification data that identifies links that form roads on the map, link length data that indicates the length of the link, link orientation data that indicates the orientation of the link, and link traveling time data that indicates the time required for traveling the link. , node coordinate data indicating the coordinates of nodes forming the start point and end point of a link, and link attribute data indicating road attributes. The node data includes node identification data that identifies a node existing on the map, node coordinate data that indicates the coordinates of the node, node name data that indicates the name of the node, node type data that indicates the type of node such as an intersection, Contains various data such as connecting link data that identifies connecting links. The road shape data is data indicating the shape of roads existing on the map. The road shape data includes data indicating the altitude of the road, the cross slope of the road, the longitudinal slope of the road, and the like.

Note that the map data may be acquired from outside the own vehicle, for example, via a communication module mounted on the vehicle. As the map data, three-dimensional map data including point groups such as feature points of road shapes and feature points of structures existing on the map may be used. In addition, when using three-dimensional map data, the ADAS locator 3 uses this three-dimensional map data and sensing results such as LIDAR (Light Detection and Ranging/Laser Imaging Detection and Ranging) for detecting point groups. may be configured to identify the vehicle position.

The surroundings monitoring sensor 4 is a sensor that monitors the surrounding environment of the own vehicle, and in this case, is provided as an autonomous sensor that operates autonomously. The surroundings monitoring sensor 4 detects, for example, a human such as a pedestrian, an animal other than a human, a dynamic target moving around the own vehicle such as a vehicle other than the own vehicle, a fallen object existing on a road, a road Detect objects existing around the vehicle, such as guardrails, curbs, trees, and other stationary objects around the vehicle. In addition, the perimeter monitoring sensor 4 can detect road markings such as lane markings, stop lines, pedestrian crossings, and instructional markings such as "stop" provided on the roads surrounding the vehicle. . Then, the periphery monitoring sensor 4 sequentially outputs the obtained sensing data to the in-vehicle LAN. The surroundings monitoring sensor 4 includes, for example, a surroundings monitoring camera that captures a predetermined range around the vehicle, a millimeter-wave radar, sonar, LIDAR, or other detection wave sensor that outputs search waves to a predetermined range around the vehicle. .

The survey wave sensor sequentially outputs scanning results based on received signals obtained by receiving reflected waves reflected by an object to the in-vehicle LAN as sensing data. More specifically, the probe wave sensor measures the distance from the probe wave sensor to the object based on the time from when the probe wave is transmitted to when the reflected wave reflected by the object is received. Also, the probe wave sensor measures the azimuth of the object with respect to the probe wave sensor based on the angle at which the reflected wave is received. The azimuth can be represented, for example, by an azimuth angle. For example, with the front direction of the host vehicle as a reference, clockwise rotation can be expressed as a positive azimuth angle, and counterclockwise rotation can be expressed as a negative azimuth angle.

In this case, the perimeter monitoring sensor 4 includes at least a front camera 41 whose imaging range is a predetermined range in front of the vehicle, and a millimeter wave radar 42 whose search range is a predetermined range in front of the vehicle. It has become. The front camera 41 may be provided, for example, on the rearview mirror of the vehicle or on the upper surface of the instrument panel. Also, the millimeter wave radar 42 may be provided, for example, on the front grill or the front bumper of the own vehicle. The millimeter wave radar 42 scans and transmits millimeter waves or quasi-millimeter waves to a sensing range in front of the vehicle, and receives reflected waves reflected by the object. Measure distance and bearing. The sensing range of the front camera 41 and the sensing range of the millimeter wave radar 42 may or may not match. Also, the sensing range of the front camera 41 and the sensing range of the millimeter wave radar 42 may or may not overlap at least partially. Also, a plurality of perimeter monitoring sensors 4 may be provided at different locations of the own vehicle.

The vehicle control ECU 5 is, for example, an electronic control unit for controlling acceleration and deceleration of the host vehicle, steering control, braking control, and the like. The vehicle control ECU 5 includes a power unit control ECU that controls acceleration and deceleration of the vehicle, a steering control ECU that controls steering of the vehicle, a brake control ECU that controls braking of the vehicle, and the like. The vehicle control ECU 5 is based on detection signals output from various sensors such as an accelerator position sensor, a brake depression force sensor, a steering angle sensor, and a wheel speed sensor mounted on the own vehicle. It outputs control signals to various driving control system devices such as an EPS motor (EPS: Electric Power Steering). Further, the vehicle control ECU 5 can output detection signals obtained from various sensors to the in-vehicle LAN.

The driving assistance ECU 6, for example, cooperates with the vehicle control ECU 5 to assist the driver's driving operation. The support by the driving support ECU 6 also includes an automatic driving function that automatically controls the running of the own vehicle. The driving support ECU 6 recognizes the driving environment of the own vehicle based on the vehicle position of the own vehicle obtained from the ADAS locator 3, map data stored in the map DB 32, sensing data obtained from the periphery monitoring sensor 4, and the like. More specifically, the driving support ECU 6 recognizes the position, shape, movement state, etc. of objects existing in the vicinity of the own vehicle based on sensing data acquired from the surroundings monitoring sensor 4, for example. It is possible to recognize the position, size, content, etc. of the road markings existing around the road. Then, the driving support ECU 6 combines the information thus recognized with information such as map data and the vehicle position of the own vehicle to create a virtual space in which the actual driving environment around the own vehicle is reproduced in three dimensions. It is possible to generate

Further, the driving support ECU 6 generates a driving plan for automatically driving the own vehicle by the automatic driving function based on the recognized driving environment. As the travel plan, a long-term travel plan and a short-term travel plan can be generated. In the short-term driving plan, the generated virtual space around the vehicle is used to perform acceleration/deceleration control to maintain a target distance from the preceding vehicle, steering control for lane following and lane changes, and collision avoidance. braking control and the like for In the long- and medium-term travel plan, a recommended route and a travel schedule for the vehicle to reach its destination are determined. The driving support ECU 6 may generate either one of the short-term driving plan and the long-term driving plan, for example, only the short-term driving plan.

An example of an automatic driving function executed by the driving support ECU 6 is an ACC function ( ACC: Adaptive Cruise Control). In addition, there is an AEB function (AEB: Autonomous Emergency Braking) that forcibly decelerates the vehicle by generating a braking force based on the result of sensing ahead of the vehicle. Note that the ACC function and the AEB function are merely examples, and the driving assistance ECU 6 may be configured to include other functions.

The HMI system 2 includes an HCU 20 (Human Machine Interface Control Unit), an operation device 21, a DSM 22 (Driver Status Monitor), a display device 23, and the like. The HMI system 2 receives input operations by the driver, who is the user of the vehicle, and presents various types of information to the driver of the vehicle. The operating device 21 includes various switches operated by the driver of the host vehicle. The operation device 21 is used for making various settings. Specifically, the operation device 21 is configured by a steering switch or the like provided on the spoke portion of the steering wheel of the host vehicle.

The DSM 22 includes, for example, a light source that generates near-infrared light, a near-infrared camera that detects near-infrared light, a control unit that controls these, and the like. The DSM 22 is arranged, for example, on the upper surface of the steering column cover or the instrument panel, with the near-infrared camera directed toward the driver's seat of the vehicle. The DSM 22 uses a near-infrared camera to capture an image of the driver's head irradiated with near-infrared light from a near-infrared light source. An image captured by the near-infrared camera is image-analyzed by a control unit (not shown). This control unit, for example, extracts the eyes of the driver from the captured image, and detects the positions of the eyes of the driver with respect to the reference positions set in the interior of the vehicle as the viewpoint positions. For the reference position, for example, the installation position of the near-infrared camera can be set. Then, the DSM 22 outputs to the HCU 20 information representing the detected viewpoint position of the driver. In addition, the control unit can identify or estimate the driver's line of sight, that is, the direction in which the driver's eyes are directed, by image analysis of the image captured by the near-infrared camera. Then, the DSM 22 outputs to the HCU 20 line-of-sight information representing the specified or presumed line-of-sight direction of the driver.

The display device 23 is configured as a head-up display 230 (HUD: Head Up Display). Hereinafter, the head-up display 230 is called HUD230. As illustrated in FIG. 2, the HUD 230 is provided, for example, on the instrument panel 12 of the host vehicle. The HUD 230 forms a display image based on image data output from the HCU 20 by a projector 231 such as a liquid crystal type or a scanning type, for example. The display image is, for example, an image representing information related to vehicle route guidance.

The HUD 230 projects a display image formed by the projector 231 onto the front windshield 10, which is an example of a projection unit, via an optical system 232 having, for example, a concave mirror. A projection area R is provided on the front windshield 10, and the display image formed by the projector 231 is projected within this projection area R. As shown in FIG. The projection area R is provided so as to be positioned in front of the driver's seat, particularly in front of the driver seated in the driver's seat.

The luminous flux of the display image projected onto the front windshield 10 is perceived or visually recognized by the driver seated in the driver's seat. The front windshield 10 is made of, for example, a translucent glass material or the like, and the scenery in front of the vehicle, that is, the light flux in the foreground is also perceived or visually recognized by the driver sitting in the driver's seat. be. As a result, the driver can visually recognize the virtual image of the display image formed in front of the front windshield 10 as the virtual image content 100 superimposed on a part of the foreground. That is, the HUD 230 realizes so-called AR display (AR: Augmented Reality) by superimposing and displaying the virtual image content 100 on the foreground of the host vehicle. The virtual image content 100 is content that visually represents at least information related to driving support for the host vehicle, that is, driving support related information. Driving support related information includes, for example, route guidance related information that indicates the direction of travel of the vehicle on the guidance route, automatic driving related information that indicates the course when the vehicle is automatically controlled, and lane information that the vehicle is traveling on. lane information that indicates a curve ahead of the vehicle in the direction of travel; pedestrian information that indicates that there is a pedestrian ahead of the vehicle in the direction of travel; Various types of information can be applied as long as it is information that is useful for driving support of the own vehicle, such as stop line information that conveys the existence of the vehicle. Then, for example, as virtual image content 100 representing pedestrian information, the superimposed content is content that is superimposed and displayed at an intersection or on the road surface in front of the vehicle in the traveling direction, or in the vicinity of the pedestrian, and non-superimposed content. is a content such as an icon that indicates the position of a pedestrian in a bird's-eye view image that indicates the configuration of an intersection and a road surface in front of the vehicle in the traveling direction.

Note that the projection unit on which the HUD 230 projects the virtual image content 100 is not limited to the front windshield 10, and may be configured by, for example, a translucent combiner. Also, the display device 23 may be configured by, for example, a combination meter, a CUD (Center Information Display), or the like.

The HCU 20 is mainly composed of a microcomputer including, for example, a processor, a volatile memory, a nonvolatile memory, an input/output circuit, and a bus connecting these. HUC20 is connected to HUD230 and in-vehicle LAN. The HUC 20 is an example of a vehicle display control device according to the present disclosure, and controls display by the HUD 230 by executing a control program stored in a storage medium such as a nonvolatile memory. This control program includes a vehicle display control program according to the present disclosure. Further, the HUC 20 executes the control program to perform the vehicle display control method according to the present disclosure. Note that the memory is, for example, a non-transitory tangible storage medium that non-temporarily stores computer-readable programs and data. Also, the non-transitional material storage medium can be realized by, for example, a semiconductor memory, a magnetic disk, or the like.

Further, the vehicle system 1 further includes a meter system display unit 7, as illustrated in FIG. The meter system display unit 7 is an example of a display unit different from the front windshield 10 of the HUD 230, and is a display unit capable of displaying meter system information such as the running speed of the host vehicle and the rotation speed of the engine. Further, as will be described later, the meter system display unit 7 can also display various types of information such as driving assistance related information represented by the virtual image content 100 in a manner different from that of the virtual image content 100, such as liquid crystal display.

Next, a configuration example of the HCU 20 regarding control of display by the HUD 230 will be described in more detail. As illustrated in FIG. 3, the HCU 20 virtually realizes a superimposed content projection unit 51, a non-superimposed content projection unit 52, a determination unit 53, and a guidance unit 54 by executing a vehicle display control program. . The HCU 20 may configure these processing units with hardware, or may configure them with a combination of software and hardware.

The superimposed content projection unit 51 executes superimposed content projection processing. The superimposed content projection process is a process of projecting the superimposed content 101, which is an example of the virtual image content 100, in the projection area R of the front windshield 10 so as to be superimposed on an object included in the foreground of the own vehicle. Note that the superimposed content 101 is a virtual image content 100 that is projected so as to be positively attached to an object included in the foreground of the own vehicle. It is different from the virtual image content 100 that is not projected, for example, the non-superimposed content 102 that is accidentally projected at a position where the non-superimposed content 102 is superimposed on the object included in the foreground of the vehicle. Specifically, the superimposed content 101 is an object included in the foreground of the vehicle, for example, a virtual image content 100 projected along the road, the depth direction of the front windshield 10 as seen from the driver, that is, the vehicle. virtual image content 100 extending forward in the direction of travel of the vehicle, and an object included in the foreground of the vehicle, for example, a stop line that actually exists in front of the direction of travel of the vehicle. a virtual image content 100 that maintains a predetermined positional relationship between the driver's viewpoint position, the actual scene in front of the host vehicle, and the projection position in the projection area R; is.

The non-superimposed content projection unit 52 executes non-superimposed content projection processing. The non-superimposed content projection process is a process of projecting the non-superimposed content 102, which is an example of the virtual image content 100, onto the projection area R of the front windshield 10 so as not to be superimposed on the object included in the foreground of the own vehicle. Note that the non-superimposed content 102 is the virtual image content 100 that is not projected by actively sticking to the object included in the foreground of the own vehicle, but is accidentally superimposed on the object included in the foreground of the own vehicle. It is a virtual image content 100 that can be projected at .

The determination unit 53 executes determination processing. The determination process is a process of determining whether or not the driver has recognized the intention of the driving support related information represented by the virtual image content 100 projected in the projection area R of the front windshield 10 . A specific example of determination will be described later.

The guidance unit 54 executes guidance processing. The guiding process is a process of guiding the driver's eyes to information other than the driving support-related information when the determination unit 53 determines that the driver has recognized the intention of the driving support-related information. A specific example of guidance will be described later.

Next, some examples of display forms of the virtual image content 100 by the vehicle display control device 20 according to the present disclosure will be described.

The display form example illustrated in FIG. 4 is an example of the display form of the virtual image content 100 when the own vehicle turns left, for example. In this case, when the vehicle reaches within a predetermined distance before the intersection, the HCU 20 first detects an object included in the foreground of the vehicle, in this case, the actual vehicle, within the projection area R of the front windshield 10. An arrow mark M1 is displayed as superimposed content 101 so as to be superimposed on the road in front of the vehicle. In this case, the arrow mark M1, which is an example of the superimposed content 101, becomes arrow information indicating that the traveling direction of the own vehicle on the guidance route is the left direction as driving support related information related to the route guidance of the own vehicle. there is

For example, when the turn signal of the host vehicle is operated to turn left, the HCU 20 detects the intention of the driving support related information represented by the arrow mark M1 projected in the projection area R of the front windshield 10, in this case, the guidance route. It is determined that the driver recognizes that the direction of travel of the own vehicle at is to the left. Then, the HCU 20 executes guidance processing.

Specifically, the HCU 20 first executes an erasing process for erasing the arrow mark M1 projected within the projection area R of the front windshield 10 . Then, the HCU 20 shifts to guidance processing. In this guidance process, the HCU 20 displays the arrow mark M2 within the projection area R of the front windshield 10 so as not to overlap the object included in the foreground of the vehicle, in this case, the road that actually exists in front of the vehicle. It is displayed as non-superimposed content 102 . In this case, the arrow mark M2, which is an example of the non-superimposed content 102, is arrow information that instructs the driver to look at the actual scene on the left side of the vehicle in the traveling direction as the driving support related information related to the route guidance of the vehicle. ing.

In this way, when the HCU 20 determines that the driver has recognized the intention of the driving support-related information indicated by the arrow mark M1, which is an example of the superimposed content 101, the HCU 20 erases the arrow mark M1 and A certain arrow mark M2 is displayed. As a result, the HCU 20 directs the driver's line of sight not to the projection area R of the front windshield 10, but to the information other than the driving support-related information represented by the superimposed content 101, in this case, the actual scene on the left side of the traveling direction of the own vehicle. lead to

Note that the HCU 20 may be configured to execute display processing for displaying the arrow mark M2, which is an example of the non-superimposed content 102, while executing erasing processing for erasing the arrow mark M1, which is an example of the superimposed content 101. good. Also, the HCU 20 may be configured to display the non-superimposed content 102 oriented leftward within the projection area R of the front windshield 10 when the host vehicle turns left. Also, the HCU 20 may be configured to display the non-superimposed content 102 on the left end side within the projection area R of the front windshield 10 when the host vehicle turns left. Also, the HCU 20 may be configured to display the non-superimposed content 102 directed to the right in the projection area R of the front windshield 10 when the host vehicle turns right. Also, the HCU 20 may be configured to display the non-superimposed content 102 on the right end side within the projection area R of the front windshield 10 when the own vehicle turns right.

Further, the HCU 20 may be configured not to execute the process of deleting the virtual image content 100 when the line of sight of the driver identified or estimated by the DSM 22 is directed toward the traveling direction of the host vehicle.

The display form example illustrated in FIG. 5 is an example of a display form in which the driving assistance related information represented by the virtual image content 100 erased by the erasing process is displayed on a display section different from the front windshield 10 . That is, when the HCU 20 executes the erasing process of erasing the arrow mark M1, which is an example of the superimposed content 101, the driving assistance related information represented by the arrow mark M1 erased by the erasing process, in this case, the vehicle's position on the guidance route. Information indicating that the direction of travel is to the left is displayed on the meter system display section 7 . In this case, the HCU 20 displays an arrow mark M3 on the liquid crystal display section of the meter system display section 7 to indicate that the traveling direction of the vehicle on the guidance route is leftward.

The display form example illustrated in FIG. 6 is an example of a display form in the case of executing the highlighting process of emphasizing and displaying an object present in the traveling direction of the host vehicle. That is, the HCU 20 executes the highlighting process, for example, when the erasing process of the superimposed content 101 is completed. In this highlighting process, the HCU 20 highlights and displays a pedestrian crossing, which is an example of an object present in front of the vehicle in the traveling direction, by surrounding it with the highlighting mark M4.

Note that such a highlighting process may be executed while the superimposed content 101 erasing process is being executed, or may be executed before the superimposed content 101 erasing process is started. Further, as for the mode of highlighting, for example, the highlighting effect may be further enhanced by lighting, blinking, deforming, or changing the color of the highlighting mark M4. In addition, the mode of highlighting is not limited to the highlighting by the highlighting mark M4. Various modes are conceivable, such as projecting virtual image content that changes the color of the portion to be superimposed on the object to be emphasized.

The display form example illustrated in FIG. 7 is a display in the case of executing the moving process of moving the virtual image content 100 projected in the projection area R of the front windshield 10 toward the traveling direction of the own vehicle on the guidance route. It is an example of a form. That is, in an example of the movement process illustrated in FIG. 7, the HCU 20 moves the arrow mark M2 displayed after the arrow mark M1 is erased from the right side to the left side. The HCU 20 thus moves the leftward arrow mark M2 from right to left, thereby guiding the driver's line of sight in the traveling direction of the vehicle on the guidance route, in this case leftward. For example, when the traveling direction of the own vehicle on the guidance route is the right direction, the HCU 20 moves the arrow mark pointing in the right direction from the left side to the right side to shift the driver's line of sight from the guidance route. The direction of travel of the own vehicle, in this case, may be guided in the right direction.

Also, the display form illustrated in FIG. It is an example of a display form. That is, in one example of the movement process illustrated in FIG. 8, the HCU 20 displays the label L1 after the process of erasing the arrow mark M1. In this case, the label L1 is displayed in the lower left portion of the projection area R of the front windshield 10, and the pattern appears to flow from the right side to the left side as indicated by the arrow V. It's becoming By displaying such a label L1, the HCU 20 guides the driver's line of sight to the traveling direction of the host vehicle on the guidance route, in this case to the left. In addition, by displaying such a label L1, even if the own vehicle approaches the intersection and the exit destination from the intersection deviates from the projection area R, the driver can control the own vehicle based on the label L1. can be easily recognized in which direction the should be advanced.

For example, when the traveling direction of the host vehicle on the guidance route is to the right, the HCU 20 displays a label whose pattern appears to flow from left to right within the projection area R of the front windshield 10. By displaying it in the lower part, the driver's line of sight may be guided in the traveling direction of the host vehicle on the guide route, in this case, in the right direction. In addition, the label L1 is not limited to a label that looks like a flowing pattern. It may be one that has been changed, or one that does not change the pattern or the like.

The display mode example illustrated in FIG. 9 is an example of a display mode when the arrow mark M5, which is an example of the superimposed content 101, is erased. That is, as illustrated in FIG. 9, the HCU 20 gradually erases the arrow mark M5 along the traveling direction of the host vehicle on the guidance route. In this way, the arrow mark M5 is gradually erased as the vehicle advances, so that the driver can read the driving support-related information indicated by the arrow mark M5, in this case, along the traveling direction of the vehicle on the guidance route. It is possible to visually or sensuously recognize that the own vehicle is traveling.

According to the present embodiment, when the driver recognizes the intention of the driving assistance related information represented by the superimposed content 101 projected in the projection area R of the front windshield 10, the driver's line of sight is changed to the driving assistance related information. Information other than information, in this case, can be guided to turn to the actual situation outside the vehicle, thereby suppressing unnecessarily guiding the driver's line of sight into the projection area R of the front windshield 10. be able to.

Further, according to the present embodiment, the HCU 20 performs erasing processing to erase the superimposed content 101 projected within the projection area R of the front windshield 10 so as to guide the driver's line of sight in the traveling direction of the vehicle. It is possible. That is, by erasing the superimposed content 101 from within the projection area R of the front windshield 10, it is possible to further prevent the driver's line of sight from being unnecessarily guided into the projection area R of the front windshield 10.

Further, according to the present embodiment, the HCU 20 can display the driving assistance related information represented by the superimposed content 101 deleted by the deletion process on a display section of the HUD 230 different from the front windshield 10 . As a result, the driver can reconfirm the driving assistance related information represented by the deleted superimposed content 101 as necessary. Note that the display section of the HUD 230 that is different from the front windshield 10 is not limited to the meter system display section 7. For example, any display section mounted on the vehicle, such as a display section of a navigation device, can be applied as appropriate. can do.

Further, according to the present embodiment, the HCU 20 can prevent the erasing process from being executed when the driver's line of sight is already in the traveling direction of the host vehicle on the guidance route. That is, if the driver's line of sight is already in the traveling direction of the vehicle on the guidance route, the necessity of intentionally erasing the superimposed content 101 from the front windshield 10 of the HUD 230 is reduced. Therefore, unnecessary deletion of the superimposed content 101 from the front windshield 10 of the HUD 230 can be avoided. It should be noted that the HCU 20 may be configured to execute the erasing process even when the driver's line of sight is directed toward the traveling direction of the host vehicle on the guidance route.

Further, according to the present embodiment, the HCU 20 can execute a highlighting process for emphasizing and displaying an object that actually exists in front of the host vehicle in the traveling direction. This makes it easier for the driver to recognize an object that actually exists in front of the vehicle in the direction of travel and should be noted. Objects to be highlighted are not limited to pedestrian crossings, and can be various objects such as people, preceding vehicles, bicycles, traffic lights, and obstacles. Such an object can be detected by, for example, the surroundings monitoring sensor 4, and the object to be highlighted should be appropriately selected and emphasized.

Further, according to the present embodiment, the HCU 20 displays the virtual image content 100 projected on the front windshield 10 so as to guide the driver's line of sight in the traveling direction of the vehicle on the guidance route. It is possible to execute movement processing for moving in a direction. By moving the virtual image content 100 in this manner, the driver can more easily recognize the intention of the information represented by the virtual image content 100, for example, the intention of whether the host vehicle is to proceed leftward or rightward. can do.

Note that the present disclosure is not limited to the above-described embodiment, and can be appropriately modified and expanded without departing from the scope of the present disclosure. For example, the shape, size, thickness, etc. of the virtual image content 100 projected onto the front windshield 10 can be changed and set as appropriate.

Various methods can be applied to determine whether or not the driver has recognized the intention of the driving assistance related information represented by the virtual image content 100 projected on the front windshield 10 . That is, for example, when the driving support related information represented by the virtual image content 100 is the route guidance related information indicating that the vehicle is traveling in the left direction on the guidance route, the turn signal of the vehicle is operated to turn left. that the steering of the own vehicle is operated in the left direction; that the DSM 22 detects that the driver's line of sight is directed to the left in the traveling direction of the own vehicle; and that the vehicle position specified by the ADAS locator 3 It can be determined that the driver has recognized the intention of the driving support related information represented by the virtual image content 100 on the condition that it is confirmed that the vehicle is traveling in the left turn lane based on the above. Even if the driving support related information represented by the virtual image content 100 is information other than the route guidance related information, such as automatic driving related information, lane information, curve notification information, etc., whether the intention of the information was recognized by the driver. Whether or not it is determined can be determined based on, for example, the operation state of the turn signals, the operation state of the steering wheel, the line of sight of the driver, the operation state of various operation buttons provided in the vehicle interior, and the like.

That is, various methods can be applied to the determination processing by the determination unit 53 as long as the method can determine whether or not the intention of the driving support related information represented by the virtual image content 100 is recognized by the driver. Further, the guidance processing by the guidance unit 54 can employ various methods as long as they can guide the driver's eyes toward information other than the driving support related information. The information other than the driving support related information is not limited to the actual scenery outside the vehicle, and various information other than the driving support related information represented by the virtual image content 100 can be applied.

Although the present disclosure has been described with reference to examples, it is understood that the present disclosure is not limited to such examples or structures. The present disclosure also includes various modifications and modifications within the equivalent range. In addition, various combinations and configurations, as well as other combinations and configurations, including single elements, more, or less, are within the scope and spirit of this disclosure.

Also, the controller and techniques described in this disclosure may be implemented by a dedicated computer provided by configuring a processor and memory programmed to perform one or more functions embodied by the computer program. , may be implemented. Alternatively, the controls and techniques described in this disclosure may be implemented by a dedicated computer provided by configuring the processor with one or more dedicated hardware logic circuits. Alternatively, the control units and techniques described in this disclosure can be implemented by a combination of a processor and memory programmed to perform one or more functions and a processor configured by one or more hardware logic circuits. It may also be implemented by one or more dedicated computers configured. The computer program may also be stored as computer-executable instructions on a computer-readable non-transitional tangible recording medium.

In the drawing, 7 is a meter system display unit (a display unit different from the projection unit), 10 is a front windshield (projection unit), 20 is an HCU (vehicle display control unit), 53 is a determination unit, 54 is a guidance unit, 230 indicates a head-up display.

Claims (7)

A vehicle display control device (20) for controlling a head-up display (230) that projects virtual image content representing driving support-related information related to driving support of a vehicle on a projection unit (10),
a determination unit (53) that determines whether or not the intention of the driving assistance related information represented by the virtual image content projected on the projection unit is recognized by the driver;
a guiding unit (54) for guiding the driver's line of sight to information other than the driving support-related information when the determining unit determines that the intention of the driving support-related information has been recognized by the driver;
with
The display control for a vehicle, wherein the guidance unit is capable of executing movement processing for moving the virtual image content projected on the projection unit in the direction of travel of the vehicle so as to guide the line of sight of the driver in the direction of travel of the vehicle. Device. 2. The vehicle display control according to claim 1, wherein the guiding unit is capable of executing erasing processing for erasing the virtual image content projected on the projecting unit so as to guide the line of sight of the driver in the traveling direction of the vehicle. Device. 3. The vehicle according to claim 2, wherein, when executing the erasing process, the guiding part displays the driving support-related information represented by the virtual image content erased by the erasing process on a display part different from the projection part. Display controller. 4. The display control device for a vehicle according to claim 2, wherein the guide section is configured not to execute the erasing process when the line of sight of the driver is in the traveling direction of the vehicle. 5. The vehicle display control device according to any one of claims 1 to 4, wherein the guidance unit is capable of executing a highlighting process of highlighting and displaying an object present in front of the vehicle in the traveling direction. A vehicle display control method for controlling a head-up display (230) that projects virtual image content representing driving support-related information related to vehicle driving support on a projection unit (10),
Determination processing for determining whether or not the intention of the driving support-related information represented by the virtual image content projected on the projection unit has been recognized by the driver;
Guidance processing for guiding the driver's line of sight to information other than the driving support-related information when it is determined in the determination processing that the intention of the driving support-related information has been recognized by the driver;
including
In the guidance processing, display control for a vehicle is capable of executing movement processing of moving the virtual image content projected on the projection unit in the direction of travel of the vehicle so as to guide the line of sight of the driver in the direction of travel of the vehicle. Method. the computer,
Vehicle display control for functioning as a vehicle display control device (20) for controlling a head-up display (230) that projects virtual image content representing driving support related information related to vehicle driving support on a projection unit (10) a program,
Determination processing for determining whether or not the intention of the driving support-related information represented by the virtual image content projected on the projection unit has been recognized by the driver;
Guidance processing for guiding the driver's line of sight to information other than the driving support-related information when it is determined in the determination processing that the intention of the driving support-related information has been recognized by the driver;
causing said computer to execute
In the guiding process, it is possible to cause the computer to execute a moving process of moving the virtual image content projected on the projection unit in the traveling direction of the vehicle so as to guide the line of sight of the driver in the traveling direction of the vehicle. A vehicle display control program.

Images