JP2019043175A - Head-up display device - Google Patents

Abstract

To provide a head-up display device which can display an image suitable for an operation mode.SOLUTION: An HUD device 100 is mounted on a vehicle 1 which is set to any one operation mode of an automatic operation mode and a manual operation mode, and displays a virtual image on a windshield. The HUD device 100 comprises an image processing part 111a which displays an automatic operation image containing a vehicle information image and an entertainment image as a virtual image when the operation mode is set to the automatic operation mode.SELECTED DRAWING: Figure 2

Description

  The present invention relates to a head-up display device.

2. Description of the Related Art A head-up display (HUD) device is conventionally known that displays a virtual image by emitting display light to a projection member such as a windshield or a combiner. For example, in the HUD device described in Patent Document 1, an entertainment (entertainment) information image and a vehicle information image are displayed as a virtual image.
Also, in recent years, an automatic driving technology that can automatically travel even if a human does not perform a driving operation has attracted attention. For example, the vehicle described in Patent Document 2 is configured to be able to switch the operation mode between the automatic operation mode and the manual operation mode.

JP 2012-81907 A JP, 2017-075840, A

  When the HUD device described in Patent Document 1 is mounted on the vehicle described in Patent Document 2, how to display the entertainment image and the vehicle information image according to the driving mode of the vehicle is optimal It was unknown.

  The present invention has been made in view of the above-described circumstances, and an object thereof is to provide a head-up display device capable of displaying an image suitable for the operation mode.

  In order to achieve the above object, the head-up display device of the present invention is a head-up display device mounted on a vehicle set to either an automatic operation mode or a manual operation mode and displaying a virtual image on a windshield. And an image processing unit configured to display an automatic driving image including a vehicle information image and an entertainment image as the virtual image when the driving mode is set to the automatic driving mode.

  According to the present invention, the head-up display device can display an image suitable for the operation mode.

FIG. 1 is a schematic view of a vehicle equipped with a HUD device according to a first embodiment of the present invention. It is the schematic which shows the structure of the HUD apparatus which concerns on the 1st Embodiment of this invention. It is a flowchart which shows the procedure of the display process of the HUD apparatus which concerns on the 1st Embodiment of this invention. It is a front view showing a manual driving picture concerning a 1st embodiment of the present invention. It is a front view which shows the 1st autonomous driving picture concerning a 1st embodiment of the present invention. It is a front view which shows the 2nd autonomous driving picture concerning a 1st embodiment of the present invention. It is a front view which shows the 3rd autonomous driving picture concerning a 1st embodiment of the present invention. It is a front view which shows the image switching preparation image which concerns on the 1st Embodiment of this invention. It is a flowchart which shows the procedure of the image switching process of the HUD apparatus which concerns on the 1st Embodiment of this invention. It is a flowchart which shows the procedure of the display process of the HUD apparatus which concerns on the 2nd Embodiment of this invention. It is a front view which shows the 4th autonomous driving picture concerning a 2nd embodiment of the present invention. It is a front view which shows the 5th autonomous driving | operation image which concerns on the 2nd Embodiment of this invention. It is a front view which shows the 6th autonomous driving picture concerning a modification of the present invention.

First Embodiment
A first embodiment of a vehicle equipped with a HUD (head-up display) device, which is an in-vehicle display device according to the present invention, will be described with reference to FIGS. 1 to 7.

  As shown in FIG. 2, the vehicle 1 includes a HUD device 100, an on-board ECU (Electronic Control Unit) 50, a car navigation (car navigation) system 60, and a manual driving intention detection unit 70.

  As shown in FIG. 1, the HUD device 100 is built in the dashboard 5 of the vehicle 1. The HUD device 100 generates display light L and emits the generated display light L toward the windshield 3. The display light L is reflected by the windshield 3 and reaches the driver 2 of the vehicle 1. As a result, the driver 2 can visually recognize the virtual image V superimposed on the real view through the windshield 3. The virtual image V is displayed on a virtual display surface A perpendicular to the road surface 8 when viewed from the driver 2.

  As shown in FIG. 2, the HUD device 100 includes a control unit 110, a display unit 120, a plane mirror 131, a concave mirror 132, a housing 140, and a light transmitting unit 141.

  The housing 140 is formed in a box shape, for example, of a light shielding material. In the housing 140, the display unit 120, the flat mirror 131, and the concave mirror 132 are accommodated. An opening 140 a through which the display light L passes is formed in the housing 140. Although the control unit 110 is provided outside the housing 140 in this example, the control unit 110 may be housed in the housing 140.

  The light transmitting portion 141 is made of a light transmitting resin such as acrylic, and is provided to close the opening 140 a of the housing 140. The light transmitting portion 141 is formed in, for example, a curved shape in order to suppress reflection of the external light that has arrived toward the driver 2.

  As shown in FIG. 2, the display unit 120 includes, for example, a light source 121 made of an LED (Light Emitting Diode), and a display element 122 that generates display light L based on light from the light source 121. The display unit 120 emits the display light L representing the generated image toward the plane mirror 131.

  The display element 122 is a reflective display element such as a DMD (Digital Micro Mirror Device) or a transmissive display element such as a TFT (Thin Film Transistor) liquid crystal panel.

  The plane mirror 131 is composed of a base material made of a synthetic resin, a glass material or the like, and a reflective film formed on the surface of the base material by vapor deposition or the like. The flat mirror 131 reflects the display light L from the display unit 120 toward the concave mirror 132.

  The concave mirror 132 is formed in a curved concave shape, and includes, for example, a base made of a synthetic resin material, and a reflective film formed on the surface of the base by vapor deposition or the like. The concave mirror 132 reflects the display light L toward the windshield 3. The display light L reflected by the concave mirror 132 passes through the light transmitting portion 141 of the housing 140 and reaches the windshield 3. The display light L that has reached the windshield 3 is reflected toward the driver 2 and reaches the driver 2. Thus, the driver 2 visually recognizes the virtual image V.

  The manual driving intention detecting unit 70 detects whether the driver 2 has an intention to perform the manual driving, and outputs the detection results to the control unit 110 as signals I71, I72, I73, and I74. Specifically, the manual driving intention detection unit 70 includes a contact detection unit 71, a seat position detection unit 72, an on-vehicle camera 73, and a biological information detection unit 74.

  The contact detection unit 71 detects whether there is a touch on a driving operation unit (steering, accelerator pedal or brake pedal) (not shown) operated during manual driving, and controls a detection signal I71 including the detection result. Output to the part 110. For example, the contact detection unit 71 is configured of a touch sensor or a pressure sensor provided in the driving operation unit. The contact detection unit 71 is not limited to a touch sensor or a pressure sensor, and may be an operation detection sensor that detects an operation amount of the driving operation unit. The operation detection sensor is, for example, an accelerator position sensor, a brake position sensor, a steering angle sensor, or a torque sensor (not shown). In this case, the contact detection unit 71 detects a minute operation amount associated with the driver 2 touching the driving operation unit.

  The seat position detection unit 72 detects the position of the driver's seat in the front-rear direction of the vehicle 1 or the angle of the backrest of the driver's seat, and outputs a detection signal I72 including the detection result to the control unit 110.

  The on-vehicle camera 73 captures an image of the driver's face, and outputs the captured image signal I 73 to the control unit 110.

  The biological information detection unit 74 detects the brain waves, heart beat, or muscle movement of the driver 2 and outputs a detection signal I 74 including the detection result to the control unit 110. The biological information detection unit 74 is provided, for example, in a wearable terminal (not shown) attached to the arm, leg, head or the like of the driver 2. In this case, the living body information detection unit 74 may transmit the detection signal I74 to the control unit 110 as a wireless signal.

  The control unit 110 includes a microcomputer and the like. Specifically, the control unit 110 includes a processing unit 111 including a central processing unit (CPU) and the like, and a memory 112 including a read only memory (ROM) and a random access memory (RAM).

  The memory 112 stores an operation program for executing display processing and the like to be described later, and original image data used to generate an image to be displayed on the display unit 120.

The processing unit 111 executes the operation program stored in the memory 112 to perform display processing according to a flowchart to be described later. The processing unit 111 is configured to be able to communicate with an on-board ECU (Electronic Control Unit) 50 via a CAN (Controller Area Network). For example, the processing unit 111 acquires vehicle information I such as the driving mode information Im, the vehicle speed information Is, the remaining fuel information If, the yaw rate information Iy, and the proximity distance information Ia from the in-vehicle ECU 50.
The driving mode information Im is information indicating whether the vehicle 1 is set to an automatic driving mode or a manual driving mode. For example, when set to the manual operation mode, the automatic operation level is level 0 or level 1. At level 0, the driver always operates all main control systems (acceleration, steering, braking). At Level 1, the system assists with any one of acceleration, steering and braking. Also, for example, the automatic driving level when the automatic driving mode is set is level 3 or more. At level 3, the system accelerates, steers and brakes only in limited environments or traffic conditions, and the driver responds when the system requests it.

  The proximity distance information Ia is information indicating the proximity distance from the vehicle 1 to an object present around the vehicle 1, and any of the devices mounted on the vehicle 1 is generated using a stereo camera, a millimeter wave radar, etc. Ru. The vehicle speed information Is is information indicating the speed of the vehicle 1 and is generated based on the detection result of a vehicle speed sensor (not shown). The remaining fuel information If is information indicating the remaining amount of fuel of the vehicle 1 and is generated based on the detection result of a remaining fuel detection sensor (not shown). The yaw rate information Iy is information indicating the angular velocity of the vehicle 1 and is generated based on the detection result of a yaw rate sensor (not shown).

  Further, the processing unit 111 acquires the entertainment information Ie from the car navigation system 60. The car navigation system 60 includes a TV (TV) tuner 60a, and outputs a video signal received through the TV tuner 60a to the processing unit 111 as the entertainment information Ie.

The processing unit 111 has an image processing unit 111a, a real scene recognition necessity determination unit 111b, a vehicle information importance degree determination unit 111c, and a manual driving intention determination unit 111d as functions.
The image processing unit 111a generates an image (for example, a manual driving image Q, an automatic driving image P, and an image switching preparation image R described later) and then causes the display element 122 to display the image. Thus, this image is displayed on the display surface A as a virtual image V.
The real scene recognition necessity determination unit 111b determines whether or not the driver 2 of the vehicle 1 needs to visually recognize the real scene through the windshield 3.
The vehicle information importance level determination unit 111c determines whether the importance level of the vehicle information I has increased.
The manual driving intention determination unit 111d determines whether the driver 2 has an intention to perform the manual driving. Specific processing contents of the real scene recognition necessity determination unit 111b, the vehicle information importance degree determination unit 111c, and the manual driving intention determination unit 111d will be described later.

  Next, the display processing for displaying the virtual image V performed by the control unit 110 (processing unit 111) will be described with reference to the flowchart in FIG. This display process is repeatedly performed when the ignition of the vehicle 1 is turned on.

  First, based on the driving mode information Im from the on-board ECU 50, the control unit 110 determines whether the driving mode of the vehicle 1 is set to the automatic driving mode (step S101). When control unit 110 determines that the operation mode of vehicle 1 is not set to the automatic operation mode (step S101: NO), it is assumed that the manual operation mode is set, and the manual operation is performed as virtual image V via image processing unit 111a. The driving image Q is displayed (step S102), and the process according to the flowchart is ended. Therefore, when the manual operation mode is set, the processes according to steps S101 and S102 are repeated, and the display of the manual operation image Q is continued.

The manual driving image Q includes a first vehicle information image C1, which is a vehicle information image C displaying vehicle information, as shown in FIG. Specifically, the first vehicle information image C1 includes a remaining fuel information image Ca representing the remaining amount of fuel by a bar graph, and a vehicle speed information image Cb representing the speed of the vehicle 1 by a number.
The control unit 110 updates the vehicle speed information image Cb according to the vehicle speed information Is from the in-vehicle ECU 50, and updates the remaining fuel information image Ca according to the remaining fuel information If from the in-vehicle ECU 50.

  On the other hand, when the control unit 110 determines that the driving mode of the vehicle 1 is set to the automatic driving mode (step S101: YES), the first image processing image P is a virtual image V via the image processing unit 111a. The autonomous driving image Pa is displayed (step S103).

As shown in FIG. 5, the first autonomous driving image Pa is obtained from the second vehicle information image C2 having a lower visibility than the first vehicle information image C1 of the manual driving image Q described above, and the car navigation system 60. , And the first entertainment image Da as the entertainment image D to display the entertainment information Ie.
The second vehicle information image C2 is displayed in a size smaller than the first vehicle information image C1 of the above-described manual driving image Q in order to reduce its visibility. That is, the remaining fuel information image Ca of the second vehicle information image C2 is displayed in a size smaller than the remaining fuel information image Ca of the manual driving image Q described above. Similarly, the vehicle speed information image Cb of the second vehicle information image C2 is displayed in a smaller size than the vehicle speed information image Cb of the manual driving image Q described above.
The first entertainment image Da is formed on substantially the entire area of the display surface A while overlapping the second vehicle information image C2. The second vehicle information image C2 is displayed on the side of the first entertainment image Da (in the present example, on the right side) so as not to impair the visibility of the first entertainment image Da.

After displaying the first autonomous driving image Pa in step S103, the control unit 110 causes the driver 2 to receive the windshield 3 based on the vehicle information I from the on-board ECU 50 via the real scene recognition necessity determination unit 111b. It is determined whether it is necessary to cause the real scene to be visually recognized through (step S104).
For example, the real scene recognition necessity determining unit 111b determines that the angular velocity of the vehicle 1 accompanying the turning of the vehicle 1 becomes equal to or greater than a preset angular velocity threshold based on the yaw rate information Iy, or the deceleration of the vehicle 1 based on the vehicle speed information Is When it becomes equal to or more than the deceleration threshold value set in advance, it is determined that it is necessary to make the driver 2 visually recognize the real scene (step S104: YES). On the other hand, when the angular velocity of the vehicle 1 becomes smaller than the above-mentioned angular velocity threshold or the deceleration of the vehicle 1 becomes smaller than the above-mentioned deceleration threshold, the real scene visual recognition necessity determining unit 111b causes the driver 2 to visually recognize the real scenery. It is determined that there is no need (step S104: NO).

  When the control unit 110 determines that it is necessary to cause the driver 2 to view the real scene through the windshield 3 via the real scene recognition necessity determination unit 111b (step S104: YES), the image processing unit 111a is used. The second autonomous driving image Pb, which is the autonomous driving image P in which the visibility of the entertainment image D is lower than that of the first autonomous driving image Pa, is displayed (step S105).

  The second autonomous driving image Pb is, as shown in FIG. 6, a second vehicular information image C2 identical to the second vehicular information image C2 of the first autonomous driving image Pa, and a first autonomous driving image And a second entertainment image Db, which is an entertainment image D having a smaller size than the first entertainment image Da of Pa. The second entertainment image Db is displayed so as not to overlap the second vehicle information image C2. The visibility of this second entertainment image Db is lower than that of the first entertainment image Da. As a result, when the vehicle 1 makes a sharp turn or a rapid deceleration, the driver 2 can easily view the real scene through the windshield 3.

  On the other hand, when the control unit 110 determines that it is not necessary to make the driver 2 visually recognize the real scene through the windshield 3 (step S104: NO), the process proceeds to step S106 described later without passing through the step S105. Transition.

Next, the control unit 110 determines whether the importance of the vehicle information I has increased through the vehicle information importance determination unit 111c (step S106).
For example, when the remaining fuel becomes less than the fuel threshold based on the remaining fuel information If, or when the vehicle speed becomes more than the vehicle speed threshold based on the vehicle speed information Is, the vehicle information importance level determination unit 111c It is determined that the degree has increased (step S106: YES). On the other hand, when the remaining fuel exceeds the fuel threshold or the vehicle speed is less than the vehicle speed threshold, the vehicle information importance degree determination unit 111c determines that the importance degree of the vehicle information I is not increased (step S106: NO) ).

  Then, when the control unit 110 determines that the importance of the vehicle information I has increased via the vehicle information importance determination unit 111c (step S106: YES), the first autonomous driving image via the image processing unit 111a. The third autonomous driving image Pc, which is the autonomous driving image P in which the visibility of the vehicle information image C is higher than that of Pa, is displayed (step S107), and the process according to the flowchart is ended.

The third autonomous driving image Pc is, as shown in FIG. 7, a first entertainment image Da identical to the first entertainment image Da of the first autonomous driving image Pa, and a first autonomous driving image Pa And a third vehicle information image C3 which is a vehicle information image C of a size larger than the second vehicle information image C2. Specifically, the remaining fuel information image Ca of the third vehicle information image C3 is larger in size than the remaining fuel information image Ca of the second vehicle information image C2, and the vehicle speed information image Cb of the third vehicle information image C3 is The size is larger than the vehicle speed information image Cb of the second vehicle information image C2. Thereby, the visibility of the vehicle information image C is improved.
The third autonomous driving image Pc may include a second entertainment image Db instead of the first entertainment image Da.

On the other hand, when the control unit 110 determines that the importance of the vehicle information I is not increased through the vehicle information importance determination unit 111c (step S106: NO), the flowchart does not go through the process of step S107. End the processing pertaining to
As described above, when the vehicle 1 is set to the automatic driving mode, the processing of steps S101 and S103 to S107 is repeated to obtain the first automatic driving image Pa, the second one according to the situation of the vehicle 1. Either the autonomous driving image Pb or the third autonomous driving image Pc is displayed.

  Next, the image switching process performed by the control unit 110 (processing unit 111) will be described with reference to the flowchart of FIG. The image switching process is performed after the display process described above. That is, when the ignition of the vehicle 1 is turned on, the process is repeatedly performed in the order of the display process and the image switching process.

  First, the control unit 110 determines whether or not the automatic driving image P is displayed (step S301), and when it is determined that the automatic driving image P is not displayed (step S301: NO), the control unit 110 relates to the flowchart. End the process. On the other hand, when it is determined that the automatic driving image P is displayed (step S301: YES), it is determined whether the driver 2 has an intention to perform the manual driving via the manual driving intention judging unit 111d (step S301). Step S302). The determination method of the manual driving intention determination unit 111d according to step S302 will be described later.

  When determining that there is no intention to perform the manual operation (step S302: NO), the control unit 110 ends the process according to the flowchart. On the other hand, when it is determined that there is an intention to perform the manual operation (step S302: YES), the image switching preparation image R is displayed as the virtual image V through the image processing unit 111a (step S303).

The image switching preparation image R is, as shown in FIG. 8, a second vehicle information image C2 identical to the second vehicle information image C2 of the first autonomous driving image Pa and a first autonomous driving image Pa. Image switching preparation message M1 for causing the driver 2 to recognize in advance that the second entertainment image Db, which is the entertainment image D smaller than the first entertainment image Da, and switching to the manual driving image Q (see FIG. 4) And.
The image switching preparation message M1 may be a message indicating that driving preparation has been performed by the driver 2, and is an icon indicating that switching to the manual driving image Q or that driving preparation has been performed. It is also good.

Next, the control unit 110 determines whether or not the intention to perform the manual operation continues through the manual operation intention determination unit 111d (step S304). Then, when it is determined that the intention to perform the manual operation continues (step S304: YES), the manual operation image Q (see FIG. 4) described above is displayed via the image processing unit 111a before switching to the automatic operation mode. (Step S305), the process according to the flowchart is ended.
On the other hand, when it is determined that the intention to perform the manual operation is not continued (step S304: NO), the automatic driving image P (see FIGS. 5 to 7) is displayed via the image processing unit 111a (step S306) The process according to the flowchart ends. For example, in step S306, the same automatic driving image P as the automatic driving image P displayed when YES in step S301 is displayed.
Specifically, the control unit 110 continues the intention to perform the manual operation when it is determined that the intention to perform the manual operation elapses after the set time has elapsed since the time that the control unit 110 determined that there is the intention to perform the manual operation (YES in step S302). When it is determined that there is no intention to perform the manual operation after the set time has elapsed, it is determined that the intention to perform the manual operation is not continued (step S304: NO) . This set time is a time during which the driver 2 can determine whether to continue the preparation and can act after viewing the image switching preparation image R displayed by the driver 2 preparing for the manual driving. It is set.

Next, a specific determination method of the manual driving intention determination unit 111d will be described.
The manual driving intention determination unit 111d determines whether or not there is a touch on the driving operation unit based on the detection signal I71. Here, the first condition is that the driver 2 contacts the driving operation unit.
Based on the detection signal I72, the manual driving intention determination unit 111d determines whether the driver's seat has been adjusted to a state suitable for manual driving. Here, the second condition is that the driver's seat is adjusted to a state suitable for manual operation.
Based on the image signal I73, the manual driving intention determination unit 111d determines whether the line of sight of the driver 2 is at a position suitable for manual driving. Here, a third condition is that the line of sight of the driver 2 is at a position suitable for manual driving.
Based on the detection signal I74, the manual driving intention determination unit 111d determines whether the biological information of the driver 2 is in a state suitable for manual driving. Here, the fourth condition is that the driver's biometric information is in a state suitable for manual driving.
When any one of the first condition, the second condition, the third condition, and the fourth condition is satisfied, the manual driving intention determination unit 111d determines that the driver 2 has an intention to perform the manual operation ((1) Step S302: YES or step S304: YES). On the other hand, when all the conditions of the first condition, the second condition, the third condition, and the fourth condition do not hold, the manual driving intention determination unit 111d determines that the driver 2 has no intention to perform the manual operation (step S302: NO or step S304: NO).
The manual driving intention determination unit 111d performs the manual driving on the driver 2 when a plurality of conditions among the first condition, the second condition, the third condition, and the fourth condition are satisfied. It may be determined that there is an intention.

  More specifically, for the second condition, when the manual driving intention determination unit 111d determines that the position of the driver's seat in the front-rear direction of the vehicle 1 and / or the angle of the backrest of the driver's seat is within a preset range Is determined to be in a state suitable for manual operation, and the driver's seat is suitable for manual operation when the position of the driver's seat in the longitudinal direction of the vehicle 1 and / or the angle of the backrest of the driver's seat is outside this setting range It is determined that the adjustment has not been made.

  More specifically, with regard to the third condition, the manual driving intention determination unit 111d detects the third condition of the driver 2 when the line of sight of the driver 2 detected using a known line of sight detection technique is poured on the traveling road. It is determined that the line of sight is at a position suitable for manual driving, and it is determined that the line of sight of driver 2 is not at a position suitable for manual driving if the detected line of sight of driver 2 is not focused on the traveling road. Do.

  More specifically, with regard to the fourth condition, when the manual driving intention determination unit 111d matches at least one signal waveform of the detected driver's electroencephalogram, heart rate, and muscle with the previously set driving preparation pattern, It is determined that the biological information of the driver 2 is in a state suitable for manual driving, and when this signal waveform does not match the driving preparation pattern, it is determined that the biological information of the driver 2 is not in a state suitable for manual driving . The operation preparation pattern is generated by experiment or simulation.

Next, the switching aspect of the display image accompanying the operation of the driver 2 will be described.
When the driving mode of the vehicle 1 is set to the automatic driving mode, the first automatic driving image Pa shown in FIG. 5 is displayed. Therefore, at this time, the driver 2 can view the first entertainment image Da of the first autonomous driving image Pa. Then, the driver 2 prepares for manual operation such as contact with the driving operation unit. Thus, the image switching preparation image R shown in FIG. 8 is displayed. The driver 2 looks at the image switching preparation image R, and continues to prepare for manual driving such as contact with the driving operation unit when there is an intention to actually perform manual driving. Thereby, the manual driving image Q shown in FIG. 4 is displayed. Thereafter, when the driver 2 performs a switching operation to the manual driving mode, the driving mode of the vehicle 1 is switched to the manual driving mode. The switching operation to the manual operation mode may be performed by operating a dedicated operation mode switching switch or operating the operation operation unit with a larger operation amount than in the case of contact. On the other hand, when the driver 2 sees the image switching preparation image R and does not intend to actually perform the manual operation, the driver 2 stops the preparation of the manual operation such as contact with the driving operation unit. For example, the driver 2 releases the steering wheel. As a result, the automatic driving mode is continued, and the display returns to the first automatic driving image Pa shown in FIG. Thus, the driver 2 can continue viewing the first entertainment image Da of the first autonomous driving image Pa.

(effect)
According to the first embodiment described above, the following effects can be obtained.

(1-1) The HUD device 100 is mounted on the vehicle 1 set to either the automatic operation mode or the manual operation mode, and displays the virtual image V on the windshield 3. The HUD device 100 includes an image processing unit 111a that displays the automatic driving image P including the vehicle information image C and the entertainment image D as a virtual image V when the driving mode is set to the automatic driving mode.
According to this configuration, it is possible to realize the autonomous driving image P suitable for the autonomous driving mode. Specifically, by displaying the entertainment image D in the automatic driving mode, the line of sight of the driver 2 can be easily focused on the windshield 3 even during automatic driving. Therefore, the driver 2 is likely to notice a change around the vehicle 1 and a change in the vehicle information image C during automatic driving. Further, even when the automatic driving mode is switched to the manual driving mode, the driver 2 can start the manual driving smoothly without moving the eyes from the windshield 3.

(1-2) The HUD device 100 includes the real scene visual recognition necessity determination unit 111b that determines whether the driver 2 of the vehicle 1 needs to visually recognize the real scene through the windshield 3. The image processing unit 111a reduces the visibility of the entertainment image D of the autonomous driving image P when it is determined that the driver 2 needs to visually recognize the real scene through the windshield 3 by the real scene visual recognition necessity determination portion 111b. .
According to this configuration, in a situation where the driver 2 needs to view the real view, as shown in FIG. 6, the visibility of the entertainment image D is lowered, so that the driver 2 can get the real view through the windshield 3 Makes it easy to see

(1-3) The HUD device 100 includes the vehicle information importance level determination unit 111c that determines whether the importance level of the vehicle information I has increased. The image processing unit 111a increases the visibility of the vehicle information image C with respect to the entertainment image D when the vehicle information importance determination unit 111c determines that the importance of the vehicle information I has increased.
According to this configuration, when the degree of importance of the vehicle information I is increased, as shown in FIG. 7, the visibility of the vehicle information image C is increased, whereby the vehicle information image C is more surely viewed.

(1-4) The image processing unit 111a displays the entertainment image D so as to overlap the vehicle information image C in the automatically driving image P.
According to this configuration, since the entertainment image D can be displayed large, the visibility of the entertainment image D can be increased.

(2-1) The HUD device 100 is an example of a vehicle-mounted display device, and is mounted on the vehicle 1 set to either the automatic operation mode or the manual operation mode. When it is determined that the manual driving intention determination unit 111d determines that the HUD device 100 has the intention to perform the manual driving, and the manual driving intention determining unit 111d determines that the HUD device 100 has the intention to perform the manual driving. And an image processing unit 111a for displaying a manual driving image Q displayed in the manual driving mode.
According to this configuration, the manual driving image Q is displayed when it is determined that the driver 2 has the intention to perform the manual driving. The driver 2 may recognize important information (vehicle information, real view, etc.) in manual driving as in the manual driving mode by visually recognizing the manual driving image Q before switching to the manual driving mode. it can. Therefore, in a state where the driver 2 is ready for the manual driving, the driving mode of the vehicle 1 can be switched to the manual driving mode, and the driver 2 can smoothly start the manual driving.

(2-2) The image processing unit 111a displays an image switching preparation image R that causes the driver 2 to recognize switching to the manual driving image Q when the manual driving intention determination unit 111d determines that there is the intention. After displaying the image switching preparation image R, when it is determined that the intention to perform the manual operation is continued by the manual driving intention determination unit 111d, the manual driving image Q including the vehicle information image C is displayed.
According to this configuration, the display is switched to the manual operation image Q only when the intention to perform the manual operation continues. Therefore, the display can be switched to the manual driving image Q in a state in which the driver 2 has the intention to perform the manual driving more reliably. Thus, the driver 2 can smoothly start the manual operation.

(2-3) After the image processing unit 111a displays the image switching preparation image R, when it is determined that the intention to perform the manual driving is not continued by the manual driving intention determination unit 111d, the image switching preparation image R , And switches the display to an autonomous driving image P including a vehicle information image C and an entertainment image D.
According to this configuration, when the intention to perform the manual driving is not continued, the display is returned to the autonomous driving image P. Therefore, switching of the display to the manual driving image Q is suppressed even though the driver 2 does not have an intention to perform the manual driving.

(2-4) When the image processing unit 111a determines that the manual driving intention determination unit 111d has the intention to perform the manual driving, the automatic driving image from the automatically driving image P including the vehicle information image C and the entertainment image D The display is switched to a manual driving image Q in which the visibility of the entertainment image D is lower than P.
According to this configuration, the driver 2 can visually recognize the entertainment image D of the autonomous driving image P during the autonomous driving. Then, when it is determined that there is an intention to perform the manual operation, the display is switched to the manual operation image Q. At this time, since the visibility of the entertainment image D is low, the driver 2 can easily view important information in manual driving through the manual driving image Q.

(2-5) The manual driving intention determination unit 111d has a first condition that the driver 2 makes contact with the driving operation unit, and a second condition that the driver's seat is adjusted to a state suitable for manual driving. And / or at least one of a third condition that the viewpoint of the driver 2 is at a position suitable for manual driving, and a fourth condition that the biological information of the driver 2 is suitable for manual driving. When one condition is satisfied, it is determined that there is an intention to perform a manual operation.
According to this configuration, before actually performing the manual operation, it is determined whether there is an intention of the manual operation.

Second Embodiment
A second embodiment of a HUD (head-up display) device according to the present invention will be described with reference to FIGS. Hereinafter, differences from the first embodiment will be mainly described.

  First, display processing for displaying a virtual image V performed by the control unit 110 (processing unit 111) will be described with reference to the flowchart of FIG. Steps S201 to S203 are the same as steps S101 to S103 in FIG. 3 of the first embodiment, and thus the description thereof is omitted.

After displaying the first autonomous driving image Pa in step S203, the control unit 110
It is determined whether the warning icon I1 needs to be displayed (step S204).
For example, based on the proximity distance information Ia from the on-board ECU 50, the control unit 110 displays the warning icon I1 when the proximity distance from the vehicle 1 to the object (for example, the preceding vehicle) becomes equal to or less than a preset distance threshold. It is determined that it is necessary (step S204: YES). On the other hand, when the proximity distance exceeds the distance threshold, the control unit 110 determines that it is not necessary to display the warning icon I1 (step S204: NO).

  When determining that it is necessary to display the warning icon I1 (step S204: YES), the control unit 110 lowers the visibility of the entertainment image D more than the first autonomous driving image Pa, and adds the warning icon I1. The fourth autonomous driving image Pd, which is the autonomous driving image P, is displayed (step S205), and the process according to the flowchart is ended.

  As shown in FIG. 11, in addition to the second vehicle information image C2, this fourth autonomous driving image Pd is displayed with a warning icon I1 displayed so as to be superimposed on the leading vehicle 200 in proximity, and a first automatic And a third entertainment image Dc which is an entertainment image D smaller in size than the first entertainment image Da of the driving image Pa. The entertainment image Dc is displayed on a corner of the display surface A (in this example, the lower left corner of the display surface A). The warning icon I1 is displayed with “!” Inside the triangle, and is displayed in the space opened by the reduction of the entertainment image D. In the first embodiment, the remaining fuel information image Ca and the vehicle speed information image Cb are arranged in the left and right direction as viewed from the driver 2, but in the present embodiment, as viewed from the driver 2, the up and down direction Lined up.

On the other hand, when determining that it is not necessary to display the warning icon I1 (step S204: NO), the control unit 110 ends the process related to the flowchart without performing the process related to step S205.
As described above, when the vehicle 1 is set to the automatic driving mode, the process of steps S201 and S203 to S205 is repeated to select one of the first automatic driving image Pa and the fourth automatic driving image Pd. Is displayed.

(effect)
According to the second embodiment described above, the following effects can be obtained.

(1) The image processing unit 111a lowers the visibility of the entertainment image D when adding the warning icon I1 as a new warning image to the automatically driven image P.
According to this configuration, the visibility of the entertainment image D is lowered to emphasize the warning icon I1. Therefore, the warning icon I1 is more surely recognized by the driver 2.

(Modification)
In addition, the said embodiment can be implemented in the following forms which changed this suitably.

In the first and second embodiments, the entertainment information Ie is a video signal received by the TV tuner 60a. However, the entertainment information Ie is not limited to this, and as indicated by the one-dot chain line in FIG. 2, is the video signal from the video reproduction device 61 that reproduces the video stored in the storage medium such as DVD (Digital Versatile Disc). It may be a video signal wirelessly transmitted from a portable terminal 62 such as a smartphone.
Further, a communication device capable of Internet communication may be mounted on the vehicle 1. The communication device may download the entertainment information Ie via the Internet.

  In the first and second embodiments, the video is displayed as the entertainment image D. However, the present invention is not limited thereto. News such as a weather forecast or traffic jam information may be used as the entertainment image D together with the video or in place of the video. , And various information such as reproduction music information may be displayed.

In the second embodiment, as shown in FIG. 11, the visibility of the entertainment image D is reduced by reducing the size of the entertainment image D. However, the present invention is not limited to this, and as shown in FIG. 12, the fifth autonomous driving image Pe may be displayed, which is the autonomous driving image P obtained by reducing the display luminance of the entertainment image D.
Similarly, in the first embodiment, the visibility of the entertainment image D is reduced by reducing the size of the entertainment image D shown in FIG. 6 in step S105 of FIG. Alternatively, the visibility of the entertainment image D may be reduced by reducing the display brightness of the entertainment image D instead of or in conjunction with this size change.
Furthermore, in the first and second embodiments, the visibility of the entertainment image D may be reduced by turning off the display of the entertainment image D.

In the second embodiment, the control unit 110 may reduce the size of the entertainment image D or reduce the luminance of the entertainment image D as the degree of urgency transmitted to the driver 2 increases. For example, when determining that it is necessary to display the warning icon I1 (step S204: YES), the control unit 110 determines that the degree of urgency is "low", "medium", or "high" based on the vehicle information I. Determine if there is. In this example, the warning icon I1 is displayed when switching from the automatic driving mode to the manual driving mode, and the degree of urgency is determined by the remaining time until the automatic driving mode is switched to the manual driving mode. Specifically, when the remaining time exceeds the first time threshold set in advance, the control unit 110 displays the first autonomous driving image Pa shown in FIG. 5 on the assumption that the degree of urgency is “low”. . Further, when the remaining time is equal to or less than the first time threshold and exceeds the second time threshold set in advance, it is assumed that the degree of urgency is "medium", and the fourth autonomous driving image shown in FIG. Display Pd. At this time, the warning icon I1 of the fourth autonomous driving image Pd may be an icon to request the driver 2 to enter preparation for the manual driving. Further, when the remaining time is equal to or less than the second time threshold, it is assumed that the degree of urgency is "high", and the sixth autonomous driving image Pf which is the autonomous driving image P shown in FIG. 13 is displayed. The sixth autonomous driving image Pf includes a second vehicle information image C2 and a warning message M2 indicating that the autonomous driving mode is to be switched to the manual driving mode and indicating a remaining time. Since the entertainment image D is not included in the sixth autonomous driving image Pf, the driver 2 can more surely visually recognize the warning message M2.
As described above, as the degree of urgency increases, the first autonomous driving image Pa, the fourth autonomous driving image Pd, and the sixth autonomous driving image Pf are switched in order. Therefore, the driver 2 can start preparation for manual driving by ending viewing of the entertainment image D or viewing a real view.

In the second embodiment, the warning icon I1 is displayed so as to be superimposed on the approaching object, but the content indicated by the warning icon I1 and the shape of the warning icon I1 can be changed as appropriate. For example, the control unit 110 may display the warning icon I1 when the vehicle speed becomes equal to or higher than the vehicle speed threshold or when the remaining fuel becomes equal to or lower than the fuel threshold. Further, the warning icon I1 may be contents corresponding to a warning light generally mounted on a meter, such as a hydraulic pressure warning and an engine warning.
Further, the control unit 110 may acquire road guidance information from the car navigation system 60, and may display an icon indicating the traveling direction of the vehicle 1 as the warning icon I1 based on the acquired road guidance information.

  In the first and second embodiments, the vehicle information image C includes the remaining fuel information image Ca and the vehicle speed information image Cb, but one of the remaining fuel information image Ca and the vehicle speed information image Cb is used. It may be omitted, and vehicle information images other than the remaining fuel information image Ca and the vehicle speed information image Cb may be displayed. For example, as the vehicle information image C, an engine rotational speed, a shift position, road guidance information, a vehicle peripheral situation, a vehicle control situation in an automatic driving mode, or the like may be displayed.

In the first embodiment, when the control unit 110 determines that the importance of the vehicle information I has increased (step S106: YES), as shown in FIGS. 6 and 7, the second vehicle information image C2 The third vehicle information image C3 is displayed in which the sizes of the remaining fuel information image Ca and the vehicle speed information image Cb are larger than those of the remaining fuel information image Ca. However, the present invention is not limited to this, and when it is determined that the degree of importance is increased by the remaining fuel being equal to or less than the fuel threshold (Step S106: YES) When it is determined that the importance is increased because the vehicle speed is equal to or higher than the vehicle speed threshold (step S106: YES), the size of only the vehicle speed information image Cb in the second vehicle information image C2 is increased. Good. Thereby, the driver 2 can emphasize the image to be focused.
Further, the visibility of the vehicle information image C may be increased by increasing the display luminance of the vehicle information image C.

  In the first embodiment, as shown in FIG. 7, in order to increase the visibility of the vehicle information image C with respect to the entertainment image D, the size of the vehicle information image C is increased. However, the present invention is not limited to this. By lowering the visibility of D, the visibility of the vehicle information image C may be increased relatively.

In the first embodiment, whether or not it is necessary to make the driver 2 visually recognize the real scene according to step S104 is performed based on the angular velocity or the deceleration of the vehicle 1, but other than the angular velocity and the deceleration It may be For example, when snow or rain falls or fog is generated, it may be determined that it is necessary to make the driver 2 visually recognize the real scene (step S104: YES).
Further, in the first embodiment, the control unit 110 may adjust the size or the display luminance of the entertainment image D in accordance with the angular velocity or the deceleration of the vehicle 1. Specifically, the larger the angular velocity or the deceleration, the smaller the size of the entertainment image D or the lower the display luminance. Thereby, the visibility of the entertainment image D according to the behavior of the vehicle 1 can be realized.

In the first and second embodiments, the control unit 110 displays the automatic driving image P including the entertainment image D in the automatic driving mode, but the driver 2 does not use the entertainment image D. When it discriminate | determines, you may display the automatic driving | running | working image which consists only of the vehicle information image C similar to the manual driving | running | working image Q. FIG.
For example, when determining that the line of sight of the driver 2 is in focus on the entertainment image D based on the image signal I73, the control unit 110 determines that the driver 2 is using the entertainment image D. On the other hand, when the line of sight of the driver 2 deviates from the entertainment image D for the set time or more, it is determined that the entertainment image D is not used.

  In the first and second embodiments, as shown in FIG. 5, although the entertainment image D is displayed so as to overlap the vehicle information image C, the entertainment image D is displayed so as not to overlap the vehicle information image C It may be done.

  In the first and second embodiments, the manual driving intention detection unit 70 includes the contact detection unit 71, the seat position detection unit 72, the on-vehicle camera 73, and the biological information detection unit 74. Any one to three of them may be omitted. The manual driving intention detection unit 70 is not limited thereto, for example, proximity of a part (such as a finger) of the body of the driver 2 to the driving mode switching switch operated when switching from the automatic driving mode to the manual driving mode Or contact may be detected. The control unit 110 displays the image switching preparation image R when detecting proximity or contact to the operation mode changeover switch, and thereafter, continuously detects proximity or contact to the operation mode changeover switch or When the preparation for manual operation such as contact with the operation unit is detected, the display is switched from the image switching preparation image R to the manual operation image Q.

  In the first embodiment, when the control unit 110 determines that the intention to perform the manual operation is continued (step S304: YES), the manual operation image Q is displayed (step S305). However, the present invention is not limited to this, and the control unit 110 may switch the display from the image switching preparation image R to the manual driving image Q when the time for which the display period of the image switching preparation image R is preset has passed.

In the first embodiment, as shown in FIG. 8, the image switching preparation image R includes the second vehicle information image C2, the second entertainment image Db, and the image switching preparation message M1. However, at least one of the second vehicle information image C2 and the second entertainment image Db may be omitted.
Furthermore, the image switching preparation image R may omit the image switching preparation message M1, and may be the same image as the autonomous driving image P (for example, the second autonomous driving image Pb). Even in this case, when the display is switched from the first autonomous driving image Pa shown in FIG. 5 to the image switching preparation image R, the visibility of the entertainment image D is lowered. Thereby, the driver 2 can recognize in advance that the display is switched to the manual driving image Q.
Further, in the flowchart of FIG. 9, the process of displaying the image switching preparation image R according to step S303 and the process of determining whether or not the intention to perform the manual operation according to step S304 may be omitted. In this case, when control unit 110 determines that there is an intention to perform a manual operation (step S302: YES), it displays manual operation image Q (step S305) and determines that there is no intention to perform a manual operation (step S302). : NO), the display of the autonomous driving image P may be continued (step S306).

  Furthermore, in the first embodiment, the control unit 110 executes the image switching process shown in the flowchart of FIG. 9, but this image switching process may be omitted.

C Vehicle information image Ca Remaining fuel information image Cb Vehicle speed information image D Entertainment image I1 Warning icon M1 Image switching preparation message M2 Warning message Q Manual driving image Pa 1st automatic driving image Pb 2nd automatic driving image Pc 3rd automatic Driving image Pd fourth automatic driving image Pe fifth automatic driving image Pf sixth automatic driving image R image switching preparation image 1 vehicle 2 driver 3 windshield 5 dashboard 8 road surface 50 in-vehicle ECU
60 car navigation system 60a TV tuner 61 image reproduction device 62 portable terminal 100 HUD device 110 control unit 111 processing unit 111a image processing unit 111b real scene recognition necessity determination unit 111c vehicle information importance determination unit 112 memory 120 display unit 121 light source 122 display element 131 flat mirror 132 concave mirror 140 housing 140 a opening 141 light transmitting portion 200 leading vehicle

Claims (6)

A head-up display device mounted on a vehicle set to either an automatic driving mode or a manual driving mode and displaying a virtual image on a windshield,
When the driving mode is set to the automatic driving mode, the image processing unit displays an automatic driving image including a vehicle information image and an entertainment image as the virtual image.
Head-up display device. It comprises a real scene visual recognition necessity determination unit that determines whether the driver of the vehicle needs to visually recognize a real scene through the windshield.
The image processing unit reduces the visibility of the entertainment image of the autonomous driving image when it is determined by the real scene recognition necessity determining unit that the driver needs to visually recognize the real scene via the windshield.
The head-up display device according to claim 1. The vehicle information importance level determination unit determines whether the importance level of the vehicle information has increased or not.
The image processing unit increases the visibility of the vehicle information image with respect to the entertainment image when it is determined by the vehicle information importance determination unit that the importance of the vehicle information has increased.
The head-up display device according to claim 1. The image processing unit reduces the visibility of the entertainment image when adding a new warning image to the autonomous driving image.
The head-up display device according to any one of claims 1 to 3. The image processing unit reduces the size of the entertainment image or reduces the luminance of the entertainment image as the degree of urgency increases.
The head-up display device according to any one of claims 1 to 4. The image processing unit displays the entertainment image so as to overlap the vehicle information image in the autonomous driving image.
The head-up display device according to any one of claims 1 to 5.

Images