WO2018070193A1 - Head-up display device - Google Patents

Abstract

[Problem] To increase the size of the display of a head-up display device and make it easier for a driver to recognize important information. [Solution] An AR-HUD 1, wherein a vehicle information acquisition unit 10 acquires various types of vehicle information 4 that can be detected by a vehicle 2. A control unit 20 controls the display of an image to be displayed on a display region visible through a windshield 3 from the driver seat of the vehicle 2 on the basis of the vehicle information 4 acquired by the vehicle information acquisition unit 10. An image display device 30 generates an image on the basis of the instruction from the control unit 20. A display distance adjusting mechanism 40 adjusts the display distance of a virtual image with respect to a driver. The display region controlled by the control unit 20 has a first display region and a second display region located above the first display region. The first display region is a region displaying augmented reality, and the second display region is a region not displaying augmented reality.

Description

Head-up display device

The present invention relates to a technology for a head-up display device, and more particularly to a technology effective when applied to a head-up display device using AR (Augmented Reality).

In vehicles such as automobiles, a head-up display (Head-Up Display, hereinafter sometimes referred to as “HUD”) device that projects and displays information on a windshield (windshield) or the like is used. Are known.

This HUD device projects driving information such as vehicle speed and engine speed or information such as car navigation onto the windshield as described above. The driver can check information without moving the line of sight to an instrument panel incorporated in the dashboard, such as a so-called instrument panel, and the amount of movement of the line of sight can be reduced.

In recent years, some HUD devices display information for supporting safe driving such as detection of pedestrians and obstacles in addition to the above-described traveling information and car navigation information. For example, when displaying a road sign on a side road or the presence of a pedestrian, it is required to enlarge the HUD device.

In addition, about the display technique by this kind of HUD apparatus, for example, it is possible to prevent an unnecessary alarm from occurring when an approaching obstacle from the front side is detected (for example, see Patent Document 1), or a plurality of display techniques. There is one that provides information with a sense of unity between display devices to an observer so that the information can be easily recognized by the observer (see, for example, Patent Document 2).

JP 2016-91084 A Japanese Unexamined Patent Publication No. 2016-60303

If you increase the display area of the HUD in order to display a lot of information superimposed on the actual scenery outside the vehicle that can be seen through the windshield, you can display a lot of information, but on the other hand, there are always many drivers. You will feel annoyed by seeing the information.

In addition, a large amount of information is displayed on a large display screen, which may cause problems such as distraction of the driver's attention or loss of recognition of important information related to safety. .

An object of the present invention is to provide a technology that allows a driver to easily recognize important information while increasing the display area of a head-up display device.

The above and other objects and novel features of the present invention will be apparent from the description of this specification and the accompanying drawings.

Of the inventions disclosed in this application, the outline of typical ones will be briefly described as follows.

That is, a typical head-up display device projects a video on a windshield of the vehicle, and displays a virtual image superimposed on the scenery in front of the vehicle to the driver.

This head-up display device has a vehicle information acquisition unit, a control unit, a video display device, a mirror, a mirror driving unit, and a display distance adjustment mechanism. The vehicle information acquisition unit acquires various types of vehicle information that can be detected by the vehicle.

The control unit controls the display of the video displayed in the display area viewed through the windshield from the driver's seat of the vehicle based on the vehicle information acquired by the vehicle information acquisition unit. The video display device generates a video based on an instruction from the control unit.

Mirror reflects the image generated by the image display device and projects it to the windshield. The mirror driving unit changes the angle of the mirror based on an instruction from the control unit. The display distance adjustment mechanism adjusts the display distance of the virtual image for the driver.

The display area controlled by the control unit includes a first display area and a second display area that is an area above the first display area. The first display area is an area for displaying augmented reality. The second display area is an area that does not display augmented reality.

Particularly, the first display area displays the first information, and the second display area displays the second information having a lower priority than the first information. The first information is safe driving support information that is information that supports safe driving, and the second information is driving support information that is information that supports driving behavior.

Among the inventions disclosed in the present application, effects obtained by typical ones will be briefly described as follows.

(1) Information necessary for safe driving can be accurately displayed in accordance with the traveling state of the vehicle.

(2) The above (1) can contribute to safe driving.

6 is an explanatory diagram showing an outline of an example of an operation concept in AR-HUD according to Embodiment 1. FIG. 3 is a functional block diagram showing an overview of an overall configuration example of an AR-HUD according to Embodiment 1. FIG. FIG. 3 is an explanatory diagram showing an outline of an example of a hardware configuration related to acquisition of vehicle information in the AR-HUD of FIG. 2. FIG. 3 is a functional block diagram illustrating details of a configuration example of the AR-HUD in FIG. 2. It is explanatory drawing which showed the detail about the example of a structure in the control part and display distance adjustment mechanism of FIG. 3 is a flowchart showing an outline of an example of an initial operation in the AR-HUD of FIG. 3 is a flowchart showing an outline of an example of normal operation in the AR-HUD of FIG. It is the flowchart which showed the outline | summary about the example of the brightness level adjustment process which is a process of step S22 of FIG. 3 is a flowchart showing an outline of an example of a flow of processing for adjusting display contents and display method of a virtual image in the AR-HUD of FIG. 2. 10 is a flowchart showing an overview of an example of the flow of display position adjustment processing that is processing of step S233 in the display video determination / change processing of FIG. 9; FIG. 3 is an explanatory diagram illustrating an example of a display area by AR-HUD in FIG. 2. It is explanatory drawing which shows the example of a display of the guidance screen based on navigation information when the display area of FIG. 11 is expanded. It is explanatory drawing which shows an example in case there are multiple roads which can turn left when a vehicle turns left by navigation guidance. It is explanatory drawing which shows the example of a display of the guidance screen based on the navigation information when the display area in the road structure of FIG. 13 is expanded. It is explanatory drawing which shows the other example of a display of the guidance screen based on the navigation information by the enlarged display area of FIG. FIG. 12 is an explanatory diagram illustrating another example of display on the display screen using the enlarged display area of FIG. 11. FIG. 10 is an explanatory diagram showing an example of a region when a display region by AR-HUD according to the second embodiment is enlarged in a horizontal direction and a vertical direction. It is explanatory drawing which shows an example of the display in the display area expanded in the horizontal direction and the vertical direction of FIG. It is explanatory drawing which shows an example of the display in the display area following FIG. It is explanatory drawing which shows an example of the display in a 2nd display area. It is explanatory drawing which shows an example of the display following FIG. FIG. 20 is an explanatory diagram illustrating another display example of FIG. 19. FIG. 18 is an explanatory diagram illustrating an example of a cooperative display operation in a display area by the AR-HUD of FIG. It is explanatory drawing which shows an example in case the viewpoint position of the virtual image display in the upper part of the display area by examination of this inventor is near. FIG. 18 is an explanatory diagram illustrating an example of a display that reduces an increase in viewpoint movement in the upper part of the display area by the AR-HUD in FIG. 17. FIG. 18 is an explanatory diagram illustrating an example of a display for reducing oversight of a road sign in the display area by the AR-HUD of FIG. FIG. 18 is an explanatory diagram illustrating an example of display according to a road condition risk level in the display area by the AR-HUD of FIG. 17; FIG. 18 is an explanatory diagram showing an example of navigation guidance display at an intersection in the display area by the AR-HUD of FIG. 17. FIG. 18 is an explanatory diagram illustrating an example of a menu for customizing display in a display area by AR-HUD in FIG. 17.

In all the drawings for explaining the embodiments, the same members are, in principle, given the same reference numerals, and the repeated explanation thereof is omitted. In order to make the drawings easy to understand, even a plan view may be hatched.

(Embodiment 1)
Hereinafter, embodiments will be described in detail.

<AR-HUD operation concept>
FIG. 1 is an explanatory diagram showing an outline of an example of an operation concept in a HUD device (hereinafter sometimes referred to as “AR-HUD”) that realizes an AR function according to the first embodiment.

As shown in FIG. 1, the AR-HUD 1 that is a head-up display device reflects an image displayed on an image display device 30 such as a projector or an LCD (Liquid Crystal Display) by a mirror 51 or a mirror 52, The light is projected onto the windshield 3 of the vehicle 2. The mirror 51 and the mirror 52 are, for example, a free-form surface mirror or a mirror having an optical axis asymmetric shape.

The driver 5 views the image projected as a virtual image in front of the transparent windshield 3 by viewing the image projected on the windshield 3. In the present embodiment, for example, by adjusting the angle of the mirror 52, the position of the image projected on the windshield 3 is adjusted, and the display position of the virtual image viewed by the driver 5 can be adjusted in the vertical direction. is there.

It is also possible to adjust the display distance, such as displaying a virtual image near (for example, 2 to 3 m away) or distant (for example, 30 to 40 m away). Then, the AR function is realized by adjusting the display position and display distance so that the virtual image is superimposed on the scenery outside the vehicle (roads, buildings, people, etc.).

In addition, the AR-HUD 1 of the present embodiment has an enlarged display area of an image projected on the windshield 3, that is, a display area 6 shown in FIGS. 11 and 12, which will be described later. It can be displayed on the shield 3. This can be realized, for example, by increasing the area of the mirror 52 or the like. The enlargement of the display area 6 is not limited to this, and may be realized by other techniques.

<Ar-HUD configuration example>
FIG. 2 is a functional block diagram showing an overview of an overall configuration example of the AR-HUD according to the first embodiment.

As shown in FIG. 2, the AR-HUD 1 mounted on the vehicle 2 includes a vehicle information acquisition unit 10, a control unit 20, a video display device 30, a display distance adjustment mechanism 40, a mirror driving unit 50, a mirror 52, and a speaker 60. Etc. In the example of FIG. 2, the shape of the vehicle 2 is displayed like a passenger car. However, the shape is not limited to this, and can be applied as appropriate to general vehicles.

The vehicle information acquisition unit 10 includes information acquisition devices such as various sensors, which will be described later, installed in each part of the vehicle 2, detects various events that occur in the vehicle 2, and enters a traveling state at predetermined intervals. The vehicle information 4 is acquired and output by detecting and acquiring the values of various parameters.

The vehicle information 4 includes, for example, speed information and gear information of the vehicle 2, steering wheel steering angle information, lamp lighting information, outside light information, distance information, infrared information, engine ON / OFF information, inside / outside of the vehicle, as shown in the figure. Camera image information, acceleration gyro information, GPS (Global Positioning System) information, navigation information, vehicle-to-vehicle communication information, road-to-vehicle communication information, and the like may be included.

The control unit 20 has a function of controlling the operation of the AR-HUD 1 and is implemented by, for example, a CPU (Central Processing Unit) and software executed thereby. It may be implemented by hardware such as a microcomputer or FPGA (Field Programmable Gate Gate Array).

As illustrated in FIG. 2, the control unit 20 generates a video to be displayed as a virtual image by driving the video display device 30 based on the vehicle information 4 acquired from the vehicle information acquisition unit 10 and the like, and generates the image on the mirror 52. The light is projected onto the windshield 3 by appropriately reflecting it. Then, control is performed such as adjusting the display position of the virtual image display area 6 and adjusting the display distance of the virtual image.

As described above, the video display device 30 is a device configured by, for example, a projector or an LCD, and generates a video for displaying a virtual image based on an instruction from the control unit 20 and projects or displays the video. To do.

The display distance adjustment mechanism 40 is a mechanism for adjusting the distance of the displayed virtual image from the driver 5 based on an instruction from the control unit 20. The mirror driving unit 50 adjusts the angle of the mirror 52 based on an instruction from the control unit 20 and adjusts the position of the virtual image display area 6 in the vertical direction.

Speaker 60 performs audio output related to AR-HUD1. For example, voice guidance of a navigation system, voice output when notifying the driver 5 with a AR function, or the like can be performed.

FIG. 3 is an explanatory diagram showing an outline of an example of a hardware configuration relating to acquisition of the vehicle information 4 in the AR-HUD of FIG.

Here, some hardware configurations of the vehicle information acquisition unit 10 and the control unit 20 are mainly shown. The acquisition of the vehicle information 4 is performed by an information acquisition device such as various sensors connected to the ECU 21 under the control of an ECU (Electronic Control Unit) 21, for example.

These information acquisition devices include, for example, a vehicle speed sensor 101, a shift position sensor 102, a steering wheel angle sensor 103, a headlight sensor 104, an illuminance sensor 105, a chromaticity sensor 106, a distance measuring sensor 107, an infrared sensor 108, and an engine start. Sensor 109, acceleration sensor 110, gyro sensor 111, temperature sensor 112, road-to-vehicle communication wireless receiver 113, vehicle-to-vehicle communication wireless receiver 114, camera (inside the vehicle) 115, camera (outside the vehicle) 116, GPS receiver 117, And VICS (Vehicle Information and Communication Communication System: road traffic information communication system, registered trademark (hereinafter the same)) receiver 118 and the like.

It is not always necessary to provide all these devices, and other types of devices may be provided. The vehicle information 4 that can be acquired by the provided device can be used as appropriate.

The vehicle speed sensor 101 acquires speed information of the vehicle 2 in FIG. The shift position sensor 102 acquires current gear information of the vehicle 2. The steering wheel angle sensor 103 acquires steering wheel angle information.

The headlight sensor 104 acquires lamp lighting information related to ON / OFF of the headlight. The illuminance sensor 105 and the chromaticity sensor 106 acquire external light information. The distance measuring sensor 107 acquires distance information between the vehicle 2 and an external object.

The infrared sensor 108 acquires infrared information related to the presence / absence and distance of an object at a short distance of the vehicle 2. The engine start sensor 109 detects engine ON / OFF information.

The acceleration sensor 110 and the gyro sensor 111 acquire acceleration gyro information including acceleration and angular velocity as information on the posture and behavior of the vehicle 2. The temperature sensor 112 acquires temperature information inside and outside the vehicle.

The road-to-vehicle communication wireless receiver 113 and the vehicle-to-vehicle communication wireless receiver 114 are road-to-vehicle communication information received by road-to-vehicle communication between the vehicle 2 and roads, signs, signals, etc. Vehicle-to-vehicle communication information received by vehicle-to-vehicle communication with the other vehicle.

The camera (inside the vehicle) 115 and the camera (outside the vehicle) 116 capture the moving image of the situation inside and outside the vehicle, and acquire the camera image information inside the vehicle and the camera image information outside the vehicle, respectively. The camera (inside the vehicle) 115 shoots, for example, the posture of the driver 5 in FIG. By analyzing the obtained moving image, it is possible to grasp, for example, the fatigue status of the driver 5 and the position of the line of sight.

In addition, the camera (outside the vehicle) 116 photographs the surrounding situation such as the front and rear of the vehicle 2. By analyzing the obtained moving images, for example, the presence or absence of moving objects such as other vehicles and people in the vicinity, road surface conditions such as buildings and terrain, rain and snow, freezing, unevenness, and road signs, etc. are grasped It is possible.

The GPS receiver 117 and the VICS receiver 118 obtain GPS information obtained by receiving the GPS signal and VICS information obtained by receiving the VICS signal, respectively. It may be implemented as a part of a car navigation system that acquires and uses these pieces of information.

FIG. 4 is a functional block diagram showing details of the configuration example of the AR-HUD in FIG.

4 shows a case where the video display device 30 is a projector, and the video display device 30 includes, for example, each unit such as a light source 31, an illumination optical system 32, and a display element 33.

The light source 31 is a member that generates projection illumination light. For example, a high-pressure mercury lamp, a xenon lamp, an LED (Light Emitting Diode) light source, a laser light source, or the like can be used.

The illumination optical system 32 is an optical system that collects the illumination light generated by the light source 31 and irradiates the display element 33 with more uniform illumination light. The display element 33 is an element that generates an image to be projected. For example, a transmissive liquid crystal panel, a reflective liquid crystal panel, a DMD (Digital Micromirror Device) (registered trademark) panel, or the like can be used.

More specifically, the control unit 20 includes an ECU 21, an audio output unit 22, a nonvolatile memory 23, a memory 24, a light source adjustment unit 25, a distortion correction unit 26, a display element drive unit 27, a display distance adjustment unit 28, and a mirror adjustment. Each part such as the part 29 is included.

As shown in FIG. 3, the ECU 21 acquires the vehicle information 4 via the vehicle information acquisition unit 10, and records, stores, and reads the acquired information in the nonvolatile memory 23 and the memory 24 as necessary. To do.

The nonvolatile memory 23 may store setting information such as setting values and parameters for various controls. Further, the ECU 21 generates video data relating to a virtual image to be displayed as the AR-HUD 1 by executing a dedicated program.

The audio output unit 22 outputs audio information via the speaker 60 as necessary. The light source adjustment unit 25 adjusts the light emission amount of the light source 31 of the video display device 30. When there are a plurality of light sources 31, they may be controlled individually.

The distortion correction unit 26 corrects image distortion caused by the curvature of the windshield 3 by image processing when the image generated by the ECU 21 is projected onto the windshield 3 of the vehicle 2 by the image display device 30. The display element drive unit 27 sends a drive signal corresponding to the video data corrected by the distortion correction unit 26 to the display element 33 to generate an image to be projected.

When the display distance adjustment unit 28 needs to adjust the display distance of the virtual image, the display distance adjustment unit 28 drives the display distance adjustment mechanism 40 to adjust the display distance of the image projected from the image display device 30. When it is necessary to adjust the position of the virtual image display area 6 itself, the mirror adjustment section 29 changes the angle of the mirror 52 via the mirror driving section 50 and moves the virtual image display area 6 up and down.

FIG. 5 is an explanatory diagram showing details of an example of the configuration of the control unit and the display distance adjusting mechanism of FIG.

In FIG. 5, the display distance adjustment unit 28 of the control unit 20 further includes, for example, a functional liquid crystal film ON / OFF control unit 281, a lens movable unit 282, and a dimming mirror ON / OFF as each unit individually controlled by the ECU 21. It includes an OFF control unit 283, a diffusion plate movable unit 284, an optical filter movable unit 285, and the like.

Further, as hardware and devices controlled and driven by these units, the display distance adjustment mechanism 40 further includes a functional liquid crystal film 401, a lens movable mechanism 402, a light control mirror 403, a diffuser plate movable mechanism 404, and an optical. A filter movable mechanism 405 and the like are included.

Note that the AR-HUD 1 does not have to include all of these units and devices, and may include various units necessary for mounting a device to which a virtual image display distance adjustment technique is applied.

<Processing content>
FIG. 6 is a flowchart showing an outline of an example of the initial operation in the AR-HUD of FIG.

When the power of the AR-HUD 1 is turned on by turning on the ignition switch in the vehicle 2 that is stopped (S01), the AR-HUD 1 starts with the vehicle information acquisition unit 10 based on an instruction from the control unit 20. Thus, the vehicle information 4 is acquired (S02).

Then, the control unit 20 calculates a suitable brightness level based on external light information acquired by the illuminance sensor 105, the chromaticity sensor 106, and the like in the vehicle information 4 (S03), and the light source adjustment unit 25 uses the light source 31. Is set so that the calculated brightness level is obtained (S04). For example, when the outside light is bright, the brightness level is set high, and when the outside light is dark, the brightness level is set low.

Thereafter, the ECU 21 determines and generates a video to be displayed as a virtual image, for example, an initial image (S05), and performs a process of correcting the distortion by the distortion correction unit 26 for the generated video (S06). The display element 33 is driven and controlled by the element driving unit 27 to generate a projected image (S07).

Thereby, the image is projected onto the windshield 3 and the driver 5 can visually recognize the virtual image. Thereafter, the ECU 21 or the display distance adjustment unit 28 calculates and determines the display distance of the virtual image (S08), and the display distance adjustment unit 28 drives the display distance adjustment mechanism 40 to display the image projected from the video display device 30. The distance is controlled (S09).

When the start-up and start-up of each unit including the above-described series of initial operations is completed in the entire AR-HUD 1, the HUD-ON signal is output. The control unit 20 determines whether or not this signal has been received (S10). .

If not received, the HUD-ON signal is further waited for a predetermined time (S11), and the HUD-ON signal waiting process (S11) is repeated until it is determined that the HUD-ON signal is received in the process of step S10.

If it is determined in step S10 that the HUD-ON signal has been received, normal operation of the AR-HUD 1 described later is started (S12), and a series of initial operations are terminated.

FIG. 7 is a flowchart showing an outline of an example of normal operation in the AR-HUD of FIG.

In the normal operation, the basic processing flow is almost the same as the initial operation shown in FIG. First, the AR-HUD 1 acquires the vehicle information 4 by the vehicle information acquisition unit 10 based on an instruction from the control unit 20 (S21). And the control part 20 performs a brightness level adjustment process based on the external light information acquired by the illumination intensity sensor 105, the chromaticity sensor 106, etc. among the vehicle information 4 (S22).

FIG. 8 is a flowchart showing an outline of an example of the brightness level adjustment process which is the process of step S22 of FIG.

When the brightness level adjustment process is started, first, a suitable brightness level is calculated based on the acquired outside light information (S221). Then, by comparing with the currently set brightness level, it is determined whether or not the brightness level needs to be changed (S222). If no change is necessary, the brightness level adjustment process is terminated.

On the other hand, when the change is necessary, the light source adjustment unit 25 controls the light emission amount of the light source 31 to set the brightness level after the change (S223), and the brightness level adjustment process is ended. .

In step S222, even when there is a difference between the preferred brightness level calculated in step S221 and the currently set brightness level, the difference is equal to or greater than a predetermined threshold value. Alternatively, it may be determined that it is necessary to change the brightness level only.

Returning to FIG. 7, thereafter, the ECU 21 changes the video to be displayed as a virtual image from the current one as necessary based on the latest vehicle information 4 acquired in the process of step S <b> 21, and determines the changed video. Are generated (S23).

It should be noted that there are many patterns for changing the display contents based on the vehicle information 4 depending on the contents of the acquired vehicle information 4 and combinations thereof. For example, when the speed information is changed, the numerical value of the speed display that is always displayed is changed, the guidance arrow graphic is displayed / erased based on the navigation information, and the arrow shape and display position are changed. There may be various patterns, such as when doing.

After that, adjustment / correction processing is performed to maintain the visibility and appropriateness of display contents according to the traveling state of the vehicle 2.

First, when it is necessary to adjust the position of the virtual image display area 6 itself, the angle of the mirror 52 is changed via the mirror driving unit 50, and a mirror adjustment process is performed to move the virtual image display area 6 up and down ( S24). Thereafter, a vibration correction process for correcting the display position of the image in the display area 6 with respect to the vibration of the vehicle 2 is performed (S25).

Thereafter, the distortion correction unit 26 performs distortion correction processing on the adjusted / corrected image (S26), and then the display element driving unit 27 drives and controls the display element 33 to generate a projected image ( S27).

Then, the display distance adjustment unit 28 calculates and determines the display distance of the virtual image (S28), and the display distance adjustment unit 28 drives the display distance adjustment mechanism 40 to display the image projected from the image display device 30. The distance is controlled (S29).

If the power is turned off when the vehicle 2 is stopped during the series of normal operations described above, a HUD-OFF signal is output to the AR-HUD 1. It is then determined whether or not this signal has been received (S30).

If the HUD-OFF signal has not been received, the process returns to step S21, and a series of normal operations are repeated until the HUD-OFF signal is received. If it is determined that the HUD-OFF signal has been received, a series of normal operations is terminated.

Next, processing for adjusting the display contents and display method of the virtual image itself to be displayed will be described.

AR-HUD 1 adjusts the display contents and display method of the virtual image itself to be displayed according to the situation such as the scenery in front of the vehicle 2 in addition to the adjustment of the virtual image display area 6 and the adjustment of the display distance. Thereby, it is possible to superimpose a more appropriate virtual image on the front landscape in a more appropriate position and manner.

FIG. 9 is a flowchart showing an outline of an example of the flow of processing for adjusting the display content and display method of the virtual image in the AR-HUD of FIG.

The generation / display of the display contents (contents) of the virtual image in the AR-HUD 1 is performed by the process of step S05 at the initial operation of FIG. 6 and the process of step S23 at the normal operation of FIG. Here, the processing content is shown by taking the display video change / decision processing in the processing of step S23 in the normal operation of FIG. 7 as an example.

First, the ECU 21 performs standard content generation processing (S231) and event content generation processing (S232). The standard content basically refers to content such as a vehicle speed display that is always displayed in the display area 6 while the vehicle 2 is traveling.

Also, the event content refers to content such as an alert display that is displayed as necessary based on the driving situation including the scenery situation in front of the vehicle 2. In any case, a plurality of contents may be generated.

After that, the ECU 21 adjusts the display position, display color, etc. of the generated content in relation to the front landscape grasped by the camera video information (S233) and the display color adjustment process (S234). )I do.

Then, video data for display related to each adjusted content is generated (S235), and the process ends. Note that the video data generated here is projected by the display element driving unit 27 in the processing of the subsequent step S27 in FIG.

FIG. 10 is a flowchart showing an outline of an example of the flow of the display position adjustment process which is the process of step S233 in the display video determination / change process of FIG.

First, here, the camera image information outside the vehicle in the vehicle information 4 obtained in the process of step S21 in FIG. 7 is analyzed, and whether or not there is an object that should be avoided from being hidden in the scenery in front. (S3100). For example, a traffic signal, a pedestrian, a two-wheeled vehicle, a forward vehicle, and the like may be applicable in addition to a curve mirror and a road sign.

Thereafter, the current display position of each standard content and each event content generated in the processing of step S231 and step S232 of FIG. 9 is collated with the coordinates of each object (S3200). Then, it is determined whether or not the display position of each content needs to be adjusted, that is, whether or not the display of each content is an obstacle to the object (S3300). For example, the display position of the arrow graphic or alert display and the position of the curve mirror or road sign are compared by image processing or the like to determine whether or not the curve mirror or road sign is hidden.

If it is determined in step S3300 that adjustment of the display position is unnecessary, the process ends. If it is determined that the display position needs to be adjusted, the display position is adjusted and moved for the target content, and a new display position is set (S3400).

As described above, the method for determining the position to move the content is not particularly limited. Instead of or in addition to the adjustment of the position of the content, the display size of the content may be reduced so that the object is not hidden (S3500).

After making these adjustments, the process returns to step S3200 again, and the above-described series of processing is repeated until it is no longer necessary to adjust the display position of each content. Since there is a possibility that another object exists before the content is moved, it is necessary to adjust until the display position is appropriate.

Note that if this adjustment takes too long, the display cannot be performed at a timing suitable for the driver. Therefore, for example, it is preferable to adjust the display position by recognizing the position of a curve mirror or a road sign at an early stage before reaching the intersection.

Through the series of processes described above, virtual image content can be displayed in a state where the object is avoided, and the visibility of the object can be improved.

<Display example of AR-HUD>
Next, a specific display example using the AR-HUD 1 will be described.

The display example in the AR-HUD 1 described below is realized by the AR-HUD 1 executing the processes shown in FIGS. 7 to 10 described above.

FIG. 11 is an explanatory diagram showing an example of a display area by the AR-HUD 1 in FIG.

FIG. 11 schematically shows an example of the display area 6 that the driver 5 of the vehicle 2 visually recognizes from the driver's seat through the windshield 3.

FIG. 11A shows an example in which the display area 6 is not enlarged in the horizontal direction, and FIG. 11B shows an area in the horizontal direction (hereinafter, horizontal direction) with respect to the road surface. An example in the case of being enlarged is shown.

In this case, as shown by the solid line in FIG. 11B, the display area 6 is enlarged in the horizontal direction with respect to the road surface, for example, so that a virtual image is superimposed on a wider area outside the vehicle. be able to. As a result, when the display area 6 is expanded in the horizontal direction, a virtual image can be superimposed and displayed on a vehicle traveling on the opposite lane or a pedestrian on the sidewalk.

On the other hand, as shown in FIG. 11 (a), when the display area 6 is narrow in the horizontal direction, a virtual image cannot be superimposed and displayed on a car traveling in an oncoming lane or a pedestrian on a sidewalk.

FIG. 12 is an explanatory diagram showing a display example of a guidance screen based on navigation information when the display area of FIG. 11 is enlarged.

FIG. 12 schematically illustrates an example of a front landscape viewed by the driver 5 of the vehicle 2 from the driver's seat through the windshield 3 and a state of a virtual image in the display area 6 projected on the windshield 3. It is shown. The dotted line in the display area 6 indicates the display area when the display area 6 is not enlarged in the horizontal direction.

FIG. 12 shows a state in which an arrow 300, a vehicle display 301, a pedestrian display 302, and the like are superimposed on the scenery outside the vehicle in the display area 6. In addition to the icon of the instrument for displaying the vehicle speed and the like (in the figure, “30 km / h” may be referred to as “vehicle speed display” in the following), and until the vehicle 2 turns left by the guidance of the arrow 300 The distance (the character “10 m” in the figure) is displayed as a virtual image.

The arrow 300 is an arrow for instructing and navigating the traveling direction of the vehicle 2 and is displayed superimposed on the road on which the vehicle 2 is traveling. The vehicle display 301 is a display indicating that there is a running vehicle. In the example of FIG. 12, the vehicle display 301 is circular and is displayed so as to surround the vehicle 200 traveling in the oncoming lane. The shape of the vehicle display 301 is not particularly limited, and may be any shape other than a circle, such as a triangle or a quadrangle.

The pedestrian display 302 indicates that there is a pedestrian 201 walking on a sidewalk and the traveling direction of the pedestrian 201. In the example of FIG. 12, a circular pedestrian display 302 is displayed superimposed on the feet of the pedestrian 201, and the traveling direction of the pedestrian 201 is indicated by an arrow. The shape of the pedestrian display 302 is not particularly limited as in the vehicle display 301.

The arrow 300 is generated based on the navigation information acquired from the vehicle information acquisition unit 10 by the ECU 21. The vehicle display 301 and the pedestrian display 302 are generated based on camera video information and infrared information acquired by the ECU 21 from the vehicle information acquisition unit 10. The vehicle speed display is generated based on the speed information acquired by the ECU 21 from the vehicle information acquisition unit 10.

As described above, the display area 6 is expanded in the horizontal direction, so that, for example, even when the vehicle 2 is traveling straight, the pedestrian display 302 indicating the pedestrian 201, the vehicle display 301 in the oncoming lane, and the like are displayed for driving. Since the person 5 can perceive, it can contribute to safe driving.

On the other hand, when the display area 6 indicated by the dotted line in FIG. 12 is not enlarged in the horizontal direction, the display area is narrow, and thus the pedestrian 201 or the like is not included in the display area when the vehicle 2 is traveling straight. . Therefore, the display timing of the pedestrian display 302 is when the vehicle 2 turns to the left and the pedestrian 201 enters the display area indicated by the dotted line, and the timing for causing the driver 5 to detect the pedestrian 201 is delayed. It will end up.

FIG. 13 is an explanatory diagram showing an example when there are a plurality of roads that can turn left when the vehicle turns left by the navigation guidance. FIG. 14 is an explanatory diagram showing a display example of a guidance screen based on navigation information when the display area in the road configuration of FIG. 13 is enlarged.

As indicated by the solid line in FIG. 13, the virtual image display area 6 is expanded in the horizontal direction, so that a guidance display for instructing and navigating the traveling direction of the vehicle 2 can be displayed in a wider range. FIG. 13 shows a case where there are two roads that can be turned to the left at a short distance, and the vehicle 2 makes a left turn not on the road in front but on the road in the back.

When the display area 6 is not enlarged in the horizontal direction, as shown by the dotted line, the road to turn left is outside the display area and is not included in the display area. On the other hand, in the case of the display area 6 expanded in the horizontal direction, as indicated by a solid line, not only the road on which the vehicle 2 makes a left turn, but also the road that can turn left before that is included in the display area.

Therefore, as shown in FIG. 14, an arrow 300 which is a guidance display for instructing / navigating the traveling direction and the like can be displayed in a superimposed manner on the road on the far side to turn left. In addition, the display area 6 in FIG. 14 includes a vehicle speed display (characters “30 km / h” in the figure), a distance to the road to turn left (characters “20 m” in the figure), and a vehicle display 301. Is displayed as a virtual image.

Here, a left turn has been described as an example, but an arrow 300 or the like can be displayed on a right turn in a similar manner by superimposing it on a road that makes a right turn. In the example of FIG. 14, the road on the right turn side is not included in the display area 6. However, for example, when the road width on which the vehicle 2 is traveling is narrow, the road on the right turn side is also included in the display area 6. . Alternatively, the display area 6 may be further expanded in the horizontal direction so that the left-turn road is included in the display area 6.

When the display area 6 is not expanded in the horizontal direction, the dotted line range shown in FIG. 14 becomes the display area, and thus an arrow is displayed in the dotted line display area. In this case, since the road to be turned left is not included in the display area, it is not known whether the left or right road is to be turned left, and the driver 5 may be confused.

In contrast to the above, according to the AR-HUD 1 in which the display area 6 is expanded in the horizontal direction, the driver 5 can accurately grasp that he / she makes a left turn on the back road, not on the front side. This is particularly effective when there are a plurality of roads that can turn left at a short distance, or when the roads have complicated shapes.

Therefore, the road on which the vehicle 2 travels can be accurately grasped by the driver 5 and concentrated on driving without being confused, thereby contributing to safe driving.

FIG. 15 is an explanatory view showing another display example of the guidance screen based on the navigation information by the enlarged display area 6 of FIG.

FIG. 15 also schematically shows an example of the front landscape viewed from the driver's seat by the driver 5 of the vehicle 2 and the state of the virtual image in the display area 6 projected on the windshield.

FIG. 15 shows a display example when the vehicle 2 approaches before the intersection where entry is prohibited except in the designated direction.

15, a sign 202 is provided on the front left side of the vehicle 2. This sign 202 is a road sign indicating entry prohibition other than the designated direction. Therefore, at the intersection, the vehicle 2 can only travel straight ahead and cannot enter either the left-turn road or the right-turn road.

In this case, in the display area 6, an entry prohibition display 303 indicating that it is not possible to enter this road is displayed superimposed on the road on the left turn side on the road on the left side of the intersection. The entry prohibition display 303, which is a restriction instruction display, recognizes the meaning of the sign 202 and the like from the camera video information outside the vehicle acquired by the ECU 21 from the vehicle information acquisition unit 10, and is generated based on the recognition result.

Also in this case, when the display area 6 is expanded in the horizontal direction, the road on the left turn side of the intersection is included in the display area 6 and the entry prohibition display 303 can be displayed.

This makes it possible for the driver 5 to accurately grasp roads and the like that are prohibited from entering in a short time and contribute to safe driving. In addition, here, an example is shown in which the sign 202 is a road sign indicating entry prohibition other than the designated direction. However, other road signs such as a regulation sign and an instruction sign are similarly displayed according to the recognized road sign. The regulation instruction display is performed on the display area 6.

For example, if the road on the left-hand side of the intersection is one-way and there is a one-way road sign as a restriction sign, a display indicating that the road is one-way as a restriction instruction display or similar to FIG. You may make it display the entry prohibition display 303. FIG. The display such as the entry prohibition display 303 shown in FIG. 15 is particularly effective when the driver 5 misses a road sign. In addition, although an icon simulating a road sign (for example, entry prohibition other than the designated direction) can be displayed on the HUD, it is more appropriate for the driver 5 to display the entry prohibition display 303 as shown in FIG. It can be recognized that the user should not enter the road quickly. That is, the entry prohibition display 303 is displayed so as to be superimposed on the actual road, and it looks as if there is a pseudo wall, so that it can be intuitively notified that the user should not enter the road.

FIG. 16 is an explanatory view showing another display example by the enlarged display area 6 of FIG.

FIG. 16 shows a state in which the vehicle 200 is traveling in the opposite lane of the lane in which the vehicle 2 is traveling, and the vehicle 203 is traveling in front of the vehicle 2 in the lane in which the vehicle 2 is traveling. In the display area 6, a vehicle display 301 and a vehicle display 305 are displayed.

In addition, the traveling speed of the oncoming vehicle (character “30 km / h” in the figure) and the distance between the vehicle 203 traveling in front of the vehicle 2 (character “10 m” in the figure) are displayed as virtual images. Yes. The inter-vehicle distance is generated based on the distance information acquired from the vehicle information acquisition unit 10 by the ECU 21.

The vehicle display 301 is a display indicating that there is a vehicle 200 traveling in the oncoming lane, and the vehicle display 305 is a display indicating that there is a vehicle 203 traveling in front of the vehicle 2. Also here, the vehicle display 301 is formed, for example, in a circular shape so as to be superimposed so as to surround the vehicle 200. Similarly, the vehicle display 305 also has a circular shape, for example, and is displayed so as to surround the vehicle 203.

In addition, the vehicle displays 301 and 305 are color-coded, for example, so that it can be distinguished whether the vehicle is traveling in the traveling lane or the vehicle traveling in the oncoming lane, that is, the oncoming vehicle. . In FIG. 16, the color classification is represented by the presence / absence of hatching.

The vehicle displays 301 and 305 may be any display that can distinguish whether the vehicle is running ahead or on the opposite lane, for example, by changing the shape, in addition to the color coding.

According to AR-HUD1 in which the display area 6 is expanded in the horizontal direction, it is possible to display virtual images such as the arrow 300, the pedestrian display 302, the vehicle display 305, etc. even on the oncoming lane, the sidewalk, and the intersecting road. Therefore, it becomes easy to accurately grasp the course, and it becomes easy to recognize the vehicles 200 and 203 and the pedestrian 201 traveling forward or opposite, thereby contributing to safe driving.

As described above, according to the AR-HUD 1 in which the display area 6 is expanded in the horizontal direction, information necessary for safe driving can be accurately displayed without hindering driving, thereby contributing to safe driving. .

(Embodiment 2)
<Overview>
In the first embodiment, the display technique when the display area 6 by the AR-HUD 1 is expanded in the horizontal direction has been described. In the second embodiment, the display area 6 is not only displayed in the horizontal direction but also on the road surface. On the other hand, a display technique when enlarged in the vertical direction (hereinafter referred to as the vertical direction) will be described.

Note that the apparatus configuration and basic operation of the AR-HUD 1 are the same as those in the first embodiment described above, and thus the description thereof is omitted.

The display area 6 by the AR-HUD 1 extends not only in the horizontal direction but also in the vertical direction, thereby increasing the amount of information that can be displayed in the vertical direction. Therefore, it is assumed that the traffic assistance information that is the second information is displayed in the upper part of the display area 6, and the priority information that is the first information is displayed in the lower part of the display area 6.

Traffic assistance information is information that assists driving operations such as traffic jam information, road information, or intersection information. The traffic jam information is information indicating the traffic jam status on the road. The road information is information indicating a lane change, for example. The intersection information is information such as the name of the intersection.

Also, the priority information is information related to the driving operation prioritized over the traffic assistance information, for example, the situation of other vehicles, pedestrians, road alignment, etc., which is displayed as a virtual image superimposed on the real scene.

<Display example of AR-HUD>
FIG. 17 is an explanatory diagram showing an example of a region when the display region 6 by the AR-HUD 1 according to the second embodiment is expanded in the horizontal direction and the vertical direction.

In FIG. 17 (a), when the display area 6 is expanded in the horizontal direction and the vertical direction, in addition to the display area 6 expanded in the horizontal direction in the first embodiment, there is a room for information display newly in the upper and lower parts. Will be born. The area indicated by hatching in FIG. 17A is a new display area created by further expanding the display area 6 expanded in the horizontal direction in the vertical direction.

The area close to the upper end of the display area 6 in which the display area 6 is expanded not only in the horizontal direction but also in the vertical direction is a part that hits the scenery such as the sky and buildings that are not so much related to the driving operation from the viewpoint of the driver 5. .

On the other hand, the area below the upper part of the display area 6 (the lower part of the display area 6) is an area where the driver 5 obtains real scene information directly connected to the driving operation such as roads, traffic conditions, or road signs.

Here, the upper part of the display area 6 is a second display area 6a, which is indicated by hatching in FIG. 17B, and the lower part of the display area 6 is a first display area 6b, which is shown in FIG. This is an area indicated by dots in b).

Therefore, the second display area 6a displays traffic assistance information consisting of auxiliary information for assisting driving operation, information notifying the operation status of airplanes, railways, etc., information notifying incoming calls such as telephone calls and mails, and the like. At the same time, priority information that is important information directly related to the driving operation is displayed in the first display area 6b.

Here, the second display region 6a is a region in which a virtual image that is not mainly AR (Augmented Reality) is displayed, and the first display region 6b is a region in which display is mainly performed by AR. is there. In the present embodiment, as an example, the traffic assistance information displayed in the second display area 6a is a virtual image that is not AR, and the priority information displayed in the first display area 6b is a virtual image display by AR. Shall.

In addition, in the area near the lower end of the first display area 6b, not only priority information but also traffic assistance information such as the traveling speed of the vehicle 2 may be displayed. This area becomes the third display area 6c, and is an area surrounded by a dotted line in FIG. In the third display area 6c, a virtual image that is not AR is mainly displayed.

The second display area 6a for displaying the traffic assistance information and the like may be an area that does not block the information of the actual scene directly connected to the driving operation of the driver 5, and is limited to an area close to the upper end of the display area 6. It is not a thing.

For example, the second display area 6a or (and) the third display area 6c may be enlarged, and the first display area 6b may be reduced, or the second display area 6a or (and) the third display area 6c may be reduced. The display area 6c may be omitted, and all may be the first display area 6b.

When the area is enlarged or reduced, for example, the area may be enlarged or reduced based on information obtained by imaging the situation in front of the camera. That is, when the presence of a vehicle or a pedestrian is detected ahead, it is necessary to display a virtual image of the AR for the vehicle or pedestrian, so the second display area 6a or (and) the third display area Control is performed so that the first display area 6b is secured widely without enlarging 6c.

On the contrary, since it is not necessary to display a virtual image of AR when the presence of a vehicle or a pedestrian is not detected in front, the second display area 6a or (and) the third display area 6c is enlarged and the first display area 6c is enlarged. You may control to reduce the display area 6b.

Furthermore, the area may be enlarged or reduced based on the vehicle speed information. For example, the second display area 6a or (and) the third display area 6c may be enlarged when traveling at a low speed or stopping. Control to reduce the first display area 6b and eliminate the second display area 6a or (and) the third display area 6c or reduce the first display area 6b as much as possible when traveling at high speed. Good.

FIG. 18 is an explanatory diagram showing an example of display in the display area enlarged in the horizontal direction and the vertical direction in FIG. FIG. 19 is an explanatory diagram showing an example of display in the display area following FIG.

FIG. 18 (a) shows that the vehicle 2 is traveling without traffic jams, and FIG. 18 (b) shows the display area 6 during traveling in FIG. 18 (a). A display example is shown.

FIG. 19A shows that a traffic jam has occurred at the end of the traveling vehicle 2, and FIG. 19B shows a table of a display area 6 that informs that a traffic jam has occurred. An example is shown, and traffic congestion information on a road is displayed when a traffic jam occurs.

First, in the traveling state shown in FIG. 18 (a), in the second display area 6a of the display area 6, as shown in FIG. 18 (b), the sign information 310 indicating the vehicle traffic classification is a virtual image as traffic auxiliary information. Is displayed.

Subsequently, as shown in FIG. 19 (a), when it is detected that a traffic jam has occurred at the destination of the vehicle 2, as shown in FIG. 19 (b), in the second display area 6a, the sign information 310 and The traffic jam information 311 is displayed as traffic assistance information.

The sign information 310 is generated based on the camera video information acquired by the ECU 21 from the vehicle information acquisition unit 10. The traffic jam information 311 is generated based on GPS information and VICS information.

Here, the traffic assistance information such as the sign information 310 and the traffic jam information 311 is only information that assists driving and is not prioritized in the actual scene directly connected to the driving operation.

For example, when the sign information 310 and the traffic jam information 311 are displayed in an area where a real scene directly connected to the driving operation of the driver 5 can be seen, that is, in the second display area, the line of sight of the driver 5 focuses on the information. It may cause you to get out of your way. In addition, since such information is not given priority over the actual scene directly connected to the driving operation, it is not preferable to display the actual scene in an area where the actual scene can be seen to reduce the visibility of the actual scene.

On the other hand, in the display shown in FIG. 19B, the information can be read without obstructing the field of view at the time of driving that is directly connected to the driving operation and by relatively little viewpoint movement from the part of the real scene where the viewpoint is most concentrated during driving. it can. Therefore, it is possible to display traffic assistance information such as traffic jam information while reducing the distraction of the driver's attention and without deviating the viewpoint for a long time from the actual scene that should be seen when driving. Further, while the vehicle 2 is traveling, as shown in FIG. 19 (b), it is possible to reduce a driver's attention reduction by displaying only simple traffic jam information.

FIG. 20 is an explanatory diagram showing an example of display in the second display area, and FIG. 21 is an explanatory diagram showing an example of display following FIG.

FIG. 20 and FIG. 21 show display examples of guidance screens based on navigation information. Here, a case where the vehicle 2 is traveling straight and turns left at the next intersection according to navigation guidance is shown.

First, as shown in FIG. 20A, the vehicle 2 is traveling straight, and when the distance to the intersection where the vehicle turns to the left is larger than the threshold value, the second display area 6a has the second display area 6a shown in FIG. As shown, only the sign information 310 indicating the vehicle traffic classification is displayed as a virtual auxiliary image as traffic assistance information.

Here, the threshold value is a distance for determining the timing for displaying the left turn guidance screen. When the distance to the intersection to turn left reaches the threshold value, a left turn guidance screen is displayed.

After that, as shown in FIG. 21A, when the distance from the vehicle 2 to the intersection where the vehicle turns to the left is equal to or smaller than the threshold value, as shown in FIG. Guidance information 312 indicating turning left at the intersection is displayed as an AR superimposed on the traveling road as priority information. The threshold value determination process and the guidance information 312 generation process are performed based on GPS information acquired from the vehicle information acquisition unit 10 by the ECU 21.

20 and 21 show an example in which the guidance screen is switched in two steps according to one threshold value. For example, when the distance to the intersection to turn left is larger than the threshold value 1, traffic assistance information is displayed. If the threshold value is 1 or less and greater than the threshold value 2, traffic assistance information is displayed. If the threshold value is 2 or less, guidance information 312 indicating turning left at the intersection is superimposed on the road and displayed as an AR. Etc.

FIG. 22 is a diagram showing another display example of FIG.

In FIG. 19, when the vehicle 2 is traveling, only simple traffic jam information is displayed in the second display area 6 b, so that the driver 5 can see the traffic jam without blocking the actual scene directly connected to the driving operation. Although the example which alert | reports a condition is shown easily, the example of a display when the vehicle 2 stops after that is demonstrated using FIG.

When the vehicle 2 stops after receiving the traffic jam information and before reaching the traffic jam occurrence point, as shown in FIG. 22, for example, detailed traffic jam information and detour information are displayed in the second display area 6a. Detailed information 313 including proposals is displayed as traffic assistance information. Further, the detailed information 313 may be displayed so as to cover the first display area 6b when the detailed information 313 does not fit in the second display area 6a due to a large amount of information.

When the vehicle 2 is stopped, there is no problem even if the actual scene directly connected to the driving action is obstructed from the view of the driver 5, so that the visibility of the detailed information 313 can be improved. Thereby, the driver | operator 5 can confirm a detailed display safely.

Next, an example of cooperative display in the first and second display areas of the display area 6 will be described.

FIG. 23 is an explanatory diagram showing an example of the cooperative display operation in the display area by the AR-HUD of FIG.

FIG. 23 shows priority information in the first display area 6b from the state in which the sign information 310 indicating the vehicle traffic classification is displayed as the traffic auxiliary information in the second display area 6a while the vehicle 2 is traveling. The example of a display until guidance information 312 is displayed as AR is shown. The guidance information 312 in FIG. 23 is a lane change guidance display that prompts the user to move from the lane in which the vehicle 2 is traveling to the leftmost lane.

First, as shown in “phase1” on the left side of FIG. 23, when the vehicle 2 is traveling straight, only the sign information 310 indicating the vehicle traffic classification is displayed in the second display area 6a. .

Thereafter, as indicated by “phase2” in the center of FIG. 23, when the distance to the intersection where the vehicle 2 turns left is 250 m, the display of the sign information 310 in the second display area 6a is gradually thinned and the first information In the display area 6b, the guidance information 312 for prompting the lane change to move the vehicle 2 to the left lane is superimposed on the road so that the display gradually becomes dark, and AR display is performed.

Here, an example is shown in which the display shown in “phase2” is executed when the distance to the intersection to turn left is about 250 m, for example, but the distance is not limited to this.

Subsequently, as shown in “phase 3” on the right side of FIG. 23, when the vehicle 2 reaches a distance of 200 m to the intersection where the vehicle turns to the left, the display of the sign information 310 in the second display area 6a is erased, and the first In the display area 6b, guidance information 312 for prompting a lane change to move to the lane is completely displayed on the left side. In this case, the display of “phase 3” is about 200 m, for example, for the distance to the left turn intersection, but the distance is not limited to this.

In addition, after the vehicle 2 changes lanes, the display of the guide information 312 is gradually thinned while the display of the sign information 310 is gradually darkened, and then the display of the guide information 312 is turned off and the sign information is displayed. The display of 310 is completely displayed. That is, the display is performed in the order of “phase3”, “phase2”, and “phase1” so as to be the reverse of FIG. Also in this case, the display timings from “phase 3” to “phase 2” and from “phase 2” to “phase 1” may be changed according to the distance as in FIG. May be changed.

Thereby, it is possible to prevent the guide information 312 from being displayed suddenly in the first display area 6b. If the guidance information 312 suddenly enters the driving field of view that is directly connected to the driving action, the driver 5 may be surprised or the driving may be distracted. This can be prevented.

FIG. 24 is an explanatory diagram showing an example of the case where the viewpoint position of the virtual image display in the second display area is near. FIG. 25 is an explanatory diagram showing an example of a display that reduces an increase in viewpoint movement in the second display area by the AR-HUD of FIG.

As described above, when viewed from the driver 5, the second display area 6a is a portion that hits a landscape such as a sky or a building that is not related to the driving operation, and is displayed in the second display area 6a. It is assumed that many traffic assistance information and the like do not need to be displayed so as to be superimposed on the actual scene.

However, when the traffic assistance information displayed in the second display area 6a is displayed at a nearby viewpoint position, the viewpoint movement of the driver 5 becomes large, and as a result, there is a possibility that the driving may be hindered.

For example, as shown in the upper part of FIG. 24, the viewpoint position DD of the driver 5 is about 30 m, and the viewpoint position VD of the sign information 310, which is the traffic auxiliary information of the virtual image displayed in the second display area 6a, is about In the case of 2 m, in order to read the traffic assistance information from the viewpoint position 2 m ahead from the viewpoint position 30 m ahead, as shown in the lower part of FIG. 24, a large viewpoint movement from 30 m far to 2 m near is necessary. End up. When driving a large viewpoint back and forth during driving, eyestrain is promoted or accidents are induced by overlooking information that must be seen during driving.

On the other hand, as shown in the upper part of FIG. 25, the viewpoint position DD of the driver 5 is about 30 m, and the viewpoint position VD of the sign information 310 that is the traffic auxiliary information of the virtual image displayed in the second display area 6a is Similarly, when the distance is about 30 m, as shown in the lower part of FIG. 25, the viewpoint position DD and the viewpoint position VD are substantially the same position, so the driver 5 recognizes the traffic assistance information without moving the viewpoint forward and backward. be able to.

Thus, when recognizing traffic assistance information, the movement of the viewpoint before and after can be greatly reduced, so that the information transmission speed can be improved, and the driver's 5 eyestrain and distraction of attention, etc. Can be reduced.

FIG. 26 is an explanatory view showing an example of a display for reducing oversight of a road sign in the display area by the AR-HUD of FIG.

In this case, as shown on the left side of FIG. 26, a guide sign display is displayed on the sign 202 at a point where the distance of the viewpoint position of the driver 5 and the distance from the vehicle 2 to the sign 202 as a road sign are substantially the same. The virtual image of the sign display 315 is superimposed and displayed.

In this case, as shown in FIG. 26, the sign 202 is a guide sign that is installed in a portion that hits a landscape such as the sky. Therefore, when the sign 202 naturally enters the eyes of the driver 5, a virtual image of the sign display 315 is superimposed on the sign 202 and displayed. For example, when the distance of the viewpoint of the driver 5 is about 30 m, the sign display 315 is displayed when the distance from the vehicle 2 to the sign approaches about 30 m.

The sign display 315 is a virtual image display indicating that there is a road sign. FIG. 26 shows an example in which an arrow that surrounds the marker 202 in a circle and causes the marker display 315 to be noticed is displayed as a virtual image as the marker display 316. The shape of the virtual image of the sign display 315, 316 is not particularly limited, and may be any shape.

A traffic sign such as the sign 202 is recognized by the camera image information acquired by the ECU 21 from the vehicle information acquisition unit 10. Further, the distance to the sign 202 is recognized by infrared information acquired by the ECU 21 from the vehicle information acquisition unit 10 or the like.

When the vehicle 2 approaches the sign 202, for example, when the distance between the vehicle 2 and the sign 202 is about 5 m and the virtual images of the sign indications 315 and 316 are displayed in a superimposed manner, the driver 5 changes the focus position. It has to change a lot and it takes time to recognize. Further, since the distance to the sign 202 is as short as about 5 m, the sign 202 may pass before it is recognized. That is, the virtual image shown in FIG. 26 exhibits a greater effect when displayed when the sign is far away, such as 30 m. When the distance to the sign becomes a short distance such as 5 m, it should be avoided to display a virtual image superimposed on the sign. The reason is that it is difficult to see the sign itself due to the virtual image.

In this way, by displaying the sign displays 315 and 316 at approximately the same distance as the viewpoint position of the driver 5, the driver 5 can recognize the sign 202 without moving the viewpoint back and forth. The oversight of the sign 202 can be reduced.

FIG. 27 is an explanatory view showing an example of display according to the road condition risk level in the display area by the AR-HUD of FIG.

FIG. 27 shows an example of the scenery in front of the driver's seat viewed through the windshield 3 and the state of the virtual image in the display area 6 projected on the windshield 3.

The state shown on the left side of FIG. 27 is the state with the lowest risk level (hereinafter referred to as low risk level) in the road condition, and the state shown on the right side of FIG. 27 is the state with the highest risk level (hereinafter referred to as high risk level). It is shown). Further, the state shown in the central part of FIG. 27 shows a state where the degree of danger is higher than the low degree of risk and the degree of risk is lower than the high degree of risk (hereinafter referred to as medium risk).

First, when the degree of risk is low, guidance is provided by navigation. In the display area 6, guidance information 312 indicating that the next intersection is to be turned left is displayed in a virtual image, and is displayed on the right side of the opposite lane. The pedestrian 201 is walking on the sidewalk.

In this case, since the pedestrian 201 is on the sidewalk on the opposite lane side and the distance from the vehicle 2 is far, the danger level is set low.

In the display area 6, as described above, the guidance information 312 indicating that the next intersection is to be turned left is displayed superimposed on the road of the traveling lane, and the pedestrian 201 on the sidewalk has a pedestrian. A pedestrian warning display 320 indicating this is superimposed on the pedestrian 201 and displayed.

The pedestrian warning display 320 has a shape such as an arrow, for example, and is displayed so as to point to the pedestrian 201 by the arrow. This pedestrian warning display 320 is displayed when a pedestrian is detected. When the distance from the vehicle 2 to the pedestrian 201 is greater than or equal to a preset distance, or when the pedestrian 201 is on the side of the opposite lane. Displayed when you are in Further, when the vehicle 2 passes the pedestrian 201, the pedestrian warning display 320 is erased.

In addition, the shape of the pedestrian warning display 320 is not particularly limited, and may be other than the arrow shape.

Subsequently, in the risk level, the pedestrian 201 has moved near the pedestrian crossing at the intersection where the vehicle 2 turns left. In this case, a pedestrian display 302 is superimposed on the pedestrian 201 and displayed in the display area 6 as in FIG.

Here, the distance from the vehicle 2 to the pedestrian 201 is shorter than a preset distance, or the pedestrian 201 is in the vicinity of the pedestrian crossing. Yes.

When the risk level is low, the guidance information 312 is displayed superimposed on the road. However, when the risk level is medium, the guidance information 312 is not superimposed along the road. That is, it is displayed in the second display area 6a. In other words, the guidance information 312 is displayed upward, and the presence of the pedestrian 201 is displayed more strongly.

This distinguishes the area where the guidance information 312 and the pedestrian display 302 are displayed, so that the driver 5 can more easily recognize the presence of the pedestrian 201. Moreover, it can appeal to the driver | operator 5 strongly that the pedestrian 201 exists, continuing navigation guidance.

Subsequently, at high risk, the pedestrian 201 has moved to the roadway on which the vehicle 2 travels instead of the sidewalk. In this case, since the pedestrian 201 is not on the sidewalk but on the roadway on which the vehicle 2 travels, the risk level is the highest.

When the degree of risk is high, the guidance information 312 displayed in the state of risk is deleted from the display area 6. A pedestrian display 302 is superimposed on the pedestrian 201, and a virtual image warning information 321 is displayed near the pedestrian 201 to warn that the pedestrian 201 is nearby and high in danger. It is displayed superimposed. Further, in order to appeal more strongly that the driver 2 is at high risk, the guidance by navigation is stopped and the guidance information 312 is deleted.

Further, when the vehicle 2 passes a pedestrian, the pedestrian display 302 and the warning information 321 are deleted, and guidance by navigation is resumed.

Thus, by changing the display of the guidance by navigation and the display of warning according to the degree of risk, the driver 5 is encouraged to pay attention to the warning event (in this case, a pedestrian). Further, when the degree of danger is not high, guidance by navigation can be continued in parallel with the warning, so that the driver 5 can be prevented from getting lost. Furthermore, since navigation guidance seamlessly moves from the lower part of the display area (first display area) to the upper part (second display area), or from the upper part to the lower part, depending on the degree of danger, guidance by navigation appears. The amount of change in the display is reduced compared to when it disappears or disappears, and it is possible to prevent the driver 5 from being surprised by the change in the display and distracting attention.

Next, a navigation guidance display when the vehicle 2 turns at an intersection will be described.

When turning an intersection, there are many points that the driver 5 must pay attention to, such as the situation of pedestrians or oncoming vehicles. In such a case, navigation guidance is not displayed in the first display area 6b within the intersection. This is because if the driver 5 is distracted by the navigation guidance display, the above-mentioned cautionary points may be overlooked.

FIG. 28 is an explanatory diagram showing an example of navigation guidance display at an intersection in the display area by the AR-HUD of FIG.

The upper part of FIG. 28 shows the traveling state of the vehicle 2, and the left side shows that the vehicle 2 is traveling before the intersection, that is, before the intersection. The center portion shows a state in which the vehicle 2 is turning left at the intersection, i.e., traveling in the intersection. The right side shows the traveling state of the vehicle 2 after completing the left turn at the intersection, that is, after passing through the intersection.

In the lower part of FIG. 28, from left to right, in the above-described traveling state of the vehicle 2, the front landscape viewed through the windshield 3 from the driver's seat and the display area 6 projected onto the windshield 3. The state of the virtual image inside is shown, respectively.

28. First, on the left side of FIG. 28, in the first display area 6b, guidance information 312 indicating that the next intersection is to be turned left is displayed as an AR superimposed on the road. Then, as shown in the center of FIG. 28, when the vehicle 2 approaches the intersection, the guidance information 312 displayed in the first display area 6b is erased, and new guidance information 312 is displayed as the driving action. Are displayed in the second display area 6a, which is a part that is not so much related. Alternatively, the guidance information 312 may not be displayed in the second display area 6a.

Here, whether or not the vehicle 2 has entered the intersection is determined based on, for example, steering wheel angle information, navigation information, and camera image information outside the vehicle acquired by the ECU 21 from the vehicle information acquisition unit 10.

When the left turn of the vehicle 2 is finished, as shown on the right side of FIG. 28, the guidance information 312 is displayed again in the first display area 6b. Here, the guidance information 312 is information indicating that the vehicle travels straight on the left-turned road.

Thus, when turning the intersection, the driver 5 can travel in a safe state because the object to which attention should be paid while traveling at the intersection is not obstructed by the virtual image display. Furthermore, since navigation guidance seamlessly moves from the lower part of the display area (first display area) to the upper part (second display area) or from the upper part to the lower part according to the driving state of the intersection, guidance by navigation is provided. The amount of change in the display is reduced compared to when the message appears and disappears, and it is possible to prevent the driver 5 from being surprised by the change in the display and distracting attention.

So far, the display examples in the second display area 6a and the first display area 6b of the display area 6 have been described. However, these displays may be customized by the user.

FIG. 29 is an explanatory view showing an example of a menu for customizing the display in the display area by the AR-HUD of FIG.

In the example of FIG. 29, menus of “upper and lower two-level display”, “upper-level display”, and “lower-level display” are provided as examples of display selection in the display area 6. In the “upper and lower two-stage display”, virtual images are displayed in all of the second display area 6a and the second table area 6b shown in FIG.

“Upper display” displays only the second display area 6a, that is, only the traffic auxiliary information including auxiliary information for assisting the driving operation. The “lower display” displays only the first display area 6b, that is, only priority information that is important information directly related to the driving operation.

The driver 5 can arbitrarily select the content to be displayed by selecting the display method of the virtual image displayed in the display area 6 from the menu of FIG. In FIG. 29, the menu for selecting only the display area in the display area 6 is used. However, various menus such as changing the transmittance of information displayed in the second display area 6a and changing the display size of the information are available. A menu may be prepared. Further, the selection menu is not limited to the above-described selection example, but may be other items.

As described above, the driver 5 can easily distinguish and recognize the display of the traffic assistance information and the priority information more important than the traffic assistance information. In addition, it is possible to make the driver 5 recognize the traffic assistance information and the priority information without hindering driving. Thereby, it can contribute to safe driving.

As mentioned above, the invention made by the present inventor has been specifically described based on the embodiment. However, the present invention is not limited to the embodiment, and various modifications can be made without departing from the scope of the invention. Needless to say.

Note that the present invention is not limited to the above-described embodiment, and includes various modifications. For example, the above-described embodiment has been described in detail for easy understanding of the present invention, and is not necessarily limited to one having all the configurations described.

Further, a part of the configuration of one embodiment can be replaced with the configuration of another embodiment, and the configuration of another embodiment can be added to the configuration of one embodiment. . In addition, it is possible to add, delete, and replace other configurations for a part of the configuration of each embodiment.

1 AR-HUD
2 Vehicle 3 Windshield 4 Vehicle information 5 Driver 6 Display area 10 Vehicle information acquisition unit 20 Control unit 21 ECU
22 Audio output unit 23 Non-volatile memory 24 Memory 25 Light source adjustment unit 26 Distortion correction unit 27 Display element drive unit 28 Display distance adjustment unit 29 Mirror adjustment unit 30 Video display device 31 Light source 32 Illumination optical system 33 Display element 40 Display distance adjustment mechanism 50 Mirror Drive Unit 51 Mirror 52 Mirror 60 Speaker 101 Vehicle Speed Sensor 102 Shift Position Sensor 103 Handle Steering Angle Sensor 104 Headlight Sensor 105 Illuminance Sensor 106 Chromaticity Sensor 107 Distance Sensor 108 Infrared Sensor 109 Engine Start Sensor 110 Acceleration Sensor 111 Gyro Sensor 112 Temperature sensor 113 Radio receiver for road-to-vehicle communication 114 Radio receiver for vehicle-to-vehicle communication 117 GPS receiver 118 VICS receiver 281 Functional liquid crystal film ON / OFF control unit 282 Lens movable unit 283 Dimming Ra ON / OFF control unit 284 diffusing plate movable part 285 optical filter moving unit 401 functional liquid crystal film 402 lens moving mechanism 403 switchable mirror 404 diffusion plate moving mechanism 405 optical filter moving mechanism

Claims (15)

1. A head-up display device that displays an image in a display area that is visually recognized through a windshield from a driver's seat of a vehicle,
   A vehicle information acquisition unit for acquiring vehicle information detected by the vehicle;
   A control unit for controlling display of the video;
   A video display device for generating the video;
   A mirror that reflects and projects the image generated by the image display device onto the windshield;
   A mirror driving section for changing the angle of the mirror;
   A display distance adjustment mechanism for adjusting the display distance of the image to the driver;
   Have
   The control unit is capable of controlling the display area by controlling the video display device based on the vehicle information,
   The display area controlled by the control unit is:
   A first display area;
   A second display area;
   Have
   The first display area is an area capable of displaying augmented reality,
   The head-up display device, wherein the second display area is an area where the augmented reality is not displayed.
2. The head-up display device according to claim 1,
   The head-up display device, wherein the second display area is an area above the first display area.
3. The head-up display device according to claim 1,
   The first display area displays first information;
   The head-up display device, wherein the second display area displays second information having a lower priority than the first information.
4. The head-up display device according to claim 3.
   The first information is safe driving support information that is information for supporting safe driving,
   The head-up display device, wherein the second information is travel support information that is information that supports driving behavior.
5. The head-up display device according to claim 4,
   The safe driving support information displayed in the first display area has a guidance display indicating a destination of the vehicle,
   The control unit generates the guidance display based on navigation information included in the vehicle information acquired by the vehicle information acquisition unit, and a road on which the vehicle turns left or a road on which the vehicle turns right on the generated guidance display A head-up display device that displays augmented reality superimposed on the head.
6. The head-up display device according to claim 4 or 5,
   The safe driving support information displayed in the first display area has a pedestrian display indicating the presence of a pedestrian,
   The control unit recognizes the pedestrian based on camera image information included in the vehicle information acquired by the vehicle information acquisition unit, and performs an augmented reality display in which the pedestrian display is superimposed on the recognized pedestrian. , Head-up display device.
7. The head-up display device according to claim 4,
   The safe driving support information displayed in the first display area has a guidance display indicating a destination of the vehicle and a pedestrian display indicating the presence of a pedestrian,
   The control unit generates the guidance display based on navigation information included in the vehicle information acquired by the vehicle information acquisition unit, and a road on which the vehicle turns left or a road on which the vehicle turns right on the generated guidance display The augmented reality displayed on the vehicle information is recognized, the pedestrian is recognized based on the camera image information of the vehicle information, the augmented reality displayed superimposed on the recognized pedestrian, and the recognized position of the pedestrian A head-up display device that determines a risk level from the first display area and displays the guidance display displayed in the first display area when it is determined that the risk level is high.
8. The head-up display device according to claim 4,
   The safe driving support information displayed in the first display area has a guidance display indicating a destination of the vehicle and a pedestrian display indicating the presence of a pedestrian,
   The control unit generates the guidance display based on navigation information included in the vehicle information acquired by the vehicle information acquisition unit, and a road on which the vehicle turns left or a road on which the vehicle turns right on the generated guidance display The augmented reality displayed on the vehicle information is recognized, the pedestrian is recognized based on the camera image information of the vehicle information, the augmented reality displayed superimposed on the recognized pedestrian, and the recognized position of the pedestrian A head-up display device that determines the risk level from the information and erases the guidance display when it is determined that the risk level is high.
9. The head-up display device according to claim 5.
   The control unit determines whether the vehicle is turning left or right based on steering wheel angle information, navigation information, and camera video information included in the vehicle information acquired by the vehicle information acquisition unit, A head-up display device that displays the guidance display displayed in the first display area in the second display area when it is determined that the vehicle is turning left or right.
10. The head-up display device according to any one of claims 5 to 8,
    The driving support information displayed in the second display area has a guide sign display indicating the presence of a guide sign,
    The control unit recognizes the guide sign based on camera image information included in the vehicle information acquired by the vehicle information acquisition unit, and performs augmented reality display in which the guide sign display is superimposed on the recognized guide sign. , Head-up display device.
11. A head-up display device that displays an image in a display area that is visually recognized through a windshield from a driver's seat of a vehicle,
    A vehicle information acquisition unit for acquiring vehicle information detected by the vehicle;
    A control unit for controlling display of the video;
    A video display device for generating the video;
    A mirror that reflects and projects the image generated by the image display device onto the windshield;
    A mirror driving section for changing the angle of the mirror;
    A display distance adjustment mechanism for adjusting the display distance of the image to the driver;
    Have
    The control unit generates a guidance display indicating a destination of the vehicle based on navigation information included in the vehicle information acquired by the vehicle information acquisition unit, and a road on which the vehicle turns to the left or the generated guidance display A head-up display device that displays augmented reality superimposed on a road on which the vehicle turns right.
12. The head-up display device according to claim 11.
    The control unit recognizes a pedestrian based on camera image information included in the vehicle information acquired by the vehicle information acquisition unit, and superimposes a pedestrian display indicating the presence of the pedestrian on the recognized pedestrian. A head-up display device that displays actual images.
13. The head-up display device according to claim 11 or 12,
    The control unit determines whether another vehicle exists based on the camera image information included in the vehicle information acquired by the vehicle information acquisition unit, and when the other vehicle exists, A head-up display device that generates a vehicle display indicating that the vehicle is present and displays an augmented reality in which the generated vehicle display is superimposed on the other vehicle.
14. The head-up display device according to claim 13.
    The control unit generates the vehicle display so that a vehicle in a traveling direction opposite to the vehicle driven by the driver and a vehicle in the same traveling direction as the vehicle driven by the driver can be identified. Display device.
15. The head-up display device according to any one of claims 11 to 13,
    The control unit determines the meaning of a road sign of a restriction sign or an instruction sign based on camera video information included in the vehicle information acquired by the vehicle information acquisition unit, and a restriction instruction corresponding to the determined meaning of the road sign A head-up display device that generates a restriction instruction display, which is a display indicating the above, and performs an augmented reality display in which the generated restriction instruction display is superimposed on the road corresponding to the road sign.

Images