JP2019217790A - Head-up display device - Google Patents

Abstract

To display important information so that a driver easily recognizes it while making display by a head-up display device larger.SOLUTION: In AR-HUD 1, a vehicle information acquisition part 10 acquires various types of vehicle information 4 which a vehicle 2 can detect. A control part 20 controls display of video which is displayed in a display area viewed from a driver seat of the vehicle 2 through a wind shield 3 based upon the vehicle information 4 which the vehicle information acquisition part 10 acquires. A video display device 30 generates the video based upon indication from the control part 20. A display distance adjustment mechanism 40 adjusts virtual display distance for the driver. The display area which the control part 20 controls includes a first display area and a second display area which is in area of upper side of the first display area and the first display area displays augmented reality and the second display area is an area which the augmented reality is not displayed.SELECTED DRAWING: Figure 2

Description

  The present invention relates to a technology of a head-up display device, and particularly to a technology effective when applied to a head-up display device using an AR (Augmented Reality).

  In vehicles such as automobiles, a head-up display (Head Up Display, hereinafter sometimes referred to as "HUD") device for projecting and displaying information on a windshield (windshield) or the like may be used. Are known.

  The HUD device projects running information such as a vehicle speed and an engine speed or information such as car navigation on a windshield as described above. The driver can check the information without moving his line of sight to an instrument panel incorporated in the dashboard, so-called instrument panel, or the like, and can reduce the amount of line of sight movement.

  In recent years, some HUD devices display information that supports safe driving such as detection of pedestrians and obstacles, in addition to the above-described travel information and car navigation information. For example, when displaying a road sign on a side road or the presence of a pedestrian, it is required to enlarge the HUD device.

  It should be noted that a display technology using this type of HUD device is one that prevents an unnecessary alarm from being issued when an approaching obstacle is detected from the front side (for example, see Patent Document 1), or a plurality of display technologies. There is one that provides information with a sense of unity between display devices to an observer and makes the information easier for the observer to recognize (for example, see Patent Document 2).

JP-A-2006-91084 JP-A-2006-60303

  If the display area of the HUD is increased to display a lot of information superimposed on the actual scenery outside the vehicle that can be seen through the windshield, a lot of information can be displayed. Information, and feel annoying.

  In addition, a large amount of information is displayed on a large display screen, which causes a problem that a driver's attention is distracted or important information related to safety is not recognized. .

  It is an object of the present invention to provide a technology that allows a driver to easily display important information while increasing the display area of a head-up display device.

  The above and other objects and novel features of the present invention will become apparent from the description of the present specification and the accompanying drawings.

  The following is a brief description of an outline of typical inventions disclosed in the present application.

  That is, a typical head-up display device displays a virtual image by projecting an image on a windshield of a vehicle so as to be superimposed on a scene in front of the vehicle for a driver.

  This head-up display device has a vehicle information acquisition unit, a control unit, a video display device, a mirror, a mirror drive unit, and a display distance adjustment mechanism. The vehicle information acquisition unit acquires various types of vehicle information that can be detected by the vehicle.

  The control unit controls display of an image displayed in a display area visually recognized from a driver's seat of the vehicle through a windshield based on the vehicle information acquired by the vehicle information acquisition unit. The video display device generates a video based on an instruction from the control unit.

  The mirror reflects an image generated by the image display device and projects the image on a windshield. The mirror driving unit changes the angle of the mirror based on an instruction from the control unit. The display distance adjustment mechanism adjusts the display distance of the virtual image to the driver.

  The display area controlled by the control unit includes a first display area and a second display area that is an area above the first display area. The first display area is an area for displaying augmented reality. The second display area is an area in which augmented reality is not displayed.

  In particular, the first display area displays the first information, and the second display area displays the second information having a lower priority than the first information. The first information is safe driving support information that supports safe driving, and the second information is driving support information that supports driving behavior.

  The effects obtained by typical aspects of the invention disclosed in the present application will be briefly described as follows.

  (1) Information necessary for safe driving can be accurately displayed according to the traveling state of the vehicle.

  (2) The above (1) can contribute to safe driving.

FIG. 4 is an explanatory diagram showing an outline of an example of an operation concept in the AR-HUD according to the first embodiment. FIG. 2 is a functional block diagram showing an outline of an overall configuration example of the AR-HUD according to the first embodiment. FIG. 3 is an explanatory diagram illustrating an outline of an example of a hardware configuration related to acquisition of vehicle information in an AR-HUD in FIG. 2. FIG. 3 is a functional block diagram illustrating details of a configuration example of an AR-HUD in FIG. 2. FIG. 5 is an explanatory diagram illustrating details of an example of a configuration in a control unit and a display distance adjusting mechanism in FIG. 4. 3 is a flowchart showing an outline of an example of an initial operation in the AR-HUD of FIG. 2; 3 is a flowchart showing an outline of an example of a normal operation in the AR-HUD of FIG. 2; 8 is a flowchart showing an outline of an example of a brightness level adjustment process which is a process of step S22 in FIG. 3 is a flowchart showing an outline of an example of a processing flow for adjusting display contents and a display method of a virtual image in the AR-HUD of FIG. 2. 10 is a flowchart showing an outline of an example of a flow of a display position adjustment process as a process of step S233 in the display video determination / change process of FIG. 9. FIG. 3 is an explanatory diagram illustrating an example of a display area according to the AR-HUD in FIG. 2. FIG. 12 is an explanatory diagram illustrating a display example of a guidance screen based on navigation information when the display area in FIG. 11 is enlarged. FIG. 9 is an explanatory diagram illustrating an example in which there are a plurality of roads that can make a left turn when a vehicle makes a left turn by navigation guidance. FIG. 14 is an explanatory diagram showing a display example of a guidance screen based on navigation information when a display area in the road configuration in FIG. 13 is enlarged. FIG. 12 is an explanatory diagram illustrating another display example of the guidance screen based on the navigation information in the enlarged display area in FIG. 11. FIG. 12 is an explanatory diagram showing another example of the display on the display screen in the enlarged display area of FIG. 11. FIG. 14 is an explanatory diagram showing an example of a region when a display region by the AR-HUD according to the second embodiment is enlarged in a horizontal direction and a vertical direction. FIG. 18 is an explanatory diagram illustrating an example of a display in a display area enlarged in a horizontal direction and a vertical direction in FIG. 17. FIG. 19 is an explanatory diagram showing an example of display in a display area following FIG. 18. FIG. 9 is an explanatory diagram illustrating an example of display in a second display area. FIG. 21 is an explanatory diagram illustrating an example of a display following FIG. 20. FIG. 20 is an explanatory diagram showing another display example of FIG. 19. FIG. 18 is an explanatory diagram illustrating an example of a cooperative display operation in a display area by the AR-HUD in FIG. 17. FIG. 9 is an explanatory diagram showing an example in the case where the viewpoint position of the virtual image display in the upper part of the display area is near in consideration of the present inventors. FIG. 18 is an explanatory diagram illustrating an example of a display for reducing an increase in viewpoint movement in an upper part of a display area by the AR-HUD in FIG. 17. FIG. 18 is an explanatory diagram showing an example of a display for reducing oversight of a road sign in a display area by the AR-HUD in FIG. 17. FIG. 18 is an explanatory diagram showing an example of a display according to a degree of risk of a road situation in a display area by the AR-HUD of FIG. 17. FIG. 18 is an explanatory diagram showing an example of guidance display for navigation at an intersection in a display area by the AR-HUD of FIG. 17. FIG. 18 is an explanatory diagram illustrating an example of a menu for customizing display in a display area by the AR-HUD in FIG. 17.

  In all the drawings for describing the embodiments, the same members are denoted by the same reference numerals in principle, and the repeated description thereof will be omitted. Note that hatching may be used even in a plan view so as to make the drawings easy to understand.

(Embodiment 1)
Hereinafter, embodiments will be described in detail.

<Operation concept of AR-HUD>
FIG. 1 is an explanatory diagram showing an outline of an example of an operation concept in a HUD device (hereinafter, sometimes referred to as “AR-HUD”) that realizes an AR function according to the first embodiment.

  The AR-HUD 1 which is a head-up display device reflects an image displayed on an image display device 30 such as a projector or an LCD (Liquid Crystal Display) by a mirror 51 or a mirror 52 as shown in FIG. The light is projected on the windshield 3 of the vehicle 2. The mirror 51 and the mirror 52 are, for example, free-form mirrors or mirrors having an optical axis asymmetric shape.

  The driver 5 sees the image projected on the windshield 3, and visually recognizes the image as a virtual image in front of the transparent windshield 3. In the present embodiment, for example, by adjusting the angle of the mirror 52, the position of the image projected on the windshield 3 is adjusted, and the display position of the virtual image viewed by the driver 5 can be adjusted in the vertical direction. is there.

  It is also possible to adjust the display distance such that the virtual image is displayed near (for example, 2 to 3 m away) or far (for example, 30 to 40 m away). The AR function is realized by adjusting the display position and the display distance so that the virtual image is superimposed on the scenery outside the vehicle (roads, buildings, people, and the like).

  Further, in the AR-HUD 1 of the present embodiment, the display area of the image projected on the windshield 3, that is, the display area 6 shown in FIGS. It can be displayed on the shield 3. This can be realized by, for example, increasing the area of the mirror 52 and the like. The enlargement of the display area 6 is not limited to this, and may be realized by another technique.

<Ar-HUD configuration example>
FIG. 2 is a functional block diagram schematically illustrating an overall configuration example of the AR-HUD according to the first embodiment.

  The AR-HUD 1 mounted on the vehicle 2 includes, as shown in FIG. 2, a vehicle information acquisition unit 10, a control unit 20, a video display device 30, a display distance adjustment mechanism 40, a mirror driving unit 50, a mirror 52, and a speaker 60. Etc. In addition, in the example of FIG. 2, the shape of the vehicle 2 is displayed like a passenger car. However, the present invention is not particularly limited to this and can be appropriately applied to general vehicles.

  The vehicle information acquisition unit 10 includes an information acquisition device such as various sensors described below installed in each unit of the vehicle 2 and detects various events that occur in the vehicle 2 or changes the traveling state at predetermined intervals. The vehicle information 4 is acquired and output by detecting and acquiring the values of the various parameters.

  As shown, the vehicle information 4 includes, for example, speed information and gear information of the vehicle 2, steering wheel angle information, lamp lighting information, external light information, distance information, infrared information, engine ON / OFF information, and information on the inside and outside of the vehicle. Camera image information, acceleration gyro information, GPS (Global Positioning System) information, navigation information, vehicle-to-vehicle communication information, road-to-vehicle communication information, and the like may be included.

  The control unit 20 has a function of controlling the operation of the AR-HUD 1, and is implemented by, for example, a CPU (Central Processing Unit) and software executed by the CPU. It may be implemented by hardware such as a microcomputer or an FPGA (Field Programmable Gate Array).

  As shown in FIG. 2, the control unit 20 generates an image to be displayed as a virtual image by driving the image display device 30 based on the vehicle information 4 or the like acquired from the vehicle information acquisition unit 10, and generates the image by a mirror 52. The light is reflected on the windshield 3 as appropriate. Then, controls such as adjusting the display position of the virtual image display area 6 and adjusting the display distance of the virtual image are performed.

  As described above, the video display device 30 is a device configured by, for example, a projector or an LCD, and generates a video for displaying a virtual image based on an instruction from the control unit 20 and projects or displays the video. Or

  The display distance adjustment mechanism 40 is a mechanism for adjusting the distance of the displayed virtual image from the driver 5 based on an instruction from the control unit 20. The mirror driving unit 50 adjusts the angle of the mirror 52 based on an instruction from the control unit 20, and adjusts the position of the virtual image display area 6 in the vertical direction.

  The speaker 60 performs audio output related to the AR-HUD1. For example, voice guidance of a navigation system or voice output for notifying the driver 5 of a warning or the like by the AR function can be performed.

  FIG. 3 is an explanatory diagram showing an outline of an example of a hardware configuration related to acquisition of the vehicle information 4 in the AR-HUD of FIG.

  Here, the hardware configuration of a part of the vehicle information acquisition unit 10 and the control unit 20 will be mainly described. The acquisition of the vehicle information 4 is performed by an information acquisition device such as various sensors connected to the ECU 21 under the control of an ECU (Electronic Control Unit) 21, for example.

  These information acquisition devices include, for example, a vehicle speed sensor 101, a shift position sensor 102, a steering wheel steering angle sensor 103, a headlight sensor 104, an illuminance sensor 105, a chromaticity sensor 106, a distance measurement sensor 107, an infrared sensor 108, an engine start Sensor 109, acceleration sensor 110, gyro sensor 111, temperature sensor 112, roadside-vehicle communication wireless receiver 113, vehicle-to-vehicle communication wireless receiver 114, camera (in-vehicle) 115, camera (outside-vehicle) 116, GPS receiver 117, And a VICS (Vehicle Information and Communication System: registered trademark (hereinafter the same)) receiver 118 and the like.

  Not all of these devices need to be provided, and other types of devices may be provided. The vehicle information 4 that can be obtained by the provided device can be appropriately used.

  The vehicle speed sensor 101 acquires the speed information of the vehicle 2 in FIG. The shift position sensor 102 acquires the current gear information of the vehicle 2. The steering wheel angle sensor 103 acquires steering angle information.

  The headlight sensor 104 acquires lamp lighting information related to ON / OFF of the headlight. The illuminance sensor 105 and the chromaticity sensor 106 acquire external light information. The distance measurement sensor 107 acquires distance information between the vehicle 2 and an external object.

  The infrared sensor 108 acquires infrared information related to the presence or absence of an object at a short distance from the vehicle 2 and the distance. The engine start sensor 109 detects ON / OFF information of the engine.

  The acceleration sensor 110 and the gyro sensor 111 acquire acceleration gyro information including acceleration and angular velocity as information on the attitude and behavior of the vehicle 2. The temperature sensor 112 acquires temperature information inside and outside the vehicle.

  The road-to-vehicle communication wireless receiver 113 and the vehicle-to-vehicle communication wireless receiver 114 are configured to receive road-to-vehicle communication information received by road-to-vehicle communication between the vehicle 2 and a road, a sign, a signal, and the like, The vehicle-to-vehicle communication information received by the vehicle-to-vehicle communication with the other vehicle is acquired.

  The camera (inside the vehicle) 115 and the camera (outside the vehicle) 116 capture moving images of the conditions inside and outside the vehicle to acquire camera image information inside the vehicle and camera image information outside the vehicle, respectively. The camera (in the vehicle) 115 captures, for example, the posture of the driver 5 in FIG. By analyzing the obtained moving image, it is possible to grasp, for example, the fatigue state of the driver 5, the position of the line of sight, and the like.

  In addition, the camera (outside the vehicle) 116 captures an image of the surrounding situation such as the front and rear of the vehicle 2. By analyzing the obtained moving images, for example, the presence or absence of moving objects such as other vehicles and people in the vicinity, the building and terrain, the road surface condition such as rain and snow, freezing, unevenness, and the like, and the road sign are grasped. It is possible.

  The GPS receiver 117 and the VICS receiver 118 respectively acquire GPS information obtained by receiving a GPS signal and VICS information obtained by receiving a VICS signal. It may be implemented as a part of a car navigation system that acquires and uses such information.

  FIG. 4 is a functional block diagram showing details of a configuration example of the AR-HUD of FIG.

  The example of FIG. 4 illustrates a case where the video display device 30 is a projector. The video display device 30 includes, for example, each unit such as a light source 31, an illumination optical system 32, and a display element 33.

  The light source 31 is a member that generates illumination light for projection, and for example, a high-pressure mercury lamp, a xenon lamp, an LED (Light Emitting Diode) light source, a laser light source, or the like can be used.

  The illumination optical system 32 is an optical system that condenses illumination light generated by the light source 31, makes the illumination light more uniform, and irradiates the light to the display element 33. The display element 33 is an element that generates an image to be projected, and for example, a transmissive liquid crystal panel, a reflective liquid crystal panel, a DMD (Digital Micromirror Device) (registered trademark) panel, or the like can be used.

  More specifically, the control unit 20 includes an ECU 21, an audio output unit 22, a nonvolatile memory 23, a memory 24, a light source adjustment unit 25, a distortion correction unit 26, a display element driving unit 27, a display distance adjustment unit 28, and a mirror adjustment. It has each part such as the part 29.

  As shown in FIG. 3, the ECU 21 acquires the vehicle information 4 via the vehicle information acquiring unit 10 and records, stores, or reads the acquired information in the nonvolatile memory 23 or the memory 24 as necessary. I do.

  The nonvolatile memory 23 may store setting information such as setting values and parameters for various controls. Further, the ECU 21 generates video data relating to a virtual image to be displayed as the AR-HUD 1 by executing a dedicated program or the like.

  The audio output unit 22 outputs audio information via the speaker 60 as needed. The light source adjustment unit 25 adjusts the light emission amount of the light source 31 of the video display device 30. When there are a plurality of light sources 31, they may be individually controlled.

  When the image generated by the ECU 21 is projected on the windshield 3 of the vehicle 2 by the image display device 30, the distortion correction unit 26 corrects the image distortion caused by the curvature of the windshield 3 by image processing. The display element drive unit 27 sends a drive signal corresponding to the image data corrected by the distortion correction unit 26 to the display element 33 to generate an image to be projected.

  When the display distance of the virtual image needs to be adjusted, the display distance adjustment unit 28 drives the display distance adjustment mechanism 40 to adjust the display distance of the image projected from the image display device 30. When it is necessary to adjust the position of the virtual image display area 6 itself, the mirror adjusting unit 29 changes the angle of the mirror 52 via the mirror driving unit 50 and moves the virtual image display area 6 up and down.

  FIG. 5 is an explanatory diagram showing details of an example of a configuration in the control unit and the display distance adjusting mechanism in FIG.

  In FIG. 5, the display distance adjustment unit 28 of the control unit 20 further includes, for example, a functional liquid crystal film ON / OFF control unit 281, a lens movable unit 282, a light control mirror ON / An OFF control unit 283, a diffusion plate movable unit 284, an optical filter movable unit 285, and the like are provided.

  The display distance adjustment mechanism 40 further includes a functional liquid crystal film 401, a lens movable mechanism 402, a light control mirror 403, a diffuser movable mechanism 404, and an optical device such as hardware and devices controlled and driven by these units. It has a filter movable mechanism 405 and the like.

  Note that the AR-HUD1 does not need to include all of these units and devices, but may appropriately include the respective units necessary to mount a device to which the technology for adjusting the display distance of the virtual image is applied.

<Processing content>
FIG. 6 is a flowchart outlining an example of an initial operation in the AR-HUD of FIG.

  When the ignition switch is turned on in the stopped vehicle 2 to turn on the power of the AR-HUD 1 (S01), the AR-HUD 1 firstly receives the vehicle information acquisition unit 10 based on an instruction from the control unit 20. To obtain vehicle information 4 (S02).

  Then, the control unit 20 calculates a suitable brightness level based on the external light information acquired by the illuminance sensor 105 and the chromaticity sensor 106 from the vehicle information 4 (S03). Is controlled so as to be at the calculated brightness level (S04). For example, if the external light is bright, the brightness level is set high, and if it is dark, the brightness level is set low.

  Thereafter, the ECU 21 determines and generates a video to be displayed as a virtual image, for example, an initial image (S05), and performs a process of correcting the generated video for distortion by the distortion correction unit 26 (S06). The display driver 33 is driven and controlled by the element driver 27 to generate a projected image (S07).

  Thereby, an image is projected on the windshield 3 and the driver 5 can visually recognize the virtual image. Thereafter, the display distance of the virtual image is calculated and determined by the ECU 21 or the display distance adjusting unit 28 (S08), and the display distance adjusting mechanism 40 is driven by the display distance adjusting unit 28 to display the image projected from the image display device 30. The distance is controlled (S09).

  When the start-up and start-up of each unit including the above-described series of initial operations is completed in the entire AR-HUD1, a HUD-ON signal is output. The control unit 20 determines whether or not this signal has been received (S10). .

  If the HUD-ON signal has not been received, the HUD-ON signal is further waited for a predetermined time (S11), and the HUD-ON signal waiting process (S11) is repeated until it is determined in step S10 that the HUD-ON signal has been received.

  If it is determined in step S10 that the HUD-ON signal has been received, a normal operation of the AR-HUD1 described later is started (S12), and a series of initial operations ends.

  FIG. 7 is a flowchart showing an outline of an example of a normal operation in the AR-HUD of FIG.

  In the normal operation, the basic processing flow is almost the same as the initial operation shown in FIG. First, the AR-HUD 1 acquires the vehicle information 4 by the vehicle information acquisition unit 10 based on the instruction from the control unit 20 (S21). And the control part 20 performs a brightness level adjustment process based on the external light information acquired by the illuminance sensor 105, the chromaticity sensor 106, etc. among the vehicle information 4 (S22).

  FIG. 8 is a flowchart showing an outline of an example of the brightness level adjustment process which is the process of step S22 in FIG.

  When the brightness level adjustment processing is started, first, a suitable brightness level is calculated based on the acquired external light information (S221). Then, by comparing with the currently set brightness level, it is determined whether or not the brightness level needs to be changed (S222). If no change is required, the brightness level adjustment processing ends.

  On the other hand, if it is necessary to change the brightness level, the light source adjustment unit 25 controls the light emission amount of the light source 31 to set the brightness level to the changed brightness level (S223), and ends the brightness level adjustment processing. .

  In step S222, even if there is a difference between the suitable brightness level calculated in the process of step S221 and the currently set brightness level, the difference is equal to or larger than a predetermined threshold. It may be determined that only the brightness level needs to be changed.

  Returning to FIG. 7, after that, the ECU 21 changes the image to be displayed as a virtual image from the current image as needed based on the latest vehicle information 4 acquired in the process of step S21, and determines the changed image. Is generated (S23).

  Note that there may be many patterns for changing the display content based on the vehicle information 4 according to the content of the acquired vehicle information 4 or a combination thereof. For example, when the speed information is changed, the value of the speed display that is always displayed is changed, the arrow graphic for guidance is displayed / erased based on the navigation information, and the shape and display position of the arrow are changed. There may be various patterns, such as the case of doing.

  Thereafter, an adjustment / correction process for maintaining visibility, appropriateness of display contents, and the like is performed according to the traveling state of the vehicle 2.

  First, when it is necessary to adjust the position of the virtual image display area 6 itself, a mirror adjustment process of changing the angle of the mirror 52 via the mirror driving unit 50 and moving the virtual image display area 6 up and down is performed ( S24). Thereafter, a vibration correction process for correcting the display position of the image in the display area 6 with respect to the vibration of the vehicle 2 is further performed (S25).

  Then, after performing a process of correcting the distortion by the distortion correction unit 26 on the adjusted and corrected image (S26), the display element driving unit 27 drives and controls the display element 33 to generate an image to be projected ( S27).

  Then, the display distance of the virtual image is calculated and determined by the ECU 21 or the display distance adjustment unit 28 (S28), and the display distance adjustment mechanism 40 is driven by the display distance adjustment unit 28 to display the image projected from the image display device 30. The distance is controlled (S29).

  While the series of normal operations described above are being performed, if the power is turned off due to the stop of the vehicle 2 or the like, a HUD-OFF signal is output to the AR-HUD1. It is determined whether this signal has been received (S30).

  If the HUD-OFF signal has not been received, the process returns to step S21, and a series of normal operations is repeated until the HUD-OFF signal is received. When it is determined that the HUD-OFF signal has been received, a series of normal operations ends.

  Next, a process for adjusting the display content and display method of the virtual image itself to be displayed will be described.

  The AR-HUD 1 adjusts the display content and the display method of the virtual image itself to be displayed according to the situation such as the scenery ahead of the vehicle 2 in addition to the above-described adjustment of the virtual image display area 6 and the display distance. This makes it possible to superimpose a more appropriate virtual image on a scene in front at a more appropriate position and mode.

  FIG. 9 is a flowchart showing an outline of an example of a processing flow for adjusting display contents and a display method of a virtual image in the AR-HUD of FIG.

  The generation and display of the display contents (contents) of the virtual image in the AR-HUD1 are performed by the processing in step S05 in the initial operation in FIG. 6 and the processing in step S23 in the normal operation in FIG. Here, the processing contents will be described by taking as an example the display video change / determination processing in the processing of step S23 in the normal operation of FIG.

  First, the standard content generation processing (S231) and the event content generation processing (S232) are performed by the ECU 21. The standard content basically refers to content such as a vehicle speed display that is always displayed in the display area 6 while the vehicle 2 is running.

  The event content refers to content such as an alert display that is displayed as needed based on a driving situation including a situation of a landscape in front of the vehicle 2. In each case, a plurality of contents may be generated.

  After that, the ECU 21 adjusts the display position, display color, and the like of each generated content based on the relationship with the scenery ahead grasped by the camera image information (S233) and the display color adjustment process (S234). )I do.

  Then, display video data relating to each content after the adjustment is generated (S235), and the process ends. Note that the video data generated here is projected by the display element drive unit 27 in the processing of the subsequent step S27 in FIG.

  FIG. 10 is a flowchart showing an outline of an example of the flow of the display position adjustment process, which is the process of step S233 in the display video determination / change process of FIG.

  First, here, the camera video information outside the vehicle in the vehicle information 4 acquired in the process of step S21 in FIG. 7 is analyzed to determine whether or not there is an object to be prevented from being hidden in a scenery ahead or the like. Is grasped (S3100). For example, a traffic light, a pedestrian, a two-wheeled vehicle, a preceding vehicle, and the like may be applicable in addition to a curved mirror, a road sign, and the like.

  Then, the current display position of each standard content and each event content generated in the processing of steps S231 and S232 in FIG. 9 is collated with the coordinates of each object (S3200). Then, it is determined whether or not the display position of each content needs to be adjusted, that is, whether or not the display of each content becomes an obstacle to the target (S3300). For example, the display position of the arrow graphic or the alert display is compared with the position of the curve mirror or the road sign by image processing or the like to determine whether or not the curve mirror or the road sign is hidden.

  In the process of step S3300, if it is determined that the adjustment of the display position is unnecessary, the process ends. If it is determined that the display position needs to be adjusted, the display position is adjusted and moved for the target content, and a new display position is set (S3400).

  As described above, the method of determining the position to move the content is not particularly limited. Instead of or in addition to the adjustment of the position of the content, the display size of the content may be reduced so that the object is adjusted so as not to be hidden (S3500).

  After performing these adjustments, the process returns to step S3200 again, and the above-described series of processing is repeated until the display position of each content does not need to be adjusted. Since there is a possibility that another object exists at the destination where the content has been moved, it is necessary to perform adjustment until the display position becomes appropriate.

  If this adjustment takes too much time, the display cannot be performed at a timing suitable for the driver. Therefore, for example, the display position may be adjusted by recognizing the position of the curve mirror or the road sign from an early stage before approaching the intersection.

  Through the above series of processes, the virtual image content can be displayed in a state where the target object is avoided, and the visibility of the target object can be improved.

<Example of AR-HUD display>
Subsequently, a specific display example using the AR-HUD1 will be described.

  The display example in the AR-HUD 1 described below is realized by the AR-HUD 1 executing each of the processes shown in FIGS. 7 to 10 described above.

  FIG. 11 is an explanatory diagram illustrating an example of a display area according to the AR-HUD1 of FIG.

  FIG. 11 schematically shows an example of the display area 6 that the driver 5 of the vehicle 2 visually recognizes from the driver's seat via the windshield 3.

  FIG. 11A shows an example in which the display area 6 is not enlarged in the horizontal direction. FIG. 11B shows an example in which the area in the horizontal direction (hereinafter, horizontal direction) with respect to the road surface is not included. It shows an example in the case of being enlarged.

  In this case, as shown by the solid line in FIG. 11 (b), for example, the display area 6 is enlarged in a horizontal direction with respect to the road surface, whereby a virtual image is superimposed on a wider area outside the vehicle. be able to. Thus, when the display area 6 is enlarged in the horizontal direction, a virtual image can be superimposed and displayed on a vehicle traveling in an oncoming lane or a pedestrian on a sidewalk.

  On the other hand, as shown in FIG. 11A, when the display area 6 is narrow in the horizontal direction, it is not possible to superimpose and display a virtual image on a car traveling on an oncoming lane or a pedestrian on a sidewalk.

  FIG. 12 is an explanatory diagram illustrating a display example of the guidance screen based on the navigation information when the display area in FIG. 11 is enlarged.

  FIG. 12 schematically illustrates an example of a scene in front of the driver 5 of the vehicle 2 visually recognized from the driver's seat via the windshield 3 and a state of a virtual image in the display area 6 projected on the windshield 3. It is shown. Note that the dotted lines in the display area 6 indicate the display area when the display area 6 is not enlarged in the horizontal direction.

  FIG. 12 shows a state in which an arrow 300, a vehicle display 301, a pedestrian display 302, and the like are displayed in the display area 6 so as to be superimposed on a scene outside the vehicle. In addition, an icon of an instrument for displaying a vehicle speed or the like (characters of “30 km / h” in the figure, sometimes referred to as “vehicle speed display” below) and an arrow 300 guide the vehicle 2 until the vehicle 2 turns left. The distance (the character “10 m” in the figure) is displayed as a virtual image.

  The arrow 300 is an arrow for instructing and navigating the traveling direction of the vehicle 2 and the like, and is displayed so as to be superimposed on the road on which the vehicle 2 is traveling. The vehicle display 301 is a display indicating that there is a running vehicle. In the example of FIG. 12, the vehicle display 301 has a circular shape and is superimposed and displayed so as to surround the vehicle 200 traveling in the oncoming lane. The shape of the vehicle display 301 is not particularly limited, and may be any shape other than a circle, such as a triangle or a square.

  The pedestrian display 302 indicates that there is a pedestrian 201 walking on a sidewalk or the like, and the traveling direction of the pedestrian 201, respectively. In the example of FIG. 12, a circular pedestrian display 302 is superimposed and displayed below the feet of the pedestrian 201, and the traveling direction of the pedestrian 201 is indicated by an arrow. The shape of the pedestrian display 302 is not particularly limited, similarly to the vehicle display 301.

  The arrow 300 is generated based on the navigation information acquired by the ECU 21 from the vehicle information acquisition unit 10. The vehicle display 301 and the pedestrian display 302 are generated based on the camera video information and the infrared information acquired by the ECU 21 from the vehicle information acquisition unit 10. The vehicle speed display is generated based on the speed information acquired by the ECU 21 from the vehicle information acquisition unit 10.

  As described above, by expanding the display area 6 in the horizontal direction, for example, even when the vehicle 2 is in a straight traveling state, the pedestrian display 302 indicating the pedestrian 201 and the vehicle display 301 in the oncoming lane are displayed. The driver 5 can be informed, which can contribute to safe driving.

  On the other hand, when the display area 6 indicated by the dotted line in FIG. 12 is not expanded in the horizontal direction, the pedestrian 201 and the like are not included in the display area when the vehicle 2 is traveling straight because the display area is small. . Therefore, the display timing of the pedestrian display 302 is when the vehicle 2 turns left and the pedestrian 201 enters the display area indicated by the dotted line, and the timing for causing the driver 5 to detect the pedestrian 201 is delayed. Will be.

  FIG. 13 is an explanatory diagram showing an example in which there are a plurality of roads that can make a left turn when the vehicle makes a left turn by navigation guidance. FIG. 14 is an explanatory diagram showing a display example of the guidance screen based on the navigation information when the display area in the road configuration in FIG. 13 is enlarged.

  As shown by the solid line in FIG. 13, the virtual image display area 6 is enlarged in the horizontal direction, so that a guidance display for instructing and navigating the traveling direction of the vehicle 2 and the like can be displayed in a wider range. FIG. 13 shows a case where there are two roads that can make a left turn in a short distance, and the vehicle 2 makes a left turn not on the road in front but on the road behind it.

  When the display area 6 is not enlarged in the horizontal direction, the road that turns left is outside the display area and is not included in the display area, as indicated by the dotted line. On the other hand, in the case of the display area 6 enlarged in the horizontal direction, as shown by the solid line, not only the road on which the vehicle 2 turns left but also the road on which the vehicle 2 can turn left is included in the display area.

  Therefore, as shown in FIG. 14, the arrow 300, which is a guidance display for instructing and navigating the traveling direction and the like, can be displayed so as to be superimposed on the back road on which the vehicle turns left. In addition, the display area 6 in FIG. 14 additionally includes a vehicle speed display (characters of “30 km / h” in the figure), a distance to a road to turn left (characters of “20 m” in the figure), and a vehicle display 301. Are displayed as virtual images.

  Here, a left turn has been described as an example, but an arrow 300 or the like can be similarly displayed for a right turn so as to be superimposed on a road that turns right. In the example of FIG. 14, the right-turn road is not included in the display area 6. For example, when the road width of the road on which the vehicle 2 is running is narrow, the right-turn road is also included in the display area 6. . Alternatively, the left turn road may be included in the display area 6 by further expanding the display area 6 in the horizontal direction.

  When the display area 6 is not enlarged in the horizontal direction, the range indicated by the dotted line shown in FIG. 14 is the display area, and an arrow is displayed in the display area indicated by the dotted line. In this case, since the road to be turned left is not included in the display area, the driver 5 may be confused because it is not known which road on the front or the back is to turn left.

  On the other hand, according to the AR-HUD 1 in which the display area 6 is enlarged in the horizontal direction, the driver 5 can accurately understand that the driver turns left not on the front but on the back road. This is particularly effective when there are a plurality of roads that can make a left turn in a short distance, or when there are complicated and complicated roads.

  Thus, the driver 5 can accurately grasp the road on which the vehicle 2 travels and can concentrate on driving without being confused, thereby contributing to safe driving.

  FIG. 15 is an explanatory diagram showing another display example of the guidance screen based on the navigation information in the enlarged display area 6 of FIG.

  FIG. 15 also schematically shows an example of a scene in front of the driver 5 of the vehicle 2 viewed from the driver's seat and a virtual image in the display area 6 projected on the windshield.

  FIG. 15 illustrates a display example when the vehicle 2 approaches a crossing where no entry is allowed except in the designated direction.

  In FIG. 15, a sign 202 is provided on the front left side of the vehicle 2. The sign 202 is a road sign indicating that entry into a direction other than the designated direction is prohibited. Therefore, at the intersection, the vehicle 2 can travel only straight ahead and cannot enter any of the left-turn road and the right-turn road.

  In this case, in the display area 6, on the road on the left side of the intersection, an entry prohibition display 303 indicating that the road cannot be entered is superimposed on the road on the left turn side. The entry prohibition display 303, which is a regulation instruction display, is generated based on the recognition result by recognizing the meaning of the sign 202 from the camera video information outside the vehicle acquired from the vehicle information acquisition unit 10 by the ECU 21.

  Also in this case, since the display area 6 is expanded in the horizontal direction, the road on the left turn side of the intersection is included in the display area 6, and the entry prohibition display 303 can be displayed.

  Thereby, the driver 5 can accurately grasp the road on which entry is prohibited in a short time and can contribute to safe driving. Also, here, an example is shown in which the sign 202 is a road sign indicating that entry is prohibited except in the designated direction. However, other road signs, such as regulation signs and instruction signs, are similarly displayed according to the recognized road sign. Is displayed on the display area 6.

  For example, when the road on the left turn side of the intersection is a one-way street and there is a one-way road sign as a regulation sign, a display indicating that the road is a one-way street as a regulation instruction display, or as in FIG. The entry prohibition display 303 may be displayed. The display such as the entry prohibition display 303 shown in FIG. 15 is particularly effective when the driver 5 overlooks a road sign. In addition, an icon imitating a road sign (for example, entry prohibited except for the designated direction) can be displayed on the HUD. However, displaying the entry prohibited display 303 as shown in FIG. It is possible to recognize that the vehicle must not enter the road quickly. That is, the entry prohibition display 303 is displayed so as to be superimposed on an actual road, and it looks as if there is a false wall. Therefore, it is possible to intuitively convey that the user should not enter the road.

  FIG. 16 is an explanatory diagram showing another display example of the enlarged display area 6 in FIG.

  FIG. 16 shows a state in which the vehicle 200 is traveling in the lane opposite to the lane in which the vehicle 2 travels, and the vehicle 203 is traveling ahead of the vehicle 2 in the lane in which the vehicle 2 travels. In the display area 6, a vehicle display 301 and a vehicle display 305 are displayed, respectively.

  In addition, the traveling speed of the oncoming vehicle (the character "30 km / h" in the figure) and the inter-vehicle distance to the vehicle 203 traveling in front of the vehicle 2 (the character "10 m" in the figure) are displayed as virtual images. I have. The inter-vehicle distance is generated based on the distance information acquired by the ECU 21 from the vehicle information acquisition unit 10.

  The vehicle display 301 is a display indicating that there is a vehicle 200 traveling in the oncoming lane, and the vehicle display 305 is a display indicating that there is a vehicle 203 traveling in front of the vehicle 2. Also here, the vehicle display 301 has a circular shape, for example, and is superimposed and displayed so as to surround the vehicle 200. Similarly, the vehicle display 305 also has a circular shape, for example, and is superimposed and displayed so as to surround the vehicle 203.

  Further, the vehicle displays 301 and 305 are color-coded, for example, so as to distinguish whether the vehicle is traveling in the traveling lane or the vehicle traveling in the oncoming lane, that is, the oncoming vehicle. . Note that in FIG. 16, color classification is represented by the presence or absence of hatching.

  The vehicle displays 301 and 305 may be any display other than the color coding, for example, by changing the shape so as to be able to distinguish between the vehicle running ahead and the vehicle on the opposite lane.

  According to the AR-HUD 1 in which the display area 6 is enlarged in the horizontal direction, it is possible to display virtual images such as the arrow 300, the pedestrian display 302, and the vehicle display 305 on the oncoming lane, the sidewalk, and the intersecting road. Therefore, it is easy to accurately grasp the course, and it is easy to recognize the vehicles 200 and 203 and the pedestrian 201 traveling ahead or on the opposite side, which can contribute to safe driving.

  As described above, according to the AR-HUD 1 in which the display area 6 is enlarged in the horizontal direction, information necessary for safe driving can be accurately displayed without hindering driving, and thus it can contribute to safe driving. .

(Embodiment 2)
<Overview>
In the first embodiment, the display technique when the display area 6 by the AR-HUD 1 is expanded in the horizontal direction has been described. In the second embodiment, the display area 6 is not only displayed in the horizontal direction but also on the road surface. On the other hand, a description will be given of a display technique when the image is also expanded in a vertical direction (hereinafter, vertical direction).

  Note that the device configuration and the basic operation of the AR-HUD 1 are the same as those of the above-described first embodiment, and a description thereof will not be repeated.

  Since the display area 6 by the AR-HUD 1 extends not only in the horizontal direction but also in the vertical direction, the amount of information that can be displayed in the vertical direction increases. In view of this, at the upper part of the display area 6, traffic assistance information as second information is displayed, and at the lower part of the display area 6, priority information as first information is displayed.

  The traffic assistance information is information that assists the driving operation, such as traffic jam information, road information, or intersection information. The traffic jam information is information indicating a traffic jam situation on a road. The road information is information indicating, for example, a lane change. The intersection information is information such as the name of the intersection.

  The priority information is information relating to the driving operation which is prioritized over the traffic auxiliary information, and is, for example, a situation of another vehicle, a pedestrian, or the like, a road alignment, and the like, and is displayed as a virtual image superimposed on a real scene.

<Example of AR-HUD display>
FIG. 17 is an explanatory diagram showing an example of an area when the display area 6 by the AR-HUD 1 according to the second embodiment is enlarged in the horizontal direction and the vertical direction.

  In FIG. 17A, when the display area 6 is enlarged in the horizontal direction and the vertical direction, respectively, in addition to the display area 6 enlarged in the horizontal direction in the first embodiment, room for information display is newly provided in the upper part and the lower part. Will be born respectively. The area indicated by hatching in FIG. 17A is a new display area created by further expanding the display area 6 expanded in the horizontal direction in the vertical direction.

  The area near the upper end of the display area 6, which is obtained by enlarging the display area 6 not only in the horizontal direction but also in the vertical direction, is a portion corresponding to the view of the sky or a building, which is not significantly related to the driving operation, from the viewpoint of the driver 5. .

  On the other hand, an area lower than the upper part of the display area 6 (lower part of the display area 6) is an area where the driver 5 obtains information of a real scene directly connected to a driving operation such as a road, a traffic condition, or a road sign.

  Here, the upper part of the display area 6 is the second display area 6a, which is the area indicated by hatching in FIG. 17B, and the lower part of the display area 6 is the first display area 6b, which is shown in FIG. This is an area indicated by a dot in b).

  Accordingly, the second display area 6a displays, for example, traffic assistance information including auxiliary information for assisting the driving operation, information indicating operation status of an airplane or a railway, and information indicating an incoming call such as a telephone or an email. At the same time, priority information, which is important information directly connected to the driving operation, is displayed in the first display area 6b.

  Here, the second display area 6a is an area in which a virtual image that is not AR (Augmented Reality) is mainly displayed, and the first display area 6b is an area in which display is mainly performed by AR. is there. In the present embodiment, as an example, the traffic assistance information displayed in the second display area 6a is a virtual image other than the AR, and the priority information displayed in the first display area 6b is a virtual image display by the AR. Shall be.

  In addition, not only the priority information but also traffic assistance information such as the traveling speed of the vehicle 2 may be displayed in an area near the lower end of the first display area 6b. This region becomes the third display region 6c and is a region surrounded by a dotted line in FIG. In this third display area 6c, a virtual image that is not AR is mainly displayed.

  The second display area 6a for displaying traffic assistance information and the like may be any area that does not block information on the actual scene directly connected to the driving operation of the driver 5, and is limited to an area near the upper end of the display area 6. Not something.

  For example, the second display area 6a or (and) the third display area 6c may be enlarged, and the first display area 6b may be reduced accordingly, or the second display area 6a or (and) the third display area 6c may be reduced. The display area 6c may be omitted, and all may be the first display area 6b.

  When the area is enlarged or reduced, the area may be enlarged or reduced based on information obtained by, for example, capturing the situation in front of the area with a camera or the like. That is, when the presence of a vehicle, a pedestrian, or the like is detected ahead, it is necessary to display a virtual image of the AR with respect to the vehicle or the pedestrian, and thus the second display area 6a and / or the third display area Control is performed so that the first display area 6b is secured wide without expanding the area 6c.

  Conversely, when the presence of a vehicle, a pedestrian, or the like is not detected in front, it is not necessary to display a virtual image of the AR. Therefore, the second display area 6a or (and) the third display area 6c is enlarged and the first display area 6c is enlarged. Control may be performed to reduce the display area 6b.

  Furthermore, the area may be enlarged or reduced based on the speed information of the vehicle. For example, at the time of low-speed running or stopping, the second display area 6a or (and) the third display area 6c may be enlarged. Control is performed such that the first display area 6b is reduced, and the second display area 6a and / or the third display area 6c are eliminated or reduced during high-speed traveling to secure the first display area 6b as wide as possible. Good to do.

  FIG. 18 is an explanatory diagram showing an example of a display in the display area enlarged in the horizontal direction and the vertical direction in FIG. FIG. 19 is an explanatory diagram illustrating an example of display in the display area subsequent to FIG.

  FIG. 18A shows a state in which the vehicle 2 is traveling without occurrence of traffic congestion or the like, and FIG. 18B shows the state of the display area 6 during traveling in FIG. 18A. It shows a display example.

  FIG. 19 (a) shows that traffic congestion has occurred ahead of the running vehicle 2, and FIG. 19 (b) shows a table in a display area 6 for notifying that traffic congestion has occurred. This is a display example, and traffic congestion information of a road is displayed as traffic congestion occurs.

  First, in the driving state shown in FIG. 18A, in the second display area 6a of the display area 6, as shown in FIG. 18B, the sign information 310 indicating the vehicle traffic division is a virtual image as traffic assistance information. Is displayed in.

  Subsequently, as shown in FIG. 19A, when it is detected that traffic congestion has occurred at the destination of the vehicle 2, as shown in FIG. 19B, the sign information 310 and the sign information 310 are displayed in the second display area 6a. The traffic jam information 311 is displayed as traffic assistance information.

  The sign information 310 is generated based on camera video information and the like acquired by the ECU 21 from the vehicle information acquisition unit 10. The traffic jam information 311 is generated based on GPS information, VICS information, and the like.

  Here, the traffic assistance information such as the sign information 310 and the traffic congestion information 311 is merely information that assists during driving and does not have priority over the actual scene directly connected to the driving operation.

  For example, when the sign information 310 and the traffic congestion information 311 are displayed in an area where the actual scene directly related to the driving operation of the driver 5 is visible, that is, in the second display area, the line of sight of the driver 5 focuses on the information. There is a risk that driving will be neglected. In addition, since such information is not given priority over the actual scene directly related to the driving operation, it is not preferable to display the information in an area where the actual scene can be seen to reduce the visibility of the actual scene.

  On the other hand, in the display shown in FIG. 19 (b), it is possible to read information by a relatively small movement of a viewpoint from a part of the actual scene where the viewpoint is most concentrated during the driving without obstructing the field of view at the time of driving directly connected to the driving operation. it can. Therefore, it is possible to display traffic assistance information such as traffic congestion information while reducing distraction of the driver and without deviating the viewpoint for a long time from the actual scene that should be viewed during driving. In addition, while the vehicle 2 is traveling, as shown in FIG. 19B, by displaying only simple traffic jam information, it is possible to reduce a decrease in the driver's attention.

  FIG. 20 is an explanatory diagram showing an example of display in the second display area, and FIG. 21 is an explanatory diagram showing an example of display subsequent to FIG.

  FIG. 20 and FIG. 21 show display examples of the guidance screen based on the navigation information. Here, a case is shown in which the vehicle 2 is traveling straight and turns left at the next intersection according to navigation guidance.

  First, as shown in FIG. 20A, when the vehicle 2 is traveling straight ahead and the distance to the intersection where the vehicle turns left is greater than the threshold value, the second display area 6a displays the information shown in FIG. As shown in FIG. 7, only the sign information 310 indicating the vehicle traffic division is displayed as a virtual image as the traffic assistance information.

  Here, the threshold value is a distance for determining a timing for displaying a left-turn guidance screen. When the distance to the intersection to turn left reaches the threshold value, a left turn guidance screen is displayed.

  Thereafter, as shown in FIG. 21A, when the distance from the vehicle 2 to the intersection where the vehicle turns left becomes equal to or smaller than the threshold value, as shown in FIG. Guidance information 312 indicating that the vehicle is turning left at an intersection is displayed as AR as superimposed on the traveling road as priority information. The process of determining the threshold value and the process of generating the guidance information 312 are performed based on the GPS information and the like acquired by the ECU 21 from the vehicle information acquisition unit 10.

  20 and FIG. 21 show an example in which the guidance screen is switched in two steps by one threshold value. For example, when the distance to the intersection where the vehicle turns left is larger than the threshold value 1, the traffic assistance information is displayed. If the threshold value is equal to or less than the threshold value 1 and greater than the threshold value 2, traffic assistance information is displayed. And so on.

  FIG. 22 is a diagram showing another display example of FIG.

  In FIG. 19, when only the simple traffic jam information is displayed in the second display area 6b when the vehicle 2 is running, the traffic jam of the driver 5 is not interrupted to the driver 5 without interrupting the actual scene directly connected to the driving operation. Although an example in which the situation is simply notified has been described, a display example when the vehicle 2 stops thereafter will be described with reference to FIG.

  After the traffic information is received and before the vehicle 2 stops before reaching the traffic congestion point, as shown in FIG. 22, for example, detailed traffic information and detour information are displayed in the second display area 6a. The detailed information 313 including a proposal is displayed as traffic assistance information. Further, when the detailed information 313 cannot be accommodated only in the second display area 6a due to a large amount of information, the detailed information 313 may be displayed so as to cover the first display area 6b.

  When the vehicle 2 is stopped, there is no problem even if the actual scene directly connected to the driving operation is somewhat obstructed from the field of view of the driver 5, and thus the visibility of the detailed information 313 can be improved. Thereby, the driver 5 can securely confirm the detailed display.

  Next, an example of cooperative display in the first and second display areas of the display area 6 will be described.

  FIG. 23 is an explanatory diagram showing an example of the cooperative display operation in the display area by the AR-HUD of FIG.

  FIG. 23 shows priority information in the first display area 6b from the state where the sign information 310 indicating the vehicle traffic division is displayed as the traffic auxiliary information in the second display area 6a while the vehicle 2 is traveling. This shows a display example until the guidance information 312 is displayed in an AR. The guidance information 312 in FIG. 23 is a guidance display for lane change that prompts the driver to move from the lane in which the vehicle 2 is traveling to the leftmost lane.

  First, as shown in “phase 1” on the left side of FIG. 23, when the vehicle 2 is traveling straight, only the sign information 310 indicating the vehicle traffic division is displayed in the second display area 6a. .

  Thereafter, as shown in the center “phase 2” of FIG. 23, when the distance to the intersection where the vehicle 2 turns left becomes 250 m, the display of the sign information 310 in the second display area 6a gradually decreases and the first In the display area 6b, guidance information 312 for prompting a lane change in which the vehicle 2 moves to the left lane is superimposed on the road and displayed in an AR manner so that the display gradually becomes darker.

  Here, an example is shown in which the display indicated by “phase 2” is executed when the distance to the intersection to turn left is, for example, about 250 m, but the distance is not limited to this.

  Subsequently, as shown in “phase 3” on the right side of FIG. 23, when the vehicle 2 reaches a distance of 200 m to the intersection where the vehicle 2 turns left, the display of the sign information 310 in the second display area 6a is deleted and the first display area 6a is deleted. In the display area 6b, guidance information 312 urging lane change to move to the lane is completely displayed on the left side. Also in this case, the display of “phase3” indicates that the distance to the left-turn intersection is, for example, about 200 m, but the distance is not limited to this.

  Also, after the vehicle 2 changes lanes, the display of the sign information 310 is displayed so as to gradually increase while the display of the guide information 312 gradually decreases, and then the display of the guide information 312 is turned off and the sign information is deleted. The display of 310 is completely displayed. That is, the display is performed in the order of “phase3”, “phase2”, and “phase1” so as to be the reverse of FIG. In this case as well, the respective display timings from “phase3” to “phase2” and “phase2” to “phase1” may be changed depending on the distance as in FIG. 23, or may be displayed on condition of time. May be changed.

  This can prevent the guide information 312 from being displayed suddenly in the first display area 6b. If the guidance information 312 suddenly enters the field of view at the time of driving that is directly related to the driving operation, the driver 5 may be surprised or the driving may be disturbed, which may cause an accident or the like, but the display is changed stepwise like this. This can be prevented.

  FIG. 24 is an explanatory diagram illustrating an example where the viewpoint position of the virtual image display in the second display area is near. FIG. 25 is an explanatory diagram showing an example of display for reducing an increase in viewpoint movement in the second display area by the AR-HUD of FIG.

  As described above, the second display area 6a is a portion corresponding to a view of the sky, a building, or the like that has little relation to the driving operation as viewed from the driver 5, and is displayed in the second display area 6a. It is assumed that there is a lot of traffic auxiliary information that does not need to be superimposed on the actual scene.

  However, when the traffic assistance information displayed in the second display area 6a is displayed at a near viewpoint position, the viewpoint movement of the driver 5 becomes large, which may hinder driving.

  For example, as shown in the upper part of FIG. 24, the viewpoint position DD of the driver 5 is about 30 m, and the viewpoint position VD of the sign information 310 which is the traffic auxiliary information of the virtual image displayed in the second display area 6a is about 30 m. In the case of 2 m, in order to read the traffic assistance information from the viewpoint position 30 m ahead to the viewpoint position 2 m ahead, as shown in the lower part of FIG. 24, a large viewpoint movement from front to back 30 m to near 2 m is necessary. Will be. If a large viewpoint is moved back and forth during driving, eye strain may be promoted, or an accident may be caused by overlooking information that should be viewed during driving.

  On the other hand, as shown in the upper part of FIG. 25, the viewpoint position DD of the driver 5 is about 30 m, and the viewpoint position VD of the sign information 310 which is the traffic auxiliary information of the virtual image displayed in the second display area 6a is Similarly, when the distance is about 30 m, as shown in the lower part of FIG. 25, since the viewpoint position DD and the viewpoint position VD are almost the same position, the driver 5 recognizes the traffic assistance information without moving back and forth the viewpoint. be able to.

  In this way, when recognizing the traffic assistance information, the movement of the front and rear viewpoints can be significantly reduced, so that the information transmission speed can be improved, and the driver 5 has eyestrain and distraction. Can be reduced.

  FIG. 26 is an explanatory diagram showing an example of a display for reducing oversight of a road sign in a display area by the AR-HUD of FIG.

  In this case, as shown on the left side of FIG. 26, a guide sign is displayed on the sign 202 at a point where the distance between the viewpoint position of the driver 5 and the distance from the vehicle 2 to the sign 202 is almost the same. Are superimposed and displayed.

  In this case, as shown in FIG. 26, the sign 202 is a guide sign installed at a portion corresponding to a scene such as the sky. Therefore, when the sign 202 naturally enters the eyes of the driver 5, the virtual image of the sign display 315 is superimposed on the sign 202 and displayed. For example, when the distance of the viewpoint of the driver 5 is about 30 m, the sign display 315 is displayed when the distance from the vehicle 2 to the sign approaches about 30 m.

  The sign display 315 is a virtual image display indicating that there is a road sign. FIG. 26 shows an example in which an arrow that surrounds the sign 202 in a circle and makes the sign display 315 noticeable is displayed as a sign image 316 as a virtual image. The shape of the virtual images of the sign displays 315 and 316 is not particularly limited, and may be any shape.

  The traffic sign such as the sign 202 is recognized by the camera image information or the like acquired by the ECU 21 from the vehicle information acquisition unit 10. Further, the distance to the sign 202 is recognized based on infrared information or the like acquired by the ECU 21 from the vehicle information acquisition unit 10.

  When the vehicle 2 approaches the sign 202, for example, when the virtual images of the sign displays 315 and 316 are superimposed and displayed when, for example, the distance between the vehicle 2 and the sign 202 is about 5 m, the driver 5 sets the focal position. It has to be changed a lot and recognition takes time. Further, since the distance to the sign 202 is as short as about 5 m, there is a possibility that the sign 202 will pass before the sign 202 is recognized. That is, the virtual image shown in FIG. 26 exhibits a greater effect by displaying when the sign is at a distance such as 30 m. When the distance from the sign becomes a short distance such as 5 m, it should rather avoid displaying a virtual image superimposed on the sign. The reason is that the sign itself becomes difficult to see due to the virtual image.

  In this way, by displaying the sign displays 315 and 316 at a distance substantially equal to the distance of the viewpoint position of the driver 5, the driver 5 can recognize the sign 202 without moving the viewpoint back and forth. , Oversight of the sign 202 can be reduced.

  FIG. 27 is an explanatory diagram showing an example of a display according to the degree of risk of a road condition in the display area by the AR-HUD of FIG.

  FIG. 27 shows an example of a scene in front of the driver's seat viewed through the windshield 3 and a virtual image in the display area 6 projected on the windshield 3.

  The state shown on the left side of FIG. 27 is the state with the lowest risk in the road condition (hereinafter referred to as low risk), and the state shown on the right side of FIG. 27 is the state with the highest risk (hereinafter high risk). Is shown). The state shown in the center of FIG. 27 indicates a state in which the risk is higher than the risk is low and the risk is lower than the risk is high (hereinafter, referred to as medium risk).

  First, when the degree of risk is low, guidance by navigation is provided, and in the display area 6, guidance information 312 indicating that the vehicle is to turn left at the next intersection superimposed on the road is displayed as a virtual image. Is a state where the pedestrian 201 is walking on the sidewalk of.

  In this case, the risk is set low because the pedestrian 201 is on the sidewalk on the opposite lane side and is far from the vehicle 2.

  In the display area 6, as described above, the guide information 312 indicating that the vehicle is to turn left at the next intersection is displayed so as to be superimposed on the road in the traveling lane, and the pedestrian 201 exists on the pedestrian 201 on the sidewalk. Is displayed so as to be superimposed on the pedestrian 201.

  The pedestrian alert display 320 has a shape such as an arrow, and is displayed so as to point to the pedestrian 201 with the arrow. The pedestrian warning display 320 is displayed when a pedestrian is detected, and is used when the distance from the vehicle 2 to the pedestrian 201 is equal to or greater than a preset distance or when the pedestrian 201 is on the side of the oncoming lane. Displayed when you are in When the vehicle 2 passes by the pedestrian 201, the pedestrian alert display 320 is deleted.

  The shape of the pedestrian alert display 320 is not particularly limited, and may be other than the arrow shape.

  Subsequently, during the danger level, the pedestrian 201 has moved to the vicinity of the crosswalk at the intersection where the vehicle 2 turns left. In this case, the pedestrian display 302 is superimposed on the pedestrian 201 in the display area 6 as in FIG.

  Here, since the distance from the vehicle 2 to the pedestrian 201 is shorter than the preset distance, or because the pedestrian 201 is near the pedestrian crossing, the danger is higher during the danger. I have.

  When the risk is low, the guide information 312 is displayed superimposed along the road. However, when the risk is medium, the guide information 312 is not superimposed along the road. That is, the image is displayed in the second display area 6a. In other words, the guidance information 312 is displayed at the top, and the presence of the pedestrian 201 is displayed so as to be more strongly appealing.

  Thereby, since the area where the guide information 312 and the pedestrian display 302 are displayed is distinguished, the driver 5 can more easily recognize the presence of the pedestrian 201. Further, it is possible to strongly appeal to the driver 5 that the pedestrian 201 is present while continuing the navigation guidance.

  Subsequently, when the degree of danger is high, the pedestrian 201 has moved to the road on which the vehicle 2 travels instead of the sidewalk. In this case, since the pedestrian 201 is not on the sidewalk but on the road on which the vehicle 2 runs, the degree of danger is the highest.

  At this high risk level, the guidance information 312 displayed in the middle of the risk level is deleted from the display area 6. On the pedestrian 201, a pedestrian display 302 is displayed in a superimposed manner, and a virtual image warning information 321 which is a display for warning that the pedestrian 201 is nearby and high in danger is displayed near the pedestrian 201. It is superimposed and displayed. Further, the guidance by the navigation is stopped and the guidance information 312 is erased in order to further emphasize that the driver 2 has a high danger.

  When the vehicle 2 passes through the pedestrian, the pedestrian display 302 and the warning information 321 are erased, and guidance by navigation is restarted.

  In this way, by changing the display of the guidance by the navigation and the display of the warning according to the degree of danger, it is possible to urge the driver 5 to pay attention to a warned event (here, a pedestrian). If the degree of danger is not high, guidance by navigation can be continued in parallel with the warning, so that the driver 5 can be prevented from getting lost. Further, the guidance by the navigation is seamlessly moved from the lower part (the first display area) of the display area to the upper part (the second display area) or from the upper part to the lower part according to the degree of danger. The amount of change in the display is reduced as compared with the case where the display is turned off or off, so that it is possible to prevent the driver 5 from being surprised by the change in the display and becoming distracted.

  Next, a navigation guidance display when the vehicle 2 turns around an intersection will be described.

  When turning around an intersection, there are many points that the driver 5 needs to pay attention to, such as the situation of a pedestrian or an oncoming vehicle. In such a case, the navigation guidance is not displayed in the first display area 6b within the intersection. This is because if the driver 5 is distracted by the guidance display of the navigation, the driver may overlook the above-mentioned cautions and the like.

  FIG. 28 is an explanatory diagram showing an example of guidance display for navigation at an intersection in a display area by the AR-HUD of FIG.

  The upper part of FIG. 28 shows the traveling state of the vehicle 2, and the left side shows that the vehicle 2 is traveling before turning at the intersection, that is, before the intersection. The center portion shows a state where the vehicle 2 is turning left at the intersection, that is, traveling in the intersection. The right side shows the traveling state of the vehicle 2 after completing the left turn at the intersection, that is, after passing through the intersection.

  In the lower part of FIG. 28, from left to right, in the running state of the vehicle 2, the front scenery visually recognized from the driver's seat via the windshield 3 and the display area 6 projected on the windshield 3. The state of the virtual image in each is shown.

  First, on the left side of FIG. 28, in the first display area 6b, guidance information 312 indicating that the vehicle is to turn left at the next intersection is displayed in an AR manner superimposed on the road. Then, as shown in the center of FIG. 28, when the vehicle 2 approaches the intersection, the guidance information 312 displayed in the first display area 6b is deleted, and the new guidance information 312 is replaced with the driving operation. Are displayed in the second display area 6a, which is a part that has little relation. Alternatively, the guidance information 312 may not be displayed in the second display area 6a.

  Here, the determination as to whether the vehicle 2 is approaching the intersection is made based on, for example, steering wheel angle information, navigation information, camera image information outside the vehicle, and the like acquired by the ECU 21 from the vehicle information acquiring unit 10.

  When the left turn of the vehicle 2 is completed, the guidance information 312 is displayed again in the AR in the first display area 6b as shown on the right side of FIG. Here, the guidance information 312 is information indicating that the vehicle is going straight ahead on a left-turned road.

  Accordingly, when turning around the intersection, the driver 5 can travel in a safe state because the target to which attention should be paid while traveling at the intersection is not obstructed by the virtual image display. Furthermore, since the guidance by the navigation moves seamlessly from the lower part (the first display area) of the display area to the upper part (the second display area) or from the upper part to the lower part according to the traveling state of the intersection, the guidance by the navigation The amount of change in the display is reduced as compared with the disappearance or disappearance of the display, and it is possible to prevent the driver 5 from being surprised by the change in the display and becoming distracted.

  So far, display examples in the second display area 6a and the first display area 6b of the display area 6 have been described, but these displays may be customized by the user.

  FIG. 29 is an explanatory diagram showing an example of a menu for customizing the display in the display area by the AR-HUD in FIG.

  In the example of FIG. 29, menus of “upper / lower display”, “upper display”, and “lower display” are provided as display selection examples in the display area 6. In “upper and lower display”, a virtual image is displayed in all of the second display area 6a and the second table area 6b shown in FIG.

  The "upper display" displays only the second display area 6a, that is, displays only traffic assistance information including auxiliary information for assisting the driving operation. The "lower display" displays only the first display area 6b, that is, displays only priority information which is important information directly connected to the driving operation.

  The driver 5 can arbitrarily select the content to be displayed by selecting the display method of the virtual image displayed in the display area 6 from the menu in FIG. In FIG. 29, the menu is such that only the display area in the display area 6 is selected. However, various menus such as changing the transmittance of information displayed in the second display area 6a, changing the display size of information, and the like are used. A menu may be prepared. Further, the selection menu is not limited to the above-described selection example, and may be another selection menu.

  As described above, the driver 5 can easily distinguish and recognize the display of the traffic auxiliary information and the priority information that is more important than the traffic auxiliary information. In addition, the driver 5 can recognize the traffic assistance information and the priority information without hindering driving. This can contribute to safe driving.

  As described above, the invention made by the inventor has been specifically described based on the embodiment. However, the present invention is not limited to the embodiment, and various modifications can be made without departing from the gist of the invention. Needless to say.

  Note that the present invention is not limited to the above-described embodiment, and includes various modifications. For example, the above-described embodiments have been described in detail for easy understanding of the present invention, and are not necessarily limited to those having all the configurations described above.

  In addition, a part of the configuration of one embodiment can be replaced with the configuration of another embodiment, and the configuration of one embodiment can be added to the configuration of another embodiment. . Further, for a part of the configuration of each embodiment, it is possible to add, delete, or replace another configuration.

1 AR-HUD
2 vehicle 3 windshield 4 vehicle information 5 driver 6 display area 10 vehicle information acquisition unit 20 control unit 21 ECU
Reference Signs List 22 Audio output unit 23 Nonvolatile memory 24 Memory 25 Light source adjustment unit 26 Distortion correction unit 27 Display element driving unit 28 Display distance adjustment unit 29 Mirror adjustment unit 30 Video display device 31 Light source 32 Illumination optical system 33 Display element 40 Display distance adjustment mechanism Reference Signs List 50 mirror driving unit 51 mirror 52 mirror 60 speaker 101 vehicle speed sensor 102 shift position sensor 103 steering wheel angle sensor 104 headlight sensor 105 illuminance sensor 106 chromaticity sensor 107 distance measurement sensor 108 infrared sensor 109 engine start sensor 110 acceleration sensor 111 gyro sensor 112 Temperature sensor 113 Roadside-vehicle communication wireless receiver 114 Vehicle-to-vehicle communication wireless receiver 117 GPS receiver 118 VICS receiver 281 Functional liquid crystal film ON / OFF control unit 282 Lens movable unit 283 Dimming Ra ON / OFF control unit 284 diffusing plate movable part 285 optical filter moving unit 401 functional liquid crystal film 402 lens moving mechanism 403 switchable mirror 404 diffusion plate moving mechanism 405 optical filter moving mechanism

Claims (14)

A head-up display device that displays a virtual image by projecting an image on a windshield of a vehicle so as to be superimposed on a scene in front of the vehicle for a driver,
A vehicle information acquisition unit that acquires various vehicle information that can be detected by the vehicle,
Based on the vehicle information acquired by the vehicle information acquisition unit, a control unit that controls the display of the video displayed in a display area visually recognized from the driver's seat of the vehicle through the windshield,
A video display device that generates the video based on an instruction from the control unit,
A mirror that reflects the image generated by the image display device and projects the image on the windshield,
A mirror driving unit that changes an angle of the mirror based on an instruction from the control unit;
A display distance adjustment mechanism for adjusting a display distance of the virtual image to a driver;
Has,
The display area controlled by the control unit,
A first display area;
A second display area that is an area above the first display area;
Has,
The first display area is an area where augmented reality can be displayed,
The head-up display device, wherein the second display area is an area where the display of the augmented reality is not performed. The head-up display device according to claim 1,
The first display area displays first information,
The head-up display device, wherein the second display area displays second information having a lower priority than the first information. The head-up display device according to claim 2,
The first information is safe driving support information that is information that supports safe driving,
The head-up display device, wherein the second information is driving support information that is information that supports driving behavior. The head-up display device according to claim 3,
The safe driving support information displayed in the first display area has a guidance display indicating a destination of the vehicle,
The control unit generates the guidance display based on the navigation information included in the vehicle information acquired by the vehicle information acquisition unit, and generates the guidance display on a road where the vehicle turns left or a road where the vehicle turns right. A head-up display device that displays augmented reality to be superimposed on the image. The head-up display device according to claim 3 or 4,
The safe driving support information displayed in the first display area has a pedestrian display indicating the presence of a pedestrian,
The control unit recognizes the pedestrian based on camera video information included in the vehicle information acquired by the vehicle information acquisition unit, and performs augmented reality display in which the pedestrian display is superimposed on the recognized pedestrian. , Head-up display device. The head-up display device according to claim 3,
The safe driving support information displayed in the first display area has a guide display indicating a destination of the vehicle and a pedestrian display indicating the presence of a pedestrian,
The control unit generates the guidance display based on the navigation information included in the vehicle information acquired by the vehicle information acquisition unit, and generates the guidance display on a road where the vehicle turns left or a road where the vehicle turns right. Augmented reality to be superimposed on the pedestrian is recognized based on the camera image information of the vehicle information, and the augmented reality to be superimposed on the recognized pedestrian is displayed. A head-up display device, wherein the guide display displayed in the first display area is displayed in the second display area when the risk is determined to be high. The head-up display device according to claim 3,
The safe driving support information displayed in the first display area has a guide display indicating a destination of the vehicle and a pedestrian display indicating the presence of a pedestrian,
The control unit generates the guidance display based on the navigation information included in the vehicle information acquired by the vehicle information acquisition unit, and generates the guidance display on a road where the vehicle turns left or a road where the vehicle turns right. Augmented reality to be superimposed on the pedestrian is recognized based on the camera image information of the vehicle information, and the augmented reality to be superimposed on the recognized pedestrian is displayed. A head-up display device that determines the degree of danger from the information and deletes the guidance display when the danger is determined to be high. The head-up display device according to claim 4,
The control unit, based on the steering angle information, navigation information, and camera video information that the vehicle information acquired by the vehicle information acquisition unit has determined based on whether the vehicle is turning left or right, A head-up display device, wherein the guide display displayed in the first display area is displayed in the second display area when it is determined that the vehicle is turning left or right. The head-up display device according to any one of claims 4 to 7,
The driving support information displayed in the second display area has a guide sign display indicating the presence of a guide sign,
The control unit performs display of augmented reality by recognizing the guide sign based on camera video information included in the vehicle information acquired by the vehicle information acquisition unit and superimposing the guide sign display on the recognized guide sign. , Head-up display device. A head-up display device that displays a virtual image by projecting an image on a windshield of a vehicle so as to be superimposed on a scene in front of the vehicle for a driver,
A vehicle information acquisition unit that acquires various vehicle information that can be detected by the vehicle,
Based on the vehicle information acquired by the vehicle information acquisition unit, a control unit that controls the display of the video displayed in a display area visually recognized from the driver's seat of the vehicle through the windshield,
A video display device that generates the video based on an instruction from the control unit,
A mirror that reflects the image generated by the image display device and projects the image on the windshield,
A mirror driving unit that changes an angle of the mirror based on an instruction from the control unit;
A display distance adjustment mechanism for adjusting a display distance of the virtual image to a driver;
Has,
The control unit is configured to generate a guidance display indicating a travel destination of the vehicle based on navigation information included in the vehicle information acquired by the vehicle information acquisition unit, and to generate the guidance display on a road on which the vehicle turns left or A head-up display device for displaying augmented reality superimposed on a road on which the vehicle turns right. The head-up display device according to claim 10,
The control unit is configured to recognize a pedestrian based on camera video information included in the vehicle information acquired by the vehicle information acquisition unit, and to superimpose a pedestrian display indicating the presence of the pedestrian on the recognized pedestrian. A head-up display device that displays reality. The head-up display device according to claim 10 or 11,
The control unit, based on camera image information included in the vehicle information acquired by the vehicle information acquisition unit, determines whether there is another vehicle, when the other vehicle is present, A head-up display device that generates a vehicle display indicating that a vehicle is present, and displays augmented reality in which the generated vehicle display is superimposed on the other vehicle. The head-up display device according to claim 12,
The control unit generates the vehicle display such that the vehicle driven by the driver and the vehicle in the opposite traveling direction to the vehicle driven by the driver can be identified from the vehicle in the same traveling direction as the vehicle driven by the driver. Display device. The head-up display device according to any one of claims 10 to 12,
The control unit determines the meaning of the road sign of the regulation sign or the instruction sign based on the camera image information included in the vehicle information acquired by the vehicle information acquisition unit, and a regulation instruction corresponding to the determined meaning of the road sign. A head-up display device that generates a restriction instruction display that is a display indicating the augmented reality and displays the generated restriction instruction display on the road corresponding to the road sign.

Images