JPWO2019130860A1 - Head-up display device and control program - Google Patents

Abstract

Allows the driver to intuitively grasp the driving situation of the moving object. The head-up display device 10 acquires the running status of the moving body 800 equipped with the head-up display device 10 by the running status acquisition unit 73, and from the acquired running status, an image of the virtual moving body f1 imitating the moving body 800. Is created and displayed on the drawing device 21, so that the virtual moving body f1 is projected and displayed forward as a virtual image.

Description

The present invention relates to a head-up display device and a control program.

In a conventional head-up display (hereinafter, also simply referred to as "HUD"), it is common to generate a virtual image at a position separated from the driver by a certain distance. The contents displayed by this HUD were limited to the operating speed of the vehicle and simple navigation.

For example, in the HUD device disclosed in Patent Document 1, the search results from the navigation database are displayed in a character string expressed in perspective according to the road surface shape.

Further, in the HUD device disclosed in Patent Document 2, navigation information such as a right turn direction and a street name regarding an intersection is displayed when the intersection is approached by a predetermined distance.

Japanese Unexamined Patent Publication No. 2012-357884 Japanese Unexamined Patent Publication No. 2014-52345

However, in Patent Documents 1 and 2, only character information and arrows are displayed, and it is difficult for the driver of the vehicle to intuitively grasp the driving situation.

The present invention has been made in view of the above circumstances, and an object of the present invention is to provide a head-up display device capable of intuitively grasping a traveling state of a moving body such as a vehicle.

The above object of the present invention is achieved by the following means.

(1) A head-up display device mounted on a moving moving body.
A drawing device that displays an image based on image data,
A virtual image projection optical system including an intermediate screen, which forms an image displayed by the drawing device on the intermediate screen, converts the formed intermediate image into a virtual image, and projects and displays the image.
A traveling status acquisition unit that acquires the traveling status of the moving body,
By creating an image of a virtual moving body imitating the moving body and displaying it on the drawing device according to the running situation acquired by the running state acquisition unit, the virtual moving body is regarded as a virtual image of the moving body. A head-up display device including a display control unit that projects and displays forward.

(2) The traveling condition acquisition unit acquires the traveling speed of the moving body as the traveling condition, and obtains the traveling speed of the moving body.
The head-up display device according to (1) above, wherein the display control unit changes the virtual moving body according to a difference between the traveling speed and a preset reference speed.

(3) The traveling condition acquisition unit acquires the traveling speed of the moving body as the traveling condition, and obtains the traveling speed of the moving body.
In the above (1) or (2), the display control unit displays the virtual moving body larger as the traveling speed becomes faster, and makes the virtual moving body smaller as the traveling speed becomes slower. The head-up display device described.

(4) Further, a moving mechanism for changing the position of the intermediate screen in the optical axis direction is provided.
The virtual image projection optical system projects and displays a virtual image at a virtual image distance corresponding to the position of the intermediate screen changed by the moving mechanism.
The traveling condition acquisition unit acquires the traveling speed of the moving body as the traveling condition, and obtains the traveling speed of the moving body.
The display control unit displays any of the above (1) to (3), wherein the faster the traveling speed, the shorter the virtual image distance of the virtual moving body, and the slower the traveling speed, the longer the virtual image distance. The head-up display device according to one.

(5) The traveling condition acquisition unit acquires operation information regarding the position and route of the moving body from the car navigation system as the traveling condition.
Based on the operation information acquired by the traveling status acquisition unit, the display control unit changes the direction of the virtual moving body to an image corresponding to any of straight ahead, right turn, and left turn, and displays the projection. The head-up display device according to any one of 1) to (4) above.

(6) A head-up display device mounted on a moving moving body, including an intermediate screen, an image displayed by a drawing device is formed on the intermediate screen, and the formed intermediate image is converted into a virtual image. A control program for causing a computer to control a virtual image projection optical system to be projected and displayed, and a head-up display device including a traveling status acquisition unit for acquiring the traveling status of the moving body.
The step (a) of acquiring the traveling status of the moving body by the traveling status acquisition unit,
By creating an image of a virtual moving body imitating the moving body and displaying it on the drawing device according to the traveling situation acquired in step (a), the virtual moving body is regarded as a virtual image in front of the moving body. Step (b) to be projected and displayed on
A control program for causing the computer to execute.

(7) In the step (a), the traveling condition acquisition unit acquires the traveling speed of the moving body as the traveling condition.
In step (b), the control according to (6) above, wherein the virtual image of the virtual moving body is changed according to the difference between the traveling speed acquired in step (a) and the preset reference speed. program.

(8) In the step (a), the traveling condition acquisition unit acquires the traveling speed of the moving body as the traveling condition.
In the step (b), the faster the traveling speed acquired in the step (a), the larger the virtual moving body is displayed, and the slower the traveling speed is, the smaller the virtual moving body is displayed. 6) or the control program according to (7) above.

(9) The head-up display device further includes a moving mechanism that changes the position of the intermediate screen in the optical axis direction, and the virtual image projection optical system responds to the position of the intermediate screen changed by the moving mechanism. The virtual image is projected and displayed at the virtual image distance.
In the step (a), the traveling condition acquisition unit acquires the traveling speed of the moving body as the traveling condition.
In the step (b), the faster the traveling speed acquired in the step (a), the shorter the virtual image distance of the virtual moving body, and the slower the traveling speed, the longer the virtual image distance. ) To the control program according to any one of the above (8).

(10) In the step (a), the traveling status acquisition unit acquires operation information regarding the position and route of the moving body as the traveling status.
In the step (b), based on the operation information acquired in the step (a), the direction of the virtual moving body is changed to an image corresponding to any of straight ahead, right turn, and left turn, and projected and displayed. The control program according to any one of 6) to (9) above.

According to the head-up display device according to the present invention, the running status acquisition unit acquires the running status of the moving body equipped with the head-up display device, and the image of the virtual moving body imitating the moving body is obtained from the acquired running status. Is created and displayed on the drawing device, so that the virtual moving object is projected and displayed forward as a virtual image. By doing so, the user can intuitively grasp the traveling situation of the moving body.

It is a side sectional view which shows the state which the head-up display device is mounted on a vehicle. It is the schematic which looked at the vehicle equipped with the head-up display device from the inside. It is a schematic diagram which shows the structure of the virtual image display device. It is a block diagram which shows the hardware structure of the head-up display device. It is a flowchart which shows the display process which the head-up display apparatus which concerns on 1st Embodiment executes. It is a display example of the virtual moving body in step S103. It is a display example of the virtual moving body in step S104. It is a display example of the virtual moving body in step S105. It is a flowchart which shows the display process which the head-up display apparatus which concerns on 2nd Embodiment executes. It is a perspective view which shows the display state of the virtual moving body which changed the virtual image distance in step S203. It is a perspective view which shows the display state of the virtual moving body which changed the virtual image distance in step S204. This is a display example of a virtual moving object when driving at night. 6 is a flowchart showing a display process executed by the head-up display device according to the third embodiment. It is a display example of the virtual moving body in step S303. This is a display example of a virtual moving body in a modified example.

Hereinafter, embodiments of the present invention will be described with reference to the accompanying drawings. In the description of the drawings, the same elements are designated by the same reference numerals, and duplicate description will be omitted. In addition, the dimensional ratios in the drawings are exaggerated for convenience of explanation and may differ from the actual ratios. Further, in the drawing, the vertical direction is the Y direction, the direction parallel to the traveling direction of the vehicle is the Z direction, and the direction orthogonal to these Y and Z directions is the X direction when the virtual image display device is mounted on the vehicle. Further, the Z direction corresponds to the optical axis direction, and the X and Y directions correspond to the horizontal and vertical directions of the display element, respectively.

(Head-up display device)
1 and 2 are schematic views illustrating a usage state in which the head-up display device 10 according to the present embodiment is mounted in the vehicle body 811 of the vehicle 800. The user (driver) 900 is driving (operating) the vehicle 800 while holding the steering wheel 813 and sitting in the driver's seat 816. As shown in FIGS. 1 and 2, the virtual image display device 20 of the head-up display device 10 displays the image information displayed on the display element 21 described later as a virtual image f toward the user 900 via the display screen 225. Project and display.

(Virtual image display device)
The configuration other than the display screen 225 of the virtual image display device 20 is installed so as to be embedded in the dashboard 814 of the vehicle body 811 behind the display 815 of the car navigation system 83. The virtual image display device 20 emits a display light D1 corresponding to a virtual image including driving-related information, a virtual moving body, and the like toward the display screen 225 along the optical axis AX. The display screen 225 is a semitransparent concave mirror or a plane mirror. The display screen 225 may function as a combiner or a windshield, or may have both functions. Moreover, the member having these functions may be provided separately. The display screen 225 is erected on the dashboard 814 by the support at the lower end, and reflects the display light D1 from the virtual image display device 20 toward the rear side (Z direction) of the vehicle body 811. That is, in the case of the illustration, the display screen 225 is a stand-alone type that is installed separately from the front window 812. The display light D1 reflected by the display screen 225 is guided to the pupil 910 of the user 900 sitting in the driver's seat 816 and the Eyebox (not shown) corresponding to the peripheral position thereof. The Eyebox is set to correspond to the position of the pupil 910 of the user 900 sitting in the driver's seat 816 with the head-up display device 10 mounted on the vehicle 800. The user 900 can observe the display light D1 reflected by the display screen 225, that is, the virtual image f as a display image separated by a predetermined distance (virtual image distance) as if it were in front of the vehicle body 811. On the other hand, the user 900 can observe the outside light transmitted through the display screen 225, that is, the front view, the real image of the automobile, and the like. As a result, the user 900 includes driving-related information, a virtual moving body, and the like formed by the reflection of the display light D1 on the display screen 225, superimposed on the external world image behind the display screen 225, that is, the see-through image. The virtual image f can be observed.

FIG. 3 is a schematic view showing the configuration of the virtual image display device 20. As shown in FIG. 3, the virtual image display device 20 includes a display element 21, a virtual image projection optical system 22, a housing 23, and a moving mechanism 25. Each component of the virtual image display device 20 other than the display screen 225 is housed in the housing 23.

The display element 21 as a drawing device has a two-dimensional display surface 21a. The image formed on the display surface 21a is projected as an intermediate image i by the virtual image projection optical system 22, and then enlarged and converted into an Eyebox as a virtual image f and projected and displayed. At this time, by using the display element 21 capable of two-dimensional display, the projection image can be switched to the intermediate screen 222 at a relatively high speed. The display element 21 may be a reflective element such as a DMD (Digital Micromirror Device) or LCOS (Liquid Crystal On Silicon), or a transmissive element such as a liquid crystal. In particular, when DMD is used as the display element 21, it becomes easy to switch images at high speed while maintaining brightness, which is advantageous for display in which the projection distance (hereinafter referred to as virtual image distance) is changed. The display element 21 operates at a frame rate of 30 fps or more, preferably 90 fps. As a result, by cooperating with the operation of the moving mechanism 25 described later, it becomes easy to make it appear that a plurality of virtual images f are displayed at different virtual image distances at the same time.

The virtual image projection optical system 22 includes a lens group 221, an intermediate screen 222, mirrors 223, 224, and a display screen 225. The virtual image projection optical system 22 is composed of at least one mirror, but includes two mirrors 223 and 224 in the illustrated example.

The lens group 221 is a fixed focus lens system, and although not shown, it has a plurality of lenses. The lens group 221 forms an image formed on the display surface 21a of the display element 21 as an intermediate image i on the intermediate screen 222, and magnifies and projects it at an appropriate magnification (the intermediate image i itself is a display of the display element 21). Operation is a prerequisite). The lens group 221 has an aperture 221a arranged on the most intermediate screen 222 side of the lens group 221. By arranging the aperture 221a in this way, it becomes relatively easy to set and adjust the F number on the intermediate screen 222 side of the lens group 221.

The intermediate screen 222 is a sheet having a diffusion function for controlling the light distribution angle to a desired angle, and is within the depth of focus at or near the image formation position of the lens group 221 (that is, the planned image formation position of the intermediate image i). ), The intermediate image i is formed. As the intermediate screen 222, for example, frosted glass, a lens diffuser, a microlens array, or the like can be used.

The moving mechanism 25 is connected to a holder that holds the upper and lower ends of the intermediate screen 222, and by translating the intermediate screen 222 in the optical axis AX direction, the position of the intermediate image i is moved in the optical axis AX direction. be able to. If the display of the display element 21 is not operating, the intermediate image i as a display image is not necessarily formed, but in the following, it is assumed that the intermediate image i is formed even if it is not actually formed. The position may also be referred to as the position of the intermediate image.

(Overall configuration of head-up display device)
FIG. 4 is a block diagram illustrating a hardware configuration of the head-up display device 10. In addition to the virtual image display device 20 described above, the head-up display device 10 includes a main control unit 60, a display control unit 70, a driver detection unit 71, an environment monitoring unit 72, and a driving status acquisition unit 73. The main control unit 60 includes a CPU (Central Processing Unit) and a memory, and the CPU executes various controls by executing a control program stored in the memory. By controlling the entire head-up display device 10, the main control unit 60 displays a virtual moving body imitating a moving body (own vehicle) mounted on the head-up display device 10 as a virtual image two-dimensionally or three-dimensionally. To do. Further, it may be displayed together with a virtual image corresponding to the detected object such as an oncoming vehicle or a passerby. An example of displaying a virtual image related to a virtual moving body will be described later.

The display control unit 70 includes a CPU and a memory, and the CPU executes a control program stored in the memory to control the virtual image display process. Further, the memory stores image data that is a base for a virtual moving body, which will be described later, and a reference speed, for example, 50 km / h, which is set according to the legal speed of the road. Further, as the image data that is the base of the virtual moving body, a plurality of types of image data may be stored in advance according to the type of vehicle (large truck, ordinary passenger car, etc.) to be mounted.

The stored reference speed may be appropriately changed by the user 900. Alternatively, the reference speed may be sequentially updated according to the legal speed of the road currently traveled, which is acquired from the car navigation system 83. The display control unit 70 creates image data related to the virtual moving body in a mode according to the traveling situation, and displays the created image data on the display element 21. The display control unit 70 operates the virtual image display device 20 under the control of the main control unit 60, and travels a virtual image f such as a virtual moving body behind the display screen 225 at a predetermined virtual image distance (also referred to as a projection distance). It is changed and projected according to the information of the traveling situation acquired from the situation acquisition unit 73. Further, when changing the display of the virtual moving body, the virtual image distance may be variably displayed by moving the position of the intermediate screen 222 in the optical axis AX direction by the moving mechanism 25 at the same time.

The driver detection unit 71 is a part that detects the existence and viewpoint position of the user 900 in the vehicle 800, and includes an internal camera 71a directed toward the driver's seat 816, an image processing unit 71b for the driver's seat, and a determination unit 71c. .. The internal camera 71a is installed on the dashboard 814 in the vehicle body 811 facing the driver's seat 816 (see FIG. 2), and takes an image of the head of the user 900 sitting in the driver's seat 816 and its surroundings. To do. The driver's seat image processing unit 71b performs various image processing such as brightness correction on the image captured by the internal camera 71a, and facilitates the processing by the determination unit 71c. The determination unit 71c detects the head and eyes (pupil 910) of the user 900 by extracting or cutting out an object from the driver's seat image processed by the driver's seat image processing unit 71b. Further, the determination unit 71c calculates the spatial position of the user 900's eyes (resulting in the direction of the line of sight) as well as the presence or absence of the user 900's head in the vehicle body 811 from the depth information accompanying the driver's seat image.

The display control unit 70 receives a detection output regarding the presence of the user 900 and the position of the eyes from the driver detection unit 71 via the main control unit 60. This makes it possible to automatically start and stop the projection of the virtual image f by the virtual image display device 20. It is also possible to project the virtual image f only in the direction of the line of sight of the user 900. Further, it is also possible to perform projection with emphasis such as brightening or blinking only the virtual image f in the direction of the line of sight of the user 900.

The environment monitoring unit 72 identifies objects (actual objects) such as automobiles, bicycles, and pedestrians that are close to the front, and determines the distance to the objects. The environment monitoring unit 72 includes an external camera 72a, an external image processing unit 72b, and a determination unit 72c. The external camera 72a is installed at an appropriate position inside and outside the vehicle body 811 and captures external images such as the front and sides of the user 900 or the vehicle 800. The external image processing unit 72b performs various image processing such as brightness correction on the image captured by the external camera 72a, and facilitates the processing by the determination unit 72c. The determination unit 72c detects the existence or nonexistence of objects such as automobiles, bicycles, and pedestrians by extracting or cutting out objects from the external image processed by the external image processing unit 72b, and depth information accompanying the external image. The spatial position of the object in front of the vehicle 800 is calculated from.

The internal camera 71a and the external camera 72a include, for example, a compound eye type three-dimensional camera. That is, both cameras 71a and 72a are a matrix of camera elements in which a lens for imaging, CMOS (Complementary Metal-Oxide Circuitr), and other image pickup elements are arranged in a matrix. Each has a drive circuit of. The plurality of camera elements constituting the cameras 71a and 72a are, for example, focused on different positions in the depth direction, or can detect relative parallax, and are obtained from each camera element. By analyzing the state of the image (focus state, position of the object, etc.), the distance to each area in the image or the object is determined.

In addition, instead of or together with the compound eye type cameras 71a and 72a as described above, a combination of a two-dimensional camera and an infrared distance sensor may be used. Alternatively, LIDAR (Light Detection And Ringing) technology may be used. As a result, distance information in the depth direction can be obtained for each part (area or object) in the detection area in front of the vehicle 800.

The traveling status acquisition unit 73 is communicated or electrically connected to each device such as the speedometer 82 and the car navigation system 83, and acquires the traveling status of the vehicle 800 described below from these devices.

The speedometer 82 is mounted on the vehicle 800 and detects the traveling speed of the vehicle 800. The traveling status acquisition unit 73 acquires speed information related to the traveling speed detected by the speedometer 82 as the traveling status. The car navigation system 83 outputs the position information of the vehicle 800 obtained from GPS (Global Positioning System), the position information, and the route information according to the destination specified by the user. The traveling status acquisition unit 73 acquires route information and position information from the car navigation system 83 as the traveling status. Further, at this time, information on the speed limit (legal speed) of the road according to the traveling position may be acquired from the car navigation system 83. The traveling status acquisition unit 73 itself may be provided with a speedometer or car navigation function.

(First Embodiment)
Hereinafter, the display processing performed by the display control unit 70 of the head-up display device 10 according to the first embodiment will be described with reference to FIGS. 5 to 8. FIG. 5 is a flowchart showing the display process, and FIGS. 6 to 8 are display examples of the virtual moving body f1. These display examples are schematic views showing a state when the vehicle 800 is traveling on a straight road. In the first embodiment described below, the display size of the virtual moving body f1 displayed two-dimensionally is changed according to the traveling speed of the moving body.

(Step S101)
The display control unit 70 acquires the current traveling speed of the vehicle 800 (moving body) on which the head-up display device 10 is mounted through the traveling status acquisition unit 73.

(Step S102)
The display control unit 70 compares the traveling speed acquired in step S101 with the reference speed stored in the memory. If the traveling speed is the same as the reference speed, the process proceeds to step S103. On the other hand, if it is faster than the reference speed, the process proceeds to step S104, and if it is slower than the reference speed, the process proceeds to step S105.

(Step S103)
The display control unit 70 projects and displays the virtual moving body f1 created in the standard size by controlling the virtual image display device 20. FIG. 6 is a display example of the virtual moving body f1 projected and displayed in step S103. In FIG. 6 (the same applies to FIGS. 7 and 8), except for the virtual moving body f1, it is a see-through image, that is, a real thing. The virtual moving body f1 is a virtual image that imitates the rear side (rear side) of the vehicle 800, and is displayed as the leading vehicle or the preceding vehicle of the vehicle 800. The size of the virtual moving body f1 in this standard size is an appropriate inter-vehicle distance from the preceding vehicle according to the reference speed, for example, if it is 50 km, the size is such that the actual vehicle is traveling 50 m ahead of the own vehicle. An image of a virtual moving body is created in step 1, and the created image is projected and displayed as a virtual moving body f1 of a virtual image.

(Step S104)
By controlling the virtual image display device 20, the display control unit 70 projects and displays the virtual moving body f1 created in a size larger than the standard size. FIG. 7 is a display example of the virtual moving body f1 projected and displayed in step S104. The display control unit 70 projects and displays the virtual moving body f1 in a size larger than the standard size. The size of the virtual moving body f1 at this time is such that the vehicle in front is traveling at an inter-vehicle distance shorter than the appropriate inter-vehicle distance. As a result, the user 900 (driver) intuitively feels as if the vehicle is traveling too fast and is too close to the vehicle in front.

(Step S105)
By controlling the virtual image display device 20, the display control unit 70 projects and displays the virtual moving body f1 created in a size smaller than the standard size. FIG. 8 is a display example of the virtual moving body f1 projected and displayed in step S105. The display control unit 70 projects and displays the virtual moving body f1 in a size smaller than the standard size. The size of the virtual moving body f1 at this time is such that the vehicle in front is traveling at an inter-vehicle distance longer than the appropriate inter-vehicle distance. As a result, the user 900 (driver) intuitively feels that the speed is slow and that he / she is too far from the vehicle in front.

As described above, in the first embodiment, the display size of the virtual moving body f1 is changed according to the traveling situation, that is, the traveling speed. More specifically, when the traveling speed of the vehicle 800 driven by the user 900 is faster than the standard speed, the size of the virtual moving body f1 is increased. As a result, the user 900 wants to loosen the accelerator and reduce the traveling speed. When the speed is slower than the standard speed, the size is reduced. This allows the user to intuitively understand that the running speed has slowed down unintentionally. By doing so, the user can intuitively grasp whether the traveling speed of the moving object is slower or faster than the standard speed.

The display size of the virtual moving body f1 may be determined (for example, proportionally) according to the difference value between the traveling speed and the reference speed. Further, the standard size may be appropriately set by the user. Further, when the traveling speed becomes too fast, the virtual moving body f1 may be blinked and displayed, or a virtual image warning character may be displayed together. Further, when the traveling speed becomes too slow, such as when the vehicle is stopped at a red light or on the shoulder of the road, the virtual moving body f1 may not be displayed.

In the display examples shown in FIGS. 6 to 8, the size of the virtual moving body f1 was changed, and the display position of the virtual moving body f1 in the height direction (Y direction) was also shifted. For example, in FIG. 7, it was shifted downward, and in FIG. 8, it was shifted upward. This shift amount may be a predetermined amount, and may be adjusted according to the sitting height of the user 900 (height of the pupil 910) and the shape of the road ahead detected by the environmental monitoring unit 72.

(Second Embodiment)
Hereinafter, the display processing performed by the display control unit 70 of the head-up display device 10 according to the second embodiment will be described with reference to FIGS. 9 and 10. FIG. 9 is a flowchart showing the display process, and FIGS. 10 and 11 are perspective views showing a display state of the virtual moving body in which the virtual image distance is changed. In the first embodiment described above, the display size of the virtual moving body f1 is changed according to the traveling speed of the moving body. In the second embodiment, the virtual image distance is changed according to the traveling speed of the moving body.

(Steps S202, S203)
By the same process as in steps S101 and S102 described above, the display control unit 70 proceeds to step S203 if the acquired traveling speed is the same as the reference speed. On the other hand, if it is faster than the reference speed, the process proceeds to step S204, and if it is slower than the reference speed, the process proceeds to step S205.

(Step S203 to Step S205)
By controlling the moving mechanism 25 of the virtual image display device 20, the display control unit 70 sets the virtual image distance of the virtual moving body f1 to a medium distance in step S203, a short distance in step S204, and a short distance in step S205. Set to a long distance and display by projection. Further, the display control unit 70 also creates the size of the virtual moving body f1 by setting it to a standard size, a large size, and a small size in steps S203 to S205, respectively.

The virtual moving body f1 whose distance has been changed will be described with reference to FIG. In FIG. 10, the vehicle 800 (own vehicle) and the oncoming vehicle 850 are real vehicles. The vehicle 800 is equipped with a head-up display device 10 and is driven by a user 900. Further, the oncoming vehicle 850 can be visually recognized as a see-through image. The area of the frames F1 to F3 corresponds to the display area of the display element 21, and the frame F1 is projected and displayed when the intermediate screen 222 is positioned closer to the mirror 223 and the virtual image distance is set to a short distance. It is a virtual image position. The frame F3 is a virtual image position projected and displayed when the intermediate screen 222 is positioned on the side far from the mirror 223 and the virtual image distance is set to a long distance. The frame F2 is a virtual image position projected and displayed when the intermediate screen 222 is positioned at a position between them.

In FIG. 10, a virtual moving body f1 imitating a vehicle 800 is projected and displayed in a standard size in a frame F2 having a medium virtual image distance in correspondence with step S203. On the other hand, in step S204, the virtual moving body f1 is projected and displayed in the frame F1 having a short virtual image distance, and in step S205, the virtual moving body f1 is projected and displayed in the frame F3 having a long virtual image distance. In FIG. 11, the virtual moving body f1 is projected and displayed in a large size in the frame F1 having a short virtual image distance in accordance with step S204. In FIG. 11, the virtual moving body f1 displayed in the frames F2 and F3 is shown by a broken line.

As described above, in the second embodiment, the virtual image distance and the size of the virtual moving body f1 are changed according to the traveling situation, that is, the traveling speed. More specifically, when the traveling speed of the vehicle 800 driven by the user 900 is faster than the standard speed, the virtual image distance of the virtual moving body f1 is shortened to increase the size. As a result, the user 900 wants to loosen the accelerator and reduce the traveling speed. When the speed is slower than the standard speed, the virtual image distance is increased and the size is reduced. This makes you want to step on the accelerator and increase the running speed. By doing so, the same effect as that of the first embodiment can be obtained in the second embodiment. Further, in the second embodiment, by changing the virtual image distance, it is possible to more realize that the virtual moving body f1 is approaching or moving away, and it is possible to grasp the traveling situation more intuitively.

(Modification example)
In the second embodiment, an example in which the virtual image distance and the size of the virtual moving body f1 are changed at the same time according to the traveling speed is shown, but the present invention is not limited to this, and only the virtual image distance may be changed. ..

Further, in FIG. 11, a three-dimensional display described below is performed, and at that time, a virtual image f2 as a square frame-shaped mark of a virtual image for alerting the user 900 to the oncoming vehicle 850. Is given at a predetermined virtual image distance.

As described above, the environmental monitoring unit 72 detects an object such as an oncoming vehicle 850 existing on the road in the detection area in front of the vehicle 800. Then, a virtual image f2 for calling attention is formed so as to surround the oncoming vehicle 850 on the frame F3 having a virtual image distance (long distance) closest to the distance to the oncoming vehicle 850. By periodically moving the position of the intermediate screen 222 between the positions corresponding to the frames F1 and F3 at a speed corresponding to the display frame rate of the display element 21 at a high speed, the virtual image f1 and the virtual image f1 can be moved at a plurality of virtual image distances. F2 is displayed alternately. As a result, the user 900 visually recognizes the virtual images f1 and f2 having different virtual image distances at the same time as if they were displayed (three-dimensional display).

FIG. 12 is an application example of the present embodiment when traveling at night. At night like this, there are generally few other vehicles (oncoming vehicle 850, etc.) running. In addition, the user loses visibility of the surrounding scenery and loses his sense of speed. From such a situation, the present embodiment can be preferably used especially at night. Further, when traveling at night, the display control unit 70 may change the brightness (luminance) and color of the virtual moving body f1. In this case, the display control unit 70 can recognize that it is nighttime by the time information by the internal timer and the signal indicating the ON / OFF state of the headlamp of the vehicle 800.

On the other hand, in the daytime, since there are many other vehicles, there are many real see-through images, and when the virtual moving body f1 is displayed, it may overlap with the see-through image, which may reduce visibility. In such a case, if the object identified by the environment monitoring unit 72 exists at a position overlapping the virtual moving body f1, the projection display of the virtual moving body f1 may be temporarily stopped. .. Further, when the frequency of existence of such an object is high, the display control unit 70 may automatically switch to a stop mode in which the display of the virtual moving body f1 is stopped for a predetermined period. Further, the transition to the stop mode may be performed when the display control unit 70 recognizes that it is daytime, or may be performed by an operation instruction by the user 900.

(Third Embodiment)
Hereinafter, the display processing performed by the display control unit 70 of the head-up display device 10 according to the third embodiment will be described with reference to FIGS. 13 and 14. FIG. 13 is a flowchart showing the display process, and FIG. 14 is a display example of the virtual moving body whose display mode has been changed. In the first and second embodiments described above, the running speed is used as the running state of the vehicle 800 (moving body), and the display mode of the virtual moving body is changed according to the running speed. In the third embodiment, as the traveling state of the moving body, the display mode of the virtual moving body is changed by using the operation information of the moving body.

(Step S301)
The display control unit 70 acquires operation information regarding the current travel position and route of the vehicle 800 (moving body) on which the head-up display device 10 is mounted from the car navigation system 83 through the travel status acquisition unit 73.

(Step S302)
The display control unit 70 determines whether or not it is time to change the traveling direction based on the operation information acquired in step S301. The display control unit 70 ends the process (end) when the traveling direction is not changed, and proceeds to the process in step S303 when the traveling direction is changed.

(Step S303)
The display control unit 70 changes the direction of the virtual moving body to an image corresponding to any of straight ahead, right turn, and left turn according to the traveling direction and displays the image. For example, in the case of a right turn, the display control unit 70 intuitively recognizes that the user makes a right turn by changing the color of the tail lamp or blinker on the right side of the virtual moving body f1 or making it blink. Change the image so that it can be done. Further, at this time, a mark for calling attention may be further added to the periphery of the tail lamp or the like. Then, the display control unit 70 projects and displays the changed image as a virtual moving body f1 of a virtual image. FIG. 14 is a display example of the virtual moving body f1 projected and displayed in step S303. In the figure, the display control unit 70 changes the color of the tail lamp 801 on the right side and blinks the display according to the recognition that the vehicle is approaching an intersection turning right from the operation information such as the route. After that, when passing through the intersection by turning right or the like, the vehicle returns to the original straight-ahead virtual moving body f1 (FIG. 6 or the like).

FIG. 15 is a modification, which is a display example in which a plurality of virtual moving bodies f11, f12, and f13 are three-dimensionally displayed substantially simultaneously. A virtual moving body f1 similar to that in FIG. 14 is projected and displayed on the short-distance frame F1. On the medium-distance frame F2, a virtual moving body f12 representing a state slightly ahead of the virtual moving body f1 in terms of time and distance, that is, a state of moving to a side closer to the intersection is projected and displayed. On the long-distance frame F3, a virtual moving body f13 representing a state in which the intersection is reached and a right turn is started is projected and displayed.

When approaching an intersection, the environmental monitoring unit 72 detects and identifies the distance to the actual intersection and road shape information, and reflects the results to display the display positions of the virtual moving objects f1, f12, and f13. You may try to adjust.

In such a third embodiment and its modification, the image of the virtual moving body f1 is changed according to the driving operation to be performed by the vehicle 800 according to the operating state, and the changed image is projected as a virtual image. indicate. As a result, the user can intuitively recognize the driving operation to be performed from now on.

(Other variants)
The configuration of the head-up display device 10 described above is not limited to the above configuration, and various modifications may be made within the scope of the claims, as the main configuration has been described in explaining the features of the above-described embodiment. Can be done. Further, it does not exclude the configuration provided in the general virtual image display device or the head-up display device.

For example, the head-up display device 10 is mounted on a vehicle such as an automobile and shows an example of displaying a virtual moving body imitating the vehicle, but the present invention is not limited to this. Any moving body other than a vehicle may be used as long as it is a moving object such as a motor or an engine. Further, in that case, it is preferable to create an image of the virtual moving body and project and display the created image in a display mode imitating the shape of the mounted moving body so that it can be intuitively recognized.

Further, the virtual image display device 20 has shown an example in which the virtual image distance is changed substantially at the same time at three levels of short, medium, and long distances, but the present invention is not limited to this, and the virtual image distance can be changed substantially at the same time in multiple stages. It may be configured. Further, in each embodiment, the projection display position of the virtual moving body f1 may be changed according to the shape and position of the road ahead detected by the environment monitoring unit 72. For example, in the case of a curve or an uphill, the position of the virtual moving body f1 projected and displayed is changed according to the shape information of the road.

The means and methods for performing various processes in the head-up display device according to the above-described embodiment can be realized by either a dedicated hardware circuit or a programmed computer. The program may be provided by a computer-readable recording medium such as a USB memory or a DVD (Digital Versaille Disc) -ROM, or may be provided online via a network such as the Internet. In this case, the control program recorded on the computer-readable recording medium is usually transferred to and stored in a storage unit such as a hard disk. Further, the above program may be provided as a single application software, or may be incorporated into the software of the device as a head-up display device.

This application is based on a Japanese patent application (Japanese Patent Application No. 2017-251058) filed on December 27, 2017, the disclosure of which is referenced and incorporated as a whole.

10 Head-up display device 20 Virtual image display device 21 Display element 21a Display surface 22 Virtual image projection optical system 221 Lens group 222 Intermediate screen 223, 224 Mirror 225 Display screen 23 Housing 25 Moving mechanism 60 Main control unit 70 Display control unit 71 Driver detection Department 72 Environmental Monitoring Department 73 Driving Status Acquisition Department 82 Speedometer 83 Car Navigation System 800 Vehicle (own vehicle)
850 Oncoming vehicle 900 User 910 Eye AX Optical axis D1 Display light F1, F2, F3 Frame f, f1, f2, f12, f13 Virtual image i Intermediate image

Claims (10)

A head-up display device mounted on a moving body that travels.
A drawing device that displays an image based on image data,
A virtual image projection optical system including an intermediate screen, which forms an image displayed by the drawing device on the intermediate screen, converts the formed intermediate image into a virtual image, and projects and displays the image.
A traveling status acquisition unit that acquires the traveling status of the moving body,
By creating an image of a virtual moving body imitating the moving body and displaying it on the drawing device according to the running situation acquired by the running state acquisition unit, the virtual moving body is regarded as a virtual image of the moving body. A head-up display device including a display control unit that projects and displays forward. The traveling condition acquisition unit acquires the traveling speed of the moving body as the traveling condition, and obtains the traveling speed of the moving body.
The head-up display device according to claim 1, wherein the display control unit changes the virtual moving body according to a difference between the traveling speed and a preset reference speed. The traveling condition acquisition unit acquires the traveling speed of the moving body as the traveling condition, and obtains the traveling speed of the moving body.
The display control unit according to claim 1 or 2, wherein the virtual moving body is displayed larger as the traveling speed is faster, and the virtual moving body is displayed smaller as the traveling speed is slower. Head-up display device. Further, a moving mechanism for changing the position of the intermediate screen in the optical axis direction is provided.
The virtual image projection optical system projects and displays a virtual image at a virtual image distance corresponding to the position of the intermediate screen changed by the moving mechanism.
The traveling condition acquisition unit acquires the traveling speed of the moving body as the traveling condition, and obtains the traveling speed of the moving body.
Any one of claims 1 to 3, wherein the display control unit displays the virtual moving object with a shorter virtual image distance as the traveling speed increases and a longer virtual image distance as the traveling speed decreases. The head-up display device described in 1. The traveling condition acquisition unit acquires operation information regarding the position and route of the moving body from the car navigation system as the traveling condition.
The display control unit changes the direction of the virtual moving body to an image corresponding to any of straight ahead, right turn, and left turn based on the operation information acquired by the traveling condition acquisition unit, and displays the projection. The head-up display device according to any one of claims 1 to 4. A head-up display device mounted on a moving moving body, which includes an intermediate screen, forms an image displayed by a drawing device on the intermediate screen, converts the formed intermediate image into a virtual image, and projects and displays the image. A control program for causing a computer that controls a virtual image projection optical system and a head-up display device including a traveling condition acquisition unit that acquires the traveling condition of the moving body to execute.
The step (a) of acquiring the traveling status of the moving body by the traveling status acquisition unit,
By creating an image of a virtual moving body imitating the moving body and displaying it on the drawing device according to the traveling situation acquired in step (a), the virtual moving body is regarded as a virtual image in front of the moving body. Step (b) to be projected and displayed on
A control program for causing the computer to execute. In the step (a), the traveling condition acquisition unit acquires the traveling speed of the moving body as the traveling condition.
The control program according to claim 6, wherein in the step (b), the virtual image of the virtual moving body is changed according to the difference between the traveling speed acquired in the step (a) and the preset reference speed. .. In the step (a), the traveling condition acquisition unit acquires the traveling speed of the moving body as the traveling condition.
In the step (b), the faster the traveling speed acquired in the step (a), the larger the virtual moving body is displayed, and the slower the traveling speed is, the smaller the virtual moving body is displayed. 6 or the control program according to claim 7. The head-up display device further includes a moving mechanism that changes the position of the intermediate screen in the optical axis direction, and the virtual image projection optical system has a virtual image distance corresponding to the position of the intermediate screen changed by the moving mechanism. Project the virtual image with
In the step (a), the traveling condition acquisition unit acquires the traveling speed of the moving body as the traveling condition.
In the step (b), the virtual image distance of the virtual moving body is shortened as the traveling speed acquired in the step (a) is increased, and the virtual image distance is increased as the traveling speed is decreased. The control program according to any one of claims 8. In the step (a), the traveling status acquisition unit acquires operation information regarding the position and route of the moving body as the traveling status.
In the step (b), based on the operation information acquired in the step (a), the direction of the virtual moving body is changed to an image corresponding to either a straight line, a right turn, or a left turn and projected and displayed. The control program according to any one of claims 6 to 9.