JP2022066080A - Display control device, head-up display apparatus and image display control method - Google Patents

Abstract

To provide a display control device, a HUD apparatus (parallax type 3D HUD apparatus or the like) and an image display control method which can alleviate (reduce) a sense of discomfort of a viewer, fatigue of eyes of the viewer and the like.SOLUTION: A display control device comprises a control unit 701 which can control a display mode of a virtual image on the basis of an object distance being a distance between a preceding object and a reference position set on the side of a viewer. The control unit 701 executes the 3D display control of displaying the virtual image as the three-dimensional virtual image by making each of right and left eyes of the viewer visually recognize each image for right eye/left eye having a parallax when the object distance exceeds a threshold, and executes the 2D display control of displaying the virtual image as the planar virtual image by making each of right and left eyes of the viewer visually recognize the same image having no parallax when the object distance is equal to or less than the threshold.SELECTED DRAWING: Figure 2

Description

The present invention relates to a display control device, a head-up display (HUD) device, an image display control method, and the like mounted on a vehicle such as an automobile.

Patent Document 1 discloses an in-vehicle stereo image display device that displays information such as outside vehicle information and vehicle traveling guidance information as a three-dimensional stereo image (stereoscopic image) by utilizing the principle of stereoscopic vision based on both visual differences. There is. In [0031] of Patent Document 1, as an effect of the invention, "the image can be recognized with a three-dimensional effect and a sense of distance according to the actual scene seen by the occupant through the windshield, and the occupant can receive information on the outside of the vehicle and guidance information. There is an advantage that it can be given accurately. "

Japanese Unexamined Patent Publication No. 7-144578 ([0004], [0031], FIG. 4, etc.)

The present inventor uses a parallax-type 3D display as a display, and a head-up display device (here, referred to as a parallax-type 3D HUD device) that allows a driver to visually recognize a stereoscopic image by giving an arbitrary convergence angle to an image. Was examined. As a result, the following issues became clear.

The parallax image is imaged on an adjustment plane (imaging plane) which is a virtual plane at a point separated from a predetermined position on the driver side by a predetermined distance. The above-mentioned predetermined distance is referred to as "adjustment distance". When the driver visually recognizes the image for the left eye (parallax image for the left eye) and the image for the right eye (parallax image for the right eye) displayed on the adjustment surface, the focus of the eye is on the adjustment surface. Become.

On the other hand, the driver fuses the image for the left eye and the image for the right eye in the brain and recognizes them as one stereoscopic virtual image (stereoscopic image). The position where the stereoscopic virtual image is displayed (distance seen from the driver) is determined according to the convergence angle of the stereoscopic virtual image. The distance from the predetermined reference position on the driver side to the position where the viewer recognizes the stereoscopic virtual image is referred to as "congestion distance".

Since the congestion distance is larger than the adjustment distance, they do not match. In other words, the driver's point of view is focused (focused) on the adjusted position, but the virtual image is perceived at a farther congested position. As a result, there is a contradiction that the congestion position where the driver perceives the virtual image does not match the adjustment position which is actually in focus due to the adjustment of the driver's eyes. This contradiction is called a convergence-accommodation conflict (VAC). The contradiction of congestion adjustment causes the driver (visual person) to feel eyestrain and annoyance.

Therefore, in the above-mentioned parallax type 3DHUD device, for example, when a three-dimensional warning display that is visually recognized so as to surround the vehicle in front is performed on the road surface at the position of the vehicle in front, which is the object ahead, the display thereof is particularly effective. When the displayed state continues for a certain period of time, there arises a problem that the driver feels uncomfortable such as annoyance or increases eye fatigue.

The present inventor has clarified such a problem. The above-mentioned Patent Document 1 makes no mention of this problem and its solution.

One of the objects of the present invention is a display control device, a HUD device (parallax type 3DHUD device, etc.), and an image display that can reduce (reduce) discomfort of the viewer and eye fatigue of the viewer. It is to provide a control method.

Other objects of the invention will be apparent to those skilled in the art by reference to the embodiments exemplified below and the best embodiments, as well as the accompanying drawings.

Hereinafter, in order to easily understand the outline of the present invention, embodiments according to the present invention will be illustrated.

In the first aspect of the present invention, the display control device is
A display control device that executes display control in a head-up display (HUD) device that allows a viewer to visually recognize a virtual image of the image by projecting an image onto a projected member.
It has a control unit capable of controlling the display mode of the virtual image based on the object distance, which is the distance between the destination object and the reference position set on the side of the viewer.
The control unit
When the object distance exceeds the threshold value, the left and right eyes of the viewer are made to visually recognize each image for the left eye / right eye having parallax, so that the virtual image is displayed as a three-dimensional virtual image in 3D display. Take control and
When the object distance is equal to or less than the threshold value, 2D display control for displaying the virtual image as a flat virtual image is performed by visually recognizing the same image having no parallax to the left and right eyes of the viewer. Run.

In the first aspect, when the object ahead (for example, a moving vehicle in front) is farther than the position corresponding to the threshold value from the viewpoint of the viewer, the 3D display that looks good and has a sense of presence is used. Sufficient visibility can be easily secured. On the other hand, if the distance to the destination object (object distance) is less than the threshold value, the destination object will be in the area where 3D display is possible, and even if it is expressed in 3D, the merit is felt. Hateful. Therefore, switch to 2D display. This eliminates the strain on the eyes due to the congestion adjustment contradiction. Further, since the display is close to the viewer, it can be visually recognized with a certain size, and the visibility is ensured without displaying in 3D. In addition, in the case of the object of the other party, "the other party" has the meaning of "seeing the other party (in the back) at a distance from the viewer".

In this way, when displaying a parallax type 3D alert mark or the like in association with the destination object (vehicle in front, etc.), when the object distance of the destination object is equal to or less than the threshold value (threshold distance), the display is displayed in 2D. By doing so, it is possible to eliminate the contradiction of congestion adjustment and reduce eye fatigue and discomfort.

Further, in the 2D display, the virtual image is not visually recognized farther than the position where the eyes are in focus, and even if the destination object approaches the viewer, the virtual image overlaps the inside of the destination object. It is unlikely that the inconvenience of being visually recognized will occur. In this respect as well, it is effective in reducing the discomfort (including annoying feelings) of the viewer and reducing eye strain by suppressing it.

Further, in the case of 3D display, for example, if the viewpoint is lost (loss of the viewpoint position) in either one of the left and right eyes, it may not be possible to visually recognize an accurate stereoscopic image. This contributes to a sense of discomfort and annoyance. In the case of 2D display, there is no need to worry about this, and the display is stable. In this respect as well, the eyestrain and burden on the eyes of the viewer are reduced.

Obstacles in a broad sense are included in the objects of the other party. Here, obstacles include objects as moving objects (vehicles in front, people trying to cross the road, etc.) and objects as stationary objects (parked vehicles, motorcycles, vehicles with extremely slow speeds, etc.). , Falling objects on the road, etc.) can also be interpreted in a broad sense.

In the second aspect, which is subordinate to the first aspect,
The control unit
When there are a plurality of destination objects, the destination object that looks the largest to the viewer is selected, and the necessity of switching between 3D display and 2D display is determined for the selected destination object.
When it is determined that switching is necessary, the display modes may be switched at once, including the display of other preceding objects that have not been selected.

In the second aspect, since the destination object that the viewer greatly recognizes has a large influence on the visual perception of the viewer, the size of the destination object (for example, the occupied area of the destination object, or the destination object is a quadrangle or the like. The size of a quadrangle or a circle when replaced with a circle or the like) is detected, and it is determined whether or not the 3D display / 2D display needs to be switched for the destination object that looks the largest. When it is determined that switching is necessary, in principle, from the viewpoint of ease of display control or from the viewpoint of reducing the discomfort given to the viewer, including the display of other preceding objects that have not been selected. Therefore, it is preferable to switch the display modes all at once.

In the third aspect, which is subordinate to the second aspect,
The control unit
When it is attempted to switch from the 3D display control to the 2D display control, or from the 2D display control to the 3D display control, for the selected destination object.
If the display priority of the destination object other than the selected destination object is higher than the display priority of the selected destination object, the switching may not be executed.

In the third aspect, when switching between 3D / 2D for the selected destination object, if there is another destination object with a higher display priority, the display of that destination object is prioritized. Do not switch. For example, when a person trying to cross a road is found near his / her vehicle and has a high degree of urgency in terms of safety, the distance to the vehicle in front of the own vehicle changes to 3D / 2D. Even if changes are made, the display with the higher urgency is prioritized, the display mode of the display with the higher urgency is prevented from suddenly switching, and the viewer does not feel uncomfortable. Safety etc. can be ensured.

In the fourth aspect, which is subordinate to any one of the first to third aspects,
The three-dimensional virtual image is
It may be displayed so as to be superimposed on the ground or a surface corresponding to the ground in the vicinity of the destination object.

In the fourth aspect, the three-dimensional virtual image (3D display, three-dimensional display, etc.) by 3D display is not directly superimposed on the destination object, but is superimposed on the lower ground (road surface) or the like in the vicinity thereof. It is a thing. Specifically, the display is, for example, a warning display (or a warning display) that indirectly calls attention to the target object. Since this display is not directly superimposed on the destination object, even if the destination object (for example, a vehicle in front) approaches the viewer and the destination object enters the 3D displayable range, for example, it is three-dimensional. The virtual image and the object of the other party can be separated and distinguished, and a visual discomfort is unlikely to occur. Therefore, the burden on the eyes of the viewer is reduced in this respect as well.

In addition, it is considered that the size of the display superimposed on the road surface or the like can often be increased. Therefore, it is considered that visibility can be ensured even when switching to 2D display, and there is no particular visual discomfort when switching from 3D to 2D. In this respect as well, the burden on the eyes of the viewer is reduced.

In the fifth aspect, which is subordinate to the fourth aspect,
The three-dimensional virtual image is
It may be displayed so as to surround at least a part of the destination object.

According to the fifth aspect, the three-dimensional virtual image (3D display, three-dimensional display, etc.) by the 3D display surrounds at least a part of the vehicle in front, so that the size becomes larger and the image becomes easier to see. In addition, since there is a portion extending from the front side to a distant place when viewed from the viewer, it is easy to feel a sense of perspective, and therefore, a sense of presence is increased in the case of 3D display. In the case of 2D display, sufficient visibility is ensured due to the large size.

In the sixth aspect, which is subordinate to any one of the first to third aspects,
The three-dimensional virtual image may be superimposed on the destination object.

In the sixth aspect, it is possible to directly superimpose a three-dimensional virtual image (for example, a warning display or a warning display) by 3D display on the destination object. When a vehicle in front or the like approaches the own vehicle, as described above, there is a concern that a three-dimensional virtual image may appear inside the vehicle in front and cause a sense of discomfort. For example, since the display is switched to 2D under such a situation, the above problem does not occur.

In the seventh aspect, the head-up display device is
A head-up display (HUD) device that allows a viewer to visually recognize a virtual image of the image by projecting an image onto a projected member.
An image generation unit that generates the image and
A display unit that displays the image and
An optical system including an optical member that reflects the display light of the image and projects it onto the projected member.
The display control device according to any one of the first to sixth aspects, and
Have.

According to the seventh aspect, it is possible to effectively reduce and suppress eye strain and discomfort due to the contradiction of congestion adjustment in the parallax type stereoscopic (3D) HUD device. Further, the conventional parallax type 3DHUD device has a visual problem that when the destination object approaches a certain position, a virtual image as a 3D display enters the destination object and becomes difficult to see. Then, by setting the threshold value appropriately and switching to 2D display control in a situation where such a problem is a concern, the above problem can be effectively solved and the vehicle can reach a certain distance to the preceding object. Even in an approaching state, it is possible to obtain the effect of reducing eye fatigue and burden while ensuring visibility. Therefore, the performance of the HUD device is improved.

In the eighth aspect, which is subordinate to the seventh aspect,
It is an image display control method.
When the object distance, which is the distance between the destination object and the reference position set on the side of the viewer, exceeds the threshold value, the left and right eyes of the viewer have parallax for the left eye / right eye. By visually recognizing each image of, 3D display control to display a three-dimensional image is executed.
When the object distance is equal to or less than the threshold value, 2D display control for displaying a flat image is executed by visually recognizing the same image having no parallax to the left and right eyes of the viewer. You may do it.

According to the eighth aspect, when the destination object is located some distance from the viewer, the 3D display can realize a display having a three-dimensional effect, a sense of presence, and a sense of distance.

On the other hand, when the other object approaches the viewer to a certain extent, the virtual image display unnaturally overlaps with the other object by detecting the situation using an appropriately set threshold value and switching to the 2D display. Alternatively, it is possible to ensure a stable and easy-to-see display by preventing the problem that the complete display cannot be seen due to the lost viewpoint of one eye.

Those skilled in the art will readily appreciate that the embodiments according to the invention exemplified may be further modified without departing from the spirit of the invention.

FIG. 1A is a diagram showing an example of the configuration of an in-vehicle system including a parallax type 3DHUD device, and FIG. 1B is a diagram showing a 2D display without congestion. FIG. 2A shows an example of 3D display when the distance to the vehicle in front (object distance) is behind the threshold value while the own vehicle is traveling, and when the object distance is equal to or less than the threshold value. 2 (B) is a diagram showing the details of the 3D display, and FIG. 2 (C) is a diagram showing the details of the 2D display. 3A and 3B are diagrams showing an example of setting a threshold value for switching between 3D display and 2D display. 4 (A) and 4 (B) are diagrams showing an example of display control when there are a plurality of destination objects. FIG. 5A is a diagram showing an overall configuration example of a parallax type 3DHUD device capable of switching between 3D / 2D, and FIG. 5B is a diagram showing a configuration example of a control unit and an image generation unit. It is a flowchart which shows the procedure example of display control. FIG. 7A is a diagram showing an example of a 3D display in a warning display (or a warning display) superimposed on a vehicle in front, and FIG. 7B is a diagram showing an example of a 2D display.

The best embodiments described below have been used to facilitate understanding of the present invention. Accordingly, one of ordinary skill in the art should note that the invention is not unreasonably limited by the embodiments described below.

See FIG. FIG. 1A is a diagram showing an example of the configuration of an in-vehicle system including a parallax type 3DHUD device, and FIG. 1B is a diagram showing a 2D display without congestion.

In FIGS. 1A and 1B, the direction along the line connecting the left and right eyes E1 and E2 of the viewer (in other words, the width direction of the vehicle 1) is defined as the left-right direction (or the lateral direction: X direction). , The direction along the line segment orthogonal to the ground or the surface corresponding to the ground (here, the road surface 6) is defined as the vertical direction (or the height direction: Y direction), and the horizontal direction and the vertical direction. The direction along the line segment orthogonal to each of the above (direction indicating the forward and backward directions of the vehicle 1) is defined as the front-rear direction (Z direction). The positive Z direction is the front and the negative Z direction is the rear. This point is the same in other drawings (FIG. 2, FIG. 3, FIG. 4, FIG. 7).

The in-vehicle system provided in the vehicle (own vehicle) 1 of FIG. 1A is a pupil detection camera for detecting the pupil (or face) that detects the line-of-sight direction and position of the driver's (viewer) left-eye EL and right-eye ER. 43, a front (broadly speaking, peripheral) image pickup camera (for example, a stereo camera) 45, an image processing unit 46 (including a distance measuring unit 47, an object type / size detecting unit 48), a HUD device 100, and a communication unit. It has a 123 (having functions such as GPS communication and inter-vehicle communication) and an ECU 120 capable of collecting various information related to the vehicle 1 (for example, lighting on / off information, vehicle speed information, engine information, etc.). If necessary, a radar unit 125 or the like may be further provided as a distance measuring means.

The parallax unit 47 included in the image processing unit 46 refers to, for example, a pair of left and right original images captured by a stereo camera as an image pickup camera 45, and is the same by, for example, stereo matching for searching for a corresponding point of each image. Parallax with respect to an object (referred to as the destination object) is detected, and the distance measurement to the destination object is measured by the principle of triangulation based on this parallax. Further, the radar unit 125 measures the distance and direction to the object (destination object) by emitting radio waves toward the object (destination object) and measuring the reflected wave. The information acquisition unit 119 of the HUD device 100 appropriately acquires the measured distance information and the like, and supplies the measured distance information and the like to the control unit 701 of the stereoscopic display device 111.

The HUD device 100 is installed, for example, in a dashboard (not shown in FIG. 1, reference numeral 41 in FIG. 2A). The HUD device 100 includes a stereoscopic display device 111, an optical system 116, a light emitting window 118, and an information acquisition unit 119. The information acquisition unit 119 can acquire various information from the communication unit 127, the ECU 120, the radar unit 125, the image processing unit 46, and the like.

The stereoscopic display device 111 is a parallax type 3D display device here. The stereoscopic display device (differential 3D display device) 111 includes an image generation unit 112, an image display unit (a liquid crystal display device or the like, which has an image display surface for displaying an image) 113, a lenticular lens, and a paralux barrier. It has (parallax barrier) and the like, and has a light ray separating unit 114 and a control unit 701 that separate light emitted from an image display surface into light rays for each of the left and right eyes.

The control unit 701 can control the operation of the image generation unit (specifically, for example, image rendering) 112 and the image display unit 113, and can switch between 2D display and 3D display. Further, the control unit 701 may be provided as a component of the display control device (not shown in FIG. 1A, reference numeral 700 in FIG. 5A).

The optical system 116 has a curved mirror (concave mirror or the like) 117 that reflects the light from the light ray separating unit 114 and projects the display lights K1 and K2 of the image onto the windshield (projected member) 2. However, other optical members (lens, auxiliary reflector, etc.) may be further provided.

In FIG. 1A, the stereoscopic display device 111 of the HUD device 100 displays an image having a parallax (parallax image) for each of the left and right eyes. As shown in FIG. 1A, each parallax image is displayed as virtual images 25L and 25R formed on the adjustment surface (imaging surface) PS. The focus of each eye of the viewer (person) is adjusted to match the position of the adjustment surface PS. The position of the adjustment surface PS is referred to as an "adjustment position", and the distance from a predetermined reference position to the adjustment surface PS (see reference numeral D1 in FIGS. 2B and 2C) is referred to as an adjustment distance. ..

However, in reality, since the human brain fuses each image (virtual image), the human is a position further back than the adjustment position (a position determined by the convergence angle, which is called a "congestion position". ), It is recognized that a three-dimensional virtual image (here, a figure of an arrow for navigation) 27 is displayed on the congestion surface VS. The three-dimensional virtual image 27 may be referred to as a "three-dimensional virtual image", and may also be referred to as a "three-dimensional image" when the "image" is broadly grasped and the virtual image is also included. .. In addition, it may be referred to as a "stereoscopic image", a "3D display", or the like.

The control unit 701 in the HUD device 100 is measured from a reference point (reference position) provided on the driver (viewer side) to an object (destination object) measured by at least one of the distance measuring unit 47 and the radar unit 125. The 2D display / 3D display can be switched by comparing the distance (referred to as the measured distance) with a predetermined threshold value. Examples of the reference position include a driver's viewpoint position and a reference point set in a part of the vehicle 1.

When the 2D display control is executed, a planar virtual image 29 (a figure of an arrow for navigation) is displayed on the adjustment surface (image plane) PS as shown in FIG. 1 (B). The planar virtual image may be referred to as a "planar virtual image", a "planar image", a "two-dimensional image", a "two-dimensional display", or the like.

Next, refer to FIG. FIG. 2A shows an example of 3D display when the distance to the vehicle in front (object distance) is behind the threshold value while the own vehicle is traveling, and when the object distance is equal to or less than the threshold value. 2 (B) is a diagram showing the details of the 3D display, and FIG. 2 (C) is a diagram showing the details of the 2D display.

In FIG. 2A, the vehicle 1 is traveling on a straight road (road surface) 6. A vehicle (front vehicle) 200 as an object (obstacle in a broad sense) of the other party can be seen in front. When the surrounding image camera 45 captures the rear image to detect the vehicle behind the vehicle and displays the image (virtual image) of the vehicle behind the vehicle in the lower right of the display area (HUD display area) 3, for example. , The vehicle behind it can be the object of the other party. In the case of an object, "the other side" has the meaning of "seeing the other side (the back side) at a distance from the viewer".

Further, the display area (HUD display area) 3 is typically a virtual area in which the adjustment surface (image plane) PS of FIG. 1 (A) is displayed. The HUD device 100 is installed in the dashboard 41.

Further, in the display example of FIG. 2A, the caution display 300 as a three-dimensional virtual image is superimposed so as to be superimposed on the road surface (surface corresponding to the ground) 6 in the vicinity of the destination object (front vehicle) 200. It is displayed. The display mode of the alert display 300 can be switched depending on whether or not the object distance of the destination object 200 exceeds the threshold value (however, it may not be possible to switch depending on the driving scene). If it exceeds, it becomes a 3D display (see FIG. 2 (B)), and if it exceeds, it becomes a 2D display (see FIG. 2 (C)).

The object distance is the distance to the destination object based on the reference position on the driver (viewer) 5 side (for example, the viewpoint position of the driver 5 or the specific position of the own vehicle 1) (FIG. 2). (B), (C), reference numerals D4a, D4b), in other words, the distance between the reference position and the destination object.

Further, in FIG. 2A, the warning display 300 (3D) on the back side, which is shown by a solid line, indicates that it is a 3D display, and the warning display 300 (2D) on the front side, which is shown by a broken line, is a warning display 300 (2D) on the front side. 2D display.

Specifically, the display area 3 (adjustment surface PS) is set at a distance of, for example, "5 m" from the above reference position, and the threshold value that serves as a reference for switching between 3D display and 2D display is set, for example, "7 m". Has been done. However, this is an example and is not limited.

FIG. 2 (A) Assuming that the destination object (front vehicle) 200 is at a distance of, for example, 8 m from the above reference position, the object distance exceeds the threshold value (7 m), so that the display is in 3D, for example, at a distance of 6 m. Then, since the condition that the object distance is equal to or less than the threshold value (7 m) is satisfied, the display is performed in 2D.

The 3D / 2D switching will be described with reference to FIGS. 2 (B) and 2 (C). In FIGS. 2B and 2C, the warning display 310 is a partially arcuate mark having a length equivalent to the width of the destination object (front vehicle) 200 (however, this is an example, and is an example. The same mark as in FIG. 2 (A) can also be adopted).

In FIG. 2B, the object distance D4a (for example, 8 m: determined by the convergence angle θ1) is larger than the threshold value Lth (for example, 7 m). In other words, the destination object 200 is farther than the threshold Lth. In this case, the warning display 310 (3D) as a three-dimensional virtual image is displayed by the 3D display control.

Further, the adjustment distance from the reference position (here, the viewpoint position) to the adjustment surface (image plane) PS is D1 (for example, 5 m), and the left and right eyes are on the adjustment surface PS (display area 3). The parallax images 31L and 31R for use are imaged.

The viewer (driver) visually recognizes the alert display 310 (3D) on the congestion surface VS at the position (congestion position) of the congestion distance D2. The convergence angle of the stereoscopic virtual image 310 (3D) is θ1. The distance D3 is a distance that causes a congestion adjustment contradiction, which corresponds to the difference between the adjustment distance D1 and the congestion distance D2a. In FIG. 2B, R1 indicates a position (position corresponding to the threshold value) separated from the reference point by a threshold value (threshold distance) Lth.

In FIG. 2C, the destination object 200 is located closer to the viewer (driver) than in FIG. 2B. The object distance D4b is, for example, 5 m, which is smaller than the threshold value Lth (7 m). Therefore, in the case of FIG. 2C, the display is 2D, and the caution display 310 (2D) as an image without parallax is displayed in the display area 3 of the adjustment surface PS. In the example of FIG. 2C, no congestion adjustment contradiction occurs.

In the embodiment of FIGS. 2A and 2B, when the object (for example, a moving vehicle in front) 200 is farther than the position R1 corresponding to the threshold Lth when viewed from the viewer 5. For example, when the object distance D4a exceeds the threshold value Lth), sufficient visibility can be easily ensured by the 3D (three-dimensional) display that looks good and has a sense of presence. On the other hand, when the object distance D2b of the destination object 200 is equal to or less than the threshold value Lth, the destination object 200 is in the area where 3D display is possible, and the merit is felt even if it is expressed in three dimensions. Hateful. Therefore, the display is switched to 2D (two-dimensional) display. This eliminates the strain on the eyes due to the congestion adjustment contradiction.

In this way, when displaying a parallax type 3D alert mark or the like in association with the destination object (vehicle in front, etc.), when the object distance of the destination object is equal to or less than the threshold value (threshold distance), the display is displayed in 2D. By doing so, it is possible to eliminate the contradiction of congestion adjustment and reduce eye fatigue and discomfort.

Further, since the alert display 300 (2D) shown by the broken line in FIG. 2 (A) or the alert display 310 (2D) in FIG. 2 (C) is near the viewer, it has a certain size. Visibility is possible, and visibility is ensured without displaying in 3D.

Further, in the 2D display, the virtual image is not visually recognized farther than the position where the eyes are in focus, and even if the destination object approaches the viewer, the virtual image overlaps the inside of the destination object. It is unlikely that the inconvenience of being visually recognized will occur. In this respect as well, it is effective in reducing the discomfort (including annoying feelings) of the viewer and reducing eye strain by suppressing it.

Further, in the case of 3D display, for example, if the viewpoint is lost (loss of the viewpoint position) in either one of the left and right eyes, it may not be possible to visually recognize an accurate stereoscopic image. This contributes to a sense of discomfort and annoyance. In the case of 2D display, there is no need to worry about this, and the display is stable. In this respect as well, the eyestrain and burden on the eyes of the viewer are reduced.

Obstacles in a broad sense are included in the objects of the other party. Here, obstacles include objects as moving objects (vehicles in front, people trying to cross the road, etc.) and objects as stationary objects (parked vehicles, motorcycles, vehicles with extremely slow speeds, etc.). , Falling objects on the road, etc.) can also be interpreted in a broad sense.

Further, the alert display 300 as a three-dimensional virtual image shown in FIG. 2 (A) and the alert display 310 as a three-dimensional virtual image shown in FIG. 2 (B) are directly displayed on the destination object 200. It is not superposed (however, direct superimposition is not excluded: see FIG. 7), but is a display superimposed on the lower road surface 6 in the vicinity thereof (referred to as a road surface superimposition display). In other words, it has a function as a warning display (or a warning display that issues a warning) that indirectly calls attention to the destination object 200.

Since this display is not directly superimposed on the destination object (front vehicle) 200, the destination object approaches the viewer 5, and for example, the destination object 200 enters the 3D displayable range (however, the threshold value). Even if the 3D display is maintained farther than Lth), the three-dimensional virtual image and the destination object can be separated and distinguished, and a visual discomfort is unlikely to occur. Therefore, the burden on the eyes of the viewer is reduced in this respect as well.

In addition, it is considered that the size of the display superimposed on the road surface or the like can often be increased. For example, the width of the warning display 310 in FIG. 2B is about the same as the width of the vehicle in front 200, which is a considerably large display. The same applies to the case of FIG. 2 (A). Therefore, it is considered that visibility can be ensured even when switching to 2D display, and there is no particular visual discomfort when switching from 3D to 2D. In this respect as well, the burden on the eyes of the viewer is reduced.

Further, the caution display (three-dimensional virtual image) 300 of FIG. 2A is displayed so as to surround at least a part of the destination object 200. Its shape is a partial annular shape (or a partial elliptical shape) in a plan view seen from a direction (upper side) perpendicular to the road surface 6. However, the present invention is not limited to this, and may be annular or elliptical. The shape of the alert display 300 in FIGS. 2 (B) and 2 (C) is a partial arc (a figure that gives a linear impression) that does not surround the destination object 200, but is not limited to this. .. For example, a portion extending from the front side to the distant side when viewed from the viewer 5 (in other words, a portion extending so as to sandwich the destination object 200 from the left and right) may be provided.

If the three-dimensional virtual image surrounds at least a part of the object 200, the size becomes larger and it becomes easier to see. In the case of 3D display, the sense of presence is increased, and in the case of 2D display, the visibility is sufficiently ensured, and the visual discomfort can be sufficiently suppressed.

The above example is a case where the three-dimensional display is not directly superimposed on the object (for example, in the case of the road surface superimposed display), but the display directly superimposed on the object (object superimposed display) is excluded. It's not something. In other words, the three-dimensional virtual image may be superimposed on the destination object.

Here, reference is made to FIG. 7. FIG. 7A is a diagram showing an example of a 3D display in a warning display (or a warning display) superimposed on a vehicle in front, and FIG. 7B is a diagram showing an example of a 2D display. In the examples of FIGS. 7A and 7B, the alert display (warning display) is an image in which an exclamation mark is drawn inside a triangular figure, and is superimposed on the rear end surface of the vehicle in front 202. Is displayed in.

As shown in FIG. 7A, it is possible to directly superimpose a three-dimensional virtual image (warning display or warning display) 302 (3D) by 3D display on the destination object (front vehicle) 202. be.

When the front vehicle 202 approaches the own vehicle 1, as described above, there is a concern that a three-dimensional virtual image may appear inside the front vehicle 202, causing a sense of discomfort. However, according to the present invention. For example, under such a situation, as shown in FIG. 2B, the display is switched to 2D display (in other words, 302 (2D) is displayed), so that the above problem does not occur. ..

Next, refer to FIG. 3A and 3B are diagrams showing an example of setting a threshold value for switching between 3D display and 2D display. In FIG. 3, the same reference numerals are given to the parts common to the above-mentioned figures (the same applies to other figures). In FIGS. 3A and 3B, the region indicated by reference numeral 21 (the region with a sand pattern) is a region capable of parallax-type 3D display (parallax-type 3D displayable region).

FIG. 3A shows an example of setting an unfavorable threshold value. In FIG. 3A, D1 indicates an adjustment distance which is a distance from the position of the viewpoint E to the adjustment surface (image plane) PS, Lth1 indicates a threshold distance, and R1 indicates a position corresponding to the threshold value (A). The threshold setting position) is shown, R2 shows the tip position (the position on the back side) of the area 21 capable of parallax type 3D display, and Z1 shows the area that can be used for the actual 3D display.

In FIG. 3A, the position R1 corresponding to the threshold value is set farther than the tip position (position on the back side) R2 of the region 21 capable of parallax type 3D display when viewed from the viewer. The front vehicle 200, which is the target object, is located on the front side of the position R1 corresponding to the threshold value. In this state, the display is switched to 2D. In other words, originally, although the area Z1 can be used for an appropriate parallax type 3D display, only 2D display is allowed. Therefore, it cannot be said to be a preferable setting example.

In order to perform an appropriate parallax type 3D display using the area Z1, the threshold value Lth1 includes the inside (R2 position) of the tip position (back side position) R2 of the area 21 where the parallax type 3D display is possible. It is better to set it to). On the other hand, since the parallax type 3D display (3D image) is visually recognized at a distance D3 behind the adjustment surface PS, in order to make an appropriate 3D display in the vicinity of the destination object, the destination object must be displayed. It is preferably at least farther than the adjustment distance D1 plus the distance D3.

In consideration of these points, in the preferred threshold setting example of FIG. 2B, the position R1 corresponding to the threshold is located in front of the tip position R2 of the region 21 capable of parallax-type 3D display (the position of R2). It may be included) and is set to the back side (however, the virtual image recognition position may be included) from the position where the 3D image is recognized (the virtual image recognition position obtained by adding the distance D3 to the adjustment distance D1).

Next, refer to FIG. 4 (A) and 4 (B) are diagrams showing an example of display control when there are a plurality of destination objects. In the example of FIG. 4A, the vehicle in front 200 and the person 250 trying to cross the road are visually recognized by the driver (viewer) 5.

Further, the partial ring-shaped road surface superimposition display 300 (3D) as a warning display is three-dimensionally displayed for the vehicle in front 200, and the person 250 is emphasized as a warning display (warning display). It is assumed that the frame 400 (3D) is displayed three-dimensionally.

It can be said that there are two objects on the other side. At this time, the destination object used as the reference for switching between the 3D display and the 2D display can be the front vehicle 200, which is the destination object that is most visible to the viewer 5. In other words, when there are a plurality of destination objects, the destination object that looks the largest to the viewer may be selected, and the necessity of switching between 3D display and 2D display may be determined for the selected preceding object.

Since the destination object that the viewer 5 largely recognizes has a large influence on the vision of the viewer 5, for example, the size of the destination objects 200 and 250 (for example, the occupied area of the destination object or the square shape of the destination object). The size of a quadrangle or circle when replaced with a circle or the like) is detected, and the necessity of switching between 3D display and 2D display is determined for the destination object that looks the largest. The process of determining the size of the destination object is executed, for example, by the object type / size detection unit 48 in FIG. 1 (A).

Further, when it is determined that switching is necessary, in principle, it is preferable to switch the display mode collectively including the display of other preceding objects. For example, in FIG. 4A, when the destination vehicle 300 is located in front of the threshold value and, as a result, switching between 3D display and 2D display is executed, display control is facilitated. From the viewpoint and from the viewpoint of suppressing the discomfort given to the viewer 5, it is preferable that the display mode of the person 250 is similarly switched from 3D to 2D. However, this is a principle, and there are exceptions (for example, FIG. 4B).

The example of FIG. 4B is common to FIG. 4A in that there are two (plurality) destination objects. However, in FIG. 4B, the distance between the person 250 and the own vehicle 1 is smaller than that in FIG. 4A, and the risk is increased. In other words, the display priority (display urgency) of the emphasis frame 400 for the person 250 is higher than the display priority (display urgency) of the warning display 300 of the vehicle in front 200.

In such a case, forcibly switching the display mode of the emphasis frame 400 in synchronization with the switching of the display mode of the warning display 300 of the vehicle in front 200 gives the viewer 5 a sense of discomfort and makes an appropriate judgment. It may also delay. Therefore, it is preferable not to switch the display modes of the alert display 300 and the highlight frame 250.

In other words, when trying to switch from 3D display control to 2D display control or from 2D display control to 3D display control for the selected destination object, other than the selected destination object. If the display priority (display urgency) of the destination object is higher than the display priority (display urgency) of the destination object, it is possible to ensure safety by not executing the display mode switching. can.

Next, refer to FIG. FIG. 5A is a diagram showing an overall configuration example of a parallax type 3DHUD device capable of switching between 3D / 2D, and FIG. 5B is a diagram showing a configuration example of a control unit and an image generation unit. In FIG. 5A, the same reference numerals are given to the portions common to those in FIG. 1A.

The parallax type 3DHUD device includes a stereoscopic display device 111, an optical system 116, and an information acquisition unit 119. The stereoscopic display device 111 includes a display control device 700, an image generation unit 112, a display unit 113, and an actuator 179. The actuator 179 can be used, for example, to change the orientation of the curved mirror (concave mirror or the like) 117 included in the optical system 116.

The display control device 700 has a control unit 701. The control unit 700 has an I / O interface 741, a processor 702, and a memory 743.

In the example of FIG. 5B, the viewpoint position detection unit 44 is provided in order to analyze the image captured by the pupil image pickup camera 43 and detect the viewpoint position (and the line-of-sight direction).

Further, in FIG. 5B, the control unit 701 has a driving scene determination unit 745 and a 3D / 2D switching necessity determination unit 746. The 3D / 2D switching necessity determination unit 746 switches the display mode based on the comparison between the distance to the target object and the threshold value, and also in consideration of various driving scenes and the display priority in the example of FIG. Judge the necessity.

The image generation unit 112 includes an image storage unit 312, a light field rendering unit 333, a left-eye image buffer 334, a right-eye image buffer 335, and an image interface (image I / F) 336.

Next, refer to FIG. FIG. 6 is a flowchart showing an example of the display control procedure. In step S1, detection and determination processing of a preceding object (including an obstacle) is executed. In step S2, the distance between the own vehicle or the like and the preceding object (preceding object distance) is detected.

In step S3, it is determined whether the detected distance is larger than a predetermined threshold value. When it is Y, it is displayed in 3D in principle (step S4), and when it is N, it is displayed in 2D in principle (step S5). However, the display mode is not switched in the driving scene or the like shown in FIG. 5 (B).

In step S6, it is determined whether or not the display is finished. When it is Y, the display control is terminated, and when it is N, the process returns to step S1.

As described above, according to the present invention, in the parallax type 3DHUD device or the like, it is possible to reduce (reduce) the discomfort of the viewer and the fatigue of the eyes of the viewer. In other words, when displaying a parallax type 3D alert mark or the like in association with the destination object (vehicle in front, etc.), if the object distance of the destination object is equal to or less than the threshold value (threshold distance), the display is performed in 2D. As a result, it is possible to eliminate the contradiction of congestion adjustment and reduce eye fatigue and discomfort.

In the present specification, the term vehicle can be broadly interpreted as a vehicle. In addition, terms related to navigation (for example, signs, etc.) shall be interpreted in a broad sense in consideration of, for example, the viewpoint of navigation information in a broad sense useful for vehicle operation. Further, the HUD device and the display device (and the display device in a broad sense) include those used as a simulator (for example, an aircraft simulator, a simulator as a game device, etc.).

The present invention is not limited to the above-mentioned exemplary embodiments, and those skilled in the art will be able to easily modify the above-mentioned exemplary embodiments to the extent included in the claims. ..

1 ... Vehicle (own vehicle), 2 ... Windshield (projected member), 3 ... HUD device display area (HUD display area), 6 ... Ground or equivalent surface of ground (road surface, etc.) ), 21 ... Parallax type 3D displayable area (parallax type 3D displayable area), 41 ... Dashboard, 43 ... Eye imaging camera, 45 ... Surrounding imaging camera, 46 ... Image processing unit, 47 ... Parallax unit, 48 ... Object type / size detection unit, 100 ... HUD device, 111 ... Stereoscopic display device, 112 ... Image generation unit, 113 ... -Display unit (display panel, etc.), 114 ... light separation unit (lenticular lens, parallax barrier, etc.), 116 ... optical unit, 117 ... curved mirror (concave mirror, etc.), 119 ... information acquisition unit , 120 ... ECU, 123 ... Communication unit, 125 ... Radar unit, 200 ... Front vehicle as the destination object, 250 ... Person as the destination object, 300, 310 ... Alert display (or alarm display), 400 ... Highlight frame as alert display (or alarm display), 700 ... Display control unit device, 701 ... Control unit, 741 ... I / O interface , 742 ... Processor, 743 ... Memory, 745 ... Driving scene determination unit, 2D / 3D switching necessity determination unit, K1, K2 ... Display light, PS ... Adjustment surface (imaging surface) ), VS ... Congestion surface, θ1 ... Convergence angle, D1 ... Adjustment distance, D2 ... Congestion distance, D3 ... Distance between the adjustment surface and the parallax position of the stereoscopic image, D4 (D4a, D4b) ... Object distance, Lth ... 3D display / 2D display switching threshold (predetermined threshold or threshold distance), R1 ... Position corresponding to the threshold, R2 ... Parallax type 3D display Possible area tip position.

Claims (8)

A display control device that executes display control in a head-up display (HUD) device that allows a viewer to visually recognize a virtual image of the image by projecting an image onto a projected member.
It has a control unit capable of controlling the display mode of the virtual image based on the object distance, which is the distance between the destination object and the reference position set on the side of the viewer.
The control unit
When the object distance exceeds the threshold value, the left and right eyes of the viewer are made to visually recognize each image for the left eye / right eye having parallax, so that the virtual image is displayed as a three-dimensional virtual image in 3D display. Take control and
When the object distance is equal to or less than the threshold value, 2D display control for displaying the virtual image as a flat virtual image is performed by visually recognizing the same image having no parallax to the left and right eyes of the viewer. Display control device to execute. The control unit
When there are a plurality of destination objects, the destination object that looks the largest to the viewer is selected, and the necessity of switching between 3D display and 2D display is determined for the selected destination object.
When it is determined that switching is necessary, the display mode is switched at once, including the display of other preceding objects that were not selected.
The display control device according to claim 1. The control unit
When it is attempted to switch from the 3D display control to the 2D display control, or from the 2D display control to the 3D display control, for the selected destination object.
If the display priority of the other destination object other than the selected destination object is higher than the display priority of the selected destination object, the switching is not executed.
The display control device according to claim 2. The three-dimensional virtual image is
The display control device according to any one of claims 1 to 3, which is displayed so as to be superimposed on the ground or a surface corresponding to the ground in the vicinity of the destination object. The three-dimensional virtual image is
Displayed to surround at least a part of the destination object,
The display control device according to claim 4. The display control device according to any one of claims 1 to 3, wherein the three-dimensional virtual image is superimposed on the destination object. A head-up display (HUD) device that allows a viewer to visually recognize a virtual image of the image by projecting an image onto a projected member.
An image generation unit that generates the image and
A display unit that displays the image and
An optical system including an optical member that reflects the display light of the image and projects it onto the projected member.
The display control device according to any one of claims 1 to 6.
Head-up display device with. It is an image display control method.
When the object distance, which is the distance between the destination object and the reference position set on the side of the viewer, exceeds the threshold value, the left and right eyes of the viewer have parallax for the left eye / right eye. By visually recognizing each image of, 3D display control to display a three-dimensional image is executed.
When the object distance is equal to or less than the threshold value, 2D display control for displaying a flat image is executed by visually recognizing the same image having no parallax to the left and right eyes of the viewer. Image display control method.

Images