JP2022072954A - Display control device, head-up display device, and display control method - Google Patents

Abstract

To reduce the visibility of an irregular image due to crosstalk.SOLUTION: Provided is a display control device for executing display control in a head-up display device 20 that projects an image to a projection member and thereby causes a virtual image of the projected image to be recognized by an observer, wherein a processor executes a 3D display process of causing left and right viewpoint images having parallax to be recognized by each of the left and right eyes of the observer and thereby displaying as content images FU1, FU2 with depth expressions added, and a glow display process of displaying one or a plurality of glow images G1, G2 which are displayed in the lateral direction of the content images and do not have distinct contours.SELECTED DRAWING: Figure 3

Description

The present disclosure is used in a moving body such as a vehicle, and is a display control device, a head-up display device, and a head-up display device that superimposes an image on the foreground of the moving body (the actual view in the forward direction of the moving body as seen from the occupant of the vehicle). Regarding display control method, etc.

In Patent Document 1, the display light projected on the projected portion such as the front windshield of the vehicle is reflected toward the occupant (observer) of the vehicle inside the vehicle, thereby giving the observer a virtual image. A head-up display device (an example of a virtual image display device) to be visually recognized is described. In particular, the head-up display device described in Patent Document 1 describes a head-up display device that recognizes a vehicle speed situation by changing the perceived distance of a virtual image (distance to a virtual image perceived by an observer). ing. The image (virtual image) can attract the visual attention of the observer by moving to the near side or the distant side when viewed from the observer, and can provide distance information to the displayed image. It can be added. The head-up display device that changes the perceived distance in this way is provided with a stereoscopic display device inside.

The stereoscopic display device may be, for example, a method using a lens array or the like (lenticular method, see, for example, Patent Document 2), a method using a parallax barrier (paralux barrier method, see, for example, Patent Document 3), or a parallax image. There is a time-divided display method (see, for example, Patent Documents 4, 5 and 6) and the like.

By directing the display light of the left viewpoint image to the position where the left eye exists and the display light of the right viewpoint image to the position where the right eye exists, the left viewpoint image and the right viewpoint image with a difference are visually recognized and fused. The perceived distance of a virtual image is changed by making an image.

Japanese Unexamined Patent Publication No. 2019-127065 Japanese Unexamined Patent Publication No. 2006-115198 Japanese Unexamined Patent Publication No. 2014-150304 Japanese Unexamined Patent Publication No. 2011-107382 Japanese Unexamined Patent Publication No. 2000-236561 Japanese Unexamined Patent Publication No. 2000-4452

By the way, it is known that crosstalk occurs in a stereoscopic display device as described above. Crosstalk is a phenomenon in which a viewpoint image that should be originally observed when observed from one viewpoint and a viewpoint image adjacent to the viewpoint image are observed at the same time, and a multiple image in which a plurality of viewpoint images are overlapped is observed. .. This will be described below.

FIG. 11 is a diagram showing the light intensity of the display light distributed in the left-right direction (X-axis) of the irips of the driver's seat of the vehicle. In a stereoscopic display device as described above, display lights having parallax (having different parallax) have different regions in the left-right direction (or in addition to the vertical direction) (the regions are "partial parallax" and "partial". It is directed to "viewpoint" or simply "viewpoint"). As shown, the display light 801 having the first parallax is directed to the partial parallax E101, and the display light 802 having the second parallax different from the first parallax is on the left side of the first partial parallax E101. The indicator light 803, which is directed to the partial parallax E102 adjacent to and has a third parallax different from the first and second parallax, is directed to the partial parallax E103 adjacent to the left side of the second partial parallax E102. Then, the display light 804 having a fourth parallax different from the first to third parallax is directed to the partial parallax E104 adjacent to the left side of the third partial parallax E103.

12A and 12B are diagrams for explaining the arrangement of the left viewpoint image and the right viewpoint image, and the arrangement of the perceptual image fused by the left viewpoint image and the right viewpoint image. The upper view of FIGS. 12A and 12B is a view seen from the upper side (Y-axis positive direction) of the moving body, and the lower figure is a view seen from the left side (X-axis positive direction) of the moving body.

The perceptual image FU1010 shown in FIG. 12A corresponds to the content image FU1010 of FIG. 13, and is a diagram showing an aspect in which the perceptual image FU1020 is fused closer to and below the observer than the perceptual image FU1020 shown in FIG. 12B. be. As shown in the figure, the display light 803 causes the left eye 700L to visually recognize the left viewpoint image VL31 at a predetermined position in the virtual image display area 1000. The display light 802 causes the right-eye view image VR21 to be visually recognized by the right-eye 700R at a position separated from the left-viewpoint image VL31 in the virtual image display area 1000 by a specific distance DV1010 in the right direction. As a result, the left viewpoint image VL31 and the right viewpoint image VR21 are fused, and at the position of the intersection of the straight line connecting the left eye 700L and the left viewpoint image VL31 and the straight line connecting the right eye 700R and the right viewpoint image VR21. 1 Perceptual image FU1010 is perceived. At this time, the angle between the straight line connecting the left eye 700L and the left viewpoint image VL31 and the straight line connecting the right eye 700R and the right viewpoint image VR21 is defined as the first convergence angle θc1. Further, as shown in the lower figure of FIG. 12A, the angle between the straight line connecting the left eye 700L and the left viewpoint image VL31 (or the straight line connecting the right eye 700R and the right viewpoint image VR21) and the horizontal line is the first vertical arrangement angle. Let it be θf1.

Further, the perceptual image FU1020 shown in FIG. 12B corresponds to the content image FU1020 of FIG. 13, and shows an aspect in which the perceptual image FU1020 shown in FIG. 12A is fused to a distant side and upward from the observer. It is a figure. As shown in the figure, the display light 803 causes the left eye 700L to visually recognize the left viewpoint image VL32 at a predetermined position in the virtual image display area 1000. The display light 802 causes the right-eye view image VR22 to be visually recognized by the right-eye 700R at a position separated from the left-viewpoint image VL32 in the virtual image display area 1000 by a specific distance DV1020 (here, DV1020> DV1010). As a result, the left viewpoint image VL32 and the right viewpoint image VR22 are fused, and the first position is at the intersection of the straight line connecting the left eye 700L and the left viewpoint image VL32 and the straight line connecting the right eye 700R and the right viewpoint image VR22. The second perceived image FU1020 is perceived at a position farther from the observer than the perceived image FU1010. At this time, the angle between the straight line connecting the left eye 700L and the left viewpoint image VL32 and the straight line connecting the right eye 700R and the right viewpoint image VR22 is smaller than the first convergence angle θc1. .. Further, as shown in the lower figure of FIG. 12B, the angle between the straight line connecting the left eye 700L and the left viewpoint image VL32 (or the straight line connecting the right eye 700R and the right viewpoint image VR22) and the horizontal line is the second vertical arrangement angle. θf2 is set smaller than the first vertical arrangement angle θf1. As a result, the second perceptual image FU1020 is above the first perceptual image FU1010 as shown in FIG. 13 from the observer's point of view, and is perceived in the distance.

As shown in FIG. 11, non-regular display light 804 other than the normal display light 803 in the partial viewing area E103 may be incident on the left eye 700L. The light intensity 920 of the non-regular display light 804 is considerably smaller than the light intensity 910 of the regular display light 803. However, the observer can see the first perceived image FU1010 in addition to the regular first perceived image FU1010 and the second perceived image FU1020, which are fused images of the regular left viewpoint images VL31 and VL32 and the normal right viewpoint images VR21 and VR22. The virtual image VR41 by the non-regular display light 804 is visually recognized at the position shifted in the left-right direction (the position shifted to the right side of the first perceived image FU1010 in the example of FIG. 13), and the regular left viewpoint image VL32 and the regular right. In addition to the normal second perceived image FU1020 fused with the viewpoint image VL22, the position is displaced in the left-right direction of the second perceived image FU1020 (in the example of FIG. 13, the position is displaced to the right of the second perceived image FU1020). , The virtual image VR42 by the non-regular display light 804 can be visually recognized.

A summary of the particular embodiments disclosed herein is presented below. It should be understood that these embodiments are presented solely to provide the reader with an overview of these particular embodiments and do not limit the scope of this disclosure. In fact, the present disclosure may include various aspects not described below.

The outline of the present disclosure relates to a display control device for displaying a highly visible image, a head-up display device, a display control response, and the like. More specifically, it is intended to reduce the visibility of the non-regular image due to crosstalk, or to suppress the deterioration of the visibility of the regular image while reducing the visibility of the non-regular image due to crosstalk. Also related.

Therefore, the display control device, the head-up display device, the display control method, and the like described in the present specification employ the following means in order to solve the above-mentioned problems. In the present embodiment, by visually recognizing a left-viewpoint image and a right-viewpoint image having a parallax, they are displayed as a content image with a depth expression added, and are displayed in the left-right direction of the content image, and do not have a clear outline. The gist is to display one or more glow images.

Therefore, the display control device described in the present specification is a display control device that executes display control in a head-up display device that makes an observer visually recognize an imaginary image of an image by projecting an image onto a projected member. It comprises one or more processors, a memory, and one or more computer programs stored in the memory and configured to be executed by the one or more processors, the processor being an observer. 3D display processing that displays a content image with depth expression by visually recognizing a left-viewpoint image and a right-viewpoint image that have a difference between the left and right eyes of the CPU, and a clear display in the left-right direction of the content image. A glow display process for displaying one or more glow images having no contour is executed.

According to the present invention, by displaying a glow image having no clear outline in the left-right direction of the regular content image, even if a non-regular content image generated by crosstalk is displayed, the glow image and the glow image are displayed. The non-genuine content image overlaps with the non-genuine content image, and the visibility of the non-genuine content image can be reduced.

FIG. 1 is a diagram showing an example of application of a vehicle display system to a vehicle. FIG. 2 is a diagram showing a configuration of a head-up display device. FIG. 3 is a diagram showing an example of a foreground that the observer visually recognizes while the own vehicle is traveling and a perceptual image that is superimposed and displayed on the foreground. FIG. 4 is a diagram conceptually showing the positional relationship between the left viewpoint virtual image and the right viewpoint virtual image displayed on the virtual image forming surface and the perceived image perceived by the observer by these left viewpoint virtual images and the right viewpoint virtual images. be. FIG. 5A is a diagram showing one aspect of the glow image G. FIG. 5B is a diagram showing one aspect of the glow image G. FIG. 6 shows a display of a first glow image added to a first content image perceived on the near side and a second glow image added to a second content image perceived on the distant side. It is a figure which shows the aspect. FIG. 7A is a diagram showing a first change mode of the glow image G, the upper figure is an example of the first display mode, and the lower figure is an example of the second display mode. FIG. 7B is a diagram showing a second change mode of the glow image G, the upper figure is an example of the first display mode, and the lower figure is an example of the second display mode. FIG. 8 is a block diagram of a vehicle display system of some embodiments. It is a flow diagram which shows the method of performing the operation of setting the display mode of a glow image based on the eye position of an observer according to some embodiments. FIG. 10 is a diagram showing the light intensity of the display light distributed in the left-right direction (X-axis) of the eye box of the driver's seat of the own vehicle when the observer's eye position 700 is at a predetermined position. FIG. 11 is a diagram showing the light intensity of the display light distributed in the left-right direction (X-axis) of the irips of the driver's seat of the vehicle, which is used in the description of the conventional example. FIG. 12A is a diagram for explaining the arrangement of the left viewpoint image and the right viewpoint image and the arrangement of the first perceptual image fused by the left viewpoint image and the right viewpoint image, which is used in the explanation of the conventional example. FIG. 12B is a diagram for explaining the arrangement of the left viewpoint image and the right viewpoint image and the arrangement of the second perceptual image fused by the left viewpoint image and the right viewpoint image, which is used in the explanation of the conventional example. FIG. q3 is a diagram which is used in the description of the conventional example and shows an example of a foreground that the observer visually recognizes while the own vehicle is traveling and a perceptual image that is superimposed and displayed on the foreground.

Hereinafter, FIGS. 1 to 10 provide a description of the configuration and operation of an exemplary vehicle display system. The present invention is not limited to the following embodiments (including the contents of the drawings). Of course, changes (including deletion of components) can be made to the following embodiments. Further, in the following description, in order to facilitate understanding of the present invention, description of known technical matters will be omitted as appropriate.

See FIG. FIG. 1 is a diagram showing an example of a configuration of a virtual image display system for a vehicle including a parallax type 3D-HUD device. In FIG. 1, the left-right direction (in other words, the width direction of the vehicle 1) of the vehicle (an example of a moving body) 1 is the X-axis (the positive direction of the X-axis is the left direction when facing the front of the vehicle 1). ), And the vertical direction (in other words, the height direction of the vehicle 1) along the line segment orthogonal to the ground or the surface corresponding to the ground (here, the road surface 6) is the Y axis (Y axis). The forward direction is the upward direction.), And the front-rear direction along the lines orthogonal to each of the left-right direction and the up-down direction is the Z-axis (the positive direction of the Z-axis is the straight-ahead direction of the vehicle 1). This point is the same in other drawings.

As shown in the figure, the vehicle display system 10 provided in the vehicle (own vehicle) 1 determines the positions and line-of-sight directions of the left eye 700L and the right eye 700R of the observer (typically, the driver sitting in the driver's seat of the vehicle 1). An external sensor 411 consisting of an eye position detection unit (line-of-sight detection unit) 409 for detecting the pupil (or face) to be detected, a camera (for example, a stereo camera) that captures the front (in a broad sense, the surroundings) of the vehicle 1, and a head. It has an up-display device (hereinafter, also referred to as a HUD device) 20 and a display control device 30 for controlling the HUD device 20.

FIG. 2 is a diagram showing one aspect of the configuration of the head-up display device. The HUD device 20 is installed, for example, in a dashboard (reference numeral 5 in FIG. 1). The HUD device 20 houses the stereoscopic display device 40, the relay optical system 80, and the stereoscopic display device 40 and the relay optical system 80, and can emit the display light K from the stereoscopic display device 40 from the inside to the outside. It has a housing 22 having a light emitting window 21.

The stereoscopic display device 40 is a parallax type 3D display device here. The stereoscopic display device (differential 3D display device) 40 is a display device 50 and a naked-eye stereoscopic display device using a multi-viewpoint image display method capable of controlling depth expression by visually recognizing a left-viewpoint image and a right-viewpoint image. , A light source unit 60 that functions as a backlight.

The display 50 has an optical modulation element 51 that optical-modulates the illumination light from the light source unit 60 to generate an image, and for example, a lenticular lens, a paralux barrier (parallax barrier), and the like, and emits light from the optical modulation element 51. The light to be generated is the left-eye display light (reference numeral K10 in FIG. 1) such as the left-eye rays K11, K12 and K13, and the right-eye display light such as the right-eye rays K21, K22 and K23 (FIG. 1). It has an optical layer (an example of a light ray separating unit) 52, which is separated from the reference numeral K20). The optical layer 52 includes an optical filter such as a lenticular lens, a parallax barrier, a lens array, and a microlens array. In the embodiment, the optical layer 52 includes all forms of the optical layer arranged on the front surface or the rear surface of the light modulation element 51 without being limited to the above-mentioned optical filter. However, this is an example and is not limited.

Further, the stereoscopic display device 40 is formed by forming the light source unit 60 with a directional backlight unit (an example of a light ray separating unit) in place of or in addition to the optical layer (an example of a light ray separating unit) 52. , Left-eye display light (reference numeral K10 in FIG. 1) such as light rays K11, K12 and K13 for the left eye, and right-eye display light (reference numeral K20 in FIG. 1) such as light rays K21, K22 and K23 for the right eye. , May be emitted. Specifically, for example, the display control device 30 described later causes the optical modulation element 51 to display a left viewpoint image when the directional backlight unit irradiates the illumination light toward the left eye 700L, thereby causing light rays for the left eye. When the display light K10 for the left eye such as K11, K12, and K13 is directed toward the observer's left eye 700L and the directional backlight unit irradiates the illumination light toward the right eye 700R, the right viewpoint image is displayed on the optical modulation element 51. By displaying the light, the light rays K21 and K22 for the right eye and the display light K20 for the right eye such as K23 are directed toward the observer's left eye 700R. However, this is an example and is not limited.

The display control device 30, which will be described later, executes, for example, image rendering processing (graphic processing), display drive processing, etc., to the observer's left eye 700L, to the left eye display light K10 of the left viewpoint image V10, and to the right eye 700R. By directing the right-eye display light K20 of the right-viewpoint image V20 and adjusting the left-viewpoint image V10 and the right-viewpoint image V20, the mode of the perceptual virtual image FU displayed (perceived by the observer) by the HUD device 20 is controlled. be able to. The display control device 30, which will be described later, controls the display (display 50) so as to reproduce a light field that (generally) reproduces light rays output in various directions from a point existing in a certain space. You may.

The relay optical system 80 has curved mirrors (concave mirrors and the like) 81 and 82 that reflect the light from the stereoscopic display device 40 and project the image display lights K10 and K20 onto the windshield (projected member) 2. However, other optical members (a refraction optical member such as a lens, a diffractive optical member such as a hologram, a reflection optical member, or a combination thereof may be included) may be further included.

In FIG. 1, the stereoscopic display device 40 of the HUD device 20 displays an image having a parallax (parallax image) for each of the left and right eyes. As shown in FIG. 1, each parallax image is displayed as V10 and V20 imaged on the virtual image display surface (virtual image image plane) VS. The focus of each eye of the observer (person) is adjusted to match the position of the virtual image display area VS. The position of the virtual image display area VS is referred to as an "adjustment position (or image formation position)", and a predetermined reference position (for example, the center 205 of the eye box 200 of the HUD device 20, the viewpoint position of the observer, or the viewpoint position of the observer. The distance from the virtual image display area VS (see reference numeral D10 in FIG. 4) from the specific position of the own vehicle 1) is referred to as an adjustment distance (imaging distance).

However, in reality, since the human brain fuses each image (virtual image), the person is placed at a position further back than the adjustment position (for example, depending on the convergence angle between the left viewpoint image V10 and the right viewpoint image V20). It is recognized as if the perceived image (here, the figure at the tip of the arrow for navigation) FU is displayed in the perceived image (here, the position that is perceived as being farther from the observer as the convergence angle becomes smaller). do. The perceptual virtual image FU may be referred to as a "stereoscopic virtual image", and may also be referred to as a "stereoscopic image" when the "image" is broadly grasped and the virtual image is also included. In addition, it may be referred to as a "stereoscopic image", a "3D display", or the like.

Next, reference is made to FIGS. 3 and 4. FIG. 3 is a diagram showing an example of a foreground that the observer visually recognizes while the own vehicle 1 is traveling and a perceptual image that is superimposed and displayed on the foreground. FIG. 4 is a diagram conceptually showing the positional relationship between the left viewpoint virtual image and the right viewpoint virtual image displayed on the virtual image forming surface and the perceived image perceived by the observer by these left viewpoint virtual images and the right viewpoint virtual images. be.

In FIG. 3, the vehicle 1 is traveling on a straight road (road surface) 6. The HUD device 20 is installed in the dashboard 5. The display light K (K10, K20) is projected onto the projected portion (front windshield of the vehicle 1) 2 from the light emitting window 21 of the HUD device 20. In the example of FIG. 3, the first content image FU1 superimposing on the road surface 6 and instructing the route of the vehicle 1 (here, the straight direction is shown), and also the route of the vehicle 1 (here, the straight line is shown) are instructed. , The second content image FU2 perceived farther than the first content image FU1, the first glow image G1 displayed in the left-right direction of the first content image FU1 and having no clear outline, the second. The second glow image G2, which is displayed in the left-right direction of the content image FU2 and does not have a clear outline, is displayed.

As shown in the left figure of FIG. 4, the HUD device 20 has (1) the projected unit 2 at a position and angle such that it is reflected by the projected unit 2 to the left eye 700L detected by the eye position detecting unit 409. The display light K10 for the left eye is emitted to the left eye, and the first left viewpoint content V11 and the first left viewpoint glow image V16 are imaged at a predetermined position in the virtual image display area VS seen from the left eye 700L. 2) The display light K20 for the right eye is emitted to the projected portion 2 at a position and angle so as to be reflected by the projected portion 2 to the right eye 700R, and at a predetermined position of the virtual image display area VS seen from the right eye 700R. The first right viewpoint content V21 and the first right viewpoint glow image V26 are imaged. The first content image FU1 perceived by the first left viewpoint content V11 having parallax and the first right viewpoint content V21 (also the first left viewpoint glow image V16 having parallax and the first right viewpoint). The first glow image G1) perceived by the glow image V26 is visually recognized at a position (a position separated by a distance D31 from the above reference position) behind the virtual image display area VS by a distance D21.

Similarly, as shown in the right figure of FIG. 4, the HUD device 20 is (1) covered at a position and an angle such that it is reflected by the projected unit 2 to the left eye 700L detected by the eye position detecting unit 409. The display light K10 for the left eye is emitted to the projection unit 2, and the second left viewpoint content V12 and the second left viewpoint glow image V17 are imaged at a predetermined position in the virtual image display area VS seen from the left eye 700L. (2) The display light K20 for the right eye is emitted to the projected portion 2 at a position and angle such that it is reflected by the projected portion 2 to the right eye 700R, and a predetermined virtual image display area VS seen from the right eye 700R is emitted. A second right-viewpoint content V22 and a second right-viewpoint glow image V27 are imaged at the position. A second content image FU2 perceived by a second left viewpoint content V12 having parallax and a second right viewpoint content V22 (also a second left viewpoint glow image V17 having parallax and a second right viewpoint). The second glow image G2) perceived by the glow image V27 is visually recognized at a position behind the virtual image display area VS by a distance D22 (a position separated by a distance D31 from the above reference position).

The HUD device 20 (display control device 30) of the above embodiment displayed the left viewpoint glow image V16 (V17) and the right viewpoint glow image V26 (V27) when displaying the glow image G. This is an example and is not limited. In another embodiment, the HUD device 20 (display control device 30) displays only one of the left viewpoint glow image V16 (V17) and the right viewpoint glow image V26 (V27) when displaying the glow image G. May be good.

Specifically, the distance (imaging distance D10) from the above-mentioned reference position to the imaginary image display area VS is set to, for example, a distance of "4 m", and the first one shown in the left figure of FIG. 4 from the above-mentioned reference position. The distance to the content image FU1 and the first glow image G1 (first perceived distance D31) is set to, for example, a distance of "7 m", and the second is shown in the right figure of FIG. 4 from the above reference position. The distance to the content image FU2 and the second glow image G2 (second perceived distance D32) is set to, for example, a distance of "10 m". However, this is an example and is not limited.

The first and second perceptual distances D31 and D32 are line segments connecting the left eye 700L and the left viewpoint image V10 (V11, V16, V12, V17) (in other words, the line-of-sight direction from the left eye 700L toward the left viewpoint image V10). ) And the line segment connecting the right eye 700R and the right viewpoint image V20 (V21, V26, V22, V27) (in other words, the line-of-sight direction from the right eye 700R to the right viewpoint image V20) and the angle (convergence angle). It is determined according to the size of θc).

The first congestion angle θc1 shown on the left side of FIG. 4 is larger than the second congestion angle θc2 shown on the right side of FIG. Therefore, the distance from the reference position to the first content image FU1 and the first glow image G1 (first perceived distance D31) is the second content image FU2 and the second content image FU2 from the reference position. It is shorter than the distance to the glow image G2 (second perceived distance D32).

The display control device 30 (HUD device 20) of the present embodiment displays the content image FU and the glow image G displayed in the left-right direction of the content image FU. As a result, even if a cross talk occurs and the non-genuine content image is displayed in the left direction and / or the right direction of the regular content image FU, it is displayed in the left-right direction of the regular content image FU. It is possible to prevent the non-genuine content image from being clearly seen by being mixed with the glow image G. In other words, the visibility of non-genuine content images can be reduced.

FIG. 5A is a diagram showing one aspect of the glow image G. As shown, the lateral length αg of the glow image G as seen by the observer is longer than the lateral length αf of the content image FU. Further, the vertical length βg of the glow image G seen from the observer is longer than the vertical length βf of the content image FU. Further, the difference (αg-αf) between the horizontal length αg of the glow image G and the horizontal length αf of the content image FU is the vertical length βg of the glow image G and the vertical direction of the content image FU. The length is longer than the difference from βf (βg-βf). Typically, the non-regular content image produced by crosstalk is viewed with a large deviation from the regular content image in the horizontal direction, and the amount of deviation from the regular content image in the vertical direction is smaller than that in the horizontal direction (and / / Or the frequency of deviation is low). Therefore, by suppressing the length (area) of the additional glow image G in the vertical direction in which the amount of deviation is small (and / or the frequency of deviation is small), the contrast (an example of visibility) of the content image FU is reduced. While suppressing it, it is possible to more reliably suppress the deterioration of the visibility of the non-regular content image due to the cross talk in the lateral direction where the amount of deviation is large (and / or the frequency of deviation is high). However, the above aspect is an example, and the present invention is not limited to this. As an example of another embodiment, the vertical length βg of the glow image G as seen by the observer may be the same as or shorter than the vertical length βf of the content image FU.

Further, it is preferable that the glow image G has a similar color and a low saturation with respect to the content image FU. Here, the similar color means that the angle formed from the center in the color wheel is 60 degrees or less. More preferably, the angle between the color of the glow image G and the color of the content image FU from the center in the color wheel is 30 degrees or less. A non-genuine content image that can be visually recognized by crosstalk has a similar color to the content image and has low saturation. Therefore, by making the color (hue, saturation, and lightness) of the glow image G substantially the same as the color (hue, saturation, and lightness) of the non-regular content image that can be visually recognized by crosstalk, it is non-normal. The content image of the above can be integrated with the glow image G to further reduce the visibility of the non-regular content image. When the content image FU is composed of a plurality of colors, the chromaticity of the glow image G may be similar in color to the average chromaticity of the pixels of the content image FU and the saturation may be low. ..

FIG. 5B is a diagram showing one aspect of the glow image G. The glow image G may have a low visibility portion GA in which the position (region) of the non-regular content image that can be visually recognized by crosstalk is cut out (hidden) or the saturation is reduced. .. As a result, when the non-genuine content image is displayed by crosstalk, the non-genuine content image is displayed in the low visibility portion GA of the glow image G, whereby the non-genuine content image and the non-genuine content image are displayed. The glow image G around the content image can be easily integrated, and the visibility of the non-regular content image can be further reduced.

However, in the above aspect, the low visibility portion GA is provided only on the left side of the content image FU, but this is an example and is not limited thereto. As an example of another embodiment, the low visibility unit GA may be provided only on the left side of the content image FU, or may be provided on both the left and right sides of the content image FU. Further, the display control device 30 described later switches between displaying the low visibility unit GA only on the left side of the content image FU or displaying it only on the right side of the content image FU, depending on the eye position 700. You may. Further, the display control device 30 described later displays the low visibility unit GA only on the left side of the content image FU, displays it only on the right side of the content image FU, or the content, depending on the eye position 700. Switching may be performed in a mode in which the image FU is not provided. When the content image FU is perceived behind the virtual image display area VS, when crosstalk occurs with respect to the left eye 700L, the left eye 700L is a non-regular right viewpoint image V20 on the right side of the regular left viewpoint image V10. To see. Therefore, it is preferable that the glow image V16 (V17) added to the left viewpoint image V11 (V12) in FIG. 4 is provided with a low visibility portion GA on at least the right side of the left viewpoint image V11. At this time, the glow image V26 (V27) added to the right viewpoint image V21 (V22) in FIG. 4 may reduce the visibility on the left side of the right viewpoint image V21 (V22). This makes it possible to adjust the left-right balance in the glow images G1 and G2. Similarly, when crosstalk occurs with respect to the right eye 700R, the right eye 700R visually recognizes the non-regular left viewpoint image V10 on the left side of the regular right viewpoint image V20. Therefore, it is preferable that the glow image V26 (V27) added to the right viewpoint image V21 (V22) in FIG. 4 is provided with a low visibility portion GA on at least the left side of the right viewpoint image V21 (V22). At this time, the glow image V16 (V17) added to the left viewpoint image V11 (V12) in FIG. 4 may reduce the visibility of the right side of the left viewpoint image V11 (V12). This makes it possible to adjust the left-right balance in the glow images G1 and G2.

FIG. 6 is added to the first glow image G1 attached to the first content image FU1 perceived on the near side and the second content image FU2 perceived on the far side from the first content image FU1. It is a figure which shows the display mode of the 2nd glow image G2. The ratio of the lateral length αg2 of the second glow image G2 to the lateral length αf2 of the second content image FU2 perceived on the distant side is that of the first content image FU1 perceived on the near side. It is larger than the ratio of the lateral length αg1 of the first glow image G1 to the lateral length αf1 (αg2 / αf2> αg1 / αf1). That is, according to some embodiments, as the perceived distance D30 increases, the ratio of the lateral length αg of the glow image to the lateral length αf of the content image may be increased. The inventor has recognized that the non-regular content image that can be visually recognized by crosstalk has a larger amount of deviation from the regular perceived image as the perceived distance D30 increases. Even if the distance D30 becomes large and the amount of deviation of the non-regular content image becomes large, the non-regular content image tends to overlap with the glow image G (the area where the non-regular content image and the glow image G overlap increases. ), The visibility of non-genuine content images can be reduced. That is, the display control device 30 increases the ratio of the lateral length αg of the glow image to the lateral length αf of the content image stepwise or continuously as the perceived distance D30 increases. Or an arithmetic expression or the like may be stored in the memory 37 in advance. The lateral length αg1 of the first glow image G1 and the lateral length αg2 of the second glow image G2 may be the same. By not changing the size of the glow image G, it is possible to prevent the observer's visual attention from being too directed toward the glow image G or the content image FU.

The HUD device 20 (display control device 30) of some embodiments changes the display mode of the glow image G depending on whether or not the detected (or estimated) eye position is in a specific state.

FIG. 7A is a diagram showing a first change mode of the glow image G, the upper figure is an example of the first display mode, and the lower figure is an example of the second display mode. The HUD device 20 (display control device 30) of some embodiments may change the saturation while maintaining the size of the glow image G. The horizontal length αg11 of the glow image G shown in the upper part of FIG. 7A is the same as the horizontal length αg12 of the glow image G shown in the lower figure. Further, the saturation of the glow image G shown in the upper part of FIG. 7A is lower than the saturation of the glow image G shown in the lower part of FIG. 7A.

FIG. 7B is a diagram showing a second change mode of the glow image G, the upper figure is an example of the first display mode, and the lower figure is an example of the second display mode. The HUD device 20 (display control device 30) of some embodiments may be varied in size while maintaining the saturation of the glow image G. The horizontal length αg21 of the glow image G shown in the upper part of FIG. 7B is shorter than the horizontal length αg22 of the glow image G shown in the lower figure. Further, the saturation of the glow image G shown in the upper part of FIG. 7B is the same as the saturation of the glow image G shown in the lower part of FIG. 7A.

Further, the first change mode shown in FIG. 7A and the second change mode shown in FIG. 7B may be combined. The HUD device 20 (display control device 30) of some embodiments may change the saturation and size of the glow image G. The horizontal length of the glow image G in the first display mode is shorter than the horizontal length of the glow image G in the second display mode, and the saturation of the glow image G in the first display mode is the first. It may be lower than the saturation of the glow image G in the display mode of 2.

FIG. 8 is a block diagram of a virtual image display system for a vehicle according to some embodiments. The display control device 30 includes one or more I / O interfaces 31, one or more processors 33, one or more image processing circuits 35, and one or more memories 37. The various functional blocks described in FIG. 3 may be composed of hardware, software, or a combination thereof. FIG. 8 is only one embodiment, and the illustrated components may be combined with a smaller number of components or may have additional components. For example, the image processing circuit 35 (eg, graphic processing unit) may be included in one or more processors 33.

As shown, the processor 33 and the image processing circuit 35 are operably connected to the memory 37. More specifically, the processor 33 and the image processing circuit 35 execute a program stored in the memory 37 to generate and / or transmit image data, for example, for a vehicle display system 10 (display). 40) can be controlled. The processor 33 and / or the image processing circuit 35 includes at least one general purpose microprocessor (eg, central processing unit (CPU)), at least one application specific integrated circuit (ASIC), and at least one field programmable gate array (FPGA). , Or any combination thereof. The memory 37 includes any type of magnetic medium such as a hard disk, any type of optical medium such as a CD and DVD, any type of semiconductor memory such as a volatile memory, and a non-volatile memory. Volatile memory may include DRAM and SRAM, and non-volatile memory may include ROM and NVRAM.

As shown, the processor 33 is operably linked to the I / O interface 31. The I / O interface 31 communicates (CAN) with, for example, the vehicle ECU 401 and / or other electronic devices (reference numerals 403 to 419 described later) provided in the vehicle according to the standard of CAN (Controller Area Network). Also called communication). The communication standard adopted by the I / O interface 31 is not limited to CAN, and is, for example, CANFD (CAN with Flexible Data Rate), LIN (Local Interconnect Network), Bluetooth (registered trademark), MOST (Media Oriented Systems Transport). : MOST is a registered trademark), a wired communication interface such as UART, or USB, or a local such as a personal area network (PAN) such as a Bluetooth® network, or an 802.1x Wi-Fi® network. In-vehicle communication (internal communication) interface, which is a short-range wireless communication interface within several tens of meters such as an area network (LAN), is included. The I / O interface 31 is a wireless wide area network (WWAN0, IEEE 802.16-2004 (WiMAX: Worldwide Interoperability for Microwave Access)), an IEEE 802.16e base (Mobile WiMAX), 4G, 4G-LTE, LTE Advanced, It may include an external communication (external communication) interface such as a wide area communication network (for example, an Internet communication network) according to a cellular communication standard such as 5G.

As shown in the figure, the processor 33 is interoperably connected to the I / O interface 31 to provide information with various other electronic devices and the like connected to the vehicle display system 10 (I / O interface 31). Can be exchanged. The I / O interface 31 includes, for example, a vehicle ECU 401, a road information database 403, a vehicle position detection unit 405, an operation detection unit 407, an eye position detection unit 409, an external sensor 411, a brightness detection unit 413, an IMU415, and mobile information. The terminal 417, the external communication device 419, and the like are operably connected. The I / O interface 31 may include a function of processing (converting, calculating, and analyzing) information received from other electronic devices connected to the vehicle display system 10.

The display 40 is operably connected to the processor 33 and the image processing circuit 35. Therefore, the image displayed by the light modulation element 51 may be based on the image data received from the processor 33 and / or the image processing circuit 35. The processor 33 and the image processing circuit 35 control the image displayed by the light modulation element 51 based on the information acquired from the I / O interface 31.

The vehicle ECU 401 uses sensors and switches provided on the vehicle 1 to indicate the state of the vehicle 1 (for example, mileage, vehicle speed, accelerator pedal opening, brake pedal opening, engine throttle opening, injector fuel injection amount, engine speed). , Motor speed, steering angle, shift position, drive mode, various warning states, posture (including roll angle and / or pitching angle), vehicle vibration (including magnitude, frequency, and / or frequency of vibration) )) And the like, and the state of the vehicle 1 is collected and managed (may include control), and as a part of the function, the numerical value of the state of the vehicle 1 (for example, the vehicle speed of the vehicle 1) is acquired. ) Can be output to the processor 33 of the display control device 30. In addition, the vehicle ECU 401 simply transmits the numerical value detected by the sensor or the like (for example, the pitching angle is 3 [brake] in the forward tilting direction) to the processor 33, or instead, the numerical value detected by the sensor is used. A determination result based on one or more states of the vehicle 1 including (for example, the vehicle 1 satisfies a predetermined condition of a forward leaning state) and / and an analysis result (for example, a brake pedal opening degree). Combined with the information, the brake has caused the vehicle to lean forward.) May be transmitted to the processor 33. For example, the vehicle ECU 401 may output a signal indicating a determination result indicating that the vehicle 1 satisfies a predetermined condition stored in advance in a memory (not shown) of the vehicle ECU 401 to the display control device 30. The I / O interface 31 may acquire the above-mentioned information from the sensors and switches provided in the vehicle 1 provided in the vehicle 1 without going through the vehicle ECU 401.

Further, the vehicle ECU 401 may output an instruction signal indicating an image displayed by the vehicle display system 10 to the display control device 30, and at this time, it is necessary to notify the coordinates, size, type, display mode, and image of the image. The degree and / or the necessity-related information that is the source for determining the notification necessity may be added to the instruction signal and transmitted.

The eye position detection unit 409 may include a camera such as an infrared camera that detects the eye position 700 of the observer sitting in the driver's seat of the vehicle 1, and may output the captured image to the processor 33. The processor 33 acquires an image taken from the eye position detection unit 409 (an example of information that can estimate the eye position 700), and analyzes the captured image by a method such as pattern matching to obtain the eye position of the observer. The coordinates of 700 may be detected.

Further, the eye position detection unit 409 is set in the analysis result of analyzing the image captured by the camera (for example, the eye position 700 of the observer is set in the eye box 200 (or in the area including the eye box 200 and its surroundings)). A signal indicating where it belongs to a plurality of spatial regions may be output to the processor 33. The method for acquiring the eye position 700 of the observer of the vehicle 1 or the information capable of estimating the eye position 700 of the observer is not limited to these, and a known eye position detection (estimation) technique is used. May be obtained.

Further, the eye position detection unit 409 detects the moving speed and / or the moving direction of the observer's eye position 700 (which may be the observer's head), and the observer's eye position 700 (the observer's head). A signal indicating the moving speed and / or the moving direction may be output to the processor 33.

Further, the eye position detection unit 409 is a signal indicating that (10) the eye position 700 of the observer is in a region where crosstalk can occur (or a region where the influence of crosstalk can increase), or (20) the observer. When the signal at which the eye position 700 is predicted to enter the region where crosstalk can occur (or the region where the influence of crosstalk can increase) is detected, it is determined that the above specific condition is satisfied, and the state is determined. The indicated signal may be output to the processor 33.

(20) The signal predicted that the observer's eye position 700 enters the region where crosstalk can occur (or the region where the influence of crosstalk can increase) is (21) the newly detected eye position 700 is the signal. A signal indicating that the eye position movement distance threshold value stored in advance in the memory 37 or more (the eye position movement within a predetermined unit time is larger than the specified range) with respect to the eye position 700 detected in the past. (22) A signal indicating that the movement speed of the eye position is equal to or higher than the eye position movement speed threshold value stored in advance in the memory 37, and (23) the cross talk in which the movement direction of the eye position is stored in advance in the memory 37. Includes a signal indicating that the direction is approaching a region that can occur (or a region where the influence of crosstalk can increase).

The software components stored in the memory 37 are the eye position detection module 502, the eye position estimation module 504, the eye position prediction module 506, the eye position state determination module 508, the display parameter setting module 510, the graphic module 512, and the light source drive module 514. , And the actuator drive module 516.

FIG. 9 is a flow chart showing a method S100 for performing an operation of setting a display mode of a glow image based on an observer's eye position according to some embodiments. The method S100 is executed by the display 40 (light modulation element 51) and the display control device 30 that controls the display 40 (light modulation element 51). Some actions in the method S100 are optionally combined, some steps are optionally modified, and some actions are optionally omitted.

As will be described below, the method S100 provides a method of changing the display mode of the glow image, particularly based on the determination of whether or not the eye position of the observer is in a specific state.

The eye position detection module 502 of FIG. 8 detects the eye position 700 of the observer (S110). The eye position detection module 502 detects coordinates indicating the lateral position of the observer's eyes (position in the X-axis direction, which is an example of a signal indicating the eye position 700), and the lateral direction of the observer's eyes. Detecting coordinates indicating the position and the position in the depth direction (positions in the X and Z axes, which is an example of a signal indicating the eye position 700), and coordinates indicating the height of the observer's eyes (Z). It is a position in the axial direction, which is an example of a signal indicating the eye position 700), and coordinates (positions in the Y and Z axes directions) indicating the height and depth of the observer's eyes. An example of a signal indicating the eye position 700, which is an example of a signal indicating the eye position 700, and / or coordinates indicating the observer's eye position 700 (positions in the X, Y, Z axis directions). Includes various software components for performing various actions related to detecting).

The eye position 700 detected by the eye position detection module 502 is one of the predetermined positions 700R, 700L, right eye position 700R, and left eye position 700L, right eye position 700R, and left eye position, respectively. It includes one of the 700L positions that can be detected (easily detected), or a position calculated from the right eye position 700R and the left eye position 700L (for example, the midpoint between the right eye position and the left eye position). For example, the eye position detection module 502 determines the eye position 700 based on the observation position acquired from the eye position detection unit 409 immediately before the timing of updating the display setting.

Further, the eye position detection module 502 detects the movement direction and / or the movement speed of the observer's eye position 700 based on the observation positions of the eyes of a plurality of observers acquired from the eye position detection unit 409, and the observer. A signal indicating the moving direction and / or moving speed of the eye position 700 may be output to the processor 33.

The eye position estimation module 504 acquires information capable of estimating the eye position (S114). Information that can estimate the eye position is, for example, an image captured from the eye position detection unit 409, the position of the driver's seat of the vehicle 1, the position of the observer's face, the height of the sitting height, or the eyes of a plurality of observers. Observation position, etc. The eye position estimation module 504 estimates the eye position 700 of the observer of the vehicle 1 from the information capable of estimating the eye position. The eye position estimation module 504 is based on an image captured from the eye position detection unit 409, the position of the driver's seat of the vehicle 1, the position of the observer's face, the height of the sitting height, the observation positions of the eyes of a plurality of observers, and the like. Includes various software components for performing various actions related to estimating the observer's eye position 700, such as estimating the observer's eye position 700. That is, the eye position estimation module 504 may include table data, an arithmetic expression, and the like for estimating the eye position 700 of the observer from the information that can estimate the eye position.

The eye position estimation module 504 sets the eye position 700 into an eye observation position acquired from the eye position detection unit 409 immediately before the timing of updating the display parameter and one or more eye observation positions acquired in the past. Based on this, it may be calculated by, for example, a method such as a weighted average.

The eye position prediction module 506 acquires information that can predict the eye position 700 of the observer (S116). The information that can predict the eye position 700 of the observer is, for example, the latest observation position acquired from the eye position detection unit 409, or one or more observation positions acquired in the past. The eye position prediction module 506 includes various software components for performing various actions related to predicting the eye position 700 based on predictable information on the observer's eye position 700. Specifically, for example, the eye position prediction module 506 predicts the eye position 700 of the observer at the timing when the image to which the new display setting is applied is visually recognized by the observer. The eye position prediction module 506 uses a prediction algorithm such as a least squares method, a Kalman filter, an α-β filter, or a particle filter to obtain the next value using one or more observation positions in the past. You may try to predict.

The eye position state determination module 508 determines whether the observer's eye position 700 is in a specific state (S130). The eye position state determination module 508 determines whether or not the observer's eye position 700 is within the region where crosstalk can occur (or the region where the influence of crosstalk can increase), and the eye position 700 determines. When it is within the region where crosstalk can occur (or the region where the influence of crosstalk can increase), it is determined that the state is specific, and (S134) the observer's eye position 700 can cause crosstalk (or the region). It is determined whether or not it is predicted to enter the region where the influence of crosstalk can increase), and if it is predicted, it is determined that it is in a specific state, and (S136) the observer's eye position 700 can be detected. Various actions for performing various actions related to the observer's eye position 700 being in a specific state, such as determining whether or not the eye position 700 is undetectable and determining that the eye position 700 is in a specific state. Includes software components. That is, the eye position state determination module 508 may include table data, an arithmetic expression, and the like for determining whether or not a specific state is obtained from the detection information, estimation information, or prediction information of the eye position 700.

(S132) The method of determining whether or not the observer's eye position 700 is within the region where crosstalk can occur (or the region where the influence of crosstalk can increase) is determined by (1) the eye position detection unit 409. Acquire some or all of the observer's eye observation positions acquired within the period (eg, more than a predetermined number of times) within the area where crosstalk can occur (or the area where the effect of crosstalk can increase). That, (2) the eye position detection module 502 detects the observer's eye position 700 within the region where crosstalk can occur (or the region where the influence of crosstalk can increase), or by a combination thereof, the observer. It includes determining that the eye position 700 of the eye box 200 is outside the eye box 200 (the eye position 700 of the observer is in a specific state) (note that the determination method is not limited thereto).

(S134) The method for determining whether or not the observer's eye position 700 is predicted to be within the region where crosstalk can occur (or the region where the influence of crosstalk can increase) is as follows: (1) Eye position prediction. The module 506 predicts whether the observer's eye position 700 after a predetermined time will be within the region where crosstalk can occur (or the region where the influence of crosstalk can increase), and (2) the eye position detection module 502 is newly added. The eye position 700 detected in the eye position 700 is equal to or larger than the eye position movement distance threshold previously stored in the memory 37 with respect to the previously detected eye position 700 (the movement speed of the eye position 700 is stored in the memory 37 in advance. It can be predicted that the eye position 700 of the observer will be within the region where crosstalk can occur (or the region where the influence of crosstalk can increase) due to the eye position movement speed threshold or higher) or a combination thereof. (The determination method is not limited to these.), Including, and determining that (the eye position 700 of the observer is in a specific state).

(S136) The method of determining whether or not the observer's eye position 700 can be detected is as follows: (1) A part of the observer's eye observation position acquired from the eye position detection unit 409 within a predetermined period (for example,). (2) The eye position detection module 502 cannot detect the observer's eye position 700 in normal operation, and (3) the eye position estimation module 504 usually cannot detect the eye position 700 more than a predetermined number of times. The observer's eye position 700 cannot be estimated in the operation of (4) the eye position prediction module 506 cannot predict the observer's eye position 700 in the normal operation, or a combination of these causes the observer's eye position 700. It includes determining that the eye position 700 cannot be detected (the observer's eye position 700 is in a specific state) (note that the determination method is not limited thereto).

FIG. 10 is a diagram showing the light intensity of the display light distributed in the left-right direction (X-axis) of the eye box 200 of the driver's seat of the own vehicle 1 when the observer's eye position 700 is in a predetermined position. be. When the observer's eye position 700 is in a predetermined position, as shown in the figure, the eyebox 200 is classified into four partial viewing areas E10, E20, E30, and E40 adjacent to each other in the left-right direction. The HUD device 20 directs the display light K1 for displaying an image having a first parallax (for example, a first left viewpoint image) to the (E10) partial parallax E10, and directs the display light K1 to the (E20) partial parallax E20. The display light K2 for displaying an image having a second parallax different from the parallax of (for example, the first right viewpoint image) is directed, and the (E30) partial parallax E30 has a second parallax different from the first and second parallax. A display light K3 for displaying an image having a parallax of 3 (for example, a second left viewpoint image) is directed, and a fourth parallax different from the first to third parallax is directed to the (E40) partial parallax E40. The display light K4 displaying the image (for example, the second right viewpoint image) is directed to the partial parallax E104 adjacent to the left side of the third partial parallax E103. A first region EC1 near the boundaries of adjacent partial visions E10 and E20, a second region EC2 near the boundaries of adjacent partial visions E20 and E30, and near the boundaries of adjacent partial visions E30 and E40. The third region EC3 can be said to be a region where crosstalk can occur (or a region where the influence of crosstalk can increase) because a part of the display light K directed to the adjacent partial viewing region E is directed. The number and arrangement of these partial viewing areas may change depending on the eye position 700 of the observer. That is, even when the eye position 700 moves to the area EC1, the area EC2, or the area EC3 which is the area where crosstalk can occur (or the area where the influence of crosstalk can increase), the partial view according to the eye position 700 By arranging the area E, it is possible to make it difficult for crosstalk to be visually recognized.

The eye position state determination module 508 includes an image captured from the eye position detection unit 409, face coordinates acquired from the eye position detection unit 409, eye position 700 coordinates acquired from the eye position detection unit 409, and the driver's seat of the vehicle 1. The area where the observer's eye position 700 can cause crosstalk (or the effect of crosstalk increases) from the position of the observer, the position of the observer's face, the height of the sitting height, or the observation position of the eyes of multiple observers. Includes various software components to perform various actions related to determining whether the eye position is in a specific state, such as entering, approaching, or expected to enter. .. That is, the eye position state determination module 508 is a region where crosstalk can occur (or a region where the influence of crosstalk can increase) for determining whether or not the region is a region where crosstalk can occur from the eye position 700 (or a region where the influence of crosstalk can increase). Or coordinate data of the area where the influence of crosstalk can increase), table data which can determine whether or not the area can cause crosstalk from the eye position 700 (or the area where the influence of crosstalk can increase), calculation. It can include expressions and the like. It should be noted that the coordinate data of the region where crosstalk can occur (or the region where the influence of crosstalk can increase) and whether or not the region is a region where crosstalk can occur (or the region where the influence of crosstalk can increase) from the eye position 700. The table data, calculation formula, etc. that can determine whether or not the data is calibrated based on the test results obtained by displaying the test while the HUD device 20 is attached to the own vehicle 1 and measuring the test display. It may be written in the memory 37.

The display parameter setting module 510 has a plurality of predetermined eye positions 700 detected by the eye position detection module 502, eye positions 700 estimated by the eye position estimation module 504, or eye positions 700 predicted by the eye position prediction module 506. It is determined where in the coordinate range of the eye position 700, and the display parameter corresponding to the eye position 700 is set. The display parameter setting module 510 determines where in a plurality of spatial regions the X-axis coordinate, the Y-axis coordinate, the Z-axis coordinate, or a combination thereof indicated by the eye position 700 belongs, and the space to which the eye position 700 belongs. Includes various software components for performing various operations related to setting display parameters corresponding to a specific area. That is, the eye position estimation module 504 may include table data, an arithmetic expression, and the like for specifying display parameters from the X-axis coordinates, Y-axis coordinates, Z-axis coordinates, or a combination thereof indicated by the eye position 700.

The types of display parameters are as follows: (1) Arrangement of images (display 40 for controlling the arrangement of images) so as to have a predetermined positional relationship with a real object located outside the vehicle 1 when viewed from the eye position 700. Parameters to control and / or parameters to control the actuator.), (2) Parameters for pre-distorting the image in order to reduce the distortion of the image that may occur due to the imaginary optical system 90 seen from the eye position 700, etc. (2) It is a parameter that controls the display 40 to distort the image displayed on the display 40 in advance, and is also called a warping parameter.), (3) The light of the image is directed to the eye position 700, and the eye position 700 is directed. Parameters for directional display (parameters for controlling the display 40, parameters for controlling the light source of the display 40, parameters for controlling the light source of the display 40, and controls for actuators) for directional display in which the light of the image is not directed (or weakened) to display parameters other than Parameters to be used, or parameters including a combination thereof), (4) Parameters for visually recognizing a desired stereoscopic image when viewed from the eye position (parameters for controlling the display 40, controlling the light source of the display 40). Includes parameters, parameters that control actuators, or parameters that include combinations thereof.). However, the display parameters set (selected) by the display parameter setting module 510 may be any parameters that are preferably changed according to the eye position 700 of the observer, and the types of display parameters are not limited thereto.

The display parameter setting module 510 selects one or a plurality of display parameters corresponding to the eye position 700 for one type of display parameter. When the eye position 700 includes, for example, the right eye position 700R and the left eye position 700L, the display parameter setting module 510 has two display parameters, that is, the display parameter corresponding to the right eye position 700R and the display parameter corresponding to the left eye position 700L. You can choose one. On the other hand, the eye position 700 is, for example, one of the predetermined positions of the right eye position 700R and the left eye position 700L, and one of the right eye position 700R and the left eye position 700L that can be detected (easily detected), or. When there is one position calculated from the right eye position 700R and the left eye position 700L (for example, the midpoint between the right eye position 700R and the left eye position 700L), the display parameter setting module 510 has one display corresponding to the eye position 700. Parameters can be selected. The display parameter setting module 510 can also select display parameters corresponding to the eye position 700 and display parameters set around the eye position 700. That is, the display parameter setting module 510 may select three or more display parameters corresponding to the eye position 700.

When the display parameter setting module 510 of the present embodiment is determined by the eye position state determination module 508 that it is not in a specific state, the display parameter of the glow image is set in the first display mode, and it is determined that the display parameter setting module 510 is in a specific state. If so, the display parameter of the glow image is set to the second display mode (S150).

The display parameter setting module 510 of some embodiments may change the size while maintaining the saturation of the glow image G based on the determination result in S130. When it is determined in S130 that the display parameter setting module 510 is not in a specific state, the display parameter setting module 510 reduces the saturation while maintaining the size of the glow image G as compared with the second display mode (first display). An example of the embodiment. When it is determined in S130 that the specific state is determined in FIG. 7A, the saturation is increased while maintaining the size of the glow image G as compared with the first display embodiment. (An example of the second display mode. See the figure below in FIG. 7A).

Further, the display parameter setting module 510 of some embodiments may change the size while maintaining the saturation of the glow image G based on the determination result in S130. When it is determined in S130 that the display parameter setting module 510 is not in a specific state, the display parameter setting module 510 is reduced in size while maintaining the saturation of the glow image G as compared with the second display mode (first display mode). An example. When it is determined in S130 that the specific state is determined in FIG. 7B (see the upper figure in FIG. 7B), the size is increased while maintaining the saturation of the glow image G as compared with the first display mode (No. 1). An example of the display mode of 2. FIG. 7B, see the figure below).

Further, the display parameter setting module 510 of some embodiments may change both the saturation and the size of the glow image G based on the determination result in S130. When it is determined in S130 that the display parameter setting module 510 is not in a specific state, the display parameter setting module 510 reduces the size of the glow image G while reducing the saturation as compared with the second display mode (first display mode). An example. Refer to the upper figure of FIG. 7A and the upper figure of FIG. 7B.) When the specific state is determined in S130, the saturation of the glow image G is increased as compared with the first display mode, while increasing the saturation. Increase the size (an example of the second display mode. See the upper figure of FIG. 7A and the lower figure of FIG. 7B).

Further, the display parameter setting module 510 of some embodiments may switch the display / non-display of the glow image G based on the determination result in S130. The display parameter setting module 510 hides the glow image G when it is determined in S130 that it is not in a specific state (an example of the first display mode), and when it is determined in S130 that it is in a specific state, the glow image G is glowed. Image G is displayed (an example of the second display mode).

In some embodiments, the eye position state determination module 508 may include, at least, that a signal indicating that the behavior (vibration) of the vehicle 1 is small is detected as a condition for determining the specific state. .. For example, the display parameter setting module 510 may not determine the specific state when the behavior (vibration) of the vehicle 1 is large.

See FIG. 8 again. The graphic module 512 includes various known software components for performing image processing such as rendering to generate image data and driving the display 40. The graphic module 512 also provides a type, arrangement (positional coordinates, angle), size, display distance (in the case of 3D), visual effect (eg, brightness, transparency, saturation, contrast, or) of the displayed image. Other visual characteristics), may include various known software components for modification. The graphic module 512 determines the type of image (one of the examples of display parameters), the position coordinates of the image (one of the examples of display parameters), the angle of the image (the pitching angle about the X direction, and the Y direction). The yaw rate angle as an axis, the rolling angle as an axis in the Z direction, etc., which are one of the examples of display parameters), the size of the image (one of the examples of display parameters), and the color of the image (hue, saturation). , One of the examples of display parameters set by brightness and the like.), Image data can be generated so as to be visually recognized by the observer, and the optical modulation element 51 can be driven.

The light source drive module 514 includes various known software components for performing driving of the light source unit 24. The light source drive module 514 can drive the light source unit 24 based on the set display parameters.

The actuator drive module 516 includes various known software components for performing driving the first actuator 28 and / or the second actuator 29. The actuator drive module 516 is based on set display parameters. 1 Actuator 28 and 2nd actuator 29 may be driven.

The operation of the above-mentioned processing process can be carried out by executing one or more functional modules of an information processing apparatus such as a general-purpose processor or a chip for a specific application. All of these modules, combinations of these modules, and / or combinations with known hardware capable of substituting their functions are within the scope of the protection of the present invention.

The functional blocks of the vehicle display system 10 are optionally performed by hardware, software, or a combination of hardware and software to implement the principles of the various embodiments described. The functional blocks described in FIG. 3 may be optionally combined or one functional block separated into two or more subblocks in order to implement the principles of the embodiments described. It will be understood by those skilled in the art. Accordingly, the description herein optionally supports any possible combination or division of functional blocks described herein.

1: Own vehicle 2: Projected part 5: Dashboard 6: Road surface 10: Vehicle display system 20: HUD device (head-up display device)
21: Light emission window 22: Housing 24: Light source unit 30: Display control device 31: I / O interface 33: Processor 35: Image processing circuit 37: Memory 40: Display (stereoscopic display device)
50: Display 51: Light modulation element 52: Optical layer 60: Light source unit 80: Relay optical system 90: Virtual image optical system 200: Eyebox 205: Center 700: Eye position 700L: Left eye 700L: Left eye position 700R: Right eye position D10 : Imaging distance D30: Perceived distance D31: First perceived distance D32: Second perceived distance E: Partial visual range E10: Partial visual range E20: Partial visual range E30: Partial visual range E40: Partial visual range EC1: First Area 1 (cross talk area)
EC2: Second region EC3: Third region FU: Perceptual virtual image FU: Content image (perceptual virtual image)
FU1: First content image FU2: Second content image G: Glow image G1: First glow image G2: Second glow image GA: Low visibility unit K: Display light K10: Left eye display light K20: Display light for right eye V10: Left viewpoint image V11: First left viewpoint content V12: Second left viewpoint content V16: First left viewpoint glow image V17: Second left viewpoint glow image V20: Right viewpoint image V21: First right viewpoint content V22: Second right viewpoint content V26: First right viewpoint glow image V27: Second right viewpoint glow image VS: Virtual image display area θc: Congestion angle θc1: First convergence angle θc2: Second convergence angle

Claims (12)

A display control device (30) that executes display control in a head-up display device that allows an observer to visually recognize a virtual image of the image by projecting an image onto a projected member.
With one or more processors (33),
Memory (37) and
It comprises one or more computer programs stored in the memory (37) and configured to be executed by the one or more processors (33).
The processor (33)
A 3D display process of displaying a content image (FU) with a depth expression by visually recognizing a left viewpoint image (V10) and a right viewpoint image (V20) having parallax to the left and right eyes of the observer.
A glow display process for displaying one or more glow images (G) that are displayed in the left-right direction of the content image (FU) and do not have a clear outline is executed.
Display control device (30). The processor (33)
The color of the glow image (G) is set to be similar in color to the color of the content image (FU) and the saturation is set low.
The display control device (30) according to claim 1. The 3D display process is
A process of displaying a first content image (FU1) having a first length (αf1) in the lateral direction and being visually recognized at a position separated by a first distance (D31) from the observer, and
It has a second length (αf2) shorter than the first length (αf1) in the lateral direction, and is visually recognized at a position separated by a second distance (32) longer than the first distance (D31). The second content image (FU2) and the process of displaying the second content image (FU2) are included.
The glow display process is
A process of displaying a first glow image (G1) having a third length (αg1) between the left end and the right end and displayed in the left-right direction of the first content image (FU1).
A process of displaying a second glow image (G2) having a fourth length (αg2) between the left end and the right end and displayed in the left-right direction of the second content image (FU2), and
The ratio of the fourth length αg2 to the second length (αf2) is larger than the ratio of the third length (αg1) to the first length (αf1) (αg2 / αf2>. αg1 / αf1) includes a process of setting the length between the left end and the right end of the glow image (G).
The display control device (30) according to claim 1. The processor (33)
The glow image (G) is displayed as one image surrounding one connected content image (FU).
The display control device (30) according to claim 1. The processor (33)
The glow image (G) is displayed so as to include a low-visibility portion GA in which a region of a non-regular content image visually recognized by crosstalk is cut out or desaturated.
The display control device (30) according to claim 1. Information indicating the position of the observer's eyes or head, or information capable of estimating the position of the eyes or head is acquired, and a process of determining whether or not the eyes or head is in a specific state, and ,
When it was determined that the position of the eyes or the head was not in the specific state, the glow image (G) was displayed in the first display mode, and it was determined that the position of the eyes or the head was in the specific state. In this case, the display switching process of displaying the glow image (G) in the second display mode is further executed.
The first display mode is to reduce the size, reduce the saturation, reduce the size while reducing the saturation, or hide the color as compared with the second display mode. including,
The display control device (30) according to claim 1. The memory (37) stores an area where crosstalk occurs or an area where the influence of crosstalk is larger than a predetermined value as a crosstalk area (EC).
The particular condition is when the position of the eye or head is detected within the crosstalk region (EC) and / or when the position of the eye or head is within the crosstalk region (EC). Including what is expected
The display control device (30) according to claim 6. The determination process predicts that the position of the eye or head falls within the crosstalk region (EC) when the moving speed of the eye or head is equal to or higher than a predetermined value.
The display control device (30) according to claim 7. The glow display process is
The glow image (G) is added to the left viewpoint image (V10) and the right viewpoint image (V20) in the left-right direction, respectively.
The display control device (30) according to claim 1. The determination process includes a process of determining whether the observer's left eye and / or right eye is in the specific state.
The display switching process is
When it is determined that only the left eye is in the specific state, the glow image added in the left-right direction of the left viewpoint image (V10) is set in the second display mode, and the right viewpoint image (V20) is used. Setting the glow image to be added in the left-right direction in the first display mode,
When it is determined that only the right eye is in the specific state, the glow image added in the left-right direction of the left viewpoint image (V10) is set in the first display mode, and the right viewpoint image (V20) is used. Including setting the glow image to be added in the left-right direction in the second display mode.
The display control device (30) according to claim 7. The display control device (30) according to any one of claims 1 to 10.
A light modulation element (50) that emits display light and
A head-up display device (20) including a relay optical system (80) that directs the display light from the light modulation element (50) to a projected portion. It is an image display control method.
A 3D display process of displaying a content image (FU) with a depth expression by visually recognizing a left viewpoint image (V10) and a right viewpoint image (V20) having parallax to the left and right eyes of the observer.
A glow display process for displaying one or more glow images (G) that are displayed in the left-right direction of the content image (FU) and do not have a clear outline is executed.
Display control method.

Images