JP2022085399A - Display controller, headup display device, and method for display control - Google Patents

Abstract

To make it more difficult for an observer to visually confirm an image with a low display quality while increasing the light usage efficiency.SOLUTION: A light source element 60 has a plurality of partial regions D, and selectively emits an illumination light from each partial region D. A light modulation element 51 modulates the illumination light that has entered from the light source element 60 and emits the illumination light as a display light. A light collection optical system collects each of the display lights formed by modulating the illumination lights emitted from the different partial regions D by the light modulation element 51, into different regions in an eye box. When the positions of the eyes of an observer in the lateral direction are in a first position Z1, the partial regions are set in a first light emission region DM1. When the positions of the eyes are in a second position Z2, which is closer to a projection target part than the first position Z1 is, the partial regions are set in a second light emission region DM2 wider than the first light emission region DM1.SELECTED DRAWING: Figure 9

Description

The present disclosure relates to a display control device of a head-up display device used in a vehicle and superimposing an image on the foreground of the vehicle to visually recognize the image, a head-up display device, a display control method, and the like.

Patent Document 1 displays the eye positions of occupants (observers) of various physiques seated in the driver's seat of a vehicle toward the entire area called an eyebox, which includes most or all of the optics. A head-up display device that is optically designed to distribute light is described. According to this, the occupant (observer) visually recognizes the image (virtual image) displayed by the head-up display device in a desired display mode (for example, within a desired luminance range) if the eye position is in the eye box. be able to.

Japanese Unexamined Patent Publication No. 2012-203176

Since the head-up display device of Patent Document 1 directs the display light to the entire eye box, the display light directed to another area of the eye box in which the observer's eyes do not exist is wasted. In other words, there is a problem that the utilization efficiency of the display light emitted by the head-up display device (here, the utilization efficiency is the ratio of the display light visually recognized by the observer to the emitted display light) becomes low. was there. From another point of view, there is also the problem of high power consumption.

A summary of the particular embodiments disclosed herein is presented below. It should be understood that these embodiments are presented solely to provide the reader with an overview of these particular embodiments and do not limit the scope of this disclosure. In fact, the present disclosure may include various aspects not described below.

The outline of the present disclosure relates to improving the efficiency of light utilization. The outline of the present disclosure also relates to making it difficult for an observer to visually recognize an image having a low display quality while improving the light utilization efficiency.

Therefore, the display control device, the head-up display device, and the display control method described in the present specification employ the following means in order to solve the above-mentioned problems. The gist of the present embodiment is to change the size of the area that emits illumination light having a predetermined light intensity or higher in the planar illumination unit that illuminates the light modulation element according to the eye position of the observer. ..

The display control device according to the first aspect described in the present specification has a light source element having a plurality of partial regions and capable of selectively emitting illumination light for each partial region, and a light source element incident from the light source element. Condensing optics that focuses the illumination light emitted from different partial regions into different regions in the eyebox for each display light modulated by the photomodulator. It is equipped with a system and a processor that controls a light source element in a display control device that controls a head-up display device that allows an observer to visually recognize a virtual image from within the range of the eyebox by projecting display light onto a projected portion. The processor acquires information about the observer's anterior-posterior eye position facing the projected portion from the eyebox, or information capable of estimating the observer's anteroposterior eye position, and the observer's anteroposterior eye position is the first. When it is at the position 1, the partial region (hereinafter, also referred to as a light emitting region) that emits illumination light having a predetermined light intensity or higher is set as the first light emitting region, and the eye position is from the first position. When the light emitting region is located at the second position close to the projected portion, the light emitting area changing process including setting the light emitting region to the second light emitting region wider than the first light emitting region is executed.

According to the display control device in the first aspect, when the eye position is close to the projected portion, the light emitting region in the light source element is widened. In other words, the display control device in the first aspect is a light source when the eye position in the front-rear direction of the own vehicle on which the head-up display device is mounted is arranged relatively forward, as compared with the case where the eye position is arranged rearward. Widen the light emitting area in the element. According to this, when the eye position is close to the projected portion, by widening the light emitting area in the light source element, it is possible to suppress a decrease in the brightness of the virtual image visually recognized near the outer edge of the virtual image display area, and to obtain a virtual image that is easy to see. Can be displayed. Further, when the eye position is far from the projected portion, the display light directed to other than the eye position can be reduced (the light utilization efficiency can be improved) by narrowing the light emitting region in the light source element.

FIG. 1 is a diagram showing an example of application of a vehicle display system to a vehicle according to some embodiments. FIG. 2 is a diagram showing a configuration of a head-up display device according to some embodiments. FIG. 3 is a diagram illustrating an optical path in a head-up display device according to some embodiments. FIG. 4A shows an aspect of a partial visual field that virtually divides the inside of the eye box and a mode in which the display light is directed to a plurality of partial visual areas according to the eye position of the observer, according to some embodiments. It is a figure explaining. FIG. 4B outlines the relationship between the partial viewing area of the eyebox and the position where the display light based on the illumination light emitted from each partial area of the directional light source unit is collected, according to some embodiments. It is a figure which shows. FIG. 4C is a diagram showing how a laser beam for illumination is irradiated to the light emitting region of the light diffusion optical system in order to direct the display light to the spot lighting pattern of FIG. 4A. FIG. 5A is a diagram showing an example of the distribution of the amount of light (luminance) when the display light is distributed to the spot lighting pattern according to some embodiments. FIG. 5B is a diagram showing how the eye positions have moved after the state of FIG. 5A. FIG. 5C is a diagram showing how the spotlighting pattern is switched from the one corresponding to the old partial viewing area to the one corresponding to the new partial viewing area E after the state of FIG. 5B. FIG. 6 is a block diagram of a vehicle display system according to some embodiments. FIG. 7A is a flow chart showing a method of performing an operation of setting a spot lighting pattern (position where display light is distributed) based on the eye position of the observer according to some embodiments. FIG. 7B is a flow chart showing a method following FIG. 7A. FIG. 7C is a flow chart showing a method following FIG. 7B. FIG. 8A shows an aspect of a partial visual field that virtually divides the inside of the eye box and a mode in which the display light is directed to a plurality of partial visual areas according to the eye position of the observer, according to some embodiments. It is a figure explaining. FIG. 8B outlines the relationship between the partial viewing area of the eyebox and the position where the display light based on the illumination light emitted from each partial area of the directional light source unit is focused, according to some embodiments. It is a figure which shows. FIG. 9 is a diagram illustrating an optical path in a head-up display device according to some embodiments. FIG. 10 is a diagram showing one aspect of the first light emitting region and the second light emitting region DM2 in the planar illumination unit. FIG. 11 is a diagram illustrating an optical path in a head-up display device according to some embodiments. FIG. 12 is a diagram showing one aspect of the light source array shown in FIG. FIG. 13A is a diagram showing one aspect of the light emission pattern of the light source array. FIG. 13B is a diagram showing one aspect of the light emission pattern of the light source array. FIG. 14A shows a modification of the relationship between the partial viewing area of the eyebox and the position where the display light based on the illumination light emitted from each partial area of the directional light source unit is collected, according to some embodiments. It is a figure which shows an example. FIG. 14B shows a modification of the relationship between the partial viewing area of the eyebox and the position where the display light based on the illumination light emitted from each partial area of the directional light source unit is collected, according to some embodiments. It is a figure which shows an example. FIG. 14C shows a modification of the relationship between the partial viewing area of the eyebox and the position where the display light based on the illumination light emitted from each partial area of the directional light source unit is collected, according to some embodiments. It is a figure which shows an example. FIG. 14D shows a modification of the relationship between the partial viewing area of the eyebox and the position where the display light based on the illumination light emitted from each partial area of the directional light source unit is collected, according to some embodiments. It is a figure which shows an example.

Hereinafter, FIGS. 1 to 14D provide an exemplary vehicle display system, head-up display device, configuration of display control device, and description of operation. The present invention is not limited to the following embodiments (including the contents of the drawings). Of course, changes (including deletion of components) can be made to the following embodiments. Further, in the following description, in order to facilitate understanding of the present invention, description of known technical matters will be omitted as appropriate.

The vehicle display system 10 of FIG. 1 is mounted on the vehicle 1, has a head-up display device (hereinafter, also referred to as a HUD device) 20, a display control device 30 that controls the HUD device 20, and a non-normal reflection described later. It includes an element 3 (optional) and is composed of a projected portion 2 that receives display light K from the HUD device 20. The HUD device 20 is a vehicle front windshield arranged in front of an observer (typically, a driver seated in the driver's seat of the vehicle) (the front is forward, which can also be referred to as the traveling direction of the vehicle). The display light K is projected toward (an example of the projected unit 2).

The non-specular reflection element 3 can be composed of, for example, a holographic element or a diffractive optical element (DOE). The holographic element is made of, for example, a hologram material such as a photopolymer or gelatin dichromate, and is an optical member that diffracts incident light in a desired direction, and records an interference pattern between object light and reference light. It is created by. The non-specular reflection element 3 is, for example, in the shape of a sheet, is included in the projected portion 2, and diffracts the display light K projected by the HUD device 20 into the eye box 200, which is a predetermined region inside the vehicle 1. For example, the non-specular reflection element 3 described later can increase the size of the image (virtual image) visually recognized by the observer by diffracting the display light K received from the HUD device 20. By arranging the eyes 700 in the eye box 200, the observer can visually recognize the virtual image V of the display image (not shown) displayed by the HUD device 20 on the side farther from the projected portion 2. As described above, the non-specular reflection element 3 may be omitted. That is, the vehicle display system 10 does not visually recognize the non-specular reflected light in the projected portion 2 (non-specular reflecting element 3), but is positive in the projected portion 2 (not including the non-specular reflecting element 3). The reflected light may be visually recognized.

The "eye box" used in the description of the present embodiment is a region (1) in which the entire virtual image V of the image can be visually recognized in the region, and at least a part of the virtual image V in the image is not visible outside the region, and (2) in the region. In, at least a part of the virtual image V of the image can be visually recognized, and a part of the virtual image V of the image cannot be visually recognized outside the region. Outside the region, the entire virtual image V of the image is less than the predetermined brightness, or (4) when the HUD device 20 can display the virtual image V that can be viewed stereoscopically, at least a part of the virtual image V can be viewed stereoscopically. Outside the region, even a part of the virtual image V is not stereoscopically viewed. That is, when the observer places the eyes (both eyes) outside the eye box 200, the observer cannot see the entire virtual image V of the image, the visibility of the entire virtual image V of the image is very low, or it is difficult to perceive. The virtual image V of the image cannot be viewed stereoscopically. The predetermined luminance is, for example, about 1/50 of the luminance of the virtual image of the image visually recognized at the center of the eye box. The "eye box" is the same as the area (also referred to as eye lip) where the observer's viewpoint position is expected to be arranged in the vehicle on which the HUD device 20 is mounted, or most of the eye lip (for example, 80% or more). Is set to include.

The virtual image display region VS is a region of a plane, a curved surface, or a partially curved surface in which an image generated inside the HUD device 20 forms an image as a virtual image V, and is also called an image plane. The virtual image display area VS is a position where the display surface (for example, the emission surface of the liquid crystal optical modulation element) 52 of the display 50 described later of the HUD device 20 is imaged as a virtual image, that is, the virtual image display area VS is the HUD. Corresponding to the display surface 52 described later of the apparatus 20 (in other words, the virtual image display area VS has a conjugate relationship with the display surface 52 of the display device 50 described later), and the virtual image visually recognized in the virtual image display area VS. Can be said to correspond to the image displayed on the display surface 52 described later of the HUD device 20. It is preferable that the virtual image display area VS itself has low visibility to the extent that it is not actually visible to the observer's eyes or is difficult to see.

In the imaginary image display area VS, the angle (tilt angle θt in FIG. 1) formed by the horizontal direction (XZ plane) with respect to the left-right direction (X-axis direction) of the vehicle 1 and the center 205 of the eyebox 200 and the imaginary image display are displayed. The angle formed by the line segment connecting the upper end VS1 of the area VS and the line segment connecting the center of the eyebox and the lower end VS2 of the imaginary image display area VS is defined as the vertical angle of the imaginary image display area VS, and is the second grade of this vertical angle. The angle (vertical arrangement angle θv in FIG. 1) formed by the branch line and the horizontal direction (XZ plane) is set. The vertical arrangement angle θv is typically set downward from the horizontal direction (XZ plane), and is, for example, +2 [degree] (here, the positive direction of the vertical arrangement angle θv is two of the vertical image angles. The equidistant line is the depression angle downward from the center 205 of the eyebox 200, and the negative direction of the vertical arrangement angle θv is the elevation angle at which the bisector of the vertical angle is upward from the center 205 of the eyebox 200. It can also be said that.).

Further, the virtual image display region VS of the present embodiment has a tilt angle θt of approximately 90 [degree] so as to substantially face the front (Z-axis positive direction). However, the tilt angle θt is not limited to this, and can be changed within the range of 40 ≦ θt <90 [degree]. In this case, for example, the tilt angle θt may be set to 60 [degree], and the virtual image display area VS may be arranged so that the upper area is farther than the lower area when viewed from the observer.

FIG. 2 is a diagram showing a configuration of the HUD device 20 of the present embodiment. The HUD device 20 houses a display 50 having a display surface 52 for displaying an image, a relay optical system (condensing optical system) 40, and these display 50 and the relay optical system 40, and displays from the display 50. It has a housing 22 having a light emitting window 21 capable of emitting light K from the inside to the outside. Although the display 50 of the present embodiment described later is a 2D display, it may be a 3D display. That is, the HUD device 20 displays the parallax image corresponding to the eye points (left and right eyes) arranged in the eye box 200, so that the observer perceives the virtual image of the stereoscopic image based on the virtual image display area VS. (Note that the 3D display may not be a binocular parallax type 3D display). Further, a part of the relay optical system 40 may be omitted.

The display 50 of FIG. 2 is composed of a light modulation element 51 and a directional light source unit 60. The display surface 52 is the surface of the light modulation element 51 on the observer side, and emits the display light K of the image. A virtual image is set by setting the angle of the display surface 52 with respect to the optical axis Kp of the display light K from the center of the display surface 52 toward the eye box 200 (center 205 of the eye box 200) via the relay optical system 40 and the projected portion 2. The angle of the display area VS (including the tilt angle θt) can be set. Further, the directional light source unit 60, which will be described later, can change the position where the virtual image V can be visually recognized (easily visible) in the eye box 200 by changing the direction of the illumination light.

The relay optical system 40 is arranged on the optical path of the display light K (light toward the eyebox 200 from the display 50) emitted from the display 50, and the display light K from the display 50 is directed to the outside of the HUD device 20. It is composed of one or more optical members projected onto the front windshield 2 of the above. The relay optical system 40 of FIG. 2 includes one concave first mirror 41 and one flat second mirror 42.

The first mirror 41 is, for example, a free curved surface shape having positive optical power. In other words, the first mirror 41 may have a curved surface shape in which the optical power differs for each region, that is, the optical power added to the display light K according to the region (optical path) through which the display light K passes. It may be different. Specifically, the first display light K1, the second display light K2, and the third display light K3 (see FIG. 2) heading from each region of the display surface 52 toward the eye box 200 are added by the relay optical system 40. The optical power may be different.

The second mirror 42 is, for example, a planar mirror, but is not limited to this, and may be a curved surface having optical power. That is, the relay optical system 40 is added according to the region (optical path) through which the display light K passes by synthesizing a plurality of mirrors (for example, the first mirror 41 and the second mirror 42 of the present embodiment). The optical power may be different. The second mirror 42 may be omitted. That is, the display light K emitted from the display 50 may be reflected by the first mirror 41 on the projected portion (front windshield) 2.

Further, in the present embodiment, the relay optical system 40 includes, but is not limited to, two mirrors, and in addition or as an alternative to these, one or more dioptric optics such as a lens. A member, a diffractive optical member such as a hologram, a reflected optical member, or a combination thereof may be included.

Further, the relay optical system 40 of the present embodiment has a function of setting the distance to the virtual image display area VS by the curved surface shape (an example of optical power), and the virtual image displayed on the display surface 52 is enlarged. However, in addition to this, it may have a function of suppressing (correcting) the distortion of the virtual image that may occur due to the curved shape of the front windshield 2.

Further, the relay optical system 40 may be rotatable (and / or moved) by attaching a single or a plurality of actuators (not shown) controlled by the display control device 30.

The light modulation element 51 is, for example, an LCD which is a transmissive display panel, and the illumination light is incident from the directional light source unit 60, and the spatial light-modulated display light K is directed to the relay optical system 40 (second mirror 42). And emit. The optical modulation element 51 has, for example, a short side in the direction in which the pixels corresponding to the vertical direction (Y-axis direction) of the imaginary image V seen from the observer are arranged, and the imaginary image V seen from the observer orthogonal to this has a short side. It has a rectangular shape (typically) in which the direction in which the pixels corresponding to the left-right direction (X-axis direction) are arranged is the long side. The observer visually recognizes the transmitted light of the light modulation element 51 (reflected light, diffracted light, etc. may be considered depending on the type of the light modulation element 51) via the imaginary optical system 90. The virtual image optical system 90 is a combination of the relay optical system 40 shown in FIG. 2 and the front windshield 2 (non-specular reflection element 3 included therein). The light modulation element 51 (display 50) may be a reflection type display panel using LCos or DMD.

(First Embodiment)
See FIG. FIG. 3 is a diagram showing an example of a main configuration of the HUD device 20 (directional light source unit 60 of the first embodiment) having a function of performing viewpoint tracking spot lighting control. In the HUD device 20 (directional light source unit 60) shown in FIG. 3, the number of eye boxes 200 is five in the left-right direction (X-axis direction) when the observer (vehicle driver) faces the front of the vehicle. N partial viewing areas E (E (1,1) to E (5,5 in FIG. 4A) divided into 5 pieces in the vertical direction (Y-axis direction)) (25 pieces in this embodiment). )) Is divided into. In the HUD device 20 (directional light source unit 60), the light emission pattern is different for each partial viewing area E where the eye position of the driver (user) is detected, and the eye position of the driver (user) is detected. The viewpoint-following spot lighting control that locally directs the display light K toward the partial viewing area E is performed.

The display control device 30 described later detects the eye position of the observer from the eye position detecting unit 411 described later, and directs the bright image (virtual image V) to be visually recognized only in the eye position of the observer and its periphery. Controls the sex light source unit 60. These will be described in detail later.

The directional light source unit (light source element) 60 of the first embodiment includes a light source 70, a scanning device (scanner) 75, a first field lens (illumination optical system) 76, and a second field lens (illumination optical system) 77. , And a light diffusion optical system 80. The scanning device 75 transmits the laser light emitted from the light source 70 into m (m> n) partial regions D of the light diffusion optical system 80 (the partial regions D of the present embodiment are D (1,11) to D (1,11) to D. It is possible to scan on (121 pieces up to (11, 11)), and the display control device 30 has a partial region D (light emitting region) corresponding to the partial visual region E in which the eye position detected by the eye position detection unit 411 exists. By controlling the light source 70 so as to irradiate the DM) with a strong laser beam, the observer can visually recognize the image (imaginary image V). The light emitting region DM is a partial region D of the partial region D that emits illumination light having a predetermined light intensity toward the light modulation element 51.

The light source 70 is, for example, a plurality of laser diodes capable of emitting three different colors (for example, R, G, B), and a plurality of laser beams are mixed (for example, white) with a dichroic mirror or the like to form one illumination. Directed at the scanning device 75 as a laser beam 74 for use. The light source 70 can adjust the intensity of the illuminating laser beam 74 (including turning off) under the control of the display control device 30 described later.

The scanning device (scanner) 75 is an element that two-dimensionally deflects the laser beam 74 for illumination emitted from the light source 70, and uses, for example, a polygon biller, a galvano mirror, a MEMS (Micro Electro Mechanical System), and a technique. It is an optical scanning device such as a MEMS mirror device). The scanning device 75 is a minute mirror configured to swing using two axes orthogonal to each other. The scanning device 75 scans at high speed in the main scanning direction and at low speed in the sub-scanning direction orthogonal to the main scanning direction, for example.

The first field lens 76 is arranged on the optical path of the illuminating laser beam 74 scanned by the scanning device 75 between the scanning device 75 and the light diffusing optical system 80. The first field lens 76 has a function of parallelizing the received illumination laser beam 74 in a direction parallel to the optical axis of the first field lens 76. Since the first field lens 76 is not an essential component, it may be omitted. However, by providing the first field lens 76, the display light K modulated by the illumination laser beam 74 emitted from each light emitting region DM of the light diffusing optical system 80 can be seen in each partial viewing area E of the eye box 200. Can be directed to with high accuracy. The first field lens 76 is a refraction optical system, but instead of the first field lens 76, one or a plurality of lenses are on the optical path of the illumination laser beam 74 between the scanning device 75 and the light diffusion optical system 80. Other refraction optics, reflection optics, and diffraction optics may be provided.

The second field lens (condensing optical system) 77 is on the optical path of the illumination laser beam 74 diffused by each partial region D (light emitting region DM) between the light diffusion optical system 80 and the light modulation element 51. As a condensing optical system, the illumination light emitted from different regions (light emitting region DM) is focused toward different regions in the eye box 200 for each display light K modulated by the optical modulation element 51. Function. The second field lens 77 of the present embodiment is composed of one or a plurality of field lenses, and the illumination laser beam 74 diffused by each partial region D (light emitting region DM) of the light diffusion optical system 80 is light-modulated. It is a front-stage optical member (backlight optical member) designed to transmit and illuminate the entire surface of the element 51. Further, in the second field lens 77, the display light K emitted from the light modulation element 51 passes through the virtual image optical system 90 (HUD optical member composed of the relay optical system 40 and the front window shield 2) in the eye box 200. It is designed to reach the partial visibility E at any position in the. The condensing optical system that focuses the display light K emitted from the different partial regions D (light emitting region DM) but modulated by the optical modulation element 51 toward the different partial viewing regions E in the eyebox 200 is a condensing optical system. Instead of (or in addition to) the field lens, various optical systems such as one or more other refraction optics, reflection optics, and diffractive optics may be included. The display light K passes through the relay optical system 40 and the projected unit 2 by the time it reaches the eye box 200 from the light modulation element 51. At this time, the display light K is not a little deflected by the relay optical system 40 and the projected portion 2, and then focused toward different regions in the eye box 200. Therefore, it can be said that the condensing optical system includes the relay optical system 40 and the projected portion 2 in addition to the second field lens (condensing optical system) 77. Further, in the condensing optical system, the second field lens (condensing optical system) 77 is omitted, and the condensing optical system may be composed of the relay optical system 40 and the projected unit 2.

The diffuser plate 78 is arranged on the optical path of the illumination laser beam 74 between the light modulation element 51 and the second field lens 77. The diffuser plate 78 diffuses the received illumination laser beam 74 light and emits it to the light modulation element 51. As a result, it is possible to reduce the luminance unevenness in the display light K generated by the illumination laser beam 74 emitted from the light emitting region DM visually recognized in each partial viewing area E of the eye box 200. The diffuser plate 78 may be any optical member having a function of diffusing light, and for example, its surface is composed of a bead member, a fine uneven structure, and a rough surface. Further, a dot sheet or a transparent milky white sheet may be used.

First, an example in which the lens array 81 is used as the light diffusion optical system 80 will be described. The lens array 81 of the present embodiment is divided into m partial regions D, and a minute lens having a curvature is formed in each partial region D. When the illumination laser beam 74 is incident on each partial region D, the illumination laser beam 74 refracted by the minute lens is emitted as diffused light. More specifically, the illuminating laser beam 74 incident on any of the m partial regions D of the lens array 81 (light diffusing optical system 80) from the light source 70 is refracted by the microlens to the second field. After passing through the lens 77 and the diffuser plate 78, the entire surface of the optical modulation element 51 is irradiated, and after the light-modulated display light K passes through the virtual image optical system 90, at least the partial region D where the eye position 700 exists is formed. A predetermined area of the eye box 200 including the eye box 200 is irradiated.

Next, an example in which the hologram recording medium 82 is used as the light diffusion optical system 80 will be described. The hologram recording medium 82 of the present embodiment is divided into m partial regions D, and interference fringes are formed in each partial region D. When the illumination laser beam 74 is incident on each partial region D, the illumination laser beam 74 diffracted by the interference fringes is emitted as diffused light. More specifically, the illuminating laser beam 74 incident on any of m partial regions D of the hologram recording medium 82 (light diffusion optical system 80) from the light source 70 is diffracted by the interference fringes to form a second. After passing through the field lens 77 and the diffuser plate 78, the entire surface of the optical modulation element 51 is irradiated, and after the light-modulated display light K passes through the virtual image optical system 90, the eye box corresponding to the predetermined partial region D. 200 predetermined areas are irradiated. The light diffusion optical system 80 may be a Fresnel lens.

FIG. 4C is a diagram showing how the scanning device (scanner) 75 scans the light diffusion optical system 80. In FIG. 4C, the first field lens 76 is omitted. In the light diffusion optical system 80, the partial visual range E of the eye box 200 is aligned in the vertical direction with the third direction (α-axis) corresponding to the first direction (X-axis) in which the partial visual range E is arranged in the horizontal direction. It has a fourth direction (β-axis) corresponding to a second direction (Y-axis). The scanning device 75 performs a main scan along a third direction (α-axis) and a sub-scan along a fourth direction (β-axis). In the example of FIG. 4C, the scanning device 75 passes through different partial regions D in the outward and return paths of the main scan, and irradiates the predetermined partial region D with the illumination laser beam 74 under the control of the display control device 30. It has become. Specifically, the scanning device 75 scans from the partial area D (11,1) to the D (1,1) at high speed as the outward path, and the predetermined partial area D (light emitting area DM) selected by the display control device 30. ) Is irradiated with the laser beam 74 for illumination, and the partial region D not selected by the display control device 30 is not irradiated with the laser beam 74 for illumination. A laser beam 74 for illumination is irradiated to a predetermined partial region D (light emitting region DM) selected by the display control device 30 while scanning up to 2). However, the mode in which the scanning device (scanner) 75 scans on the light diffusing optical system 80 is not limited to this.

In another example, the scanning device 75 may be irradiated with the illuminating laser beam 74 only on the outward path (alternatively, only on the return path). Specifically, the scanning device 75 shifts to a predetermined partial region D (light emitting region DM) selected by the display control device 30 while scanning from the partial regions D (11, 1) to D (1, 1). After irradiating the illumination laser beam 74, scanning to the partial regions D (11, 2) without irradiating the illumination laser beam 74, and again as the outward route, the partial regions D (11, 2) to D (2). The laser beam 74 for illumination may be irradiated to a predetermined partial region D (light emitting region DM) selected by the display control device 30 while scanning up to 2).

In another example, the scanning device 75 may irradiate the same partial region D with the illumination laser beam 74 on the outward trip and the return trip. Specifically, the scanning device 75 has the partial region D (11, 1) as the outward trip. After irradiating the predetermined partial region D (light emitting region DM) selected by the display control device 30 with the laser beam 74 for illumination while scanning from to D (1,1), the partial region D (1,1) is again used as a return route. ) To D (11, 1) while irradiating the predetermined partial region D (light emitting region DM) selected by the display control device 30 with the illumination laser beam 74. The position in the partial region D to which the laser beam 74 for illumination is irradiated differs between the outward route and the return route. That is, the illuminating laser beam 74 is irradiated to a position on the upper side (negative direction of β) of the predetermined partial region D on the outward route, and on the lower side (positive direction of β) of the predetermined partial region D on the return route. The position of may be irradiated.

FIG. 4A is a diagram illustrating an aspect of a partial visual field that virtually divides the inside of the eye box and a mode in which the display light is directed to a plurality of partial visual areas corresponding to the eye positions of the observer. Here, it is assumed that the observer's right eye 700R is detected in the partial visual range E (2, 3), and the left eye 700L is detected in the partial visual range E (4, 3). The partial viewing area E (hereinafter, also referred to as a spot lighting pattern SPR for the right eye) to which the display light K for the right eye is directed is the upper partial viewing area E (2, 3) centered on the partial viewing area E (2, 3). 2) Upper part, lower part of lower partial view area E (2,4), right part of right side partial view area E (1,3), left part of left side partial view area E (3,3), The upper left part of the upper left partial view area E (3,2), the lower left part of the lower left partial view area E (3,4), the lower right part of the lower right partial view area E (1,4), and the upper right part. It is a horizontally long elliptical region straddling nine partial visual regions E in the upper right portion of the visual regions E (1, 2). Similarly, the partial view area E (hereinafter, also referred to as a spot lighting pattern SPL for the left eye) to which the display light K for the left eye is directed is the upper partial view centering on the partial view area E (4, 3). Upper part of area E (4,2), lower part of lower partial view area E (4,4), right part of right side partial view area E (3,3), left side partial view area E (5,3) ), The upper left part of the upper left partial view area E (5, 2), the lower left part of the lower left partial view area E (5, 4), and the lower right part of the lower right partial view area E (3, 4). , And a horizontally long elliptical region straddling the nine partial viewing areas E in the upper right part of the upper right partial viewing area E44 (3, 2).

FIG. 4B schematically shows the relationship between the aspect of the partial viewing area E of the eye box 200 and the position where the display light K based on the illumination light emitted from each partial area D of the directional light source unit 60 is focused. It is a figure which shows. In FIG. 4B, the position where the display light K based on the illumination light emitted from each partial region D is focused is drawn by a point (black circle), but the main ray of the display light K is directed. It indicates the position, and the display light K is also irradiated around the point (black circle). In the example of FIG. 4B, the directional light source unit 60 arranges the partial region D so that nine different locations can be irradiated in one partial viewing area E. Specifically, there are a total of nine locations, one at the center of the partial viewing area E, four at the four corners of the partial viewing area E, and four at the midpoint of each of the four corners of the partial viewing area E. In one aspect shown in FIG. 4B, the display control device 30 controls the directional light source unit 60 so that the display light K is irradiated to all nine different points in the partial viewing area E where the eye position 700 exists. The light emitting region DM has a main partial region DA that emits illumination light that is the source of the display light K that is focused on the center of the partial viewing region E where the eye position 700 exists, and an eye position 700 that is larger than the main partial region DA. Includes a sub-partial region DB that emits illumination light that is the source of the display light K that is focused at a position away from the center of the partial viewing area E. That is, when the left eye position 700L exists in the partial viewing area E (4, 3), the main partial area DA is the partial area D (8, 6), and the sub partial area DB is the partial area D (7, 5). ), D (8,5), D (9,5), D (7,6), D (9,6), D (7,7), D (8,7), and D (9,7) ). On the other hand, when the right eye position 700R exists in the partial viewing area E (2, 3), the main partial area DA is the partial area D (4, 6), and the sub partial area DB is the partial area D (3, 5). ), D (4,5), D (5,5), D (3,6), D (5,6), D (3,7), D (4,7), and D (5,7) ).

FIG. 4C is a diagram showing how the illumination laser beam 74 is irradiated to the light emitting region DM of the light diffusion optical system 80 in order to direct the display light K to the spot lighting pattern SP of FIG. 4A. The display control device 30 drives the light source 70 at the timing when the scanning device 75 scans the light emitting region DM that emits the illumination light having a predetermined light intensity among the m partial regions D. As a result, as shown in FIG. 4A, light modulation is performed on the spot lighting pattern SP (spot lighting pattern SPR for the right eye, spot lighting pattern SPL for the left eye) of the above-mentioned eye box 200 corresponding to the light emitting region DM of the light diffusion optical system 80. The display light K of the element 51 is directed. The light emitting area DM corresponding to the above-mentioned right eye spot lighting pattern SPR is referred to as a right eye light emitting area DMR, and the light emitting area DM corresponding to the above left eye spot lighting pattern SPL is referred to as a left eye light emitting area DML. Therefore, the display light K in which the illumination light emitted from the light emitting region DMR for the right eye is modulated by the light modulation element 51 is irradiated to the spot lighting pattern SPR for the right eye, and the illumination light emitted from the light emitting region DML for the left eye is emitted. The display light K modulated by the light modulation element 51 is applied to the spot lighting pattern SPL for the left eye. Further, the display control device 30 does not irradiate the partial region D other than the light emitting region DMR for the right eye and the light emitting region DML for the left eye with the illuminating laser beam 74, or irradiates the illuminating laser beam 74 with a very low light intensity. do. As a result, the display light K can be efficiently irradiated to the visual field E where the observer's eye position exists, and the power consumption can be suppressed to a low level.

FIG. 5A is a diagram showing an example of the distribution of the amount of light (luminance) when the display light K is distributed to the spot lighting pattern SP. When the eye position 700 is estimated to be in the partial viewing area E (2, 3), the display control device 30 has a predetermined spot lighting pattern SP associated with the partial viewing area E (2, 3). In addition, the light source DM of the light diffusion optical system 80 (partial regions D (3,5), D (4,5), D (5,5), D (3,6), D (4,6), D The scanning device 75 scans the light emitting region DM so that the illumination laser beam 74 irradiates (5,6), D (3,7), D (4,7), D (5,7)). The light source 70 is driven according to the timing. As a result, as shown in FIG. 4A, the display light K of the light modulation element 51 is directed to the predetermined spot lighting pattern SP of the eye box 200 corresponding to the light emitting region DM of the light diffusion optical system 80. Reference numeral DB1 (DB) in FIG. 5A indicates a light amount distribution in the left-right direction (X-axis direction) of the eye box 200 (the same applies to FIGS. 5B and 5C described later). The light amount distribution Ld1 has a light emitting region DM (partial regions D (3,5), D (4,5), D (5,5), D (3,6), D (4,6), D (5, 5). 6), the light of the display light based on the illumination light emitted from D (3,7), D (4,7), D (5,7) is combined, and the boundary of the spot lighting pattern SP. Within, a light amount of a predetermined threshold Lth (for example, 50% with respect to the maximum light amount (luminance) in the spotlighting pattern SP) or more is secured. Further, the light amount distribution Ld is spotlighting in the partial viewing area E. The amount of light extends beyond the boundary of the pattern SP and spreads, and the intensity of the light does not decrease sharply but gradually (with a gradient). Therefore, even when the viewpoint moves to the outside of the boundary, the display ( The imaginary image) becomes thin and disappears, and does not disappear suddenly. This suppresses (reduces) the sense of discomfort and anxiety.

In the present embodiment, the sub-partial region DB that emits the illumination light that is the source of the display light K that is focused at a position away from the center of the partial viewing area E (2, 3) is provided. In particular, in the embodiment shown in FIGS. 5A, 5B, and 5C, the sub-subregion DB is arranged so that the display light K is all focused on the boundary of the partial viewing area E (2, 3). Therefore, even when the eyes move to the vicinity (or outside) of the partial viewing area E, the image (virtual image V) having a relatively high brightness by the sub-partial area DB can be visually recognized. FIG. 5B shows the case where the eye position 700 moves from the partial visual range E (2,3) to E (3,3) after the state of FIG. 5A. Spot lighting corresponding to partial visibility E (2, 3) without switching the spot lighting pattern SP at the moment when system latency occurs and the spot lighting pattern SP moves from partial visibility E (2, 3) to E (3, 3). Even in the case of the pattern SP), the light from the sub-partial region DB that emits the illumination light that is the source of the display light K that is focused on the position away from the center of the partial viewing area E (2, 3). The display light K having a relatively high brightness can be visually recognized. In FIG. 5C, after the state of FIG. 5B, the spot lighting pattern SP is switched from the one corresponding to the old partial viewing area E (2, 3) to the one corresponding to the new partial viewing area E (3, 3). It is a figure which shows the state.

Further, in another preferable example, in the spot lighting pattern SP, uniform (including substantially uniform) light irradiation is performed so as to have a predetermined luminance level. Specifically, the arrangement of the light emitting region DM, the adjustment of the emitted light intensity, and / or the whole or partial optical adjustment of the condensing optical system are performed so that the light amount distribution Ld has a top hat shape. .. As a result, in the illuminated partial viewing area E, the brightness of the image (virtual image V) can be visually recognized substantially uniformly even if the eye position moves. However, in the present embodiment, the light amount distribution Ld may be a Gaussian distribution.

In some embodiments, the display control device 30 (processor 33) may increase the emission intensity of the sub-region DB to be greater than 0.7 times the emission intensity of the main partial region DA. According to this, since the emission intensity of the sub-subregion DB is relatively strong, even when the eye position 700 is near the boundary of the partial viewing region E, the light from the sub-subregion DB causes a relatively high brightness display. The light K can be visually recognized.

Further, in some embodiments, the display control device 30 (the processor 33 may make the light emission intensity of the sub-subregion (DB) higher than the light emission intensity of the main partial region (DA). For example, since the emission intensity of the sub-subregion DB is relatively strong, even when the eye position 700 is near the boundary of the partial viewing region E, the light from the sub-subregion DB produces a relatively high-brightness display light K. It can be visually recognized.

FIG. 6 is a block diagram of the vehicle display system 10 according to some embodiments. The display control device 30 includes one or more I / O interfaces 31, one or more processors 33, one or more image processing circuits 35, and one or more memories 37. The various functional blocks shown in FIG. 6 may be composed of hardware, software, or a combination thereof. FIG. 6 is only one embodiment, and the illustrated components may be combined with a smaller number of components or may have additional components. For example, the image processing circuit 35 (eg, graphic processing unit) may be included in one or more processors 33.

As shown, the processor 33 and the image processing circuit 35 are operably connected to the memory 37. More specifically, the processor 33 and the image processing circuit 35 execute a program stored in the memory 37, for example, to control the directional light source unit 60 (the control of the directional light source unit 60 is, for example, the control). , Control of the illumination laser beam 74 (illumination light) emitted by the light source 70, control of the light source array 80A described later, etc.), generation and / or transmission of image data, and the like, display system 10 for vehicles (HUD). The device 20 and the directional light source unit 60) can be operated. The processor 33 and / or the image processing circuit 35 includes at least one general purpose microprocessor (eg, central processing unit (CPU)), at least one application specific integrated circuit (ASIC), and at least one field programmable gate array (FPGA). , Or any combination thereof. The memory 37 includes any type of magnetic medium such as a hard disk, any type of optical medium such as a CD and DVD, any type of semiconductor memory such as a volatile memory, and a non-volatile memory. Volatile memory may include DRAM and SRAM, and non-volatile memory may include ROM and NVRAM.

As shown, the processor 33 is operably linked to the I / O interface 31. The I / O interface 31 communicates with, for example, a vehicle ECU 401 described later or another electronic device (reference numerals 403 to 419 described later) provided in the vehicle according to a standard of CAN (Controller Area Network) (also referred to as CAN communication). Call). The communication standard adopted by the I / O interface 31 is not limited to CAN, and is, for example, CANFD (CAN with Flexible Data Rate), LIN (Local Interconnect Network), Ethernet (registered trademark), MOST (Media Oriented Systems Transport). : MOST is a registered trademark), a wired communication interface such as UART, or USB, or a local such as a personal area network (PAN) such as a Bluetooth® network, or an 802.1x Wi-Fi® network. In-vehicle communication (internal communication) interface, which is a short-range wireless communication interface within several tens of meters such as an area network (LAN), is included. The I / O interface 31 is a wireless wide area network (WWAN0, IEEE 802.16-2004 (WiMAX: Worldwide Interoperability for Microwave Access)), an IEEE 802.16e base (Mobile WiMAX), 4G, 4G-LTE, LTE Advanced, It may include an out-of-vehicle communication (external communication) interface such as a wide area communication network (for example, an Internet communication network) according to a cellular communication standard such as 5G.

As shown in the figure, the processor 33 is interoperably connected to the I / O interface 31 to provide information with various other electronic devices and the like connected to the vehicle display system 10 (I / O interface 31). Can be exchanged. The I / O interface 31 includes, for example, a vehicle ECU 401, a road information database 403, a vehicle position detection unit 405, an external sensor 407, an operation detection unit 409, an eye position detection unit (line-of-sight direction detection unit) 411, an IMU413, and brightness. The sensor 415, the portable information terminal 417, the external communication device 419, and the like are operably connected. The I / O interface 31 may include a function of processing (converting, calculating, and analyzing) information received from other electronic devices connected to the vehicle display system 10.

The light modulation element 51 is, for example, a liquid crystal light modulation element, and is operably connected to the processor 33 and the image processing circuit 35. Therefore, the image displayed by the light modulation element 51 may be based on the image data received from the processor 33 and / or the image processing circuit 35. The processor 33 and the image processing circuit 35 control the image displayed by the light modulation element 51 based on the information acquired from the I / O interface 31.

The vehicle ECU 401 uses sensors and switches provided on the vehicle 1 to indicate the state of the vehicle 1 (for example, mileage, vehicle speed, accelerator pedal opening, brake pedal opening, engine throttle opening, injector fuel injection amount, engine speed). , Motor speed, steering angle, shift position, drive mode, various warning states, posture (including roll angle and / or pitching angle), vehicle vibration (including magnitude, frequency, and / or frequency of vibration) )) And the like, and collect and manage (may include control) the state of the vehicle 1. As a part of the function, the numerical value of the state of the vehicle 1 (for example, the vehicle speed of the vehicle 1). ) Can be output to the processor 33 of the display control device 30. In addition, the vehicle ECU 401 simply transmits the numerical value detected by the sensor or the like (for example, the pitching angle is 3 [brake] in the forward tilting direction) to the processor 33, or instead, the numerical value detected by the sensor is used. A determination result based on one or more states of the vehicle 1 including (for example, the vehicle 1 satisfies a predetermined condition of a forward leaning state) and / and an analysis result (for example, a brake pedal opening degree). Combined with the information, the brake has caused the vehicle to lean forward.) May be transmitted to the processor 33. For example, the vehicle ECU 401 may output a signal indicating a determination result indicating that the vehicle 1 satisfies a predetermined condition stored in advance in a memory (not shown) of the vehicle ECU 401 to the display control device 30. The I / O interface 31 may acquire the above-mentioned information from the sensors and switches provided in the vehicle 1 provided in the vehicle 1 without going through the vehicle ECU 401.

Further, the vehicle ECU 401 may output an instruction signal indicating an image displayed by the vehicle display system 10 to the display control device 30, and at this time, it is necessary to notify the coordinates, size, type, display mode, and image of the image. The degree and / or the necessity-related information that is the source for determining the notification necessity may be added to the instruction signal and transmitted.

The road information database 403 is included in a navigation device (not shown) provided in the vehicle 1 or an external server connected to the vehicle 1 via an external communication interface (I / O interface 31), and the vehicle position detection described later. Based on the position of the vehicle 1 acquired from the unit 405, the road information (lane, white line, stop line, pedestrian crossing,) on which the vehicle 1 travels, which is the information around the vehicle 1 (information related to the actual object around the vehicle 1). Road width, number of lanes, intersections, curves, pedestrian crossings, traffic regulations, etc.), feature information (buildings, bridges, rivers, etc.), presence / absence, position (including distance to vehicle 1), direction, shape, type , Detailed information and the like may be read out and transmitted to the processor 33. Further, the road information database 403 may calculate an appropriate route (navigation information) from the departure point to the destination, and output a signal indicating the navigation information or image data indicating the route to the processor 33.

The own vehicle position detection unit 405 is a GNSS (Global Navigation Satellite System) or the like provided in the vehicle 1, detects the current position and orientation of the vehicle 1, and transmits a signal indicating the detection result via the processor 33. , Or directly output to the road information database 403, the portable information terminal 417 described later, and / or the external communication device 419. The road information database 403, the mobile information terminal 417 described later, and / or the external communication device 419 obtains the position information of the vehicle 1 from the own vehicle position detection unit 405 continuously, intermittently, or at a predetermined event. , Information around the vehicle 1 may be selected and generated and output to the processor 33.

The out-of-vehicle sensor 407 detects real objects existing around the vehicle 1 (front, side, and rear). The actual objects detected by the out-of-vehicle sensor 407 are, for example, obstacles (pedestrians, bicycles, motorcycles, other vehicles, etc.), road surfaces, lane markings, roadside objects, and / or features (buildings, etc.) of the traveling lane described later. Etc. may be included. As the out-of-vehicle sensor, for example, a detection unit composed of a radar sensor such as a millimeter wave radar, an ultrasonic radar, a laser radar, a camera, or a combination thereof, and detection data from the one or a plurality of detection units are processed (. It consists of a processing device (data fusion) and a processing device. Conventional well-known methods are applied to object detection by these radar sensors and camera sensors. By object detection by these sensors, the presence or absence of a real object in the three-dimensional space, and if the real object exists, the position of the real object (relative distance from the vehicle 1 and the traveling direction of the vehicle 1 in the front-rear direction). (Horizontal position, vertical position, etc.), size (horizontal direction (horizontal direction), height direction (vertical direction), etc.), movement direction (horizontal direction (horizontal direction), depth) Direction (front-back direction)), movement speed (horizontal direction (horizontal direction), depth direction (front-back direction)), and / or type may be detected. One or a plurality of out-of-vehicle sensors 407 detect a real object in front of the vehicle 1 in each detection cycle of each sensor, and the real object information (presence / absence of the real object, existence of the real object exists) which is an example of the real object information. In this case, information such as the position, size, and / or type of each real object can be output to the processor 33. It should be noted that these real object information may be transmitted to the processor 33 via another device (for example, vehicle ECU 401). Infrared cameras and near-infrared cameras are desirable when using a camera as a sensor so that a real object can be detected even when the surroundings are dark, such as at night. When using a camera as a sensor, a stereo camera that can acquire a distance or the like by parallax is desirable.

The operation detection unit 409 is, for example, a CID (Center Information Display) of the vehicle 1, a hardware switch provided on an instrument panel, or a software switch that combines an image and a touch sensor, and is a vehicle 1. The operation information based on the operation by the occupant (the user sitting in the driver's seat and / or the user sitting in the passenger seat) is output to the processor 33. For example, the operation detection unit 409 may change the display area setting information based on the operation of moving the virtual image display area VS, the eyebox setting information based on the operation of moving the eyebox 200, and the brightness of the virtual image by the user's operation. The image brightness setting information based on the above, the information based on the operation of setting the observer's eye position 700, and the like are output to the processor 33.

The eye position detection unit 411 may include a camera such as an infrared camera that detects the eye position 700 of the observer sitting in the driver's seat of the vehicle 1, and may output the captured image to the processor 33. The processor 33 acquires an image taken from the eye position detection unit 411 (an example of information that can estimate the eye position 700), and analyzes the captured image by a method such as pattern matching to obtain the eye position of the observer. The coordinates of 700 may be detected, and a signal indicating the detected coordinates of the eye position 700 may be output to the processor 33.

Further, the eye position detection unit 411 is a spatial region corresponding to an analysis result obtained by analyzing an image captured by the camera (for example, the observer's eye position 700 corresponds to a plurality of preset display parameters 600 (described later)). A signal indicating where it belongs to) may be output to the processor 33. The method for acquiring information capable of estimating the eye position 700 of the observer of the vehicle 1 or the eye position 700 of the observer is not limited to these, and a known eye position detection (estimation) technique is used. May be obtained.

Further, the eye position detection unit 411 detects the moving speed and / or moving direction of the observer's eye position 700, and outputs a signal indicating the moving speed and / or moving direction of the observer's eye position 700 to the processor 33. It may be output to.

Further, the eye position detection unit 411 is presumed to have (10) a signal indicating that the observer's eye position 700 is outside the eye box 200, and (20) the observer's eye position 700 is outside the eye box 200. When a signal or (30) a signal whose eye position 700 of the observer is predicted to be outside the eye box 200 is detected, it is determined that a predetermined condition is satisfied, and a signal indicating the state is output to the processor 33. You may.

(20) The signal presumed that the observer's eye position 700 is outside the eye box 200 is (21) a signal indicating that the observer's eye position 700 cannot be detected, and (22) the observer's eye position 700. After the movement is detected, a signal indicating that the observer's eye position 700 cannot be detected, and / or (23) either of the observer's eye positions 700R or 700L is near the boundary 200A of the eyebox 200 (near the above). Includes, for example, a signal indicating that it is within a predetermined coordinate from the boundary 200A).

(30) The signal predicted that the observer's eye position 700 is outside the eye box 200 is (31) stored in advance in the memory 37 with respect to the previously detected eye position 700 by the newly detected eye position 700. A signal indicating that the eye position movement distance is equal to or greater than the threshold value (the eye position movement within a predetermined unit time is larger than the specified range), and (32) the eye position movement speed are stored in advance in the memory 37. Includes a signal indicating that the eye position movement speed is equal to or higher than the threshold value, and the like.

Further, the eye position detection unit 411 may have a function as a line-of-sight direction detection unit 411. The line-of-sight direction detection unit 411 may include an infrared camera or a visible light camera that captures the face of an observer sitting in the driver's seat of the vehicle 1, and may output the captured image to the processor 33. The processor 33 acquires a captured image (an example of information capable of estimating the line-of-sight direction) from the line-of-sight direction detection unit 411, and analyzes the captured image to determine the line-of-sight direction (and / or the gaze position) of the observer. Can be identified. The line-of-sight direction detection unit 411 may analyze the captured image from the camera and output a signal indicating the line-of-sight direction (and / or the gaze position) of the observer, which is the analysis result, to the processor 33. The method for acquiring information that can estimate the line-of-sight direction of the observer of the vehicle 1 is not limited to these, and the EOG (Electro-oculogram) method, the corneal reflex method, the scleral reflex method, and the Purkinje image detection. It may be obtained using other known line-of-sight detection (estimation) techniques such as method, search coil method, infrared fundus camera method.

The IMU413 is one or more sensors (eg, accelerometers and gyroscopes) configured to detect the position, orientation, and changes (speed of change, acceleration of change) of vehicle 1 based on inertial acceleration. Can include combinations of. The IMU 413 processes the detected values (the detected values include the position and orientation of the vehicle 1, and signals indicating these changes (change speed, change acceleration), etc.), and the results of analyzing the detected values. It may be output to 33. The analysis result is a signal or the like indicating a determination result of whether or not the detected value satisfies a predetermined condition, and is, for example, from a value related to a change (change speed, change acceleration) in the position or orientation of the vehicle 1. , It may be a signal indicating that the behavior (vibration) of the vehicle 1 is small.

The brightness sensor 415 determines the illuminance or brightness in a predetermined range of the foreground existing in front of the vehicle interior of the vehicle 1 as the outside brightness (an example of brightness information), or the illuminance or brightness in the vehicle interior as the brightness inside the vehicle (brightness). Detect as an example of information). The brightness sensor 415 is, for example, a phototransistor, a photodiode, or the like, and is mounted on an instrument panel, a rearview mirror, a HUD device 20, or the like of the vehicle 1 shown in FIG.

The personal digital assistant 417 is a smartphone, a laptop computer, a smart watch, or other information device that can be carried by an observer (or another occupant of vehicle 1). The I / O interface 31 can communicate with the mobile information terminal 417 by pairing with the mobile information terminal 417, and the data recorded in the mobile information terminal 417 (or the server through the mobile information terminal). To get. The mobile information terminal 417 has, for example, the same functions as the above-mentioned road information database 403 and own vehicle position detection unit 405, acquires the road information (an example of real object-related information), and transmits it to the processor 33. You may. Further, the personal digital assistant 417 may acquire commercial information (an example of information related to a real object) related to a commercial facility in the vicinity of the vehicle 1 and transmit it to the processor 33. The mobile information terminal 417 transmits schedule information of the owner (for example, an observer) of the mobile information terminal 417, incoming information on the mobile information terminal 417, mail reception information, and the like to the processor 33, and the processor 33 and an image. The processing circuit 35 may generate and / or transmit image data relating to these.

The external communication device 419 is a communication device that exchanges information with the vehicle 1, for example, another vehicle connected to the vehicle 1 by vehicle-to-vehicle communication (V2V: Vehicle To Vehicle), and pedestrian-to-vehicle communication (V2P: Vehicle To Pedestrian). ), A network communication device connected by pedestrians (portable information terminals carried by pedestrians) and road-to-vehicle communication (V2I: Vehicle To Roadside Infrastructure), and in a broad sense, communication with vehicle 1 (V2X). : Includes everything connected by (Vehicle To Everything). The external communication device 419 acquires, for example, the positions of pedestrians, bicycles, motorcycles, other vehicles (preceding vehicles, etc.), road surfaces, lane markings, roadside objects, and / or features (buildings, etc.) and transfers them to the processor 33. It may be output. Further, the external communication device 419 has the same function as the own vehicle position detection unit 405 described above, and may acquire the position information of the vehicle 1 and transmit it to the processor 33, and further, the road information database 403 described above. It also has a function, and may acquire the road information (an example of information related to a real object) and transmit it to the processor 33. The information acquired from the external communication device 419 is not limited to the above.

The software components stored in the memory 37 are the eye position detection module 502, the eye position estimation module 504, the eye position prediction module 506, the eye position state determination module 508, the spot illumination pattern setting module 510, the display parameter setting module 512, and the graphic. It includes a module 514, a light source drive module 516, an actuator drive module 518, and a brightness detection module 520.

7A, 7B, and 7C are flow diagrams illustrating a method S100 for performing an operation of setting a spot illumination pattern based on the observer's eye position according to some embodiments. The method S100 is executed in the HUD device 20 including the display and the display control device 30 that controls the HUD device 20. Some operations of the method S100 shown below are arbitrarily combined, some operation procedures are arbitrarily modified, and some operations are optionally omitted.

The eye position detection module 502 of FIG. 6 detects the eye position 700 of the observer (S110). The eye position detection module 502 detects coordinates indicating the observer's eye position 700 (positions in the X and Y axis directions, which is an example of a signal indicating the eye position 700), and observer's eye height. Detecting coordinates (positions in the Y-axis direction, which is an example of a signal indicating the eye position 700), and coordinates indicating the height and depth of the observer's eyes (Y and Z axes). It is a position in the direction and is an example of a signal indicating the eye position 700.) And / or coordinates indicating the eye position 700 of the observer (position in the X, Y, Z axis directions and the eye position). It includes various software components for performing various operations related to detecting (an example of a signal indicating 700).

The eye position 700 detected by the eye position detection module 502 is one of the predetermined positions 700R, 700L, right eye position 700R, and left eye position 700L, right eye position 700R, and left eye position 700L, respectively. It includes one of the detectable (easy to detect) positions, or a position calculated from the right eye position 700R and the left eye position 700L (for example, the midpoint between the right eye position and the left eye position). For example, the eye position detection module 502 determines the eye position 700 based on the observation position acquired from the eye position detection unit 411 immediately before the timing of updating the display setting.

Further, the eye position detection unit 411 detects the movement direction and / or the movement speed of the observer's eye position 700 based on a plurality of observation positions with different eye detection timings of the observer acquired from the eye position detection unit 411. Then, a signal indicating the moving direction and / or moving speed of the observer's eye position 700 may be output to the processor 33.

The eye position estimation module 504 acquires information capable of estimating the eye position (S114). Information that can estimate the eye position is, for example, an image captured from the eye position detection unit 411, the position of the driver's seat of the vehicle 1, the position of the observer's face, the height of the sitting height, or the eyes of a plurality of observers. Observation position, etc. The eye position estimation module 504 estimates the eye position 700 of the observer of the vehicle 1 from the information capable of estimating the eye position. The eye position estimation module 504 is based on an image captured from the eye position detection unit 411, the position of the driver's seat of the vehicle 1, the position of the observer's face, the height of the sitting height, the observation position of the eyes of a plurality of observers, and the like. Includes various software components for performing various actions related to estimating the observer's eye position 700, such as estimating the observer's eye position 700. That is, the eye position estimation module 504 may include table data, an arithmetic expression, and the like for estimating the eye position 700 of the observer from the information that can estimate the eye position.

The eye position estimation module 504 sets the eye position 700 as the eye observation position acquired from the eye position detection unit 411 immediately before the timing of updating the spot illumination pattern, and one or more eye observation positions acquired in the past. Based on the above, for example, it may be calculated by a method such as a weighted average.

The eye position prediction module 506 acquires information that can predict the eye position 700 of the observer (S116). The information that can predict the eye position 700 of the observer is, for example, the latest observation position acquired from the eye position detection unit 411, or one or more observation positions acquired in the past. The eye position prediction module 506 includes various software components for performing various actions related to predicting the eye position 700 based on predictable information on the observer's eye position 700. Specifically, for example, the eye position prediction module 506 predicts the eye position 700 of the observer at the timing when the image to which the new display setting is applied is visually recognized by the observer. The eye position prediction module 506 uses a prediction algorithm such as a least squares method, a Kalman filter, an α-β filter, or a particle filter to obtain the next value using one or more observation positions in the past. You may try to predict.

The spot illumination pattern setting module 510 sets an area to which the display light K is directed based on the eye position acquired in S110 (S130). The spot illumination pattern setting module 510 sets the area including the partial view area E in which the observer's left eye position 700L exists and a part or all of the partial view area E around the area as the spot lighting pattern SPL for the left eye, and observes the area. A region including a partial viewing area E in which the right eye position 700R of the person exists and a part or all of the partial viewing area E adjacent to the partial viewing area E is set in the spot lighting pattern SPR for the right eye (S132). Specifically, as shown in FIG. 4B, the spot illumination pattern setting module 510 includes a partial viewing area E (2, 3) in which the observer's right eye 700L exists and a peripheral partial viewing area E (1, 2). Part of E (2,2), E (2,3), E1,3), E (3,3), E (1,4), E (2,4), and E (2,5) The spot lighting pattern SPR for the right eye including the above, the partial viewing area E (4,3) in which the observer's left eye 700L exists, and the peripheral partial viewing areas E (3,2), E (4,2), E (5). , 2), E3,3), E (5,3), E (3,4), E (4,4), and a spotlight pattern SPR for the right eye including a part of E (5,4). Direct the display light K to. In this case, the spot illumination pattern setting module 510 includes a main partial region DA (D (4, 6)) that directs the display light K to the center of the partial viewing region E (2, 3) in which the observer's right eye 700R exists. Sub-partial region DB (D (3,5), D (4,5), D (5,5) that directs the display light K to a region other than the center in the partial visual region E (2,3) where the right eye 700R exists. ), D (3,6), D (5,6), D (3,7), D (4,7), and D (5,7)) are made to emit light at a predetermined light intensity or higher. The main partial region DA (D (8, 6)) in which the display light K is directed to the center of the partial viewing region E (4, 3) in which the observer's left eye 700L exists, and the partial viewing region E (2) in which the left eye 700L exists. , 3) Sub-subregion DB (D (7,5), D (8,5), D (9,5), D (7,6), D ( 9,6), D (7,7), D (8,7), and D (9,7)) are made to emit light at a predetermined light intensity or higher. The spot illumination pattern setting module 510 is provided with a light emitting region DMR for the right eye (main partial region DA for the right eye + sub partial region DB) and a light emitting region DML for the left eye (main partial region DA for the left eye + sub partial region DB). The partial region D is not irradiated with the illumination laser beam 74 (or is irradiated with the illumination laser beam 74 having a very low light intensity).

Further, the spot illumination pattern setting module 510 includes a continuous spot lighting pattern for both eyes including a partial viewing area E in which the observer's left eye position 700L exists and a partial viewing area E in which the observer's right eye position 700R exists. Set to SPC (S134). Specifically, as shown in FIG. 8A, the spot illumination pattern setting module 510 has a partial viewing area E (2, 3) in which the observer's right eye 700L exists, and a partial viewing area E (4,) in which the left eye 700L exists. 3) and partial visibility around them E (1,2), E (2,2), E (3,2), E (4,2), E (5,2), E (1, 3), E (3,3), E (3,5), E (1,4), E (2,4), E (3,4), E (4,4), and E (5,5) The display light K is directed to the spot lighting pattern SPC for both eyes including a part of 4). In this case, the spot illumination pattern setting module 510 directs the display light K to the center of the partial viewing area E (2, 3) where the observer's right eye 700R exists, the main partial area DA (D (4, 6)), and the left eye. Main partial region DA (D (8, 6)), main partial region DA (D (4, 6)) and main partial region that direct the display light K to the center of the partial viewing area E (4, 3) where 700L exists. Sub-subregion DB (D (5,4) to D (7,4), D (2,5) to, D (9,5), D (2,5) around DA (D (8,6)) 6), D (3,6), D (5,6) to D (7,6), D (9,6), D (2,7) to D (9,7), and D (5, 8) to D (7,8)) are made to emit light at a predetermined light intensity or higher. Then, the spot illumination pattern setting module 510 provides a laser beam 74 for illumination in a partial region D other than the light emitting region DMC for both eyes (main partial region DA for the right eye + main partial region DA for the right eye + sub-subregion DB). (Or irradiate the illumination laser beam 74 with very low light intensity).

Further, the spot illumination pattern setting module 510 sets the size of the light emitting area DM in the planar illumination unit SE based on the eye position (Z-axis coordinates) in the front-rear direction in the own vehicle 1 acquired in S110 (light emission area). The change process S136 is executed.). FIG. 13 is a diagram for explaining the difference in the optical path in the head-up display device 20 due to the difference in the eye position in the front-rear direction in the own vehicle 1. In this figure, the above-mentioned illumination optical system and the like are omitted. The illumination light emitted from the specific light emitting region DM of the planar illumination unit SE is modulated by the display light K indicating an image on the light modulation element 51, and this display light K corresponds to the light emission region DM by the condensing optical system. The light is focused on the spot pattern SP. The spot illumination pattern setting module 510 sets the first light emitting region DM1 for the eye at the first position 701 separated by the first distance D1 from the projected portion 2, and is covered by the first distance D1. A second light emitting area DM2 wider than the first light emitting area DM1 is set for the eyes at the second position 702, which is a position close to the projection unit 2 (in other words, a position in front of the first distance D1). do.

FIG. 10 shows a first light emitting region DM1 (first left eye light emitting region DML1 and a first right eye light emitting region DMR1) and a second light emitting region DM2 (for the second left eye) in the planar illumination unit SE. It is a figure which shows one aspect of the light emitting region DML2, the light emitting region DMR2) for the second right eye. Assuming that the vertical length of the light emitting region DM is the symbol PV and the horizontal length is the symbol PH, the first light emitting region DM1 has a longer vertical length PV than the second light emitting region DM2 in the horizontal direction. The length PH is also shortened. Further, the second light emitting region DM2 includes the first light emitting region DM1 and the light emitting region DM around the first light emitting region DM1. In this way, when the eye position 700 is arranged in front (the second position 702 with respect to the first position 701), the light emitting region DM of the light source element 60 (the light source element 60A described later) is widened. , The entire display surface 52 of the light modulation element 51 (“whole” here refers to 100% of the entire displayable area of the light modulation element 51 and a preset display area (for example, 70 of the entire area) in the displayable area. %) Is also included.) The virtual image V of the image that can be displayed can be visually recognized by the observer with a desired brightness (more than a desired brightness). In the example of FIG. 14, the first left eye light emitting region DML1 for the left eye 700L (second left eye light emitting region DML2) and the first right eye light emitting region DMR1 for the right eye 700R ((second right eye). The light emitting region DMR2) was provided, but the present invention is not limited to this. The spot illumination pattern setting module 510 of another example is any one based on the eye position (Z-axis coordinate) in the front-rear direction in the own vehicle 1. The area may be changed only for the light emitting region DM directed to one eye. Further, the spot illumination pattern setting module 510 of another example has eye positions (Z-axis coordinates) in the front-rear direction in the own vehicle 1. ), A continuous spotlight pattern for both eyes including a partial view area E where the left eye position 700L exists and a partial view area E where the right eye position 700R exists. The size of the area DMC may be changed.

The spot illumination pattern setting module 510 controls the light amount distribution Ld in the light emitting region DM in the planar illumination unit SE based on the eye position (Z-axis coordinates) in the front-rear direction in the own vehicle 1 acquired in S110 (S138).

In some embodiments, the spot illumination pattern setting module 510 may have the emission intensity of the sub-region DB higher than 0.7 times the emission intensity of the main partial region DA. According to this, since the emission intensity of the sub-subregion DB is relatively strong, even when the eye position 700 is near the boundary of the partial viewing region E, the light from the sub-subregion DB causes a relatively high brightness display. The light K can be visually recognized.

Further, in some embodiments, the spot illumination pattern setting module 510 may make the light emission intensity of the sub-region (DB) higher than the light emission intensity of the main partial region (DA). According to this, since the emission intensity of the sub-subregion DB is relatively strong, even when the eye position 700 is near the boundary of the partial viewing region E, the light from the sub-subregion DB causes a relatively high brightness display. The light K can be visually recognized. Further, it is possible to improve the uniformity of the brightness of the virtual image V that can be displayed on the entire virtual image display area VS.

In the display parameter setting module 512 of FIG. 6, the eye position 700 detected by the eye position detection module 502, the eye position 700 estimated by the eye position estimation module 504, or the eye position 700 predicted by the eye position prediction module 506 are predetermined. It is determined where in the plurality of partial visual areas E to belong to, and the display parameter 600 corresponding to the eye position 700 is set. The display parameter setting module 512 determines where the X-axis coordinate, the Y-axis coordinate, the Z-axis coordinate, or a combination thereof indicated by the eye position 700 belongs to a plurality of spatial regions (partial viewing area E). Includes various software components for performing various actions related to setting the display parameter 600 corresponding to the partial viewing area E to which the eye position 700 belongs. That is, the display parameter setting module 512 may include table data, an arithmetic expression, etc. for specifying the display parameter 600 from the X-axis coordinates, the Y-axis coordinates, the Z-axis coordinates, or a combination thereof indicated by the eye position 700. ..

The display parameter setting module 512 may apply the corresponding display parameter for each partial viewing area E (S152). For example, when the light emitting region DM emits light in a time-division manner, the display parameter setting module 512 may switch to a different display parameter 600 for each timing when one light emitting region DM emits light. In the example of FIG. 4B, the display parameter 600 corresponding to the light emitting region DM (7, 6) is applied to the light modulation element 51 at the timing when the light emitting region DM (7, 6) emits light, and the light emitting region DM (8, 6) is applied. The display parameter 600 corresponding to the light emitting region DM (8, 6) may be applied to the light modulation element 51 at the timing when the light is emitted.

Further, the other display parameter setting module 512 may apply one common display parameter to the plurality of light emitting region DMs (S154). In the display parameter setting module 512, for example, since the display light K is directed to the spotlight pattern SPR for the right eye shown in FIG. 4B, the light emitting regions DMR for the right eye (partial regions D (8, 6), D (7, 5), D). (8,5), D (9,5), D (7,6), D (9,6), D (7,7), D (8,7), D (9,7)) A common display parameter 600 is applied to the light modulation element 51 at each timing. Specifically, the display parameter setting module 512 sets the display parameter 600 corresponding to the main partial region DA (D (8, 6) in the example of FIG. 4B) that directs the display light K to the center of the spot lighting pattern SP. It may be applied to the modulation element 51.

In some embodiments, the display parameter setting module 512 may switch the display parameter 600 between the timing of causing the light emitting region DMR for the right eye to emit light and the timing for emitting light of the light emitting region DML for the left eye. Here, assuming that the display parameter 600 is a parameter that makes the image to be displayed different, the display parameter setting module 512 displays the image for the right eye at the timing of emitting the light emitting region DMR for the right eye, and emits the light emitting region DML for the left eye. By displaying the image for the left eye at the timing of making it, the observer can perceive a stereoscopic image (virtual image) due to left-right parallax.

Further, the other display parameter setting module 512 may apply two or more display parameters to one spot lighting pattern SP (S154). In this case, the display parameter setting module 512 sets the common display parameter 600 in the plurality of partial areas D in advance. For example, in the example of FIG. 4B, the first display parameter common to the partial areas D (7, 5), D (8, 5), and D (9, 5) is set, and the partial area D (7, 6) is set. ), D (8,6), and D (9,6) have a common second display parameter (different from the first display parameter), and partial areas D (7,7), D. Assuming that a third display parameter (different from the first and second display parameters) common to (8,7) and D (9,7) is set, the display parameter setting module 512 is partially divided. When the regions D (7, 5), D (8, 5), and D (9, 5) emit light, the first display parameter is applied to the light modulation element 51, and the partial region D (7, 6) is applied. ), D (8, 6), and D (9, 6) emit light, respectively, the second display parameter is applied to the light modulation element 51, and the partial regions D (7, 7), D (8, When 7) and D (9, 7) emit light, the third display parameter is applied to the light modulation element 51.

The types of the display parameter 600 are as follows: (1) Image arrangement (display 50 for controlling image arrangement) so as to have a predetermined positional relationship with a real object located outside the vehicle 1 when viewed from the eye position 700. And / or parameters that control the actuator.), (2) Parameters for pre-distorting the image in order to reduce the distortion of the image that may occur due to the virtual image optical system 90 as seen from the eye position 700. (A parameter that controls the display 50 to distort the image displayed on the display 50 in advance, and is also called a warping parameter.), (3) The desired stereoscopic image is visually recognized when viewed from the eye position. (Parameters for controlling the display 50, parameters for controlling the light source of the display 50, parameters for controlling the actuator, or parameters including a combination thereof), and the like. However, the display parameter 600 set (selected) by the display parameter setting module 512 may be any parameter that is preferably changed according to the observer's eye position 700, and the type of the display parameter 600 is not limited thereto. ..

The display parameter setting module 512 selects one or a plurality of display parameters 600 corresponding to the eye positions 700 for one type of display parameter. When the eye position 700 includes, for example, the right eye position 700R and the left eye position 700L, the display parameter setting module 512 includes the display parameter 600 corresponding to the right eye position 700R, the display parameter 600 corresponding to the left eye position 700L, and the display parameter 600. You can choose between the two. On the other hand, the eye position 700 is, for example, one of the predetermined positions of the right eye position 700R and the left eye position 700L, and one of the right eye position 700R and the left eye position 700L that can be detected (easily detected), or. When there is one position calculated from the right eye position 700R and the left eye position 700L (for example, the midpoint between the right eye position 700R and the left eye position 700L), the display parameter setting module 512 has one display corresponding to the eye position 700. Parameter 600 can be selected. The display parameter setting module 512 may also select a display parameter 600 corresponding to the eye position 700 and a display parameter 600 set around the eye position 700. That is, the display parameter setting module 512 may select three or more display parameters 600 corresponding to the eye positions 700.

The eye position state determination module 508 of FIG. 6 determines whether the eye position 700 of the observer is in an unstable state (S170). The eye position state determination module 508 (10) determines whether or not the observer's eye position 700 is moving, and if it detects the movement of the eye position, determines that it is in an unstable state, (20). It is determined whether or not the observer's eye position 700 is moving at a speed equal to or higher than a predetermined threshold, and when movement at a speed equal to or higher than a predetermined threshold is detected, it is determined to be in an unstable state (30). ) Determine whether the observer's eye position 700 can be detected, and if the eye position 700 cannot be detected, determine that it is in an unstable state. (40) The observer's eye position 700 is outside the eye box 200. It is determined whether or not the eye is present, and if it is outside the eye box 200, it is determined to be in an unstable state. (50) It is determined whether the observer's eye position 700 can be estimated to be outside the eye box 200, and the eye is determined. If it can be estimated that it is outside the box 200, it is determined that it is in an unstable state, or (60) it is determined whether or not the observer's eye position 700 is expected to be outside the eye box 200, and the eye box 200 is determined. Includes various software components to perform various actions related to the observer's eye position 700 being unstable, such as determining that it is in an unstable state if it is predicted to be outside. .. That is, from the detection information, estimation information, or prediction information of the eye position 700, the eye position state determination module 508 indicates whether the eye position is moving, the eye position is moving at high speed, and / or. It may include table data, arithmetic expressions, etc. for determining whether or not it is in an unstable state.

(S176) The eye position detection module 502 calculates the dispersion of the position data of each of the plurality of observation positions acquired from the eye position detection unit 411 within a predetermined measurement time, and the eye position state determination module 508 calculates the eye position. When the dispersion calculated by the detection module 502 is larger than a predetermined threshold value, it may be determined that the stability of the eye position of the observer is low (unstable).

(S178) The eye position detection module 502 calculates the deviation of each position data of the plurality of observation positions acquired from the eye position detection unit 411 within a predetermined measurement time, and the eye position state determination module 508 calculates the eye position. When the deviation calculated by the detection module 502 is larger than a predetermined threshold value, it may be determined that the stability of the eye position of the observer is low (unstable) (not unstable). ..

Further, without using the dispersion of the method S176 or the deviation of the method S178, the eye position detection module 502 has a larger number of partial visual areas to which the eye position 700 has moved than a predetermined threshold value per predetermined unit time. Occasionally, it may be in a form in which it is determined that the stability of the eye position of the observer is low (unstable) (not unstable). Further, in the eye position detection module 502, the total distance traveled by the eye position 700 (the total distance between a plurality of observation positions acquired a plurality of times per unit time) per predetermined unit time is equal to or greater than a predetermined threshold value. When it becomes long, it may be in a form in which it is determined that the stability of the eye position of the observer is low (unstable) (not unstable).

(S176) The method of determining whether or not the observer's eye position 700 can be detected is as follows: (1) A part of the observer's eye observation position acquired from the eye position detection unit 411 within a predetermined period (for example,). (2) The eye position detection module 502 cannot detect the observer's eye position 700 in normal operation, and (3) the eye position estimation module 504 usually cannot detect the eye position 700 more than a predetermined number of times. The observer's eye position 700 cannot be estimated in the operation of (4) the eye position prediction module 506 cannot predict the observer's eye position 700 in the normal operation, or a combination of these causes the observer's eye position 700. It includes determining that the eye position 700 cannot be detected (the observer's eye position 700 is in an unstable state) (note that the determination method is not limited thereto).

(S178) The method of determining whether or not the observer's eye position 700 is outside the eye box 200 is as follows: (1) One of the observer's eye observation positions acquired from the eye position detection unit 411 within a predetermined period. Acquiring a part (for example, a predetermined number of times or more) or all of them outside the eyebox 200, (2) the eye position detection module 502 detects the observer's eye position 700 outside the eyebox 200, or these. The combination includes, and includes, determining that the observer's eye position 700 is outside the eye box 200 (the observer's eye position 700 is in an unstable state) (note that the determination method is not limited thereto). ..

(S180) The method of determining whether the observer's eye position 700 can be estimated to be outside the eye box 200 is as follows: (1) After the movement of the observer's eye position 700 is detected by the eye position detection unit 411, the observer The eye position 700 cannot be detected, (2) the eye position detection module 502 detects the observer's eye position 700 in the vicinity of the boundary 200A of the eye box 200, and (3) the eye position detection module 502 observes. It can be estimated that the observer's eye position 700 is outside the eye box 200 by detecting either the right eye position 700R or the left eye position 700L near the boundary 200A of the eye box 200, or a combination thereof (observer). (The determination method is not limited to these).

(S182) The method of determining whether or not the observer's eye position 700 is predicted to be outside the eye box 200 is as follows: (1) The eye position prediction module 506 sets the observer's eye position 700 after a predetermined time in the eye box. Predicting outside 200, (2) The eye position 700 newly detected by the eye position detection module 502 is equal to or greater than the eye position movement distance threshold stored in advance in the memory 37 with respect to the previously detected eye position 700. There is (the movement speed of the eye position 700 is equal to or higher than the eye position movement speed threshold stored in advance in the memory 37), or the observer's eye position 700 is outside the eye box 200 due to a combination thereof. It includes (but is not limited to these) determination that it can be predicted (the eye position 700 of the observer is in an unstable state).

When the eye position state determination module 508 determines that the spot illumination pattern setting module 510 is not in an unstable state, the spot illumination pattern setting module 510 is set to the first spot lighting pattern SP1 (S192). On the other hand, when the display parameter setting module 512 is determined to be in an unstable state by the eye position state determination module 508, the second spot lighting pattern in which the area to which the display light K is directed is expanded from the first spot lighting pattern SP1. It may be set to SP2 (S194).

See FIG. 6 again. The graphic module 514 includes various known software components for performing image processing such as rendering to generate image data and driving the display 50. The graphic module 514 also provides a type, arrangement (positional coordinates, angle), size, display distance (in the case of 3D), visual effect (eg, brightness, transparency, saturation, contrast, or) of the displayed image. Other visual characteristics), may include various known software components for modification. The graphic module 514 has an image type (one of the display parameters), image position coordinates (one of the display parameters), an image angle (pitching angle about the X direction, and yaw rate about the Y direction). Image data is generated so that the observer can see the angle, the rolling angle about the Z direction, etc., which is one of the display parameters) and the size of the image (one of the display parameters), and HUD. The device 20 can be driven.

The light source drive module 516 includes various known software components for performing driving of the directional light source unit 60. The light source drive module 516 can drive the directional light source unit 60 based on the set spot lighting pattern and display parameter 600.

The actuator drive module 518 includes various known software components for performing driving of the first actuator 28 and / or the second actuator 29. The actuator drive module 518 is based on a set display parameter 600. The first actuator 28 and the second actuator 29 may be driven.

The brightness detection module 520 of FIG. 6 uses a brightness sensor 415 to change the illuminance or brightness of a predetermined range of the foreground existing in front of the vehicle interior of the vehicle 1 to the outside brightness (an example of brightness information) or the interior of the vehicle interior. Illuminance or brightness is detected as the brightness inside the vehicle (an example of brightness information). The brightness detection module 520 executes various operations related to acquiring (detecting) brightness information, comparing the acquired brightness information with a predetermined threshold value, and outputting a comparison result. Includes various software components to do.

Further, the brightness detection module 520 determines the brightness such as the external brightness which is the illuminance or brightness of a predetermined range of the foreground existing in front of the vehicle interior of the vehicle 1, or the brightness inside the vehicle which is the illuminance or brightness of the vehicle interior. Get predictable information. The information that can predict the brightness is, for example, information indicating a position where the brightness becomes dark from the road information database 403. Based on this, the brightness detection module 520 may, for example, predict that it will become brighter or darker after a predetermined time, and output the prediction result.

In some embodiments, the processor 33 acquires information about the ambient brightness acquired from the brightness detection module 520, or information that can predict the ambient brightness, and executes the spot illumination pattern setting module 510. Therefore, when it is estimated that the ambient brightness is dark, the ratio of the emission intensity of the sub-region DB to the emission intensity of the main partial region DA may be increased. Specifically, for example, in the spot illumination pattern setting module 510, when the surroundings are bright, the ratio of the light intensity between the main partial region DA and the sub partial region DB is set to 1: 0.7, and when the surroundings are dark, 1 : May be set to 0.8. Further, in some embodiments, the spot illumination pattern setting module 510 sets the ratio of the light intensity between the main partial region DA and the sub partial region DB to 1: 1.3 when the surroundings are bright, and the surroundings are set to 1: 1.3. If it is dark, it may be set to 1: 1.5. In a dark environment, the intensity of the illumination light emitted from each light emitting area DM is reduced as a whole, but this reduces the influence of the combined wave of the light amounts based on the surrounding light emitting area DM (increase in the amount of light). By increasing the ratio of the emission intensity of the sub-region DB to the emission intensity of the main partial region DA in a dark environment, it is possible to suppress the decrease in brightness of the image (virtual image) near the boundary of the partial viewing region E. can.

The operation of the above-mentioned processing process can be carried out by executing one or more functional modules of an information processing apparatus such as a general-purpose processor or a chip for a specific application. All of these modules, combinations of these modules, and / or combinations with known hardware capable of substituting their functions are within the scope of the protection of the present invention.

The functional blocks of the vehicle display system 10 are optionally performed by hardware, software, or a combination of hardware and software to implement the principles of the various embodiments described. It is possible that the functional blocks described in FIG. 6 may be optionally combined or one functional block separated into two or more subblocks in order to implement the principles of the embodiments described. It will be understood by those skilled in the art. Accordingly, the description herein optionally supports any possible combination or division of functional blocks described herein.

(Second embodiment)
FIG. 8 is a diagram showing the configuration of the directional light source unit 60A in the second embodiment. FIG. 12 is a diagram showing one aspect of the light source array 80A shown in FIG. The directional light source unit 60 is composed of a field lens 77A and a light source array 80A in which a plurality of light sources (81 as shown in FIG. 12 in this embodiment) are arranged in an array. The light source array 80A (plane illumination unit SE) has m (m> n) partial regions D (the partial regions D of the present embodiment are 121 from D (1,1) to D (11,11). The display control device 30 partially directs the strong display light K to the spot lighting pattern SP corresponding to the partial viewing area E in which the eye position detected by the eye position detection unit 411 exists. By driving (partially driving) the light source, the observer can visually recognize the image (imaginary image V) as in the case of the directional light source unit 60A described above, so that the observer's eyes do not exist in the partial viewing area E. You can prevent the light from facing you.

The field lens 77A is arranged on the optical path of the illumination light emitted from the light source arranged in each partial region D between the light source array 80A and the light modulation element 51. The second field lens 77 of the present embodiment is composed of one or a plurality of field lenses, and the illumination laser beam 74 diffused by each partial region D of the light diffusion optical system 80 covers the entire surface of the light modulation element 51. It is a front-stage optical member (backlight optical member) designed for transmitted illumination. Further, in the field lens 77A, the display light K emitted from the light modulation element 51 passes through the virtual image optical system 90 (HUD optical member composed of the relay optical system 40 and the front windshield 2), and is arbitrary in the eye box 200. It is designed to reach the partial field of view E at the position.

The diffuser plate 78 is arranged on the optical path of the illumination light between the light modulation element 51 and the field lens 77A. The diffuser plate 78 diffuses the received illumination light and emits it to the light modulation element 51. As a result, it is possible to reduce the luminance unevenness in the display light K generated by the illumination light emitted from the plurality of light emitting areas DM visually recognized in the partial viewing area E of the eye box 200. The diffuser plate 78 may be any optical member having a function of diffusing light, and for example, its surface is composed of a bead member, a fine uneven structure, and a rough surface. Further, a dot sheet or a transparent milky white sheet may be used.

In the light source array 80A of the present embodiment, one light source such as an LED is arranged in each of m partial regions D (a plurality of light sources may be arranged), and the light source array 80A is arranged in any of m partial regions D. The illumination light emitted by the light source is transmitted to the entire surface of the light modulation element 51 after passing through the field lens 77 and the diffuser plate 78, and after the light-modulated display light K passes through the imaginary optical system 90, a predetermined value is obtained. A predetermined area in a predetermined eyebox 200 corresponding to the partial area D is irradiated.

With reference to FIGS. 12, 13A, and 13B, the relationship between the vertical length PV of the light emitting region DM and the horizontal length PH will be described. 12, FIG. 13A, and FIG. 13B define the bounding box including all the partial regions D of the group that emit light at a predetermined light intensity or higher, although the emission patterns are different, as the emission region DM. , And the size of the light emitting region DM in FIG. 13B can be said to be the same. The horizontal direction of the light emitting region DM corresponds to the left-right direction (X-axis direction) of the eye box 200, and the vertical direction of the light-emitting region DM corresponds to the vertical direction (Y-axis direction) of the eye box 200. In the present embodiment, the horizontal length PH of the light emitting region DM is set to be twice or more the vertical length PV. As a result, the horizontal length of the spot lighting pattern SP corresponding to the light emitting region DM is set to be approximately twice or more the vertical length. As a result, an image (virtual image) is desired even if the eye position 700 moves in the horizontal direction by increasing the horizontal direction of the spot lighting pattern SP while reducing the vertical direction of the spot lighting pattern SP to suppress the power of the light source. It can be visually recognized by the brightness of.

That is, in some embodiments, the width of the spotlighting pattern SP may be set wider than the partial viewing area E. Further, in some embodiments, the length of the spotlighting pattern SP in the left-right direction may be set to be twice or more the partial viewing area E. Specifically, the vertical length of the partial viewing area E is 26 [mm] and the horizontal length is 10 [mm], whereas the vertical length of the spot lighting pattern SP is 52 [mm]. Arrangement of the light emitting region DM, adjustment (balance) of the light intensity emitted by the light emitting region DM, and / or whole or partial optics of the condensing optical system so that the length in the lateral direction becomes 20 [mm]. Adjustments are made.

14A-14D show the partial viewing area of the eyebox and the position where the display light based on the illumination light emitted from each partial area of the directional light source unit is focused, according to some embodiments. It is a figure which shows the modification of the relationship.

In the example of FIG. 14A, the directional light source unit 60 arranges the partial region D so that five different locations can be irradiated in one partial viewing area E. Specifically, there are a total of five locations, one in the center of the partial viewing area E and four in the four corners of the partial viewing area E. In one aspect shown in FIG. 14A, the display control device 30 controls the directional light source unit 60 so that the display light K is irradiated to all five different points in the partial viewing area E where the eye position 700 exists. The light emitting region DM has a main partial region DA that emits illumination light that is the source of the display light K that is focused on the center of the partial viewing region E where the eye position 700 exists, and an eye position 700 that is larger than the main partial region DA. Includes a sub-partial region DB that emits illumination light that is the source of the display light K that is focused at a position away from the center of the partial viewing area E. That is, when the left eye position 700L exists in the partial viewing area E (4, 3), the main partial area DA is the partial area D (8, 6), and the sub partial area DB is the partial area D (7, 5). ), D (9,5), D (7,7), and D (9,7). On the other hand, when the right eye position 700R exists in the partial viewing area E (2, 3), the main partial area DA is the partial area D (4, 6), and the sub partial area DB is the partial area D (3, 5). ), D (5,5), D (3,7), and D (5,7).

In the example of FIG. 14B, the directional light source unit 60 arranges the partial region D so that three different locations can be irradiated in one partial viewing area E. Specifically, there are a total of three locations, one in the center of the partial viewing area E and two of the four corners of the partial viewing area E. In one aspect shown in FIG. 14B, the display control device 30 controls the directional light source unit 60 so that the display light K is irradiated to all three different points in the partial viewing area E where the eye position 700 exists. The light emitting region DM has a main partial region DA that emits illumination light that is the source of the display light K that is focused on the center of the partial viewing region E where the eye position 700 exists, and an eye position 700 that is larger than the main partial region DA. Includes a sub-partial region DB that emits illumination light that is the source of the display light K that is focused at a position away from the center of the partial viewing area E. That is, when the left eye position 700L exists in the partial viewing area E (4, 3), the main partial area DA is the partial area D (8, 6), and the sub partial area DB is the partial area D (7, 5). ), And D (9,7). On the other hand, when the right eye position 700R exists in the partial viewing area E (2, 3), the main partial area DA is the partial area D (4, 6), and the sub partial area DB is the partial area D (3, 5). ), And D (5,7).

In the example of FIG. 14C, the directional light source unit 60 arranges the partial region D so that four different locations can be irradiated in one partial viewing area E. Specifically, there are four locations at the four corners of the partial viewing area E. In one aspect shown in FIG. 14C, the display control device 30 controls the directional light source unit 60 so that the display light K is irradiated to all four different points in the partial viewing area E where the eye position 700 exists. The light emitting region DM does not include the main partial region DA that emits the illumination light that is the source of the display light K that is focused on the center of the partial viewing region E where the eye position 700 exists, and the eye position 700 is higher than the main partial region DA. Includes only the sub-partial region DB that emits the illumination light that is the source of the display light K that is focused at a position away from the center of the partial viewing area E where the is present. That is, when the left eye position 700L exists in the partial viewing area E (4, 3), there is no main partial area DA, and the sub partial area DB is the partial areas D (7, 5), D (9, 5), D. (7,7) and D (9,7). On the other hand, when the right eye position 700R exists in the partial viewing area E (2, 3), there is no main partial area DA, and the sub partial area DB is the partial areas D (3, 5), D (5, 5), D. (3,7) and D (5,7).

In the example of FIG. 14D, the directional light source unit 60 arranges the partial region D so that two different locations can be irradiated in one partial viewing area E. Specifically, there are two locations other than the four corners of the partial viewing area E. In one aspect shown in FIG. 14D, the display control device 30 controls the directional light source unit 60 so that the display light K is irradiated to all two different points in the partial viewing area E where the eye position 700 exists. The light emitting region DM does not include the main partial region DA that emits the illumination light that is the source of the display light K that is focused on the center of the partial viewing region E where the eye position 700 exists, and the eye position 700 is higher than the main partial region DA. Includes only the sub-partial region DB that emits the illumination light that is the source of the display light K that is focused at a position that is distant from the center of the partial viewing area E where is present and is not the boundary of the partial viewing area D. That is, when the left eye position 700L exists in the partial viewing area E (4, 3), there is no main partial area DA, and the sub partial area DB is a partial area D (7.5, 6) that is not a boundary of the partial viewing area D. ), And D (8.5, 6). On the other hand, when the right eye position 700R exists in the partial visual range E (2, 3), there is no main partial region DA, and the sub partial region DB is the partial regions D (3.5, 6) and D (4.5). , 6).

The light source element 60 (60A) of some embodiments is a main portion that emits illumination light for directing the display light K to the center of the partial viewing area E, as shown in FIGS. 4B, 14A, and 14B. It may have a region DA. In this case, the processor 33 may set the emission pattern so that the emission region DM includes the main partial region DA that emits the illumination light for directing the display light to the center of the partial viewing region E.

Further, the light source element 60 (60A) of some embodiments is for directing the display light to the center of the partial viewing area E as shown in FIGS. 4B, 14A, 14B, 14C, and 14D. It has two or more sub-subregion DBs whose points are point-symmetrical at positions where illumination light can be emitted. In this case, the processor 33 includes two or more sub-partial region DBs whose light emitting region DM is point-symmetrical at a position where the illumination light for directing the display light to the center of the partial viewing region E can be emitted. Set the light emission pattern.

Further, the light source element 60 (60A) of some embodiments provides illumination light for directing the display light to the center of the partial viewing area E, as shown in FIGS. 4B, 14A, 14B, and 14C. The above-mentioned two or more sub-subregion DBs whose emission positions are point-symmetrical may be arranged at positions where illumination light for directing the display light to the boundary of the partial viewing area E can be emitted.

Further, the light source element 60 (60A) of some embodiments provides illumination light for directing the display light to the center of the partial viewing area E, as shown in FIGS. 4B, 14A, 14B, and 14C. The above-mentioned two or more sub-subregion DBs whose emission positions are point-symmetrical are used as illumination light for directing the display light to the point-symmetrical two corners or all four corners of the four corners of the partial viewing area E. It may be arranged at a position where it can be emitted.

The light source element 60 (60A) of some embodiments has a main partial region DA that emits illumination light for directing the display light to the center of the partial viewing area E, as shown in FIGS. 14C and 14D. Instead, it may have only the above-mentioned two or more sub-subregion DBs whose points are point-symmetrical at positions where the illumination light for directing the display light to the center of the partial viewing region E can be emitted.

The arrangement of the partial regions D in the light source element 60 (60A) does not have to be regularly arranged as a whole. For example, the position corresponding to the center (and its periphery) of the eye box 200 and the eye box 200 It may be different from the position corresponding to the periphery of. Further, the arrangement of the partial region D in the light source element 60 (60A) is a position corresponding to the center (and its periphery) in the left-right direction of the eye box 200 and a position corresponding to the periphery in the left-right direction of the eye box 200. It may be different. Further, the arrangement of the partial region D in the light source element 60 (60A) is a position corresponding to the center (and its periphery) in the vertical direction of the eye box 200 and a position corresponding to the periphery in the vertical direction of the eye box 200. It may be different.

Further, in the above embodiment, the light source element 60 (60A) has m partial regions D that are larger than n partial viewing regions E, but the present invention is not limited to this. That is, the number of partial areas E (n) and the number of partial areas D (m) may be equal.

Further, in the above embodiment, the display control device 30 (processor 33) changes the width of the light emitting region DM in the planar illumination unit SE based on the eye position (Z-axis coordinates) in the front-rear direction in the own vehicle 1. However, it is not limited to this. The display control device 30 (processor 33) has, in addition to the eye position (Z-axis coordinate) in the front-rear direction in the own vehicle 1, (1) the eye position (X coordinate) in the left-right direction in the own vehicle 1, and (2) the own vehicle. The width of the light emitting region DM in the planar illumination unit SE is also changed based on the vertical eye position (Y coordinate) in 1 (Y coordinate), (3) or the eye position (X coordinate, Y coordinate) of a combination thereof. You may.

1: Vehicle 2: Front windshield (projected part)
3: Non-normal reflection element 10: Vehicle display system 20: HUD device 28: First actuator 29: Second actuator 30: Display control device 31: I / O interface 33: Processor 35: Image processing circuit 37: Memory 40: Relay optical system 41: First mirror 42: Second mirror 50: Display 51: Optical modulation element 52: Display surface 60: Directional light source unit (light source element)
60A: Directive light source unit (light source element)
70: Light source 74: Laser beam for illumination 75: Scanning device 76: First field lens 77: Second field lens 77A: Field lens 78: Diffusing plate 80: Light diffusion optical system (plane illumination unit)
80A: Light source array (planar lighting unit)
81: Lens array 82: Hologram recording medium 90: Virtual image optical system 100: Virtual image display area 101: Upper end 102: Lower end 200: Eye box 200A: Boundary 205: Center 401: Vehicle ECU
403: Road information database 405: Own vehicle position detection unit 407: Vehicle outside sensor 409: Operation detection unit 411: Eye position detection unit (line-of-sight direction detection unit)
413: IMU
415: Brightness sensor 417: Mobile information terminal 419: External communication device 502: Eye position detection module 504: Eye position estimation module 506: Eye position prediction module 508: Eye position state determination module 510: Spot illumination pattern setting module 512: Display Parameter setting module 514: Graphic module 516: Light source drive module 518: Actuator drive module 520: Brightness detection module 600: Display parameter 700: Eye position 700L: Left eye 700R: Right eye D: Partial field of view DA: Main partial area DB: Sub Partial area DM: Light source area DML: Light source area for left eye DMR: Light source area for right eye E: Partial field of view SP: Spot lighting pattern SP1: First spot lighting pattern SP2: Second spot lighting pattern SPL: Spot lighting for left eye Pattern SPR: Spot lighting pattern for right eye V: Virtual image θt: Tilt angle θv: Vertical arrangement angle

Claims (10)

A light source element (60, 60A) having a plurality of partial regions (D) and capable of selectively emitting illumination light for each of the partial regions (D).
A light modulation element (51) that modulates the illumination light incident from the light source element (60, 60A) and emits it as display light.
Condensing optics in which the illumination light emitted from the different partial regions (D) is focused toward different regions in the eyebox (200) for each display light modulated by the light modulation element (51). System (2,40,77,77A) and
In the display control device (30) that controls the head-up display device (20) in which the observer visually recognizes a virtual image from within the range of the eyebox by projecting the display light onto the projected portion.
A processor (33) for controlling the light source element (60, 60A) is provided.
The processor (33)
Information on the eye position in the anteroposterior direction of the observer facing the projected portion or information capable of estimating the eye position in the anteroposterior direction of the observer is acquired from the eye box (200).
When the observer's eye position in the front-rear direction is at the first position (Z1), it is referred to as a partial region (D) (hereinafter referred to as a light emitting region (DM)) that emits the illumination light having a predetermined light intensity or higher. ) Is set in the first light emitting region (DM1), and
When the eye position is in the second position (Z2) closer to the projected portion than the first position (Z1), the light emitting area (DM) is wider than the first light emitting area (DM1). Setting in the second light emitting area (DM2) and executing the light emitting area changing process including.
Display control device (30). The information capable of estimating the eye position includes information regarding the position of the driver's seat in the front-rear direction.
The light emitting area changing process is based on the position of the driver's seat in the front-rear direction.
When it is estimated that the eye position of the observer in the anteroposterior direction is in the first position (Z1), it is set in the first light emitting region (DM1).
When it is estimated that the eye position is in the second position (Z2) closer to the projected portion than in the first position (Z1), it is set in the second light emitting region (DM2). including,
The display control device (30) according to claim 1. The processor (33)
The second light emitting region (DM2) is directed from the first light emitting region (DM1) along the vertical direction of the light modulation element (51) corresponding to the vertical direction of the virtual image and in the horizontal direction of the virtual image. At least wide in the direction along the lateral direction of the light modulation element (51) corresponding to the above.
The display control device (30) according to claim 1 or 2. The processor (33)
The average light intensity in the second light emitting region (DM2) is set to be lower than the average light intensity in the first light emitting region (DM1).
The display control device (30) according to any one of claims 1 to 3. The processor (33)
The information regarding the right eye position and the left eye position of the observer in the eye box (200), or the information capable of estimating the right eye position and the left eye position is acquired, and the information is acquired.
The light emitting region (DM) is
The right eye light emitting region (DMR), which is set according to the partial viewing area (E) in which the right eye position is arranged,
Includes a left eye light emitting region (DML), which is set according to the partial viewing area (E) where the left eye position is located.
The display control device (30) according to any one of claims 1 to 4. The processor (33)
The emission pattern in the right eye emission region (DMR) and the emission pattern in the left eye emission region (DML) are time-division-switched.
The display control device (30) according to claim 5. The processor (33)
The light emitting region (DM) is a partial region (D) (hereinafter, main partial region (DA)) for emitting the illumination light for directing the peak of the light intensity of the display light to the eye position, and the eye. It is set to include a partial region (D) (hereinafter, sub-subregion (DB)) that emits the illumination light for directing the peak of the light intensity of the display light to the periphery of the position.
The emission intensity of the sub-regional region (DB) is made higher than 0.7 times the emission intensity of the main partial region (DA).
The display control device (30) according to any one of claims 1 to 6. The processor (33)
The light emitting region (DM) is a partial region (D) (hereinafter, main partial region (DA)) for emitting the illumination light for directing the peak of the light intensity of the display light to the eye position, and the eye. It is set to include a partial region (D) (hereinafter, sub-subregion (DB)) that emits the illumination light for directing the peak of the light intensity of the display light to the periphery of the position.
The emission intensity of the sub-regional region (DB) is made higher than the emission intensity of the main partial region (DA).
The display control device (30) according to any one of claims 1 to 7. In the head-up display device (20) in which the observer visually recognizes a virtual image from within the range of the eye box (200) by projecting the display light onto the projected portion.
A light source element (60, 60A) having a plurality of partial regions (D) and capable of selectively emitting illumination light for each of the partial regions (D).
A light modulation element (51) that modulates the illumination light incident from the light source element (60, 60A) and emits it as display light.
Condensing optics in which the illumination light emitted from the different partial regions (D) is focused toward different regions in the eyebox (200) for each display light modulated by the light modulation element (51). System (2,40,77,77A) and
A processor (33) for controlling the light source element (60, 60A) is provided.
The processor (33)
Information on the eye position in the anteroposterior direction of the observer facing the projected portion or information capable of estimating the eye position in the anteroposterior direction of the observer is acquired from the eye box (200).
When the observer's eye position in the front-rear direction is at the first position (Z1), it is referred to as a partial region (D) (hereinafter referred to as a light emitting region (DM)) that emits the illumination light having a predetermined light intensity or higher. ) Is set in the first light emitting region (DM1), and
When the eye position is in the second position (Z2) closer to the projected portion than the first position (Z1), the light emitting area (DM) is wider than the first light emitting area (DM1). Setting in the second light emitting area (DM2) and executing the light emitting area changing process including.
Head-up display device (20). A light source element (60, 60A) having a plurality of partial regions (D) and capable of selectively emitting illumination light for each of the partial regions (D).
A light modulation element (51) that modulates the illumination light incident from the light source element (60, 60A) and emits it as display light.
Condensing optics in which the illumination light emitted from the different partial regions (D) is focused toward different regions in the eyebox (200) for each display light modulated by the light modulation element (51). System (2,40,77,77A) and
In the display control method of the head-up display device (20), in which the observer visually recognizes a virtual image from within the range of the eye box by projecting the display light onto the projected portion.
Obtaining information on the eye position in the anteroposterior direction of the observer facing the projected portion from the eye box (200), or information capable of estimating the eye position in the anteroposterior direction of the observer.
When the observer's eye position in the front-rear direction is at the first position (Z1), it is referred to as a partial region (D) (hereinafter referred to as a light emitting region (DM)) that emits the illumination light having a predetermined light intensity or higher. ) Is set in the first light emitting region (DM1).
When the eye position is in the second position (Z2) closer to the projected portion than the first position (Z1), the light emitting area (DM) is wider than the first light emitting area (DM1). Performing a light emitting area changing process, including setting in a second light emitting area (DM2),
Display control method.

Images