JP2022171105A - Display control device, head-up display device, and display control method - Google Patents

Abstract

To reduce situations in which display light is not directed to actual eye positions, while improving light use efficiency.SOLUTION: A processor can at least set a part region D (thereafter, called a light emitting region DM) emitting illumination light equal to or more than prescribed light intensity of a light source element 60 (60A) in a first light emitting region DM1, and a second light emitting region DM2 wider than the first light emitting region DM1 on the basis of at least information on eye positions of an observer, or information enabling an estimation of the eye positions. When a head-up display device 20 starts up, the processor implements start-up light-emitting processing of setting the light emitting region DM in the second light emitting region DM2, and thereafter, implements reduction processing of reducing the light emitting region DM to the first light emitting region DM1.SELECTED DRAWING: Figure 9

Description

The present disclosure relates to a display control device for a head-up display device that is used in a vehicle and that superimposes an image on the foreground of the vehicle for visual recognition, a head-up display device, a display control method, and the like.

In Japanese Patent Laid-Open No. 2004-100003, the display is directed toward the entire area called an eyebox, which includes most or all of the eyelips where the eye positions of occupants (observers) of various physiques sitting in the driver's seat of a vehicle are assumed to exist. Head-up display devices are described that are optically designed to distribute light. According to this, the occupant (observer) visually recognizes an image (virtual image) displayed by the head-up display device in a desired display mode (for example, within a desired luminance range) if the eye position is within the eye box. be able to.

JP 2012-203176 A

Since the head-up display device of Patent Literature 1 directs the display light to the entire eyebox, the display light directed to other areas of the eyebox where the observer's eyes do not exist is wasted. In other words, the utilization efficiency of the display light emitted by the head-up display device (here, the utilization efficiency of the display light (also referred to as the light utilization efficiency) is the ratio of the display light visually recognized by the observer to the emitted display light. ) becomes low. From another point of view, there is also a problem of high power consumption.

The present applicant has devised a head-up display device that detects the eye position of the observer, directs the display light to the eye position, and reduces the display light directed to other than the eye position (for details, see Japanese Patent Application No. 2020-165113. technology is unknown.). Such a head-up display device needs to detect the eye position of the observer, and when the vehicle starts the activation operation, the activation operation of the head-up display device, the display control device, the eye position detection unit, etc. is not completed. , the eye position cannot be detected (the eye position cannot be detected with high accuracy), so there is a problem that the display cannot be started (in other words, the display starts after the vehicle (head-up display device) starts the activation operation). (There was room for improvement in terms of the time required for In addition, it is difficult to stabilize the display control operation and eye position detection accuracy during the startup operation of the head-up display device, the display control device, the eye position detection unit, etc., or immediately after the startup operation is completed. There is a possibility that the display light may not be directed normally to a certain position.

A summary of certain embodiments disclosed herein follows. It should be understood that these aspects are presented only to provide the reader with an overview of these particular embodiments and are not intended to limit the scope of this disclosure. Indeed, the present disclosure may encompass various aspects not described below.

Summary of the present disclosure relates to improving light utilization efficiency. The summary of the present disclosure also relates to reducing the time required to start display while improving light utilization efficiency. The summary of the present disclosure also relates to improving the light utilization efficiency while reducing the situation where the display light is not directed to the actual eye position.

Therefore, the display control device, the head-up display device, and the display control method described in this specification employ the following means in order to solve the above problems. In this embodiment, when the HUD device or the eye position detection unit is in a state of starting operation, the area of the planar illumination unit that illuminates the light modulation element emits illumination light having a predetermined light intensity or more. is made relatively wide and then narrowed.

In the display control device according to the first aspect described in this specification, the light source element has a plurality of partial areas, each partial area can emit illumination light, and the illumination light incident from the light source element is modulated. From a light modulation element that emits display light, and a condensing optical system that collects the illumination light emitted from different partial areas and modulated by the light modulation element toward a different area in the eyebox for each display light. In a display control device configured at least to control a head-up display device in which a viewer views a virtual image from within the range of an eyebox by projecting display light onto a projection target portion, information about the viewer's eye position ( (hereinafter referred to as eye position information) or information that can estimate the eye position (hereinafter referred to as eye position estimation information), and controls the light source element based at least on the eye position information or the eye position estimation information. a processor that emits illumination light having a predetermined light intensity or higher (hereinafter referred to as a light emitting region) in a first light emitting region and a second light emitting region that is wider than the first light emitting region; The light emitting area can be set at least to the light emitting area, and when the head-up display device is activated, the light emitting area is set to the second light emitting area, and then the light emitting area is set to the first light emitting area. Executes a shrinking process that shrinks to .

FIG. 1 is a diagram illustrating an application of a vehicle display system to a vehicle, according to some embodiments. FIG. 2 is a diagram illustrating a configuration of a head-up display device, according to some embodiments. FIG. 3 is a diagram illustrating optical paths in a head-up display device, according to some embodiments. FIG. 4A shows a mode of partial viewing zones in which the eyebox is virtually partitioned and a mode in which display light is directed to a plurality of partial viewing zones corresponding to the eye position of the observer, according to some embodiments. It is a figure explaining. FIG. 4B schematically illustrates the relationship between partial viewing areas of the eyebox and positions at which display light based on illumination light emitted from each partial area of the directional light source unit is collected, according to some embodiments; It is a schematic diagram. FIG. 4C is a diagram showing how an illumination laser beam is applied to the light-emitting region of the light diffusing optical system to direct the display light to the spot lighting area of FIG. 4A. FIG. 5A is a diagram illustrating an example distribution of the amount of light (brightness) when display light is distributed in a spot lighting area, according to some embodiments. FIG. 5B is a diagram showing how the eye position has moved after the state of FIG. 5A. FIG. 5C is a diagram showing how the spot lighting area is switched from that corresponding to the previous partial viewing zone to that corresponding to the new partial viewing zone E after the state of FIG. 5B. FIG. 6 is a block diagram of a vehicle display system, according to some embodiments. FIG. 7A is a flow diagram illustrating a method of performing operations to set a spot lighting area (where display light is distributed) based on observer eye position, according to some embodiments. FIG. 7B is a flow diagram illustrating a portion of FIG. 7A in more detail. FIG. 7C is a flow diagram illustrating a portion of FIG. 7A in more detail. FIG. 7D is a flow diagram illustrating a portion of FIG. 7A in greater detail. FIG. 8A shows a mode of partial viewing zones in which the inside of the eyebox is virtually divided and a mode in which display light is directed to a plurality of partial viewing zones corresponding to the eye position of the observer, according to some embodiments. It is a figure explaining. FIG. 8B schematically illustrates the relationship between partial viewing areas of the eyebox and positions at which display light based on illumination light emitted from each partial area of the directional light source unit is collected, according to some embodiments; It is a schematic diagram. FIG. 9 is a diagram showing one mode of the first light emitting region and the second light emitting region DM2 in the planar illumination section. FIG. 10 is a diagram illustrating optical paths in a head-up display device, according to some embodiments. 11 is a diagram showing one mode of the light source array shown in FIG. 10. FIG. FIG. 12A is a diagram showing one aspect of the light emission pattern of the light source array. FIG. 12B is a diagram showing one aspect of the light emission pattern of the light source array. FIG. 13A is a variation of the relationship between partial viewing areas of the eyebox and positions where display light based on illumination light emitted from each partial area of the directional light source unit is collected, according to some embodiments; FIG. 4 is an illustrative diagram; FIG. 13B is a variation of the relationship between partial viewing areas of the eyebox and positions where display light based on illumination light emitted from each partial area of the directional light source unit is collected, according to some embodiments; FIG. 4 is an illustrative diagram; FIG. 13C is a variation of the relationship between partial viewing areas of the eyebox and positions where display light based on illumination light emitted from each partial area of the directional light source unit is collected, according to some embodiments; FIG. 4 is an illustrative diagram; FIG. 13D is a variation of the relationship between partial viewing areas of the eyebox and positions where display light based on illumination light emitted from each partial area of the directional light source unit is collected, according to some embodiments; FIG. 4 is an illustrative diagram; FIG. 14 is a diagram showing one mode of the first light emitting region (and the second light emitting region) in the planar lighting unit before and after the spot area reduction process.

1-14 provide a description of the configuration and operation of an exemplary vehicular display system, heads-up display device, and display control device. In addition, the present invention is not limited by the following embodiments (including the contents of the drawings). Of course, modifications (including deletion of constituent elements) can be added to the following embodiments. In addition, in the following description, descriptions of known technical matters are omitted as appropriate in order to facilitate understanding of the present invention.

A vehicle display system 10 shown in FIG. 1 is mounted on a vehicle 1 and includes a head-up display device (hereinafter also referred to as a HUD device) 20, a display control device 30 for controlling the HUD device 20, and a non-specular reflection device to be described later. It includes an element 3 (which can be omitted) and is composed of a projection target portion 2 that receives display light K from the HUD device 20 and an eye position detection portion 411 that detects the eye position 700 of the observer. The HUD device 20 is placed in front of an observer (typically, a driver sitting in the driver's seat of the vehicle 1) (the front can also be referred to as the forward direction, which can also be called the traveling direction of the vehicle). The display light K is projected toward a shield (an example of the projected portion 2).

The non-regular reflection element 3 can be composed of, for example, a holographic element or a diffractive optical element (DOE). A holographic element is an optical member made of, for example, a hologram material such as a photopolymer or dichromated gelatin, which diffracts incident light in a desired direction, and records an interference pattern between an object beam and a reference beam. created by The non-regular reflection element 3 is, for example, a sheet-shaped element, is included in the projection target portion 2 , and diffracts the display light K projected by the HUD device 20 toward the eyebox 200 , which is a predetermined area inside the vehicle 1 . For example, the later-described non-regular reflection element 3 diffracts the display light K received from the HUD device 20, thereby increasing the size of the image (virtual image) visually recognized by the observer. By arranging the eye 700 in the eye box 200 , the observer can visually recognize the virtual image V of the display image (not shown) displayed by the HUD device 20 on the far side from the projection target section 2 . Incidentally, as described above, the non-regular reflection element 3 may be omitted. That is, the vehicular display system 10 does not allow non-specularly reflected light from the projection target portion 2 (non-regular reflection element 3) to be visually recognized, but is a direct reflection light from the projection target portion 2 (not including the non-regular reflection element 3). The reflected light may be visually recognized.

The term “eyebox” used in the description of the present embodiment refers to (1) an area in which the entire virtual image V of the image is visible, and at least a portion of the virtual image V of the image is not visible outside the area; At least part of the virtual image V of the image is visible, and outside the area, no part of the virtual image V of the image is visible. In the area where at least part of the virtual image V of the image is less than the predetermined brightness, in the area (4) at least part of the virtual image V of the image is visible at a predetermined brightness or more in the area, and outside the area the virtual image V of the image is visible. (5) when the HUD device 20 can display a stereoscopically visible virtual image V, at least part of the virtual image V can be stereoscopically viewed; is also a non-stereoscopic region. That is, when the observer places the eyes (both eyes) outside the eyebox 200, the observer cannot see the entire virtual image V of the image, or the visibility of the entire virtual image V of the image is very low and is difficult to perceive, or The virtual image V of the image cannot be viewed stereoscopically. The predetermined brightness is, for example, about 1/50 of the brightness of the virtual image of the image viewed at the center of the eyebox. The “eye box” is the same as the area (also called the eyelip) where the viewer's viewpoint position is assumed to be arranged in the vehicle in which the HUD device 20 is mounted, or a large portion (for example, 80% or more) of the eyelip. is set to include

The virtual image display area VS is a planar, curved, or partially curved area on which an image generated inside the HUD device 20 is formed as a virtual image V, and is also called an imaging plane. The virtual image display area VS is a position where a display surface (e.g., an exit surface of a liquid crystal light modulation element) 52 of a display device 50 (described later) of the HUD device 20 is formed as a virtual image. It corresponds to the display surface 52 of the device 20, which will be described later (in other words, the virtual image display area VS has a conjugate relationship with the display surface 52 of the display device 50, which will be described later). It can be said that the virtual image V visually recognized in the virtual image display area VS corresponds to the image displayed on the display surface 52 of the HUD device 20, which will be described later. It is preferable that the virtual image display area VS itself has low visibility to the extent that it is not actually visible to the observer's eyes, or is difficult to be visually recognized.

In the virtual image display area VS, an angle (tilt angle θt in FIG. 1) formed between the lateral direction (X-axis direction) of the vehicle 1 and the horizontal direction (XZ plane), the center 205 of the eyebox 200, and the virtual image display area VS are displayed. The vertical angle of view of the virtual image display area VS is defined as the angle between the line segment connecting the upper end VS1 of the area VS and the line segment connecting the eyebox center 205 and the lower end VS2 of the virtual image display area VS. An angle (vertical arrangement angle θv in FIG. 1) formed by the equisecting line and the horizontal direction (XZ plane) is set. The vertical arrangement angle θv is typically set downward from the horizontal direction (XZ plane), and is, for example, +2 [degree] (here, the positive direction of the vertical arrangement angle θv is two times the vertical angle of view). The bisector is the depression angle downward from the center 205 of the eyebox 200, and the negative direction of the vertical arrangement angle θv is the elevation angle where the bisector of the vertical angle of view is upward from the center 205 of the eyebox 200. can be said to be.).

In addition, the virtual image display area VS of the present embodiment has a tilt angle θt of approximately 90 [degrees] so that the virtual image display area VS faces approximately forward (positive direction of the Z axis). However, the tilt angle θt is not limited to this, and can be set within a range of 40≦θt<90 [degree]. In this case, for example, the tilt angle θt may be set to 60 [degrees], and the virtual image display area VS may be arranged so that the upper area is farther from the lower area as viewed from the observer.

FIG. 2 is a diagram showing the configuration of the HUD device 20 of this embodiment. The HUD device 20 contains a display 50 having a display surface 52 for displaying an image, a relay optical system (condensing optical system) 40, and the display 50 and the relay optical system 40. The display light from the display 50 is It has a housing 22 having a light exit window 21 through which K can be emitted from the inside to the outside. Note that the display device 50 of this embodiment, which will be described later, is a 2D display device, but may be a 3D display device. That is, the HUD device 20 displays parallax images corresponding to the eye points (left and right eyes) arranged in the eye box 200, thereby making the observer perceive a virtual image of a stereoscopic image based on the virtual image display area VS. may Note that the 3D display may not be a binocular parallax 3D display, and may be, for example, a light field display. Also, part of the relay optical system 40 may be omitted.

The display 50 in FIG. 2 is composed of an optical modulation element 51 and a directional light source unit 60 . The display surface 52 is the viewer-side surface of the light modulation element 51 and emits display light K for an image. By setting the angle of the display surface 52 with respect to the optical axis Kp of the display light K that travels from the center of the display surface 52 to the eyebox 200 (the center 205 of the eyebox 200) via the relay optical system 40 and the projection target unit 2, a virtual image is formed. The angle of the display area VS (including the tilt angle θt) can be set. Further, the directional light source unit 60, which will be described later, changes the direction of the illumination light, thereby changing the position where the virtual image V can be visually recognized (easily visually recognized) within the eyebox 200. FIG.

The relay optical system 40 is arranged on the optical path of the display light K emitted from the display 50 (the light directed from the display 50 to the eyebox 200 ). consists of one or more optical elements that project onto the front windshield 2 of the The relay optical system 40 of FIG. 2 includes one concave first mirror 41 and one planar second mirror 42 .

The first mirror 41 has, for example, a free-form surface shape with positive optical power. In other words, the first mirror 41 may have a curved shape with different optical power for each region. can be different. Specifically, the first display light K1, the second display light K2, and the third display light K3 (see FIG. 2) traveling from each region of the display surface 52 toward the eyebox 200 are added by the relay optical system 40. The optical power may be different.

The second mirror 42 is, for example, a plane mirror, but is not limited to this, and may be a curved surface having optical power. That is, the relay optical system 40 is added according to the area (optical path) through which the display light K passes by synthesizing a plurality of mirrors (for example, the first mirror 41 and the second mirror 42 of this embodiment). Different optical powers may be used. Note that the second mirror 42 may be omitted. That is, the display light K emitted from the display device 50 may be reflected by the first mirror 41 to the projection target portion (front windshield) 2 .

Also, in the present embodiment, the relay optical system 40 includes two mirrors, but is not limited to this, and includes one or more refractive optical members such as lenses, diffractive optical members such as holograms, etc. It may additionally or alternatively include members, reflective optical members, or combinations thereof.

In addition, the relay optical system 40 of the present embodiment has a function of setting the distance to the virtual image display area VS and a virtual image obtained by enlarging the image displayed on the display surface 52 with this curved surface shape (an example of optical power). In addition to this, it may have a function of suppressing (correcting) the distortion of the virtual image that may occur due to the curved shape of the front windshield 2 .

Also, the relay optical system 40 may be rotatable (and/or movable) with one or more actuators (not shown) controlled by the display control device 30 attached.

The light modulation element 51 is, for example, an LCD, which is a transmissive display panel, receives illumination light from the directional light source unit 60, and directs the spatially modulated display light K to the relay optical system 40 (second mirror 42). to emit. The short side of the light modulation element 51 is, for example, the direction in which pixels are arranged corresponding to the vertical direction (Y-axis direction) of the virtual image V seen by the observer, and the direction of the virtual image V seen by the observer is perpendicular to the short side. It has a rectangular shape (typically) whose long side is the direction in which the pixels corresponding to the left-right direction (X-axis direction) are arranged. An observer visually recognizes transmitted light of the light modulation element 51 (reflected light, diffracted light, etc. may be considered depending on the type of the light modulation element 51 ) through the virtual image optical system 90 . The virtual image optical system 90 is a combination of the relay optical system 40 shown in FIG. 2 and the front windshield 2 (the non-regular reflection element 3 included therein). The light modulation element 51 (display device 50) may be a reflective display panel using LCoS or DMD.

(First embodiment)
Please refer to FIG. FIG. 3 is a diagram showing an example of the main configuration of the HUD device 20 (the directional light source unit 60 of the first embodiment) having a function of performing viewpoint-tracking spot lighting control. In the HUD device 20 (directional light source unit 60) illustrated in FIG. n (25 in this embodiment) partial viewing zones E (E (1, 1) to E (5 , 5)). The HUD device 20 (directional light source unit 60) varies the light emission pattern (spot lighting area SP described later) for each partial viewing area E in which the driver's (user's) eye position is detected. ) is performed to locally direct the display light K toward the partial viewing area E in which the eye position of ) is detected.

The display control device 30, which will be described later, detects the eye position of the observer from the eye position detection unit 411, which will be described later, and directs the viewer so that a bright image (virtual image V) is visible only at the eye position of the observer and its surroundings. control the optical light source unit 60; These will be detailed later.

A directional light source unit (light source element) 60 of the first embodiment includes a light source 70, a scanning device (scanner) 75, a first field lens (illumination optical system) 76, and a second field lens (illumination optical system) 77. , and a light diffusion optical system 80 . The scanning device 75 scans the laser light emitted from the light source 70 into m (m>n) partial regions D (the partial regions D in this embodiment are D(1,11) to D 121 up to (11, 11).) can be scanned above, and the display control device 30 detects the eye position detected by the eye position detection unit 411. The image (virtual image V) is made visible to the observer by controlling the light source 70 so as to irradiate the DM) with strong laser light. The light-emitting region DM is a partial region D from which illumination light having a predetermined light intensity is emitted toward the light modulation element 51 .

The light source 70 is, for example, a plurality of laser diodes capable of emitting three different colors (e.g., R, G, and B), respectively. laser beam 74 toward scanning device 75 . The light source 70 can adjust the intensity of the illumination laser beam 74 (including extinguishing) under the control of the display control device 30, which will be described later. More specifically, the light source 70 can time-divisionally adjust the intensity of the illumination laser beam 74 in accordance with the scanning position of the scanning device 75, which will be described later, under the control of the display control device 30, which will be described later. Yes (including lights off).

A scanning device (scanner) 75 is an element that two-dimensionally deflects the illumination laser beam 74 emitted from the light source 70. For example, a polygon mirror, a galvanometer mirror, or a MEMS (Micro Electro Mechanical System) technology is used. an optical scanning device such as a MEMS mirror device). The scanning device 75 is a minute mirror configured to be oscillated using two mutually orthogonal axes. The scanning device 75 scans, for example, at high speed in the main scanning direction and at low speed in the sub-scanning direction perpendicular to the main scanning direction.

The first field lens 76 is arranged on the optical path of the illumination laser beam 74 scanned by the scanning device 75 between the scanning device 75 and the light diffusing optical system 80 . The first field lens 76 has the function of collimating the received illumination laser beam 74 in a direction parallel to the optical axis of the first field lens 76 . Note that the first field lens 76 is not an essential component and may be omitted. However, by providing the first field lens 76, the display light K obtained by modulating the illumination laser beam 74 emitted from each light emitting region DM of the light diffusing optical system 80 is distributed to each partial viewing region E of the eyebox 200. can be directed with high precision. It should be noted that although the first field lens 76 is a refractive optic, there may additionally or alternatively be one or A plurality of other refractive optical systems, reflective optical systems, and diffractive optical systems may be provided.

A second field lens (collecting optical system) 77 is arranged on the optical path of the illumination laser beam 74 diffused by each partial region D (light emitting region DM) between the light diffusion optical system 80 and the light modulation element 51. and functions as a condensing optical system for condensing illumination light emitted from different (light-emitting regions DM) toward different regions within the eyebox 200 for each display light K modulated by the light modulation element 51. . The second field lens 77 of this embodiment is composed of one or more field lenses, and the illumination laser beam 74 diffused by each partial region D (light emitting region DM) of the light diffusion optical system 80 is optically modulated. It is a front-stage optical member (backlight optical member) designed to transmit and illuminate the entire surface of the element 51 . The second field lens 77 passes the display light K emitted from the light modulation element 51 into the eyebox 200 via the virtual image optical system 90 (HUD optical member composed of the relay optical system 40 and the front windshield 2). is designed to reach a partial viewing zone E at any position of The condensing optical system converges illumination light emitted from different partial regions D (light emitting regions DM) toward different partial viewing regions E within the eyebox 200 for each display light K modulated by the light modulation element 51. , instead of (or in addition to) the field lens, various optical systems such as one or more refractive optical systems, reflective optical systems, and diffractive optical systems may be included. Note that the display light K passes through the relay optical system 40 and the projection target section 2 before reaching the eyebox 200 from the light modulation element 51 . At this time, the display light K is deflected to some extent by the relay optical system 40 and the projection target section 2 and then condensed toward different regions within the eyebox 200 . Therefore, in a broad sense, the condensing optical system can be said to include the relay optical system 40 and the projection target section 2 in addition to the second field lens (condensing optical system) 77 . Also, the condensing optical system may be configured by the relay optical system 40 and the projection target section 2 without the second field lens (condensing optical system) 77 .

A diffusion plate 78 is arranged on the optical path of the illumination laser beam 74 between the light modulation element 51 and the second field lens 77 . The diffuser plate 78 diffuses the received illumination laser beam 74 and emits it to the light modulation element 51 . As a result, it is possible to reduce luminance unevenness in the display light K generated by the illumination laser beam 74 emitted from the light emitting area DM that is visually recognized in each partial viewing area E of the eyebox 200 . The diffuser plate 78 may be any optical member that has a function of diffusing light, and its surface is composed of, for example, a bead member, a fine concave-convex structure, or a rough surface. Also, a dot sheet or a transparent milky white sheet may be used.

First, an example using a lens array 81 as the light diffusion optical system 80 will be described. The lens array 81 of this embodiment is divided into m partial regions D, and each partial region D is formed with a minute lens having a curvature. When the illumination laser beam 74 is incident on each partial area D, the illumination laser beam 74 refracted by the microlenses is emitted as diffused light. More specifically, an illumination laser beam 74 incident on any one of m partial regions D of the lens array 81 (light diffusion optical system 80) from the light source 70 is refracted by the microlens to form a second field After passing through the lens 77 and the diffusion plate 78, the entire surface of the light modulation element 51 (here, the "whole surface" means the entire area capable of displaying an image and a partial area used for displaying an image ( After the display light K that has been irradiated and light-modulated (including the entire surface of the use area) passes through the virtual image optical system 90, a predetermined area of the eyebox 200 that includes at least a partial area D where the eye position 700 exists. be irradiated.

Next, an example using a hologram recording medium 82 as the light diffusion optical system 80 will be described. The hologram recording medium 82 of this embodiment is divided into m partial regions D, and each partial region D has an interference fringe. When the illumination laser beam 74 is incident on each partial region D, the illumination laser beam 74 diffracted by the interference fringes is emitted as diffused light. More specifically, an illumination laser beam 74 incident on any one of m partial regions D of the hologram recording medium 82 (light diffusion optical system 80) from the light source 70 is diffracted by interference fringes to form a second After passing through the field lens 77 and the diffusion plate 78, the display light K irradiated onto the entire surface of the light modulation element 51 and light-modulated passes through the virtual image optical system 90, and then passes through the eye box corresponding to the predetermined partial region D. 200 predetermined areas are irradiated. Note that the light diffusion optical system 80 may be a Fresnel lens.

FIG. 4C is a diagram showing how the scanning device (scanner) 75 scans the light diffusion optical system 80 . In FIG. 4C, the first field lens 76 is omitted. The light diffusion optical system 80 has a third direction (α-axis) corresponding to the first direction (X-axis) in which the partial viewing area E of the eyebox 200 is aligned in the horizontal direction, and the partial viewing area E in the vertical direction. and a fourth direction (β-axis) corresponding to the second direction (Y-axis). The scanning device 75 performs sub-scanning along the fourth direction (β-axis) while performing main scanning along the third direction (α-axis). In the example of FIG. 4C , the scanning device 75 passes through different partial regions D in the outward and return passes of main scanning, and is controlled by the display control device 30 to irradiate a predetermined partial region D with the illumination laser beam 74 . It's becoming Specifically, the scanning device 75 scans from partial areas D(11, 1) to D(1, 1) at high speed as a forward pass, while scanning a predetermined partial area D (light emitting area DM) selected by the display control device 30. ) is irradiated with the illumination laser beam 74, and the partial region D not selected by the display control device 30 is not irradiated with the illumination laser beam 74. Thereafter, the partial regions D(1, 2) to D(11 , and 2), a predetermined partial region D (light emitting region DM) selected by the display control device 30 is irradiated with the illumination laser beam 74 . However, the manner in which the scanning device (scanner) 75 scans the light diffusion optical system 80 is not limited to this.

Another example scanning device 75 may be illuminated by the illumination laser beam 74 only on the forward pass (alternatively, only on the return pass). Specifically, the scanning device 75 scans from partial areas D(11, 1) to D(1, 1) as a forward pass, and scans the predetermined partial area D (light emitting area DM) selected by the display control device 30. After irradiating the illumination laser beam 74, scanning is performed up to the partial area D(11,2) without irradiating the illumination laser beam 74, and the forward path is again performed from the partial area D(11,2) to D(2, 2), the illumination laser beam 74 may be irradiated to a predetermined partial area D (light emitting area DM) selected by the display control device 30 while scanning.

The scanning device 75 of another example may irradiate the same partial region D with the illumination laser beam 74 in the forward pass and the return pass. to D(1,1) while irradiating a predetermined partial area D (light emitting area DM) selected by the display control device 30 with the illumination laser beam 74, and then the partial area D(1,1 ) to D(11, 1), the illumination laser beam 74 is applied to a predetermined partial area D (light emitting area DM) selected by the display control device 30 . Note that the position within the partial region D irradiated with the illumination laser beam 74 differs between the outward path and the return path. That is, the illumination laser beam 74 irradiates the upper side (the negative direction of β) of the predetermined partial region D on the forward pass, and the lower side of the predetermined partial region D (the positive direction of β) on the return pass. position may be irradiated.

FIG. 4A is a diagram for explaining a mode of partial viewing zones in which the inside of the eyebox is virtually divided, and a mode in which display light is directed to a plurality of partial viewing zones corresponding to the positions of the eyes of the observer. Here, it is assumed that the right eye 700R of the observer is detected in the partial viewing area E(2,3) and the left eye 700L is detected in the partial viewing area E(4,3). The partial viewing area E (hereinafter also referred to as the right-eye spot lighting area SPR) to which the right-eye display light K is directed is centered on the partial viewing area E(2,3) and extends above the partial viewing area E(2,3). 2), the lower part of the lower partial viewing zone E(2,4), the right part of the right partial viewing zone E(1,3), the left part of the left partial viewing zone E(3,3), The upper left part of the upper left partial viewing area E(3,2), the lower left part of the lower left partial viewing area E(3,4), the lower right part of the lower right partial viewing area E(1,4), and the upper right part It is a horizontally long elliptical area that spans nine partial viewing zones E in the upper right portion of the viewing zone E(1,2). Similarly, the partial viewing area E to which the left-eye display light K is directed (hereinafter also referred to as the left-eye spot lighting area SPL) is an upper partial viewing area centered on the partial viewing area E (4, 3). Upper part of area E(4,2), lower part of lower partial viewing area E(4,4), right part of right partial viewing area E(3,3), left partial viewing area E(5,3) ), the upper left part of the upper left partial viewing area E(5,2), the lower left part of the lower left partial viewing area E(5,4), the lower right part of the lower right partial viewing area E(3,4). , and nine partial viewing zones E in the upper right part of the upper right partial viewing zone E44(3,2).

FIG. 4B schematically shows the relationship between the aspect of the partial viewing area E of the eyebox 200 and the position where the display light K based on the illumination light emitted from each partial area D of the directional light source unit 60 is collected. FIG. 10 shows. In addition, in FIG. 4B, the position where the display light K based on the illumination light emitted from each partial region D is condensed is drawn by a point (hollow circle). It shows the position to which the principal ray of the display light K based on the illumination light is directed, and the display light K is also irradiated around the point (hollow circle) as the center. In the example of FIG. 4B, the directional light source unit 60 arranges the partial areas D so that nine different locations within one partial viewing area E can be illuminated. Specifically, there are one point at the center of the partial viewing area E, four points at the four corners of the partial viewing area E, and four points at the midpoints of the four corners of the partial viewing area E, for a total of nine points. In one aspect shown in FIG. 4B, the display control device 30 controls the directional light source unit 60 so that the display light K is emitted to all nine different locations within the partial viewing area E where the eye position 700 exists. The light emitting area DM includes a main partial area DA that emits illumination light that is the source of the display light K condensed at the center of the partial viewing area E where the eye position 700 exists, and the eye position 700 exists in the main partial area DA. and a sub-partial area DB that emits illumination light that is the source of the display light K that is condensed at a position away from the center of the partial viewing area E. That is, when the left eye position 700L exists in the partial viewing area E(4,3), the main partial area DA is the partial area D(8,6), and the secondary partial area DB is the partial area D(7,5). ), D(8,5), D(9,5), D(7,6), D(9,6), D(7,7), D(8,7), and D(9,7 ). On the other hand, when the right eye position 700R exists in the partial viewing area E(2,3), the main partial area DA is the partial area D(4,6), and the secondary partial area DB is the partial area D(3,5). ), D(4,5), D(5,5), D(3,6), D(5,6), D(3,7), D(4,7), and D(5,7 ).

FIG. 4C is a diagram showing how the illumination laser beam 74 is applied to the light emitting region DM of the light diffusion optical system 80 in order to direct the display light K to the spot lighting area SP of FIG. 4A. The display control device 30 drives the light source 70 in synchronization with the timing at which the scanning device 75 scans the light-emitting regions DM from which illumination light of a predetermined light intensity is emitted out of the m partial regions D. FIG. As a result, as shown in FIG. 4A, light modulation is performed in the above-described spot lighting areas SP (right eye spot lighting area SPR, left eye spot lighting area SPL) of the eye box 200 corresponding to the light emitting areas DM of the light diffusing optical system 80. The display light K of element 51 is directed. The light emitting region DM corresponding to the right eye spot lighting area SPR is called a right eye light emitting region DMR, and the light emitting region DM corresponding to the left eye spot lighting area SPL is called a left eye light emitting region DML. Therefore, the display light K obtained by modulating the illumination light emitted from the right-eye light-emitting region DMR by the light modulation element 51 is applied to the right-eye spot lighting area SPR, and the illumination light emitted from the left-eye light-emitting region DML is The display light K modulated by the light modulation element 51 is applied to the left-eye spot lighting area SPL. In addition, the display control device 30 does not irradiate the illumination laser beam 74 or irradiates the illumination laser beam 74 with a very low light intensity to the partial area D other than the right-eye light-emitting area DMR and the left-eye light-emitting area DML. do. This makes it possible to efficiently irradiate the viewing area E where the observer's eye positions are present with the display light K, thereby reducing power consumption.

FIG. 5A is a diagram showing an example of the light amount (luminance) distribution when the display light K is distributed in the spot lighting area SP. When the eye position 700 is estimated to be in the partial viewing area E(2,3), the display control device 30 sets the spot lighting area SP to the predetermined spot lighting area SP associated with the partial viewing area E(2,3). Furthermore, the light emitting area DM of the light diffusion optical system 80 (partial areas D(3,5), D(4,5), D(5,5), D(3,6), D(4,6), D (5,6), D(3,7), D(4,7), D(5,7)), the scanning device 75 scans the light emitting area DM so that the illumination laser beam 74 is irradiated. The light source 70 is driven according to the timing. Thereby, as shown in FIG. 4A, the display light K of the light modulation element 51 is directed to the predetermined spot lighting area SP of the eyebox 200 corresponding to the light emitting area DM of the light diffusing optical system 80 . Ld1 (Ld) in FIG. 5A indicates the light amount distribution in the left-right direction (X-axis direction) of the eyebox 200 (the same applies to FIGS. 5B and 5C described later). The light amount distribution Ld1 corresponds to the light emitting region DM (partial regions D(3,5), D(4,5), D(5,5), D(3,6), D(4,6), D(5, 6), D (3, 7), D (4, 7), and D (5, 7) are combined display light based on the illumination light emitted from D (5, 7), and the boundary of the spot lighting area SP , a light quantity equal to or greater than a predetermined threshold value Lth (for example, 50% of the maximum light quantity (luminance) in the spot lighting area SP) is ensured. The amount of light protrudes and spreads outside the boundary of the area SP, and the intensity of the light does not drop sharply, but gradually (with a gradient). The virtual image) fades and disappears, and does not suddenly disappear, thereby suppressing (reducing) discomfort and anxiety.

In this embodiment, there is a sub-partial area DB that emits the illumination light that is the source of the display light K condensed at a position away from the center of the partial viewing area E(2,3). In particular, in the embodiments shown in FIGS. 5A, 5B, and 5C, the sub-regions DB are arranged such that the display light K is all condensed on the boundary of the sub-viewing region E(2,3). Therefore, even when the eye moves to the vicinity of (or to the outside of) the partial viewing area E to which the display light K is directed, the image (virtual image V) with relatively high luminance due to the sub-partial area DB can be visually recognized. can. FIG. 5B shows a case where the eye position 700 has moved from the partial viewing zone E(2,3) to E(3,3) after the state of FIG. 5A. System latency occurs and the spot lighting area SP does not switch at the moment when the partial viewing area E(2,3) moves to E(3,3) (spot lighting corresponding to the partial viewing area E(2,3) area SP), the light from the sub-partial area DB that emits the illumination light that is the source of the display light K condensed at a position away from the center of the partial viewing area E(2,3) The display light K having a relatively high luminance can be visually recognized. FIG. 5C shows that after the state of FIG. 5B , the spotlighting area SP is switched from that corresponding to the previous partial viewing zone E(2,3) to that corresponding to the new partial viewing zone E(3,3). It is a figure which shows a state.

In another preferred example, the spot lighting area SP is illuminated with uniform (including substantially uniform) light so as to have a predetermined luminance level. Specifically, the arrangement of the light emitting region DM, the adjustment of the emitted light intensity, and/or the whole or partial optical adjustment of the condensing system are performed so that the light amount distribution Ld has a top hat shape. As a result, within the illuminated partial viewing area E, the brightness of the image (virtual image V) can be visually recognized substantially uniformly even if the eye position moves. However, in this embodiment, the light quantity distribution Ld may be a Gaussian distribution.

In some embodiments, the display control device 30 (processor 33) sets the emission intensity of the secondary partial area DB to be higher than 0.7 times and lower than 1.0 times the emission intensity of the main partial area DA. good. According to this, since the luminous intensity of the sub-partial area DB is relatively strong, even when the eye position 700 is near the boundary of the partial viewing area E, the light from the sub-partial area DB provides relatively high luminance display. The light K can be visually recognized.

Further, in some embodiments, the display control device 30 (processor 33) may make the light emission intensity of the sub-regions (DB) higher than the light emission intensity of the main partial regions (DA). According to this, since the luminous intensity of the sub-partial area DB is relatively strong, even when the eye position 700 is near the boundary of the partial viewing area E, the light from the sub-partial area DB provides relatively high luminance display. The light K can be visually recognized.

FIG. 6 is a block diagram of a vehicle display system 10, according to some embodiments. The display controller 30 comprises one or more I/O interfaces 31 , one or more processors 33 , one or more image processing circuits 35 and one or more memories 37 . Various functional blocks illustrated in FIG. 6 may be implemented in hardware, software, or a combination of both. FIG. 6 is just one embodiment and the components shown may be combined into fewer components or there may be additional components. For example, image processing circuitry 35 (eg, a graphics processing unit) may be included in one or more processors 33 .

As shown, processor 33 and image processing circuitry 35 are operatively coupled with memory 37 . More specifically, the processor 33 and the image processing circuit 35 execute a program stored in the memory 37, for example, to control the directional light source unit 60 (the control of the directional light source unit 60 is, for example, , control of the illumination laser beam 74 (illumination light) emitted by the light source 70, control of the light source array 80A described later, etc.), generation and / or transmission of image data, etc., the vehicle display system 10 (HUD The device 20, the light modulating element 51, the directional light source unit 60) can be operated. Processor 33 and/or image processing circuitry 35 may include at least one general purpose microprocessor (e.g., central processing unit (CPU)), at least one application specific integrated circuit (ASIC), at least one field programmable gate array (FPGA). , or any combination thereof. Memory 37 includes any type of magnetic media such as hard disks, any type of optical media such as CDs and DVDs, any type of semiconductor memory such as volatile memory, and non-volatile memory. Volatile memory may include DRAM and SRAM, and non-volatile memory may include ROM and NVRAM.

As shown, processor 33 is operatively coupled with I/O interface 31 . The I/O interface 31 communicates with, for example, a vehicle ECU 401 (described later) provided in the vehicle or other electronic devices (reference numerals 403 to 419 described later) according to CAN (Controller Area Network) standards (also known as CAN communication). ). The communication standard adopted by the I/O interface 31 is not limited to CAN. : MOST is a registered trademark), a wired communication interface such as UART or USB, or a personal area network (PAN) such as a Bluetooth network, a local network such as an 802.11x Wi-Fi network. It includes an in-vehicle communication (internal communication) interface, which is a short-range wireless communication interface within several tens of meters such as an area network (LAN). In addition, the I / O interface 31 is a wireless wide area network (WWAN0, IEEE802.16-2004 (WiMAX: Worldwide Interoperability for Microwave Access)), IEEE802.16e base (Mobile WiMAX), 4G, 4G-LTE, LTE Advanced, An external communication (external communication) interface such as a wide area communication network (for example, Internet communication network) may be included according to a cellular communication standard such as 5G.

As shown, the processor 33 is interoperably coupled with the I/O interface 31 to communicate with various other electronic devices and the like connected to the vehicle display system 10 (I/O interface 31). can be given and received. The I/O interface 31 includes, for example, a vehicle ECU 401, a road information database 403, a vehicle position detection unit 405, a vehicle exterior sensor 407, an operation detection unit 409, an eye position detection unit (line-of-sight direction detection unit) 411, an IMU 413, a brightness A sensor 415, a personal digital assistant 417, an external communication device 419, etc. are operatively coupled. Note that the I/O interface 31 may include a function of processing (converting, calculating, and analyzing) information received from other electronic devices or the like connected to the vehicle display system 10 .

Light modulating element 51 is, for example, a liquid crystal display (LCD) and is operably coupled to processor 33 and image processing circuitry 35 . Accordingly, the image displayed by light modulating element 51 may be based on image data received from processor 33 and/or image processing circuitry 35 . The processor 33 and image processing circuit 35 control the image displayed by the light modulation element 51 based on the information obtained from the I/O interface 31 .

The vehicle ECU 401 detects the state of the vehicle 1 (for example, the ON/OFF state of a start switch (for example, an accessory switch: ACC or an ignition switch: IGN) from sensors and switches provided in the vehicle 1 (an example of first start information). ), mileage, vehicle speed, accelerator pedal opening, brake pedal opening, engine throttle opening, injector fuel injection amount, engine speed, motor speed, steering angle, shift position, drive mode, headlight lighting・Information about headlights including turning off and irradiation range (an example of dimming reference information), various warning states, posture (including roll angle and/or pitching angle), vehicle vibration (vibration magnitude, frequency, and/or frequency)), etc., collects and manages (may also include control) the state of the vehicle 1, and as part of the function, the numerical value of the state of the vehicle 1 ( For example, a signal indicating the vehicle speed of the vehicle 1 can be output to the processor 33 of the display control device 30 . The vehicle ECU 401 simply transmits a numerical value detected by a sensor or the like (for example, the pitching angle is 3 [degrees] in the forward tilting direction) to the processor 33, or alternatively, transmits the numerical value detected by the sensor. Determination results based on one or more states of the vehicle 1 including (for example, the vehicle 1 satisfies a predetermined forward lean condition), or/and analysis results (for example, the degree of brake pedal opening (combined with the information that the vehicle is leaning forward due to braking) may be sent to the processor 33 . For example, the vehicle ECU 401 may output to the display control device 30 a signal indicating a determination result that the vehicle 1 satisfies a predetermined condition stored in advance in a memory (not shown) of the vehicle ECU 401 . Note that the I/O interface 31 may acquire the above-described information from sensors and switches provided in the vehicle 1 without using the vehicle ECU 401 .

In addition, the vehicle ECU 401 may output to the display control device 30 an instruction signal that instructs an image to be displayed by the vehicle display system 10. At this time, the coordinates, size, color, and Gradation, type, display mode, necessity of image notification, necessity-related information used as a basis for determining the necessity of notification, and/or a signal for adjusting the brightness of the virtual image (an example of a dimming signal), It may be added to the signal and transmitted.

The road information database 403 is included in a navigation device (not shown) provided in the vehicle 1 or an external server connected to the vehicle 1 via an external communication interface (I/O interface 31). Based on the position of the vehicle 1 acquired from the unit 405, road information (lanes, white lines, stop lines, crosswalks, road width, number of lanes, intersections, curves, forks, traffic regulations, etc.), tunnel entrance/exit information (an example of light adjustment reference information), feature information (buildings, bridges, rivers, etc.) etc.), its position (including the distance to the vehicle 1), direction, shape, type, detailed information, etc. may be read out and transmitted to the processor 33 . The road information database 403 may also calculate an appropriate route (navigation information) from the departure point to the destination and output to the processor 33 a signal indicating the navigation information or image data indicating the route.

The vehicle position detection unit 405 is a GNSS (global navigation satellite system) or the like provided in the vehicle 1, detects the current position and direction of the vehicle 1, and transmits a signal indicating the detection result via the processor 33. or directly to the road information database 403, a portable information terminal 417 and/or an external communication device 419, which will be described later. The road information database 403, a portable information terminal 417 (to be described later), and/or an external communication device 419 acquire position information of the vehicle 1 from the vehicle position detection unit 405 continuously, intermittently, or at each predetermined event. , information about the surroundings of the vehicle 1 may be selected/generated and output to the processor 33 .

The vehicle exterior sensor 407 detects real objects existing around the vehicle 1 (front, side, and rear). Real objects detected by the vehicle exterior sensor 407 include, for example, obstacles (pedestrians, bicycles, motorcycles, other vehicles, etc.), road surfaces of driving lanes, lane markings, roadside objects, and/or features (buildings, etc.), which will be described later. etc. may be included. Exterior sensors include, for example, radar sensors such as millimeter wave radar, ultrasonic radar, and laser radar, cameras, or a detection unit consisting of a combination thereof, and processing detection data from the one or more detection units ( data fusion) and a processing device. A conventional well-known method is applied to object detection by these radar sensors and camera sensors. By object detection by these sensors, the presence or absence of a real object in the three-dimensional space, and if the real object exists, the position of the real object (relative distance from the vehicle 1, the traveling direction of the vehicle 1 in the front-back direction) horizontal position, vertical position, etc.), size (horizontal direction (horizontal direction), height direction (vertical direction), etc.), movement direction (horizontal direction (horizontal direction), depth direction (front-rear direction)), movement speed (lateral direction (left-right direction), depth direction (front-rear direction)), and/or type may be detected. One or a plurality of sensors outside the vehicle 407 detects a real object in front of the vehicle 1 in each sensor detection period, and detects real object information (presence or absence of a real object, existence of a real object), which is an example of real object information. If so, information such as the position, size and/or type of each real object) can be output to the processor 33 . Note that the real object information may be transmitted to the processor 33 via another device (for example, the vehicle ECU 401). Also, when using a camera as a sensor, an infrared camera or a near-infrared camera is desirable so that a real object can be detected even when the surroundings are dark, such as at night. Moreover, when using a camera as a sensor, a stereo camera that can acquire distance and the like by parallax is desirable.

The operation detection unit 409 is, for example, a CID (Center Information Display) of the vehicle 1, a hardware switch provided on an instrument panel, or a software switch combining an image and a touch sensor. It outputs to the processor 33 operation information based on the operation by the passenger (the user sitting in the driver's seat and/or the user sitting in the front passenger seat). For example, the operation detection unit 409 detects display area setting information based on an operation to move the virtual image display area VS, eye box setting information based on an operation to move the eye box 200, and operation to change the brightness of the virtual image. image brightness setting information (an example of a dimming signal), information based on an operation for setting the eye position 700 of the observer, and the like are output to the processor 33 . Note that the HUD device 20 may be turned on/off by operating the operation detection unit 409 . That is, the operation detection unit 409 can output to the processor 33 a signal for turning on/off the HUD device 20 (an example of first activation information).

The eye position detection unit 411 may include a camera such as an infrared camera that detects the eye position 700 of the observer sitting in the driver's seat of the vehicle 1 , and may output the captured image to the processor 33 . The processor 33 acquires a captured image (an example of information that can estimate the eye position 700) from the eye position detection unit 411, and analyzes this captured image by a method such as pattern matching to determine the eye positions of the observer. The coordinates of 700 may be detected and a signal indicative of the detected coordinates of eye position 700 may be output to processor 33 .

Further, the eye position detection unit 411 detects a spatial region corresponding to a plurality of preset display parameters 600 (described later) corresponding to an analysis result (for example, an observer's eye position 700) obtained by analyzing the captured image of the camera. ) may be output to the processor 33. Note that the method of acquiring the eye position 700 of the observer of the vehicle 1 or the information that can estimate the eye position 700 of the observer is not limited to these, and a known eye position detection (estimation) technique is used. may be obtained by

Further, the eye position detection unit 411 detects the moving speed and/or the moving direction of the observer's eye position 700, and outputs a signal indicating the moving speed and/or the moving direction of the observer's eye position 700 to the processor 33. can be output to

Further, the eye position detection unit 411 outputs (10) a signal indicating that the observer's eye position 700 is outside the eyebox 200, and (20) the observer's eye position 700 is estimated to be outside the eyebox 200. (30) a signal that the observer's eye position 700 is expected to be outside the eyebox 200; (40) a signal indicating that the observer's eye position 700 cannot be detected; When a signal that is estimated to be degraded in detection accuracy is detected, it may be determined that a predetermined condition is satisfied, and a signal indicating the state may be output to the processor 33 . Also, the eye position detection unit 411 outputs (60) a signal indicating that the eye position detection unit 411 has started normal operation (that the activation operation has been completed) (activation information of the eye position detection unit (second activation information ), or conversely (70) a signal indicating that the eye position detector 411 has not started normal operation (not activated) (activation information of the eye position detector (second activation An example of information).) may be output to the processor 33 .

(20) The signal that the observer's eye position 700 is estimated to be outside the eyebox 200 is, for example, (21) a signal indicating that the observer's eye position 700 cannot be detected, (22) the observer's eye position A signal indicating that the observer's eye position 700 cannot be detected after the movement of 700 is detected; The neighborhood includes, for example, a signal indicating being within predetermined coordinates from the boundary 200A.

(30) A signal that predicts that the observer's eye position 700 is outside the eye box 200 is, for example, A signal indicating that the eye position movement distance is greater than or equal to a previously stored eye position movement distance threshold value (that the movement of the eye position within a predetermined unit time is greater than a specified range); and a signal indicating that it is equal to or greater than the stored eye position movement speed threshold.

(40) The signal indicating that the observer's eye position 700 cannot be detected is, for example, (41) a signal indicating that the observer's eye position 700 cannot be detected, and (42) the movement of the observer's eye position 700 is detected. and/or (43) a signal indicating that either of the observer's eye positions 700R, 700L cannot be detected.

(50) A signal that is estimated to indicate that the detection accuracy of the observer's eye position 700 is degraded is, for example, (52) eye position movement speed is stored in memory 37; and/or (53) a signal indicating that either of the observer's eye positions 700R and 700L cannot be detected.

Also, the eye position detection unit 411 may have a function as the line-of-sight direction detection unit 411 . The line-of-sight direction detection unit 411 may include an infrared camera or a visible light camera that captures the face of an observer sitting in the driver's seat of the vehicle 1 , and may output the captured image to the processor 33 . The processor 33 acquires a captured image (an example of information for estimating the line-of-sight direction) from the line-of-sight direction detection unit 411, and analyzes the captured image to determine the line-of-sight direction (and/or the gaze position) of the observer. can be specified. Note that the line-of-sight direction detection unit 411 may analyze the captured image from the camera and output to the processor 33 a signal indicating the line-of-sight direction (and/or the gaze position) of the observer, which is the analysis result. Note that the method of acquiring information that can estimate the line-of-sight direction of the observer of the vehicle 1 is not limited to these, and includes an EOG (Electro-oculogram) method, a corneal reflection method, a scleral reflection method, and Purkinje image detection. may be obtained using other known gaze direction detection (estimation) techniques such as method, search coil method, infrared fundus camera method.

The IMU 413 includes one or more sensors (e.g., accelerometers and gyroscopes) configured to detect the position, orientation, and changes thereof (velocity of change, acceleration of change) of the vehicle 1 based on inertial acceleration. can include a combination of The IMU 413 outputs detected values (the detected values include signals indicating the position and orientation of the vehicle 1, and changes thereof (change speed, change acceleration)) and the results of analyzing the detected values to a processor. 33. The result of the analysis is a signal or the like indicating whether or not the detected value satisfies a predetermined condition. , a signal indicating that the behavior (vibration) of the vehicle 1 is small.

The brightness sensor 415 converts the illuminance or luminance of a predetermined range of the foreground that exists in front of the passenger compartment of the vehicle 1 into the outside world brightness (an example of dimming reference information), or converts the illuminance or luminance in the passenger compartment into the vehicle interior brightness ( An example of dimming reference information.). The brightness sensor 415 is, for example, a phototransistor, a photodiode, or the like, and is mounted on the instrument panel, rearview mirror, HUD device 20, or the like of the vehicle 1 shown in FIG.

The personal digital assistant 417 is a smart phone, a laptop computer, a smartwatch, or other information device that can be carried by the observer (or other occupant of the vehicle 1). By pairing with the mobile information terminal 417, the I/O interface 31 can communicate with the mobile information terminal 417, and can read data recorded in the mobile information terminal 417 (or a server through the mobile information terminal). to get The mobile information terminal 417 has, for example, the same functions as the road information database 403 and the own vehicle position detection unit 405 described above, and acquires the road information (an example of real object related information; an example of dimming reference information). and may be sent to processor 33 . The mobile information terminal 417 may also acquire commercial information (an example of real object related information) related to commercial facilities near the vehicle 1 and transmit it to the processor 33 . In addition, the mobile information terminal 417 transmits schedule information of the owner of the mobile information terminal 417 (for example, an observer), incoming call information at the mobile information terminal 417, mail reception information, etc. to the processor 33, and the processor 33 and the image Processing circuitry 35 may generate and/or transmit image data for these.

The external communication device 419 is a communication device that exchanges information with the vehicle 1, for example, other vehicles connected to the vehicle 1 by vehicle-to-vehicle communication (V2V: vehicle-to-vehicle communication), pedestrian-to-vehicle communication (V2P: vehicle-to-pedestrian ) connected by pedestrians (mobile information terminals carried by pedestrians), network communication equipment connected by road-to-vehicle communication (V2I: Vehicle To roadside Infrastructure), broadly speaking, communication with vehicle 1 (V2X : Vehicle To Everything). The external communication device 419 acquires, for example, the positions of pedestrians, bicycles, motorcycles, other vehicles (preceding vehicles, etc.), road surfaces, lane markings, roadside objects, and/or features (buildings, etc.), and sends them to the processor 33. can be output. Further, the external communication device 419 has the same function as the vehicle position detection unit 405 described above, may acquire the position information of the vehicle 1 and transmit it to the processor 33, and furthermore may store the road information database 403 described above. It may also have a function to acquire the road information (an example of real object related information; an example of dimming reference information) and transmit it to the processor 33 . Information acquired from the external communication device 419 is not limited to the above.

The software components stored in the memory 37 are an eye position detection module 502, an eye position estimation module 504, an eye position prediction module 506, an eye position state determination module 508, an activation determination module 510, a release condition determination module 512, and a spot lighting area. It includes a setting module 514, a display parameter setting module 516, a graphic module 518, a light source driving module 520, an actuator driving module 522, a dimming value setting module 524, and the like.

FIGS. 7A, 7B, 7C, and 7D are flow diagrams illustrating a method S100 of performing operations to set spot lighting areas based on an activation state, such as HUD device 20, according to some embodiments. The method S100 is performed in a HUD device 20 that includes a display and a display controller 30 that controls the HUD device 20 . Some of the acts of method S100 described below are optionally combined, some of the steps of the acts are optionally varied, and some of the acts are optionally omitted.

First, refer to FIG. 7A. The activation determination module 510 of FIG. 6 acquires activation information indicating the activation state of at least one of the vehicle 1, the HUD device 20, the display control device 30, and the eye position detection unit 411, and based on the activation information, the HUD device 20 and the eye position detection unit 411 are activated (step S110). Step S110 will be described later in detail with reference to FIGS. 7B and 7C. Here, the "activation state" means that any of the vehicle display system 10 as a whole, the HUD device 20, or the eye position detection unit 411 is activated by supplying power, turning on the start switch, or the like. It is a state from when the vehicle display system 10 starts operating until it starts normal operation. This is the state until it can be set to .

(Step S140)
Next, the spotlighting area setting module 514 in FIG. 6 sets the spotlighting area SP based on the determination in step S110.

(Step S150)
In step S140, the spotlighting area setting module 514 sets the spotlighting area SP to the first spotlighting area SP1 when it is determined in step S110 that the spotlighting area setting module 514 is not in the activated state. In step S150, the spot lighting area setting module 514 detects the eye position 700 detected by the eye position detection module 502, the eye position 700 estimated by the eye position estimation module 504, and/or the eye position prediction module 506, which will be described later. In accordance with the determined eye position 700 (so as to include at least the eye position 700), a narrower area (first spot lighting area SP1) than a second spot lighting area SP2, which will be described later, is set.

(Light emission process at startup (step S160))
On the other hand, in step S140, the spotlighting area setting module 514 changes the spotlighting area SP to the second spotlighting area SP2, which is wider than the first spotlighting area SP1, when it is determined in step S110 that the spotlighting area setting module 514 is in the activated state. Set (light emission process at startup (step S160)). In the startup light emission process (step S160), the spot lighting area setting module 514 detects the eye position 700 detected by the eye position detection module 502, the eye position 700 estimated by the eye position estimation module 504, and/or the eye position 700, which will be described later. Not based on the eye position 700 predicted by the position prediction module 506, the spot lighting area SP is set to the second spot lighting area SP2 pre-stored in the memory 37. FIG. Here, the second spot lighting area SP2 may be the entire eyebox 200 . As a result, if the eye position 700 is within the eye box 200, at least one of the HUD device 20, the display control device 30, and the eye position detection unit 411 has just started, and even if these operations are unstable, observation can be performed. The virtual image V can be visually recognized by a person. Moreover, the situation that the display light K is not directed to the eye position 700 can be reduced.

Also, in some embodiments, the second spot lighting area SP2 in the start-up lighting process (step S160) may be part of the eyebox 200. FIG. The second spotlighting area SP2 in step S160 may be a square including the center of the eyebox 200, a rectangle elongated in the left-right direction of the vehicle 1, or an ellipse elongated in the left-right direction of the vehicle 1. In addition, if there are a plurality of first spotlighting areas SP1 (two in this case) such as the right eye spotlighting area SPR and the left eye spotlighting area SPL, the second spotlighting area SP2 in step S160 is also , may be plural. In this case, the second spot lighting areas SP2 (first spot lighting Even if a right-eye spot lighting area SPR that is wider than the right-eye spot lighting area SPR that is the area SP1 and a left-eye spot lighting area SPL that is wider than the left-eye spot lighting area SPL that is the first spot writing area SP1 are set. good. The two predetermined partial viewing zones E pre-stored in the memory 37 are, for example, areas centered on two points separated by an average interpupillary distance of 64 [mm] with the center of the eyebox 200 as the center of symmetry. There may be (but not limited to).

In the light emission process at startup (step S160), the cancellation condition determination module 512 of FIG. 6 determines whether the cancellation condition of the light emission process at startup is satisfied. If it is determined that the requirement is satisfied, the spot lighting area SP is made narrower than the second spot lighting area SP2 (spot area reduction processing (step S170)). The spot area reduction process (step S170) will be described later in detail with reference to FIG. 7D.

(Step S120)
Reference is now made to FIG. 7B. The activation determination module 510 of FIG. 6 acquires first activation information (an example of the activation information) indicating the activation state of at least one of the vehicle 1, the HUD device 20, and the display control device 30, and Based on the activation information, it is determined whether or not it is in the activated state (step S120).

In step S120, the activation determination module 510 receives, for example, a signal (first signal) indicating the activation state of the vehicle 1 (for example, the ON/OFF state of the activation switch (eg, accessory switch: ACC or ignition switch: IGN) from the vehicle ECU 401 or the like). ) is detected, and when the vehicle 1 is detected to be activated, it may be determined that the HUD device 20 is in the activated state (step S121).

Further, in step S120, the activation determination module 510 detects, for example, a signal for turning on/off the HUD device 20 (an example of first activation information) from the operation detection unit 409, and detects a signal for turning on the HUD device 20. is detected, it may be determined that the HUD device 20 is activated (step S123).

Further, in step S120, the activation determination module 510 provides, for example, a voltage detection circuit (not shown) (or current detection circuit (not shown)) in the HUD device 20, and the voltage detection circuit (or current detection circuit) detects When a signal indicating whether power is supplied to the HUD device 20 (an example of first activation information) is detected and a signal indicating that power is supplied to the HUD device 20 is detected, the HUD device 20 is activated. It may be determined to be in the state (step S125).

Further, in step S120, the activation determination module 510 provides, for example, a voltage detection circuit (not shown) (or a current detection circuit (not shown)) in the display control device 30 (processor 33), and the voltage detection circuit (or the A signal (an example of first activation information) indicating whether or not power is being supplied from the current detection circuit) to the display control device 30 (processor 33) is detected, and power is supplied to the display control device 30 (processor 33). When the signal indicating that is detected, it may be determined that the HUD device 20 is in the activated state (step S127).

It should be noted that determination of whether or not the HUD device 20 is in the activated state is not limited to the above, and any known means may be used.

(Step S130)
Reference is now made to FIG. 7C. Activation determination module 510 in FIG. 6 acquires second activation information (an example of the activation information) indicating the activation state of eye position detection unit 411, and detects eye position detection unit 411 based on the second activation information. is activated (step S130).

In step S130, the activation determination module 510 receives, for example, a signal from the eye position detection unit 411 indicating that the eye position detection unit 411 has started normal operation (completion of activation operation). information (an example of the second start-up information)), and a signal ( example of activation information (second activation information) of the eye position detection unit) is not detected, it may be determined that the eye position detection unit 411 is in an activated state (step S131).

Further, in step S130, the activation determination module 510 receives, for example, a signal (activation information of the eye position detection unit (second activation information) from the eye position detection unit 411 indicating that the eye position detection unit 411 is in the activation operation. ) can be detected periodically (or irregularly), and a signal indicating that the eye position detection unit 411 is in the activation operation (activation information of the eye position detection unit (second activation information ) is detected regularly (or irregularly), it may be determined that the eye position detection unit 411 is in the activated state (step S133).

Further, in step S130, the activation determination module 510 receives, for example, a signal from the eye position detection unit 411 indicating that activation of the eye position detection unit 411 has not been completed (activation information of the eye position detection unit (second activation ) can be detected periodically (or irregularly), and a signal indicating that activation of the eye position detection unit 411 has not been completed (activation information of the eye position detection unit (second ) is detected regularly (or irregularly), it may be determined that the eye position detector 411 is in the activated state (step S135).

Further, in step S130, the activation determination module 510 receives, for example, a signal from the eye position detection unit 411 indicating that activation of the eye position detection unit 411 has not been completed (activation information of the eye position detection unit (second activation). ) can be detected periodically (or irregularly), and a signal indicating that activation of the eye position detection unit 411 has not been completed (activation information of the eye position detection unit (second ) is detected regularly (or irregularly), it may be determined that the eye position detector 411 is in the activated state (step S135).

In addition, in step S130, after the HUD device 20 (display control device 30) is determined to be in the activated state in step S120, the activation determination module 510, for example, detects eye position information (or eye position estimation) from the eye position detection module 502. If the eye position estimable information from the eye position prediction module 504 and the eye position predictable information from the eye position prediction module 506 are not detected a predetermined number of times (once or a predetermined plurality of times), the eye position detection unit 411 may be determined to be active (step S137).

The determination as to whether or not the eye position detection unit 411 is in the active state is not limited to the above, and any known means may be used.

(Spot area reduction process (step S170))
Reference is now made to FIG. 7D. The cancellation condition determination module 512 of FIG. 6 determines whether or not the cancellation condition of the startup light emission processing S160 is satisfied. to the first spotlighting area SP1 of .

In step S170, the canceling condition determination module 512 of FIG. 6 determines that the canceling condition is satisfied when a predetermined time period stored in advance in the memory 37 has elapsed since it was determined in step S110 that the state is activated. (an example of step S180).

6 can detect that the display control device 30 (processor 33) has completed the activation sequence in step S170. When the display control device 30 (processor 33) detects that the activation sequence has been completed, it may be determined that the cancellation condition is met (an example of step S180).

Further, in step S170, the cancellation condition determination module 512 in FIG. 6 receives, for example, a signal ( An example of release information) can be detected, and a signal (an example of release information) indicating that the eye position detection unit 411 has started normal operation (completion of activation operation) from the eye position detection unit 411. is detected, it may be determined that the cancellation condition is established (an example of step S180).

Further, in step S170, the release condition determination module 512 of FIG. can be detected periodically (or irregularly), and a signal (an example of release information) indicating that the eye position detection unit 411 is in the activation operation is no longer detected regularly (or irregularly). In this case, it may be determined that the cancellation condition is met (an example of step S180).

Further, in step S170, the cancellation condition determination module 512 in FIG. A signal that can be detected periodically (or irregularly) and indicates that activation of the eye position detector 411 has not been completed (an example of the release information) is periodically (or irregularly) If it is no longer detected, it may be determined that the cancellation condition is met (an example of step S180).

Further, in step S170, the cancellation condition determination module 512 in FIG. A signal that can be detected periodically (or irregularly) and indicates that activation of the eye position detector 411 has not been completed (an example of the release information) is periodically (or irregularly) If it is no longer detected, it may be determined that the cancellation condition is met (an example of step S180).

Further, in step S170, the cancellation condition determination module 512 of FIG. Alternatively, when the eye position estimable information from the eye position estimation module 504 and the eye position predictable information from the eye position prediction module 506 are detected a predetermined number of times (once or a predetermined plurality of times), the cancellation is performed. It may be determined that the condition is established (an example of step S180).

(Spot area reduction process (step S190))
In step S170, the spotlighting area setting module 514 moves the spotlighting area SP from the second spotlighting area SP2 to is set to the narrow first spot lighting area SP1. In the spot area reduction process (step S190), the spot lighting area setting module 514 uses the eye position 700 detected by the eye position detection module 502, the eye position 700 estimated by the eye position estimation module 504, and/or the eye position 700 to be described later. An area narrower than the second spot lighting area SP2 (first spot lighting area SP1) is set according to the eye position 700 predicted by the position prediction module 506 (so as to include at least the eye position 700). As a result, the display light K directed to the eyebox 200 area other than the eye position 700 can be reduced, and power consumption can be suppressed. In addition, it is possible to reduce the occurrence of stray light caused by the display light K that is not directed toward the eye position 700 .

(First spot area reduction process (step S191))
In step S170, the spotlighting area setting module 514 instantaneously changes the spotlighting area SP from the second spotlighting area SP2 to the first spotlighting area SP1 if it is determined in step S180 that the cancellation condition is satisfied. You can switch to

(Second Spot Area Reduction Processing (Step S192))
In addition, in step S170, if it is determined in step S180 that the cancellation condition is satisfied, the spot lighting area setting module 514 gradually reduces the spot lighting area SP from the second spot lighting area SP2. eye position detection module 502, estimated eye position estimation module 504, and/or eye position prediction module 506. You may switch to area SP1.

The eye position detection module 502 in FIG. 6 detects the eye position 700 of the observer via the eye position detection unit 411 (acquires information indicating the eye position 700). The eye position detection module 502 detects the coordinates indicating the observer's eye position 700 (positions in the X and Y axis directions and is an example of a signal indicating the eye position 700), and detects the height of the observer's eye. coordinates indicating the height (position in the Y-axis direction, which is an example of a signal indicating the eye position 700); and/or coordinates indicating the observer's eye position 700 (which are positions in the X, Y, and Z axis directions and are an example of a signal indicating the eye position 700). 700 includes various software components for performing various operations related to detecting. The information indicating the eye position 700 is an example of start-up information (second start-up information) for the eye position detector.

Note that the eye position 700 detected by the eye position detection module 502 includes positions 700R and 700L of the right and left eyes, one of the predetermined positions of the right eye position 700R and the left eye position 700L, the right eye position 700R and the left eye position 700L. , or a position calculated from the right eye position 700R and the left eye position 700L (for example, the middle point between the right eye position and the left eye position). For example, the eye position detection module 502 determines the eye position 700 based on the observation position acquired from the eye position detection unit 411 immediately before the timing of updating the display settings.

Further, the eye position detection unit 411 detects the movement direction and/or the movement speed of the observer's eye position 700 based on a plurality of observation positions with different detection timings of the observer's eyes acquired from the eye position detection unit 411. A signal indicating the moving direction and/or moving speed of the observer's eye position 700 may be output to the processor 33 .

The eye position estimation module 504 obtains information from which eye positions can be estimated. The information that can estimate the eye position is, for example, the captured image acquired from the eye position detection unit 411, the position of the driver's seat of the vehicle 1, the position of the observer's face, the height of the sitting height, or the eye position of a plurality of observers. observation position and so on. The eye position estimating module 504 estimates the eye position 700 of the observer of the vehicle 1 from the information that can estimate the eye position. The eye position estimation module 504 uses the captured image acquired from the eye position detection unit 411, the position of the driver's seat of the vehicle 1, the position of the face of the observer, the height of the sitting height, or the observation positions of the eyes of a plurality of observers. , estimating the eye position 700 of the observer, etc., for performing various operations related to estimating the eye position 700 of the observer. That is, the eye position estimation module 504 can include table data, arithmetic expressions, and the like for estimating the eye position 700 of the observer from information that can estimate the eye position. The eye position estimable information is an example of activation information (second activation information) of the eye position detection unit.

The eye position estimation module 504 calculates the estimated positions of the eye positions 700 based on the observation position of the eye acquired from the eye position detection unit 411 immediately before the spot lighting area is updated, and one or more previously acquired eye positions. Based on the observation position, for example, it may be calculated by a technique such as weighted average.

The eye position prediction module 506 acquires information that can predict the eye position 700 of the observer. The information that can predict the observer's eye position 700 is, for example, the latest observation position acquired from the eye position detection unit 411, or one or more observation positions acquired in the past. Eye position prediction module 506 includes various software components for performing various operations related to predicting eye positions 700 based on information capable of predicting eye positions 700 of an observer. Specifically, for example, the eye position prediction module 506 predicts the eye position 700 of the observer at the timing when the observer visually recognizes the image to which the new display settings are applied. The eye position prediction module 506 uses one or more past observed positions, for example, using a least squares method, a prediction algorithm such as a Kalman filter, an α-β filter, or a particle filter to calculate the next value. You can make a prediction. The information capable of predicting the eye position 700 of the observer is an example of activation information (second activation information) of the eye position detection section.

The spot lighting area setting module 514 selects an area to which the display light K is directed based on the acquired information indicating the eye position 700 (the information with which the eye position can be estimated or the information with which the eye position 700 of the observer can be predicted). (spot lighting area SP). The spot lighting area setting module 514 sets an area including the partial viewing area E in which the left eye position 700L of the observer exists and part or all of the peripheral partial viewing area E as the left eye spot lighting area SPL, and performs observation. An area including a partial viewing zone E in which the right eye position 700R of the person exists and a part or all of the partial viewing zone E adjacent thereto is set as a right eye spot lighting area SPR. Specifically, as shown in FIG. 4B, the spot lighting area setting module 514 sets a partial viewing area E(2,3) in which the observer's right eye 700R exists, a peripheral partial viewing area E(1,2), Part of E(2,2), E(2,3), E1,3), E(3,3), E(1,4), E(2,4), and E(2,5) , a partial viewing area E(4,3) in which the observer's left eye 700L exists, and peripheral partial viewing areas E(3,2), E(4,2), E(5 , 2), E3,3), E(5,3), E(3,4), E(4,4), and a portion of E(5,4) for the right eye spot lighting area SPR; The directional light source unit 60 is controlled so that the display light K is directed toward the . In this case, the spot lighting area setting module 514 includes a main partial area DA (D(4,6)) that directs the display light K to the center of the partial viewing area E(2,3) where the right eye 700R of the observer exists, Sub-regions DB(D(3,5), D(4,5), D(5,5 ), D(3,6), D(5,6), D(3,7), D(4,7), and D(5,7)) emit light at a predetermined light intensity or higher, A main partial area DA (D(8,6)) for directing the display light K to the center of a partial viewing area E(4,3) where the left eye 700L of the observer exists, and a partial viewing area E(2) where the left eye 700L exists. , 3) directing the display light K to non-central areas DB(D(7,5), D(8,5), D(9,5), D(7,6), D( 9,6), D(7,7), D(8,7), and D(9,7)) are caused to emit light with a predetermined light intensity or higher. Then, the spot lighting area setting module 514 sets the light emission area DMR for the right eye (the main partial area DA for the right eye + the sub partial area DB) and the light emission area for the left eye DML (the main partial area DA for the left eye + the sub partial area DB). The partial region D is not irradiated with the illumination laser beam 74 (or is irradiated with the illumination laser beam 74 with very low light intensity).

In addition, the spot lighting area setting module 514 creates a continuous binocular spot lighting area including a partial viewing area E in which the observer's left eye position 700L exists and a partial viewing area E in which the observer's right eye position 700R exists. It may be set to SPC. Specifically, as shown in FIG. 8A, the spot lighting area setting module 514 sets the partial viewing area E(2,3) where the right eye 700R of the observer exists, 3), and partial viewing zones E(1,2), E(2,2), E(3,2), E(4,2), E(5,2), E(1, 3), E(3,3), E(3,5), E(1,4), E(2,4), E(3,4), E(4,4), and E(5, 4), directing the display light K to the binocular spot lighting area SPC, including part of 4). In this case, the spot lighting area setting module 514 directs the display light K to the center of the partial viewing area E(2,3) where the observer's right eye 700R exists, the main partial area DA(D(4,6)), the left eye 700R, and the left eye 700R. A main partial area DA (D(8,6)) directing the display light K to the center of the partial viewing area E(4,3) where 700L exists, a main partial area DA(D(4,6)), and a main partial area Sub-areas DB (D(5,4)~D(7,4), D(2,5)~, D(9,5), D(2, 6), D (3, 6), D (5, 6) to D (7, 6), D (9, 6), D (2, 7) to D (9, 7) and D (5, 8) to D(7, 8)) are caused to emit light with a predetermined light intensity or higher. Then, the spot lighting area setting module 514 sets the illuminating laser beam 74 in the partial area D other than the binocular light emitting area DMC (right eye main partial area DA+right eye main partial area DA+sub partial area DB). (or illuminating laser beam 74 with very low light intensity).

FIG. 9 shows a first light emitting region DM1 (first left eye light emitting region DML1, first right eye light emitting region DMR1) and a second light emitting region DM2 (second left eye light emitting region DMR1) in the planar illumination unit SE. FIG. 10 is a diagram showing one aspect of the light emitting region DML2 and the second right eye light emitting region DMR2). Assuming that the vertical length of the light-emitting region DM is PV and the horizontal length is PH, the first light-emitting region DM1 has a longer vertical length PV than the second light-emitting region DM2. The length PH is also shortened. Also, the second light-emitting region DM2 includes the first light-emitting region DM1 and the surrounding light-emitting region DM. In this way, when the eye position 700 is positioned forward (second position 702 with reference to first position 701), widening light emitting region DM of light source element 60 (light source element 60A, which will be described later) , the entire display surface 52 of the light modulation element 51 ("whole" here means 100% of the entire displayable area of the light modulation element 51, or a preset display area in the displayable area (for example, 70% of the entire display area). ) can be displayed by the observer at a desired luminance (higher than the desired luminance). In the example of FIG. 9, the first left-eye light-emitting region DML1 (second left-eye light-emitting region DML2) for the left eye 700L and the first right-eye light-emitting region DMR1 ((second right-eye light-emitting region DML2) for the right eye 700R In another example, the spotlighting area setting module 514 can set either one of them based on the eye position (Z-axis coordinate) in the front-rear direction of the vehicle 1 . The size may be changed only for the luminous area DM directed toward the eyes of the vehicle 1. In addition, the spot lighting area setting module 514 of another example changes the eye position (Z-axis coordinate) in the front-rear direction of the vehicle 1. Based on this, one continuous binocular luminous area DMC directed toward one continuous binocular spot lighting area SPC including the partial viewing area E in which the left eye position 700L exists and the partial viewing area E in which the right eye position 700R exists. You can change the width of

The spot lighting area setting module 514 may control the light amount distribution Ld in the light emitting area DM of the planar lighting unit SE based on the obtained eye position (Z-axis coordinate) in the front-rear direction of the vehicle 1 .

In some embodiments, the spot lighting area setting module 514 may set the emission intensity of the secondary partial area DB higher than 0.7 times the emission intensity of the main partial area DA. According to this, since the light emission intensity of the sub-partial area DB is relatively strong, even when the eye position 700 is near the boundary of the partial viewing area E, the light from the sub-partial area DB provides relatively high luminance display. The light K can be visually recognized.

Also, in some embodiments, the spot lighting area setting module 514 may make the emission intensity of the secondary partial area (DB) higher than the emission intensity of the main partial area (DA). According to this, since the light emission intensity of the sub-partial area DB is relatively strong, even when the eye position 700 is near the boundary of the partial viewing area E, the light from the sub-partial area DB provides relatively high luminance display. The light K can be visually recognized. In addition, it is possible to improve the luminance uniformity of the virtual image V that can be displayed in the entire virtual image display area VS.

The display parameter setting module 516 of FIG. It determines to which of the plurality of partial viewing zones E obtained, the display parameter 600 corresponding to the eye position 700 is set. The display parameter setting module 516 determines where the X-axis coordinate, Y-axis coordinate, Z-axis coordinate, or a combination thereof indicated by the eye position 700 belongs to a plurality of spatial areas (partial viewing area E), It includes various software components for performing various operations related to setting the display parameters 600 corresponding to the sub-viewing zone E to which the eye position 700 belongs. That is, the display parameter setting module 516 can include table data, arithmetic expressions, etc. for specifying the display parameters 600 from the X-axis coordinates, Y-axis coordinates, Z-axis coordinates indicated by the eye position 700, or a combination thereof. .

The display parameter setting module 516 may apply display parameters corresponding to each partial viewing zone E. FIG. For example, when the light-emitting regions DM emit light in a time division manner, the display parameter setting module 516 may switch to different display parameters 600 for each timing at which one light-emitting region DM emits light. In the example of FIG. 4B, the display parameters 600 corresponding to the light-emitting region DM(7,6) are applied to the light modulation element 51 at the timing when the light-emitting region DM(7,6) emits light. The display parameter 600 corresponding to the light emitting region DM(8,6) may be applied to the light modulation element 51 at the timing when D emits light.

Also, another display parameter setting module 516 may apply one common display parameter to a plurality of light emitting areas DM. For example, the display parameter setting module 516 directs the display light K to the right-eye spot lighting area SPR shown in FIG. (8,5), D(9,5), D(7,6), D(9,6), D(7,7), D(8,7), D(9,7)) A common display parameter 600 is applied to the light modulation element 51 at each timing. Specifically, the display parameter setting module 516 sets the display parameter 600 corresponding to the main partial area DA (D(8, 6) in the example of FIG. 4B) that directs the display light K to the center of the spotlighting area SP. Light-emitting region DM (partial regions D(8,6), D(7,5), D(8,5), D(9,5), D(7,6), D(9,6), D( 7, 7), D(8, 7), and D(9, 7)) may be applied to the light modulation element 51 at respective timings of light emission.

In some embodiments, the display parameter setting module 516 may switch the display parameters 600 depending on the timing at which the right-eye light-emitting region DMR is illuminated and the timing at which the left-eye light-emitting region DML is illuminated. Here, assuming that the display parameter 600 is a parameter for making the displayed image different, the display parameter setting module 516 causes the right eye image to be displayed at the timing of causing the right eye light emitting region DMR to emit light, and the left eye light emitting region DML to emit light. By displaying the image for the left eye at the timing to allow the viewer to perceive a stereoscopic image (virtual image) due to left and right parallax.

Also, another display parameter setting module 516 may apply two or more display parameters to one spotlighting area SP. In this case, the display parameter setting module 516 sets display parameters 600 common to the plurality of partial areas D in advance. For example, in the example of FIG. 4B, the common first display parameter is set for the partial areas D(7,5), D(8,5), and D(9,5), and the partial area D(7,6 ), D(8,6), and D(9,6) are set with a common second display parameter (different from the first display parameter), and partial areas D(7,7), D (8, 7) and D(9, 7) are set with a common third display parameter (different from the first and second display parameters), the display parameter setting module 516 performs partial When the regions D(7,5), D(8,5), and D(9,5) respectively emit light, the first display parameters are applied to the light modulation element 51 and the partial region D(7,6 ), D(8,6) and D(9,6) emit light respectively, applying the second display parameters to the light modulating element 51 and the partial areas D(7,7), D(8, 7) and D(9,7) respectively apply the third display parameter to the light modulation element 51 .

The types of the display parameters 600 are as follows: (1) the arrangement of an image that has a predetermined positional relationship with a real object positioned outside the vehicle 1 when viewed from the eye position 700 (the display device 50 is used to control the arrangement of the image); and/or actuators.), (2) parameters for pre-distorting the image to reduce image distortion that may be caused by, for example, the virtual image optics 90 viewed from the eye position 700. (This is a parameter that controls the display 50 to pre-distort the image displayed on the display 50, and is also called a warping parameter.), (3) Viewing the desired stereoscopic image from the eye position; (parameters for controlling the display 50, parameters for controlling the light sources of the display 50, parameters for controlling actuators, or parameters including a combination thereof), and the like. However, the display parameters 600 set (selected) by the display parameter setting module 516 may be parameters that are preferably changed according to the observer's eye position 700, and the types of the display parameters 600 are not limited to these. .

The display parameter setting module 516 selects one or more display parameters 600 corresponding to the eye position 700 for one type of display parameter. For example, if the eye positions 700 include each of a right eye position 700R and a left eye position 700L, the display parameter setting module 516 sets the display parameter 600 corresponding to the right eye position 700R, the display parameter 600 corresponding to the left eye position 700L, can be selected. On the other hand, the eye position 700 is, for example, a predetermined one of the right eye position 700R and the left eye position 700L, one of the right eye position 700R and the left eye position 700L that can be detected (easily detected), or If there is one position calculated from the right eye position 700R and the left eye position 700L (for example, the midpoint between the right eye position 700R and the left eye position 700L), the display parameter setting module 516 creates one display corresponding to the eye position 700. Parameters 600 may be selected. Note that the display parameter setting module 516 may also select the display parameter 600 corresponding to the eye position 700 and the display parameters 600 set around the eye position 700 . That is, display parameter setting module 516 may select three or more display parameters 600 corresponding to eye position 700 .

Graphics module 518 of FIG. 6 includes various known software components for performing image processing, such as rendering, to generate image data, and to drive display 50 . The graphics module 518 also controls the type, placement (positional coordinates, angle), size, display distance (in the case of 3D), visual effects (for example, brightness, transparency, saturation, contrast, or and other visual characteristics), may include various known software components. The graphic module 518 stores image type (one of the display parameters), image position coordinates (one of the display parameters), image angles (pitch angle with the X direction as the axis, yaw rate with the Y direction as the axis, It is one of the display parameters, such as the rolling angle about the Z direction, and the size of the image (one of the display parameters). Device 20 may be driven.

Light source driving module 520 includes various known software components for performing driving of directional light source unit 60 . Based on the spot lighting area SP set by the spot lighting area setting module 514, the display parameter 600 set by the display parameter setting module 516, and the brightness set by the light adjustment value setting module 524, which will be described later, A directional light source unit 60 may be driven.

Actuator drive module 522 includes various known software components for performing driving first actuator 28 and/or second actuator 29. Based on set display parameters 600, actuator drive module 522: A first actuator 28 and a second actuator 29 can be driven.

The operations of the processing processes described above may be implemented by executing one or more functional modules of an information processing device such as a general purpose processor or an application specific chip. These modules, combinations of these modules, and/or combinations with known hardware that can replace their functions are all within the scope of protection of the present invention.

The functional blocks of vehicle display system 10 are optionally implemented in hardware, software, or a combination of hardware and software to carry out the principles of the various described embodiments. 6 may optionally be combined or separated into two or more sub-blocks to implement the principles of the described embodiments; will be understood by those skilled in the art. Accordingly, the description herein optionally supports any possible combination or division of the functional blocks described herein.

(Second embodiment)
FIG. 10 is a diagram showing the configuration of a directional light source unit 60A according to the second embodiment. FIG. 11 is a diagram showing one aspect of the light source array 80A shown in FIG. The directional light source unit 60 is composed of a field lens 77A and a light source array 80A in which a plurality of light sources (in this embodiment, 81 as shown in FIG. 11) are arranged in an array. The light source array 80A (planar illumination unit SE) includes m (m>n) partial regions D (partial regions D in this embodiment are 121 from D(1,1) to D(11,11). ), and the display control device 30 partially directs the strong display light K to the spot lighting area SP corresponding to the partial viewing area E in which the eye position detected by the eye position detection unit 411 exists. By driving (partially driving) the light source, as in the case of the directional light source unit 60A described above, the image (virtual image V) is visually recognized by the observer. You can avoid directing the light to the

Field lens 77A is arranged on the optical path of the illumination light emitted from the light source arranged in each partial region D between light source array 80A and light modulation element 51 . The second field lens 77 of this embodiment is composed of one or more field lenses, and the illumination laser beam 74 diffused by each partial region D of the light diffusion optical system 80 covers the entire surface of the light modulation element 51. Front stage optics (backlight optics) designed for transillumination. Further, the field lens 77A allows the display light K emitted from the light modulation element 51 to pass through the virtual image optical system 90 (the HUD optical member composed of the relay optical system 40 and the front windshield 2) to an arbitrary position within the eyebox 200. It is designed to reach the partial viewing zone E at the position.

The diffusion plate 78 is arranged on the optical path of the illumination light between the light modulation element 51 and the field lens 77A. The diffusion plate 78 diffuses the received illumination light and emits it to the light modulation element 51 . As a result, luminance unevenness in the display light K generated by the illumination light emitted from the plurality of light emitting regions DM viewed within the partial viewing area E of the eyebox 200 can be reduced. The diffuser plate 78 may be any optical member that has a function of diffusing light, and its surface is composed of, for example, a bead member, a fine concave-convex structure, or a rough surface. Also, a dot sheet or a transparent milky white sheet may be used.

In the light source array 80A of the present embodiment, one light source such as an LED is arranged in each of the m partial regions D (a plurality of light sources may be arranged). Illumination light emitted from the light source is applied to the entire surface of the light modulation element 51 after passing through the field lens 77 and the diffuser plate 78, and after the light-modulated display light K passes through the virtual image optical system 90, it A predetermined area within a predetermined eyebox 200 corresponding to the partial area D is illuminated.

The relationship between the vertical length PV and the horizontal length PH of the light emitting region DM will be described with reference to FIGS. 11, 12A, and 12B. 11, 12A, and 12B have different light emission patterns, but if a bounding box that includes all of a group of partial regions D that emit light at a predetermined light intensity or more is defined as a light emission region DM, then FIGS. 11 and 12A , and FIG. 12B are the same. The horizontal direction of the light-emitting region DM corresponds to the horizontal direction (X-axis direction) of the eyebox 200, and the vertical direction of the light-emitting region DM corresponds to the vertical direction (Y-axis direction) of the eyebox 200. FIG. In this embodiment, the horizontal length PH of the light emitting region DM is set to be at least twice the vertical length PV. As a result, the horizontal length of the spot lighting area SP corresponding to the light emitting area DM is set to approximately twice or more the vertical length. As a result, while the vertical direction of the spot lighting area SP is reduced to suppress the power of the light source, the horizontal direction of the spot lighting area SP is increased to maintain the desired image (virtual image) even if the eye position 700 moves in the horizontal direction. can be visually recognized with a brightness of

That is, in some embodiments, the width of the spot lighting area SP may be set wider than the partial viewing zone E. Furthermore, in some embodiments, the length of the spot lighting area SP in the horizontal direction may be set to twice the partial viewing zone E or more. Specifically, the vertical length of the partial viewing area E is 26 [mm] and the horizontal length is 10 [mm], while the vertical length of the spot lighting area SP is 52 [mm]. , so that the length in the horizontal direction is 20 [mm], the arrangement of the light emitting region DM, the adjustment (balance) of the light intensity emitted by the light emitting region DM, and / or the whole or partial optical adjustments are made.

13A-13D illustrate partial viewing areas of an eyebox and locations where display light based on illumination light emitted from each partial area of a directional light source unit is collected, according to some embodiments. It is a figure which shows the modification of relationship.

In the example of FIG. 13A , the directional light source unit 60 arranges the partial areas D so that five different locations within one partial viewing area E can be illuminated. Specifically, there are 1 point in the center of the partial viewing area E and 4 points in the 4 corners of the partial viewing area E, totaling 5 points. In one aspect shown in FIG. 13A , the display control device 30 controls the directional light source unit 60 so that the display light K is applied to all five different locations within the partial viewing area E where the eye position 700 exists. The light emitting area DM includes a main partial area DA that emits illumination light that is the source of the display light K condensed at the center of the partial viewing area E where the eye position 700 exists, and the eye position 700 exists in the main partial area DA. and a sub-partial area DB that emits illumination light that is the source of the display light K that is condensed at a position away from the center of the partial viewing area E. That is, when the left eye position 700L exists in the partial viewing area E(4,3), the main partial area DA is the partial area D(8,6), and the secondary partial area DB is the partial area D(7,5). ), D(9,5), D(7,7), and D(9,7). On the other hand, when the right eye position 700R exists in the partial viewing area E(2,3), the main partial area DA is the partial area D(4,6), and the secondary partial area DB is the partial area D(3,5). ), D(5,5), D(3,7), and D(5,7).

In the example of FIG. 13B, the directional light source unit 60 arranges the partial areas D so that three different locations within one partial viewing area E can be illuminated. Specifically, there are three positions in total, one in the center of the partial viewing zone E and two out of the four corners of the partial viewing zone E. In one aspect shown in FIG. 13B , the display control device 30 controls the directional light source unit 60 so that the display light K is emitted to all three different locations within the partial viewing area E where the eye position 700 exists. The light emitting area DM includes a main partial area DA that emits illumination light that is the source of the display light K condensed at the center of the partial viewing area E where the eye position 700 exists, and the eye position 700 exists in the main partial area DA. and a sub-partial area DB that emits illumination light that is the source of the display light K that is condensed at a position away from the center of the partial viewing area E. That is, when the left eye position 700L exists in the partial viewing area E(4,3), the main partial area DA is the partial area D(8,6), and the secondary partial area DB is the partial area D(7,5). ), and D(9,7). On the other hand, when the right eye position 700R exists in the partial viewing area E(2,3), the main partial area DA is the partial area D(4,6), and the secondary partial area DB is the partial area D(3,5). ), and D(5,7).

In the example of FIG. 13C, the directional light source unit 60 arranges the partial areas D so that four different locations within one partial viewing area E can be illuminated. Specifically, four points at the four corners of the partial viewing area E. FIG. In one aspect shown in FIG. 13C , the display control device 30 controls the directional light source unit 60 so that the display light K is emitted to all four different locations within the partial viewing area E where the eye position 700 exists. The light-emitting area DM does not include the main partial area DA that emits the illumination light that is the source of the display light K condensed at the center of the partial viewing area E where the eye position 700 exists, and is closer to the eye position 700 than the main partial area DA. It includes only the sub-partial area DB that emits the illumination light that is the source of the display light K condensed at a position away from the center of the partial viewing area E in which . That is, when the left eye position 700L exists in the partial viewing area E(4,3), there is no main partial area DA, and the subareas DB are the partial areas D(7,5), D(9,5), D(9,5) and D(9,5). (7,7), and D(9,7). On the other hand, when the right eye position 700R exists in the partial viewing area E(2,3), there is no main partial area DA, and the subareas DB are divided into partial areas D(3,5), D(5,5), D (3,7), and D(5,7).

In the example of FIG. 13D, the directional light source unit 60 arranges the partial areas D so that two different locations within one partial viewing area E can be illuminated. Specifically, two locations other than the four corners of the partial viewing area E are selected. In one aspect shown in FIG. 13D , the display control device 30 controls the directional light source unit 60 so that the display light K is emitted to all two different locations within the partial viewing area E where the eye position 700 exists. The light-emitting area DM does not include the main partial area DA that emits the illumination light that is the source of the display light K condensed at the center of the partial viewing area E where the eye position 700 exists, and is closer to the eye position 700 than the main partial area DA. is located away from the center of the partial viewing area E in which is present, and includes only the sub-partial area DB that emits the illumination light that is the source of the display light K condensed at a position that is not on the boundary of the partial viewing area E. That is, when the left eye position 700L exists in the partial viewing area E(4,3), there is no main partial area DA, and the secondary partial area DB is the partial area D(7.5,6) which is not the boundary of the partial viewing area E. ), and D(8.5,6). On the other hand, when the right eye position 700R exists in the partial viewing area E(2,3), there is no main partial area DA, and the secondary partial area DB consists of partial areas D(3.5,6) and D(4.5). , 6).

The light source element 60 (60A) of some embodiments has a main portion that emits illumination light for directing the display light K to the center of the partial viewing zone E, as shown in FIGS. 4B, 13A, and 13B. It may have an area DA. In this case, the processor 33 may set the light emitting pattern so that the light emitting area DM includes the main partial area DA that emits the illumination light for directing the display light to the center of the partial viewing area E.

Also, the light source element 60 (60A) of some embodiments is designed to direct the display light to the center of the partial viewing zone E, as shown in FIGS. 4B, 13A, 13B, 13C, and 13D. It has two or more sub-partial regions DB whose positions where the illumination light can be emitted are point-symmetrical. In this case, the processor 33 is configured so that the light-emitting area DM includes two or more sub-partial areas DB which are symmetrical about the position where the illumination light for directing the display light to the center of the partial viewing area E can be emitted. Set the lighting pattern.

Also, the light source element 60 (60A) of some embodiments provides illumination light for directing the display light to the center of the partial viewing zone E, as shown in FIGS. 4B, 13A, 13B, and 13C. The above two or more sub-partial areas DB whose emission positions are point-symmetrical may be arranged at positions where the illumination light for directing the display light to the boundary of the partial viewing area E can be emitted.

Also, the light source element 60 (60A) of some embodiments provides illumination light for directing the display light to the center of the partial viewing zone E, as shown in FIGS. 4B, 13A, 13B, and 13C. Illumination light for directing the display light to two or all four corners of the four corners of the partial viewing area E that are point-symmetrical about the above-mentioned two or more sub-partial areas DB whose output positions are point-symmetrical. You may arrange|position in the position which can be emitted.

The light source element 60 (60A) of some embodiments has a main partial area DA that emits illumination light for directing the display light to the center of the partial viewing area E, as shown in FIGS. 13C and 13D. Instead, it is also possible to have only the two or more sub-partial areas DB with point-symmetrical positions from which the illumination light can be emitted so that the display light is directed to the center of the partial viewing area E. FIG.

It should be noted that the arrangement of the partial regions D in the light source element 60 (60A) does not need to be arranged regularly as a whole. may be different from the position corresponding to the periphery of . In addition, the arrangement of the partial area D in the light source element 60 (60A) is made up of a position corresponding to the center (and its periphery) of the eyebox 200 in the left-right direction and a position corresponding to the periphery of the eyebox 200 in the left-right direction. can be different. Further, the arrangement of the partial area D in the light source element 60 (60A) is divided into a position corresponding to the vertical center (and its periphery) of the eyebox 200 and a position corresponding to the vertical periphery of the eyebox 200. can be different.

In addition, in the above embodiment, the light source element 60 (60A) has m partial areas D, which are more than n partial viewing areas E, but the present invention is not limited to this. That is, the number of partial viewing zones E (n) and the number of partial areas D (m) may be equal.

Further, in the above-described embodiment, the display control device 30 (processor 33) changes the size of the light-emitting region DM in the planar illumination unit SE based on the eye position (Z-axis coordinate) in the front-rear direction of the vehicle 1. However, it is not limited to this. The display control device 30 (processor 33), in addition to the front-back eye position (Z-axis coordinate) of the vehicle 1, (1) the left-right eye position (X-coordinate) of the vehicle 1, (2) the up-down eye position of the vehicle 1 The size of the light-emitting region DM in the planar illumination unit SE may be changed based on the direction eye position (Y coordinate), (3), or a combination thereof (X coordinate, Y coordinate). .

FIG. 14 is a diagram showing one mode of the first light emitting region and the second light emitting region in the planar lighting unit before and after the spot area reduction process. In some embodiments, the processor 33 extracts the light emitting area DM corresponding to the spot lighting area SP from the second light emitting area DM2 (corresponding to the second spot lighting area SP2) to the first spot lighting area SP2. (Spot area reduction processing S170), and the light intensity of at least a part of the first light emitting area DM1 may be increased ( light intensity increase processing). In the light intensity increasing process, the light intensity of the main partial area DA (open circle in FIG. 14) of the first light emitting area DM1 is increased, and the light intensity of the sub partial area DB of the first light emitting area DM1 ( It may also include a mode in which the light intensity of (marked with an open square) is not increased (maintained). Conversely, the light intensity increasing process increases the light intensity of the sub-partial regions DB of the first light-emitting region DM1 (marked with open squares in FIG. 14), and increases the light intensity of the main partial region of the first light-emitting region DM1. A mode in which the light intensity of DA (the hollow circle in FIG. 14) is not increased (maintained) may be included. According to this aspect, the light intensity increasing process for increasing the light intensity of at least a part of the first light emitting area DM1 is executed in combination with the light emitting area reducing process for reducing the light emitting area DM, thereby reducing the virtual image V to the desired value. , the light utilization efficiency can be improved while displaying with a dimming value of .

In the spot area reduction process S170 in some embodiments, the light intensity increase process may increase the light intensity of the entire first light emitting region DM1. According to this embodiment, the light intensity increasing process increases the light intensity of the main partial area DA (the hollow circle in FIG. 14) of the first light emitting area DM1, The light intensity of the partial area DB (the hollow square mark in FIG. 14) is also increased.

In some embodiments, the processor 33 determines that the average light intensity in the first light emitting region DM1 after the spot area reduction processing S170 is equal to the average light intensity in the second light emitting region DM3 before the spot area reduction processing S170. You can set it higher. According to this embodiment, the average of the light intensity of the first light emitting region DM1 after the spot area reduction processing S170 (the hollow circle and the hollow square in FIG. 14) is the average of the light intensity before the spot area reduction processing S170. The light intensity is made higher than the average of the light intensity of the second light emitting region DM2 (the hollow circles, the hollow squares, and the hollow triangles in FIG. 14).

Further, in the spot area reduction processing S170 of some embodiments, the processor 33 gradually reduces the light intensity of the second light emitting region DM2 that is not included in the first light emitting region DM1 in the spot area reduction processing S170. You may let According to this embodiment, the light intensity of the second light emitting region DM2 (marked with a hollow triangle in FIG. 14) not included in the first light emitting region DM1 is gradually reduced. As a result, depending on the eye position 700 of the observer, observation can be made in the partial viewing zone E corresponding to the first light emitting region DM1 (marked with a hollow triangle in FIG. 14) not included in the second light emitting region DM2 or in the vicinity thereof. When there is a person's eye position 700, the sharp drop in luminance of the virtual image V due to the sharp drop in the light intensity of the first light emitting region DM1 not included in the second light emitting region DM2 is visually recognized. can be prevented

1: Vehicle 2: Front windshield (projected part)
3: non-specular reflection element 10: vehicle display system 20: HUD device 21: light exit window 22: housing 28: first actuator 29: second actuator 30: display control device 31: I/O interface 33: processor 35 : Image processing circuit 37 : Memory 40 : Relay optical system 41 : First mirror 42 : Second mirror 50 : Display 51 : Light modulation element 52 : Display surface 60 : Directional light source unit (light source element)
60A: Directional light source unit (light source element)
64: average interpupillary distance 70: light source 74: illumination laser beam 75: scanning device 76: first field lens 77: second field lens 77A: field lens 78: diffusion plate 80: light diffusion optical system 80A: light source Array 81 : Lens array 82 : Hologram recording medium 90 : Virtual image optical system 200 : Eyebox 200A : Boundary 205 : Eyebox center 401 : Vehicle ECU
403: road information database 405: own vehicle position detection unit 407: vehicle exterior sensor 409: operation detection unit 411: eye position detection unit (line-of-sight direction detection unit)
415 : Brightness sensor 417 : Personal digital assistant 419 : External communication device 502 : Eye position detection module 504 : Eye position estimation module 506 : Eye position prediction module 508 : Eye position state determination module 510 : Activation determination module 512 : Release condition determination Module 514 : Spot lighting area setting module 516 : Display parameter setting module 518 : Graphic module 520 : Light source driving module 522 : Actuator driving module 524 : Dimming value setting module 600 : Display parameter 700 : Eye position 700L : Left eye 700R : Right eye D : Partial area DA : Main partial area DM : Light emitting area DM1 : First light emitting area DM2 : Second light emitting area DM3 : Second light emitting area DMC : Light emitting area DML : Left eye light emitting area DML1 : First left eye light emitting area Light-emitting area DML2: Second left-eye light-emitting area DMR: Right-eye light-emitting area DMR1: First right-eye light-emitting area DMR2: Second right-eye light-emitting area E: Partial viewing area K: Display light K1: First display light K2: Second display light K3: Third display light Kp: Optical axis Ld: Light quantity distribution Ld1: Light quantity distribution Lth: Predetermined threshold value S160: Start-up light emission processing S170: Spot area reduction processing SP: Spot lighting area SP1: First display light Spot lighting area SP2: Second spot lighting area SPC: Spot lighting area SPL: Left eye spot lighting area SPR: Right eye spot lighting area V: Virtual image VS: Virtual image display area VS1: Upper end VS2: Lower end

Claims (12)

a light source element (60, 60A) having a plurality of partial areas (D) and capable of emitting illumination light for each partial area (D);
a light modulation element (51) that modulates the illumination light incident from the light source element (60, 60A) and emits it as display light;
a condensing optical system for condensing the illumination light emitted from the different partial regions (D) toward different regions within the eyebox (200) for each display light modulated by the light modulation element (51); (2, 40, 77, 77A), and a head-up display device (20) for allowing an observer to visually recognize a virtual image from within the range of the eyebox by projecting the display light onto a projection target part. In a display control device (30) that controls
Information about the eye position of the observer (hereinafter referred to as eye position information) or information capable of estimating the eye position (hereinafter referred to as eye position estimation information) is obtained, and the eye position information or the eye position a processor (33) for controlling the light source elements (60, 60A) based at least on the estimated information;
Said processor (33)
The partial regions (D) (hereinafter referred to as light emitting regions (DM)) that emit illumination light having a predetermined light intensity or more are referred to as a first light emitting region (DM1) and the first light emitting region (DM1 ) can be set at least in the wider second light emitting area (DM2),
when the head-up display device (20) is started, executing a start-up light-emitting process in which the light-emitting region (DM) is set to the second light-emitting region (DM2);
After that, performing a reduction process for reducing the light-emitting region (DM) to the first light-emitting region (DM1);
A display controller (30). Said processor (33)
In the startup light emission process,
obtaining the eye position information and/or the eye position estimation information;
and setting the partial area (D) for directing the display light to a predetermined position indicated by the eye position information and/or the eye position estimation information as the first light emitting area (DM1). ,
After setting the first light emitting region (DM1), the light emitting region (DM) is reduced from the second light emitting region (DM2) to the first light emitting region (DM1) by executing the reduction process. reduce to
A display control device (30) according to claim 1. The processor (33), in the start-up light emission process,
gradually narrowing the light-emitting region (DM) from the second light-emitting region (DM2) to the first light-emitting region (DM1) in steps;
A display control device (30) according to claim 1 or claim 2. Said processor (33)
The average light intensity in the second light emitting region (DM2) during the light emission process at startup is set to be lower than the average light intensity in the first light emitting region (DM1) during the light emission process at startup. do,
A display control device (30) according to claim 1. Said processor (33)
Acquiring information about the right eye position and left eye position of the observer in the eye box (200) or information capable of estimating the right eye position and left eye position;
The first light emitting area (DM1) includes a right eye light emitting area (DMR) set according to the partial viewing area (E) in which the right eye position is arranged, and the partial viewing area in which the left eye position is arranged. (E) a left eye light emitting area (DML) set according to;
the second light emitting region (DM2) includes the binocular light emitting region (DMC) wider than the right eye light emitting region (DMR) and the left eye light emitting region (DML);
In the light-emitting process at startup, the light-emitting region (DM) is changed from the light-emitting region for both eyes (DMC) to the right-eye light-emitting region (DMR) and the left-eye light-emitting region (DML);
A display control device (30) according to claim 1. a light source element (60, 60A) having a plurality of partial areas (D) and capable of emitting illumination light for each partial area (D);
a light modulation element (51) that modulates the illumination light incident from the light source element (60, 60A) and emits it as display light;
a condensing optical system for condensing the illumination light emitted from the different partial regions (D) toward different regions within the eyebox (200) for each display light modulated by the light modulation element (51); (2, 40, 77, 77A), and a head-up display device (20) for allowing an observer to visually recognize a virtual image from within the range of the eyebox by projecting the display light onto a projection target part. in
Information about the eye position of the observer (hereinafter referred to as eye position information) or information capable of estimating the eye position (hereinafter referred to as eye position estimation information) is obtained, and the eye position information or the eye position a processor (33) for controlling the light source elements (60, 60A) based at least on the estimated information;
Said processor (33)
The partial regions (D) (hereinafter referred to as light emitting regions (DM)) that emit illumination light having a predetermined light intensity or more are referred to as a first light emitting region (DM1) and the first light emitting region (DM1 ) can be set at least in the wider second light emitting area (DM2),
When the head-up display device (20) is activated, the light-emitting area (DM) is changed to the first light-emitting area (DM1) after being set to the second light-emitting area (DM2). , run
A head-up display device (20). Said processor (33)
In the startup light emission process,
obtaining the eye position information and/or the eye position estimation information;
and setting the partial area (D) for directing the display light to a predetermined position indicated by the eye position information and/or the eye position estimation information as the first light emitting area (DM1). ,
After setting the first light emitting region (DM1), the light emitting region (DM) is reduced from the second light emitting region (DM2) to the first light emitting region (DM1) by executing the reduction process. reduce to
A head-up display device (20) according to claim 6. The processor (33), in the start-up light emission process,
gradually narrowing the light-emitting region (DM) from the second light-emitting region (DM2) to the first light-emitting region (DM1) in steps;
A head-up display device (20) according to claim 6 or claim 7. Said processor (33)
The average light intensity in the second light emitting region (DM2) during the light emission process at startup is set to be lower than the average light intensity in the first light emitting region (DM1) during the light emission process at startup. do,
A head-up display device (20) according to claim 6. Said processor (33)
Acquiring information about the right eye position and left eye position of the observer in the eye box (200) or information capable of estimating the right eye position and left eye position;
The first light emitting area (DM1) includes a right eye light emitting area (DMR) set according to the partial viewing area (E) in which the right eye position is arranged, and the partial viewing area in which the left eye position is arranged. (E) a left eye light emitting area (DML) set according to;
the second light emitting region (DM2) includes the binocular light emitting region (DMC) wider than the right eye light emitting region (DMR) and the left eye light emitting region (DML);
In the light-emitting process at startup, the light-emitting region (DM) is changed from the light-emitting region for both eyes (DMC) to the right-eye light-emitting region (DMR) and the left-eye light-emitting region (DML);
A head-up display device (20) according to claim 6. a light source element (60, 60A) having a plurality of partial areas (D) and capable of emitting illumination light for each partial area (D);
a light modulation element (51) that modulates the illumination light incident from the light source element (60, 60A) and emits it as display light;
a condensing optical system for condensing the illumination light emitted from the different partial regions (D) toward different regions within the eyebox (200) for each display light modulated by the light modulation element (51); (2, 40, 77, 77A), and a head-up display device (20) for allowing an observer to visually recognize a virtual image from within the range of the eyebox by projecting the display light onto a projection target part. In the display control method of
Acquiring information about the position of the observer's eyes (hereinafter referred to as eye position information) or information capable of estimating eye positions (hereinafter referred to as eye position estimation information); controlling the light source elements (60, 60A) based at least on position estimation information;
The partial regions (D) (hereinafter referred to as light emitting regions (DM)) that emit illumination light having a predetermined light intensity or more are referred to as a first light emitting region (DM1) and the first light emitting region (DM1 ) setting at least a wider second light emitting area (DM2);
When the head-up display device (20) is activated, the light-emitting area (DM) is changed to the first light-emitting area (DM1) after being set to the second light-emitting area (DM2). , including
Display control method. The start-up light emission process includes:
obtaining the eye position information and/or the eye position estimation information;
setting the partial area (D) for directing the display light to a predetermined position indicated by the eye position information and/or the eye position estimation information as the first light emitting area (DM1);
changing the light emitting region (DM) from the second light emitting region (DM2) to the first light emitting region (DM1) after setting the first light emitting region (DM1). Item 12. The display control method according to item 11.

Images