JP2021092609A - Windshield display device - Google Patents

Abstract

To provide a windshield display device for a vehicle that can perform display visible to an occupant even if the occupant's viewpoint is changed or plural occupants see an indication.SOLUTION: A target display luminance distribution is calculated to an occupant's viewpoint by a front luminance distribution calculation part 22 and a target display luminance distribution calculation part 24. Accordingly, even if an occupant's viewpoint is changed, easy-to-see display can be performed to the occupant. If there are plural occupants, a target display luminance distribution is calculated accordingly. Hereby, even if plural occupants see the display, easy-to-see display can be performed to the occupants.SELECTED DRAWING: Figure 1

Description

The present invention relates to a windshield display device for a vehicle, such as a windshield display (hereinafter referred to as WSD), which displays by superimposing it on a windshield in a vehicle.

Conventionally, in Patent Document 1, by controlling the gradation according to the brightness distribution of the landscape viewed from the vehicle, the visibility is maintained even when the difference in brightness between the bright portion and the dark portion included in the landscape is large. A head-up display device that can be used is disclosed. In this head-up display device, the brightness of the first outside light at the first position in the actual scene and the brightness of the second outside light at the second position in the actual scene are detected. When the brightness of the second external light is lower than the brightness of the first external light by a reference value or more, the brightness of the second position in the display image is set lower than the brightness of the first position in the display image. The image is generated.

JP-A-2018-138986

However, in the head-up display device shown in Patent Document 1, there is a possibility that erroneous correction is performed when the viewpoint of the occupant changes or when a plurality of occupants see the display.

In view of the above points, the present invention provides a WSD device for a vehicle capable of displaying a display that is easy for the occupant to see even when the viewpoint of the occupant changes or when a plurality of occupants view the display. The purpose.

In order to achieve the above object, the invention according to claim 1 is applied to a vehicle, and by displaying on a display unit (3) arranged on the windshield, the invention is superimposed on the foreground visible through the windshield. It is a windshield display device that performs a desired display, and has a front brightness distribution calculation unit (22) that calculates the front brightness distribution of the vehicle, and a front brightness distribution calculated by the occupant's viewpoint and the front brightness distribution calculation unit. Based on the display brightness distribution calculation unit (23) that calculates the display brightness distribution on the display unit suitable for the viewpoint of the occupant, and the display brightness distribution calculated by the display brightness distribution calculation unit, the display unit displays. The brightness is adjusted so that the target display brightness distribution calculation unit (24), which calculates the target display brightness distribution, which is the target brightness distribution to be performed, and the target display brightness distribution calculated by the target display brightness distribution calculation unit. It has a display luminance adjusting unit (25) for displaying on the display unit.

In this way, the target display luminance distribution is calculated according to the viewpoint of the occupant. Therefore, even if the viewpoint of the occupant changes, it is possible to display the display so that the occupant can easily see it. Further, when there are a plurality of occupants, the target display luminance distribution can be calculated correspondingly. In this way, even when a plurality of occupants see the display, it is possible to perform a display that is easy for the occupants to see.

The reference reference numerals in parentheses attached to each component or the like indicate an example of the correspondence between the component or the like and the specific component or the like described in the embodiment described later.

It is a figure which showed the schematic structure of the vehicle which mounted the WSD system which concerns on 1st Embodiment of this invention. It is a block diagram of the WSD system including the WSD apparatus. It is a flowchart which showed the detail of the display control processing. It is a figure explaining the relationship between the luminance distribution of the foreground and the luminance distribution in a display part. It is a figure explaining the relationship between the luminance distribution of the foreground and the luminance distribution in a display part. It is a figure explaining the relationship between the luminance distribution of the foreground and the luminance distribution in the display part at the time of providing the display area for displaying necessary information in a driver. It is a figure explaining the composition of the display luminance distribution when there are two occupants. It is a figure which showed the example of the case where the occupant is only a driver, and the brightness is given a gradation. It is a figure which showed the example of the case where the brightness is given a gradation when there are two occupants. It is a figure which showed the state in the case of having two image projection devices described in another embodiment. It is a figure which showed the state in the case of performing the electronic mirror display described in another embodiment.

Hereinafter, embodiments of the present invention will be described with reference to the drawings. In each of the following embodiments, parts that are the same or equal to each other will be described with the same reference numerals.

(First Embodiment)
The WSD system to which the WSD apparatus according to the first embodiment is applied will be described. The WSD system is provided in the vehicle, and by projecting a display image on the display unit provided in the windshield, various displays such as display of various information related to vehicle driving are provided to the occupants including the driver. To do.

In the WSD system shown in FIG. 1, for example, the display image can be visually recognized by the occupant by projecting the display image onto the display unit 3 of the windshield 2 from the WSD device 10 housed in the instrument panel 1 of the vehicle V. To do. The display unit 3 is configured by sandwiching the transparent screen film 3a with the laminated glass 2a and 2b constituting the windshield 2, for example. The range of the display unit 3 is arbitrary, but is, for example, the entire surface of the windshield 2. The windshield 2 provided with such a display unit 3 reflects the image projected from the WSD device 10 while having transparency through which external light is transmitted so that the driver can confirm the foreground of the vehicle V. It is visible to the driver.

The WSD device 10 is configured to include a video projection device 11 and the like. The image projection device 11 is composed of, for example, a projector using a self-luminous display, an LSM (laser scan module), or the like, and is a display device capable of projecting an image, and is arranged toward the display unit 3. The image projected by the image projection device 11 is determined based on the image data transmitted from the display control electronic control device (hereinafter, referred to as ECU) 20 which will be described later.

More specifically, as shown in FIG. 2, the WSD system is configured to include a front camera 30, an occupant sensor 40, and a vehicle state detection unit 50 in addition to the WSD device 10 having the display control ECU 20. Then, in the WSD system, various data from the front camera 30, the occupant sensor 40, and the vehicle state detection unit 50 are transmitted to the display control ECU 20, and the display control ECU 20 generates image data to be displayed on the display unit 3. .. Then, the display control ECU 20 controls the image projection device 11, so that the image of the desired display image is projected from the image projection device 11, and the image is displayed on the display unit 3 so that the occupant can visually recognize the image. It has become.

The front camera 30 corresponds to an image pickup device, captures an image of the foreground of the own vehicle, and transmits the image data as sensing information to the display control ECU 20 via an in-vehicle LAN (Local Area Network) or the like.

The occupant sensor 40 recognizes the states of the occupants in the front seats, that is, the driver's seat and the passenger seat in the vehicle, and transmits the data regarding the occupant's state to the display control ECU 20 through the in-vehicle LAN or the like. For example, the occupant sensor 40 is composed of a DSM (Driver Status Monitor), for example, a near-infrared light source and a near-infrared camera provided in the vehicle interior, a control unit for controlling them, and the like. Specifically, in DSM, the near-infrared light source irradiates the occupants in the front seat including the driver with near-infrared light, the image is taken by the near-infrared camera, and the captured image is analyzed by the control unit. , The viewpoint position of the occupant is being measured. Then, the measured viewpoint position information is output to the display control ECU 20. If the information on the viewpoint position of the occupant is only the information on the viewpoint position of the driver, it will be the information of one occupant, and if the information on the viewpoint position of the driver and the passenger seat is the information of two occupants, it will be the information of the occupant. The number of occupants can also be grasped based on the information on the viewpoint position.

The vehicle state detection unit 50 transmits data indicating the driving state of the vehicle (hereinafter, referred to as driving state data). The vehicle state detection unit 50 may be anything as long as it can convey data that can recognize whether the vehicle is driving. For example, the vehicle state detection unit 50 may be sensors such as a vehicle speed sensor and an engine speed sensor that output detection signals corresponding to the vehicle state, or an ECU that handles data such as vehicle speed and engine speed. It may be. Further, in the case of the present embodiment, various information regarding the vehicle state, for example, information such as vehicle speed, engine speed, remaining fuel amount, and water temperature is also displayed on the image display of the display unit 3. Therefore, the meter ECU or the like that handles these various types of information is used as the vehicle state detection unit 50 to transmit various types of information.

The display control ECU 20 generates and adjusts the image data of the image to be displayed on the display unit 3 based on various data transmitted from the front camera 30, the occupant sensor 40, and the vehicle state detection unit 50, and obtains the adjusted image data. The corresponding image is projected from the image projection device 11. Specifically, the display control ECU 20 includes an adjustment method switching unit 21, a front luminance distribution calculation unit 22, a display luminance distribution calculation unit 23, a target display luminance distribution calculation unit 24, and a display luminance adjustment unit 25.

The adjustment method switching unit 21 switches the adjustment method according to the number of occupants, such as whether the occupant is only the driver or is also in the passenger seat, and the vehicle state, such as whether the vehicle is driving or stopped. The details of the adjustment method that can be switched will be described later.

The front luminance distribution calculation unit 22 calculates the luminance distribution in front of the vehicle based on the image data of the foreground of the vehicle transmitted as sensing information from the front camera 30. For example, the front luminance distribution calculation unit 22 calculates the luminance distribution of each portion in front, such as the brightness being high and bright on the right side of the vehicle and the brightness being low and dark on the left side of the vehicle. The term "front" as used herein means a range of view that the occupant can see through the windshield 2. By projecting the image by the image projection device 11, the image display on the display unit 3 is superimposed on the foreground. The range on which the image display on the display unit 3 is superimposed is the field of view of the front display.

The display luminance distribution calculation unit 23 calculates the display luminance distribution suitable for the occupant's viewpoint based on the data regarding the occupant's viewpoint position transmitted from the occupant sensor 40. That is, when the viewpoint position of the occupant changes, the positional relationship between the foreground seen from the occupant's viewpoint and the display on the display unit 3 changes accordingly. Therefore, the display brightness distribution calculation unit 23 calculates the display brightness distribution so that the foreground and the brightness of the image display at each location of the display unit 3 have a suitable relationship in consideration of the viewpoint of the occupant. ..

The target display luminance distribution calculation unit 24 calculates the target display luminance distribution based on the display luminance distribution suitable for the viewpoint of the occupant calculated by the display luminance distribution calculation unit 23. Specifically, the display luminance distribution calculated by the display luminance distribution calculation unit 23 is corrected based on whether there are one or two occupants and whether or not the driver is driving. That is, when the target display luminance distribution calculation unit 24 has one occupant, the target display luminance distribution calculation unit 24 sets the display luminance distribution calculated by the display luminance distribution calculation unit 23 as it is in the target display luminance distribution. Further, in the case where the target display luminance distribution calculation unit 24 has two people, if the driver is driving, the display luminance distribution calculation unit 23 calculates the display luminance distribution suitable for the viewpoint while driving. Is performed, and the corrected display luminance distribution is set as the target display luminance distribution. Further, the target display luminance distribution calculation unit 24 corrects the display luminance distribution suitable for the viewpoint calculated by the display luminance distribution calculation unit 23 for non-driving if the driver is not driving in the case of two people. Then, the corrected display luminance distribution is set as the target display luminance distribution. The correction method here will be described later.

The display brightness adjusting unit 25 adjusts the display on the display unit 3 based on the target display brightness distribution calculated by the target display brightness distribution calculation unit 24. That is, the brightness distribution of the image projected from the image projection device 11 is adjusted so as to have the target display brightness distribution. As a result, the image of the brightness distribution corresponding to the target display brightness distribution is projected from the image projection device 11, and the brightness distribution of the display image displayed on the display unit 3 follows the target display brightness distribution. Therefore, even when the viewpoint of the occupant changes or when a plurality of occupants see the display, it is possible to display the display so that the occupant can easily see it.

Regarding the brightness adjustment corresponding to the target display brightness distribution in the image projection device 11, for example, when the image projection device 11 is composed of a self-luminous display, the output is simply multiplied by the target display brightness distribution. You can move it up and down with. Further, when the image projection device 11 is of the projector type, the light source output may be determined based on the maximum brightness and the brightness may be adjusted.

As described above, the WSD system according to the present embodiment is configured. Hereinafter, the operation of this WSD system will be described with reference to a flowchart of display control processing executed by the display control ECU 20 shown in FIG.

The display control ECU 20 executes the display control process shown in FIG. 3 at predetermined control cycles when a vehicle start switch such as an ignition switch (not shown) is switched from off to on.

First, in step S100, the occupant is detected. This process is executed based on the data regarding the state of the occupant transmitted from the occupant sensor 40. Since the data on the occupant's condition includes information on the viewpoint position of the occupant, it is possible to grasp whether the number of occupants is one or two based on the information, and the viewpoint position of the occupant. Is grasped.

Next, the process proceeds to step S105, and it is determined whether or not there is one occupant. Here, if there is only one occupant, it is sufficient to adjust the display luminance distribution in consideration of only the driver, so the processes of steps S120 to S130 are executed as the process for one person. If a negative determination is made in step S105, the process proceeds to step S110 to acquire the operating state. This process is performed by acquiring the driving state data transmitted from the vehicle state detecting unit 50. After that, the process proceeds to step S115, and it is determined whether or not the vehicle is in operation based on the operation state data acquired in step S110. Then, if an affirmative determination is made in step S115, the processes of steps S140 to S150 are executed as the processes when there are two occupants and the driver is driving. If a negative determination is made in step S115, the processes of steps S155 to S170 are executed as processes when there are two occupants and the driver is not driving.

In addition, steps S100 to S115 are processed by the adjustment method switching unit 21, and the adjustment method is switched by grasping the number of occupants and the driving state of the vehicle.

As described above, when the affirmative determination is made in step S105, the processes of steps S120 to S130 are executed as the processes for one person. Specifically, in step S120, an image of the foreground is acquired, and in step S125, the brightness distribution of the foreground is calculated. The process of step S120 is performed by acquiring the sensing information transmitted from the front camera 30. Further, the process of step S125 is performed by calculating the brightness distribution of each part of the foreground from the image data of the foreground acquired in step S120. These steps S120 and S125 are processed by the forward luminance distribution calculation unit 22.

After that, the process proceeds to step S130, a display luminance distribution suitable for the viewpoint of the occupant is calculated, and the display luminance distribution is set as it is as the target display luminance distribution. Step S130 is processed by the display luminance distribution calculation unit 23 and the target display luminance distribution calculation unit 24. The occupant assumed here is generally a driver, but may be a passenger seat occupant. That is, since the process for one person does not determine whether or not the vehicle is in operation as in step S115, it includes not only the case where the occupant is the driver but also the case where the occupant is the passenger seat occupant. Therefore, in step S130, when there is one occupant, the display luminance distribution suitable for the viewpoint of the occupant is calculated regardless of whether the occupant is a driver or a passenger seat occupant. .. Further, when there is one occupant, it is not necessary to perform the correction required when there are two occupants, so that the calculated display luminance distribution is set as it is as the target display luminance distribution. ..

Here, the display luminance distribution suitable for the viewpoint of the occupant means that the height and luminance distribution of the image display are adjusted according to the viewpoint when the image is displayed on the display unit 3 so as to be superimposed on the foreground. Means to do.

For example, as shown in FIGS. 1 and 4, regarding the brightness distribution in the foreground, it is assumed that the upper position is bright and the brightness is high, and the lower position is dark and the brightness is low. In this state, when the image is displayed on the display unit 3 so as to be superimposed on the foreground, even if the brightness is lowered for the lower position of the image display, that is, the portion corresponding to the lower position where the brightness is low in the foreground. The occupant can accurately see the image display. On the other hand, the upper position of the image display, that is, the portion corresponding to the upper position having high brightness in the foreground, is difficult for the occupant to see unless the brightness of the image display is also increased because the brightness of the foreground is high. Therefore, it is necessary to adjust the brightness distribution of the image display on the display unit 3 based on the brightness of the foreground.

Further, the positional relationship between the foreground and the image display on the display unit 3 superimposed on the foreground changes according to the viewpoint of the occupant. Therefore, the brightness distribution of the image display is calculated so that the brightness distribution is appropriate for the viewpoint of the occupant. That is, as shown in FIG. 1, the display luminance distribution is set so that the luminance distribution in front of the vehicle indicated by the image data of the foreground and the luminance distribution of the image display on the display unit 3 match with respect to the viewpoint position of the occupant. calculate.

Although FIG. 1 shows the brightness adjustment at the vertical position of the image display on the display unit 3, the same applies to the vehicle width direction. For example, in a left-hand steering wheel vehicle, as shown in FIG. 5, it is assumed that the left side of the brightness data of the foreground is dark and the brightness is low, and the right side is bright and the brightness is high. In this case, the brightness distribution of the image display on the display unit 3 is adjusted so that the brightness of the left side of the image display is lowered and the brightness of the right side of the image display is increased with reference to the viewpoint of the driver D.

At this time, for the image data of the foreground, for example, the distance from the windshield to the foreground is assumed to be a predetermined distance. A straight line connects the boundary of each part with different brightness in the foreground and the viewpoint, and each part of the foreground is divided by the straight line. Then, the brightness distribution of the image display in the display unit 3 is calculated so that the brightness of each portion partitioned by the straight line and the brightness of the region included in the division of the display unit 3 have the same relationship. For example, when the brightness of a predetermined portion of the foreground is high, the high brightness is also set for the region of the display unit 3 that is included in the straight section that divides the predetermined portion. .. As a result, the brightness distribution of the image display in the display unit 3 is calculated corresponding to each portion of the foreground partitioned by the straight line.

Here, regarding the image data of the foreground, the distance from the windshield to the foreground is assumed to be a predetermined distance, but it is not always necessary to set the predetermined distance. For example, when the distance from the image data of the foreground to the foreground can be derived, the viewpoint and each part of the foreground may be connected by a straight line based on the distance to divide each part.

As described above, the display luminance distribution suitable for the viewpoint of the occupant is calculated, and when there is one occupant, the display luminance distribution is set as the target display luminance distribution. Then, the process proceeds to step S135, and the brightness of the image display is adjusted based on the set target display brightness distribution. That is, an image having a brightness distribution corresponding to the target display brightness distribution is projected from the image projection device 11, and the brightness distribution of the display image displayed on the display unit 3 follows the target display brightness distribution. Therefore, even when the viewpoint of the occupant changes or when a plurality of occupants see the display, it is possible to display the display so that the occupant can easily see it.

Further, the processes of steps S140 to S150 are executed as the processes when the affirmative determination is made in step S115, that is, when there are two occupants and the driver is driving. In this case, the display form is different from that in the case of one occupant. Specifically, in steps S140 and S145, the foreground image acquisition process in step S120 and the foreground luminance distribution calculation process in S125 are executed. After that, in step S150, the display luminance distribution and the target display luminance distribution when there are two occupants and the driver is driving are calculated. This step S150 is also processed by the display luminance distribution calculation unit 23 and the target display luminance distribution calculation unit 24.

If there are two occupants, the driver is included in the two. For this reason, first, the display area of information that the driver wants to provide to the driver (hereinafter referred to as driver-provided information), such as information necessary for the driver to drive the vehicle and display necessary for operating the in-vehicle device, is suitable for the driver's viewpoint. Calculate the display brightness distribution.

The display area of the driver-provided information here includes a place where the driver can easily see while driving, for example, a front area of the driver in the instrument panel and a center display area. Further, the information required for the driver to drive the vehicle means various meter information such as vehicle speed, engine speed, remaining fuel amount, and water temperature. Conventionally, these meter information displays are displayed using an analog instrument such as a speedometer provided individually, but here, the image is displayed by the display unit 3. The displays required for operating in-vehicle devices include, for example, a display showing the operation status of an air conditioner (A / C), an air conditioner display such as an air conditioner operation switch, a map display of a navigation device, a route guidance display, and navigation such as an operation switch of a navigation device. It means display etc. Each of these pieces of information is not highly necessary for the passenger seat occupant, but is highly necessary for the driver in driving the vehicle. Therefore, as information provided by the driver, as a display brightness distribution suitable for the driver's viewpoint. It is calculated. Then, for the display area of the driver-provided information, the calculated display luminance distribution suitable for the driver's viewpoint is used as it is as the target display luminance distribution.

On the other hand, for an area different from the information display area required for the driver to drive the vehicle, the target display luminance distribution is calculated using the foreground luminance distribution. Various methods can be adopted for calculating the target display luminance distribution based on the foreground luminance distribution.

For example, based on the foreground luminance distribution calculated in step 145, a method of calculating the display luminance distribution for each occupant by the same method as in step S130 described above and synthesizing the calculated display luminance distribution can be adopted.

For the synthesis in that case, for example, a weighted average can be used. Regarding the coefficient in the weighted average, in other words, how to add weight, the driver side and the passenger side of the passenger seat may be equalized, or the driver side and the passenger side of the passenger seat may be prioritized. The side with the closest viewpoint of the occupant's depression may be prioritized.

Specifically, a method of calculating a target display luminance distribution based on the foreground luminance distribution for an area different from the display area while providing a display area of information necessary for the driver to drive will be described with an example. ..

As shown by hatching in FIG. 6, for example, a position corresponding to the front position of the driver among the lower positions of the display unit 3 is defined as a display area 3b of information necessary for the driver to drive the vehicle. For example, in the display area 3b, various meter information displays 3c such as vehicle speed and engine speed, navigation display 3d, and air conditioner display 3e are displayed in order from the left side of the paper. For this display area 3b, a brightness distribution suitable for the driver's viewpoint is calculated. For example, as shown in the figure, if the part of the foreground corresponding to the navigation display 3d is dark and the other parts are bright, the brightness is set low only for the navigation display 3d, and the various meter information display 3c and the air conditioner display 3e are set to be low. Set the brightness high. Then, the display brightness distribution for each occupant is calculated for the area 3f other than the display area 3b shown by hatching in the figure, and the calculated display brightness distribution is synthesized.

An example of synthesizing the display luminance distribution will be described with reference to FIG. 7. For example, as shown in FIG. 7A, it is assumed that the brightness of the foreground is in the order of "bright", "dark", "bright", "dark", and "bright" from the left side. In that case, the display brightness distribution suitable for the viewpoint of the driver D on the driver's seat side (hereinafter referred to as the driver's seat brightness distribution) is (B), and the brightness distribution suitable for the viewpoint of the passenger seat occupant P (hereinafter referred to as the passenger seat brightness distribution). Is expressed as (C).

In that case, when the coefficients of the weighted average of the driver's seat luminance distribution and the passenger seat luminance distribution, that is, the weighting is equalized and combined, the target display luminance distribution is expressed as shown in (D). Note that "medium" shown here means a brightness intermediate between the brightness of "bright" and "dark".

Further, when the visibility of the display is prioritized over the visibility of the foreground and the brighter one of the driver's seat luminance distribution and the passenger seat luminance distribution is prioritized and combined, the target display luminance distribution is expressed as shown in (E). To.

Further, when giving priority to the side closer to the viewpoint of each occupant, for example, the display unit 3 is divided into left and right halves as shown in (F). The target display luminance distribution is the driver's seat luminance distribution for the left compartment located in front of the driver's seat and the passenger seat luminance distribution for the right compartment located in front of the passenger seat. In this case, it is possible to adjust the brightness for the occupant who is likely to see it. In this way, the display luminance distribution can be combined.

Further, the display luminance distribution of the occupant on the bright side of the two occupants may be combined with the display luminance distribution of the occupant on the bright side, that is, the display luminance distribution of the occupant on the bright side may be selected and set as the target display luminance distribution. In this way, the visibility of the display can be ensured.

Further, instead of setting the combined display brightness distribution as it is as the target display brightness distribution, the display brightness distribution may be corrected and used as the target display brightness distribution in order to alleviate the amount of change in brightness in the horizontal direction. This correction can be made even when the above-mentioned occupant is one person.

For example, when the left side of the vehicle is dark and the right side is bright, as shown in FIG. 8A, if there is only one occupant, the brightness of the left side of the display unit 3 is lowered and the brightness of the right side is increased, but at the boundary position. Adds a brightness gradation that gradually changes the brightness. That is, for places where there is a difference in brightness, the brightness is gradually changed from low to high in the combined display brightness distribution. Similarly, when there are two occupants, the brightness on the left side of the display unit 3 is lowered and the brightness on the right side is increased according to each occupant as shown in FIG. 8B. Then, the portion where the brightness differs between the person on the right side and the person on the left side is set as the intermediate position, and in the intermediate position, the brightness is set to the middle of the brightness set for each occupant. Can be attached. For example, a gradation is added to the brightness at the intermediate position by performing a blurring process with a filter that matches the parallax of two occupants.

By doing so, sudden changes in brightness can be suppressed, and it is possible to prevent the occupant from becoming difficult to see the image display on the display unit 3.

In the situation of FIG. 8B, when the brightness distribution is evenly changed from the dark side to the bright side at the intermediate position, when the image display on the display unit 3 is viewed from the occupant on the right side, it is in front of the dark foreground. A bright image display may be visible. In this case, the dark foreground may be difficult to see due to the influence of the image on the bright display unit 3. Therefore, it is preferable that the brightness distribution at the intermediate position is set with priority given to making the foreground visible.

As described above, when there are two occupants and the driver is driving, the display luminance distribution suitable for the occupant's viewpoint is calculated, and the target display luminance distribution is obtained based on the display luminance distribution. Set. Then, the process proceeds to step S135, and the brightness of the image display is adjusted based on the set target display brightness distribution. That is, an image having a brightness distribution corresponding to the target display brightness distribution is projected from the image projection device 11, and the brightness distribution of the display image displayed on the display unit 3 follows the target display brightness distribution.

Here, the intermediate position is a portion where the brightness set for each occupant is different, but the foreground may be used as a reference. For example, a predetermined range centered on the boundary position between the dark position and the bright position in the foreground may be set as the intermediate position.

Further, the maximum brightness and the minimum brightness may be set for the target display brightness distribution. By doing so, it is possible to limit the difference in brightness in the display surface of the image display on the display unit 3, and it is possible to make the image display easier for the occupant to see.

Further, the brightness distribution of the image display on the display unit 3 changes from moment to moment as the foreground changes, but the amount of change in brightness per unit time is reduced so as to reduce the change in brightness over time. The limit may be set so that it is equal to or less than a predetermined value. For example, when the foreground changes suddenly on a curved road surface or the like, if the target display luminance distribution is changed according to the change in the luminance distribution of the foreground, the image display may be difficult for the occupant to see. Therefore, by limiting the amount of change in brightness per unit time, it is possible to prevent the change in the target display brightness distribution from becoming too large, and it is possible to improve the visibility of the occupant.

On the other hand, the processes of steps S155 to S170 are executed as a process when a negative determination is made in step S115, that is, when there are two occupants and the driver is not in operation. In this case, the display mode is different from that when the driver is driving. Specifically, in steps S150 and S160, the foreground image acquisition process in step S120 and the foreground luminance distribution calculation process in S125 are executed. After that, in step S165, the display luminance distribution with two occupants is calculated, and in step S170, the target display luminance distribution is calculated. These steps S165 and S170 are also processed by the display luminance distribution calculation unit 23 and the target display luminance distribution calculation unit 24.

In step S165, the display luminance distribution suitable for each occupant's viewpoint is calculated individually. For example, based on the foreground luminance distribution calculated in step 160, the display luminance distribution for each occupant is calculated by the same method as in step S130 described above. Then, in step S170, the target display luminance distribution is calculated by synthesizing the display luminance distribution of each occupant calculated in step S165. As the synthesis method at this time, the same method as in step S150 described above can be used. That is, when the driver is not driving, it is not necessary to preferentially display various information necessary for the driver to drive. Therefore, the driver and the passenger in the passenger seat are treated in the same manner, and the target display luminance distribution is calculated by simply synthesizing the display luminance distribution calculated for each occupant.

As described above, when there are two occupants and the driver is not driving, the display luminance distribution suitable for the occupant's viewpoint is calculated, and the target display luminance distribution is set based on the display luminance distribution. Will be done. Then, the process proceeds to step S135, and the brightness of the image display is adjusted based on the set target display brightness distribution. That is, an image having a brightness distribution corresponding to the target display brightness distribution is projected from the image projection device 11, and the brightness distribution of the display image displayed on the display unit 3 follows the target display brightness distribution.

As described above, in the present embodiment, the target display luminance distribution is calculated according to the viewpoint of the occupant. Therefore, even if the viewpoint of the occupant changes, it is possible to display the display so that the occupant can easily see it. In addition, when there are a plurality of occupants, the target display luminance distribution is calculated correspondingly. Therefore, even when a plurality of occupants see the display, it is possible to perform a display that is easy for the occupants to see.

Further, when there are a plurality of occupants, the target display luminance distribution corresponding to whether or not the driver is driving is calculated. Therefore, the target display brightness distribution can be competingly recorded according to the driving situation of the driver, and it is possible to perform a display that is easier for the occupant to see.

(Other embodiments)
Although the present disclosure has been described in accordance with the above-described embodiment, the present disclosure is not limited to the embodiment, and includes various modifications and modifications within an equal range. In addition, various combinations and forms, as well as other combinations and forms that include only one element, more, or less, are also within the scope of the present disclosure.

(1) For example, in the above embodiment, a horizontally long rectangular display unit 3 has been described as an example, but the shape of the display unit 3 is arbitrary.

(2) Although DSM is taken as an example of the occupant sensor 40, the presence or absence of an occupant may be detected by a simple sensor such as a seating sensor. When the occupant sensor 40 is used as the seating sensor, the data regarding the viewpoint position of the occupant is not directly transmitted from the seating sensor to the display control ECU 20, but the data indicating the presence or absence of the occupant is simply transmitted as the data regarding the state of the occupant. become. Therefore, the data indicating the presence or absence of the occupant is used as the data related to the state of the occupant, and if the data indicates the presence or absence of the occupant, the viewpoint position of the occupant is set to a predetermined position as a default value, for example. Just do it.

(3) In each of the above embodiments, when the presence of the occupants in the front row seats, that is, the driver and the passenger seat occupants is confirmed, the target display luminance distribution is calculated in consideration of all the occupants. It has become. However, this is also only an example, and only some of the occupants may be included in the calculation of the target display luminance distribution. For example, when there is an occupant who has not visually recognized the display unit 3 for a certain period of time, the target display brightness distribution may be calculated by excluding the occupant.

(4) In each of the above embodiments, the case where the image projection device 11 is configured by one has been described as an example, but two image projection devices 11 may be provided. For example, as shown in FIG. 9, as the display unit 3, a transparent screen of a Fresnel mirror type or a reflective hologram is attached to the inner surface of a windshield 2 made of laminated glass, and the first image projection device 11 is used. The projector 11a on the driver's seat side is provided on the side opposite to the driver's seat, that is, on the passenger seat side, and the focusing point of the projector 11a is taken as the viewpoint of the driver. Further, as the second image projection device 11, the projector 11b on the passenger seat side is provided on the side opposite to the passenger seat, that is, on the driver's seat side, and the focusing point of the projector 11b is taken as the viewpoint of the passenger in the passenger seat.

With such a configuration, if the images corresponding to the display luminance distribution to the driver and the images corresponding to the display luminance distribution to the passenger seat occupants are projected from the respective projectors 11a and 11b, they are individually displayed for each occupant. The brightness distribution can be adjusted.

(5) In the above embodiment, the vehicle speed, the engine speed, the remaining fuel amount, and the water temperature are mentioned as the information necessary for the driver displayed on the display unit 3 to drive the vehicle, but other information is included. You may do so. For example, the display unit 3 can also play the role of an electronic mirror device. In that case, as shown in FIG. 10, the left and right ends of the display unit 3 corresponding to the electronic mirror device can be set as the electronic mirror display 3g, and the left and right rear images of the vehicle can be displayed. When the display unit 3 plays the role of the electronic mirror device in this way, the display brightness distribution suitable for the driver's viewpoint is calculated for the electronic mirror display 3g at both left and right ends of the display unit 3. Just do it.

As shown in FIG. 10, some kind of display can be performed between the air conditioner display 3e and the electronic mirror display 3g at the right end position, for example, an audio display 3h such as an operation state of an audio device or an operation switch. In that case, the audio display 3h is complemented with an adjustment value based on the display luminance distribution around the audio display 3h so that the display does not give a sense of discomfort to the occupant between the air conditioner display 3e and the electronic mirror display 3g. For example, a correction value that gently connects the brightness distributions of the air conditioner display 3e and the electronic mirror display 3g, for example, the brightness of the audio display 3h so as to be intermediate between the brightness of the air conditioner display 3e and the electronic mirror display 3g. To set. As a result, the audio display 3h can be displayed so as not to be uncomfortable for the occupant.

Further, it can be applied not only to the display in which the position is fixed as shown in FIG. 10 but also to the temporary display such as various warning displays. In that case, as for the temporary display, as information necessary for the driver to drive the vehicle, when the display is performed, that part may also have a display luminance distribution suitable for the driver's viewpoint.

(6) In the above embodiment, the information necessary for the driver to drive the vehicle is displayed when the driver is driving, but the fact that the driver is driving means that the display is performed at the timing. It's just an example. For example, as shown in the above embodiment, the driver does not always display the information necessary for driving the vehicle during driving, but displays it only at the time of starting, or in the case of an autonomous driving vehicle, the driver from automatic driving. It may be only in a state such as when the authority is being transferred to manual operation.

(7) In the above embodiment, the description has been made assuming that the number of passengers in the front seats of the vehicle is two, but there may be a plurality of passengers such as three. In that case, the display luminance distribution may be calculated for each occupant according to the number of occupants, and the display luminance distribution may be combined to calculate the target display luminance distribution.

(8) Further, in the above embodiment, the image projection type display device using the WSD device 10 and the display unit 3 has been described as an example, but a display device other than the image projection type may be used. For example, the display unit 3 itself may be a display device composed of a transparent self-luminous display.

(9) The control unit and its method described in the present disclosure are provided by configuring a processor and a memory programmed to execute one or more functions embodied by a computer program. It may be realized by a dedicated computer. Alternatively, the controls and methods thereof described in the present disclosure may be implemented by a dedicated computer provided by configuring the processor with one or more dedicated hardware logic circuits. Alternatively, the control unit and method thereof described in the present disclosure may be a combination of a processor and memory programmed to perform one or more functions and a processor composed of one or more hardware logic circuits. It may be realized by one or more dedicated computers configured. Further, the computer program may be stored in a computer-readable non-transitional tangible recording medium as an instruction executed by the computer.

2 Windshield 3 Display unit 10 WSD device 11 Image projection device 20 Display control ECU
21 Adjustment method switching unit 22 Front brightness distribution calculation unit 23 Display brightness distribution calculation unit 24 Target display brightness distribution calculation unit 25 Display brightness adjustment unit 50 Vehicle condition detection unit

Claims (10)

A windshield display device that is applied to a vehicle and displays on a display unit (3) arranged on a windshield so as to superimpose a desired display on the foreground that is visually recognized through the windshield.
The front luminance distribution calculation unit (22) for calculating the luminance distribution in front of the vehicle, and the front luminance distribution calculation unit (22).
With the display brightness distribution calculation unit (23) that calculates the display brightness distribution on the display unit suitable for the viewpoint of the occupant based on the viewpoint of the occupant and the brightness distribution in front calculated by the front brightness distribution calculation unit. ,
A target display luminance distribution calculation unit (24) that calculates a target display luminance distribution, which is a target luminance distribution to be displayed by the display unit, based on the display luminance distribution calculated by the display luminance distribution calculation unit.
It has a display brightness adjusting unit (25) that adjusts the brightness so as to have the target display brightness distribution calculated by the target display brightness distribution calculation unit and causes the display on the display unit. Windshield display device. Enter the data regarding the condition of the occupant and
The display brightness distribution calculation unit according to claim 1, wherein the display brightness distribution calculation unit sets the viewpoint of the occupant based on the data related to the state of the occupant, and calculates the display brightness distribution on the display unit suitable for the set viewpoint. Windshield display device The display luminance distribution calculation unit calculates the display luminance distribution in correspondence with the front luminance distribution, and increases the luminance of the display luminance distribution corresponding to the location in the place where the brightness is high in the front luminance distribution. The windshield display device according to claim 1 or 2, wherein the brightness of the display brightness distribution corresponding to the place is lowered in a place where the brightness is low in the front brightness distribution. Depending on whether the number of occupants indicated by the data regarding the state of the occupants is one or a plurality, the display brightness distribution calculation unit calculates the display brightness distribution and the target display brightness distribution calculation unit calculates the target. It has an adjustment method switching unit (21) for switching the brightness adjustment method by switching the display brightness distribution calculation method.
When the number of people is one, the display luminance distribution calculation unit is based on the viewpoint of the one occupant and the front luminance distribution calculated by the front luminance distribution calculation unit, and is the viewpoint of the occupant. Calculate the display luminance distribution on the display unit suitable for
The windshield display device according to claim 3, wherein the target display brightness distribution calculation unit uses the display brightness distribution calculated by the display brightness distribution calculation unit as the target display brightness distribution. When the number of passengers is more than one, the display luminance distribution calculation unit can be used as a viewpoint for each occupant based on the viewpoints of the plurality of occupants and the front luminance distribution calculated by the front luminance distribution calculation unit. The display brightness distribution in the suitable display unit is calculated, and the display brightness distribution is calculated.
The windshield display device according to claim 4, wherein the target display brightness distribution calculation unit calculates the target display brightness distribution by synthesizing the display brightness distribution for each occupant calculated by the display brightness distribution calculation unit. The adjustment method switching unit calculates the display luminance distribution by the display luminance distribution calculation unit and the target display luminance distribution by the target display luminance distribution calculation unit during driving and non-driving of the vehicle. Switch the calculation method,
The display luminance distribution calculation unit calculates the display luminance distribution on the display unit suitable for the viewpoint of the driver for the display area of the driver-provided information which is the information provided to the driver among the plurality of occupants. Regarding the area of the display unit that is different from the display area of the driver-provided information, the viewpoint for each occupant is based on the viewpoints of the plurality of occupants and the front brightness distribution calculated by the front brightness distribution calculation unit. Calculate the display luminance distribution on the display unit suitable for
Regarding the display area of the driver-provided information, the target display luminance distribution calculation unit uses the display luminance distribution of the driver-provided information display area calculated by the display luminance distribution calculation unit as the target display luminance distribution as it is. The windshield display device according to claim 5, wherein for an area different from the display area, the target display brightness distribution is calculated by synthesizing the display brightness distribution for each occupant calculated by the display brightness distribution calculation unit. The target display brightness distribution calculation unit synthesizes the display brightness distribution for each occupant calculated by the display brightness distribution calculation unit, and the display brightness distribution of the driver among the plurality of occupants and the passenger in the passenger seat. The windshield display device according to claim 5 or 6, wherein the target display brightness distribution is calculated by a weighted average of the display brightness distribution. In the target display brightness distribution calculation unit, the display brightness distribution of the driver and the display brightness distribution of the passenger in the passenger seat are equal, priority is given to the driver side, priority is given to the occupant side of the passenger seat, and the driver and the passenger seat are given priority. The windshield display device according to claim 7, wherein the weighted average is performed by weighting any one of the occupants whose viewpoints are close to each other. The target display brightness distribution calculation unit is based on the display brightness distribution for each occupant calculated by the display brightness distribution calculation unit, and the display brightness distribution of the driver among the plurality of occupants and the display of the passenger in the passenger seat. The windshield display device according to claim 5 or 6, wherein the target display brightness distribution that gives priority to the brighter one of the brightness distributions is calculated. The target display brightness distribution calculation unit adds a gradation that gradually changes the brightness from low brightness to high brightness in the display brightness distribution at a place where there is a brightness difference with respect to the combined display brightness distribution. The windshield display device according to any one of claims 5 to 9, which calculates a display luminance distribution.

Images