JP7082745B2 - Display device for vehicles - Google Patents

Description

The present invention relates to a vehicle display device (vehicle display system) mounted on a vehicle such as an automobile, for example.

In recent years, research and development of mirrorless vehicles in which conventional vehicle mirrors have been replaced with electronic mirrors (including electronic door mirrors) have been conducted. The electronic mirror serves as a vehicle mirror including, for example, a side mirror for confirming the rear and rear sides of the vehicle, and also has a function as a monitor for displaying an image captured by an image pickup unit provided in the vehicle. It is a display.

For example, Patent Document 1 discloses an electronic mirror mounted on a vehicle. In addition, although it is not an electronic mirror, an example of moving a display arranged in front of the driver's seat by using a guide rail is described in, for example, Patent Document 2.

Japanese Unexamined Patent Publication No. 2009-83618 Japanese Unexamined Patent Publication No. 2017-140906

For example, due to changes in the environment around the vehicle (eg day / night, lighting on / off, headlight high beam / low beam), or the driver's condition (eg degree of fatigue), the driver's note. Since the viewpoint (typical viewpoint position) and visual field range (visible range) change, the head-up display (HUD) device (first display) responds to changes in the driver's gaze point and visual field range. By changing the virtual image display distance (imaging distance) of the unit) and changing the position of the display unit (second display unit, for example, an electronic mirror), the visual convenience for the driver is improved. The present inventor has recognized that it is possible (for example, to make it easier to see).

However, on the other hand, when the virtual image display area (for example, set on the windshield as the projected member) of the HUD device (first display unit) is within the field of view of the driver, it is displayed. When the virtual image display distance (imaging distance) of the virtual image is changed, or when the electronic mirror (second display unit) that functions as a left and right side mirror is within the driver's field of view, each The present inventors have also recognized that moving each electronic mirror in order to adjust the distance between the electronic mirrors may cause a sense of discomfort to the driver and may affect driving.

Patent Document 1 and Patent Document 2 do not mention any of the above points, and neither disclosure nor suggestion is made regarding the countermeasures.

One object of the present invention is to give driving to the first and second display units without causing discomfort to the driver when making changes that may affect the driver's vision. It is to suppress the influence. Other objects of the invention will be apparent to those skilled in the art by reference to the embodiments exemplified below and the best embodiments, as well as the accompanying drawings.

Hereinafter, in order to easily understand the outline of the present invention, embodiments according to the present invention will be illustrated.

In the first aspect, the vehicle display device is
The first display unit and
The second display and
For each of the first display unit and the second display unit, the driver's vision includes at least one of moving the display unit itself, moving the display on the display unit, and changing the display form on the display unit. A first determination unit that determines whether or not changes that may affect
Whether or not the display by the first display unit or the first display unit is within the visual field of the driver is determined, and the display by the second display unit or the second display unit is performed. However, a second determination unit for determining whether or not the driver is within the visual field of the driver, and
A control unit that controls the change in each of the first display unit and the second display unit.
Equipped with
The control unit is based on the determination result of the second determination unit when the first determination unit determines that the change of the first display unit and the second display unit is necessary. Then, among the first display unit and the second display unit, those determined to be out of the driver's visual field range are subjected to the change, and those in which the change is not implemented are thereafter. , The change is made when it is determined that the driver is out of the field of view of the driver.

According to the first aspect, when the driver (user) is not looking at the first and second display units when making changes that may affect the driver's vision, each of them. By making changes to the display unit, it is possible to reduce the feeling of discomfort to the driver and suppress the influence on driving.

Note that "changes that may affect the driver's vision" include movement of the display unit itself (for example, the display unit moves along the width direction of the vehicle, etc.) and movement of the display unit on the display unit. (For example, the position where the display is made moves in one display, the virtual image displayed by the HUD device moves along the traveling direction of the vehicle due to the change in the virtual image display distance, etc.), and Changing the display form on the display unit (for example, enlarging / reducing the image so that the driver can easily see it, changing the brightness of the image, changing the background color, making it a three-dimensional image, an icon, etc. It is a change that includes at least one of (changing the outer shape, adding an auxiliary display, changing the layout of image elements, changing the type of presentation information, etc.). In other words, they may be alone or in combination thereof.

Further, in the second aspect, which is subordinate to the first aspect,
The first display unit is a head-up display (HUD) device that makes a driver visually recognize a virtual image of the image by projecting an image onto a projected member provided in the vehicle.
The second display unit is at least one display unit.
The change in the first display unit is to move the virtual image as a display of the head-up display device by changing the virtual image display distance, which is the distance to the virtual image with respect to a predetermined position. It is a change including at least one of changing the display form in the first display unit.
The change in the second display unit is at least one of moving the second display unit, moving the display in the second display unit, and changing the display form in the second display unit. It may be a change including.

In the second aspect, the first display unit is a head-up display (HUD) device, the second display unit is at least one display unit, and the change in the HUD device is a virtual image due to a change in the virtual image display distance. Movement (for example, changing to display the virtual image closer to the driver at night by making the virtual image display distance shorter than daytime), changing the display form (for example, enlarging / reducing the virtual image to improve visibility, virtual image) Change the brightness of, change the background color, make a virtual image a three-dimensional image, change the outer shape of an icon, add an auxiliary display, change the layout of image elements, change the type of presentation information, etc.) Changes to the display include at least one, and changes to the display itself (eg, movement in the width direction of the vehicle), movement of the display (or display area) within one display (eg, one). It may be a change including at least one of (effective when the occupied area of the display is relatively large) and changing the display form.

While driving, the driver can be roughly divided into whether he is looking forward through the windshield or at least one indicator such as an instrument or an electronic mirror. When he is looking forward, he is looking forward. Generally, the virtual image displayed by the HUD device (or the virtual image display area of the HUD device) is within the field of view of the driver, the display (and the display of the display) is out of the field of view, while the driver is at least one. When looking at the display, it is considered that the virtual image (or virtual image display area) displayed by the HUD device is out of the visual field range. Therefore, changes to the HUD device are made when the virtual image displayed by the HUD device is out of the field of view, changes are made to the display when the display is out of the field of view, and changes are made to each display unit. By performing these individually and at distributed timings, the change can be completed without causing discomfort to the driver. In other words, by performing the process of transitioning the display position and display form so that the optimum information can be presented outside the driver's gaze area, it is possible to carry out the process reasonably while reducing the discomfort given to the driver. It will be possible.

Further, in the third aspect subordinate to the first or second aspect,
The change in the first display unit and the second display unit is caused by at least one of a change in the environment around the vehicle, a change in the state of lighting provided in the vehicle, and the state of the driver. It may be carried out in response to changes in the driver's gaze point and visual field range.

In the third aspect, the above-mentioned "change that may affect the driver's vision" is a change in the environment around the vehicle (for example, day / night) and a change in the state of lighting provided in the vehicle (for example). Corresponds to changes in the driver's gaze point and visual field range depending on at least one of the lighting on / off, headlight high beam / low beam, etc., and the driver's condition (for example, the degree of fatigue). ) Is to be carried out. Since such changes do not require responsiveness (quickness) such as changes for notifying danger, the changes are distributed in a period not seen by the driver. By doing so, the change can be completed while reducing the burden on the driver (particularly the visual burden).

Further, in the fourth aspect subordinate to the second or third aspect,
The at least one display as the second display unit serves as a vehicle mirror including a side mirror for confirming the rear and rear sides of the vehicle, and is an image captured by the image pickup unit provided in the vehicle. It may be an electronic mirror having a function as a monitor for displaying.

In the fourth aspect, the second display unit is an electronic mirror, and by appropriately making the above changes to the electronic mirror, a display that is easier to see for the driver is provided in response to various situations. This can improve the convenience of the driver (especially the visual convenience).

Further, in the fifth aspect, which is subordinate to any one of the second to fourth aspects,
The at least one indicator as the second indicator includes a first indicator and a second indicator.
In the near future, the control unit may use the first display and the second display even if both the first display and the second display are out of the driver's field of view. If any one of the indicators in the above is expected to be within the field of view of the driver, the change in the one is not performed and the movement of the one is not performed. It may be carried out after one of the above is out of the field of view of the driver.

In the fifth aspect, when the first and second indicators are provided as the second indicator, at some point, both the first indicator and the second indicator are out of the driver's field of view. However, considering, for example, the navigation display displayed by the HUD device (for example, the display of an arrow prompting a left turn), in the near future, the driver's field of vision will be directed to one of the indicators, for example. , It may be predicted that only one of the indicators will be within the visual field range (eg, peripheral vision). In this case, if the change is started for one of the indicators, inconvenience such that the movement of the indicator in the middle of the change can be seen when the driver's line of sight is changed may occur.

Therefore, in such a case, one of the indicators is not changed (in other words, only the other indicator is changed), and the change of the other indicator is later changed from the driver's field of view. Perform when it is out of range. As a result, it is possible to avoid the above-mentioned inconvenience (for example, the inconvenience that the change of the display is visually recognized in the peripheral visual field and gives the driver a sense of discomfort).

Further, in the sixth aspect, which is subordinate to the second to fifth aspects,
When the control unit intends to make the change to the head-up display device as the first display unit, the virtual image displayed by the head-up display device is within the field of view of the driver. Even in this case, if the state in which the virtual image is within the visual field range continues for a predetermined time or longer, the change may be carried out.

In the sixth aspect, when the driver keeps looking forward, the virtual image of the head-up display (HUD) device remains within the driver's field of view, and when a predetermined time elapses, the HUD device is described. Change (moving the virtual image by changing the virtual image display distance, changing the form of the virtual image, etc.). As mentioned above, it is not preferable to make a change when the virtual image (display area of the virtual image) is in the visual field range, but if the change is not made even after a predetermined time has passed, there is a demerit (for example, surroundings). The inability to properly display a virtual image in response to changes in the environment imposes a burden on the driver, etc.), but outweighs the benefits of suspending changes. Therefore, in this case, the HUD device is changed. This makes it possible to avoid the above-mentioned inconvenience.

Further, in the seventh aspect, which is subordinate to the sixth aspect,
When the change in the head-up display device is to change the virtual image display distance to move the virtual image, the control unit changes the virtual image display distance at a speed different from the normal speed. You may do so.

In the seventh aspect, when the change in the sixth aspect is the movement of the virtual image due to the change of the virtual image display distance (imaging distance), the driver moves the virtual image (substantially, the head-up display). (HUD) The virtual image as a display of the device will move along the traveling direction of the vehicle), so in order to reduce the discomfort at that time, the virtual image display distance is usually changed. Do it at a speed different from the speed of. In other words, by accelerating the change, the time required for the change can be shortened, and by making the change so slowly that the driver cannot see it, the discomfort that the driver feels can be reduced.

In the eighth aspect, which is subordinate to the second aspect,
In the case where the change in the head-up display device as the first display unit is to change the virtual image display distance to move the virtual image.
While the control unit is changing the virtual image display distance, the second determination unit determines that the virtual image displayed by the head-up display device is within the field of view of the driver. In case,
Stop the change of the virtual image display distance at that timing,
Or,
At that timing, the change in the virtual image display distance is stopped, and then the virtual image display distance is changed at a speed slower than the normal speed.
Or,
At that timing, the speed of change in the virtual image display distance is made faster than the speed of the previous change, thereby accelerating the change.
Or,
At that timing, the virtual image is temporarily erased, and then, when it is determined by the second determination unit that the virtual image is not within the field of view of the driver even if the virtual image is displayed again, the virtual image is displayed. It may be displayed at the position when the change of the distance is completed.

In the eighth aspect, the driver's line of sight changes while the virtual image as a display of the head-up display (HUD) device is being moved by changing the virtual image display distance, and the virtual image enters the viewing range. In that case, the change is temporarily stopped, or after the change is temporarily stopped, the virtual image display distance is changed at a speed slower than the normal speed, or the change is accelerated at that point, or the virtual image is erased. After that, when it is determined that the virtual image does not fall within the viewing range even if the virtual image is displayed again, the virtual image is redisplayed at the position when the change of the virtual image display distance is completed. As a result, it is possible to suppress the driver's discomfort and deterioration of visibility.

Those skilled in the art will readily appreciate that the embodiments according to the invention exemplified may be further modified without departing from the spirit of the invention.

1 (A) to 1 (F) show a head-up display (HUD) device as a first display unit and a display device (electronic mirror) as a second display unit of the vehicle display device of the present invention. It is explanatory drawing for demonstrating an example of the case of making the change which may affect the driver's vision for each of. 2 (A) to 2 (D) show the first and second indicators when one of the two indicators is predicted to be in the driver's field of view in the near future. It is explanatory drawing for demonstrating the example of the change about the display part. 3 (A) to 3 (F) show the first and second cases where the virtual image displayed by the HUD device as the first display unit remains within the visual field of the driver for a predetermined time or longer. An example of the change for each display unit is shown. 4 (A) to 4 (G) show a virtual image in the visual field range of the driver while the virtual image display distance (imaging distance) of the virtual image displayed by the HUD device as the first display unit is being changed. It is explanatory drawing for demonstrating the example of the change about the HUD apparatus in the case of entering the inside. 5 (A) to 5 (C) are explanatory views for explaining the mode of modification of the two indicators as the second display unit. FIG. 6A shows an example of switching control of the virtual image display surface of the multi-sided HUD device, FIG. 6B shows a configuration example of a main part of the multi-sided HUD device, and FIG. 6C shows an optical system. An example of a position control signal for controlling the position of is shown. It is a figure which shows an example of the appearance of the vehicle which adopted the electronic mirror. It is a figure which shows an example of the structure of the display device for a vehicle of this invention. It is a flowchart which shows an example of the procedure of the change processing about the 1st and 2nd display part in the display device for a vehicle of this invention. In the flowchart which shows an example of the processing procedure when the virtual image enters within the field of view of the driver in the middle of changing the virtual image display distance in the HUD device as the 1st display part in the vehicle display device of this invention. be.

The best embodiments described below have been used to facilitate understanding of the present invention. Accordingly, one of ordinary skill in the art should note that the invention is not unreasonably limited by the embodiments described below.

First, a specific example of the change process in the vehicle display device (or also referred to as “vehicle display system”) of the present invention will be described with reference to FIGS. 1 to 4.

1 (A) to 1 (F) show a head-up display (HUD) device as a first display unit and a display device (electronic mirror) as a second display unit of the vehicle display device of the present invention. It is explanatory drawing for demonstrating an example of the case of making the change which may affect the driver's vision for each of.

In FIG. 1A, for example, just before sunset, the vehicle 2 is traveling on a straight road 9. The vehicle display device provided in the vehicle 2 includes a HUD device (not shown in FIG. 1, see reference numeral 10 in FIG. 8) as a first display unit. The HUD device 10 projects an image (display light of an image) onto a windshield (windshield) 6 as a projected member (translucent member), whereby the driver 1 holding a steering wheel (for example, a steering wheel). Make the virtual image visible in front. As the projected member, various members such as a combiner can be used in addition to the windshield 6.

The HUD device 10 displays a virtual image on a virtual image display surface (see FIG. 6A) set forward. In the example of FIG. 1A, the virtual image is a vehicle speed display SP of "55 km / h". This vehicle speed display SP is displayed inside the virtual image display area 7 set on the surface of the windshield 6. The virtual image is visually recognized by the driver 1 in front of the windshield 6, but the driver 1 is looking at the virtual image through the windshield 6, and therefore, FIG. 1 ( In the example of A), it can be considered that the virtual image display area 7 is set on the surface of the windshield 6.

Further, the vehicle 2 is provided with at least one display as a second display unit, specifically, first and second display units 120a and 120b. The first and second display devices 120a and 120b are provided on the instrument panel 118 on the lower side of the windshield 6, and are composed of, for example, a liquid crystal display device or the like. Here, the first and second indicators 120a and 120b serve as a vehicle mirror including, for example, side mirrors for confirming the rear and rear sides of the vehicle 2, and are imaged by an image pickup unit provided in the vehicle. An electronic mirror (electronic door mirror) that functions as a monitor for displaying images. Specifically, the first and second indicators 120a and 120b are electronic mirrors (left electronic side mirrors and right electronic side mirrors) that function as left and right side mirrors, respectively. However, the present invention is not limited to this. Further, the inner rear view mirror (rearview mirror) 125 shown in FIG. 1A may also be an electronic mirror.

In FIG. 1A, the first and second indicators (specifically, the left electronic side mirror and the right electronic side mirror) 120a and 120b are arranged at the left and right ends of the instrument panel 118, respectively. Has been done. Further, in FIG. 1A, the driver 1 is gazing at the front (particularly, the vehicle speed display SP), so that the vehicle speed display SP (and the virtual image display area) 7 as a virtual image is the field of view of the driver 1. It is within the range (indicated by the dashed line in the figure).

In other words, as shown in FIG. 1 (B), the virtual image (vehicle speed display) SP on the virtual image display surface PS set in front of the windshield 6 is forward from the driver 1's eye (viewpoint) A. It is within the field of view that gradually expands toward. On the other hand, the two indicators (first and second indicators, specifically, the right electronic side mirror and the left electronic side mirror) 120a and 120b as the second display unit are the driver 1. It is out of the field of view.

Next, reference is made to FIG. 1 (C). In FIG. 1C, for example, the sun goes down and it becomes night, and the headlights (see reference numerals 5a and 5b in FIG. 7) provided in the vehicle 2 are turned on. Here, it is assumed that the headlights 5a and 5b are in a low beam state. In the daytime (including dusk), the gaze point (typical viewpoint position) of the driver 1 is relatively far away, and the left and right visual fields (expansion of the field of view in the width direction of the vehicle 2) are relatively wide, but at night. When the headlights 5a and 5b are turned on, the gaze point of the driver 1 tends to gather near the range LB where the light of the headlights 5a and 5b is illuminated, and therefore the driver. The gazing point of 1 moves to a range closer to the vehicle 1 as compared with the case of daytime, and the left and right visual fields (viewing angles) are also narrowed.

Therefore, in order to respond to (adapt) such a change in the visual field range of the driver 1, the vehicle display device shortens the virtual image display distance of the virtual image (vehicle speed display SP) displayed by the HUD device 1 and also. Each of the first and second indicators (right electronic side mirror, left electronic side mirror) 120a and 120b as the second display unit should be close to the handle 3 (in other words, the distance between the indicators). Move (so that it becomes shorter). As a result, the driver 1 can reduce the burden of moving the viewpoint when viewing the display by the HUD device 1 (display by virtual image) and the display by each of the indicators 120a and 120b (display by real image), which is visually convenient. The sex improves. The virtual image display distance can be said to be, for example, the distance to the virtual image based on a predetermined position (for example, the position of the viewpoint A of the driver 1).

In FIG. 1C, the vehicle speed display SP as a virtual image is within the visual field range of the driver 1. In other words, FIG. 1 (D) corresponding to FIG. 1 (C) is the same as FIG. 1 (B), and the visual field range of FIG. 1 (A) is maintained. In this state, if the virtual image display distance of the vehicle speed display SP as a virtual image is changed, the change is visually recognized by the driver 1 and causes a sense of discomfort. The virtual image display distance of the vehicle speed display SP is not changed, only the position is changed by moving the first and second indicators (electronic side mirror for right and electronic side mirror for left) 120a and 120b as the second display unit. Is going. The first display 120a is moved from the position P1 to the position P2, and the second display 120b is moved from the position P3 to the position P4. In FIG. 1C, the movements of the first and second indicators 120a and 120b are indicated by arrows.

Next, reference is made to FIG. 1 (E). In FIG. 1 (E), the driver 1 is looking at the first and second indicators 120a or 120b whose positions have been changed, and the vehicle speed display SP as a virtual image (in other words, FIG. 1 (A)). The virtual image display area 7) is out of the field of view of the driver 1.

Using this period, the virtual image display surface PS is moved from the first position P10 to the third position P12 via the second position P11. In other words, the virtual image (vehicle speed display SP) as the display of the HUD device 10 moves so as to approach the driver 1.

In this way, taking advantage of the fact that there is a period that is not visible to the driver 1, changes to the HUD device 10 as the first display unit that may affect the driver's vision, and a second. By making changes to the first and second displays 120a and 120b as the display unit, which may affect the driver's vision, individually and at distributed timings, the driver 1 can be used. It is possible to improve the visual convenience of the vehicle display device (for example, make the display easier to see) without giving a sense of discomfort.

In the above example, "the first and second display units (HUD device 10, the first and second display units 120a and 120b which are electronic mirrors) can affect the driver's vision. The "possible changes" were "movement of the display (virtual image) in the HUD device 10" and "movement of the first and second indicators 120a and 120b (movement of the indicator itself)". It is not limited to. For example, the above "change" may affect the driver's vision, including at least one of "moving the display itself, moving the display on the display, and changing the display mode on the display". It may be "a change".

Specifically, "changes that may affect the driver's vision" include movement of the display unit itself (for example, the display moves along the width direction of the vehicle) and display on the display unit. (For example, by changing the virtual image display distance of the virtual image displayed by the HUD device, the virtual image moves along the traveling direction of the vehicle, or the position where the display is made moves in one display device. (To be done), to change the display form in the display unit (for example, enlarge / reduce the image so that the driver can easily see it, change the brightness of the image, change the background color, make it a three-dimensional image. , Changing the outer shape of an icon or the like, adding an auxiliary display, changing the layout of an image element, changing the type of presentation information, etc.). The movement of the display unit and the movement of the display will be specifically described later with reference to FIG.

Further, the above-mentioned "change that may affect the driver's vision" is not limited to the above-mentioned example. For example, a change in the environment around the vehicle 2 (for example, day / night), a change in the state of the lighting provided in the vehicle 2 (for example, on / off of the lighting, high beam / low beam of the headlight, etc.), the driver 1 It may be implemented in order to respond (adapt) to changes in the driver's gaze point and visual field range depending on at least one of the states (for example, the degree of fatigue).

The state of the driver 1 can be determined based on biological information such as a pulse or an electroencephalogram, for example. Since such changes do not require responsiveness (quickness) such as changes for notifying danger, the changes are distributed in a period not seen by the driver 1. By doing so, it is possible to complete the change while reducing the burden on the driver (particularly the visual burden).

In other words, by performing the process of transitioning the display position and display form so that the optimum information can be presented outside the driver's gaze area, it is possible to carry out the process reasonably while reducing the discomfort given to the driver. It will be possible.

Next, refer to FIG. 2 (A) to 2 (D) show the first and second indicators when one of the two indicators is predicted to be in the driver's field of view in the near future. It is explanatory drawing for demonstrating the example of the change about the display part. In FIG. 2, the same reference numerals are given to the parts common to those in FIG. This point is the same for FIGS. 3 and 4.

FIG. 2A is a diagram corresponding to FIG. 1A. However, in FIG. 2 (A), unlike FIG. 1 (A), there is a road 11 that turns to the left diagonally forward to the left, and the virtual image display area 7 is expanded as compared with FIG. 1 (A). Then, in the expanded virtual image display area 7, the arrow 13 as a navigation display prompting the driver 1 to turn left is displayed so as to be superimposed on the road 11. Further, in FIG. 2A, the vehicle speed of the vehicle 2 is decelerated to "20 km / h" because the vehicle 2 is turned left.

Further, in FIG. 2A, the first and second indicators 120a and 120b are not included in the visual field range of the driver 1. However, if both the first and second indicators 120a and 120b are moved in the same manner as in the example of FIG. 1, in the near future (for example, immediately after that), as shown in FIG. 2B, When the line of sight of the driver 1 is directed in the direction of the arrow 13 as the navigation display and the visual field range shifts to the left, the moving first display 120a enters the visual field range and the moving first display 120a enters. May be visible to driver 1. In particular, since the moving distance of the first display 120a is longer than the moving distance of the second display 120b, there is a high possibility of this.

Therefore, in FIG. 2B, the movement of the virtual image due to the change in the virtual image display distance of the virtual image (vehicle speed display SP, which is “5 km / h” here) as the display of the HUD device 10 (FIG. 1 (FIG. 1). Only the same movement as E)) and the movement of the second display 120b are carried out.

In FIG. 2C, the vehicle 2 is in the process of turning to the left, but since the first display 120a is within the field of view of the driver 1, the first display 120a is moved. Not done.

In FIG. 2D, the left turn is completed, the vehicle 2 is traveling on the road 11, and in this state, the first display 120a is out of the field of view of the driver 1. Therefore, in this period, the movement of the second display 120a is carried out.

As described above, even if both the first and second indicators 120a and 120b are out of the field of view of the driver 1, in the near future, among the first and second indicators 120a and 120b If it is predicted that one of the above will be within the field of view of the driver 1, for example, based on the navigation display or the like, no change is made to either one, and the movement of either one is not performed. By performing this after one of them is out of the field of view of the driver 1, it is possible to avoid the inconvenience of giving the driver 1 a sense of discomfort and affecting the operation of the vehicle 2.

Next, refer to FIG. 3 (A) to 3 (F) show the first and second cases where the virtual image displayed by the HUD device 10 as the first display unit remains within the visual field of the driver for a predetermined time or longer. It is explanatory drawing which shows the example of the change about each display part of. FIG. 3A is the same as FIG. 1C described above. In the example of FIG. 1, in FIG. 1 (D), the first and second indicators 120a and 120b are out of the field of view of the driver 1, but in the example of FIG. 3, it is shown in FIG. 3 (B). As described above, even after the movements of the first and second indicators 120a and 120b are completed, the driver 1 keeps his eyes on the front, and the virtual image SP as the display of the HUD device 10 is the viewing range of the driver 1. The state of being inside continues.

In this case, if such a state continues for a predetermined time or longer, as shown in FIG. 3C, the virtual image displayed by the HUD device 10 is changed (in other words, the HUD device) regardless of the visual field range. Here, the movement of the virtual image SP by changing the virtual image display distance) is carried out.

As mentioned above, it is not preferable to make a change when the virtual image (display area of the virtual image) is in the visual field range, but if the change is not made even after a predetermined time has passed, there is a demerit (for example, surroundings). The inability to properly display a virtual image in response to changes in the environment imposes a burden on the driver 1), but there is the inconvenience that the merit of suspending the change is outweighed. Therefore, in this case, the movement of the virtual image (change regarding the HUD device 10) is carried out by changing the virtual image display distance. This makes it possible to avoid the above-mentioned inconvenience. As a result, both changes to the HUD device 10 and changes to the first and second indicators 20a and 120b, as shown in FIG. 3 (D) (same as FIG. 1 (F)). Can be completed.

However, as shown in FIG. 3C, when the virtual image SP is moved by changing the virtual image display distance (imaging distance) within the visual field range of the driver 1, the driver 1 is the virtual image SP. The movement (substantially, the virtual image SP as a display of the HUD device 10 will move along the traveling direction of the vehicle 2) will be visually recognized.

Therefore, in order to reduce the discomfort that the driver 1 remembers at that time, the virtual image display distance is changed at a speed different from the normal speed. In the example of FIG. 3 (E), the period required for the change can be shortened by accelerating the change (change) of the virtual image display distance. In FIG. 3E, a thick solid arrow indicates that the moving speed of the virtual image SP is increased.

Further, in the example of FIG. 3F, the virtual image display distance is changed (changed) so slowly that the driver 1 cannot see it, thereby reducing the sense of discomfort that the driver remembers. In FIG. 3F, a thin broken line arrow indicates that the moving speed of the virtual image SP is extremely slow. In other words, by accelerating the change, the period required for the change can be shortened, and by making the change so slowly that the driver cannot see it, the discomfort that the driver feels can be reduced.

Next, refer to FIG. 4 (A) to 4 (G) show a virtual image in the visual field range of the driver while the virtual image display distance (imaging distance) of the virtual image displayed by the HUD device as the first display unit is being changed. It is explanatory drawing for demonstrating the example of the change about the HUD apparatus in the case of entering the inside.

In FIG. 4A, while the vehicle 2 is being driven, the virtual image (vehicle speed display SP displayed on the virtual image display surface PS), which is the display of the HUD device 10, becomes the first as the virtual image display distance changes. It has moved from the position P10 of the above to the second position P11. However, the movement of the virtual image SP has not been completed.

In FIG. 4B, the direction of the line of sight of the driver 1 is changed during the movement of the virtual image SP, and the virtual image SP is in the visual field range. In this case, display control as shown in FIGS. 4 (C) to 4 (G) can be performed.

In FIG. 4C, the change in the virtual image display distance is stopped at the timing (time point) when the virtual image SP enters the visual field range. In this case, the position of the virtual image SP has not reached the target third position P12, but the visibility is improved as compared with the time when the change of the virtual image display distance is started.

In FIG. 4D, the change of the virtual image display distance is stopped at that timing, and then the virtual image display distance is changed at a speed slower than the normal speed. Since the change is slow, the discomfort given to the driver 1 is reduced.

In FIG. 4 (E), the change is accelerated by making the speed of change of the virtual image display distance faster than the speed of the immediately preceding change at that timing. As a result, the time required for the virtual image SP to reach the target third position P12 can be shortened, and therefore the discomfort given to the driver 1 is reduced.

In FIG. 4F, the virtual image SP is temporarily erased at that timing (the virtual image SP disappears at the second position P11). Here, since the driver 1 did not see the virtual image SP until just before, even if the virtual image SP is erased, no particular problem occurs. After that, in FIG. 4 (G), when the virtual image SP is out of the field of view of the driver 1, in other words, even if the virtual image is displayed again, it is not within the field of view of the driver 1. (This determination is made by the second determination unit 144 in FIG. 10), the virtual image SP is displayed again at the position when the change of the virtual image display distance is completed, in other words, at the target third position P12. do. In this case, since the virtual image SP during movement cannot be seen by the driver 1, no discomfort occurs.

In this way, the change is temporarily stopped, or after the change is temporarily stopped, the virtual image display distance is changed at a speed slower than the normal speed, or the change is accelerated at that point, or the virtual image is erased. After that, when it is determined that the virtual image does not fall within the visual field range even if the virtual image is displayed again, the virtual image is redisplayed at the position when the change of the virtual image display distance is completed, so that the driver feels uncomfortable. , And the decrease in visibility can be suppressed.

Next, refer to FIG. 5 (A) to 5 (C) are explanatory views for explaining the mode of modification of the two indicators as the second display unit. In FIG. 5, the same reference numerals are given to the parts common to the above-mentioned figures. This point is the same for FIGS. 6 to 8.

As shown in FIG. 5A, the first and second indicators (specifically, the left electronic side mirror and the right electronic side mirror) 120a and 120b as the second indicator are respectively. It is supported by the first and second movable belts VB (a) and VB (b).

Here, when the first motor drive unit 110a drives the first stepping motor MT (a), the first gear GE (a) rotates, and along with this, the first movable belt VB (a). Rotates. Along with this rotation, the first display (left electronic side mirror) 120a moves. In FIG. 1 (A), this movement is indicated by a bidirectional arrow.

Further, when the second motor drive unit 110b drives the second stepping motor MT (b), the second gear GE (b) rotates, and the second movable belt VB (b) rotates accordingly. Rotate. Along with this rotation, the second display (right electronic side mirror) 120b moves. The movement of the first and second indicators (left electronic side mirror, right electronic side mirror) 120a and 120b can be controlled independently, respectively.

Next, refer to FIG. 5 (B). In the example of FIGS. 1 to 3 described above, the first and second indicators 120a and 120b were moved (in other words, the second display unit itself was moved), but FIG. 5 In the example of (B), in one display 121 (long laterally, having a rectangular outer shape), the first display area 122a moves between the position P5 and the position P6, and the second display. Region 122b moves between position P7 and position P8. Here, the fact that the first and second display areas 122a and 122b move means that the display in the display area moves. In the example of FIG. 5B, the same effect as that of the examples of FIGS. 1 to 3 described above can be obtained. Further, in the example of FIG. 5B, since the display itself does not move, the movement mechanism as shown in FIG. 5A is unnecessary, and the effect that the configuration can be simplified can be obtained.

Further, in the example of FIG. 5C, first and second indicators 122a and 122b (each having a rectangular outer shape long in the lateral direction) are provided, and in the first indicator 122a, the first and second indicators 122a and 122b are provided. The display area 124a of 1 moves between the position P9 and the position P10, and the second display area 124b moves between the position P11 and the position P12 in the second display 122b. Also in the example of FIG. 5 (C), the same effect as the examples of FIGS. 1 to 3 and the example of FIG. 5 (B) described above can be obtained. Further, in the example of FIG. 5 (B), it is necessary to secure a large occupied area for one display, but in the example of FIG. 5 (C), the two displays 123a and 123b are separated. Therefore, even if a large occupied area cannot be secured, there is an advantage that it is easy to realize a layout that makes effective use of the vacant space.

Next, the change of the virtual image display distance will be described. As described above, the virtual image display distance can be said to be, for example, the distance to the virtual image based on a predetermined position (for example, the position of the viewpoint A of the driver 1). As a method of changing the virtual image display distance, for example, one virtual image display surface is tilted in a direction perpendicular to the road surface (including the case where the virtual image display surface is superimposed on the road surface), and the virtual image display surface is on the virtual image display surface. There is a method of changing the distance from the viewpoint A of the driver 1 to the virtual image by controlling the display position of the virtual image (specifically, the position in the vertical direction, in other words, the position along the vertical line perpendicular to the road surface). .. For example, if the virtual image display surface is tilted and the upper side is farther from the viewpoint A of the driver 1, the virtual image display distance can be increased by moving the virtual image display position upward. , If you move it downward, the virtual image display distance becomes shorter. Therefore, the virtual image display distance can be finely adjusted by controlling the display position of the virtual image. Inclining the virtual image display surface in a direction perpendicular to the road surface, for example, causes the image forming unit (reference numeral 46 in FIG. 6B) included in the HUD device to be displayed in the display light (FIG. 6B). It can be realized by tilting with respect to the traveling direction of reference numeral K). Further, as another method of changing the virtual image display distance, there is a method of switching and controlling two or more virtual image display surfaces. Hereinafter, this method will be described with reference to FIG. FIG. 6A shows an example of switching control of the virtual image display surface of the multi-sided HUD device, FIG. 6B shows a configuration example of a main part of the multi-sided HUD device, and FIG. 6C shows an optical system. An example of a position control signal for controlling the position of is shown.

The multi-layer (multi-layer) HUD device is a HUD device capable of setting a multi-faceted (three or more faces) virtual image display plane. In other words, the virtual image display distance can be changed to m ways (m is a natural number of 3 or more). In the multi-faceted HUD device, since the virtual image display surface capable of displaying the virtual image is multi-faceted, the virtual image display distance can be changed more freely, and a three-dimensional display with a sense of depth becomes possible. In addition, the size and height of the object to be displayed can be changed as appropriate to give a sense of perspective, the display position of the object can be adjusted, and the object can be made three-dimensional with depth. It is more realistic by applying geometric three-dimensional decoration processing (which can also be simply called three-dimensional decoration) such as adding shadows to objects, adopting perspective expression, and expressing the texture of objects precisely. 3D display is possible.

Regarding the display of the virtual image in this multi-faceted HUD device, for example, by adopting the switching control of the virtual image display distance according to the distinction between day and night, the burden of focusing adjustment (focusing) when the user visually recognizes the virtual image is reduced. , It is possible to reduce the load during operation.

In the example of FIG. 6A, as a virtual image display surface suitable for use at night, a first virtual image display surface for night (described as “night 1”) PS10 and a second virtual image display for night are displayed. A surface (described as "night 2") PS11 is set, and as a virtual image display surface suitable for use in the daytime, a first virtual image display surface (described as "day 1") PS12 for daytime and a daytime are used. A second virtual image display surface (described as "daytime 2") PS13 for use is set. The virtual image display distances (the reference point is the viewpoint A) for the first and second virtual image display surfaces for night are L201 and L202, respectively. The virtual image display distances for the first and second virtual image display surfaces for daytime are L203 and L204, respectively. Here, L201 <L202 <L203 <L204. Further, on each of the virtual image display surfaces PS10 to PS13, a virtual image SP for displaying the vehicle speed, which is information of non-superimposed content that does not need to be superimposed on the actual scene, is displayed. It is also possible to display a virtual image as information of the superimposed content superimposed on the actual scene.

In FIG. 6A, the HUD device 10 projects (projects) an image (display lights K (1) to K (4) for displaying an image onto a windshield 6 as a projected member (translucent member). ), And as a result, the driver 1 can visually recognize the virtual image SP.

Next, refer to FIG. 6 (B). The HUD device 10 includes a position control signal generation unit 91, a virtual image display distance control unit 24 (including a lens drive unit 93 and a screen drive unit 95), a lens 44, and an image display surface 47 on which an image M is displayed. It includes an image display unit 46, an image processing unit 51, and a light source unit 53 (including a light source driving unit 55 and a light source 57). The position control signal VPC generated by the position control signal generation unit 91 is supplied to the lens drive unit 93 and the screen drive unit 95 of the virtual image display distance control unit 24, and is also supplied to the light source drive unit 55 at the same time.

The virtual image display distance control unit 24 sets the screen 46 (and the lens 44) as the image display unit in a predetermined range (here, in the direction along the optical axis of the screen 46 as the image display unit (in other words, the direction along the optical path)). Then, by vibrating in the distance range LZ), the optical path length from the screen 46 as the image display unit (more specifically, the image display surface 47 on which the image M is displayed) to the projected member 6 is periodically set. Change to. Further, the light source driving unit 55 of the light source unit 53 controls the emission timing of the light from the light source (laser light source LD) 57, so that the image M is displayed on the image display surface 47 of the screen 46 as the image display unit. Timing is controlled.

Here, when the virtual image display surface corresponding to each of the virtual image display distances that can be changed in m ways is the first to m virtual image display surfaces, the screen 46 (and the lens 44) as the image display unit is within a predetermined range. In (LZ), control is performed by vibrating at a predetermined cycle, control of the display timing of the image on the display surface 47 of the screen 46 as the image display unit, and control of changing the display content synchronized with the control of the display timing (combination). It is possible to display a desired virtual image on each of the first to mth virtual image display surfaces having different virtual image display distances.

The position control signal VPC generated by the position control signal generation unit 91 is, for example, a sawtooth-shaped (saw-shaped) voltage signal (sawtooth wave voltage signal) as shown in FIG. 6 (c). In 6 (c), the time t is set on the horizontal axis and the voltage v is set on the vertical axis. When the voltage of the position control signal VPC is 0, the screen 46 as the image display unit is located at the first position PT0, and when the voltage of the position control signal VPC is the peak value, the screen 46 as the image display unit is located. Is located at the second position PT1.

Here, as shown in FIG. 6C, an image (“55 km / h”) to be displayed on the first (night 1) virtual image display surface PS10 for night is displayed at time t1, and at time t2, at night. Image to be displayed on the second (night 2) virtual image display surface PS11 for daytime (“55 km / h”), and displayed on the first (daytime 1) virtual image display surface PS12 for daytime at time t3. By displaying (“55 km / h”) and displaying the image (“55 km / h”) to be displayed on the second (day 2) virtual image display surface PS13 for daytime at time t4, FIG. 6 (A). ) Is realized to display a virtual image (vehicle speed display SP).

Next, refer to FIG. 7. FIG. 7 shows an example of the appearance of a vehicle using an electronic mirror. The vehicle 2 includes headlights 5a and 5b, a windshield 6, an external light sensor (illuminance sensor) 101 for measuring external light intensity (illuminance), a left rear imaging camera 102a (imaging range Z1), and a right. It has a rear imaging camera 102b (imaging range Z2) and a peripheral imaging camera 160 that captures an actual view of the surroundings of the vehicle 2 (here, the front, in other words, the Z-axis direction).

Next, refer to FIG. FIG. 8 shows an example of the configuration of the vehicle display device of the present invention. In FIG. 8, the same reference numerals are given to the parts common to the above-mentioned figures.

The vehicle display device includes a HUD device 10 (including a virtual image display distance control unit 24 and a display control unit 52) as a first display unit, an external light sensor (illuminance sensor) 101, and a left rear image pickup camera. 102a, right rear imaging camera 102b, image generation unit (for left side) 104a, image generation unit (for right side) 104b, display control unit (for left side) 106a, display control unit (for right side) The moving mechanism described with reference to FIG. 5A for moving the 106b, the first and second displays 120a and 120b as the second display unit, and the respective displays 120a and 120b (described here). Is omitted) and.

Further, the vehicle display device is attached to the pupil imaging camera 130 that detects the direction of the line of sight by detecting the movement of the eye (viewpoint) A of the driver 1 and the biometric information (here) on the left arm of the driver 1. Then, the biological information acquisition unit 132 that measures (detects) the pulse information), the visual field detection unit 140, and the above-described "HUD device 10 and the first and second displays 120a and 120b. The first determination unit 141 that determines the necessity of "changes that may affect the driver's vision" and outputs the signals G1 and G2 indicating the determination results, and the visual field range (near range in the line-of-sight direction). A signal indicating whether or not each of the determination unit 142, the display (imaginary image) of the HUD device 10 and the first and second displays 120a and 120b is within the visual field range of the driver 1 and indicates the determination result. It controls the second determination unit 144 that outputs D1 and D2, and "changes that may affect the driver's vision for the HUD device 10 and the first and second indicators 120a and 120b". It has a control unit 150 (including a display control unit 152 and a HUD control unit 154).

The vehicle display device includes a surrounding image pickup camera 160, an image analysis unit 162, a vehicle information acquisition unit 164, a wireless communication unit 166, and an ECU (electronic control unit) 168 that controls the operation of each unit of the vehicle 2. , Have.

As described above, the vehicle display device includes the first display unit (here, the HUD device 10) and the second display unit (here, the first and second display units 120a and 120b as electronic side mirrors). And, for each of the first and second display units (HUD device 10, first and second display units 120a and 120b), the display unit itself is moved, the display is moved in the display unit, and the display form in the display unit is changed. A first determination unit 141 and a first display unit (HUD device) that determine whether or not a change that may affect the driver's vision is necessary, including at least one of the factors. Alternatively, it is determined whether or not the display by the first display unit (the virtual image SP displayed by the HUD device 10) is within the visual field range of the driver 1, and the second display unit (first and second displays) is used. Second, it is determined whether or not the display by the device 120a, 120b) or the second display unit (the image displayed on each display surface of each display 120a, 120b) is within the visual field range of the driver 1. The above changes (which may affect the driver's vision) regarding the determination unit 144 and the first and second display units (HUD device 10, first and second display units 120a and 120b). It has a control unit 150 that controls a certain change).

The control unit 150 is determined by the first determination unit 141 that the above changes are necessary for the first and second display units (HUD device 10, the first and second display units 120a and 120b). In this case, based on the determination result of the second determination unit 144, the driver 1 of the first and second display units (HUD device 10, the first and second indicators 120a and 120b) Those that are determined to be out of the visual field range are made to carry out the above changes, and those that are not changed at this time are subsequently determined by the second determination unit 144 to be out of the visual field range of the driver 1. If so, have the above changes implemented.

Further, the display control unit 152 included in the control unit 150 supplies the movement control signals G1 and G2 of the display to the first and second motor drive units 110a and 110b, respectively, and the control signals G3 in the display form. Each of the G4s is supplied to the display control unit (for the left side) 106a and the display control unit (for the right side) 106b.

Here, each of the first and second motor drive units 110a and 110b operates according to the movement control signals G1 and G2 of the displayed display to drive the stepping motors MT (a) and MT (b). do. As a result, the first and second indicators 120a and 120b are moved to predetermined positions.

Further, the display control unit (for the left side) 106a and the display control unit (for the right side) 106b operate according to the sent control signals G3 and G4 of the display form, respectively, and for example, the first and second displays. Enlarge / reduce the image displayed on the devices 120a and 120b, adjust the brightness, change the background color, make the image three-dimensional, change the outline of the image, add an auxiliary image, etc. The visibility of the display is improved by changing the layout of the image elements and changing the type of presentation information. The display control unit (for the left side) 106a and the display control unit (for the right side) 106b may be provided in the control unit 150.

Further, the HUD control unit 154 included in the control unit 150 supplies information G5 about the content displayed by the HUD device 10 to the second determination unit 144. In the example of FIG. 2 described above, it was predicted that the line of sight of the driver 1 would be changed in the near future based on the navigation display and the like, but the information of this navigation display is included in the above information G5. It has been. Therefore, the second determination unit 144 can make the above prediction.

Further, the HUD control unit 154 included in the control unit 150 supplies the display control signal G6 to the display control unit 52 of the HUD device 10, and the virtual image display distance control signal G7 controls the virtual image display distance of the HUD device 10. Supply to section 24 (see FIG. 6B for this configuration). As a result, the content of the display (virtual image) of the HUD device 10 is changed, and the switching control of the virtual image display distance as shown in FIG. 6A is performed.

According to the vehicle display device having such a configuration, the first and second display units (HUD device 10, the first and second display devices 120a and 120b) can affect the driver's vision. When the driver 1 makes a change when the driver 1 is not looking at the change, the change is made for each display unit, so that the driver 1 is less likely to feel uncomfortable, and the influence on the driving is reduced. It is suppressed.

Further, as described above, the "change that may affect the driver's vision" includes "movement of the display unit itself", and specifically, the indicators 120a and 120b are in the width direction of the vehicle 2. Includes moving along etc.

Further, as described above, "changes that may affect the driver's vision" include "movement of the display in the display unit", and specifically, for example, the display can be displayed in one display unit. The position to be moved moves (examples of FIGS. 5B and 5C), or the virtual image SP displayed by the HUD device 10 changes along the traveling direction of the vehicle 2 due to a change in the virtual image display distance. Includes moving (example of FIG. 6 (A)).

Further, as described above, the "change that may affect the driver's vision" includes "changing the display form in the display unit", and specifically, for example, the driver 1 visually recognizes the image. Enlarge / reduce the image to make it easier, change the brightness of the image, change the background color, make it a three-dimensional image, change the outline of icons etc., add auxiliary display, change the layout of image elements It includes processing such as changing the type of presented information. However, it is not limited to these.

Further, the "change that may affect the driver's vision" may be one in which the above processing is performed alone, or one in which two or more processings are used in combination. For example, when the first and second display units 120a and 120b are moved due to the night, the display brightness is lowered or the image is enlarged for easy viewing. By performing the change in parallel, the visual burden on the driver 1 can be further reduced.

Next, refer to FIG. FIG. 9 is a flowchart showing an example of a procedure for changing the first and second display units in the vehicle display device of the present invention. Here, an example in which the vehicle display device has a HUD device 10 as a first display unit and at least one display devices 120a and 120b as a second display unit (previously, FIGS. 1 to 3 are used). The main procedure example will be described with respect to the example described above.

First, information for determining the necessity of change (for example, ambient external light intensity information, vehicle information on headlight on / off and high beam / low beam, driver's biological information, etc.) is acquired (step 1). Next, it is determined whether or not the change (“change that may affect the driver's vision regarding the first and second display units” described above) is necessary (step S2). For example, as in the example of FIG. 1B, it is presumed that the driver's visual field is narrowed due to the headlights being turned on at night, or the driver's visual field is exhausted. If it is estimated that the range has become narrower, it is determined that a change is necessary.

Next, in the case of Y in step S2, the driver's line-of-sight information is detected (step S3), and then the first display unit is within the visual field range determined based on the detected line-of-sight information. It is determined whether the display (virtual image) of the HUD device is included, or whether at least one indicator, which is the second display unit, is included (step S4).

If the HUD device is within the visual range in step S4, the HUD device as the first display unit is not changed, but the display unit as the second display unit is changed (step S5). ). Subsequently, it is determined whether or not the change for the HUD device for which the change is suspended can be carried out (step S6). In the case of Y in step S6, the display (virtual image) of the HUD device is changed (movement of the virtual image by changing the virtual image display distance (imaging distance)) (step S7).

If it is N in step S6, it is determined whether or not a predetermined time has elapsed from the time when the change is suspended (step S8), if it is N in step S8, it returns to step S6, and if it is Y, it is predetermined. Along with the measures, a change in the display (virtual image) of the HUD device (movement of the virtual image by changing the virtual image display distance (imaging distance)) is carried out (step S9). The "predetermined measure" is, for example, to move the display (virtual image) of the HUD device at a speed different from the normal speed, and specifically, as in the example of FIG. 3 (E), the virtual image. Measures to accelerate the change in the display distance and shorten the time required for the change, or, as in the example of FIG. 3 (F), change the virtual image display distance so slowly that the driver cannot see it, and the driver. These are measures to reduce the discomfort that people remember.

In step S4, if at least one display unit as the second display unit is within the visual field range, the process proceeds to step S10. In step S10, what is in the field of view (or is presumed to be in the field of view in the near future, as in the example of FIG. 2) is all of at least one indicator (eg, FIG. 1). -In the case of the example of FIG. 3, whether it is a part of the display (both the first display 120a and the second display 120b) or a part of the display (first display 120a, second display). Whether it is one of the vessels 120b) is determined.

In step S10, it is determined that what is in the visual field range (or is presumed to be in the visual field range in the near future) is a part of the display (for example, the first display 120a). Then, the display (virtual image) of the HUD device is changed (virtual image) without changing a part of the display (first display 120a) (moving the display in the examples of FIGS. 1 to 3). (Movement of virtual image in the examples of FIGS. 1 to 3) and change of "other display (second display 120b)" outside the field of view (movement of the display in the examples of FIGS. 1 to 3). ).

Here, when it is determined in step S10 that all of the indicators are within the visual field range, changes to all of the indicators (both the first and second indicators 120a and 120b) are suspended. If it is determined in step S10 that a part of the display is within the visual field range, the part of the display (here, the first display 120a) is changed. It has been suspended and has not been implemented.

In step S12, it is determined that the display for which the change is suspended (both of the first and second displays 120a and 120b, or the first display 120a) can be changed, and in the case of N. In the case of Y, the determination in step S12 is repeated, and in the case of Y, the process proceeds to step S13, and changes (here, movement of the display) for the display whose change is suspended are carried out.

Next, refer to FIG. FIG. 10 is an example of a processing procedure when a virtual image enters the driver's field of view during the change of the virtual image display distance in the HUD device as the first display unit in the vehicle display device of the present invention. It is a flowchart which shows.

First, the virtual image display distance (imaging distance) of the HUD device is changed (step S20). Next, it is determined whether or not the display (virtual image) of the HUD device is within the visual field range during the change (step S21). In step S21, in the case of N, the process proceeds to step S23, and it is determined whether or not the change of the virtual image display distance (imaging distance) is completed (step S23). Return, in the case of Y, the change is completed.

If it is Y in step S21, the process proceeds to step S22. In step S22, as a countermeasure against the fact that the display (virtual image) of the HUD device is within the viewing range during the change of the virtual image display distance (imaging distance), "the change is temporarily stopped at that timing" or "After stopping once, change the virtual image display distance at a speed slower than normal speed", or "accelerate the change at that point", or "erase the virtual image and then display the virtual image again" However, when it is determined that the virtual image is not within the viewing range, the virtual image is redisplayed at the position when the change of the virtual image display distance is completed. " As a result, the driver's discomfort and deterioration of visibility are suppressed.

Although the present invention has been described above using the embodiments thereof, the present invention is not limited to these embodiments, and various modifications and applications are possible. For example, in the examples of FIGS. 1 to 3, the "movement of the virtual image (change of the virtual image display distance)" for the HUD device is carried out at the time of transition from day to night (in other words, due to changes in the surrounding environment). It is implemented in response), but it is not limited to this. For example, when the headlights are switched from high beam to low beam, the surrounding environment does not change at night, but the driver's gaze point is closer to the vehicle, so the field of view changes. The movement of the virtual image (change of the virtual image display distance) may be carried out in response to this change (in this case, the change in the state of lighting provided in the vehicle). In addition to changes in the surrounding environment or lighting conditions in the vehicle, changes in the driver's physical condition, fatigue level, etc. are also taken into consideration, and the visual field range fluctuates based on a comprehensive judgment. The above changes may be made when it is presumed to be. Further, in the above embodiment, the display moves along the width direction of the vehicle, but the moving direction is not particularly limited.

Further, the present invention can be applied to a display device for vehicles in general (including ships, aircraft, etc.). When applied to vehicles in general, the "driver" in the above description corresponds to a "steerer", a "driver", and the like.

As described above, according to the present invention, when the vehicle display device includes the first and second display units, the display of each display unit or each display unit is out of the driver's field of view. By making changes to each display unit individually and at distributed timings at a certain time, the changes can be completed without causing discomfort to the driver. In other words, by performing the process of transitioning the display position and display form so that the optimum information can be presented outside the driver's gaze area, it is possible to carry out the process reasonably while reducing the discomfort given to the driver. It is possible.

The present invention is not limited to the above-mentioned exemplary embodiments, and those skilled in the art will be able to easily modify the above-mentioned exemplary embodiments to the extent included in the claims. ..

1 ... Driver (user), 2 ... Vehicle (vehicle), 3 ... Handle (steering wheel), 5a, 5b ... Rear-view mirror, 6 ... Projected member (windshield, etc.) ), 7 ... Virtual image display area on the windshield, 9 ... Road, 10 ... HUD device as the first display unit, 11 ... Road, 24 ... Virtual image display distance of the HUD device Control unit, 52 ... Display control unit of HUD device 52, 101 ... External light sensor (illumination sensor), 102a, 102b ... Left rear or right rear image pickup camera, 104a, 104b ... Image generation unit (For left side or right side), 106a, 106b ... Display control unit (for left side or right side), 118 ... Instrument panel, 120 (120a, 20b) ... First display Display as a unit (first display, second display), 125 ... inner rear view mirror (rearview mirror), 130 ... pupil imaging camera, 132 ... biometric information acquisition unit, 140. The line-of-sight detection unit, 141 ... the first determination unit, 142 ... the determination unit of the viewing range (near range in the line-of-sight direction), 144 ... the second determination unit, 150 ... the control unit, 152 ... Display control unit, 154 ... HUD control unit, 160 ... Surrounding (front) image pickup camera, 162 ... Image analysis unit, 164 ... Vehicle information acquisition unit, 166 ... Wireless Communication unit, 168 ... ECU.

Claims (8)

The first display unit and
The second display and
For each of the first display unit and the second display unit, the driver's vision includes at least one of moving the display unit itself, moving the display on the display unit, and changing the display form on the display unit. A first determination unit that determines whether or not changes that may affect
Whether or not the display by the first display unit or the first display unit is within the visual field of the driver is determined, and the display by the second display unit or the second display unit is performed. However, a second determination unit for determining whether or not the driver is within the visual field of the driver, and
A control unit that controls the change in each of the first display unit and the second display unit.
Equipped with
The control unit is based on the determination result of the second determination unit when the first determination unit determines that the change of the first display unit and the second display unit is necessary. Then, among the first display unit and the second display unit, those determined to be out of the driver's visual field range are subjected to the change, and those in which the change is not implemented are thereafter. , The change is made when it is determined that the driver is out of the field of view.
A display device for vehicles characterized by this. The first display unit is a head-up display device that makes a driver visually recognize a virtual image of the image by projecting an image onto a projected member provided in the vehicle.
The second display unit is at least one display unit.
The change in the first display unit is to move the virtual image as a display of the head-up display device by changing the virtual image display distance, which is the distance to the virtual image with respect to a predetermined position. It is a change including at least one of changing the display form in the first display unit.
The change in the second display unit is at least one of moving the second display unit, moving the display in the second display unit, and changing the display form in the second display unit. Changes to include,
The vehicle display device according to claim 1. The change in the first display unit and the second display unit is caused by at least one of a change in the environment around the vehicle, a change in the state of lighting provided in the vehicle, and the state of the driver. It is carried out in response to changes in the driver's gaze point and visual field range.
The vehicle display device according to claim 1 or 2. The at least one display as the second display unit serves as a vehicle mirror including a side mirror for confirming the rear and rear sides of the vehicle, and is an image captured by the image pickup unit provided in the vehicle. An electronic mirror that functions as a monitor to display
The vehicle display device according to claim 2 or 3, wherein the display device is for a vehicle. The at least one indicator as the second indicator includes a first indicator and a second indicator.
In the near future, the control unit may use the first display and the second display even if both the first display and the second display are out of the driver's field of view. If any one of the indicators in the above is expected to be within the field of view of the driver, the change in the one is not carried out and the movement of the one is not performed. The vehicle display device according to any one of claims 2 to 4, wherein the display device is performed after any one of the above is out of the field of view of the driver. When the control unit intends to make the change to the head-up display device as the first display unit, the virtual image displayed by the head-up display device is within the field of view of the driver. Even in this case, according to any one of claims 2 to 5, the change is carried out when the state in which the virtual image is within the visual field range continues for a predetermined time or longer. Display device for vehicles. When the change in the head-up display device is to change the virtual image display distance to move the virtual image, the control unit changes the virtual image display distance at a speed different from the normal speed. The vehicle display device according to claim 6, wherein the display device is for a vehicle. In the case where the change in the head-up display device as the first display unit is to change the virtual image display distance to move the virtual image.
While the control unit is changing the virtual image display distance, the second determination unit determines that the virtual image displayed by the head-up display device is within the field of view of the driver. In case,
Stop the change of the virtual image display distance at that timing,
Or,
At that timing, the change in the virtual image display distance is stopped, and then the virtual image display distance is changed at a speed slower than the normal speed.
Or,
At that timing, the speed of change in the virtual image display distance is made faster than the speed of the previous change, thereby accelerating the change.
Or,
At that timing, the virtual image is temporarily erased, and then, when it is determined by the second determination unit that the virtual image is not within the field of view of the driver even if the virtual image is displayed again, the virtual image is displayed. Display at the position when the distance change is completed,
The vehicle display device according to claim 2.

Images