WO2019044732A1

WO2019044732A1 - Display device for vehicle

Info

Publication number: WO2019044732A1
Application number: PCT/JP2018/031480
Authority: WO
Inventors: 勇希舛屋
Original assignee: 日本精機株式会社
Priority date: 2017-08-31
Filing date: 2018-08-27
Publication date: 2019-03-07
Also published as: JP7082745B2; JPWO2019044732A1

Abstract

The purpose of the present invention is to provide a display device wherein a change performed on a first display unit and a second display unit that could affect the vision of a driver is performed so as not to be distracting thereby minimizing the effect on the driver. The display device for a vehicle comprises: a first determination unit (140) for determining whether a change in relation to a first display unit and a second display unit 10, 120a, 120b is necessary; a second determination part (144) for determining whether the display units or a display on the display units are within the field of view of the driver; and a control unit (150) for controlling the change. When the first determination unit (140) has determined that a change is necessary with respect to the first display unit and the second display unit, the control unit (150) performs a change on the display unit which, from the first and the second display units, is determined to be outside the field of view of the driver on the basis of the second determination unit 144, and performs a change on the display unit on which the change was not performed when it is determined that the display unit is outside the field of view of the driver.

Description

Vehicle display device

The present invention relates to, for example, a display device for a vehicle (display system for a vehicle) and the like mounted on a vehicle such as an automobile.

In recent years, research and development have been conducted on mirrorless vehicles in which conventional vehicle mirrors are replaced with electronic mirrors (including electronic door mirrors). One type of electronic mirror plays a role of a vehicle mirror including side mirrors for checking the rear and rear sides of the vehicle, for example, and has a function as a monitor for displaying an image captured by an imaging unit provided in the vehicle. It is a display.

For example, Patent Document 1 discloses an electronic mirror mounted on a vehicle. In addition, although it is not an electronic mirror, the example which moves the indicator arrange | positioned ahead of a driver's seat using a guide rail is described, for example in patent document 2. FIG.

JP, 2009-83618, A Unexamined-Japanese-Patent No. 2017-140906

For example, the driver's note due to changes in the environment around the vehicle (eg, day / night, lighting on / off, high beam / low beam of headlights), or driver's condition (eg, degree of fatigue) Since the viewpoint (representative viewpoint position) and the visual field range (visible range) change, the head-up display (HUD) device (first display) is made to correspond to the change in the driver's gaze point and visual field range. The visual convenience for the driver is improved by changing the virtual image display distance (imaging distance) of the section) or changing the position of the display section (second display section, for example, an electronic mirror). The inventor has recognized that it is possible (for example, to make it easier to view).

However, on the other hand, when the virtual image display area (for example, set on the windshield as the projection target member) of the HUD device (first display unit) is within the visual field range of the driver, If the virtual image display distance (imaging distance) of a virtual image is changed, or an electronic mirror (second display unit) functioning as a left or right side mirror is within the driver's field of view, The present inventors also recognized that moving each electronic mirror to adjust the distance between the electronic mirrors may cause the driver to feel uncomfortable and affect the driving.

Patent Document 1 and Patent Document 2 make no mention of the above-mentioned points, and the description of the measures is neither disclosed nor suggested.

One object of the present invention is to give driving to the first and second display portions so as not to cause the driver to feel discomfort when making changes that may affect the driver's vision. To control the impact. Other objects of the present invention will become apparent to those skilled in the art by referring to the following exemplified aspects and best embodiments, as well as the attached drawings.

In the following, in order to facilitate an understanding of the summary of the invention, an embodiment according to the invention is illustrated.

In the first aspect, the display device for vehicle
A first display unit,
A second display unit,
For each of the first display unit and the second display unit, the driver's vision includes at least one of the movement of the display unit itself, the movement of the display on the display unit, and the change of the display mode on the display unit. A first determination unit that determines whether a change that may affect
It is determined whether the display by the first display unit or the display by the first display unit is within the visual field range of the driver, and the display by the second display unit or the second display unit A second determination unit that determines whether or not the driver is within the visual field range of the driver;
A control unit configured to control the change of each of the first display unit and the second display unit;
Equipped with
The control unit is based on the determination result of the second determination unit when the first determination unit determines that the change in the first display unit and the second display unit is necessary. Of the first display unit and the second display unit that are determined to be out of the driver's field of view, and for those for which the change has not been performed, And the change is implemented when it is determined that the driver's field of view is out of range.

According to the first aspect, when making a change that may affect the driver's vision on the first and second display units, each of the first and second display units may not be seen by the driver (user). Since the display unit is changed, the driver is less likely to feel discomfort, and the influence on the driving is suppressed.

Note that “changes that may affect the driver's vision” include movement of the display unit itself (for example, movement of the display along the width direction of the vehicle, etc.), movement of display on the display unit (For example, movement of a position to be displayed in one display, movement of a virtual image displayed by the HUD device along a traveling direction of a vehicle by change of virtual image display distance, etc.), Changing the display mode of the display unit (for example, enlarging / reducing an image so as to be easily recognized by the driver, changing the brightness of the image, changing the background color, forming a three-dimensional image, etc. It is a change including at least one of changing the outline, adding an auxiliary display, changing the layout of the image element, changing the type of presentation information, and the like. In other words, they may be alone or in combination.

In addition, in a second aspect dependent on the first aspect,
The first display unit is a head-up display (HUD) device that causes a driver to visually recognize a virtual image of the image by projecting the image onto a projection target provided on a vehicle.
The second display unit is at least one display unit;
Moving the virtual image as the display of the head-up display device by changing the virtual image display distance which is the distance to the virtual image with reference to a predetermined position. It is a change including at least one of changing the display mode on the first display unit,
The change in the second display unit includes at least one of movement of the second display unit, movement of a display on the second display unit, and changing of a display mode on the second display unit. It may be a change that includes.

In the second aspect, the first display unit is a head-up display (HUD) device, the second display unit is at least one display, and the change for the HUD device is a virtual image due to a change in virtual image display distance (Eg, change night display to be closer to the driver by shortening the virtual image display distance than noon), change the display mode (eg, enlarge / reduce the virtual image to improve visuality, virtual image Changing the background color, changing a virtual image to a stereoscopic image, changing the outline of an icon or the like, adding an auxiliary display, changing the layout of image elements, changing the type of presentation information, etc. At least one of them is included, and changes to the display include movement of the display itself (e.g. movement of the vehicle in the width direction), movement of the display (or display area) within one display (e.g. Effective when the occupied area of one display is relatively large), and changing the display mode, the may be changed, including at least one.

During driving, the driver can be roughly divided into looking forward through the windshield or looking at at least one indicator such as an instrument or an electronic mirror, etc. When looking forward, Generally, the virtual image displayed by the HUD device (or the virtual image display area of the HUD device) is within the driver's field of view, and the indicator (and the indicator's display) is outside the field of view, while the driver is at least one. When looking at the display, the virtual image (or virtual image display area) displayed by the HUD device is considered to be out of the visual field range. Therefore, when the virtual image displayed by the HUD device is out of the field of view, the change for the HUD device is performed, and when the display is out of the field of view, the change for the display is performed, and the change for each display unit By performing the above individually at the distributed timing, it is possible to complete the change without causing the driver to feel discomfort. In other words, by performing the processing of changing the display position and the display form so as to be able to present optimal information, it is possible to implement without awkwardness while reducing the discomfort given to the driver by performing the process outside the driver's gaze area. It becomes possible.

In addition, in a third aspect dependent on the first or second aspect,
The change in the first display unit and the second display unit may be performed by at least one of a change in an environment around the vehicle, a change in a state of illumination provided to the vehicle, and a state of the driver. It may be implemented in response to changes in the driver's gaze point and the visual field range.

In the third aspect, the above-mentioned “change that may affect the driver's vision” is a change in the environment around the vehicle (eg, day / night), a change in the state of illumination provided to the vehicle (eg, Adapts to changes in the driver's gaze point and visual field range by at least one of lighting on / off, high beam / low beam of headlights, etc., and driver's condition (eg, degree of fatigue) To be implemented). For example, since such a change does not require promptness (a promptness) such as a change for notifying a danger, the change is dispersedly performed using a period when the driver is not looking at it. By doing so, it is possible to complete the change while reducing the burden on the driver (especially, the visual burden).

In addition, in a fourth aspect dependent on the second or third aspect,
The at least one display as the second display unit plays a role of a vehicle mirror including a side mirror for checking the rear and rear sides of the vehicle, and an image captured by an imaging unit provided in the vehicle It may be an electronic mirror having a function as a monitor displaying.

In the fourth aspect, the second display unit is an electronic mirror, and the electronic mirror is appropriately modified to provide the driver with an easy-to-see display corresponding to various situations. This improves the driver's convenience (especially visual convenience).

In the fifth aspect dependent on any one of the second to fourth aspects,
At least one display as the second display includes a first display and a second display,
The control unit may control the first display and the second display in the near future even if both the first display and the second display are out of the driver's view range. If any one of the indicators is predicted to be within the visual field range of the driver, the change for either one is not performed, and either one of the movements is You may make it carry out, after any one becomes out of the visual field range of the said driver.

In the fifth aspect, when the first and second indicators are provided as the second indicator, at some point, both the first indicator and the second indicator are out of the driver's field of vision. However, considering the navigation display (for example, the display of an arrow prompting a left turn) displayed by the HUD device, the driver's gaze is directed to the side of one display in the near future, for example, It may be expected that only one of the displays will be within the field of view (eg, peripheral vision). In this case, if the change of one of the displays is started, it may be assumed that the movement of the display in the middle of the change can be seen when the driver's line of sight is changed.

Therefore, in such a case, no change is made to one of the displays (in other words, only the other display is changed), and a change to the one display is made later by the driver's view Perform when out of range. As a result, it is possible to avoid the occurrence of the above-mentioned inconvenience (for example, the inconvenience that the change of the display is visually recognized in the peripheral vision to give a sense of discomfort to the driver).

In the sixth aspect dependent on the second to fifth aspects,
The control unit is configured to cause the virtual image displayed by the head-up display device to be within the visual field range of the driver when the control unit causes the head-up display device as the first display unit to perform the change. Even in the case where the state where the virtual image is within the visual field range continues for a predetermined time or more, the change may be performed.

In the sixth aspect, when the driver keeps looking forward, the virtual image of the head-up display (HUD) device continues to be within the driver's field of view, and when a predetermined time has elapsed, A change (a movement of a virtual image by a change of a virtual image display distance, a change of a virtual image form, etc.) is performed. Although it is not preferable to change when the virtual image (display area of virtual image) is within the field of view, as described above, there is a disadvantage due to that (for example, around The inability to display appropriate virtual images in response to changes in the environment puts a burden on the driver, etc.), which outweighs the benefits of holding changes. Therefore, in this case, a change is made to the HUD device. This can avoid the occurrence of the above-mentioned inconvenience.

In addition, in a seventh aspect dependent on the sixth aspect,
When the change in the head-up display device is to move the virtual image by changing the virtual image display distance, the control unit changes the virtual image display distance at a speed different from a normal speed. You may do so.

In a seventh aspect, when the change in the sixth aspect is movement of a virtual image by change of virtual image display distance (imaging distance), the driver moves virtual image (substantially, head-up display In order to visually recognize the virtual image as the display of the (HUD) device will move along the traveling direction of the vehicle), in order to reduce the discomfort at that time, the change of the virtual image display distance is usually Do at a different speed than the speed of. In other words, by accelerating the change, the time required for the change can be shortened, and by making the change so slow that the driver can not see it, the driver can feel less discomfort.

In an eighth aspect dependent on the second aspect,
In the case where the change in the head-up display device as the first display unit is changing the virtual image display distance to move the virtual image,
While the control unit is changing the virtual image display distance, it is determined by the second determination unit that the virtual image displayed by the head-up display device has come within the visual field range of the driver In case,
Stop the change of virtual image display distance at that timing,
Or
At that timing, stop changing the virtual image display distance, and then change the virtual image display distance at a slower speed than normal speed,
Or
At that timing, accelerate the change by making the speed of change of virtual image display distance faster than the speed of the previous change,
Or
At that timing, the virtual image is erased once, and then the virtual image is displayed as a virtual image when it is determined by the second determination unit that the virtual image is not displayed within the driver's field of view even if the virtual image is displayed again. It may be displayed at the position when the change of the distance is completed.

In the eighth aspect, while moving the virtual image as the display of the head-up display (HUD) device by changing the virtual image display distance, the driver's line of sight changes, and the virtual image falls within the visual field range. In this case, stop the change temporarily, or stop it once, then change the virtual image display distance at a slower speed than the normal speed, accelerate the change at that time, or delete the virtual image. Thereafter, when it is determined that the virtual image is displayed again but not within the visual field range, processing is performed such that the virtual image is redisplayed at the position where the change of the virtual image display distance is completed. As a result, it is possible to suppress a driver's discomfort and a decrease in visibility.

Those skilled in the art will readily understand that the illustrated embodiments of the present invention can be further modified without departing from the spirit of the present invention.

FIGS. 1 (A) to 1 (F) show a head-up display (HUD) device as a first display unit and a display (electronic mirror) as a second display unit of the vehicle display device of the present invention. Is an explanatory diagram for describing an example in the case of performing a change that may affect the driver's vision. FIGS. 2A to 2D show the first and second ones when one of the two displays is predicted to be in the driver's field of view in the near future. It is an explanatory view for explaining an example of change about a display part. FIGS. 3A to 3F illustrate the first and second virtual images displayed by the HUD device as the first display unit when the virtual image continues to be within the driver's field of view for a predetermined time or more. The example of a change about each display part is shown. FIGS. 4A to 4G show that the virtual image is within the driver's field of view while changing the virtual image display distance (imaging distance) of the virtual image displayed by the HUD device as the first display unit. It is an explanatory view for explaining an example of change about a HUD device when it enters inside. FIG. 5A to FIG. 5C are explanatory diagrams for explaining a mode of change of two displays as the second display unit. 6 (A) shows an example of switching control of the virtual image display surface of the multi-surface HUD device, FIG. 6 (B) shows a configuration example of the main part of the multi-surface HUD device, and FIG. 6 (C) shows the optical system 18 shows an example of a position control signal that controls the position of It is a figure which shows an example of the external appearance of the vehicle which employ | adopted the electronic mirror. It is a figure showing an example of the composition of the display for vehicles of the present invention. It is a flowchart which shows an example of the procedure of the change process about the 1st, 2nd display part in the display apparatus for vehicles of this invention. A flowchart showing an example of a processing procedure in the case where a virtual image falls within the visual field range of the driver in the middle of changing the virtual image display distance in the HUD device as the first display unit in the vehicle display device of the present invention. is there.

The preferred embodiments described below are used to easily understand the present invention. Accordingly, one of ordinary skill in the art should note that the present invention is not unduly limited by the embodiments described below.

First, with reference to FIGS. 1 to 4, a specific example of the change process in the display device for a vehicle (or “display system for a vehicle”) of the present invention will be described.

FIGS. 1 (A) to 1 (F) show a head-up display (HUD) device as a first display unit and a display (electronic mirror) as a second display unit of the vehicle display device of the present invention. Is an explanatory diagram for describing an example in the case of performing a change that may affect the driver's vision.

In FIG. 1A, for example, the vehicle 2 is traveling on a straight road 9 immediately before the sun goes down. The display apparatus for vehicles with which the vehicle 2 is equipped is equipped with the HUD apparatus (not shown in FIG. 1, refer the code | symbol 10 in FIG. 8) as a 1st display part. The HUD device 10 projects an image (display light of the image) onto a windshield (front glass) 6 as a projection target member (a light transmitting member), and thereby the driver 1 who holds the steering wheel (for example, a steering wheel) Make the virtual image visible in front of you. In addition to the windshield 6, various members such as a combiner can be used as the projection target member.

The HUD device 10 displays a virtual image on a virtual image display surface (see FIG. 6A) set forward. In the example of FIG. 1A, the virtual image is a vehicle speed indication SP of "55 km / h". The vehicle speed display SP is displayed inside the virtual image display area 7 set on the surface of the windshield 6. In addition, although a virtual image is visually recognized by the driver 1 in front of the windshield 6, the driver 1 is looking at the virtual image through the windshield 6, so that FIG. In the example of A), it can be seen that the virtual image display area 7 is set on the surface of the windshield 6.

Further, the vehicle 2 is provided with at least one display as a second display unit, specifically, first and

second displays

120a and 120b. The first and

second displays

120a and 120b are provided on the instrument panel 118 below the windshield 6, and are configured of, for example, a liquid crystal display device or the like. Here, the first and

second displays

120a and 120b, for example, play a role of a vehicle mirror including side mirrors for checking the rear and rear sides of the vehicle 2, and imaging by an imaging unit provided in the vehicle It is an electronic mirror (electronic door mirror) having a function as a monitor for displaying an image. Specifically, the first and

second displays

120a and 120b are electronic mirrors (left electronic side mirror, right electronic side mirror) that function as left and right side mirrors, respectively. However, it is not limited to this. Further, the inner rear view mirror (back mirror) 125 shown in FIG. 1A may also be an electronic mirror.

In FIG. 1A, the first and second displays (specifically, the left electronic side mirror and the right electronic side mirror) 120a and 120b are disposed at the left and right ends of the instrument panel 118, respectively. It is done. Further, in FIG. 1 (A), the driver 1 gazes ahead (in particular, the vehicle speed display SP), and hence the vehicle speed display SP (and virtual image display area) 7 as a virtual image is the visual field of the driver 1 It is in the range (indicated by a broken line in the figure).

In other words, as shown in FIG. 1B, the virtual image (vehicle speed display) SP on the virtual image display surface PS set in front of the windshield 6 is fronted from the driver's 1 eye (viewpoint) A as a starting point. Within the field of view gradually expanding towards the On the other hand, two displays (first and second displays, specifically the right side electronic side mirror and the left side electronic side mirror) 120a and 120b as the second display unit It is out of view range.

Next, reference is made to FIG. In FIG. 1 (C), for example, the sun is down and it is at night, and the headlights (see

symbols

5a and 5b in FIG. 7) provided on the vehicle 2 are on. Here, it is assumed that the

headlights

5a and 5b are in a low beam state. In the daytime (including dusk), the gaze point (representative viewpoint position) of the driver 1 is relatively far, and the left and right views (the spread of the view in the width direction of the vehicle 2) are relatively wide. When the

headlights

5a and 5b are turned on, the gaze point of the driver 1 tends to gather in the vicinity of the range LB to which the light of the

headlights

5a and 5b is irradiated. The fixation point 1 moves to a range closer to the vehicle 1 than in the daytime, and the left and right visual fields (viewing angles) also become narrow.

Therefore, in the vehicle display device, the virtual image display distance of the virtual image (vehicle speed display SP) displayed by the HUD device 1 is shortened to cope with (adaptation to) such a change in the visual field range of the driver 1. Each of the first and second displays (right side electronic side mirror, left side electronic side mirror) 120a and 120b as the second display unit is positioned closer to the handle 3 (in other words, the distance between the displays) Move so that As a result, the driver 1 can reduce the burden of moving the viewpoint when viewing the display (display by virtual image) by the HUD device 1 and the display (display by real image) by the

respective displays

120a and 120b, and visual convenience Improves the quality. The virtual image display distance can be, for example, a distance to a virtual image based on a predetermined position (for example, the position of the viewpoint A of the driver 1).

In FIG. 1C, the vehicle speed indication SP as a virtual image is within the visual field range of the driver 1. In other words, FIG. 1 (D) corresponding to FIG. 1 (C) is the same as FIG. 1 (B), and the visual field range of FIG. 1 (A) is maintained. In this state, if the virtual image display distance of the vehicle speed display SP as a virtual image is changed, the change is visually recognized by the driver 1, which causes an uncomfortable feeling. Therefore, in FIG. The virtual image display distance of the vehicle speed display SP is not changed, and only the position change by the movement of the first and second displays (right side electronic side mirror, left side electronic side mirror) 120a and 120b as the second display part Is going. The first display 120a is moved from the position P1 to the position P2, and the second display 120b is moved from the position P3 to the position P4. In FIG. 1C, the movements of the first and

second displays

120a and 120b are indicated by arrows.

Next, FIG. 1E is referred to. In FIG. 1E, the driver 1 directs his line of sight to the first and

second indicators

120a and 120b whose positions have been changed, and the vehicle speed indication SP as a virtual image (in other words, FIG. 1A). The virtual image display area 7) in is out of the visual field range of the driver 1.

Using this period, the virtual image display surface PS is moved from the first position P10 to the third position P12 via the second position P11. In other words, the virtual image (vehicle speed display SP) as the display of the HUD device 10 moves so as to approach the driver 1.

As described above, the change that may affect the driver's vision of the HUD device 10 as the first display unit, taking advantage of the period when the driver 1 can not see, and the second By changing the first and

second displays

120a and 120b as the display units of the above, which may affect the driver's vision, separately at the distributed timing. The visual convenience of the vehicle display device can be improved (for example, the display can be easily viewed) without giving a sense of discomfort.

In the above example, “the driver's vision of the first and second display units (the first and

second displays

120a and 120b which are the HUD device 10 and the electronic mirror) can be affected. “Changes with nature” are “movement of display (virtual image) in HUD device 10” and “movement of first and

second displays

120a and 120b (movement of display itself)”. It is not limited to For example, the above-mentioned "change" may possibly affect the driver's vision including at least one of "movement of display unit itself, movement of display on display unit, and change of display mode on display unit." It may be a certain change.

Specifically, "a change that may affect the driver's vision" means movement of the display unit itself (for example, movement of the display unit along the width direction of the vehicle), display on the display unit (Eg, changing the virtual image display distance of the virtual image displayed by the HUD device causes the virtual image to move along the traveling direction of the vehicle, or the position at which the display is made to move in one display) Changing the display mode of the display unit (for example, enlarging / reducing the image so as to be easily recognized by the driver, changing the brightness of the image, changing the background color, or creating a three-dimensional image) , Change an outline of an icon, add an auxiliary display, change a layout of an image element, change a type of presentation information, and the like. The movement of the display unit and the movement of the display will be specifically described later with reference to FIG.

Further, the above-mentioned "change that may affect the driver's vision" is not limited to the above example. For example, changes in the environment around the vehicle 2 (for example, day / night), changes in the state of lighting provided for the vehicle 2 (for example, lighting on / off, high beam / low beam of headlights, etc.) It may be implemented to cope with changes in the driver's gaze point and visual field range according to at least one of the conditions (for example, the degree of fatigue).

In addition, the state of the driver 1 can be determined based on, for example, biological information such as pulse and brain waves. Since such a change does not require promptness (rapidness) such as a change for notifying a danger, for example, the change is made in a distributed manner using a period when the driver 1 is not looking at it. By doing so, it is possible to complete the change while reducing the burden on the driver (especially the visual burden).

In other words, by performing the processing of changing the display position and the display form so as to be able to present optimal information, it is possible to implement without awkwardness while reducing the discomfort given to the driver by performing the process outside the driver's gaze area. It becomes possible.

Next, FIG. 2 will be referred to. FIGS. 2A to 2D show the first and second ones when one of the two displays is predicted to be in the driver's field of view in the near future. It is an explanatory view for explaining an example of change about a display part. In FIG. 2, parts common to FIG. 1 are given the same reference numerals. This point is the same as in FIGS. 3 and 4.

FIG. 2 (A) is a diagram corresponding to FIG. 1 (A). However, in FIG. 2 (A), unlike FIG. 1 (A), there is a road 11 that is folded forward to the left and the virtual image display area 7 is expanded compared to FIG. 1 (A). And, in the expanded virtual image display area 7, an arrow 13 as a navigation display prompting the driver 1 to turn left is displayed so as to be superimposed on the road 11. Further, in FIG. 2 (A), the vehicle speed of the vehicle 2 is decelerated to 20 km / h because the vehicle 2 is turned to the left.

Further, in FIG. 2A, the first and

second displays

120 a and 120 b are not within the visual field range of the driver 1. However, here, as in the example of FIG. 1, when both of the first and

second displays

120a and 120b are moved, as shown in FIG. 2B in the near future (for example, immediately after that) When the line of sight of the driver 1 is directed in the direction of the arrow 13 as the navigation display and the field of view shifts to the left, the first indicator 120a in motion enters the field of vision and the first indicator 120a in motion May be visually recognized by the driver 1. In particular, since the movement distance of the first display 120a is longer than the movement distance of the second display 120b, the possibility is high.

Therefore, in FIG. 2 (B), the movement of the virtual image due to the change of the virtual image display distance of the virtual image (the vehicle speed display SP, which is “5 km / h” here) as the display of the HUD device 10 (FIG. The same movement as E) and the movement of the second display 120b are performed.

In FIG. 2C, the vehicle 2 is on the way to the left, but since the first display 120a is within the field of view of the driver 1, the movement of the first display 120a is performed I will not.

In FIG. 2 (D), the left turn ends and the vehicle 2 travels on the road 11. In this state, the first display 120a is out of the field of view of the driver 1. Therefore, the movement of the second display 120a is performed in this period.

Thus, even if both of the first and

second displays

120a and 120b are out of the visual field range of the driver 1, it is possible to select one of the first and

second displays

120a and 120b in the near future. In the case where it is predicted that one of them is within the visual field range of the driver 1, for example, based on the navigation display or the like, the change for either one is not carried out, and either one of the movements is By carrying out after one of the driver 1 is out of the visual field range, it is possible to avoid the inconvenience of giving the driver 1 a sense of discomfort and affecting the operation of the vehicle 2.

Next, FIG. 3 will be referred to. FIGS. 3A to 3F show the first and second images when the virtual image displayed by the HUD device 10 as the first display unit continues to be within the driver's field of view for a predetermined time or more. It is explanatory drawing which shows the example of the change about each display part of. FIG. 3A is the same as FIG. 1C described above. In the example of FIG. 1, although the 1st,

2nd indicator

120a, 120b became out of the visual field range of the driver 1 in FIG. 1 (D), it is shown in FIG. 3 (B) in the example of FIG. Thus, even after the movement of the first and

second indicators

120a and 120b is completed, the driver 1 remains gazing forward, and the virtual image SP as the display of the HUD device 10 is in the driver's 1 visual field range The condition inside is continuing.

In this case, when such a state continues for a predetermined time or more, as shown in FIG. 3C, regardless of the visual field range, the change of the virtual image displayed by the HUD device 10 (in other words, HUD device) , In which the movement of the virtual image SP by changing the virtual image display distance is performed.

It is not preferable to change when the virtual image (display area of virtual image) is in the field of view, as described above, but there is a disadvantage due to that (for example, The inability to appropriately display a virtual image corresponding to a change in the environment causes a disadvantage that the driver 1 is given a burden, etc., over the merit of the pending change. Therefore, in this case, movement of the virtual image (change of the HUD device 10) by changing the virtual image display distance is performed. This can avoid the occurrence of the above-mentioned inconvenience. As a result, as shown in FIG. 3D (which is the same as FIG. 1F), both of the change for the HUD device 10 and the change for the first and second indicators 20a and 120b. Can be completed.

However, as shown in FIG. 3C, in the case where the virtual image SP is moved by changing the virtual image display distance (imaging distance) within the visual field range of the driver 1, the driver 1 selects the virtual image SP. Movement (substantially, the virtual image SP as the display of the HUD device 10 will move along the traveling direction of the vehicle 2) will be visually recognized.

Therefore, in order to reduce the sense of incongruity felt by the driver 1 at that time, the change of the virtual image display distance is performed at a speed different from the normal speed. In the example of FIG. 3E, the period required for the change can be shortened by accelerating the change (change) of the virtual image display distance. In FIG. 3E, the thick solid arrow indicates that the moving speed of the virtual image SP is increased.

Further, in the example of FIG. 3F, the sense of incongruity felt by the driver is reduced by performing the change (change) of the virtual image display distance so slowly that the driver 1 can not visually recognize. In FIG. 3F, the fact that the moving speed of the virtual image SP is extremely slow is indicated by a thin broken arrow. In other words, by accelerating the change, the time required for the change can be shortened, and by making the change so slow that the driver can not visually recognize, the driver can feel less discomfort.

Next, FIG. 4 will be referred to. FIGS. 4A to 4G show that the virtual image is within the driver's field of view while changing the virtual image display distance (imaging distance) of the virtual image displayed by the HUD device as the first display unit. It is an explanatory view for explaining an example of change about a HUD device when it enters inside.

In FIG. 4 (A), during driving of the vehicle 2, the virtual image (vehicle speed indication SP displayed on the virtual image display surface PS) displayed by the HUD device 10 changes with the change of the virtual image display distance. Is moved from the position P10 to the second position P11. However, the movement of the virtual image SP has not been completed.

In FIG. 4B, in the middle of movement of the virtual image SP, the direction of the line of sight of the driver 1 is changed, and the virtual image SP is in the state of the visual field range. In this case, display control as shown in FIG. 4C to FIG. 4G can be performed.

In FIG. 4C, the change of the virtual image display distance is stopped at the timing (point in time) when the virtual image SP enters the visual field range. In this case, although the position of the virtual image SP has not reached the target third position P12, the visibility is improved as compared with the time when the change of the virtual image display distance is started.

In FIG. 4D, after the change of the virtual image display distance is stopped at that timing, the virtual image display distance is changed at a speed slower than the normal speed. Since the change is slow, the discomfort given to the driver 1 is reduced.

In FIG. 4E, the change is accelerated by making the speed of change of the virtual image display distance faster than the speed of the previous change at that timing. As a result, it is possible to shorten the time for the virtual image SP to reach the target third position P12, thus reducing the sense of discomfort given to the driver 1.

In FIG. 4F, the virtual image SP is once erased at that timing (in the second position P11, the virtual image SP has disappeared). Here, since the driver 1 did not look at the virtual image SP until immediately before, even if the virtual image SP is erased, no particular problem occurs. Thereafter, when the virtual image SP is out of the visual field range of the driver 1 in FIG. 4 (G), in other words, when the virtual image is displayed again, the virtual image SP does not fall within the visual field range of the driver 1 (This determination is made by the second determination unit 144 in FIG. 10), the virtual image SP is displayed again at the position when the change of the virtual image display distance is completed, in other words, at the target third position P12. Do. In this case, the driver 1 does not have a sense of incongruity because the virtual image SP during the movement can not be seen.

Thus, after temporarily stopping or temporarily stopping the change, the virtual image display distance is changed at a speed slower than the normal speed, or the change is accelerated at that time, or the virtual image is erased, After that, when it is determined that the virtual image is not displayed again even if the virtual image is displayed again, the driver may feel discomfort by performing processing such as redisplaying the virtual image at the position where the change of the virtual image display distance is completed. And the decrease in visibility can be suppressed.

Next, FIG. 5 will be referred to. FIG. 5A to FIG. 5C are explanatory diagrams for explaining a mode of change of two displays as the second display unit. In FIG. 5, the same reference numerals are given to parts common to those in the above-mentioned figure. This point is the same as in FIGS. 6 to 8.

As shown in FIG. 5A, the first and second displays (specifically, the left electronic side mirror and the right electronic side mirror) 120a and 120b as the second display are respectively It is supported by the first and second movable belts VB (a) and VB (b).

Here, when the first motor drive unit 110a drives the first stepping motor MT (a), the first gear GE (a) rotates, and accordingly, the first movable belt VB (a) Will rotate. Along with this rotation, the first display (left electronic side mirror) 120a moves. In FIG. 1 (A), this movement is indicated by a bi-directional arrow.

In addition, when the second motor drive unit 110b drives the second stepping motor MT (b), the second gear GE (b) rotates, and accordingly, the second movable belt VB (b) Rotate. Along with this rotation, the second display (right electronic side mirror) 120b moves. The movements of the first and second displays (left electronic side mirror, right electronic side mirror) 120a and 120b can be controlled independently.

Next, FIG. 5B will be referred to. In the example of FIGS. 1 to 3 described above, the first and

second displays

120a and 120b are moved (in other words, the second display unit itself is moved), but FIG. In the example of (B), the first display area 122a moves between the position P5 and the position P6 in one display 121 (having a rectangular outer shape which is long in the horizontal direction), and the second display Region 122b moves between position P7 and position P8. Here, the movement of the first and

second display areas

122a and 122b means that the display in the display area is moved. Also in the example of FIG. 5 (B), the same effect as the example of FIGS. 1 to 3 described above can be obtained. Further, in the example of FIG. 5B, since the display itself does not move, a moving mechanism as shown in FIG. 5A is unnecessary, and an effect of simplifying the configuration can be obtained.

Further, in the example of FIG. 5C, the first and

second displays

122a and 122b (each having a rectangular outer shape that is long in the horizontal direction) are provided, and in the first display 122a, The first display area 124a moves between the position P9 and the position P10, and the second display area 124b moves between the position P11 and the position P12 in the second display 122b. Also in the example of FIG. 5 (C), the same effects as the examples of FIGS. 1 to 3 described above and the example of FIG. 5 (B) can be obtained. Moreover, in the example of FIG. 5 (B), it is necessary to secure a large exclusive area for one display, but in the example of FIG. 5 (C), two

displays

123a and 123b are separated. Therefore, even when a large exclusive area can not be secured, there is an advantage that it is easy to realize a layout that effectively utilizes the free space.

Next, the change of the virtual image display distance will be described. As described above, the virtual image display distance can be, for example, the distance to the virtual image based on a predetermined position (for example, the position of the viewpoint A of the driver 1). As a method of changing the virtual image display distance, for example, one virtual image display surface is inclined with respect to a direction perpendicular to the road surface of the road (including the case where the virtual image display surface is superimposed on the road surface). There is a method of changing the distance from the viewpoint A of the driver 1 to the virtual image by controlling the display position (specifically, the position in the vertical direction, that is, the direction along the perpendicular perpendicular to the road surface) of the virtual image in . For example, when moving away from the viewpoint A of the driver 1 to the upper side on the virtual image display surface as a result of the virtual image display surface being inclined, moving the display position of the virtual image upward increases the virtual image display distance. The virtual image display distance is shortened by moving downward. Therefore, the virtual image display distance can be finely adjusted by controlling the display position of the virtual image. Note that inclining the virtual image display surface with respect to the direction perpendicular to the road surface means, for example, the display light (see FIG. 6B) of the image forming unit (symbol 46 in FIG. 6B) included in the HUD device. It can be realized by inclining with respect to the traveling direction of the code K). As another method of changing the virtual image display distance, there is a method of switching control of two or more virtual image display surfaces. Hereinafter, this method will be described with reference to FIG. 6 (A) shows an example of switching control of the virtual image display surface of the multi-surface HUD device, FIG. 6 (B) shows a configuration example of the main part of the multi-surface HUD device, and FIG. 6 (C) shows the optical system 18 shows an example of a position control signal that controls the position of

A multi-surface (multi-layer) HUD device is a HUD device capable of setting a virtual image display surface of a multi-surface (three or more surfaces). In other words, the virtual image display distance can be changed to m (m is a natural number of 3 or more). In the multi-surface HUD device, since the virtual image display surface capable of displaying virtual images is multifaceted, the virtual image display distance can be changed more freely, and stereoscopic display with a sense of depth becomes possible. Furthermore, the size and height of the object to be displayed (object) are appropriately changed to give perspective, the display position of the object is adjusted, the object is made to have depth, and three-dimensional, More realistic by applying geometric three-dimensional decoration processing (which can also be called simply three-dimensional decoration), such as applying shadows to objects, adopting oblique view expressions, or closely expressing the texture of objects 3D display is possible.

For virtual image display in this multi-surface HUD device, for example, by adopting switching control of the virtual image display distance according to the distinction between day and night, the burden of focus adjustment (focusing) when the user visually recognizes a virtual image is reduced. It is possible to reduce the load during operation.

In the example of FIG. 6A, as a virtual image display surface suitable for use at night, a first virtual image display surface (denoted as "night 1") PS10 for night and a second virtual image display for night The first virtual image display surface for daytime (denoted as "day 1") PS12 and the daytime as a virtual image display plane suitable for use in the daytime with the plane (denoted as "night 2") PS11. A second virtual image display surface (denoted as "day 2") PS13 for the purpose is set. The virtual image display distances (the reference point is the viewpoint A) for the first and second virtual image display surfaces for night are L201 and L202, respectively. The virtual image display distances for the first and second virtual image display surfaces for day are L203 and L204, respectively. Here, L201 <L202 <L203 <L204. Further, on each of the virtual image display surfaces PS10 to PS13, a virtual image SP of vehicle speed display, which is information of non-superimposed content that does not need to be superimposed on the real scene, is displayed. In addition, it is also possible to display a virtual image as information of superimposed content to be superimposed on a real scene.

In FIG. 6A, the HUD device 10 projects the images (display light K (1) to K (4) for displaying the images on the windshield 6 as a projection target member (light transmission member)). ), And as a result, the driver 1 can visually recognize the virtual image SP.

Next, FIG. 6B will be referred to. The HUD device 10 includes a position control signal generation unit 91, a virtual image display distance control unit 24 (including a lens drive unit 93 and a screen drive unit 95), a lens 44, and an image display surface 47 on which an image M is displayed. It includes an image display unit 46, an image processing unit 51, and a light source unit 53 (including a light source drive unit 55 and a light source 57). The position control signal VPC generated by the position control signal generation unit 91 is supplied to the lens drive unit 93 and the screen drive unit 95 of the virtual image display distance control unit 24 and is also supplied to the light source drive unit 55 at the same time.

The virtual image display distance control unit 24 has a predetermined range (here, a direction along the optical path) along the optical axis of the screen 46 (and the lens 44) as the image display unit, ie, a direction along the optical path. Then, by oscillating in the distance range LZ), the optical path length from the screen 46 (more specifically, the image display surface 47 on which the image M is displayed) as the image display unit to the projection target member 6 is periodical. Change to The light source driving unit 55 of the light source unit 53 controls the emission timing of light from the light source (laser light source LD) 57 to display the image M on the image display surface 47 of the screen 46 as the image display unit. Timing is controlled.

Here, when the virtual image display surface corresponding to each of the virtual image display distances that can be changed in m ways is the first to m-th virtual image display surfaces, the screen 46 (and the lens 44) as an image display unit In (LZ), control to vibrate at a predetermined cycle, control of display timing of an image on the display surface 47 of the screen 46 as an image display unit, and (change combination of) change control of display contents synchronized with control of display timing. It is possible to display a desired virtual image on each of the first to m-th virtual image display surfaces having different virtual image display distances.

The position control signal VPC generated by the position control signal generator 91 is, for example, a sawtooth (sawtooth) voltage signal (sawtooth voltage signal) as shown in FIG. 6C. In 6 (c), time t is set on the horizontal axis and voltage v is set on the vertical axis. When the voltage of the position control signal VPC is 0, the screen 46 as an image display unit is located at the first position PT0, and when the voltage of the position control signal VPC is a peak value, the screen 46 as an image display unit Is located at the second position PT1.

Here, as shown in FIG. 6C, an image (“55 km / h”) to be displayed on the first (night 1) virtual image display surface PS10 for night is displayed at time t1, and at night t2 An image ("55 km / h") to be displayed on the second (night 2) virtual image display surface PS11 for the image, and an image to be displayed on the first (day 1) virtual image display surface PS12 for daytime at time t3 FIG. 6 (A) is displayed by displaying (“55 km / h”) and displaying an image (“55 km / h”) to be displayed on the second (day 2) virtual image display surface PS13 for daytime at time t4. The display of a virtual image (vehicle speed indication SP) as shown in) is realized.

Next, FIG. 7 will be referred to. FIG. 7 shows an example of the appearance of a vehicle employing an electronic mirror. The vehicle 2 includes

headlights

5a and 5b, a windshield 6, an external light sensor (illuminance sensor) 101 for measuring the external light intensity (illuminance), a left rear imaging camera 102a (imaging range Z1), and a right A rear imaging camera 102b (imaging range Z2) and an ambient imaging camera 160 for imaging a real scene around the vehicle 2 (here, in the forward direction, in other words, in the Z-axis direction) are included.

Next, FIG. 8 is referred to. FIG. 8 shows an example of the structure of the display apparatus for vehicles of this invention. In FIG. 8, the same reference numerals are given to parts common to those in the above-mentioned figure.

The display device for a vehicle includes a HUD device 10 (including a virtual image display distance control unit 24 and a display control unit 52) as a first display unit, an external light sensor (illuminance sensor) 101, and a left rear imaging camera 102a, a right rear imaging camera 102b, an image generation unit (for the left side) 104a, an image generation unit (for the right side) 104b, a display control unit (for the left side) 106a, and a display control unit (for the right side) 106 b, the first and

second displays

120 a and 120 b as the second display unit, and the moving mechanism (the description here is that described in FIG. 5A) for moving the

respective displays

120 a and 120 b. Has omitted) and.

In addition, the display apparatus for a vehicle detects the movement of the eye (viewpoint) A of the driver 1, thereby detecting the direction of the line of sight, the pupil imaging camera 130, and the left arm of the driver 1 Then, the biological information acquisition unit 132 that measures (detects) pulse information (the pulse information), the sight line detection unit 140, and the “HUD device 10 and the first and

second indicators

120a and 120b described above, The first determination unit 141 determines whether or not “changes that may affect the driver's vision” and outputs signals G1 and G2 indicating the determination results, and a visual range (near-viewing direction range) It is determined whether the determination unit 142, the display (virtual image) of the HUD device 10, and each of the first and

second displays

120a and 120b are within the visual field range of the driver 1, and a signal indicating the determination result A second determination unit 144 that outputs D1 and D2; Control unit 150 (display control unit 152, HUD control unit for controlling “changes that may affect the driver's vision of the HUD device 10 and the first and

second displays

120a and 120b”) And (iv) and (iv).

Further, the display device for vehicle includes an ambient imaging camera 160, an image analysis unit 162, a vehicle information acquisition unit 164, a wireless communication unit 166, and an ECU (electronic control unit) 168 that controls the operation of each unit of the vehicle 2. And.

As described above, the vehicle display device includes the first display unit (here, the HUD device 10) and the second display unit (here, the first and

second displays

120a and 120b as electronic side mirrors). For each of the first and second display units (HUD device 10, first and

second indicators

120a and 120b), movement of the display unit itself, movement of display on the display unit, change of display mode on the display unit A first determination unit 141 that determines whether there is a need for a change that may affect the driver's vision including at least one of causing the first display unit (HUD device), Alternatively, it is determined whether or not the display by the first display unit (virtual image SP displayed by the HUD device 10) is within the visual field range of the driver 1, and the second display unit (first and second displays)

Device

120a, 120b) or the second display unit A second determination unit 144 that determines whether or not the display (the image displayed on each display surface of each of the

displays

120a and 120b) is within the visual field range of the driver 1, the first and second A control unit 150 for controlling the above-described changes (changes that may affect the driver's vision) of the display unit (HUD device 10, first and

second displays

120a and 120b) doing.

In the control unit 150, the first determination unit 141 determines that the above-described changes in the first and second display units (HUD device 10, first and

second indicators

120a and 120b) are necessary. If the driver 1 of the first and second display units (HUD device 10, first and

second indicators

120a and 120b) determines that the driver 1 The above change is performed for those determined to be out of the visual field range, and for those in which no change is performed at this time, the second determination unit 144 thereafter determines that the driver 1 is out of the visual field range. If it does, make the above change.

In addition, the display control unit 152 included in the control unit 150 supplies the movement control signals G1 and G2 of the display to the first and second

motor driving units

110a and 110b, respectively, and controls the display control signal G3, Each of G4 is supplied to the display control unit (for the left side) 106a and the display control unit (for the right side) 106b.

Here, each of the first and second

motor drive units

110a and 110b operates in accordance with the sent movement control signals G1 and G2 of the display to drive the stepping motors MT (a) and MT (b). Do. As a result, the first and

second displays

120a and 120b are moved to the predetermined positions.

Further, the display control unit (for the left side) 106a and the display control unit (for the right side) 106b operate in accordance with the control signals G3 and G4 of the sent display form, for example, the first and second displays Zoom in / out the image displayed on the

projectors

120a and 120b, adjust the brightness, change the background color, make the image three-dimensional, change the outline of the image, add an auxiliary image, etc. By changing the layout of image elements or changing the type of presentation information, the visibility of the display is improved. The display control unit (for the left side) 106 a and the display control unit (for the right side) 106 b may be provided in the control unit 150.

In addition, the HUD control unit 154 included in the control unit 150 supplies the second determination unit 144 with the information G5 about the content displayed by the HUD device 10. In the example of FIG. 2 described above, it is predicted that the line of sight of the driver 1 will be changed in the near future based on the navigation display etc., but the information of the navigation display is included in the above information G5 It is done. Therefore, the second determination unit 144 can perform the prediction as described above.

Further, the HUD control unit 154 included in the control unit 150 supplies the display control signal G6 to the display control unit 52 of the HUD device 10, and controls the virtual image display distance control signal G7 for the virtual image display distance of the HUD device 10. The unit 24 (see FIG. 6B for this configuration) is supplied. As a result, the content of the display (virtual image) of the HUD device 10 is changed, and switching control of the virtual image display distance as shown in FIG. 6A is performed.

According to the vehicle display device having such a configuration, it is possible to affect the driver's vision of the first and second display units (HUD device 10, first and

second displays

120a and 120b). When the driver 1 is not looking at the time of implementing a characteristic change, the driver makes a change in each display unit, thereby reducing the driver 1 from feeling discomfort and having an impact on driving. Be suppressed.

In addition, as described above, “a change that may affect the driver's vision” includes “the movement of the display unit itself”. Specifically, each

display

120a, 120b is in the width direction of the vehicle 2 Including moving along with etc.

Also, as described above, “change that may affect the driver's vision” includes “movement of display on the display unit”, and specifically, for example, the display may be performed in one display. 5B, or the virtual image SP displayed by the HUD device 10 is moved along the traveling direction of the vehicle 2 by the change in virtual image display distance. It includes moving (example of FIG. 6 (A)).

Further, as described above, “a change that may affect the driver's vision” includes “changing the display mode in the display unit”, and specifically, for example, the driver 1 visually recognizes Scale the image to be easy, change the brightness of the image, change the background color, make a stereoscopic image, change the outline of the icon, etc., add an auxiliary display, change the layout of the image element Processing of changing the type of presentation information. However, it is not limited to these.

Further, the “change that may affect the driver's vision” may be performed by the above processing alone, or may be used in combination of two or more processing. For example, when moving the first and

second displays

120a and 120b due to the night, the display brightness is lowered along with the movement, or the image is enlarged for easy viewing. The visual burden on the driver 1 can be further alleviated by simultaneously performing the change of.

Next, FIG. 9 is referred to. FIG. 9 is a flow chart showing an example of the procedure of change processing for the first and second display portions in the vehicle display device of the present invention. Here, an example in which the display device for a vehicle includes the HUD device 10 as the first display portion and at least one

display

120a, 120b as the second display portion (using FIGS. 1 to 3 above) The main procedure example will be described with respect to the example described in FIG.

First, information for determining necessity of change (for example, ambient light intensity information, on / off of headlights, vehicle information regarding high beam / low beam, biometric information of driver, etc.) is acquired (step 1), Next, it is determined whether or not the change (the change that may affect the driver's vision of the first and second display units as described above) is necessary (step S2). For example, as in the example of FIG. 1B, when the headlights are turned on at night, it is estimated that the driver's visual field range is narrowed, or when the driver is tired, the visual field When it is estimated that the range is narrowed, it is determined that the change is necessary.

Next, in the case of Y in step S2, the information of the driver's line of sight is detected (step S3), and then the first display unit is within the visual field range determined based on the detected line of sight information. It is determined whether the display (virtual image) of the HUD device which is or the at least one display which is the second display part is included (step S4).

When the HUD device is within the visual range in step S4, the change of the HUD device as the first display unit is not performed, but the change of the display as the second display unit is performed (step S5) ). Subsequently, it is determined whether or not the change for the HUD device for which the change is pending can be implemented (step S6). In the case of Y at step S6, change of the display (virtual image) of the HUD device (movement of virtual image by change of virtual image display distance (imaging distance)) is performed (step S7).

In the case of N in step S6, it is determined whether or not a predetermined time has elapsed from the time when the change is suspended (step S8), and in the case of N in step S8, the process returns to step S6. Along with the measure, change of the display (virtual image) of the HUD device (movement of virtual image by change of virtual image display distance (imaging distance)) is performed (step S9). The “predetermined measure” is, for example, moving the display (virtual image) of the HUD device at a speed different from the normal speed, and specifically, as in the example of FIG. Measures to accelerate the change of the display distance and shorten the time required for the change, or as shown in the example of FIG. 3 (F), perform the change of the virtual image display distance so slowly that the driver can not see it. Measures to reduce the sense of discomfort.

If it is determined in step S4 that at least one display as the second display unit is within the view range, the process proceeds to step S10. In step S10, all of the at least one display (eg, FIG. 1) is within the field of view (or is assumed to be within the field of view in the near future as in the example of FIG. 2). In the case of the example of FIG. 3, the first display 120a and the second display 120b) or the part of the display (a first display 120a, a second display) Device 120b) is determined.

At step S10, it is determined that it is a part of the display (for example, the first display 120a) that is within the field of view (or is presumed to be within the field of view in the near future) Then, a part of the display (the first display 120a) is not changed (the movement of the display in the example of FIGS. 1 to 3), and the display (virtual image) of the HUD device is changed ( In the example of FIGS. 1 to 3, movement of the virtual image) and change of “other display (second display 120b)” which is out of the view range (movement of the display in the example of FIGS. 1 to 3) ).

Here, when it is determined in step S10 that all of the indicators are within the field of view, changes to all indicators (both the first and

second indicators

120a and 120b) are suspended. If it is determined in step S10 that a part of the display is within the field of view, a part of the display (here, the first display 120a) is changed. It is suspended and not implemented.

In step S12, it is determined that it is possible to change the indicators (both the first and

second indicators

120a and 120b or the first indicator 120a) for which the change is pending, and the case of N In step S12, the determination in step S12 is repeated, and in the case of Y, the process proceeds to step S13, and the change (in this case, the movement of the display) of the display whose change is suspended is performed.

Next, FIG. 10 is referred to. FIG. 10 is an example of a processing procedure in the case where a virtual image enters the driver's field of view in the middle of changing the virtual image display distance in the HUD device as the first display unit in the vehicle display device of the present invention. Is a flowchart showing

First, the change of the virtual image display distance (imaging distance) of the HUD device is performed (step S20). Next, in the course of the change, it is determined whether the display (virtual image) of the HUD device is within the visual field range (step S21). In step S21, in the case of N, it proceeds to step S23, and it is judged whether or not the change of the virtual image display distance (imaging distance) is completed (step S23), and in the case of N in step S23, it proceeds to step S21. If it returns Y, the change is finished.

In the case of Y at step S21, the process proceeds to step S22. In step S22, as a measure against the fact that the display (virtual image) of the HUD device is within the visual field range during the change of the virtual image display distance (imaging distance), "temporarily stop the change at that timing" or "After stopping temporarily, change the virtual image display distance at a slower speed than normal speed" or "Accelerate the change at that time" or "Erase the virtual image and then display the virtual image again However, when it is determined that the image does not fall within the visual field range, processing is performed such that the virtual image is redisplayed at the position where the change of the virtual image display distance is completed. As a result, the driver's sense of incongruity and a decrease in visibility are suppressed.

As mentioned above, although this invention was demonstrated using the embodiment, this invention is not limited to these embodiment, A various deformation | transformation and application are possible. For example, in the example of FIGS. 1 to 3, “moving the virtual image (changing the virtual image display distance)” for the HUD device is performed when transitioning from day to night (in other words, changes in the surrounding environment). Although implemented correspondingly, it is not limited thereto. For example, when the headlight is switched from high beam to low beam, the surrounding environment is night and there is no change, but the driver's gaze point is closer to the vehicle, so the field of view changes. The movement of the virtual image (change of the virtual image display distance) may be performed to correspond to this change (in this case, the change of the state of illumination provided to the vehicle). In addition to the change in the surrounding environment or the change in the state of illumination provided to the vehicle, the field of view fluctuates by comprehensively judging in consideration of changes in the driver's physical condition and fatigue level. The above changes may be implemented when it is estimated. Further, in the above embodiment, the display is moved along the width direction of the vehicle, but the moving direction is not particularly limited.

The present invention is also applicable to display devices for vehicles in general (including ships, aircraft, etc.). When applied to a vehicle in general, the "driver" in the above description corresponds to a "steer", a "pilot" or the like.

As described above, according to the present invention, when the vehicle display device includes the first and second display units, the display of each display unit or each display unit is outside the driver's field of vision range. By performing the change for each display unit individually and at distributed timing, the change can be completed without causing the driver to feel discomfort. In other words, by performing the processing of changing the display position and the display form so as to be able to present optimal information, it is possible to implement without awkwardness while reducing the discomfort given to the driver by performing the process outside the driver's gaze area. It is possible.

The invention is not limited to the above-described exemplary embodiments, and one of ordinary skill in the art could easily modify the above-described exemplary embodiments to the extent that they are included in the claims. .

DESCRIPTION OF SYMBOLS 1 ... driver (user), 2 ... vehicle (vehicle), 3 ... steering wheel (steering wheel), 5a, 5b ... headlights, 6 ... projected member (wind shield etc.) 7) Virtual image display area on the windshield, 9: Road, 10: HUD device as the first display part 11, 11: Road, 24: Virtual image display distance of the HUD device Control unit 52 Display control unit 52 of the HUD device External light sensor (illuminance sensor) 102a, 102b Left rear or right

rear imaging camera

104a, 104b Image generation unit (For left side or right side), 106a, 106b ··· Display control unit (for left side or right side), 118 ··· Instrument panel, 120 (120a, 20b) ··· First display Display as part First display, second display), 125 inner rear view mirror (back mirror) 130 pupil imaging camera 132 biological information acquisition unit 140 gaze detection unit 141 ... first determination unit, 142 determination of ... field range (near range viewing direction), 144 ... second determination unit, 150 ... controller, 152 ... display Control unit 154: HUD control unit 160: surrounding (forward) imaging camera 162: image analysis unit 164: vehicle information acquisition unit 166: wireless communication unit 168 -ECU.

Claims

A first display unit,
A second display unit,
For each of the first display unit and the second display unit, the driver's vision includes at least one of the movement of the display unit itself, the movement of the display on the display unit, and the change of the display mode on the display unit. A first determination unit that determines whether a change that may affect
It is determined whether the display by the first display unit or the display by the first display unit is within the visual field range of the driver, and the display by the second display unit or the second display unit A second determination unit that determines whether or not the driver is within the visual field range of the driver;
A control unit configured to control the change of each of the first display unit and the second display unit;
Equipped with
The control unit is based on the determination result of the second determination unit when the first determination unit determines that the change in the first display unit and the second display unit is necessary. Of the first display unit and the second display unit that are determined to be out of the driver's field of view, and for those for which the change has not been performed, Causing the change to be performed when it is determined that the driver's field of view is out of range.
And a display device for a vehicle.
The first display unit is a head-up display device that causes a driver to visually recognize a virtual image of the image by projecting the image onto a projection target provided on a vehicle.
The second display unit is at least one display unit;
Moving the virtual image as the display of the head-up display device by changing the virtual image display distance which is the distance to the virtual image with reference to a predetermined position. It is a change including at least one of changing the display mode on the first display unit,
The change in the second display unit includes at least one of movement of the second display unit, movement of a display on the second display unit, and changing of a display mode on the second display unit. Is a change that includes
A display device for a vehicle according to claim 1, characterized in that.
The change in the first display unit and the second display unit may be performed by at least one of a change in an environment around the vehicle, a change in a state of illumination provided to the vehicle, and a state of the driver. Implemented in response to changes in the driver's gaze point and visual field range,
The display device for vehicles according to claim 1 or 2 characterized by things.
The at least one display as the second display unit plays a role of a vehicle mirror including a side mirror for checking the rear and rear sides of the vehicle, and an image captured by an imaging unit provided in the vehicle Is an electronic mirror that has the function of a monitor that displays
The display apparatus for vehicles according to claim 2 or 3 characterized by things.
At least one display as the second display includes a first display and a second display,
The control unit may control the first display and the second display in the near future even if both the first display and the second display are out of the driver's view range. If any one of the indicators is predicted to be within the visual field range of the driver, the change for either one is not performed, and either one of the movements is The display apparatus for a vehicle according to any one of claims 2 to 4, wherein the display is performed after any one of the driver's eyes is out of the visual field range of the driver.
The control unit is configured to cause the virtual image displayed by the head-up display device to be within the visual field range of the driver when the control unit causes the head-up display device as the first display unit to perform the change. 6. The method according to any one of claims 2 to 5, wherein, even in the case where the state in which the virtual image is within the visual field range continues for a predetermined time or more, the change is performed. Vehicle display device.
When the change in the head-up display device is to move the virtual image by changing the virtual image display distance, the control unit changes the virtual image display distance at a speed different from a normal speed. A display device for a vehicle according to claim 6, characterized in that.
In the case where the change in the head-up display device as the first display unit is changing the virtual image display distance to move the virtual image,
While the control unit is changing the virtual image display distance, it is determined by the second determination unit that the virtual image displayed by the head-up display device has come within the visual field range of the driver In case,
Stop the change of virtual image display distance at that timing,
Or
At that timing, stop changing the virtual image display distance, and then change the virtual image display distance at a slower speed than normal speed,
Or
At that timing, accelerate the change by making the speed of change of virtual image display distance faster than the speed of the previous change,
Or
At that timing, the virtual image is erased once, and then the virtual image is displayed as a virtual image when it is determined by the second determination unit that the virtual image is not displayed within the driver's field of view even if the virtual image is displayed again. Display at the position when the change of distance is completed,
The display device for a vehicle according to claim 2, characterized in that: