WO2016056199A1

WO2016056199A1 - Head-up display device, and display method for head-up display

Info

Publication number: WO2016056199A1
Application number: PCT/JP2015/004903
Authority: WO
Inventors: 神谷　玲朗; 希北川
Original assignee: 株式会社デンソー
Priority date: 2014-10-07
Filing date: 2015-09-28
Publication date: 2016-04-14

Abstract

Provided is a head-up display device (10) in which an image is projected onto a transparent plate-like member (3) that is provided in front of the driver seat of a vehicle (1), and as a result, the image is virtually displayed so as to be superimposed on scenery which is in front of the vehicle and which is visible from the driver seat through the plate-like member. The head-up display device (10) is provided with the following: projection units (11, 12) whereby letters or shapes are projected onto the plate-like member as an image expressing information that is to be presented to the driver of the vehicle in order to virtually display the image superimposed onto the scenery; and a display control unit (13) that takes the center of the field of vision seen from the driver seat as a reference point, and displays the letters or shapes such that the more offset the display locations of the letters or shapes are from the reference point in the vertical or lateral direction, the larger the display dimensions become.

Description

Head-up display device and head-up display display method

Cross-reference of related applications

This application is based on Japanese Application No. 2014-206636 filed on October 7, 2014 and Japanese Application No. 2015-140160 filed on July 14, 2015. Incorporate.

The present disclosure relates to a head-up display device and a head-up display display method for projecting an image onto a transparent plate-like member provided in front of the driver's seat, thereby displaying a virtual image on the scenery in front of the driver's seat. It is about.

As a technology for presenting various information to the driver, a head-up display device (hereinafter referred to as a character or icon) that projects an image of information (such as a character or an icon) on a transparent plate-like member (such as a windshield) provided in front of the driver's seat. HUD devices) are known. If the HUD device is used, an image can be displayed in a state of being superimposed on the front scenery seen through the transparent plate member, so that the driver can grasp the information without diverting his gaze from the front.

In such a HUD device, as a display area for displaying an icon (or character) representing information, the first display area arranged away from the center of the driver's field of view and the vicinity of the center of the field of view are arranged. Providing a second display area has been proposed (Patent Document 1). In this technique, the icon display area is switched according to the importance of the information presented to the driver, so that the icon is displayed larger in the second display area than in the first display area. .

However, in the technique of Patent Document 1, since a large icon is displayed near the center of the field of view, the driver may not be able to visually recognize the scenery in front, and the eyesight away from the center of the field of view is small in a region with low vision. There was a problem that even if the icon was displayed, the driver could not grasp the information correctly.

JP 2013-189122 A

The present disclosure aims to provide a head-up display device and a head-up display display method that allow a driver to correctly grasp the presented information without hindering the visual recognition of the scenery in front using the HUD device.

In the first aspect of the present disclosure, the image is projected onto a transparent plate-like member provided in front of the driver's seat of the vehicle, so that the image is superimposed on the scenery in front seen from the driver's seat through the plate-like member. The head-up display device for displaying a virtual image projects the image on the plate-like member in order to display a character or a figure as the image representing the information to be presented to the driver of the vehicle so as to superimpose the image on the scenery. With the center of the field of view as seen from the projection unit and the driver's seat as a reference point, the character or the figure is displayed with a larger display size as the display position of the character or the figure is further away from the reference point in the vertical direction or the horizontal direction. A display control unit for displaying is provided.

In the above-described head-up display device, as the display position of the character or graphic approaches the reference point, the display size of the character or graphic is reduced to increase the position close to the center of the field of view as viewed from the driver's seat. Since characters and figures are not displayed, it is possible to prevent the driver from seeing the scenery in front of the driver.

Also, the closer to the center of the field of view, the higher the driver's visual acuity (that is, the visual recognition ability). Therefore, even if the display size is reduced as the display position of characters or figures approaches the reference point, the driver Can grasp characters and figures.

On the other hand, the visual acuity of the driver is lower as the position away from the center of the visual field in the vertical direction or the horizontal direction, so by increasing the display size as the display position of the character or figure moves away from the reference point, Characters and figures can be easily understood by the driver.

In the second aspect of the present disclosure, the image is projected onto a transparent plate-like member provided in front of the driver's seat of the vehicle, so that the image is superimposed on a front view seen through the plate-like member from the driver's seat. In a head-up display display method for displaying a virtual image, the image is projected on the plate-like member in order to display a character or a figure as the image representing the information to be presented to the driver of the vehicle over the scenery. Then, with the center of the field of view as viewed from the driver's seat as a reference point, the character or the figure is displayed with a larger display size as the display position of the character or the figure moves away from the reference point vertically or horizontally. Prepare for that.

In the above head-up display display method, as the display position of the character or figure approaches the reference point, the display size of the character or figure is reduced, so that the position close to the center of the field of view as seen from the driver's seat. Since large characters and graphics are not displayed, it is possible to prevent the driver from seeing the scenery in front of the driver with the display of characters and graphics.

The above and other objects, features and advantages of the present disclosure will become more apparent from the following detailed description with reference to the accompanying drawings. The drawing
FIG. 1 is an explanatory diagram showing a rough configuration of a vehicle equipped with the head-up display device of the present embodiment. FIG. 2 is a block diagram showing the configuration of the HUD device of this embodiment. FIG. 3 is an explanatory view exemplifying an area (display area) where characters or icons of the object information are displayed on the scenery in front of the driver's seat viewed through the windshield. FIG. 4 is a flowchart of the HUD display control process executed by the HUD device of this embodiment. FIG. 5 is an explanatory diagram schematically showing the correspondence between the display positions of characters and icons and the display dimensions. FIG. 6 is an explanatory diagram showing an example of displaying characters and icons in the lower display area. FIG. 7 is an explanatory diagram showing an example of displaying characters and icons in the upper display area. FIG. 8 is an explanatory diagram showing an example of displaying characters and icons in the left display area. FIG. 9 is a block diagram showing the configuration of the HUD device of the first modified example. FIG. 10A and FIG. 10B are explanatory views showing an example in which the driver's line of sight moves according to the road configuration in front of the route of the vehicle. FIG. 11 is a flowchart of the reference point setting process executed by the HUD device of the first modified example. FIG. 12 is an explanatory diagram showing an example in which characters and icons are displayed on the HUD device of the first modified example when the road is curved in front of the route of the vehicle. FIG. 13 is an explanatory diagram showing an example in which characters and icons are displayed on the HUD device of the first modified example when the road is a slope in front of the vehicle path, FIG. 14 is an explanatory diagram showing a rough configuration of a vehicle equipped with the HUD device of the second modification, FIG. 15 is a block diagram showing the configuration of the HUD device of the second modified example.

Hereinafter, examples will be described in order to clarify the contents of the present disclosure described above.
A. Device configuration :
FIG. 1 shows a rough configuration of a vehicle 1 on which the head-up display device 10 of this embodiment is mounted. As shown in the figure, a head-up display device (hereinafter, HUD device) 10 of this embodiment is mounted in a dashboard 2 in front of the driver's seat of the vehicle 1. The HUD device 10 includes a projection unit 11 that projects an image, and a concave mirror 12 that reflects the image projected by the projection unit 11 and projects the image onto a windshield (that is, a windshield) 3.

The image projected on the windshield 3 from the HUD device 10 is reflected by the windshield 3 and reaches the eyes of the driver. Then, the driver recognizes the projected image as a virtual image 4 positioned in front of the windshield 3 in a state of being superimposed on the scenery in front.

Note that the windshield 3 of this embodiment corresponds to a “plate member” of the present disclosure. In the HUD device 10 of the present embodiment, an image is projected onto the windshield 3, but the image is projected onto a transparent plate-like member called a combiner provided on the front side of the windshield 3 (that is, on the driver's seat side). May be.

In addition, the vehicle 1 acquires target information by emitting radio waves to a camera 20 that captures an image in front of the vehicle 1 or a predetermined search area set in front of the vehicle 1 and receiving the reflected waves. A radar 21 or the like is mounted.

The camera 20 according to the present embodiment is configured to take an image similar to a front view seen through the windshield 3 facing the front from the driver's seat.

FIG. 2 is a block diagram showing the configuration of the HUD device 10 of this embodiment. As shown in the figure, the HUD device 10 includes a display control unit 13, an object detection unit 15, an object information acquisition unit 16, and the like in addition to the projection unit 11 described above.

Note that these four “parts” are conceptually classified by focusing on the function of the HUD device 10, and each does not necessarily exist physically independently. These can be configured by various devices, electronic components, integrated circuits, computers, computer programs, or combinations thereof.

The object detection unit 15 is connected to the camera 20 described above, and detects a predetermined object from the front image of the vehicle 1 photographed by the camera 20.

The object information acquisition unit 16 is connected to the radar 21 described above, the communication system 22 that shares information with other vehicles, the navigation system 23 that guides the vehicle 1 to the destination, and the like. Information about the detected object (hereinafter, object information) is acquired from these.

The display control unit 13 selects characters and icons (that is, figures) representing the object information acquired by the object information acquisition unit 16, and also displays and displays positions (hereinafter referred to as display positions) of the characters or icons. The size (hereinafter referred to as display dimension) is determined, and the contents are instructed to the projection unit 11.

The projection unit 11 projects characters or icons in accordance with the contents instructed by the display control unit 13, thereby displaying the characters or icons in a virtual image in association with the object in the front scenery.

FIG. 3 exemplifies a region 5 (hereinafter referred to as a display region) in which characters or icons of the object information are displayed over the front view seen through the windshield 3 from the driver's seat. As shown in the drawing, in this embodiment, the vanishing point P that is the center of the visual field facing the front from the driver's seat is used as a reference point, and the lower display area 5D positioned below the vanishing point P and the vanishing point P An upper display area 5U located on the upper side and a left display area 5L located on the left side of the vanishing point P are provided.

The display area 5 is not limited to the example illustrated in FIG. 3, and a right display area located to the right of the vanishing point P may be provided. In addition, in the example of FIG. 3, each display area 5 is independent, but a part of each display area 5 may be overlapped, or the entire windshield 3 may be a single display area 5. Further, in the case of the example shown in FIG. 3, three projection units 11 that project an image may be provided corresponding to each of the three display areas 5, or three displays using one projection unit 11. An image may be displayed in the region 5.
B. HUD display control processing:
FIG. 4 shows a flowchart of the HUD display control process executed by the HUD device 10 of this embodiment.

When the HUD display control process (S100) is started, first, data of a front image of the vehicle 1 taken by the camera 20 is acquired (S101), the acquired data is analyzed, and a predetermined target is included in the front image. It is determined whether or not an object exists (S102).

As an object to be detected in S102, a preceding vehicle that travels ahead of the vehicle 1, a traffic signal for a vehicle that is installed at an intersection of a road on which the vehicle 1 is traveling, or a road that the vehicle 1 is traveling on are provided. A specific building (for example, a landmark) or the like can be exemplified.

The detection in S102 is performed using, for example, a silhouette template of the object, and based on whether a silhouette that matches any of a plurality of templates prepared in advance is present in the front image. Determine the presence or absence. And when a several target object exists in a front image, a target object is detected separately. In addition, the detection method of a target object is not restricted to this.

In addition, as described above, the front image captured by the camera 20 of the present embodiment is the same as the front view seen from the driver's seat, so the object visually recognized by the driver is detected from the front image. Is done.

And when a target object exists in a front image (S102: yes), the position (henceforth a visual recognition position) where a target object is visually recognized from a driver's seat within display field 5 is detected (S103).

As described above, in this embodiment, the lower display area 5D, the upper display area 5U, and the left display area 5L are provided, and the detected objects are different in the respective display areas 5. For example, the preceding vehicle is detected in the lower display area 5D, the vehicle traffic light is detected in the upper display area 5U, and the specific building is detected in the left display area 5L.

In S103, the visual recognition position of the preceding vehicle in the lower display area 5D, the visual recognition position of the vehicle traffic signal in the upper display area 5U, and the visual recognition position of a specific building in the left display area 5L are detected.

These objects are visually recognized at a position closer to the vanishing point P (FIG. 3) as the distance from the vehicle 1 increases.

If the visual recognition position of a target object is detected, the target object information regarding the target object will be acquired (S104). If there are a plurality of objects, object information is acquired for each object.

The information to be acquired differs depending on the object. For example, when the object is a preceding vehicle, the distance between the vehicle 1 and the preceding vehicle is acquired as the object information based on the target information of the radar 21.

Further, in the vehicle 1 equipped with a function (so-called adaptive cruise control) for keeping the distance between the preceding vehicle constant and following the preceding vehicle, when the driver selects the preceding vehicle to be followed, the communication system 22 Based on the received information, the situation of the preceding vehicle (for example, whether the communication system 22 is supported, whether automatic driving or manual driving, etc.) can be acquired as object information. is there.

Also, as an example in the case where the object is a traffic signal for a vehicle, the name of the intersection where the traffic signal for the vehicle is installed is acquired as the object information based on the map information of the navigation system 23.

Furthermore, as an example of the case where the object is a specific building, based on the map information of the navigation system 23, the type of a specific building (for example, a gas station, a convenience store, a tourist facility, a driver's favorite store, etc.) ) As object information.

When the object information is acquired in this way, characters and icons (graphics) representing the object information are selected (S105). In the above example, when the distance between the vehicle 1 and the preceding vehicle is acquired as the object information, a numerical value (for example, 100 m) representing the distance is selected. Alternatively, when the status of the preceding vehicle is acquired, an icon simulating an antenna is selected if the preceding vehicle is compatible with the communication system 22, and an icon simulating a cross mark is selected if the preceding vehicle is not compatible with the communication system 22. If the preceding vehicle is in automatic driving, the letter “A” representing automatic is selected, and if it is in manual driving, the letter “M” representing manual is selected. .

Also, when the name of the intersection where the vehicle traffic signal is installed is acquired as the object information, the character representing the name is selected.

Furthermore, when a specific building type is acquired as object information, an icon imitating a logo mark of a gas station or a convenience store is selected.

Subsequently, based on the visual recognition position of the target detected in S103, the display position of characters and icons is determined in the display area 5 (S106). In the present embodiment, in order to associate characters and icons with the objects, the characters and icons are displayed at positions adjacent to the objects visually recognized from the driver's seat in the display area 5 in either the vertical direction or the horizontal direction. It has become. In addition, you may display a character and an icon on a target object.

When the display position of the character or icon is determined, the display size of the character or icon is determined (S107). In this embodiment, the display dimensions are determined based on the display positions of characters and icons, and the correspondence between the display positions of the characters and icons and the display dimensions is determined in advance.

FIG. 5 schematically shows the correspondence between the display positions of characters and icons and the display dimensions. In the present embodiment, with the vanishing point P as a reference point, the display size of characters and icons is proportional to the distance from the vanishing point P to the display position as shown in the figure, and the display size becomes closer to the vanishing point P. On the contrary, as the display position is farther from the vanishing point P, the display size becomes larger.

However, the display dimension has a lower limit, and even if the display position is close to the vanishing point P, characters and icons are displayed with the lower display dimension. Thereby, it can avoid that a display dimension is too small and a driver | operator cannot read a character and an icon. As the lower limit of such display dimensions, for example, a character width that can be identified by a driver with visual acuity of 0.7 with both eyes can be set.

Also, the display dimension has an upper limit, and no characters or icons are displayed with a display dimension larger than the upper limit. Thereby, it can avoid that the display dimension is too large and the visual recognition of the scenery ahead from a driver's seat is prevented. The upper limit of the display dimension is, for example, a predetermined ratio (with respect to the height of the lower display area 5D and the upper display area 5U, or the horizontal width of the left display area 5L, based on the size of the display area 5. For example, a character width of 20%) can be set.

When the display dimensions of the characters and icons are determined in S107 of FIG. 4, the projection unit 11 causes the characters and icons selected in S105 to be displayed at the display positions determined in S106 with the display dimensions determined in S107. A character or icon image is projected (S108).

When the characters and icons are displayed in the display area 5 in this way, the process returns to the head of the HUD display control process to newly acquire the data of the front image (S101), and when the object exists in the front image (S102: yes) ), The display of characters and icons is updated by repeating the series of processes described above.

On the other hand, if no object is present in the front image in the determination in S102 (S102: no), it is determined whether characters or icons are being projected (S109).

If a character or icon is being projected (S109: yes), the object corresponding to the character or icon projected in the previous process no longer exists in the front image (for example, the preceding vehicle as the object is present). It is determined that the vehicle 1 has made a left turn, or the vehicle 1 has passed the position of a vehicle traffic signal or a specific building as an object. Therefore, the projection of characters and icons is stopped (S110), and the process returns to the head of the HUD display control process.

On the other hand, if no character or icon is originally projected (S109: no), the process of S110 is omitted and the process returns to the head of the HUD display control process.
C. Display example of characters and icons:
As described above, in this embodiment, the lower display area 5D, the upper display area 5U, and the left display area 5L are provided as the display area 5, and in the following, these displays are performed according to the HUD display control process (S100). An example in which characters and icons are displayed in the area 5 will be described.
C-1. Display example of lower display area 5D:
FIG. 6 shows an example in which characters and icons are displayed in the lower display area 5D. The example of FIG. 6 represents a front image (similar to the front view seen from the driver's seat facing the front) taken by the camera 20 of the vehicle 1 traveling on the highway.

As shown with hatching in the figure, the front image as a target in the front image is a preceding vehicle A on the right front traveling in the overtaking lane (target A in the figure) and the front front traveling in the traveling lane. Of the preceding vehicle B (object B in the figure).

Further, as characters representing the object information of the preceding vehicle, a numerical value of the distance from the vehicle 1 to the preceding vehicle is displayed adjacently below the visual recognition position of the preceding vehicle.

In the illustrated example, the preceding vehicle A is closer to the vehicle 1 than the preceding vehicle B, so that the preceding vehicle A is viewed at a position away from the vanishing point P (see FIG. 3), and the viewing position of the preceding vehicle A in the lower display area 5D. Is below the viewing position of the preceding vehicle B.

Correspondingly, the character (here 50 m) representing the distance of the preceding vehicle A (hereinafter referred to as information A) is lower than the character (here 100 m) representing the distance of the preceding vehicle B (hereinafter referred to as information B). The display position in the display area 5D is down, and the distance from the vanishing point P as the reference point to the display position is long. For this reason, the display size of information A is larger than that of information B in accordance with the correspondence relationship in FIG. Accordingly, the driver can easily recognize that the information A (50 m) corresponds to the preceding vehicle A and the information B (100 m) corresponds to the preceding vehicle B.
C-2. Display example of the upper display area 5U:
FIG. 7 shows an example in which characters and icons are displayed in the upper display area 5U. The example of FIG. 7 represents a front image (similar to the scenery in the front seen from the driver's seat facing the front) taken by the camera 20 of the vehicle 1 traveling on a general road.

As shown with hatching in the figure, the front image has a vehicle signal C on the front side (object C in the figure) and a vehicle signal D on the back side (objects in the figure) as objects in the front image. And object D).

Further, the name of the intersection where the vehicle traffic signal is installed is displayed adjacently above the visual position of the vehicle traffic signal as characters representing the object information of the vehicle traffic signal.

As shown in the drawing, the vehicle traffic signal C located closer to the vehicle 1 than the vehicle traffic signal D is visually recognized at a position away from the vanishing point P (see FIG. 3), and the vehicle traffic signal C in the upper display area 5U is visible. The visual recognition position of the traffic light C is higher than the visual recognition position of the vehicle traffic light D.

Corresponding to this, the character (in this case, 2-chome) representing the information C related to the vehicle traffic signal C is within the upper display area 5U than the character representing the information D related to the vehicle traffic signal D (here 3-chome). The display position is on the top, and the distance from the vanishing point P as the reference point to the display position is long. For this reason, the display size of the information C is larger than that of the information D in accordance with the correspondence relationship of FIG. Accordingly, the driver can easily recognize that the information C (2-chome) corresponds to the vehicle signal C and the information D (3-chome) corresponds to the vehicle signal D.
C-3. Display example of the left display area 5L:
FIG. 8 shows an example in which characters and icons are displayed in the left display area 5L. The example of FIG. 8 represents a front image (similar to a front view seen from the driver's seat facing the front) taken by the camera 20 of the vehicle 1 traveling on a general road.

As shown with hatching in the figure, the front image includes the front building E (the object E in the figure) and the back building F (the object F in the figure) as objects. It is included.

And, as the object information of these buildings, icons imitating the logo marks of gas stations and convenience stores are displayed adjacent to the upper part of the building's visual recognition position.

As shown in the figure, the building E located closer to the vehicle 1 than the building F is visually recognized at a position away from the vanishing point P (see FIG. 3), and the visible position of the building E in the left display area 5L. Is to the left of the viewing position of the building F.

Correspondingly, the icon representing the information E on the building E (here, a convenience store) has a display position in the left display area 5L leftward than the icon representing the information F on the building F (here, GS). Thus, the distance from the vanishing point P as the reference point to the display position is long. Therefore, the display size of the icon of information E is larger than that of information F according to the correspondence relationship of FIG. Thus, the driver can easily recognize that the information E (convenience store) corresponds to the building E and the information F (GS) corresponds to the building F.

As described above, in the HUD device 10 of the present embodiment, the display position of characters and icons is close to the vanishing point P with the vanishing point P in front of the driver's seat as a reference point (that is, in the lower display area 5D). The display position in the upper display area 5U becomes lower, or the display position in the left display area 5L becomes right). It has become smaller. As a result, no large character or icon is displayed near the vanishing point P. For a driver who is driving with a line of sight toward the vanishing point P, the character and icon are displayed in front of the driver. It is possible to avoid being difficult to visually recognize.

Also, the driver who is looking at the vanishing point P has higher visual acuity (that is, visual discrimination ability) as the position is closer to the vanishing point P. Therefore, even if the display size is reduced as the display position of characters and icons approaches the vanishing point P, the driver can read the characters and icons.

On the other hand, since the visual acuity of the driver is lower as the position is further away from the vanishing point P in the vertical direction or the left and right direction, the display position of the characters and icons is away from the vanishing point P (that is, the lower display area 5D By increasing the display size as it becomes higher in the upper display area 5U or left in the left display area 5L, it is possible to make it easier for the driver to read characters and icons.

Furthermore, the display position of characters and icons in the display area 5 is related to the distance from the driver's seat to the object, and the closer the distance, the more distant the display position from the vanishing point P is in the vertical or horizontal direction. Become. In this embodiment, as the display position moves away from the vanishing point P, characters and icons are displayed with larger display dimensions. In this way, characters and icons can be displayed with appropriate dimensions according to the common sense that the distance from the driver's seat looks smaller and the closer it looks, the driver can see the correspondence between the displayed information and the object. Can be recognized easily, and the driver can correctly grasp information corresponding to the object.
D. Modified example:
In the above-described embodiment, the vanishing point P (see FIG. 3) in front of the driver's seat is set as the reference point. This is because the driver who is driving the vehicle 1 often turns his or her line of sight toward the vanishing point P. However, the driver's line of sight is not fixed and can move according to the traveling scene of the vehicle 1 or the like. Therefore, the reference point may be changed in accordance with the driver's line of sight. In the following, such a modified example will be described focusing on points different from the above-described embodiment.

In the description of the modified example, the same components as those in the above-described embodiment are denoted by the same reference numerals and the description thereof is omitted.
D-1. First modification:
FIG. 9 is a block diagram showing the configuration of the HUD device 10 of the first modification. The HUD device 10 of the first modification includes a road form information acquisition unit 24, a line-of-sight estimation unit 25, and a reference point change unit 26 in addition to the configuration of the HUD device 10 of the above-described embodiment (see FIG. 2). ing.

The road form information acquisition unit 24 is connected to the navigation system 23, and refers to the map information of the navigation system 23, and relates to road forms such as curves and hills ahead of the route of the vehicle 1 (hereinafter, road form information). To get.

The gaze estimation unit 25 estimates the driver's gaze based on the road configuration information acquired by the road configuration information acquisition unit 24.

If the driver's line of sight estimated by the line-of-sight estimation unit 25 does not face the vanishing point P, the reference point changing unit 26 moves the reference point from the vanishing point P according to the driver's line of sight.

Then, when the reference point is changed from the vanishing point P by the reference point changing unit 26, the display control unit 13 replaces the vanishing point P and changes the display dimensions of the characters and icons based on the positional relationship with the changed reference point. decide.

10A and 10B show an example in which the driver's line of sight moves according to the road form ahead of the route of the vehicle 1. In the example shown in FIG. 10A, the road is greatly curved rightward in front of the route of the traveling vehicle 1. In this case, the driver of the vehicle 1 moves the line of sight to the right from the vanishing point P in front of the driver's seat, as shown in FIG. Accordingly, in the HUD device 10 of the first modification, the reference point is changed to the center of the visual field after moving the line of sight.

FIG. 11 shows a flowchart of the reference point setting process executed by the HUD device 10 of the first modification.

This reference point setting process (S200) is executed at any stage before the process (S107) for determining the display size of characters and icons in the above-described HUD display control process (see FIG. 4). .

In the reference point setting process (S200), it is first determined whether or not a line-of-sight switch (not shown) is set to ON (S201). In the HUD device 10 according to the first modified example, the driver can select whether or not to activate the function of changing the reference point according to the driver's line of sight (hereinafter referred to as the line-of-sight function) by operating the line-of-sight switch. When the line-of-sight correspondence function is activated, the line-of-sight correspondence switch is set to ON, and when the line-of-sight correspondence function is not activated, the line-of-sight correspondence switch is set to OFF.

If the line-of-sight switch is not set to ON (S201: no), the vanishing point P is set as a reference point as in the above-described embodiment (S202), and the reference point setting process in FIG. Then, the process returns to the HUD display control process of FIG.

On the other hand, when the line-of-sight switch is set to ON (S201: yes), the road form information ahead of the route from the travel point of the vehicle 1 is acquired with reference to the map information of the navigation system 23 (S203). . In addition, you may acquire road form information from the front image etc. of the vehicle 1 image | photographed with the camera 20. FIG.

Subsequently, the driver's line of sight is estimated based on the acquired road form information (S204). For example, as shown in FIGS. 10A and 10B, if the road is curved in the right direction in front of the route of the vehicle 1, the driver's line of sight is directed to the right from the vanishing point P. On the other hand, if the road curves to the left, it is estimated that the driver's line of sight is pointing to the left of the vanishing point P. At this time, it can be estimated that the smaller the curvature radius of the curve (that is, the steeper the curve), the greater the driver's line of sight is moving from the vanishing point P in the left-right direction.

Note that the driver's line of sight may change according to the speed of the vehicle 1, and as the speed increases, the driver's line of sight tends to be directed further (that is, beyond the curve). Therefore, as the speed of the vehicle 1 is acquired, the speed of the vehicle 1 may be added to the estimation of the driver's line of sight.

Also, the movement of the driver's line of sight is not limited to the left-right direction, but can also move in the vertical direction. For example, if the road is uphill in front of the route of the vehicle 1, the driver looks up at the destination before the uphill, so the driver's line of sight is above the vanishing point P. Estimated. On the other hand, if the road is downhill, the driver looks down on the destination before the downhill, so the driver's line of sight is estimated to be below the vanishing point P. In this case, it can be estimated that as the slope of the slope is steeper, the driver's line of sight moves more greatly in the vertical direction from the vanishing point P.

Thus, when the driver's line of sight is estimated, it is determined whether or not the driver's line of sight faces the vanishing point P (S205). When it is estimated that a straight road continues ahead of the route of the vehicle 1 and the driver's line of sight is facing the vanishing point P (S205: yes), the vanishing point P is set as a reference point (S202).

On the other hand, when it is estimated that the driver's line of sight does not face the vanishing point P (S205: no), the reference point is moved according to the driver's line of sight, and the center of the visual field is set as the reference point (S206). ).

In S204 of the first modification, the driver's line of sight is estimated based on the road form information, and may differ from the actual line of sight. For example, even if the road is curved in front of the route of the vehicle 1, if the preceding vehicle is present in front of the vehicle 1, the driver's line of sight is directed to the preceding vehicle instead of the tip of the curve. In that case, it is close to the vanishing point P. Therefore, when it is estimated that the driver's line of sight does not face the vanishing point P (S205: no), the radar 21 then determines whether a preceding vehicle is detected in front of the vehicle 1 or not. If the preceding vehicle is not detected, the reference point is moved according to the estimated line of sight. If the preceding vehicle is detected, the vanishing point P may be set as the reference point.

Thus, when the reference point is set according to the driver's line of sight, the reference point setting process in FIG. 11 is terminated, and the process returns to the HUD display control process in FIG.

In the HUD display control process, after returning from the reference point setting process, if the vanishing point P is set as the reference point in S107, the figure is displayed based on the distance from the vanishing point P to the display position of the character or icon. The display dimensions are determined according to the correspondence relationship of 5. On the other hand, if the reference point has been changed from the vanishing point P, the display dimensions are changed according to the correspondence in FIG. 5 based on the distance from the set reference point to the display position of the character or icon instead of the vanishing point P. decide.

FIG. 12 shows an example in which characters and icons are displayed on the HUD device 10 of the first modified example when the road is curved in front of the route of the vehicle 1. The example of FIG. 12 represents a forward image taken by the camera 20 in front of the curve of the vehicle 1 where the road is curved in the right direction.

Also, in the first modification, one display area 5 that overlaps the entire front image taken by the camera 20 is provided.

In the case of the example in FIG. 12, since it is estimated that the driver's line of sight is directed toward the end of the curve, the reference point is set at the right end in the front image (that is, the display area 5).

Moreover, as shown with hatching in the figure, the front image has buildings G, H, and I (object G, object H, object in the figure) arranged along the curve as objects. Three items I) are included. Of these, the building G closest to the vehicle 1 is visually recognized at the position farthest from the reference point, and as the building H and the building I move away from the vehicle 1 in this order, the visual recognition position becomes closer to the reference point. Yes.

Correspondingly, when an icon representing information of each building (information G, information H, information I in the figure) is attached above the visual recognition position of each building, the display position of the icon indicates that the information I is the reference point. The information H and the information G are separated in the horizontal direction from the reference point. Therefore, according to the correspondence relationship of FIG. 5, the display size of the icon has the largest information G among the three pieces of information, the next largest information H, and the smallest information I. Since the reference point is moved from the front of the driver's seat to the side of the curve (right side in the example of FIG. 12) before the curve, the display size of the icon is smaller on the side of the curve than the front of the driver's seat. Become.

FIG. 13 shows an example in which characters and icons are displayed on the HUD device 10 of the first modified example when the road is sloped in front of the route of the vehicle 1. The example of FIG. 13 represents a forward image taken by the camera 20 in the uphill direction ahead of the path of the vehicle 1 and before the uphill road.

In the case of the example in FIG. 13, since it is estimated that the driver's line of sight is directed to the top of the uphill, the reference point is set at the top in the forward image (that is, the display area 5).

In addition, as shown with hatching in the figure, the front image has an object in the same lane as the preceding vehicle J (the object J in the figure) in the right front and traveling in the adjacent lane as an object. It includes a preceding vehicle K (object K in the figure) that has already traveled uphill in front of the front. The preceding vehicle J closer to the vehicle 1 than the preceding vehicle K is visually recognized at a position farther from the reference point than the preceding vehicle K.

Correspondingly, when a character representing distance information (information J, information K in the figure) of each preceding vehicle from the vehicle 1 is attached below the visual recognition position of each preceding vehicle, information corresponding to the preceding vehicle J The display position of the letter J (50 m here) is further away from the reference point in the vertical and horizontal directions than the letter K of information K (here 100 m) corresponding to the preceding vehicle K. Therefore, the display size of the character of the information J is larger than that of the character of the information K according to the correspondence relationship of FIG. Before the uphill, the reference point is moved from the front of the driver's seat to the upper side, so that the display size of the characters becomes smaller toward the upper side than the front of the driver's seat.

On the contrary, before the downhill, the driver's line of sight is lowered and the reference point is moved from the front of the driver's seat to the lower side, so the display size of the characters is lower than the front of the driver's seat. Get smaller.

As described above, in the HUD device 10 of the first modification, attention is paid to the fact that the driver's line of sight can move according to the form of the road ahead of the route of the vehicle 1, and the estimation is based on the road form information. The reference point is changed to the center of the field of view according to the driver's line of sight. The display size is reduced as the display position of characters and icons is closer to the reference point, and the display dimension is increased as the display position is further away. As a result, even if the driver's line of sight moves from the front of the driver's seat in front of a curve or a slope, no large letters or icons are displayed near the center of the field of view. It is possible to avoid difficulty in visual recognition. In addition, since characters and icons are displayed large on the outer edge of the field of view where the driver's visual acuity is reduced, the driver can easily read the characters and icons.
D-2. Second modification:
In the first modification described above, the driver's line of sight is estimated based on the road form information. However, as a direct detection of the driver's line of sight, the reference point may be changed according to the detected line of sight.

FIG. 14 shows a rough configuration of the vehicle 1 on which the HUD device 10 of the second modified example is mounted. In the second modification, in addition to the configuration of the above-described embodiment (see FIG. 1), a face camera 27 that captures a driver's face image is mounted on the vehicle 1.

The face camera 27 is provided separately from the camera 20 that captures a front image of the vehicle 1 and is installed, for example, in the vicinity of a meter panel in order to capture a face image including at least the eyes of the driver.

Note that the facial camera 27 of this embodiment corresponds to a “photographing unit” of the present disclosure.

FIG. 15 is a block diagram showing the configuration of the HUD device 10 of the second modification. The HUD device 10 of the second modification includes a line-of-sight detection unit 28 and a reference point changing unit 26 in addition to the configuration of the HUD device 10 of the above-described embodiment (see FIG. 2).

The line-of-sight detection unit 28 is connected to the face camera 27 and analyzes the driver's face image captured by the face camera 27 to detect the driver's line of sight.

If the driver's line of sight detected by the line-of-sight detection unit 28 does not face the vanishing point P, the reference point changing unit 26 moves the reference point from the vanishing point P according to the driver's line of sight.

The reference point setting process executed by the HUD device 10 of the second modification is different from the reference point setting process (see FIG. 11) of the first modification described above in the following points.

First, in S203, face image data including the driver's eyes photographed by the face camera 27 is obtained instead of the road form information. Subsequently, in S204, the acquired face image data is analyzed to detect the driver's line of sight. The driver's line of sight can be detected based on, for example, the position of an iris portion (so-called black eye) identified from the driver's face image.

If the detected driver's line of sight faces the vanishing point P (S205: yes), the vanishing point P is set as a reference point (S202), and if the driver's line of sight does not face the vanishing point P (S205: no), The reference point is moved in accordance with the driver's line of sight, and the center of the visual field is set as the reference point (S206).

In addition, when a driver | operator's eyes | visual_axis is moving continuously, after a gaze stops after that, you may set a reference point according to the stopped gaze.

In the HUD device 10 of the second modified example, as in the first modified example, when the driver's line of sight moves from the front of the driver's seat, the reference point is changed according to the line of sight, Since large characters and icons are not displayed near the center, it can be avoided that it is difficult for the driver to visually recognize the scenery in front. In addition, since characters and icons are displayed large on the outer edge of the field of view where the driver's visual acuity is reduced, the driver can easily read the characters and icons.

Moreover, in the HUD device 10 of the second modified example, it is possible to set a reference point that matches the actual line of sight by directly detecting the driver's line of sight.

As mentioned above, although an Example and a modification were demonstrated, this indication is not restricted to said Example and a modification, It can implement in a various aspect in the range which does not deviate from the summary.

For example, in the above-described embodiment, the lower display area 5D, the upper display area 5U, and the left display area 5L are provided, but at least one of them may be provided. Moreover, it is good also as one display area 5 without dividing | segmenting into these several display areas.

Further, when providing a right display area located to the right of the vanishing point P, the closer the distance from the driver's seat to the object (for example, a specific building), the closer the specific building in the right display area. The viewing position is on the right (ie, away from the vanishing point P). Therefore, the display size may be increased as the display position of the character or icon representing the object information of the specific building becomes right in the right display area.

Further, in the above-described embodiment, a predetermined object is detected from the front image, and information regarding the detected object is acquired. However, when the target object is a specific building, based on the map information of the navigation system 23, information on the type and position of the specific building existing along the route on which the vehicle 1 travels is acquired first. When the position of the acquired specific building is close, the specific building may be detected from the front image.

In the above-described embodiment, the radar 21 is used to acquire the distance from the vehicle 1 to the preceding vehicle, but the present invention is not limited to this. For example, a sonar that measures the distance using sound waves or a laser sensor that measures the distance using light may be used. Further, the distance may be measured based on the captured image of the camera 20.

Furthermore, in the above-described embodiments and modifications, it has been described that the shooting range of the camera 20 is fixed. However, when the driver's line of sight is estimated or detected as in the modification, the shooting range of the camera 20 may be changed according to the driver's line of sight. By doing so, it becomes possible to detect the object from the captured image of the camera 20 in conjunction with the driver's line of sight.

Here, the flowchart or the process of the flowchart described in this application is configured by a plurality of sections (or referred to as steps), and each section is expressed as S100, for example. Further, each section can be divided into a plurality of subsections, while a plurality of sections can be combined into one section. Further, each section configured in this manner can be referred to as a device, module, or means.

Although the present disclosure has been described based on the embodiments, it is understood that the present disclosure is not limited to the embodiments and structures. The present disclosure includes various modifications and modifications within the equivalent range. In addition, various combinations and forms, as well as other combinations and forms including only one element, more or less, are within the scope and spirit of the present disclosure.

Claims

By projecting an image onto a transparent plate-like member (3) provided in front of the driver's seat of the vehicle (1), the image is displayed as a virtual image so as to overlap the scenery in front of the driver's seat seen through the plate-like member. A head-up display device (10),
A projection unit (11, 12) for projecting the image on the plate-like member in order to display a character or a figure as the image representing information to be presented to the driver of the vehicle on a virtual image on the scenery;
Display control for displaying the character or the figure with a larger display size as the display position of the character or the figure moves away from the reference point in the vertical direction or the horizontal direction with the center of the field of view as viewed from the driver's seat as the reference point A head-up display device comprising: a unit (13).
The head-up display device according to claim 1,
A road form information obtaining unit (24) for obtaining road form information relating to a road form ahead of the route of the vehicle;
A line-of-sight estimation unit (25) for estimating the line of sight of the driver based on the road form information;
A head-up display device further comprising: a reference point changing unit (26) that moves the reference point according to the driver's line of sight estimated by the line-of-sight estimation unit.
The head-up display device according to claim 1,
A photographing unit (27) for photographing a face image including at least eyes of the driver;
A line-of-sight detection unit (28) for detecting the line of sight of the driver based on the face image;
A head-up display device further comprising: a reference point changing unit (26) that moves the reference point according to the driver's line of sight detected by the line-of-sight detection unit.
The head-up display device according to any one of claims 1 to 3,
An object detection unit (15) for detecting a predetermined object from the scenery;
An object information acquisition unit (16) for acquiring object information related to the object;
The projection unit projects the character or the graphic representing the object information as the information presented to the driver onto the plate-like member so as to display a virtual image in association with the object. apparatus.
The head-up display device according to claim 4,
The character or the graphic projected by the projection unit is displayed in a lower display area (5D) set below the reference point,
The object detection unit detects a preceding vehicle existing in front of the vehicle as the object,
The display control unit displays the character or the graphic associated with the preceding vehicle with a larger display size as the viewing position of the preceding vehicle visually recognized from the driver's seat becomes lower in the lower display area. apparatus.
The head-up display device according to claim 4,
The character or the figure projected by the projection unit is displayed in an upper display area (5U) set above the reference point,
The object detection unit detects a vehicle traffic signal present in the scenery as the object,
The display control unit displays the character or the figure associated with the vehicle traffic signal in a larger display size as the viewing position in the upper display area of the traffic signal viewed from the driver's seat increases. Up display device.
The head-up display device according to claim 4,
The character or the graphic projected by the projection unit is displayed in a side display area (5L) set to the left or right of the reference point,
The object detection unit detects a specific building existing in the scenery as the object,
The display control unit is configured to associate the specific building with the specific building as the visual recognition position in the side display region of the specific building viewed from the driver's seat becomes more lateral with respect to the reference point. A head-up display device that displays the figure in a large display size.
Head-up display display method for projecting an image onto a transparent plate-like member provided in front of a driver's seat of a vehicle, and displaying the image as a virtual image superimposed on a front view seen through the plate-like member from the driver's seat Because
Projecting the image on the plate-like member in order to display a character or a figure as the image representing information to be presented to the driver of the vehicle on a virtual image on the scenery (S108),
With the center of the field of view as viewed from the driver's seat as a reference point, the character or the figure is displayed with a larger display size as the display position of the character or the figure is further away from the reference point in the vertical direction or the horizontal direction (S107). A head-up display display method.