JP5723106B2 - Vehicle display device and vehicle display method - Google Patents

Description

  The present invention relates to a vehicular display device and a vehicular display method for displaying navigation information and the like for driving assistance in a front visual field region of a vehicle driver.

  Conventionally, there is a navigation device that supports driving to a destination, and image information including map information from the departure point or the current location to the destination and information on the current position of the vehicle is displayed on a display such as a liquid crystal panel provided on the vehicle. It is trying to display. Further, in recent years, a head-up display (hereinafter referred to as HUD) that irradiates image information on a combiner or windshield installed in a vehicle and presents the reflected image information to a driver is provided to improve the driver's visibility. There is also.

  In the vehicle display device provided with the HUD, since navigation information and vehicle information are displayed on the windshield, the displayed information and the actual scene may overlap, which may hinder driving. For this reason, navigation information is usually displayed at a lower position of the windshield, that is, at a reference position lower than the position of the line of sight when the driver looks forward, so as not to hinder driving.

  Some conventional HUDs can detect the driver's line of sight and adjust the display position vertically and horizontally. However, since the movement pattern of the head (face) during driving is different for each driver, it is difficult to quickly change the display position corresponding to various driving actions of the driver. For this reason, a driver | operator's eyes | visual_axis and the position of a display image may not correspond, and the displayed important image may be missed.

  Patent Document 1 discloses a head-up display that detects a driver's line of sight, measures a visual field range visible to the driver, and controls an image projection direction so as to be within the visual field range. Patent Document 2 discloses an example in which an inter-vehicle distance from a vehicle ahead is measured and a display position of a head-up display is controlled based on inter-vehicle distance information.

  However, in the conventional example and the examples of Patent Documents 1 and 2, since the movement pattern of the head (face) of each driver is not considered, the display position of the image and the driver's line-of-sight direction are shifted. There is a case where the displayed image information is missed.

JP 2010-18201 A JP 2004-322680 A

  In a conventional vehicle display device equipped with a HUD, the driver's line of sight is detected so that the display position can be adjusted up, down, left, and right. Due to the difference, the driver's line of sight and the position of the display image may not match, and the displayed image information may be missed.

  In view of such circumstances, an object of the present invention is to provide a vehicle display device and a vehicle display method capable of changing the display position of image information in accordance with the driving style of the driver.

A vehicle display device according to an embodiment of the present invention includes an image information generation unit that generates image information, and a head-up display that projects and displays the image information generated by the image information generation unit on a windshield of a vehicle. a behavior measuring unit for generating a motion pattern of the head by the movement amount measured by the driver individual habits of the head of the driver for each operating scene straight and right-left, the motion pattern of each of the driver A storage unit that sequentially updates and stores the information, a driver's movement pattern of the corresponding driver is read from the storage unit, and a driving scene to be encountered is determined based on the current location and route information of the vehicle a display position determining unit for determining the display position of the image information of the driver and each of the driving scene based on past motion pattern of the driver, the determination of the display position determination unit Depending characterized by comprising a display position control unit for controlling the display position of the image information.

Vehicle display method according to an embodiment of the present invention, the image information generated by the image information generation unit The vehicle display method for projecting displayed by the head-up display on the windshield of the vehicle, the straight and right-turn operation by measuring the amount of movement of the driver's head for each scene to generate a motion pattern of the head by the driver individual habits, sequentially updated and stored in the storage unit the movement pattern of each of the driver The driver's movement pattern is read from the storage unit, and the driving scene to be met is determined based on the current location and route information of the vehicle , and the driver's memory stored in the storage unit is stored. determining the display position of the image information of each of the driver and the driver past motion pattern based on the scene, control child the display position of the image information according to the determined The features.

  According to the vehicle display device of the present invention, information to be shown can be presented to the driver at an appropriate timing by shifting the display position of the image information in accordance with the movement of each driver during driving.

1 is a block diagram showing the overall configuration of a vehicle display device according to an embodiment of the present invention. The lineblock diagram showing HUD (head up display) in the embodiment. Explanatory drawing which shows the display position of the display information in the embodiment. Explanatory drawing which shows an example of the change data and correction timing data of a driver | operator's display position. The flowchart which shows the change operation | movement of a display position.

  Hereinafter, a display device for a vehicle according to an embodiment of the present invention will be described with reference to the drawings.

  FIG. 1 is a block diagram illustrating an overall configuration of a vehicle display device 100 according to an embodiment. In FIG. 1, the vehicle display device 100 includes an information processing unit 10, an operation unit 20, a camera 21, and a head-up display 30 (hereinafter, HUD 30).

  The information processing unit 10 includes a control unit 11, an image information generation unit 12, a display position determination unit 13, a storage unit 14, a behavior measurement unit 15, a driver information input unit 16, a navigation information acquisition unit 17, and Vehicle information acquisition unit 18, and HUD 30 includes drive unit 31. The navigation information acquisition unit 17 acquires navigation information from the navigation device 200, and the vehicle information acquisition unit 18 acquires vehicle information from the vehicle 300.

  The control unit 11 of the information processing unit 10 controls the operation of the vehicle display device 100 and includes a CPU, a ROM, a RAM, and the like. The image information generation unit 12 generates image information including navigation information and information on the host vehicle based on information from the vehicle information acquisition unit 18 and the navigation information acquisition unit 17.

  The display position determination unit 13 determines the display position of the image information generated by the image information generation unit 12 and changes the display position by controlling the drive unit 31 of the HUD 30 (display position determination processing will be described later). ). The drive unit 31 constitutes a display position control unit. The storage unit 14 stores various types of information processed by the information processing unit 10.

  The behavior measurement unit 15 captures the driver's head (face) with the camera 21 for each driving scene (for example, when turning right or left), and generates head movement information based on the captured result. To do. That is, since the movement pattern of the head is different for each driver when turning right or left, the behavior measurement unit 15 measures the movement pattern of the driver's head in each driving scene and generates movement information. . As the movement pattern, for example, changes in the driver's posture, line-of-sight direction, and face direction are measured.

  The driver information input unit 16 inputs who is the driver, and inputs the driver information from the input information from the operation unit 20 or the driver's face information captured by the camera 21. The driver information input to the driver information input unit 16 is stored in the storage unit 14. Further, the face information photographed by the camera 21 is stored in the storage unit 14, and the driver is identified by comparing the face information saved when the driver's face is photographed next with the photographed face information. Information may be acquired.

  The navigation information acquisition unit 17 acquires navigation information such as the current position of the vehicle, route information, and road conditions from the navigation device 200. Further, the vehicle information acquisition unit 18 acquires vehicle information such as an accelerator, a brake, a steering wheel angle, a gear position, a blinker, and a vehicle speed from the vehicle 300. The navigation information acquired by the navigation information acquisition unit 17 and the vehicle information acquired by the vehicle information acquisition unit 18 are input to the control unit 11.

  The image information generation unit 12, the display position determination unit 13, the storage unit 14, the behavior measurement unit 15, the driver information input unit 16, the navigation information acquisition unit 17, and the vehicle information acquisition unit 18 are connected to the control unit 11, Various types of information are processed under the control of the control unit 11.

  The operation unit 20 detects an input from an operation button (not shown) provided on the vehicle, and inputs various display on / off instructions, driver information, and the like by a driver's operation. The operation unit 20 may be a touch panel type that touches a display.

  A plurality of cameras are mounted on the vehicle, images of the surroundings of the vehicle are photographed, obstacles on the road are identified by analyzing the photographed images, and information indicating the presence or absence of the obstacles is displayed as the image information generation unit 12. The obstacle information may be generated. In addition to the method of photographing the surroundings with a camera, the obstacles may be detected by attaching a plurality of ultrasonic sensors or radars to the vehicle and detecting obstacles around the vehicle.

  Next, the configuration of the HUD 30 will be described. The HUD 30 is a projector disposed at a position corresponding to the driver's seat on the dashboard of the vehicle, for example, and projects an image on the windshield in front of the driver's seat.

  FIG. 2 is a configuration diagram of the HUD 30. In FIG. 2, the HUD 30 includes a light flux generation unit 32, an irradiation lens 33, and an optical lens 34 that controls the irradiation range. The irradiation lens 33 and the optical lens 34 constitute an optical box 35, and the focus and magnification can be controlled. Furthermore, the mirror 36 which controls an irradiation position, the lens 37 which expands an image, and the drive part 31 which controls the angle of the mirror 36 are included.

  Image information from the image information generation unit 12 is supplied to the light beam generation unit 32, and the light beam generation unit 32 outputs a light beam for displaying the image information. The light beam is applied to the mirror 36 through the irradiation lens 33 and the optical lens 34. The light beam reflected by the mirror 36 is magnified by the magnifying lens 37 and projected on the windshield FG of the vehicle. The optical box 35, the mirror 36, and the magnifying lens 37 constitute a projection optical system.

  The display range of the projected image can be controlled by the optical lens 33, and the irradiation position (display position) can be controlled by adjusting the angle of the mirror 36. The drive unit 31 is driven by a position control signal from the display position determination unit 13 and adjusts the angle of the mirror 36 to change the display position of the image information.

  Since the focus of the image information may be blurred when the display position of the image information is shifted, the optical box 35 may be controlled to adjust the focus correctly. Further, when the size of the image information changes by shifting the display position, the display magnification may be adjusted to display the same size. The focus and display magnification are controlled to preset adjustment values so as to be optimal when the display position is shifted.

  Thus, in the vehicle display device 100 of the embodiment, the image information can be displayed on the display unit (the windshield FG). As image information, for example, navigation information and information on the own vehicle (vehicle speed, etc.) are displayed along a route from an arbitrary departure point to a destination for a vehicle driver. Further, when there is an obstacle, the detection result of the obstacle may be displayed.

  FIG. 3 is a diagram schematically showing the display position of the image information. The display unit is substituted by the windshield FG in front of the driver seat, and projects the image 301 from the HUD 30 onto the windshield FG in front of the driver seat. A display unit 302 such as an LCD display can be arranged in the center of the dashboard of the vehicle, and various types of information can be displayed on the display unit 302. In addition, the camera 21 is attached to the front ceiling portion in order to photograph the driver. The attachment position of the camera 21 is not limited to the illustrated position, and may be attached to another position such as a dashboard or a handle part as long as the face of the driver, particularly one eye can be photographed.

  In the present embodiment, the image information 301 is projected to a position below the windshield FG, that is, a position below the driver's reference line of sight (field of view) so that the actual scene can be watched preferentially during driving. To display. The display position is shifted so that the image information 301 can be seen by the driver for each driving scene such as when turning right or turning left.

  Hereinafter, the display position changing operation will be described. The display position changing operation is roughly performed as follows. First, the driver is determined who is driving. The determination of the driver is made by comparing the image captured by the camera 21 with the face image registered in advance in the storage unit 14. Alternatively, the driver may directly input the driver name by operating the operation unit 20.

  The behavior measuring unit 15 measures the movement of the driver's head based on the image of the driver's head (face, eyes) taken by the camera 21. Head movement information may be acquired using a sensor that measures the head position instead of the camera 21. Further, the behavior measurement unit 15 acquires driving scene information such as right turn, left turn, and straight ahead from the vehicle information acquisition unit 18 and the navigation information acquisition unit 17 and measures the movement of the driver's head for each driving scene. The measured movement information is stored in the storage unit 14 for each driver.

The display position determination unit 13 determines the display reference position of the image information from the information on the head (eye position) when traveling straight, stored in the storage unit 14. Further, the display position determination unit 13 obtains the movement pattern of the driver's head (eye position) at the time of right turn, left turn, etc. from the current movement information and the movement information stored in the storage unit 14, A driving scene to be met is determined from the route information, and the display position of the image information for each driving scene is determined.
For example, when the vehicle turns right, the movement pattern of the driver when turning right is read out from the storage unit 14, and image information is displayed at the position of the driver's line of sight according to the wrinkle (such as tilting to the right) when turning right. Change the display position so that Similarly, the movement pattern at the time of the left turn of the driver is also read out from the storage unit 14 at the time of the left turn so that the image information is displayed at the position of the driver's line of sight according to the heel when turning left (slightly tilted to the left, etc.) Change the display position. The display position is corrected according to the first half, middle board, and second half of the left / right turn.

  Thus, for each driver, the movement pattern at the time of straight ahead or right / left turn is measured, the sequentially updated movement pattern is stored in the storage unit 14, and the display position determination unit 13 determines the driving scene to be encountered from the current location and route information, Determine the display position. Based on the information from the navigation information acquisition unit 17 and the information from the vehicle information acquisition unit 18, the image information generation unit 12 generates a navigation image indicating the current location of the vehicle and the direction in which the vehicle should travel in accordance with the progress of the vehicle. Displayed on the HUD 30. Further, the display unit is changed by controlling the driving unit 31 so as to match the display position determined by the display position determination unit 13.

  Hereinafter, the display position changing operation will be described in detail. FIG. 4 shows an example of the display position (coordinate statistical value) of the image information calculated by the display position determination unit 13 based on the statistical data of the head movement pattern for each driver measured by the behavior measurement unit 15. It is explanatory drawing. The coordinate statistic indicates the driver's line-of-sight position in coordinates (X, Y) as shown in FIG. 3, for example, the standard line-of-sight position when the driver is moving straight ahead and coordinates ( 0, 0), and the offset value is stored in the storage unit 14. Further, statistics of the amount of movement of each driver's head during straight travel are taken to calculate coordinate statistical values (X, Y) during straight travel for each driver, which are used as reference positions for display.

  The display position of the image information is shifted to the right when the value of the coordinate X is (+), for example, and is shifted to the left when the value of the coordinate X is (−). If the value of the coordinate Y is (+), it is shifted upward, and if the value of the coordinate Y is (−), it is shifted downward. In the example of FIG. 4, the coordinates of the line-of-sight position of the driver A when traveling straight are (0, 0), the coordinates of the line-of-sight position of the driver B are (1, 0), and the line-of-sight position of the driver C The coordinates are (0, 1). That is, for the driver A, the image information is displayed at the standard position with respect to the standard line-of-sight position (0, 0), and the driver B is displayed at a position slightly shifted to the right. The driver C is displayed at a position shifted slightly upward.

  Similarly, in the right turn and left turn scenes, the behavior measuring unit 15 holds the head movement information in the storage unit 14 in time series, and the display position determining unit 13 is used when the driver makes a right turn or a left turn. The line-of-sight position, that is, the statistical coordinate (X, Y) is calculated and held. Further, the right turn scene and the left turn scene are subdivided into the first half / midboard / second half of the right / left turn, and the statistical value coordinates (X, Y) are calculated and held for each subdivided unit.

  Furthermore, the display position determination unit 13 calculates the average of the timing when the change in the movement amount becomes significant from the time series change (for example, the differential change amount) of the head movement amount in the subdivided unit including past information. The value is calculated, the timing (correction timing) for shifting the display position of the image information is determined, and held in the storage unit 14.

  The correction timing in the first half of the right / left turn in FIG. 4 is set based on, for example, the time when the driver takes out the blinker. In other words, when the driver makes a right or left turn, if there is statistical data such as how many seconds after turning the winker and starting to turn the steering wheel, how many seconds after completing the right or left turn, the display position when making a right or left turn for each driver Can be set in advance. In the middle of the left / right turn, it is set based on the elapsed time from the correction timing in the first half. Also, for the second half of the left / right turn, it is set based on the elapsed time from the correction timing of the middle stage.

  The change in the display position of the image information when the driver A makes a right turn will be described using FIG. 4 as an example. The display position will be at the position of the coordinate statistical value (1, 0) after 1000 (mS) after the right turn indicator is taken out. Shifted. In the middle of the right turn, the position is shifted to the position of the coordinate statistical value (3, 0) after 800 (mS) from the correction timing of the first half. 0). In FIG. 4, there is a portion “...” Where the numerical value is not filled, but this indicates that the measurement data is still insufficient.

  The correction timing may be determined by using the information from the vehicle information acquisition unit 18 and the navigation information acquisition unit 17 in addition to the blinker information to determine the position of the host vehicle within the intersection and correcting the display position. good. As for driving scenes, in addition to right / left turn scenes, various scenes such as merging, lane change, toll gate / parking lot entry, etc. are set, and information on the amount of head movement for each driving scene is stored in the storage unit 14 It is preferable to set the display position correction timing.

  The current driving scene information is obtained by using the surrounding image of the vehicle reflected on the camera 21, route information from the navigation information acquisition unit 17, current position information, steering angle from the vehicle information acquisition unit 18, and vehicle speed information. Can be acquired. Further, when an external shooting camera is installed, the current driving scene can be determined based on information from the external shooting camera. In this way, the display position can be switched according to the behavior of the driver by reading out the coordinate statistical value for each driving scene from the storage unit 14.

  In the driving scene determined by the system, if the driver takes a driving action different from normal driving, the scene determination is corrected at that time. For example, when the next route indicates a right turn in the navigation, it is determined that the scene is a right turn from 30 meters before the next intersection. However, if the route turns right but is traveling at a speed of 60 km / h 30 m before the intersection, it is determined that the scene is going straight. Alternatively, even if the navigation indicates a straight route, there are various correction conditions such as determining that a left turn scene has been entered from a position 30 m before the intersection when the steering wheel is turned to the left.

  Further, when the movement amount of the head is measured using the captured image of the camera 21, the behavior measurement unit 15 estimates the eye position in accordance with the acquisition timing of the driver information. The head position estimation method can be replaced by a sensor or the like attached to the upper part of the driver's seat in addition to the camera 21. If the information on the position of the reference eye (either left or right) is directly known by the camera 21, that information is used. If only the head position is known, the position of the eye is determined based on the head position information. It may be estimated.

  The coordinate statistical values in FIG. 4 are calculated based on the average value of the head movement amount of each driving scene stored in the storage unit 14 until now. You may calculate using statistical data, such as a value and a median.

  FIG. 5 is a flowchart showing the shift operation of the display position of the image information. The operation of FIG. 5 is performed under the control of the control unit 11. In FIG. 5, when the engine is started in step S0, the driver is confirmed in step S1, and the driver information is read in step S2. In step S3, the reference position of the image information, that is, the coordinate statistical value (X, Y) when the driver goes straight ahead is output from the storage unit 14, and is used as the display reference position. In step S4, information on the current driving scene is acquired.

  In step S5, the movement amount (movement pattern) of the driver's head is measured, and in step S6, the driver's movement information is stored in the storage unit 14 and updated. In step S7, it is determined whether or not a driving scene (for example, a right / left turn scene) for changing the display position of the image information has been entered. When the change scene is entered, it is determined in step S8 whether or not the display position is to be updated, and if it is the update timing, the correction timing and statistical coordinate values in FIG. 4 are read in step S9. In step S10, information for changing the display position is output, and the display position of the image information is shifted.

  In step S11, it is determined whether or not the set driving scene has been completed, for example, whether or not a right / left turn has been completed. If the driving scene has not ended, the process returns to step S5, the head movement amount is measured, and the operation up to step S10 is repeated. If it is determined in step S8 that it is not time to change the display position, the process proceeds to step S11. If it is determined in step S11 that the scene is ended, it is determined in step S12 whether or not the engine is off. If not, the process returns to step S3 to shift the display position to the reference position, and the following steps are repeated. If it is determined in step S12 that the engine is off, the process ends in step S13.

  As described above, in the present embodiment, by shifting the display position of the image information in each driving scene in accordance with the movement pattern at the time of driving of each driver, the information desired to be displayed can be presented to the driver at an appropriate timing. it can. Therefore, the trouble of adjusting the display position every time when sitting in the driver's seat can be saved. Also, even if the driver changes, once registered, there is no need to make adjustments thereafter, so that labor can be saved.

  The embodiment of the present invention is not limited to the configuration described above. For example, the method of adjusting the mirror angle has been described as an example of shifting the display position of the image information, but it may be shifted by other methods, or the position of the display information may be shifted by image processing. Modifications can be made without departing from the scope of the claims.

DESCRIPTION OF SYMBOLS 100 ... Display apparatus 10 for vehicles ... Information processing part 11 ... Control part 12 ... Image information generation part 13 ... Display position determination part 14 ... Memory | storage part 15 ... Behavior measurement part 16 ... Driver information input part 17 ... Navigation information acquisition part 18 ... Vehicle information acquisition unit 20 ... Operation unit 21 ... Camera 30 ... Display device (head-up display)
DESCRIPTION OF SYMBOLS 31 ... Drive part 32 ... Light flux generation part 33 ... Irradiation lens 34 ... Optical lens 35 ... Optical box 36 ... Mirror

Claims (9)

An image information generation unit for generating image information;
A head-up display that projects and displays the image information generated by the image information generation unit on a windshield of a vehicle;
A behavior measurement unit that measures the amount of movement of the head of the driver for each driving scene of straight ahead and right / left turn, and generates a head movement pattern by the driver's individual heel ,
A storage unit for sequentially updating and storing the movement pattern for each driver;
Reads the driver's movement pattern corresponding to determine the driver from the storage unit, and indexing operation scene now encounters based on current position and the route information of the vehicle, even past motion pattern of the driver A display position determining unit that determines a display position of the image information for each of the driver and the driving scene;
A display position control unit that controls the display position of the image information in accordance with the determination of the display position determination unit;
A vehicle display device characterized by comprising: The head-up display includes a light beam generation unit that generates a light beam based on image information from the image information generation unit, and a projection optical system that reflects the light beam by a mirror and projects the light onto the windshield,
The vehicle display device according to claim 1, wherein the display position control unit controls a display position of the image information by controlling a reflection angle by the mirror. The said behavior measurement part is provided with the camera which image | photographs the said driver | operator, and produces | generates the said driver | operator's movement pattern based on the moving amount | distance of the said driver | operator's gaze direction and face direction. Vehicle display device.   The vehicle display device according to claim 1, wherein the behavior measuring unit includes a sensor arranged around the driver in order to measure the movement of the head of the driver.   The display position determination unit calculates coordinate information indicating the display position of the image information in the driving scene, and the display position control unit controls the display position of the image information based on the coordinate information. The vehicle display device according to claim 1, wherein:   The display position determination unit sets a plurality of display timing switching timings in the driving scene, and the display position control unit switches the display position of the image information at the set timings. The vehicle display device described.   The vehicle display device according to claim 1, wherein the display position determination unit determines the driving scene based on a vehicle peripheral image or navigation information obtained by photographing the driving scene with a camera.   The vehicle display device according to claim 7, wherein the display position determining unit corrects the determined driving scene in real time according to an actual action of the driver. A vehicle display method for projecting and displaying image information generated by an image information generation unit on a windshield of a vehicle by a head-up display,
Measure the amount of movement of the driver's head for each driving scene of straight ahead and right / left turn to generate a head movement pattern by the driver's individual heel ,
The movement pattern for each driver is sequentially updated and stored in a storage unit,
The driver's movement pattern is read out from the storage unit by judging the driver, and the driving scene to be met is calculated based on the current location and route information of the vehicle , and the past of the driver stored in the storage unit Determining the display position of the image information for each of the driver and the driving scene based on the movement pattern of
A display method for a vehicle, wherein a display position of the image information is controlled according to the determination.

Images