JP2015011457A - Vehicle information provision device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a technique capable of determining whether or not a driver appropriately performs safety confirmation in accordance with a surrounding circumstance.SOLUTION: A front camera 4 and a radar device 8 acquire surrounding circumstance information indicating a surrounding circumstance of an own vehicle. Then, a vehicle information provision device: determines existence of a confirmation object (a traffic sign, an electric bulletin board, an obstacle on a road, a left-turn lane, a right-turn lane, a pedestrian crossing, a traffic light or an approaching vehicle from behind) which needs to be confirmed by a driver of the own vehicle on the basis of the surrounding circumstance information acquired by the front camera 4 and the radar device 8; and displays a driver confirmation image, to the driver, requiring the driver to confirm the confirmation object to the driver when determining the existence of the confirmation object. Also, the vehicle information provision device: detects a direction of driver's eyes; and determines whether or not the driver moves eyes thereof toward a position where the driver confirmation image is displayed, on the basis of a detection result of the direction of the driver's eyes.

Description

  The present invention relates to a vehicle information providing apparatus that provides information to a vehicle occupant.

  2. Description of the Related Art Conventionally, there is known an apparatus that measures a driver's visual activity based on eye movements and provides a warning warning to the driver based on the measurement result (see, for example, Patent Document 1). .

Japanese Patent No. 4603264

  However, since the technique described in Patent Document 1 does not perform measurement in consideration of the situation around the host vehicle, it is determined whether or not the driver has performed an appropriate safety check according to the situation around the host vehicle. There was a problem that I could not.

  This invention is made | formed in view of such a problem, and it aims at providing the technique which can judge whether the driver | operator performed appropriate safety confirmation according to the surrounding condition.

  In order to achieve the above object, an information providing apparatus for a vehicle according to the present invention includes a surrounding state acquisition unit, a confirmation object determination unit, a confirmation image display unit, a line-of-sight direction detection unit, and a line-of-sight movement determination unit. .

  In the vehicle information providing apparatus of the present invention, first, the surrounding situation acquisition unit acquires surrounding situation information indicating the surrounding situation of the host vehicle, which is a vehicle on which the vehicle information providing apparatus is mounted. Further, the confirmation object determination unit determines whether there is a confirmation object that is an object that needs to be confirmed by the driver of the vehicle based on the surrounding state information acquired by the surrounding state acquisition unit. To do. After that, the confirmation image display means displays a driver confirmation image for instructing the driver to confirm the confirmation object when the confirmation object determination means determines that there is a confirmation object. The line-of-sight direction detecting means detects the direction of the driver's line of sight. Then, the line-of-sight movement determination means determines whether or not the driver has moved the line of sight toward the position where the driver confirmation image is displayed based on the detection result by the line-of-sight direction detection means.

  The vehicular information providing apparatus configured as described above identifies an object (confirmation object) that the driver needs to confirm in the vicinity of the own vehicle by acquiring the surrounding situation information indicating the surrounding situation of the own vehicle. The driver confirmation image corresponding to the identified confirmation object can be displayed to the driver.

  When the driver visually recognizes the displayed driver confirmation image, there is a high possibility that the driver will actually confirm the confirmation object indicated by the driver confirmation image, while the driver visually recognizes the driver confirmation image. If not, it is highly likely that the confirmation object indicated by the driver confirmation image is not actually confirmed.

  Therefore, according to the vehicle information providing apparatus of the present invention, it is determined whether or not the driver has moved the line of sight toward the position where the driver confirmation image is displayed, so that the driver can enter the surrounding situation. Accordingly, it can be determined whether or not an appropriate safety check has been performed.

It is a block diagram which shows the structure of the information provision apparatus 1 for vehicles. It is a figure which shows arrangement | positioning of the display screen area | region DR within a windshield. It is a flowchart which shows an information provision process. It is a flowchart which shows an alerting | reporting process. It is a figure which shows a driver | operator confirmation image. It is the 1st explanatory view showing the driver check picture corresponding to the situation around the own vehicle. It is the 2nd explanatory view showing the driver check picture corresponding to the situation around the own vehicle. It is the 3rd explanatory view showing the driver check picture corresponding to the situation around the own vehicle. It is the 4th explanatory view showing the driver check picture corresponding to the situation around the own vehicle. It is a figure which shows the alerting | reporting image of another embodiment. It is a figure which shows the driver | operator confirmation image of another embodiment. It is a figure explaining an operation instruction image. It is a figure explaining a back check request image and a side check request image.

Embodiments of the present invention will be described below with reference to the drawings.
The vehicle information providing apparatus 1 of this embodiment is mounted on a vehicle capable of automatic driving, and as shown in FIG. 1, a head up display device 2 (hereinafter referred to as a HUD device 2), a driver's seat. A camera 3, a front camera 4, a left rear camera 5, a right rear camera 6, an electronic mirror 7, a radar device 8, a vehicle speed sensor 9, a navigation device 10, and a control unit 11 are provided.

  The HUD device 2 irradiates display light for displaying an image from below the windshield toward the windshield. As a result, the driver visually recognizes the projected virtual image superimposed on the actual scenery in front of the vehicle. The HUD device 2 displays an image on a rectangular display screen region DR provided below the windshield (see FIG. 2).

  The driver's seat camera 3 continuously captures the face of an occupant (ie, driver) sitting in the driver's seat. Hereinafter, the image data acquired by photographing by the driver's seat camera 3 is referred to as face image data.

  The front camera 4 continuously shoots the scenery in front of the host vehicle that the driver can visually recognize through the windshield. Hereinafter, the image data acquired by photographing the front camera 4 is referred to as foreground image data.

The left rear camera 5 is installed at the left end portion of the vehicle and captures the situation of the left rear of the vehicle.
The right rear camera 6 is installed at the right end portion of the vehicle and captures the right rear situation of the vehicle.
The electronic mirrors 7 are display devices installed on the left and right sides of the dashboard (see FIG. 2). The electronic mirror 7 installed on the left side displays an image captured by the left rear camera 5, and the electronic mirror 7 installed on the right side displays an image captured by the right rear camera 6.

  The radar device 8 transmits a radar wave toward the rear of the vehicle and receives a reflected radar wave, so that the position of the vehicle located behind the vehicle (hereinafter referred to as the rear vehicle), the host vehicle, and the rear vehicle. And relative speed.

The vehicle speed sensor 9 detects the traveling speed of the host vehicle.
The navigation device 10 obtains road map data from a map storage medium in which road map data and various types of information are recorded, and based on a GPS signal received via a GPS (Global Positioning System) antenna (not shown) or the like. It is configured to detect the current position. The navigation device 10 is configured to execute control for displaying the current location of the vehicle on the display screen ND (see FIG. 2), control for guiding a route from the current location to the destination, and the like. Yes.

  A touch panel is installed on the display screen ND of the navigation device 10. Therefore, the driver can input various instructions by performing an operation of pressing the display screen ND with a finger.

  The control unit 11 is mainly configured by a known microcomputer including a CPU, a ROM, a RAM, an I / O, a bus line connecting these components, and the like. The control unit 11 executes various processes based on inputs from the cameras 3, 4, 5, 6, the radar device 8, the vehicle speed sensor 9, and the navigation device 10, and controls the HUD device 2, the electronic mirror 7, and the navigation device 10. Control.

In the vehicular information providing apparatus 1 configured as described above, the control unit 11 executes an information providing process and a notification process described later.
First, the procedure of the information provision process which the control part 11 performs is demonstrated. The information providing process is a process that is repeatedly executed during the operation of the vehicle information providing apparatus 1.

  When this information providing process is executed, as shown in FIG. 3, the control unit 11 first determines the own vehicle based on the traveling speed detected by the vehicle speed sensor 9 (hereinafter referred to as the own vehicle traveling speed) in S10. A current speed image VP indicating the traveling speed (see FIG. 6B) is displayed on the HUD device 2. The current speed image VP of the present embodiment is an image showing the traveling speed of the host vehicle in numbers and units.

  Next, in S20, the surrounding situation of the host vehicle is detected. Specifically, foreground image data captured by the front camera 4 is used to perform image recognition processing (for example, pattern matching), for example, road signs, electronic bulletin boards, road obstacles, left turn lanes, right turn only Detect lanes, pedestrian crossings and traffic lights. A rear vehicle approaching the host vehicle (hereinafter also referred to as an approaching rear vehicle) based on the traveling speed of the host vehicle detected by the vehicle speed sensor 9 and the position and relative speed of the rear vehicle detected by the radar device 8. Is detected.

  In S30, based on the detection result in S20, it is determined whether or not the driver confirmation display condition is satisfied. The driver confirmation display condition of the present embodiment is to detect at least one of a road sign, an electric bulletin board, an obstacle on the road, a left turn lane, a right turn lane, a pedestrian crossing, a traffic light, and an approaching rear vehicle in S20. It is.

  If the driver confirmation display condition is not satisfied (S30: NO), the process proceeds to S80. On the other hand, when the driver confirmation display condition is satisfied (S30: YES), in S40, a driver confirmation image set in advance according to the detection result in S20 (see FIGS. 6 to 9). ) Is displayed.

  Thereafter, in S50, the driver's line-of-sight direction is detected using the face image data photographed by the driver's seat camera 3. In S50, for example, the driver's eyes are extracted from the face image data, and the driver's line-of-sight direction is detected by performing image recognition processing (for example, pattern matching) on the extracted eyes.

  Furthermore, in S60, based on the line-of-sight direction detected in S50, it is determined whether or not the driver has confirmed the driver confirmation image displayed in S40. Thereafter, in S70, the determination result in S60 is stored, and the process proceeds to S80.

  When the process proceeds to S80, it is determined whether or not a preset notification condition indicating that the driver has not confirmed the driver confirmation image is satisfied using the determination result stored in S70. The notification condition in the present embodiment is, for example, that the driver has not confirmed the driver confirmation image continuously for a predetermined number of determinations (for example, five times).

  If the notification condition is satisfied (S80: YES), the notification process flag is set in S90, and the information providing process is temporarily ended. On the other hand, when the notification condition is satisfied (S80: NO), the notification processing flag is cleared in S100, and the information provision processing is temporarily ended.

Next, the procedure of the notification process executed by the control unit 11 will be described. The notification process is a process that is repeatedly executed during the operation of the vehicle information providing apparatus 1.
When this notification process is executed, the control unit 11 first determines whether or not the notification process flag is set in S210, as shown in FIG. Here, when the notification processing flag is cleared (S210: NO), the notification processing is temporarily ended. On the other hand, if the notification processing flag is set (S210: YES), in S220, a notification image indicating that the driver confirmation image is insufficiently confirmed by the driver is displayed on the HUD device 2. The notification process is temporarily terminated.

Next, the contents of the driver confirmation image will be described.
As shown in FIG. 5, the driver confirmation image includes a detected object image CP1, a host vehicle image CP2, an approach direction instruction image CP3, a line-of-sight direction instruction image CP4, and a relative speed image CP5.

The detected object image CP1 is an image indicating the object detected in S20 (hereinafter also referred to as a detected object).
The host vehicle image CP2 is an image obtained by simplifying the shape of the host vehicle viewed from above.

  The approach direction instruction image CP3 is an image formed in an oval shape so as to cover the periphery of the host vehicle image CP2. The approach direction instruction image CP3 formed in an oval shape is divided into eight direction instruction images indicating the front, rear, right side, left side, right front, left front, right rear and left rear of the host vehicle. Yes. By highlighting at least one of the eight direction indicating images, the direction of the current position of the approaching rear vehicle based on the host vehicle is indicated.

  The line-of-sight direction instruction image CP4 is a simplified image of both human eyes, and is arranged so that two white-eye images formed in a circular shape are aligned in the horizontal direction. A black eye image is arranged inside each of the two white eye images. The line-of-sight direction image CP4 instructs the driver on the line-of-sight direction based on the position of the black-eye image in the white-eye image. For example, the line-of-sight direction instruction image CP4 in FIG. 5 instructs the driver to turn his line of sight toward the left front.

  The relative speed image CP5 is an image showing the relative speed with the approaching rear vehicle. The relative velocity image CP5 includes a plurality (13 in the present embodiment) of rectangular images RP01, RP02, RP03, RP04, RP05, RP06, RP07, RP08, RP09, RP10, RP11, RP12, and RP13.

  The rectangular images RP01 to RP13 are images formed in a rectangular shape. The rectangular images RP01, RP02, RP03, RP04, RP05, RP06, RP07, RP08, RP09, RP10, RP11, RP12, and RP13 are arranged so as to be aligned in the horizontal direction from left to right. Yes.

  Each of the rectangular images RP01 to RP13 can be individually highlighted. The relative speed image CP5 displays the relative speed so that the number of rectangular images to be highlighted increases as the relative speed increases.

  The relative speed image CP5 is arranged directly below the line-of-sight direction instruction image CP4. This is intended to make the line-of-sight direction instruction image CP4 and the relative velocity image CP5 integral to form an image imitating a face. That is, the line-of-sight direction instruction image CP4 represents both eyes of the person, and the relative speed image CP5 represents the mouth of the person.

Next, a driver confirmation image displayed according to the detected object detected in S20 will be described.
First, as shown in FIG. 6 (a), when a road sign indicating a speed limit is detected at the left front of the host vehicle MC, the detected object image CP1 is displayed as shown in FIG. 6 (b). Is shown in the form of a road sign, and the line-of-sight direction image CP4 instructs the driver to turn his line of sight toward the left front.

  Further, as shown in FIG. 6C, when a guide sign indicating the distance to the exit of the expressway is detected in the left front of the host vehicle MC, as shown in FIG. CP1 indicates the distance to the exit, and the line-of-sight direction instruction image CP4 instructs the driver to turn his line of sight toward the left front.

  Further, as shown in FIG. 7A, when an electronic bulletin board notifying the passage is detected in the left front of the host vehicle MC, the detected object image CP1 is closed as shown in FIG. 7B. Is shown in the form of a road sign, and the line-of-sight direction image CP4 instructs the driver to turn his line of sight toward the left front.

  Further, as shown in FIG. 7C, when an obstacle is detected in front of the host vehicle MC, as shown in FIG. 7D, the detected object image CP1 shows the obstacle in a simplified manner, The line-of-sight direction image CP4 instructs the driver to turn his line of sight forward.

  Further, as shown in FIG. 8A, when a vehicle approaching from the rear of the host vehicle MC is detected, the detected object image CP1 is displayed behind the host vehicle, as shown in FIG. 8B. The approach direction instruction image CP3 is an image indicating the presence of the vehicle, and the direction instruction image indicating the approach direction of the vehicle is highlighted. An approach direction instruction image CP3 in FIG. 8B shows vehicle approach from the rear and right rear of the host vehicle. Further, the line-of-sight direction instruction image CP4 instructs the driver to turn his / her line of sight toward the upper front, that is, the rearview mirror BM (see FIG. 2).

  Further, as shown in FIG. 8C, when a white line indicating a left turn dedicated lane is detected in front of the host vehicle MC, as shown in FIG. 8D, the detected object image CP1 has a left turn white line. The sight line direction instruction image CP4 instructs the driver to turn his sight line forward.

  As shown in FIG. 9A, when a white line indicating a pedestrian crossing and a traffic light are detected in front of the host vehicle MC, the detected object image CP1 is displayed as a pedestrian crossing as shown in FIG. 9B. The line-of-sight direction instruction image CP4 instructs the driver to turn his line of sight forward.

  In the vehicular information providing apparatus 1 configured as described above, the front camera 4 and the radar apparatus 8 acquire peripheral situation information indicating the peripheral situation of the host vehicle. Further, based on the surrounding situation information acquired by the front camera 4 and the radar device 8, a confirmation object (in this embodiment, a road sign, an electric bulletin board, It is determined whether there are obstacles on the road, a left turn lane, a right turn lane, a pedestrian crossing, a traffic light, and an approaching rear vehicle) (S20, S30). Thereafter, when it is determined that there is a confirmation object (S30: YES), a driver confirmation image for instructing the driver to confirm the confirmation object is displayed to the driver (S40). Further, the direction of the driver's line of sight is detected (S50). Then, based on the detection result of the line-of-sight direction, it is determined whether or not the driver has moved the line of sight toward the position where the driver confirmation image is displayed (S60).

  As described above, the vehicle information providing apparatus 1 can specify the object (confirmation object) that the driver needs to confirm in the vicinity of the own vehicle by acquiring the surrounding condition information indicating the surrounding condition of the own vehicle. The driver confirmation image corresponding to the identified confirmation object can be displayed to the driver.

  When the driver visually recognizes the displayed driver confirmation image, there is a high possibility that the driver will actually confirm the confirmation object indicated by the driver confirmation image, while the driver visually recognizes the driver confirmation image. If not, it is highly likely that the confirmation object indicated by the driver confirmation image is not actually confirmed.

  Therefore, according to the vehicle information providing apparatus 1, the driver determines whether or not the driver has moved his / her line of sight toward the position where the driver confirmation image is displayed, so that the driver can respond to the surrounding situation. It is possible to determine whether or not an appropriate safety check has been performed.

  When the confirmation object is a road sign (see FIG. 6A), the vehicle information providing apparatus 1 displays an image imitating the road sign as the detected object image CP1 constituting the driver confirmation image. (See FIG. 6B). Thus, the vehicle information providing apparatus 1 can make the driver intuitively specify the object to be confirmed when the object to be confirmed is a road sign.

  In addition, the vehicle information providing apparatus 1 displays the line-of-sight direction instruction image CP4 and the relative speed image CP5 constituting the driver confirmation image so as to have a shape imitating a face. As a result, the frequency with which the driver visually recognizes the driver confirmation image can be improved. This is because humans are likely to be alerted to human faces.

  In the embodiment described above, the front camera 4 and the radar device 8 are the surrounding state acquisition means in the present invention, the processing in S20 and S30 is the confirmation object determination means in the present invention, the processing in S40 is the confirmation image display means in the present invention, S50. The process is the line-of-sight direction detecting means in the present invention, and the process in S60 is the line-of-sight movement determining means in the present invention.

As mentioned above, although one Embodiment of this invention was described, this invention is not limited to the said embodiment, As long as it belongs to the technical scope of this invention, a various form can be taken.
For example, in the above embodiment, a notification image indicating that the driver confirmation image is insufficiently confirmed by the driver is displayed on the HUD device 2 so as to guide and motivate the break. It was. However, the method of performing induction and motivation for a break is not limited to this. For example, guidance and a motivation to a break can be performed by performing the notification shown in FIG.

  Specifically, first, as shown in FIG. 10A, a display timing image DP1 showing the timing until the icon display of the discount coupon (see FIG. 10B) is displayed in the display screen area DR of the windshield. indicate. The display timing image DP1 of FIG. 10A displays the characters “17M”, indicating that icon display is performed after 17 minutes.

  Then, when 17 minutes have elapsed since the display of the display timing image DP1, as shown in FIG. 10B, the discount coupon icon image DP2 is displayed in the display screen region DR of the windshield. The discount coupon icon image DP2 shows the relative speed of the store image DP21 showing the logo mark of the store issuing the discount coupon, the speed limit image DP22 showing the speed limit of the road on which the host vehicle is traveling, and the approaching rear vehicle. The relative speed image DP23 shown is included. The store image DP21, the speed limit image DP22, and the relative speed image DP23 are arranged with the intention of becoming an image that imitates the face as a unit. That is, the store image DP21 and the speed limit image DP22 represent both eyes of the person, and the relative speed image DP23 represents the mouth of the person.

  Further, immediately after the discount coupon icon image DP2 is displayed, as shown in FIG. 10 (c), a plurality of (6 in FIG. 10 (c)) showing different stores in the display screen ND of the navigation device 10. Logo marks LM1, LM2, LM3, LM4, LM5, LM6 are displayed.

  Then, when the driver performs an operation of pressing the display screen ND with a finger, the same logo as the store image DP21 of the discount coupon icon image DP2 is selected from the plurality of logo marks LM1 to LM6 displayed on the display screen ND. A mark (logo mark LM1 in FIG. 10C) is selected. Thus, the privilege image DP3 indicating that the discount coupon has been acquired is displayed in the display screen region DR, and the discount content image DP4 indicating the discount content of the discount coupon is displayed in the display screen ND of the navigation device 10. Furthermore, the navigation apparatus 10 sets the store corresponding to the logo mark LM1 selected by the driver as the transit point of the host vehicle.

  Note that the display shown in FIG. 10 may be performed when the driver's condition is detected and it is predicted that there is a sign of dozing, or may be performed while driving in an area where dozing is likely to occur. It may be done before entering an area where it is easy to wake up, or may be done regularly.

  In the display shown in FIG. 10, the discount content of the discount coupon may be changed according to the driver's state (for example, fatigue level). For example, the discount rate may be increased as the degree of fatigue or sleepiness increases. As a result, it becomes easy to guide a driver having a high degree of fatigue or drowsiness to a break, and the driver can recover from fatigue or drowsiness. Further, the display timing of the discount coupon icon image DP2 may be changed according to the degree of fatigue or sleepiness.

  Further, in the display shown in FIG. 10, points of a popular point card group may be given instead of the discount coupon. Thereby, the utility value of acquiring points is improved, and the driver's expectation that the icon display is performed can be increased.

  Further, in the display shown in FIG. 10, when there is a possibility of traffic jam on the road on which the host vehicle is traveling, the store image DP21 is displayed, and the store image DP21 is displayed in order to avoid traffic jam. You may make it take a break. Thereby, the possibility that traffic congestion can be avoided can be increased.

  Further, in the above embodiment, when a vehicle approaching from the rear of the host vehicle is detected, as shown in FIG. 8B, the detected object image CP1, the approach direction instruction image CP3, and the line-of-sight direction instruction image CP4, I showed what the driver would look at the mirror. However, the method for causing the driver to look at the mirror is not limited to this. For example, by performing the display shown in FIG. 11, the driver can turn his / her line of sight toward the mirror.

  Specifically, when a rear vehicle approaching the host vehicle is detected, the timing at which the host vehicle needs to check the approaching rear vehicle with a side mirror is predicted based on the relative speed between the host vehicle and the rear vehicle. . As shown in FIG. 11 (a), a display timing image DP6 indicating the timing until the host vehicle confirms the approaching rear vehicle with the side mirror and a direction indication image DP7 indicating the approaching direction of the rear vehicle are displayed on the windshield. Displayed in the display screen area DR. The display timing image DP6 in FIG. 11A displays the characters “20S”, indicating that it is necessary to check the approaching rear vehicle after 20 seconds. In addition, the direction instruction image DP7 in FIG. 11A indicates that the vehicle is approaching from the right rear.

  Then, when 20 seconds have elapsed since the display of the display timing image DP6, a character image DP8 indicating one character is displayed in the display screen of the right electronic mirror 7, as shown in FIG. A character image DP8 in FIG. 11B displays a character “B”, and is a character constituting a part of the store name corresponding to the store image DP21 in FIG.

  Then, when the driver turns his gaze toward the right electronic mirror 7 and confirms the character image DP8 and presses the steering switch, it is considered that the driver has acquired the character displayed on the electronic mirror 7, and FIG. ), A character image DP9 indicating the same character as the character image DP8 is displayed in the display screen ND of the navigation device 10.

  After that, when the driver utters the store name that he came up with using the characters displayed in the display screen ND as a clue, the vehicle information providing device 1 confirms the content uttered by the driver by voice recognition, and stores the image DP21. When it is determined that the name of the store corresponding to is uttered, a privilege image (not shown) indicating that the discount coupon of the store corresponding to the store image DP21 has been acquired is displayed in the display screen region DR, and the discount coupon A discount content image (not shown) showing the discount content is displayed in the display screen ND of the navigation device 10. Note that the shorter the time from when the character image DP8 is displayed on the right electronic mirror 7 until the name spoken by the driver is correct, the better the discount content of the discount coupon is for the driver.

  As described above, the character image DP8 (“B” in FIG. 11) indicating a part of the character string (“ABC” in FIG. 11) composed of a plurality of characters set in advance is displayed as the driver confirmation image. Thus, the driver looks at the character image DP8 as a clue to specify the character string, so that the driver looks at the direction in which the character image DP8 is displayed. Accordingly, displaying the character image DP8 on the right electronic mirror 7 makes it easier for the driver to think of directing his gaze toward the right electronic mirror 7, and as a result, when confirmation of the right electronic mirror 7 is necessary. The frequency with which the driver turns his / her line of sight toward the right electronic mirror 7 can be improved.

  Moreover, in the said embodiment, what determined whether the driver confirmed the driver confirmation image by detecting a driver | operator's gaze direction was shown. However, the method for determining whether or not the driver has confirmed the driver confirmation image is not limited to this. For example, when the driver operates a steering switch immediately after the detected object image CP1 is displayed, it may be determined that the driver has confirmed the driver confirmation image. Then, in order to allow the driver to operate the steering switch immediately after the detected object image CP1 is displayed, the driver confirmation image may include an operation instruction image CP6 as shown in FIG. The operation instruction image CP6 in FIG. 12 displays the characters “push”. Thus, the driver can recognize that it is necessary to press the steering switch after confirming the driver confirmation image.

  In the above embodiment, the notification image indicating that the driver confirmation image is insufficiently confirmed by the driver is displayed on the HUD device 2 in S220. However, the driver confirmation image is not confirmed. The processing in the case where it is sufficient is not limited to this. For example, the audio may be stopped or the air conditioner may be turned off.

  Further, when the vehicle information providing apparatus 1 determines that the driver confirmation image is not sufficiently confirmed by the driver, the fatigue level of the driver is predicted, and processing corresponding to the prediction result is executed. May be. As processing according to the prediction result of the fatigue level, for example, display (character, color, icon) by at least one of the HUD device 2, the navigation device 10, and a meter (not shown), application, and activation of at least one of the in-vehicle devices Or a stop, a sound or a voice warning, etc. are mentioned. Further, as a process corresponding to the prediction result of the fatigue level, a nearby service area may be introduced, and a route point of the navigation device 10 may be set to a nearby service area to start route guidance.

  Further, when the driver confirms the driver confirmation image, points may be given to the driver. It is possible to link with point business by discounting insurance premiums, products and services according to the number of points awarded. Moreover, when a driver | operator confirms a driver | operator confirmation image and a point is provided, you may make it display that by the HUD apparatus 2, the navigation apparatus 10, and a meter (not shown).

Further, when the driver confirms the driver confirmation image, the fact may be notified by image display or audio output.
Moreover, in the said embodiment, what detected a road sign or an electronic bulletin board by performing image recognition processing using the image image | photographed with the camera 3 was shown. However, the method of acquiring information indicated by a road sign or an electric bulletin board is not limited to this. For example, a road sign or an electric bulletin board may be detected by performing an image recognition process using an image acquired by a laser radar that irradiates a radar wave in front of the host vehicle. In addition, a map database that stores map data may be mounted on the host vehicle, and information indicated by a road sign or an electric bulletin board may be acquired by referring to the map database. In addition, it has a road-to-vehicle communication function for performing wireless communication with a roadside device installed near the traveling route of the vehicle, or a vehicle-to-vehicle communication function for performing wireless communication with other vehicles existing around the host vehicle. Information indicated by a road sign or an electric bulletin board may be acquired by mounting a wireless communication device on the host vehicle and performing road-to-vehicle communication or vehicle-to-vehicle communication.

  Further, when the vehicle is approaching from behind the host vehicle MC as shown in FIG. 8A, when the rear vehicle is approaching to the extent that can be confirmed by the rearview mirror or side mirror, as shown in FIG. Alternatively, a back confirmation request image CP7 requesting confirmation by the rearview mirror or a side confirmation request image CP8 requesting confirmation by the side mirror may be displayed. Thereby, a driver | operator's eyes | visual_axis can be guided to the mirror in which the approaching back vehicle is reflected.

  DESCRIPTION OF SYMBOLS 1 ... Vehicle information provision apparatus, 2 ... HUD apparatus, 3 ... Driver's seat camera, 8 ... Radar apparatus, 11 ... Control part

Claims (4)

A vehicle information providing device (1) that is mounted on a vehicle and provides information to an occupant of the vehicle,
Surrounding situation acquisition means (4, 8) for obtaining surrounding situation information indicating the surrounding situation of the host vehicle that is a vehicle equipped with the vehicle information providing device;
Based on the surrounding situation information acquired by the surrounding situation acquisition means, a confirmation object for determining whether or not there is a confirmation object that is an object that needs to be confirmed by the driver of the own vehicle around the own vehicle Determination means (S20, S30);
Confirmation image display means (S40) for displaying a driver confirmation image for instructing the driver to confirm the confirmation object when the confirmation object determination means determines that there is the confirmation object. )When,
Gaze direction detection means (S50) for detecting the direction of the gaze of the driver;
Line-of-sight movement determination means (S60) for determining whether or not the driver has moved the line of sight toward the position where the driver confirmation image is displayed based on the detection result by the line-of-sight direction detection means. An information providing apparatus for a vehicle characterized by the above. The confirmation image display means includes
The vehicle information providing apparatus according to claim 1, wherein when the confirmation object is a road sign, an image simulating the road sign is displayed as the driver confirmation image. The said confirmation image display means displays the image which shows a part of the character string which consists of a several preset character as said driver | operator confirmation image. The Claim 1 or Claim 2 characterized by the above-mentioned. Vehicle information providing device. The confirmation image display means includes
4. The display device according to claim 1, wherein at least a part of the plurality of images constituting the driver confirmation image is arranged and displayed so as to have a shape imitating a face. 5. The vehicle information providing device according to claim 1.