WO2016166791A1

WO2016166791A1 - Driving assistance device

Info

Publication number: WO2016166791A1
Application number: PCT/JP2015/061342
Authority: WO
Inventors: 友美保科; 朝子重田
Original assignee: 三菱電機株式会社
Priority date: 2015-04-13
Filing date: 2015-04-13
Publication date: 2016-10-20
Also published as: JPWO2016166791A1; JP6242541B2

Abstract

A driving assistance device is provided with: a line-of-sight distribution output unit for outputting the actual line-of-sight distribution of a driver; a line-of-sight distribution storage unit in which an ideal line-of-sight distribution is stored; and a display control unit for determining whether or not to generate safe driving assistance information on the basis of the degree by which the actual line-of-sight distribution and the ideal line-of-sight distribution coincide, and, upon determining that the safe driving assistance information is to be generated, for generating the safe driving assistance information, in which the actual line-of-sight distribution is superimposed on a vehicle exterior captured image containing the view in front of the vehicle, and causing a display to display the safe driving assistance information.

Description

Driving assistance device

The present invention relates to a driving support device that memorizes driving details performed by a driver and looks back on driving performed by the driver.

2. Description of the Related Art Conventionally, there has been known a driving support device that displays a message or sounds a warning sound when a driver's sudden start or stop is detected to alert the driver.
For example, when the driving support device according to Patent Document 1 performs driving evaluation based on the degree of deviation between the actual driving state and the ideal driving state, stores information on the location where dangerous driving has occurred, and finishes driving The information about dangerous spots and dangerous driving is displayed together. Furthermore, at the time of the next driving, a warning is given to the driver when approaching a place where a dangerous driving state has occurred in the past.

JP 2007-108926 A

However, in the conventional driving support apparatus such as the above-mentioned Patent Document 1, only information such as a dangerous place and a dangerous driving type is displayed with simple characters at the end of driving or the like, and driving performed by the driver himself / herself. There was a problem that it was difficult to remember in detail. For this reason, it is difficult for the driver to understand specifically what kind of driving was good or bad, and effective safe driving education was not possible.

The present invention has been made to solve the above-described problems, and provides a driving support device capable of specifically displaying the details of driving performed by the driver and providing effective safe driving education. The purpose is to do.

The driving support apparatus according to the present invention includes a gaze distribution output unit that outputs the driver's actual gaze distribution, a gaze distribution storage unit that stores the ideal gaze distribution, and the actual gaze distribution and the ideal gaze distribution. It is determined whether or not to generate safe driving support information based on the degree of coincidence, and when it is determined to generate, safe driving support information is generated and displayed by superimposing an actual gaze distribution on a captured image outside the vehicle including a front view of the vehicle. And a display control unit to be displayed on the device.

According to the present invention, it is determined whether or not the safe driving support information is generated based on the degree of coincidence between the actual line-of-sight distribution and the ideal line-of-sight distribution, and the actual line-of-sight distribution is added to the outside captured image including the front landscape of the vehicle. Since the superimposed safe driving support information is generated and displayed on the display, the details of the driving performed by the driver can be specifically displayed, and effective safe driving education can be performed. .

It is a block diagram which shows the structural example of the driving assistance apparatus which concerns on Embodiment 1 of this invention. It is a figure for demonstrating the coincidence degree of the ideal gaze distribution on the picked-up image outside a vehicle including the front scenery of a vehicle, and an actual gaze distribution. 3 is a diagram illustrating a display example of safe driving support information according to Embodiment 1. FIG. 1 is a hardware configuration diagram of a driving support apparatus and peripheral devices according to Embodiment 1. FIG. It is a block diagram which shows the structural example of the driving assistance device which concerns on Embodiment 2 of this invention. 6 is a flowchart illustrating an operation of the driving support apparatus according to the second embodiment. It is a block diagram which shows the structural example of the driving assistance device which concerns on Embodiment 3 of this invention. It is a figure which shows the example of a display of the safe driving assistance information to which the notice matter of Embodiment 3 was provided. 12 is a flowchart illustrating an operation of the driving support apparatus according to the third embodiment. It is a block diagram which shows the structural example of the driving assistance device which concerns on Embodiment 4 of this invention. It is a figure which shows the example of a display of the safe driving assistance information to which the consideration matter of Embodiment 4 was provided. 10 is a flowchart illustrating an operation of the driving support apparatus according to the fourth embodiment. It is a block diagram which shows the structural example of the driving assistance device which concerns on Embodiment 5 of this invention. It is a figure which shows the example of a display of the safe driving assistance information to which the notice matter of Embodiment 5 was provided. 10 is a flowchart illustrating an operation of the driving support apparatus according to the fifth embodiment. It is a block diagram which shows the structural example of the driving assistance device which concerns on Embodiment 6 of this invention. It is a figure which shows the example of a display of the safe driving assistance information to which the notice matter of Embodiment 6 was provided. 14 is a flowchart illustrating the operation of the driving support apparatus according to the sixth embodiment. It is a figure which shows the example of a display of the safe driving assistance information to which the map image and the content explaining the driving | running state were provided as notes.

Hereinafter, in order to explain the present invention in more detail, modes for carrying out the present invention will be described with reference to the accompanying drawings.
Embodiment 1 FIG.
FIG. 1 is a block diagram showing a configuration example of a driving support apparatus 10 according to Embodiment 1 of the present invention. The driving support device 10 includes a gaze distribution storage unit 11 that stores the driver's ideal gaze distribution, a gaze distribution output unit 12 that outputs the driver's actual gaze distribution, the ideal gaze distribution and the actual gaze. And a display control unit 13 that generates safe driving support information that supports the safe driving of the driver using the distribution and displays the information on the display 1. The driving support device 10 is an in-vehicle device mounted on a vehicle or a portable information terminal brought into the vehicle. Moreover, you may incorporate in the navigation apparatus etc. which were mounted in the vehicle.

The display 1 is, for example, an LCD (Liquid Crystal Display), an organic EL (Electroluminescence) display, or a head-up display. As the display 1, a display included in a navigation device or the like may be used.

For example, a line-of-sight detection device 2 and an imaging device 3 outside the vehicle are connected to the driving support device 10 as external information acquisition devices.
The line-of-sight detection device 2 detects the driver's line of sight and outputs it to the line-of-sight distribution output unit 12 as line-of-sight information. The line-of-sight detection device 2 is, for example, a visible light camera or a near-infrared light camera installed in front of the driver, and processes at least one of the coordinates or angle of the driver's line of sight by processing an image captured by the camera. An image processing apparatus that calculates and outputs time-series data. The image processing apparatus may estimate at least one of the coordinates or angle of the line of sight based on the orientation of the face that has been image-recognized, or may estimate at least one of the coordinate or angle of the line of sight based on the orientation of the eye that has been image-recognized. May be. The above description is merely an example, and the line-of-sight detection device 2 may be anything that can detect the line of sight.

The outside image pickup device 3 is a camera that picks up an image of the scenery in front of the vehicle as seen from the driver, and outputs the outside image pickup image to the display control unit 13.

The line-of-sight distribution storage unit 11 stores information indicating an ideal line-of-sight distribution range in a predetermined driving environment. The predetermined driving environment includes, for example, an intersection, a right / left turn point, a straight section divided by a right / left turn point, a railroad crossing, and a guide point when the in-vehicle navigation device guides the route. For each driving environment, an ideal line-of-sight distribution representing the moving range of the line of sight when the driver sees a portion to be seen during driving is generated and stored in advance in the line-of-sight distribution storage unit 11.

The line-of-sight distribution output unit 12 acquires the driver's actual line-of-sight information detected by the line-of-sight detection device 2, generates a line-of-sight distribution representing the driver's actual line-of-sight movement range, and outputs the line-of-sight distribution to the display control unit 13.

The display control unit 13 includes a line-of-sight distribution comparison unit 14 and a display information control unit 15.
The line-of-sight distribution comparison unit 14 compares the ideal line-of-sight distribution stored in the line-of-sight distribution storage unit 11 with the actual line-of-sight distribution output from the line-of-sight distribution output unit 12 to obtain the degree of coincidence of the line-of-sight distribution. When the degree of coincidence between the ideal gaze distribution and the actual gaze distribution is high, the gaze distribution comparison unit 14 determines that the driver's safety is sufficient and the display of the safe driving support information is unnecessary. On the other hand, when the degree of coincidence between the ideal line-of-sight distribution and the actual line-of-sight distribution is low, the line-of-sight distribution comparison unit 14 determines that the driver's safety confirmation is insufficient and that safe driving support information needs to be displayed.

Here, FIG. 2 shows an example of the degree of coincidence between the ideal line-of-sight distribution and the actual line-of-sight distribution on the outside-captured image including the front landscape of the vehicle. FIG. 2A shows a state where the degree of coincidence between the ideal gaze distribution and the actual gaze distribution is high. FIG. 2B shows a state where the actual line-of-sight distribution is smaller than the ideal line-of-sight distribution and the degree of coincidence is low. In FIG. 2C, the ideal gaze distribution and the actual gaze distribution are the same size, but the positions are shifted and the degree of coincidence is low.

The line-of-sight distribution comparison unit 14 calculates, for example, a deviation between both line-of-sight distributions in order to determine the degree of coincidence between the ideal line-of-sight distribution and the actual line-of-sight distribution, and the degree of coincidence when the deviation is equal to or greater than a predetermined threshold. The safety confirmation is insufficient, and it is determined that the display of safe driving support information is necessary. On the other hand, when the deviation is smaller than the threshold value, it is determined that the degree of coincidence is high and the safety confirmation is sufficient, and it is not necessary to display safe driving support information. For example, assuming that the area of the ideal line-of-sight distribution is A and the area where the ideal line-of-sight distribution and the actual line-of-sight distribution overlap is B, the deviation is calculated from the equation (AB) / A.
Hereinafter, the deviation is used to determine the degree of coincidence of the line-of-sight distribution.

Further, when it is determined that the safe driving support information is to be generated, the line-of-sight distribution comparison unit 14 generates the safe driving support information by using an externally captured image including the scenery in front of the vehicle imaged by the external imaging device 3 and displays it. The information is output to the information control unit 15. The display information control unit 15 receives the safe driving support information from the line-of-sight distribution comparison unit 14, and outputs and displays it on the display 1.

Here, FIG. 3 shows an example of the safe driving support information displayed on the display 1. The safe driving support information shown in FIG. 3A is an image in which an actual line-of-sight distribution is superimposed on a captured image outside the vehicle including a front landscape of the vehicle. Further, the safe driving support information may be an image in which an ideal line-of-sight distribution and an actual line-of-sight distribution are superimposed on an outside-captured captured image including a front landscape of the vehicle as shown in FIG. Further, in the example of FIG. 3, captions such as “actual gaze distribution” and “ideal gaze distribution” are added.
It should be noted that the captured image outside the vehicle is preferably a moving image rather than a still image so that the driver can clearly remember the driving situation. By superimposing the driver's actual gaze distribution on the image outside the vehicle when driving with insufficient safety confirmation, it is possible to clearly remind the driver of the gaze movement during driving. it can. Thereby, the driver can be urged to drive safely, and effective safe driving education can be performed. Furthermore, the state of the line-of-sight movement in the range of the actual line-of-sight distribution may be displayed in synchronization with the image outside the vehicle.

FIG. 4 illustrates a hardware configuration example of the driving support device 10 and its peripheral devices.
A CPU (Central Processing Unit) 1010, a ROM (Read Only Memory) 102, a RAM (Random Access Memory) 103, an input device 104, an external storage device 105, and an output device 106 are connected to the bus 100.

The CPU 101 reads out and executes various programs stored in the ROM 102 or the external storage device 105, thereby functioning as the line-of-sight distribution output unit 12 and the display control unit 13 of the driving support device 10 in cooperation with each hardware. Realize.

The RAM 103 is a memory used when executing the program.
The input device 104 is the line-of-sight detection device 2 and the imaging device 3 outside the vehicle.
The external storage device 105 is a storage device such as an HDD, CD, or DVD, or a storage device that employs a semiconductor memory such as a USB memory or an SD card. The external storage device 105 is the line-of-sight distribution storage unit 11.
The output device 106 is the display device 1.

As described above, according to the first embodiment, the driving support device 10 includes the gaze distribution output unit 12 that outputs the driver's actual gaze distribution, the gaze distribution storage unit 11 that stores the ideal gaze distribution, It is determined whether to generate safe driving support information based on the degree of coincidence between the ideal gaze distribution and the actual gaze distribution, and when it is determined that the gaze distribution is to be generated, the actual gaze distribution is displayed on the outside captured image including the front landscape of the vehicle. Since it comprises the display control part 13 which produces | generates the superimposed safe driving assistance information and displays it on the indicator 1, the driving | operation which the driver performed can be displayed concretely and effective safe driving education can be performed. it can.

Further, according to the first embodiment, the display control unit 13 displays the ideal line-of-sight distribution on the display 1 together with the safe driving support information. Can be informed, and more effective safe driving education can be conducted.

Embodiment 2. FIG.
FIG. 5 is a block diagram showing a configuration example of the driving support apparatus 10 according to Embodiment 2 of the present invention. The driving support apparatus 10 according to the second embodiment has a configuration in which an information storage unit 20 is added to the driving support apparatus 10 according to the first embodiment illustrated in FIG. The information storage unit 20 is the RAM 103 or the external storage device 105 shown in FIG.
5 that are the same as or correspond to those in FIG. 1 are denoted by the same reference numerals and description thereof is omitted.

In addition, the map information acquisition device 4 and the vehicle information acquisition device 5 are connected to the driving support device 10 of the second embodiment as external information acquisition devices. These map information acquisition device 4 and vehicle information acquisition device 5 are the input devices 104 shown in FIG.

The map information acquisition device 4 calculates the current position of the host vehicle using a GPS (Global Positioning System) satellite signal, refers to map information around the current position, information on a point where the host vehicle is traveling, road information, etc. Is output to the driving support device 10. Here, the point information is, for example, a railroad crossing, a guide point, a point where sudden braking is likely to occur, and the like. The road information is, for example, an intersection, a street, a straight road, and a sharp curve point.

The vehicle information acquisition device 5 acquires vehicle information such as the vehicle speed, gear, steering angle, accelerator opening, and brake operation amount of the host vehicle through CAN (Controller Area Network) and outputs the vehicle information to the driving support device 10.

The line-of-sight distribution output unit 12 a changes the driving environment of the own vehicle to a predetermined driving environment stored in the line-of-sight distribution storage unit 11 based on the current point information or road information of the own vehicle received from the map information acquisition device 4. It is determined whether it is applicable. When the line-of-sight distribution output unit 12a determines that the driving environment of the host vehicle corresponds to the predetermined driving environment, the line-of-sight information detected by the line-of-sight detection device 2 from the predetermined point in time until the predetermined period elapses. Based on this, an actual gaze distribution is generated. The predetermined driving environment includes, for example, a period during which the vehicle is traveling in a predetermined point such as an intersection, a right / left turn point, a straight section divided by a right / left turn point, a level crossing or a guide point, This is a period in which the vehicle is in a predetermined driving state such as a steering wheel, sudden braking, sudden acceleration, meandering driving, snoozing driving, aside driving.

For example, the line-of-sight distribution output unit 12a determines that the vehicle has entered a predetermined driving environment when the vehicle has entered the intersection, and has passed through the intersection from the time of entering the intersection until the current time when the vehicle has passed the intersection. An actual gaze distribution is generated based on the gaze information. The same applies when entering a turning point, level crossing, guide point, etc. in addition to an intersection.
Further, for example, the line-of-sight distribution output unit 12a determines that the vehicle is in a predetermined driving environment when the vehicle is traveling on a straight road, and performs a predetermined period (for example, 30 minutes) every predetermined period (for example, 10 minutes). Second) to generate an actual gaze distribution.

Further, the line-of-sight distribution output unit 12 a determines whether the driving environment of the host vehicle corresponds to the predetermined driving environment stored in the line-of-sight distribution storage unit 11 based on the current vehicle information received from the vehicle information acquisition device 5. It may be determined. For example, the line-of-sight distribution output unit 12a determines that it corresponds to a predetermined driving environment when an unsafe driving such as a sudden handle or a sudden brake is detected based on vehicle information, and a predetermined period from the time when the unsafe driving occurs. The actual gaze distribution is generated based on the gaze information until elapses. Alternatively, the line-of-sight distribution output unit 12a may generate an actual line-of-sight distribution based on line-of-sight information for a predetermined period including the time when unsafe driving occurs, and may include information before unsafe driving occurs. The unsafe driving is not limited to the sudden handle and the sudden brake, and may be sudden start, rapid acceleration, meandering, and the like. The line-of-sight distribution output unit 12a determines, for example, sudden braking when the deceleration of the host vehicle is equal to or greater than a predetermined threshold, and determines rapid acceleration when the acceleration is equal to or greater than a predetermined threshold. When the amount of change is equal to or greater than a predetermined threshold, it is determined that the handle is a sudden handle. A method for determining dozing driving and side-by-side driving will be described in detail in the sixth embodiment.

The display information control unit 15 a stores the safe driving support information generated by the line-of-sight distribution comparison unit 14 in the information storage unit 20. Then, the display information control unit 15a determines whether or not it is time to display the safe driving support information generated by the line-of-sight distribution comparison unit 14 based on the current vehicle information received from the vehicle information acquisition device 5, and the timing to display it. If it is determined that it is, the safe driving support information stored in the information storage unit 20 is acquired and output to the display 1.

For example, when the display information control unit 15a determines that the host vehicle is parked based on the vehicle information of the vehicle information acquisition device 5, the display information control unit 15a acquires the safe driving support information from the information storage unit 20, and displays the information on the display 1. Output and display. Thereby, the driver | operator can know the content of the driving | operation which he performed at the safe timing.

The display information control unit 15a determines whether or not there is a passenger based on an image captured inside the vehicle with a camera (not shown), and if it is determined that there is a passenger, whether or not the vehicle is parked. Regardless, safe driving support information may be output to the display 1. Thereby, it is possible to provide safe driving education to passengers.

Next, the operation of the driving support apparatus 10 according to the second embodiment will be described using the flowchart shown in FIG.
First, in step ST21, when driving is started, the driving support device 10 receives the line-of-sight information received from the line-of-sight detection device 2, the vehicle-side captured image received from the vehicle-side imaging device 3, the point information or road information received from the map information acquisition device 4, and the vehicle. Storage of vehicle information received from the information acquisition device 5 is started. The driving support device 10 stores the received various information in, for example, the external storage device 105.

In subsequent step ST22, the line-of-sight distribution output unit 12a drives the vehicle based on the current point information or road information received from the map information acquisition device 4 or the current vehicle information received from the vehicle information acquisition device 5. It is determined whether the environment corresponds to a predetermined operating environment. When it is determined that the line-of-sight distribution output unit 12a corresponds to the predetermined driving environment (step ST22 "YES"), the line-of-sight information received from the line-of-sight detection device 2 is used to generate an actual line-of-sight distribution in the predetermined driving environment. And output to the line-of-sight distribution comparison unit 14 (step ST23).
On the other hand, when it is determined that the driving environment of the vehicle does not correspond to the predetermined driving environment (step ST22 “NO”), the line-of-sight distribution output unit 12a repeats the process of step ST22.

In subsequent step ST24, the line-of-sight distribution comparison unit 14 receives the actual line-of-sight distribution in the predetermined driving environment from the line-of-sight distribution output unit 12a, and acquires the ideal line-of-sight distribution in the predetermined driving environment from the line-of-sight distribution storage unit 11. Compare both gaze distributions. When the deviation between the ideal line-of-sight distribution and the actual line-of-sight distribution is greater than or equal to the threshold (“YES” in step ST24), the line-of-sight distribution comparison unit 14 determines that the driver's safety check is insufficient, and the predetermined driving environment The safe driving support information is generated by superimposing the ideal line-of-sight distribution and the actual line-of-sight distribution on the vehicle outside-captured image of the outside-vehicle imaging device 3 in step ST25. This safe driving support information is output to the display information control unit 15 a and stored in the information storage unit 20.

On the other hand, when the deviation between the ideal line-of-sight distribution and the actual line-of-sight distribution is smaller than the threshold value (“NO” in step ST24), the line-of-sight distribution comparison unit 14 determines that the driver has sufficiently confirmed the safety and performs step ST25. Skip processing.

In subsequent step ST <b> 26, the display information control unit 15 a determines whether the host vehicle is parked based on the vehicle information of the vehicle information acquisition device 5. If the vehicle is not parked (step ST26 “NO”), the process returns to step ST22.

On the other hand, when the host vehicle is parked (step ST26 “YES”), the display information control unit 15a checks whether the safe driving support information is accumulated in the information accumulation unit 20 (step ST27). When safe driving support information is stored in the information storage unit 20 (step ST27 “YES”), the display information control unit 15a acquires the stored safe driving support information and displays it on the display 1 (step ST27). ST28), the process ends. When the safe driving support information is not stored in the information storage unit 20 (step ST27 “NO”), the display information control unit 15a ends the process without displaying the safe driving support information.

Note that the various information that has been stored in the external storage device 105 in step ST21 is deleted, for example, in order from a predetermined time, or the previous information is deleted when the safe driving support information is generated in step ST25. Or information prior to this may be deleted when the safe driving assistance information is displayed in step ST28.

As described above, according to the second embodiment, the driving support device 10 includes the information storage unit 20 that stores the safe driving support information, and the display control unit 13 is stored in the information storage unit 20 when the vehicle is parked. Since the safe driving support information is displayed on the display 1, it is possible to inform the driver of the details of the driving performed by the driver at a safe timing.

Further, according to the second embodiment, when it is determined that the safe driving support information is generated, the display control unit 13 from the outside-vehicle captured image and the line-of-sight distribution output unit 12a captured during a period corresponding to a predetermined driving environment. Since safe driving support information is generated using the actual line-of-sight distribution output, it is possible to inform the driver of the actual driving performed in driving environments where there is a high need for safety confirmation such as intersections. it can. In addition, it is possible to notify the actual situation when the driver performs dangerous driving such as side-by-side driving, snoozing driving, sudden steering, or sudden braking. Thereby, it is possible to remind the driver of the driving performed by himself / her and to perform more effective safe driving education.

Embodiment 3 FIG.
The driving support apparatus 10 according to the first and second embodiments displays on the display 1 safe driving support information in which the line-of-sight distribution when the driver's safety check is insufficient is superimposed on the actual captured image outside the vehicle. The driver can know where he was looking while driving. However, at first glance, it is not possible to know what was actually wrong, and there is a possibility that the improvement method is unknown. Therefore, in the third embodiment, the matters to be noticed by the driver are displayed on the display 1 together with the safe driving support information, so that the driver can clearly and easily understand how the driving is bad. Inform.

FIG. 7 is a block diagram showing a configuration example of the driving support apparatus 10 according to Embodiment 3 of the present invention. The driving support apparatus 10 according to the third embodiment has a configuration in which a notice matter assigning unit 30 is added to the driving support apparatus 10 according to the second embodiment illustrated in FIG.
7, parts that are the same as or correspond to those in FIG. 1 or FIG.

When the gaze distribution comparison unit 14 determines that the deviation between the ideal gaze distribution and the actual gaze distribution is equal to or greater than the threshold and the safety confirmation is insufficient, Receive the gaze distribution and the actual gaze distribution, determine the specific matters that the driver should be aware of, and generate comments or images that explain how the driving was bad or explain how to improve . And the consideration matter provision part 30 assign | provides the produced | generated comment etc. to the safe driving assistance information which the gaze distribution comparison part 14 produced | generated as consideration matter. The display information control unit 15a stores the safe driving support information and the notice items in the information storage unit 20 in association with each other.

Here, FIG. 8 shows a display example of the safe driving support information to which considerations are given.
In order to indicate what kind of line of sight movement the driver is making, the notice giving section 30 obtains an area in which the actual line-of-sight distribution does not overlap in the ideal line-of-sight distribution, and clearly indicates this area. The comment “Let's take care of this range next time” is added to the safe driving support information as a consideration. In addition, although illustration is abbreviate | omitted, it is good also considering the image etc. which highlight the area | region where the actual gaze distribution does not overlap in an ideal gaze distribution.
In addition, in order to clearly indicate that the safety check at the time of passing through the intersection was insufficient, the consideration matter assigning unit 30 adds a comment such as “insufficient safety confirmation at the intersection” to the safe driving support information as a consideration matter. It may be given. For example, a comment for each driving environment is defined in advance, and the consideration assigning unit 30 selects and assigns a comment corresponding to the driving environment of the host vehicle.

Next, the operation of the driving support apparatus 10 according to the third embodiment will be described using the flowchart shown in FIG. Here, steps ST21 to ST28 shown in FIG. 9 are the same as those in the flowchart shown in FIG.
When the deviation between the ideal line-of-sight distribution and the actual line-of-sight distribution is greater than or equal to the threshold value in a predetermined driving environment (step ST24 “YES”), the line-of-sight distribution comparison unit 14 generates safe driving support information in subsequent step ST25. To the display information control unit 15a. In continuing step ST31, the notice matter provision part 30 in the display information control part 15a produces | generates a notice matter, and provides it to safe driving assistance information. The considerations are stored in the information storage unit 20 together with the safe driving support information.

When acquiring the safe driving support information from the information storage unit 20 in step ST <b> 28, the display information control unit 15 a also acquires the notes given to the safe driving support information together and outputs them to the display 1. .
Note that the display information control unit 15a may not only display a comment or the like on the display item 1 on the display unit 1 but also output a voice from a speaker (not shown).

As described above, according to the third embodiment, the display control unit 13 causes the display 1 to display the matters to be noted by the driver together with the safe driving support information. It ’s easy to understand how bad driving was. Thereby, more effective safe driving education can be performed.

Embodiment 4 FIG.
Since the driving support device 10 according to the first and second embodiments causes the line-of-sight distribution when the driver's safety check is insufficient to be superimposed on the actual captured image outside the vehicle and displayed on the display 1, You can know where you were looking while driving. However, for example, on an unfamiliar road, there is a possibility that the driver does not know where the safety check has been neglected simply by looking at the captured image outside the vehicle. Therefore, in the fourth embodiment, a map image indicating a point where the safety check is determined to be insufficient is displayed on the display 1 together with the safe driving support information, and the point where the safety check is insufficient. In an easy-to-understand manner and make them aware of future driving.

FIG. 10 is a block diagram showing a configuration example of the driving support apparatus 10 according to Embodiment 4 of the present invention. The driving support apparatus 10 according to the fourth embodiment has a configuration in which a notice matter assigning unit 40 is added to the driving support apparatus 10 according to the second embodiment illustrated in FIG.
7, parts that are the same as or correspond to those in FIG. 1 or FIG.

The consideration item assigning unit 40 generates a map image indicating a point that is the target of the safe driving support information, as a consideration item to be added to the safe driving support information. FIG. 11 shows a display example of the safe driving support information to which considerations are given.
The consideration giving unit 40 is a target of determination when the gaze distribution comparison unit 14 determines that the deviation between the ideal gaze distribution and the actual gaze distribution is equal to or greater than the threshold value and the safety confirmation is insufficient. Map information including a point is acquired from the map information acquisition device 4, and a map image displaying an icon or the like indicating a point where safety confirmation is determined to be insufficient is generated. And the consideration matter provision part 50 is provided to the safe driving assistance information which the eyes | visual_axis distribution comparison part 14 produced | generated as a consideration matter with the produced | generated map image. The display information control unit 15a stores the safe driving support information and the notice items in the information storage unit 20 in association with each other.

Next, the operation of the driving support apparatus 10 according to the fourth embodiment will be described with reference to the flowchart shown in FIG. Here, steps ST21 to ST28 shown in FIG. 12 are the same as those in the flowchart shown in FIG.
When the deviation between the ideal line-of-sight distribution and the actual line-of-sight distribution is greater than or equal to the threshold value in a predetermined driving environment (step ST24 “YES”), the line-of-sight distribution comparison unit 14 generates safe driving support information in subsequent step ST25. To the display information control unit 15a. In subsequent step ST41, the consideration matter assigning unit 40 obtains the map information from the map information obtaining device 4, generates a map image clearly indicating the point where the safety confirmation is determined to be insufficient, and assigns it to the safe driving support information. . The map image is stored in the information storage unit 20 together with the safe driving support information.
When acquiring the safe driving support information from the information storage unit 20 in step ST28, the display information control unit 15a also acquires a map image attached to the safe driving support information and outputs the map image to the display 1. .

As described above, according to the fourth embodiment, the display control unit 13 displays the map image indicating the target location of the safe driving support information together with the safe driving support information as a matter to be noted by the driver. Because it is displayed on the road, it is possible to easily inform the driver of the point where the safety check is judged to be insufficient even on the road where the driver is unfamiliar, and to help the driver clearly notice the movement of the line of sight while driving. It becomes. Thereby, more effective safe driving education can be performed.

Embodiment 5 FIG.
Since the driving support apparatus 10 according to the first and second embodiments displays the safe driving support information on the display 1 only when the driver's safety check is insufficient, the driver appropriately performs the safety check thereafter. If driving is improved and driving is improved, the driver may not realize how the driving has improved and may not lead to growth. Therefore, in the fifth embodiment, when the driving is improved, the driver is given up and specifically notified of how the driving has been improved.

FIG. 13 is a block diagram showing a configuration example of the driving support apparatus 10 according to Embodiment 5 of the present invention. The driving support apparatus 10 according to the fifth embodiment has a configuration in which a consideration adding unit 50 and a safety confirmation degree determination unit 51 are added to the driving support apparatus 10 of the second embodiment shown in FIG.
In FIG. 13, the same or corresponding parts as those in FIG. 1 or FIG.

The safety confirmation degree determination unit 51 determines a safety confirmation degree that represents the degree of safety confirmation performed by the driver. When the line-of-sight distribution comparison unit 14 determines that the driving environment of the host vehicle corresponds to the predetermined driving environment, the safety confirmation degree determination unit 51 determines the ideal line-of-sight distribution received from the line-of-sight distribution storage unit 11 and the line-of-sight distribution output unit 12a. The degree of safety confirmation is determined based on the deviation from the actual gaze distribution.

The line-of-sight distribution comparison unit 14 outputs the safety confirmation degree determined by the safety confirmation degree determination unit 51 to the display information control unit 15a together with the safe driving support information.

For example, the safety confirmation degree determination unit 51 determines a safety confirmation degree indicating that “safety confirmation is insufficient” when the deviation between the ideal gaze distribution and the actual gaze distribution is equal to or greater than a threshold, and the deviation is When it is smaller than the threshold value, the safety confirmation level indicating “ideal safety confirmation” is determined.

Note that the degree of safety confirmation is not limited to the above two stages of “insufficient safety confirmation” and “ideal safety confirmation”, and may be three or more stages. For example, when the range of deviation between the ideal gaze distribution and the actual gaze distribution is 0 to 100, 0 to 25 is “ideal safety confirmation”, 26 to 50 is “sufficient safety confirmation”, 51 to 75 may be determined as “a little more safety confirmation is required”, and 76 to 100 may be determined as “insufficient safety confirmation”.

In the following description, when the safety confirmation degree is “ideal safety confirmation” (in the above example, when the deviation range is 0 to 25), it is expressed as “high safety confirmation degree”.
On the other hand, when the safety confirmation level is “insufficient safety check” (in the above example, the deviation range is 76 to 100), it is expressed as “low safety check level”.

The consideration item assigning unit 50 generates a comment, an image, or the like indicating whether or not the improvement has been made compared to the past driving as the consideration item to be added to the safe driving support information. FIG. 14 shows a display example of the safe driving support information to which considerations are given.
When the safety confirmation level received from the safety confirmation level determination unit 51 is high and the safety confirmation has been sufficiently performed, the consideration giving unit 50 displays the past safe driving support information stored in the information storage unit 20. Refer to and confirm the safety confirmation level given to the safe driving support information when traveling the same point last time. Then, the consideration item assigning unit 50 compares the current and previous safety confirmation degrees to determine whether or not the driving has been improved, generates a comment corresponding to the determination result, and the current safe driving as an attention item Give to support information. In the example of FIG. 14, since the driving has been improved, a comment “I can confirm better than the previous time” is given. Further, the notice matter assigning unit 50 may assign the previous gaze distribution as the notice matter to the current safe driving support information, and arrange the previous gaze distribution and the current gaze distribution side by side as shown in FIG.

The display information control unit 15a associates the safe driving support information received from the line-of-sight distribution comparison unit 14, the safety confirmation degree, and the notes generated by the note addition unit 50 and stores them in the information storage unit 20.

Note that the gaze distribution comparison unit 14 of the first to fourth embodiments generates the safe driving support information only when the deviation between the ideal gaze distribution and the actual gaze distribution is large and the degree of safety confirmation is low. In contrast, the line-of-sight distribution comparison unit 14 according to the fifth embodiment has a low safety confirmation degree but a high safety confirmation degree in addition to a low safety confirmation degree (that is, driving has been improved). Case) also generate safe driving support information. For this reason, in the configuration example shown in FIG. 13, when it is determined that the driving has been improved in the notice provision unit 50, the display information control unit 15 a instructs the gaze distribution comparison unit 14 to generate safe driving support information. It is configured to issue.

Next, the operation of the driving support apparatus 10 according to the fifth embodiment will be described using the flowchart shown in FIG. Here, steps ST21 to ST23 and ST25 to ST28 shown in FIG. 15 are the same as the flowchart shown in FIG.

In step ST51, the safety confirmation degree determination unit 51 calculates a deviation between an ideal line-of-sight distribution and an actual line-of-sight distribution in a predetermined driving environment, and determines the current safety confirmation degree. When the current safety confirmation level is low (“YES” in step ST51), the line-of-sight distribution comparison unit 14 superimposes the ideal line-of-sight distribution and the actual line-of-sight distribution on the vehicle outside captured image of the vehicle exterior imaging apparatus 3 in the predetermined driving environment. The current safe driving support information is generated and output to the display information control unit 15a (step ST25). The current safe driving support information is stored in the information storage unit 20.

In subsequent step ST52, the consideration assigning unit 50 refers to the information accumulating unit 20, extracts past safe driving support information at the same point as the current position of the host vehicle, and the safety when traveling the same point last time. Determine whether the degree of confirmation is high or low.

When the current safety confirmation level is low but the previous safety confirmation level is high (“NO” in step ST52), the notice matter assigning unit 50 determines that the current safety check is insufficient and does not assign the notice matter. The process proceeds to step ST26. In addition, since the previous safety confirmation degree does not exist at the point where the vehicle travels for the first time, also in this case, the notice matter assigning unit 50 proceeds to the process of step ST26 without assigning the notice matter.

On the other hand, when the degree of safety confirmation is low both in this time and in the previous time (step ST52 “YES”), the notice matter assigning unit 50 assigns a notice matter that prompts improvement of driving to the current safe driving support information (step ST53). Considerations that prompt improvement are stored in the information storage unit 20 together with the current safe driving support information. As in the case of step ST52 “YES”, when the current safety confirmation level is low but the previous safety confirmation level is high (step ST52 “NO”), a notice for promoting improvement may be added. .

If the current safety confirmation level is not low (step ST51 “NO”), the consideration assigning unit 50 refers to the information storage unit 20 and extracts past safe driving support information at the same point as the current position of the host vehicle. Then, it is determined whether or not the current safety confirmation level is higher than the safety confirmation level when traveling the same point last time (step ST54).

Note item giving unit 50 outputs an instruction to generate current safe driving support information to line-of-sight distribution comparison unit 14 when it is determined that the current safety confirmation level is higher than the previous time (step ST54 “YES”). In accordance with this instruction, the line-of-sight distribution comparison unit 14 generates the current safe driving support information in which the ideal line-of-sight distribution and the actual line-of-sight distribution are superimposed on the outside-of-vehicle captured image of the outside-of-vehicle imaging device 3 in the predetermined driving environment. It outputs to the control part 15a (step ST25). The current safe driving support information is stored in the information storage unit 20. In continuing step ST55, the consideration matter provision part 50 provides the consideration matter which shows that the driving | operation improved to this safe driving assistance information. The notice items indicating the improvement are stored in the information storage unit 20 together with the current safe driving support information.

On the other hand, if it is determined that the current safety confirmation level is lower than the previous time, or the previous and current safety confirmation levels are the same, or if the previous safety confirmation level does not exist (step ST54 “NO”), the line-of-sight distribution comparison unit 14 and The notice matter assigning unit 50 proceeds to the process of step ST26 without generating the current safe driving support information and the notice matter.

When acquiring the safe driving support information from the information storage unit 20 in step ST28, the display information control unit 15a acquires the safe driving support information together with a notice when the safe driving support information is given to the display 1. Output.
Note that the display information control unit 15a may not only display a comment or the like on the display item 1 on the display unit 1 but also output a voice from a speaker (not shown).
Further, the notice matter assigning unit 50 may extract not only past safe driving support information at the same point as the current position of the host vehicle but also past safe driving support information at a similar point. For example, the consideration provision unit 50 may regard a right turn point and a left turn point as similar, or may regard an intersection at a different place as similar.

As described above, according to the fifth embodiment, the driving support device 10 includes the information storage unit 20 that stores the safe driving support information, and the display control unit 13 determines the items that the driver should pay attention to in the information storage unit 20. Since it is generated using the past safe driving support information stored in the vehicle, it is possible to inform the driver of matters to be noted about the current driving based on the past driving.

Further, according to the fifth embodiment, the display control unit 13 obtains a safety confirmation level that represents the degree of safety confirmation performed by the driver based on the degree of coincidence between the ideal gaze distribution and the actual gaze distribution, and the safety confirmation Since the safe driving support information is generated when the degree is less than or equal to the threshold value, it is possible to generate the safe driving support information with more detailed contents based on the degree of safety confirmation.

In addition, according to the fifth embodiment, the driving support device 10 includes the information storage unit 20 that stores the safe driving support information and the safety confirmation level in association with each other, and the display control unit 13 newly calculates the safety confirmation. When the degree of safety confirmation is determined to be improved by comparing the degree of safety and the degree of safety confirmation of the past safe driving support information stored in the information storage unit 20, the newly obtained safety confirmation degree is less than the threshold value Since it is determined that the safe driving support information is generated at least, if the driver who had insufficient safety confirmation properly checks the safety and the driving is improved, the driver is improved. I can inform you. Thereby, more effective safe driving education can be performed.

In addition, according to the fifth embodiment, the display control unit 13 generates a notice indicating that the degree of safety confirmation has been improved, and displays it on the display 1 together with the safe driving support information. If the driver has seen improvements in the operation is as appropriate to confirm safety, it is possible to inform the improved how compliment driver specifically. Thereby, more effective safe driving education can be performed.

Embodiment 6 FIG.
Since the driving support device 10 according to the first and second embodiments causes the line-of-sight distribution when the driver's safety check is insufficient to be superimposed on the actual captured image outside the vehicle and displayed on the display 1, You can know where you were looking while driving. However, there is a possibility that it is impossible to remember what kind of driving was performed when the safety check is neglected only by looking at the image taken outside the vehicle in front of the vehicle. Therefore, in the sixth embodiment, the driving state is notified together with the safe driving support information to remind the situation at that time more clearly.

FIG. 16 is a block diagram showing a configuration example of the driving support apparatus 10 according to Embodiment 6 of the present invention. The driving support device 10 according to the sixth embodiment is provided with a consideration adding unit 60, a safety confirmation degree determining unit 61, and a driving state determining unit 62 with respect to the driving support device 10 according to the second embodiment shown in FIG. It is a configuration.
16 that are the same as or correspond to those in FIG. 1 or FIG.

In addition, an in-vehicle imaging device 6 is connected to the driving support device 10 of the sixth embodiment as an external information acquisition device. This in-vehicle imaging device 6 is the input device 104 shown in FIG.
The vehicle interior imaging device 6 is a camera that captures the driver's face, and outputs the vehicle interior captured image to the line-of-sight distribution comparison unit 14.

The safety confirmation level determination unit 61 performs the same operation as the safety confirmation level determination unit 51 of the fifth embodiment.

The driving state determination unit 62 determines whether the driving state of the vehicle is a state in which an unsafe driving such as a side-by-side driving, a snoozing driving, and sudden braking and a steering wheel is performed. As a result, the reason why the deviation between the ideal line-of-sight distribution and the actual line-of-sight distribution is large and the safety confirmation level is low is determined.

When determining the side-view driving, the driving state determination unit 62 is configured such that the deviation between the ideal line-of-sight distribution received from the line-of-sight distribution storage unit 11 and the line-of-sight distribution output unit 12a is greater than or equal to a predetermined threshold. It is determined that the driver is driving aside. The threshold value for determining aside driving may be the same value as the threshold value for determining whether or not safe driving support information is generated, or may be a different value.

When determining the drowsy driving, the driving state determination unit 62 acquires the driver's face image captured by the in-vehicle imaging device 6, detects the degree of eye open / close or blinks, etc. from the face image, and sets a predetermined threshold value. And the driver's drowsy driving and the degree of dozing are determined.
The driving state determination unit 62 acquires line-of-sight information via the line-of-sight distribution output unit 12a, and determines that the driver is dozing when the driver's line of sight is not detected for a predetermined time (for example, 0.5 seconds). May be.

For example, when determining sudden braking as unsafe driving, the driving state determination unit 62 acquires vehicle information from the vehicle information acquisition device 5, and determines that braking is sudden when the deceleration of the host vehicle is equal to or greater than a predetermined threshold. To do. On the other hand, when the deceleration is smaller than a predetermined threshold, it is determined that the brake is ideal.

The line-of-sight distribution comparison unit 14 outputs the safety confirmation degree determined by the safety confirmation degree determination unit 61 and the driving state determined by the driving state determination unit 62 to the display information control unit 15a together with the safe driving support information.
In the above description, three types of driving operation such as aside driving, dozing operation, and unsafe driving are shown, but the present invention is not limited to these three types.

The consideration item assigning unit 60 provides a comment or an image that explains the driving state or the improvement method when the safety confirmation level is low as the consideration items to be given to the safe driving support information when the safety confirmation level is low. And so on. FIG. 17 shows a display example of the safe driving support information to which considerations are given.

FIG. 17A is a display example showing safe driving support information and points to be noted when the driving state determination unit 62 determines sudden braking. When the driving state determination unit 62 determines that the brake is abrupt, the attention matter giving unit 60 refers to, for example, past safe driving support information stored in the information storage unit 20 and suddenly brakes at the same point or a similar point. The number of times of sudden braking was detected and a comment such as “Let's be careful because the prospect is bad” is added to the current safe driving support information as considerations. Further, for example, the notice matter assigning unit 60 detects an image that causes a sudden brake from an image picked up outside the vehicle when it is determined that the brake is suddenly generated, and generates an image that highlights the cause to be the matter to be taken care of.

FIG. 17 (b) is a display example showing safe driving support information and points to be noted when the driving state determination unit 62 determines a sideward driving. When the driving state determination unit 62 determines that the driver is looking aside, for example, the attention provision unit 60 refers to past safe driving support information stored in the information storage unit 20, and the same point or a similar point, or the current point The number of times that it was determined to be aside-run driving during the period from the start to the specified time, and the number of times that the side-run operation was performed and comments such as “Let's watch out for aside when going straight” are important points to consider this time. Give to support information.

FIG. 17 (c) is a display example showing safe driving support information and points to be noted when the driving state determination unit 62 determines a drowsy driving. When it is determined that the driving state determination unit 62 is a snoozing driving, the attention matter giving unit 60 refers to the past safe driving support information stored in the information storage unit 20, for example, the same point or a similar point, or the current point This time, the number of times that it was determined to be a nap driving during the period from the first to the previous time is detected, and the safe driving support information of this time with the number of times of the nap driving and comments such as "Let's take a break a little more" To grant. In addition, for example, the notice matter assigning unit 60 receives the in-vehicle captured image when it is determined that the driver is looking aside from the driving state determination unit 62 and takes it as a note matter.

The display information control unit 15a associates the safe driving support information received from the line-of-sight distribution comparison unit 14, the degree of safety confirmation, the driving state, and the notice items generated by the notice item assigning unit 60 and accumulates them in the information storage unit 20. .

Next, the operation of the driving support apparatus 10 according to the sixth embodiment will be described using the flowchart shown in FIG. Here, steps ST21 to ST23 and ST25 to ST28 shown in FIG. 18 are the same as the flowchart shown in FIG.

In step ST61, the safety confirmation degree determination unit 61 calculates the deviation between the ideal line-of-sight distribution and the actual line-of-sight distribution in a predetermined driving environment, and determines the current safety confirmation degree. When the current safety confirmation level is low (“YES” in step ST61), the line-of-sight distribution comparison unit 14 superimposes the ideal line-of-sight distribution and the actual line-of-sight distribution on the vehicle outside captured image of the vehicle exterior imaging apparatus 3 in the predetermined driving environment. The current safe driving support information is generated (step ST25). On the other hand, when the degree of safety confirmation this time is not low (step ST61 “NO”), the line-of-sight distribution comparison unit 14 and the attention item assigning unit 60 do not generate the safe driving support information and the attention item, and the process proceeds to step ST26.

In subsequent step ST62, the driving state determination unit 62 determines whether or not the side-view driving has been performed using the ideal line-of-sight distribution and the actual line-of-sight distribution. When the driving state determination unit 62 determines that the armpit driving has been performed (step ST62 “YES”), the line-of-sight distribution comparison unit 14 displays the current safe driving support information, the determination result of the armpit driving, the degree of safety confirmation, etc. Output to the control unit 15a. Subsequently, the notice matter assigning unit 60 generates a notice matter explaining the contents of the side-view driving as shown in FIG. 17B and assigns it to the current safe driving support information (step ST63). The display information control unit 15a stores the current safe driving support information, points to be noted, a safety confirmation degree, and the like in the information storage unit 20.

When it is not a side-view driving (step ST62 “NO”), in the following step ST64, the driving state determination unit 62 determines whether or not the drowsy driving has been performed using the in-vehicle image captured by the in-vehicle imaging device 6 or the like. To do. When the driving state determination unit 62 determines that the drowsy driving has been performed (step ST64 “YES”), the line-of-sight distribution comparison unit 14 displays the current safe driving support information, the determination result of the dozing driving, the safety confirmation degree, and the like as display information. Output to the control unit 15a. Subsequently, the notice matter assigning unit 60 generates a notice matter explaining the contents of the sleep driving as shown in FIG. 17C, and assigns it to the current safe driving support information (step ST65). The display information control unit 15a stores the current safe driving support information, points to be noted, a safety confirmation degree, and the like in the information storage unit 20.

If it is not a drowsy driving (step ST64 “NO”), in the subsequent step ST66, the driving state determination unit 62 uses the vehicle information of the vehicle information acquisition device 5 to perform an unsafe driving such as a sudden brake or a sudden handle. It is determined whether or not. When the driving state determination unit 62 determines that unsafe driving has been performed (step ST66 “YES”), the line-of-sight distribution comparison unit 14 indicates the current safe driving support information, the determination result of unsafe driving, the degree of safety confirmation, and the like. It outputs to the display information control part 15a. Subsequently, the notice matter assigning unit 60 generates a notice matter explaining the contents of the unsafe driving as shown in FIG. 17A and assigns it to the current safe driving support information (step ST67). The display information control unit 15a stores the current safe driving support information, points to be noted, a safety confirmation degree, and the like in the information storage unit 20.

When it is not unsafe driving (step ST66 “NO”), the line-of-sight distribution comparison unit 14 outputs the current safe driving support information, the degree of safety confirmation, and the like to the display information control unit 15a. Subsequently, the notice matter assigning unit 60 generates, for example, a notice matter explaining the content of insufficient safety confirmation as shown in FIG. 8, and assigns it to the current safe driving support information (step ST68). The display information control unit 15a stores the current safe driving support information, points to be noted, a safety confirmation degree, and the like in the information storage unit 20.

In the flowchart of FIG. 18, the driving state determination unit 62 determines the driving state in the order of aside driving, dozing operation, and unsafe driving, but the determination order is arbitrary.

As described above, according to the sixth embodiment, the display control unit 13 determines that the safe driving support information is generated when the degree of coincidence between the ideal line-of-sight distribution and the actual line-of-sight distribution is equal to or less than the threshold, and the degree of coincidence is the threshold. Since the cause which became below was judged and it was made to display on the indicator 1 with the safe driving assistance information as a matter which the driver should pay attention to, it is possible for the driver The actual situation when driving dangerously can be reminded more clearly. Thereby, more effective safe driving education can be performed.

It should be noted that the functions of the

consideration assigning units

30, 40, 50, 60 described in the third to sixth embodiments can be freely combined.
For example, a map image of a point where sudden braking has occurred as shown in FIG. 19A is obtained by combining the function of the notice matter giving unit 40 of the fourth embodiment with the notice matter giving unit 60 of the sixth embodiment. A map of a point where a dashing operation was performed as shown in FIG. 19 (c), or a map image of a point where a side-viewing operation was performed as shown in FIG. 19 (b). An image may be given as a notice item.
In addition, for example, when the function of the notice matter giving unit 50 according to the fifth embodiment is combined with the notice matter giving part 60 according to the sixth embodiment, the sudden brake occurs at the point where the sudden brake has occurred this time. If there was a sudden braking at the time of the previous run, this time a warning was given to indicate that the improvement was made when there was no sudden braking. Also good.

In the first to sixth embodiments, when the display

information control units

15 and 15a display the safe driving support information stored in the information storage unit 20 on the display 1, for example, in order along the traveled route. The safe driving support information may be displayed, or the safe driving support information having a low safety confirmation level may be displayed in order. Also, instead of displaying all the safe driving support information, for example, a predetermined number of safe driving support information may be displayed in order from the lowest safety confirmation level.

In addition to the above, within the scope of the present invention, the present invention can freely combine each embodiment, modify any component of each embodiment, or omit any component of each embodiment. It is.

The driving support apparatus according to the present invention presents the driver with safe driving support information in which an actual line-of-sight distribution is superimposed on an outside-vehicle captured image including a front landscape of the vehicle. Suitable for use in.

DESCRIPTION OF SYMBOLS 1 Display device, 2 Eye-gaze detection apparatus, 3 Outside imaging device, 4 Map information acquisition device, 5 Vehicle information acquisition device, 6 In-vehicle imaging device, 10 Driving support device, 11 Eye-gaze distribution storage part, 12, 12a Eye-gaze distribution output part, 13 Display control unit, 14 Line-of-sight distribution comparison unit, 15, 15a Display information control unit, 20 Information storage unit, 30, 40, 50, 60 Notes assignment unit, 51, 61 Safety confirmation level determination unit, 62 Driving state determination unit , 100 bus, 101 CPU, 102 ROM, 103 RAM, 104 input device, 105 external storage device, 106 output device.

Claims

A gaze distribution output unit that outputs the actual gaze distribution of the driver;
A line-of-sight distribution storage unit storing an ideal line-of-sight distribution;
It is determined whether to generate safe driving support information based on the degree of coincidence between the actual line-of-sight distribution and the ideal line-of-sight distribution, and when it is determined to generate the actual line-of-sight image, A driving support apparatus comprising: a display control unit that generates safe driving support information on which a line-of-sight distribution is superimposed and displays the information on a display.
The driving support apparatus according to claim 1, wherein the display control unit causes the display to display the ideal line-of-sight distribution together with the safe driving support information.
2. The driving support apparatus according to claim 1, wherein the display control unit causes the display to display a matter to be noted by the driver together with the safe driving support information.
An information storage unit for storing the safe driving support information;
4. The driving support apparatus according to claim 3, wherein the display control unit generates items that the driver should pay attention to using past safe driving support information stored in the information storage unit.
4. The driving support apparatus according to claim 3, wherein the matter to be noted by the driver is a map image indicating a point that is the target of the safe driving support information generated by the display control unit.
When it is determined that the safe driving support information is generated, the display control unit captures the outside of the vehicle imaged during a period in which the vehicle is traveling in a predetermined point or in a predetermined driving state. The driving support apparatus according to claim 1, wherein the safe driving support information is generated using a captured image and the actual line-of-sight distribution output from the line-of-sight distribution output unit.
The driving support device according to claim 6, wherein the predetermined driving state is at least one of a state in which aside driving, snoozing driving, sudden steering, or sudden braking is performed.
The display control unit determines that the safe driving support information is generated when a degree of coincidence between the actual line-of-sight distribution and the ideal line-of-sight distribution is equal to or less than a threshold value, and determines a cause of the degree of coincidence being equal to or less than the threshold value. 4. The driving support apparatus according to claim 3, wherein the determined cause is displayed on the display unit together with the safe driving support information as a matter to be noted by the driver.
The display control unit determines whether or not the cause that the degree of coincidence between the actual line-of-sight distribution and the ideal line-of-sight distribution is equal to or less than a threshold value is at least one of side-by-side driving, snoozing driving, sudden steering, or sudden braking. The driving support device according to claim 8, further comprising:
An information storage unit for storing the safe driving support information;
The driving support apparatus according to claim 1, wherein the display control unit displays the safe driving support information stored in the information storage unit on the display when the vehicle is parked.
The display control unit obtains a safety confirmation degree indicating a degree of safety confirmation performed by the driver based on a degree of coincidence between the actual eye gaze distribution and the ideal gaze distribution, and the safety confirmation degree is equal to or less than a threshold value. The driving support device according to claim 1, wherein the driving support device is determined to generate the safe driving support information.
An information storage unit that stores the safe driving support information and the safety confirmation level in association with each other;
When the display control unit determines that the degree of safety confirmation is improved by comparing the newly obtained safety confirmation degree with the safety confirmation degree of past safe driving support information stored in the information storage unit, The driving support device according to claim 11, wherein it is determined that the safe driving support information is generated even if the newly obtained safety confirmation degree is not equal to or less than the threshold value.
13. The driving support apparatus according to claim 12, wherein the display control unit generates information indicating that the degree of safety confirmation has been improved, and causes the display to display the information together with the safe driving support information.
The driving assistance device according to claim 1, wherein the line-of-sight distribution output unit generates the actual line-of-sight distribution from line-of-sight information estimated based on a direction of the driver's face.