JP4742982B2 - Notification device and program - Google Patents

Description

  The present invention relates to a notification device for performing notification to a driver of a vehicle.

In recent years, various techniques for performing notification to a vehicle driver have been proposed.
For example, it is determined whether the traveling vehicle is in a dangerous state based on information on the driver who drives the vehicle and various information from the outside of the vehicle, and is determined to be in a dangerous state. In such a case, there is a technique of notifying that effect (see Patent Document 1).

As a technique for preventing such notification from becoming a nuisance to the driver, when the driver's line of sight is facing an obstacle present in the traveling direction of the vehicle, the notification is not performed. There is a technique such as (see Patent Document 2).
Japanese Patent Laid-Open No. 06-150199 JP 2004-295472 A

However, any of the above-described techniques is a technique for performing notification so as to avoid a danger that may occur during the traveling of the vehicle, and thus it cannot be said that it is appropriate to use the vehicle for starting.
For example, when starting from a state where the vehicle is stopped, each of the left and right regions with respect to the traveling direction is visually recognized over a certain period of time. Therefore, unnecessary notification may be repeatedly performed before starting.

  The present invention has been made to solve such a problem, and an object of the present invention is to provide a technique for enabling appropriate notification in order to avoid a danger that may occur when starting the vehicle. That is.

In order to solve the above-mentioned problem, the notification device according to claim 1 is a notification device that performs notification to a driver who drives the vehicle while mounted on the vehicle.
In this notification device, the situation detection means detects the driving situation of the vehicle by the driver. The confirmation determination means determines whether or not the driver has confirmed each of one or more specific areas around the vehicle before the situation detection means detects that the vehicle is in a driving situation for starting. In addition, when it is detected by the situation detection means that the vehicle is in a driving situation where the vehicle is started, the passage determination means determines whether or not an object is passing through each of the specific areas. And an alerting | reporting means alert | reports according to the determination result of the said confirmation determination means and the said traffic determination means.

  In the notification device configured as described above, notification according to a determination result such as whether the driver has confirmed a specific area around the vehicle or whether an object is passing through the specific area before the vehicle starts. Can be done to inform the driver.

  Here, when the driver starts the vehicle, he / she visually recognizes the periphery of the vehicle over a certain period of time, but the above determination is made based on the situation until the vehicle starts. Therefore, unlike the notification device based on only the state of visual recognition at that time, the notification device does not repeatedly perform unnecessary notification until the vehicle starts. Notification can be performed. Thereby, it can be expected to greatly contribute to avoiding a danger that may occur when the vehicle starts.

  The situation detection means described above is means for detecting the driving situation of the vehicle by the driver, and detects at least “the driving situation in which the vehicle is started”. Here, in order to detect the driving situation, for example, the operation state (shift position) of the transmission, the operation state of the access pedal and various brakes (brake pedal and side brake), the speed of the vehicle, etc. are referred to. It is possible to do. For example, the operation state of the transmission is drive (D), the accelerator pedal has started to be depressed, the brake pedal has not been depressed, the side brake has not been activated, the vehicle speed has a predetermined threshold It may be configured to detect that it is larger than the value (or a combination thereof) as “the driving situation in which the vehicle is started”.

  Further, this situation detection means may detect not only “the driving situation where the vehicle is started” but also “the driving situation where the vehicle is stopped”. Specifically, for example, the operation state (shift position) of the transmission is parking (P) or neutral (N), the accelerator pedal is not depressed, the brake pedal is depressed, the side brake is It may be configured to detect that the vehicle is operating or the vehicle speed is equal to or lower than a predetermined threshold value (or a combination thereof) as the “driving situation in which the vehicle is stopped”. In such a configuration, the confirmation determination unit and the traffic determination unit are in a period from when it is detected that the vehicle is in a driving state for stopping the vehicle until it is detected that the vehicle is in a driving state for starting. In this case, it may be configured to perform the determination.

  Further, the notification means described above is a means for performing notification according to the determination results of the confirmation determination means and the traffic determination means, and a specific configuration such as what kind of notification is to be performed at what determination result. Various configurations can be considered for.

For example, as described in the following, in one or more of the specific area, it is determined that the object by the passing determining means is passing, and is not confirmed driver by the check determining means and determination It is conceivable that a notification is issued to warn the driver of the danger when the specified area is present.

  With this configuration, it is dangerous for the driver when an object is passing through a specific area around the vehicle but the driver has not confirmed the specific area. Can be warned.

  For the “notification to warn of danger” here, a message indicating that the driver is in danger is displayed on the display device, or a message to that effect is displayed from the speaker. It can be considered that the configuration is realized by, for example, outputting.

Further, as a specific configuration for performing notification by notifying means, as described in the following, in one or more of the specific area, it is determined that the object is passing by the passing determining means, and In the case where there is a specific area that is determined to be confirmed by the driver by the confirmation determination unit, or the passage determination unit determines that the object is not passing, and the confirmation determination unit It is conceivable to configure such that notification is given to alert the driver when there is a specific area that is determined not to be confirmed by the driver.

  If configured in this way, even if an object is passing in a specific area around the vehicle, even if the driver confirms the specific area, or even if the object is not passing through the specific area, When the driver does not confirm the specific area, the driver can be alerted.

  In addition, for the purpose of “notification to alert the driver” here, it is necessary to continue to pay attention to objects passing through a specific area or to recognize that the driver has failed to confirm. It is conceivable to realize a configuration in which display is performed on a display device or a message to that effect is output from a speaker.

In addition, it is desirable that the notification means described above does not perform notification according to the determination result in order not to confuse the driver with unnecessary notification. As a determination result that should not be notified, it is determined that the object is not passing by the traffic determination unit with respect to a specific area, and it is determined that the driver is checking by the confirmation determination unit. For this purpose, for example, it may be configured as a notification device according to claim 3 .

  In the notification device, the notification means is determined that the object is not passing by the passage determination means and the driver is confirmed by the confirmation determination means in one or more specific areas. The notification about the specific area is not performed.

  If comprised in this way, a driver | operator will confirm and the alert | report about the specific area | region which does not pass an object will not be performed. Since it can be said that such a specific area is a specific area where the possibility of danger is relatively low, the driver is confused by unnecessary notification by not reporting about it. Can be prevented.

  In addition, although the case where it is set as the structure which does not alert | report is shown here, when it is confirmed by the driver | operator that there is no traffic of objects in one or more specific area | regions, the object is detected by the traffic determination means. Even when there is a specific area that is determined to be passing and that has been determined to be confirmed by the driver by the confirmation determination means, the specific area is not notified. Also good.

  Further, the notification means described above is configured such that when an output unit for outputting the notification content by the notification means is provided at a position corresponding to each specific area in the vehicle, the output unit is used for notification. May be.

As a specific configuration, for example, as described in claim 4 , for one or more specific areas, notification according to the determination result by the confirmation determination unit and the traffic determination unit corresponds to the specific area. It can be considered that the configuration is performed by an output unit provided at a position.

  If comprised in this way, the alerting | reporting according to the determination result about a specific area will be performed by the output part provided in the position corresponding to the specific area. Therefore, it can be easily recognized from the position of the output unit where the notification is made, such as which specific region the notification is for. As a result, the driver recognizes, from the position of the output unit that made the notification, what specific area he should check and which specific area may be dangerous when the notification is made. Thus, the specific area can be quickly confirmed.

  Note that the output unit in this configuration is a display device that displays notification contents, a speaker that outputs notification contents, or the like. And these output parts should just be provided in the positional relationship so that alerting | reporting content may reach | attain a driver | operator from the specific area | region corresponding to the output part.

  By the way, when starting the vehicle, the driver visually recognizes the periphery of the vehicle for the purpose of avoiding a danger that may occur when starting the vehicle, but such a danger is more than the case of a straight road. It can be said that this is more likely to occur when the road is near an intersection. Therefore, it is good also as a structure which alert | reports only when it is the road vicinity used as such an intersection.

  For this purpose, for example, when the intersection determination unit determines that the vehicle has reached a position within a predetermined range from the intersection, the notification unit performs notification according to the determination results of the confirmation determination unit and the traffic determination unit. It is conceivable to configure as follows.

Further, in order to notify only when the road is near an intersection, it may be configured as a notification device according to claim 5 . The notification device includes an intersection determination unit that determines whether or not the vehicle has reached a position within a predetermined range from the intersection through communication with another device that can communicate with the notification device. The confirmation determination unit determines that the intersection determination unit has determined that the vehicle has reached a position within the predetermined range, and the situation detection unit detects that the vehicle is in a driving situation in which the vehicle is started. Then, it is determined whether or not the driver has confirmed each of one or more specific areas around the vehicle. On the other hand, at the time when the traffic determination means determines that the intersection determination means has reached a position within the predetermined range, and the situation detection means detects that the vehicle is in a driving situation where the vehicle is started. , It is determined whether or not an object is passing through each of the specific areas.

  With this configuration, the determination by the confirmation determination unit and the traffic determination unit is performed only when the vehicle reaches a position within a predetermined range from the intersection, so that the notification by the notification unit according to the determination result is performed. Is performed only in the same case. In other words, with this configuration, the notification by the notification means can be performed only when the road is near an intersection.

  The intersection determination means in this configuration is a means for determining whether or not the vehicle has reached a position within a predetermined range from the intersection through communication with another device capable of communicating with the notification device. The specific configuration for performing is not particularly limited.

  For example, if the present notification device is configured to be communicable with the navigation device as the “other device”, the vehicle passes through an intersection of position information and the like with the navigation device. What is necessary is just to comprise so that it may be determined whether it reached | attained the position within the predetermined range. Further, the present notification device is installed as an “other device” in the vicinity of the intersection, and is configured to be able to communicate with a device that transmits information indicating that the vehicle has reached a position within a predetermined range from the intersection. If the information is received from this device, the vehicle may be determined to have reached a position within a predetermined range from the intersection.

Moreover, the confirmation determination means mentioned above is a means which determines whether the driver | operator confirmed the specific area | region, About the specific structure for performing the determination, it is not specifically limited. For example, if a line-of-sight detection means for detecting the direction in which the driver is turning his / her line of sight is provided, the confirmation determination means starts the vehicle by the situation detection means as described in claim 6 . The specific area in which the driver has confirmed that the driver's line of sight has been directed for a predetermined time or more by the line-of-sight detection means until it is detected that the vehicle is in a driving situation. What is necessary is just to comprise so that it may determine.

  If comprised in this way, it can determine with the specific area | region located in the direction having been confirmed by the driver having a driver | operator's eyes | visual_axis having been aimed at the specific area over predetermined time or more. Here, if the “predetermined time” described above is set to a time that is considered necessary for confirming the specific area, it cannot be said that the specific area is confirmed as if the line of sight is simply moved. Such a state is eliminated, and it is possible to more appropriately determine that the specific area has been confirmed by the driver.

  The line-of-sight detection means in this configuration identifies the direction of the line of sight by analyzing an image obtained by photographing the driver's face with a camera, and the direction of the line of sight thus identified is in the specific region. This is a well-known means for specifying whether or not the direction is the corresponding direction.

  In addition, when an object passes through the specific area immediately before or after a predetermined time has elapsed since the driver turned his / her line of sight to the specific area, the driver fully recognizes the passage of the object. It is possible that the line of sight is directed to another area before. In such a case as well, it is not always appropriate to determine that the driver has confirmed the specific area only after a predetermined time after directing the line of sight to the specific area. There is a possibility that it will be impossible to give sufficient attention and warning to the person.

In order to prevent this, for example, it is conceivable to configure like a notification device according to claim 7 . In this notification device, the confirmation determination unit is configured to determine that the object is passing by the passage determination unit with respect to the specific region in which the driver's line of sight is detected by the line-of-sight detection unit, It is determined that the specific area has been confirmed by the driver when it is detected that the driver's line of sight has been directed to the specific area for a predetermined time or more from the time when it is determined that the vehicle is passing.

  According to this configuration, even when an object passes through the specific area immediately before or after a predetermined time has elapsed since the driver turned his / her line of sight to the specific area, it is further predetermined from that point. If the driver's line of sight is not directed to the specific area for more than the time, it is not determined that the specific area has been confirmed by the driver. This means that if the driver turns his line of sight to another area before fully recognizing the traffic of the object, even if he has been looking at the specific area for a predetermined time or longer, the specific area This means that it can be determined not to be confirmed. Thereby, it becomes possible to determine that the driver has confirmed the specific area more appropriately.

  Further, in each of the notification devices described above, an object may pass through a specific area that has been determined to be once confirmed by the confirmation determination unit before the driving situation in which the vehicle is started. In such a case, since the driver does not recognize that the object is passing through the specific area, the specific area should be reconfirmed. In other words, it is desirable to determine that such a specific area has not been confirmed by the driver, and to perform notification according to the determination result.

As a configuration for this purpose, it is conceivable to configure as a notification device according to claim 2 . In the notification device, the confirmation determination unit is configured to determine the specific region that has been previously determined to be confirmed by the driver before the situation detection unit detects that the vehicle has started driving. When it is determined by the traffic determination means that the object is passing, it is determined that the specific area is a specific area that the driver has not confirmed.

  If comprised in this way, when an object passes the specific area once determined with the confirmation determination means, it will determine with the specific area not having been confirmed by the driver | operator. Therefore, notification according to the determination result that it is not confirmed as such can be performed by the notification means.

A program according to an eighth aspect is a program for causing a computer system to execute various processing procedures for causing the notification apparatus according to any one of the first to seventh aspects to function as all means.

The computer system controlled by such a program can constitute a part of the notification device according to any one of claims 1 to 7 .
Each program described above consists of an ordered sequence of instructions suitable for processing by a computer system, and is provided to a notification device or a user who uses this through various recording media and communication lines. Is.

Embodiments of the present invention will be described below with reference to the drawings.
(1) Overall Configuration The notification device 1 includes a control unit 2 that controls the operation of the entire notification device 1, a memory 3 that stores various data, and the like, and is a device that is used in a state of being mounted on a vehicle. The control unit 2 is communicably connected to a sensor 100, a navigation device 200, an in-vehicle camera 302, an out-of-vehicle camera 304, and the like provided in the vehicle, and executes processing to be described later based on information obtained from these. It is configured.

  Among the devices connected to the control unit 2, the sensor 100 detects, for example, a vehicle speed sensor that detects the traveling speed of the vehicle, an accelerator pedal sensor that detects the amount of depression of the accelerator pedal in the vehicle, and the amount of depression of the brake pedal. A brake pedal sensor, a side brake sensor that detects the amount of operation of the side brake lever, a foot position sensor that detects the position of the driver's foot, a shift position sensor that detects the switching state (shift position) of the transmission, and the like .

  In addition, the navigation device 200 detects the current position of the vehicle, identifies where the vehicle is located on the map indicated by the map data based on the current position, and displays information indicating that on the control unit In response to a request from 2, a reply is made.

  The in-vehicle camera 302 is provided in a positional relationship capable of capturing the driver's face (especially both eyes), and transmits image data indicating the image of the driver's face thus captured to the control unit 2. Is configured to do.

  In addition, the outside camera 304 is provided in a positional relationship in which a first vehicle exterior camera provided in a positional relationship capable of capturing an area on the right front side of the periphery of the vehicle and in a position capable of capturing an area on the left front side. Each of which is configured to transmit image data indicating an image of the area thus photographed to the control unit 2.

Hereinafter, another embodiment in which the contents of the processing executed by the control unit 2 are different in such a configuration will be described in detail.
(2) Processing by Control Unit 2 (2-1) Notification Processing A processing procedure of notification processing executed by the control unit 2 will be described below with reference to FIG. This notification process is started when the notification device 1 is activated in response to the ignition switch of the vehicle being switched to the ON side, and thereafter repeatedly executed every predetermined time (for example, 10 ms). In addition, the control part 2 implement | achieves this alerting | reporting process in each part which comprises the control block diagram shown in FIG.

  When this notification process is started, first, the intersection determination unit 14 determines whether or not the vehicle has reached a position within a predetermined range from the intersection (s102). Here, the intersection determination unit 14 requests information from the navigation device 200 and acquires information returned from the navigation device 200 that has received this request. And the intersection determination part 14 determines with the vehicle having reached | attained the position within the predetermined range from the intersection, when the position of the vehicle shown by the information is a position which approached the intersection by a predetermined distance.

If it is determined in s102 that the vehicle has not reached a position within the predetermined range from the intersection (s102: NO), the notification process is immediately terminated.
If it is determined in s102 that the vehicle has reached a position within a predetermined range from the intersection (s102: YES), the driver's line of sight is detected by the line-of-sight detection unit 16 (s104). Here, the line-of-sight detection unit 16 acquires image data transmitted from the in-vehicle camera 302 and performs a known image analysis process from an image (driver's face) indicated by the image data, so that the driver can It is detected in which direction around the vehicle the line of sight is directed.

  Next, the traffic detection unit 18 detects the traffic state of the object in each of one or more specific areas around the vehicle (two areas on the left front and right front in this embodiment) (s106). Here, the traffic detection unit 18 acquires the image data transmitted from the outside camera 304, and performs a known image analysis process from the image of the specific area indicated by the image data, thereby allowing the traffic for each specific area. A state (with or without object traffic on the left and with or without object traffic on the right) is detected.

  Next, based on the driver's line of sight detected in s104 and the traffic state detected in s106, the confirmation state determination unit 22 performs state determination processing described later for the number of specific regions (s108). ). Here, a plurality of state determination processes using each of the traffic conditions detected in s106 as an argument together with the driver's line of sight detected in s104 are sequentially or simultaneously activated, thereby indicating the traffic conditions. The state determination process is performed for each specific area. This state determination process is a process for determining the confirmation state of the specific area by the driver, and the specific area is either unconfirmed or confirmed for the specific area that is the argument described above. A variable Chk (Unconfirmed → Chk = 0, Confirmed → Chk = 1) is a return value. A specific processing procedure will be described later.

  Next, the status detection unit 12 checks whether the vehicle is stopped and whether the driver is about to start the vehicle based on the change in the parameter detected by the sensor 100 (s112). . Here, the parameter detected by the sensor 100 is, for example, from the state where the traveling speed detected by the vehicle speed sensor is less than a predetermined value and the stepping amount detected by the brake pedal sensor is greater than or equal to the predetermined value. Is less than a predetermined value, and it is determined that the driver is about to start the vehicle when the amount of depression detected by the accelerator pedal sensor is equal to or greater than the predetermined value.

If it is determined in s112 that the driver has not started the vehicle (s112: NO), the process returns to s104.
On the other hand, if it is determined in s112 that the driver is going to start the vehicle (s112: YES), the notification unit 24 performs the traffic state detected in s106 performed immediately before and the immediately preceding state. Based on each variable Chk obtained in step s108, the notification content for each specific area is determined (s116). Here, as described above, the case where there are two specific areas, the left front and the right front, will be described as an example. Based on the data table shown in FIG. 4, the following notification contents are determined for each specific area. The

First, for the left front specific area, the traffic state for the left front specific area (with or without object traffic on the left), the return value of the state determination process for the left front specific area (Chk (left)) = 0 (unconfirmed) or 1 (confirmed)), the notification content is determined as follows (see FIGS. 4A and 4B).
・ "No object on the left" and "Chk (left) = 1"-> No notification (no left notification)
・ "No object on the left" and "Chk (left) = 0" → A message for urging attention to the left front (note left)
-"There is an object passing on the left" and "Chk (left) = 1" → A message for urging attention to the left front (note left)
-“There is an object on the left” and “Chk (left) = 0” → A message to warn that the left front is dangerous (left warning)
In addition, for the right front specific area, the traffic state for the right front specific area (with or without traffic on the right), the return value of the state determination process for the right front specific area (Chk (right)) = 0, 1) The notification content is determined as follows.
・ "No object to the right" and "Chk (right) = 1"-> No notification (no right notification)
・ "No object to the right" and "Chk (right) = 0" → Message to encourage attention to the right front (right attention)
-“There is an object on the right” and “Chk (right) = 1” → A message for urging attention to the right front (caution on the right)
・ "There is an object on the right" and "Chk (right) = 0" → A message to warn that the right front is dangerous (right warning)
In addition, the above-mentioned “message for prompting attention” is a message having contents such as continuing attention to an object passing through a specific area, and recognizing that the driver has failed to confirm. . The “message for warning that it is dangerous” is a message that informs the driver that it is dangerous.

  And after the alerting | reporting part 24 performs alerting | reporting based on the alerting | reporting content determined in s116 (s118), this alerting | reporting process is complete | finished. Here, the notification regarding the specific area is not performed about the specific area determined not to be notified as the notification content in s116 among the specific areas. In addition, for a specific area in which a message (a left caution or a right caution) for prompting attention to be given as notification content is determined, the control unit 2 indicates that the message should be output for the specific area from the navigation device 200. Is commanded. In addition, for a specific area for which a message for warning that the notification content is dangerous (left warning, right warning) is determined, the control unit 2 indicates that the message should be output for the specific area from the navigation device. 200 is commanded. And the navigation apparatus 200 which received the instruction | command from the control part 2 implement | achieves notification by making the display part display or output from a speaker sequentially or simultaneously.

In the present embodiment, the speaker that outputs the notification content in the navigation device 200 is arranged on the right side and the left side as viewed from the driver, and the control unit 2 selects the speaker that outputs the notification content according to the notification content. Order to use properly. For example, if the notification content is a left caution or left warning, a message is output that the speaker should be output from the left side. If the notification content is a right caution or right warning, the message is positioned on the right side. To output from the selected speaker. As a result, the notification content is output from the speaker arranged according to the notification content.
(2-2) State determination process The process procedure of a state determination process is demonstrated below based on FIG. This state determination process is started by passing the corresponding specific area and the driver's line of sight as arguments in s108 of FIG. 2 described above.

  In this state determination process, first, a specific area indicated by “sub-confirmation state data (hereinafter simply referred to as“ sub-confirmation state data ”in the description of the state determination process)” for the specific area passed in s108 described above. The confirmation state is checked (s202). In the present embodiment, for each specific area, “sub-confirmation state data” indicating a state of whether or not the driver has confirmed the specific area is prepared. This “sub-confirmation state data” can be simulated by the state transition diagram shown in FIG. 6. From the initial state of “unconfirmed”, “under confirmation” and “confirmed” through the subsequent processing. It will be a transition to one of the states. In s202, it is checked whether the state indicated by the “subconfirmation state data” is “unconfirmed”, “confirming”, or “confirmed”.

  As a result of the check in s202, when it is determined that the confirmation state of the specific area is “confirmed” (s202: YES), the “object traffic state” passed in s108 described above is checked. (S204).

  As a result of the check in s204, if it is determined that the object is in a state indicating that the object is passing (the object is passing) (s204: YES), the sub-confirmation state data is in a state indicating “unconfirmed”. It is updated (s206) (see arrow a in FIG. 6).

  Next, after each of the variables Timer and Chk corresponding to the sub confirmation status data is initialized (0 → Timer, Chk) (s208), the process uses the variable Chk at this time as a return value, and the process performs a main routine (FIG. Return to s110 of 2; This variable Timer is a variable of an initial value “0” associated with each sub-confirmation state data, and is initialized (“0” is set) each time “YES” is determined in s102 of FIG. The The variable Chk is a variable having an initial value “0” associated with each sub-confirmation state data together with the variable Timer, and is initialized (“0”) every time “YES” is determined in s102 of FIG. Is set).

  On the other hand, if it is determined as a result of the check in s204 that the object is not passing (s204: NO), the variable Chk at this time is returned without performing s206 and s208. The process returns to the main routine of the notification process.

  As a result of the check in s202 described above, when it is determined that the confirmation state of the specific area is not “confirmed” (s202: NO) but “unconfirmed” (s210: YES), the above-described s108 is set. Then, the “driver's line of sight” passed is checked (s212).

  As a result of the check in s212, when it is determined that the driver's line of sight is directed toward the specific region passed in s108 described above (s212: YES), the sub-confirmation state data indicates “under confirmation”. After updating to the state shown (s214) (see arrow b in FIG. 6), the process returns to the main routine of the notification process using the variable Chk at this time as a return value.

  On the other hand, if it is determined as a result of the check in s212 that the driver's line of sight is not in the direction of the specific area passed in s108 described above (s212: NO), s214 is not performed at this time. Then, the process returns to the main routine of the notification process with the variable Chk as a return value.

  Also, as a result of the check in s202 described above, when it is determined that the confirmation state of the specific area is not “confirmed” or “unconfirmed” but “confirming” (s210: NO), the above-described s108 is performed. Then, the “driver's line of sight” passed is checked (s216).

  As a result of the check in s216, if it is determined that the driver's line of sight is directed toward the specific area passed in s108 described above (s216: YES), the “object” passed in s108 described above Is checked "(s218).

  As a result of the check in s218, when it is determined that the object is in a state of passing (object passing) (s218: YES), or the driver's line of sight is confirmed in s216 described above When it is determined that the state is not directed toward the specific region to be determined (s216: NO), the sub-confirmation state data is updated to a state indicating “unconfirmed” (s220) (see arrow c in FIG. 6). After each of the variables Timer and Chk corresponding to the sub confirmation status data is initialized (0 → Timer, Chk) (s222), the process returns to the main routine of the notification process using the variable Chk at this time as a return value.

  If it is determined as a result of the check in s218 described above that the object is not passing (s218: NO), the variable Timer corresponding to the sub confirmation state data is set to a predetermined threshold value. It is checked whether or not (for example, 50) or more (s224). Since “1” is added to this variable Timer every time it is determined that the driver's line of sight is directed in the direction of the specific area passed in s108 described above in the subsequent processing, in this s224, Thus, it is determined whether or not the driver's line of sight is directed over a specific area for a predetermined time (10 ms (initiating period of notification processing) × 50 = 0.5 s) or more.

  If it is determined in s224 that the variable Timer is not equal to or greater than the threshold (s224: NO), “1” is added to the variable Timer (Timer + 1 → Timer) (s230) (FIG. 6). The process returns to the main routine of the notification process with the variable Chk at this time as a return value.

On the other hand, if it is determined in s224 that the Timer is equal to or greater than the threshold (s224: YES), the sub-confirmation state data is updated to a state indicating “confirmed” (s226) (arrow in FIG. 6). e), after “1” is set to the variable Chk corresponding to the sub-confirmation state (s228), the process returns to the main routine of the notification process using the variable Chk at this time as a return value.
(3) Action and Effect In the notification device 1 configured as described above, whether the driver has confirmed a specific area around the vehicle before the vehicle starts, or whether an object is passing through the specific area. The notification according to the determination result can be performed to notify the driver.

  Here, when the driver starts the vehicle, he / she visually recognizes the periphery of the vehicle over a certain period of time, but the above determination is made based on the situation until the vehicle starts. Therefore, in the notification device 1, unlike notification that is based only on the state of visual recognition at that time, unnecessary notification is not repeatedly performed until the vehicle starts, so that appropriate notification is made when the vehicle starts. It can be performed. Thereby, it can be expected to greatly contribute to avoiding a danger that may occur when the vehicle starts.

  In the above embodiment, in s116 and s118 in FIG. 2, the specific area in which it is determined that the object is passing in one or more specific areas and the driver has not confirmed. Is configured to warn the driver that the specific area is dangerous (see “Left Warning” and “Right Warning” in FIG. 4). ). Therefore, when an object passes through a specific area around the vehicle and the driver does not confirm the specific area, a danger may occur to the driver in the specific area. Can be warned.

  Further, in the above-described embodiment, in s116 and s118 in FIG. 2, the specific area that is determined that the object is passing and the driver confirms is in one or more specific areas. If it exists, or if there is a specific area where it is determined that the object is not passing and the driver has not confirmed, the driver is alerted (See “Left Caution” and “Right Caution” in FIG. 4). Therefore, even if an object is passing in a specific area around the vehicle, even if the driver confirms the specific area, or even if an object is not passing in the specific area, drive in that specific area. When the driver does not confirm, the driver can be urged to pay attention to the specific area.

  Further, in the above-described embodiment, in s116 and s118 in FIG. 2, notification is not performed for the specific area that is determined that the object is not passing and that is determined to be confirmed by the driver (FIG. 4). (See “No left notification” and “No right notification”). For this reason, the driver confirms and does not report on a specific area where no object passes, that is, a specific area where the possibility of danger is relatively low. Can be prevented from becoming confused.

  Moreover, in the said embodiment, it is comprised so that the process after the process (s104 of the figure) after the process of detecting a driver | operator's eyes | visual_axis in the alerting | reporting process of FIG. 2 may be performed on condition that the vehicle arrived at the intersection vicinity. ("YES" in s102 in the figure). Therefore, notification is performed only when the vehicle reaches a position within a predetermined range from the intersection (s116, s118 in the figure). That is, with this configuration, notification can be performed only when the vehicle has reached the vicinity of the intersection.

  When starting the vehicle, the driver visually recognizes the vicinity of the vehicle for the purpose of avoiding a danger that may occur when starting the vehicle, but such a danger is more than the case of a straight road. It can be said that it is more likely to occur when the road is near an intersection. Therefore, even if the notification is performed only when the vehicle is in the vicinity of the intersection, the object of avoiding danger can be sufficiently achieved while preventing unnecessary notification.

  In the above embodiment, in the state determination process of FIG. 5, the specific area in which the driver's line of sight has been directed over the predetermined area for a predetermined time or more is the specific area confirmed by the driver. (S224 in the figure). For this reason, when the driver's line of sight is directed to the specific area for a predetermined time or more, it can be determined that the specific area located in the direction has been confirmed by the driver. Here, if the “predetermined time” described above is set to a time that is considered necessary for confirming the specific area, it cannot be said that the specific area is confirmed as if the line of sight is simply moved. Such a state is eliminated, and it is possible to more appropriately determine that the specific area has been confirmed by the driver.

  Further, in the above embodiment, in s118 of FIG. 2, the notification content is output from the speaker arranged at the position corresponding to the notification content, that is, the notification is performed using different speakers according to the notification content. ing. Therefore, notification according to the determination result for the specific area is performed by a speaker provided at a position corresponding to the specific area. For this reason, it is possible to easily recognize which specific region the notification is for, based on the position of the speaker where the notification is performed (more specifically, the direction in which the sound is heard). Thus, when the notification is given, the driver can confirm which specific area he should check and in which specific area danger can occur, or the position of the speaker that made the notification, or It is possible to recognize from the direction in which the sound is output and to quickly confirm the specific area.

  Further, in the above embodiment, in the state determination process in FIG. 5, even if the specific region has been confirmed once, if it is determined that the object is subsequently passed, the confirmation state transitions to unconfirmed. At the same time, the variable Timer is initialized (s202 to s208, s218 to s222 in the figure, arrows e, f, and i in FIG. 4). Therefore, if the line of sight is not directed to the specific area until a predetermined time or more passes again from that time, the specific area is not confirmed (s224 and s226 in FIG. 5). This means that if the driver turns his line of sight to another area before fully recognizing the traffic of the object, even if he has been looking at the specific area for a predetermined time or longer, the specific area This means that it can be determined not to be confirmed. Thereby, it becomes possible to determine that the driver has confirmed the specific area more appropriately.

  Further, in the above embodiment, in the state determination process in FIG. 5, even if the specific region has been confirmed once, if it is determined that the object is subsequently passed, the confirmation state transitions to unconfirmed. (S202 to s208, s218 to s222, arrows e, f, g, h, i in FIG. 4). Therefore, when an object passes after it has been confirmed for a specific area, the confirmation state for the specific area can be unconfirmed, and a result of notification about the specific area can be performed Thus, it is possible to cause the driver to confirm again the specific area that has been unconfirmed.

As a result, even if an object passes through a specific area around the vehicle, the driver confirms the specific area, or even if an object does not pass through the specific area, The driver can be alerted in the case where the vehicle has not been confirmed.
(4) Modifications Although the first embodiment of the present invention has been described above, the present invention is not limited to the above-described embodiment, and can take various forms as long as they belong to the technical scope of the present invention. Needless to say.

  For example, in the said embodiment, what was comprised so that transmission of the information with respect to the control part 2 from the navigation apparatus 202 might be performed when the request | requirement from the control part 2 was received was illustrated. However, the transmission of information from the navigation device 202 to the control unit 2 may be configured such that the navigation device 202 periodically or when the vehicle reaches a position within a predetermined range from the intersection.

  In the above embodiment, when the depression amount detected by the brake pedal sensor is less than the predetermined value and the depression amount detected by the accelerator pedal sensor is equal to or greater than the predetermined value in s112 of FIG. An example is shown in which it is determined that the driver is about to start the vehicle. However, in s112, the operation state of the transmission is set to drive (D), the accelerator pedal is started to be depressed, the brake pedal is not depressed, the side brake is not activated, and the vehicle speed is It may be configured to detect that the vehicle is larger than a predetermined threshold (or a combination thereof) as “the vehicle is about to start”.

  In s102 of FIG. 2 in the above embodiment, not only the vehicle has reached a position within a predetermined range from the intersection, but also detects that the vehicle has stopped in a state of reaching that position, and the vehicle has stopped. It may be configured to shift to s104 on the condition that it is present. In s102 in this case, for example, the operation state (shift position) of the transmission is parking (P) or neutral (N), the accelerator pedal is not depressed, the brake pedal is depressed, side brake It is conceivable to detect that the vehicle is operating or the vehicle speed is equal to or lower than a predetermined threshold value (or a combination thereof) as “the vehicle is stopped”.

  Moreover, in the said embodiment, what was comprised so that it might determine through the exchange of information between the navigation apparatuses 200 whether the vehicle arrived at the intersection vicinity in s102 of FIG. However, another configuration can be adopted as a configuration for determining whether or not the vehicle has reached the vicinity of the intersection. For example, if the notification device 1 is installed near an intersection and is configured to be communicable with a device that transmits information indicating that the vehicle has reached a position within a predetermined range from the intersection, What is necessary is just to comprise so that it may determine with the vehicle having arrived at the intersection vicinity (position within the predetermined range from an intersection) with the information received from the apparatus.

  Moreover, in the said embodiment, what was comprised so that the alerting | reporting process might be performed by making each left front and right front of a vehicle into a specific area was illustrated. However, not only the left front and right front of the vehicle but also the front, left rear, right rear, and rear of the vehicle may be used as a specific area to perform the notification process.

  Moreover, in the said embodiment, what was comprised so that notification content might be output from the speaker arrange | positioned in the position according to notification content in s118 of FIG. However, the output of the notification content from the position corresponding to the notification content may be realized by an output unit other than the speaker. In this case, it is desirable that the output unit is provided in such a positional relationship that the notification content reaches the driver from a specific area corresponding to the output unit.

  Further, in the above embodiment, in s116 and s118 in FIG. 2, it is determined not to notify the specific area that is determined that the object is not passing and is determined to be confirmed by the driver. What was comprised was illustrated. However, here, it may be configured not to notify the specific area that is determined that the object is not passing and that is determined not to be confirmed by the driver. Specifically, when the correspondence relationship of FIG. 4 is “no object passage to the left” and “Chk (left) = 0”, “the object passage to the left” and “Chk (left) = 1” When “No object passing to the right” and “Chk (right) = 0”, and “There is an object passing to the right” and “Chk (right) = 1”, no notification is made. (In these cases, “no left notification” and “no right notification”) may be used.

  Moreover, in the said embodiment, what was comprised so that the alerting | reporting content about each specific area might be determined with reference to a data table based on a traffic state and the variable Chk in s116 of FIG. However, in s116, the confirmation state of the driver may be determined in advance, and the notification content may be determined based on the determination result.

For this purpose, for example, the notification process of FIG. 2 may be configured as follows.
Specifically, as shown in FIG. 7, after completing s102 to s108 in FIG. 2, the confirmation state of the specific area of the driver at this time point is determined based on each return value obtained in s108. (S110). Here, by updating the “main confirmation state data” based on each return value obtained in s108, the state indicated by the updated data is the confirmation state of the specific area of the driver at that time. Determined.

  The “main confirmation state data” is prepared as data indicating a state such as whether or not the driver has confirmed all the specific areas. Here, as described above, the case where the specific area is the two areas of the left front and the right front will be described as an example. This “main confirmation state data” is represented by the state transition diagram shown in FIG. The transition from the initial state of “Unconfirmed” to the state of “Confirmed only on left”, “Confirmed only on right”, or “Confirmed all” as shown below It becomes.

  Specifically, for example, in the initial state indicating “unconfirmed”, the return value of the state determination process for the left front specific region indicates confirmed (Chk (left) = 1), and the right front If the return value of the state determination process for the specific area indicates unconfirmed (Chk (right) = 0), the main confirmation state data is updated to a state indicating “confirmed only on left” (see arrow a in FIG. 8). ). Similarly, when the return value for the left front specific area indicates unconfirmed (Chk (left) = 0) and the return value for the right front specific area indicates confirmed (Chk (right) = 1), the main The confirmation state data is updated to a state indicating “only right confirmed” (see arrow b in FIG. 8).

  In this way, in the state of “confirmed only on the left” or “confirmed only on the right”, if the return values for the confirmed specific region and the unconfirmed specific region indicate confirmed (Chk (left ) = 1, Chk (right) = 1), the main confirmation state data is updated to a state indicating “all confirmed” (see arrows c and d in FIG. 8). On the other hand, if the return values for the confirmed specific area and the unidentified specific area indicate unconfirmed (Chk (left) = 0, Chk (right) = 0), the main confirmation state data is “unconfirmed”. (See arrows e and f in FIG. 8).

  If the return value for one specific area indicates confirmed and the return value for the other specific area indicates unconfirmed in the state of “all confirmed” (Chk (left) = 1, Chk). (Right) = 0, or Chk (left) = 0, Chk (right) = 1), and the main confirmation state data is updated to a state indicating “confirmed only on the left” or “confirmed only on the right” (FIG. 8 arrows g and h).

  If the return values for both specific areas indicate “unconfirmed” in the state of “all confirmed” (Chk (left) = 0, Chk (right) = 0), the main confirmation state data is “unconfirmed”. Is updated to a state indicating "(see arrow i in FIG. 8).

  Next, if “YES” is determined in s112, the notification content is determined by the notification unit 24 based on the determination result in s110 (s116). Here, if the determination result of s110, that is, the state indicated by "main confirmation state data" is "unconfirmed", a message indicating that confirmation for all specific areas has not been performed is determined as the notification content. The In addition, if “only left confirmed” or “right confirmed only”, a message indicating that confirmation of a specific area other than the confirmed specific area has not been confirmed is determined as the notification content. . If a parameter indicating “all confirmed” is obtained, it is determined that the notification content is not notified.

And after the alerting | reporting part 24 performs alerting | reporting based on the alerting | reporting content determined in s116 (s118), this alerting | reporting process is complete | finished. Here, the navigation unit 200 is instructed by the control unit 2 to output the notification content (message) determined in s116, and the navigation device 200 that has received this command displays the notification content on the display unit. Notification is realized by outputting from the speaker.
(5) Correspondence with the Present Invention In the embodiment described above, s112 in FIG. 2 is a situation detection means in the present invention, s108 and s110 are confirmation determination means in the present invention, and s114 and 106 in the same figure. S116 and s118 are notification means according to the present invention, s102 is an intersection determination means according to the present invention, and s104 is a line-of-sight detection means according to the present invention.

Block diagram showing the overall structure of the notification device Flow chart showing notification processing Control block diagram for realizing notification processing in the control unit Data table showing correspondence between traffic status and confirmation status and notification content Flow chart showing state determination processing State transition diagram showing the transition state of the sub confirmation state data The flowchart which shows the alerting | reporting process in another embodiment. State transition diagram showing the transition state of the main confirmation state data

Explanation of symbols

  DESCRIPTION OF SYMBOLS 1 ... Notification apparatus, 2 ... Control part, 3 ... Memory, 12 ... Situation detection part, 14 ... Intersection determination part, 16 ... Eye-gaze detection part, 18 ... Traffic detection part, 22 ... Confirmation state determination part, 24 ... Notification part.

Claims (7)

An informing device for informing a driver who drives the vehicle in a state mounted on the vehicle,
Status detection means for detecting the driving status of the vehicle by the driver;
Confirmation determination means for determining whether or not the driver has confirmed each of one or more specific areas around the vehicle before the situation detection means detects that the vehicle has started driving.
A passage determining means for determining whether or not an object is passing through each of the specific areas at the time when the situation detecting means detects that the vehicle has started driving;
A notification means for performing notification according to a determination result of the confirmation determination means and the traffic determination means,
The notification means is a specification in which it is determined that the object is passing by the traffic determination means and the driver is not confirmed by the confirmation determination means in one or more of the specific areas. When the area exists, a warning is given to warn the driver that it is dangerous.
The notifying means determines that the object is passing by the passage determining means in one or more of the specific areas, and the specific area determined by the confirmation determining means is confirmed by the driver. Is present, or there is a specific area in which it is determined that the object is not passing by the passage determination means and the driver is not confirmed by the confirmation determination means. in the case, we have line a notification for attention to the driver,
further,
The confirmation determination unit is configured to determine whether the object is detected by the traffic determination unit for the specific area that has been previously determined to be confirmed by the driver before the situation detection unit detects that the vehicle has started driving. When it determines with passing , the alerting | reporting apparatus characterized by determining with the specific area | region which the driver has not confirmed the specific area | region being characterized. The notifying unit is configured to determine, among the one or more specific regions, the specific region that is determined that the object is not passing by the passage determining unit and that the driver has confirmed by the confirmation determining unit. The notification device according to claim 1, wherein the notification is not performed. In the case where an output unit that outputs the notification content by the notification means is provided at a position corresponding to each of the specific areas in the vehicle,
The notification means performs notification according to the determination result by the confirmation determination means and the traffic determination means for each of the one or more specific areas by an output unit provided at a position corresponding to the specific area. The notification device according to claim 1 or 2 . Via communication with another device capable of communicating with the notification device, comprising an intersection determination means for determining whether or not the vehicle has reached a position within a predetermined range from the intersection,
The confirmation determination means is operated when it is determined by the intersection determination means that the vehicle has reached a position within the predetermined range, and when the situation detection means detects that the vehicle is in a driving situation. Determine whether the person has confirmed each of one or more specific areas around the vehicle,
The traffic determination means is determined to have reached the position within the predetermined range by the intersection determination means, and when it is detected that the driving condition for starting the vehicle is detected by the situation detection means, notifying apparatus according to any one of claims 1 to 3, wherein the determining whether an object in each specific area are passing. Provided with a line-of-sight detection means for detecting a direction in which the driver is directing the line of sight,
The confirmation determination unit detects that the driver's line of sight has been directed by the line-of-sight detection unit for a predetermined time or more after the situation detection unit detects that the vehicle is in a driving situation where the vehicle is stopped. The notification device according to any one of claims 1 to 4 , wherein the determined specific region is determined to be a specific region confirmed by a driver. The confirmation determination means, when it is determined that the object is passing by the passage determination means for a specific area where the driver's line of sight is detected by the line-of-sight detection means, And determining that the specific area has been confirmed by the driver when it is detected that the driver's line of sight has been directed to the specific area for a predetermined time or more from 5. The notification device according to 5 . The program for making a computer system perform the various process procedures for functioning as all means with which the alerting | reporting apparatus in any one of Claim 1 to 6 is provided.

Images