JP2014048885A - Diminished attentiveness detection system - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a diminished attentiveness detection system capable of performing an alert action when attentiveness of a driver to the driving diminishes.SOLUTION: The diminished attentiveness detection system includes: a mirror recognition frequency confirming means 11 for performing counting processing of counting the frequency of recognizing side mirrors by a driver based on the fact that the face of the driver of a vehicle is directed in the direction where the side mirrors of the vehicle are installed; attentiveness determination means 18 for determining whether the attentiveness of the driver diminishes based on the result of the counting processing of the mirror recognition frequency confirming means 11; and alert means 19 for performing an alter motion according to the fact that the attentiveness determination means 18 determines that the attentiveness of the driver diminishes.

Description

  The present invention relates to a low attention level detection system that detects a low level of attention of a driver of a vehicle.

  If the driver's attention during driving is reduced, an accident may be caused. Therefore, Patent Document 1 describes a device that performs an attention recovery operation when it is detected that the driver has entered a sleep symptom state.

JP 2010-29459 A

  The device described in Patent Document 1 detects whether or not the driver is in a non-wake state based on an electroencephalogram, a heart rate, a pulse rate, a respiratory rate, or a blink rate. That is, the driver's attention to driving can be reduced even in an awake state. And even if the driver is awake, there is a risk of causing an accident if the driver's attention is reduced. In such a case, the device described in Patent Document 1 does not perform an attention recovery operation and cannot prevent an accident from occurring.

  The present invention has been made in view of such a problem, and an object of the present invention is to detect that the attention to driving is reduced regardless of whether or not the driver is in a non-wake state. An object of the present invention is to provide a low attention level detection system.

  In order to achieve the above-described object, the attention reduction detection system according to claim 1 is configured such that the driver's face faces the direction in which a side mirror is installed in the vehicle. Based on the result of the counting process of the mirror viewing frequency confirmation unit that performs the counting process of counting the number of times the side mirror has been viewed, and whether or not the driver's attention has been reduced. It is characterized by comprising attentiveness judging means for judging.

  According to a second aspect of the present invention, there is provided the attention level reduction detection system according to the first aspect, wherein the attention level determination unit is configured to detect the driver's driver when the result of the counting process by the mirror viewing frequency confirmation unit is a predetermined value or less. It is characterized by determining that attention is reduced.

  According to a third aspect of the present invention, in the attention level reduction detection system according to the second aspect, the predetermined value is determined by the mirror viewing frequency confirmation unit within a predetermined period after the attention level determination unit starts up the attention level reduction detection system. It is a value based on the result of the counting process.

  According to a fourth aspect of the present invention, in the attention level reduction detection system according to any one of the first to third aspects, when the mirror viewing frequency confirmation means detects that the lane change is being detected by the lane change detection means. The counting process is interrupted.

  According to a fifth aspect of the present invention, in the attention reduction detection system according to the fourth aspect, the counting process includes an addition process for adding the number of times the driver has visually recognized the side mirror, and the lane change based on a result of the addition process. And a subtraction process for subtracting the value of the result of the addition process performed during a predetermined period before the detection means detects that the lane is being changed.

  According to a sixth aspect of the present invention, in the attention level reduction detection system, in any one of the first to fifth aspects, the mirror viewing frequency confirmation unit is configured such that the driver's face of the vehicle is installed and the side mirror is installed in the vehicle. When the driver is continuously facing the direction in which the vehicle is held for a predetermined time or more, the driver performs the counting process on the assumption that the driver visually recognizes the side mirror.

  According to a seventh aspect of the present invention, in the attention level reduction detection system according to any one of the first to sixth aspects, the imaging unit that captures the face of the driver of the vehicle, and the image captured by the imaging unit, Based on the face direction detecting means for recognizing the driver's face direction of the vehicle, and the direction of the driver's face recognized by the face direction detecting means, the direction of the driver's face on the horizontal plane is determined. Recognition processing for recognizing the direction in which the driver faces to view the side mirror based on the integration result of the face orientation angle analysis means that integrates for each predetermined angle range with respect to the vehicle front direction. A mirror angle setting unit that performs the mirror angle setting unit, and the mirror viewing frequency checking unit is configured to cause the driver's face to face the side mirror on the vehicle based on a result of recognition processing by the mirror angle setting unit. There has been and judging whether facing direction are provided.

  The attention level reduction detection system according to claim 8 performs a warning operation in accordance with any one of claims 1 to 7, wherein the attention level determination means determines that the driver's level of attention has decreased. An alarm means is provided.

  According to the attention reduction detection system of claim 1 of the present invention using the above means, the number of times the mirror viewing frequency confirmation means visually recognizes the side mirror based on the direction in which the face of the driver of the vehicle faces. The counting process for counting is performed, and the attention determining means is configured to determine whether or not the driver's attention has been reduced based on the result of the counting process of the mirror visual frequency confirmation means. It can be reliably detected that the driver's attention to driving is reduced regardless of whether or not the driver is in a non-wake state.

  According to the attention reduction detection system of claim 2, the attention determination means determines that the driver's attention has been reduced when the result of the counting process by the mirror viewing frequency confirmation means is equal to or less than a predetermined value. Therefore, it is possible to reliably detect that the driver's attention to driving is reduced.

  According to the attention level lowering detection system of claim 3, the predetermined value is based on a result of the counting process by the mirror visual recognition frequency checking unit within a predetermined period after the attention level determining unit starts up the attention level lowering detection system. Since it is a value, it is determined whether or not the driver's attention to driving has been reduced based on the difference in the results of the counting process performed by one driver. Without being affected by the difference, it is possible to reliably detect a decrease in attention to the driving of the one driver.

  According to the attentiveness drop detection system of claim 4, the vehicle includes lane change detection means for detecting that the vehicle is changing lanes, and the mirror visibility frequency confirmation means is being changed by the lane change detection means. Since it is configured to interrupt the counting process when it is detected, the counting process is performed except that the driver is changing the lane where the side mirror is frequently viewed, and it is affected by the lane change. Therefore, it is possible to reliably detect a decrease in attention to driving.

  According to the attentiveness reduction detection system of claim 5, the counting process is changing the lane by the lane change detecting means from the addition process for adding the number of times the driver visually recognizes the side mirror and the value of the result of the addition process. And a subtraction process that subtracts the value of the result of the addition process performed during a predetermined period before it is detected, so in the counting process, before the lane change in which the driver frequently sees the side mirror A subtraction process for excluding the period is performed, and a decrease in attention to driving can be reliably detected without being affected by the lane change.

  According to the attentiveness reduction detection system of claim 6, the mirror visual recognition frequency confirmation means is provided when the face of the driver of the vehicle is continuously facing the direction in which the side mirror is installed in the vehicle for a predetermined time or more. Since the driver is configured to perform the counting process when the driver sees the side mirror, when the driver views the side mirror, the driver performs the counting process to ensure a reduction in the driver's attention. Can be detected.

  According to the attentiveness reduction detection system of claim 7, a photographing means for photographing the face of the driver of the vehicle, and a face orientation detecting means for recognizing the orientation of the face of the driver of the vehicle based on the image taken by the photographing means And a face direction angle analyzing unit that integrates the direction in which the driver's face is directed for each predetermined angle range with respect to the vehicle front direction on the horizontal plane based on the driver's face direction recognized by the face direction detecting unit, Mirror angle setting means for performing a recognition process for recognizing a direction in which the driver faces the side mirror based on the integration result of the direction angle analysis means, and the mirror viewing frequency confirmation means is based on the mirror angle setting means. Since it is configured to determine whether the driver's face is facing the direction in which the side mirror is installed in the vehicle based on the result of the recognition process, the difference in the driver's driving posture, body shape, etc. That the direction of the difference in the side mirror from the point of view of the driver is corrected, the driver can determine whether directed toward the side mirror more precisely.

  According to the attention level reduction detection system of claim 8, since the warning level judging means includes warning means for performing a warning action in response to the judgment that the driver's attention level has fallen, the warning action of the driver Decrease in attention can be suppressed.

1 is a block diagram illustrating a schematic configuration of a low attention level detection system mounted on a vehicle as an embodiment of the present invention. It is a top view which shows the positional relationship with a driver's seat, the rear-view mirror (side mirror) outside a vehicle, and the operation panel of the audio equipment installed in the dashboard, or an air conditioner. It is a histogram which shows the example which integrated | accumulated the number of angle information input by the face direction detection means for every predetermined angle range which the said angle information shows. It is explanatory drawing which shows the frequency | count that a driver | operator's eyes | visual_axis moved exceeding the predetermined range on the horizontal surface. It is a flowchart which shows the operation | movement of the attention fall detection system of embodiment of this invention. 6 is a flowchart showing an operation of a reference value setting process (step S100) shown in FIG. It is a flowchart which shows operation | movement of the attention determination process (step S200) shown in FIG.

Hereinafter, embodiments of the present invention will be described with reference to the drawings.
FIG. 1 is a block diagram showing a schematic configuration of a low attention level detection system mounted on a vehicle as an embodiment of the present invention, which will be described with reference to FIG.

  As shown in FIG. 1, the attention reduction detection system includes a lane change detection unit 10, a mirror viewing frequency confirmation unit 11, a camera (photographing unit) 12, an illumination unit 13, a face direction detection unit 14, and a face direction angle analysis unit 15. , Mirror angle setting means 16, storage means 17, attention determining means 18, and alarm means 19.

  The lane change detection means 10 is, for example, when the direction indicator (blinker) installed in the vehicle is blinking (except during the hazard operation in which the left and right direction indicators simultaneously blink). Detect that the lane is being changed.

  The camera 12 is an infrared camera that can photograph a driver's face even when the vehicle interior is dark, such as at night or in a tunnel. And the camera 12 is installed in the position which can image | photograph a driver | operator's face, for example in the edge part of the instrument panel in which the speedometer etc. are installed.

  The illumination means 13 is, for example, an infrared LED (Light Emitting Diode) that outputs infrared rays necessary for photographing by the camera 12 according to the control of the camera 12. The illumination means 13 is installed in the position which outputs infrared rays toward the driver's face in the vicinity of the camera 12, for example.

  The face orientation detection unit 14 recognizes the direction in which the driver's face is facing based on the captured image of the driver's face taken by the camera 12. Specifically, the face direction detection means 14 recognizes the angle of the driver's face direction with respect to the front direction of the vehicle on a horizontal plane, for example, every 0.1 second by a known method, and indicates the angle of the recognition result. The angle information, which is information, is input to the face angle analysis means 15. As a known method, for example, there is a method described in Japanese Patent Application Laid-Open No. 2007-280375.

  For example, the face angle analysis unit 15 integrates the number of angle information input by the face direction detection unit 14 for each angle indicated by the angle information, thereby calculating the number of times the driver's face is turned on the front of the vehicle on the horizontal plane. Accumulate for each angle relative to the direction. The face direction angle analyzing unit 15 calculates the value of the mirror gaze number counter, which is a counter that counts the number of times the driver's face is directed to the side mirror, based on the angle information input by the face direction detecting unit 14. Integration processing is performed by counting up (addition processing in counting processing).

  The mirror angle setting means 16 performs an instruction value setting process for setting an instruction value for the direction of the right side mirror 100R and an instruction value for the direction of the left side mirror 100L based on the result of integration by the face angle analysis means 15. Do. The instruction value setting process will be described later.

  The mirror visual recognition frequency confirmation means 11 includes time information indicating the time elapsed since the start of this system and the time elapsed since the attention determination process described later is started, and the mirror gaze frequency counter value information indicating the counted value. Corresponding data are stored in the storage means 17 in a table format. Further, the mirror viewing frequency confirmation unit 11 reads out the mirror gaze number counter value information stored in a table format in association with the time information in the storage unit 17 and inputs the read information to the attention determination unit 18.

  The storage means 17 stores mirror gaze counter value information and time information for setting a reference value used for determining whether or not attention is reduced, and for determining whether or not attention is reduced. The attention level determination means 18 determines the setting of the reference value and whether or not the attention level is reduced. The warning unit 19 performs a warning operation according to the determination result of the attention level determination unit 18 and suppresses a decrease in the driver's attention level.

  FIG. 2 is a top view showing a positional relationship between a driver's seat, a rear-view mirror (simply called a side mirror), audio equipment installed on a dashboard, and an operation panel 110 of an air conditioner. Here, in order for the driver to visually recognize the rear, a rearview mirror (rear mirror) is installed in the vehicle. The rearview mirror includes a room mirror (indoor rearview mirror) that is a reflector installed in the vehicle, and a side mirror that is a reflector installed outside the vehicle so that the driver can visually recognize the rear side of the vehicle. And rear-view mirror outside the car). In the present embodiment, it is detected whether or not the attention is reduced based on the frequency with which the driver visually recognizes the side mirror. However, the frequency of viewing the rearview mirror is considered in detecting the reduction in attention. May be.

  As shown in FIG. 2, the vehicle of this example is viewed from above, that is, when the angle in the front direction of the vehicle is 0 ° from the virtual viewpoint P of the driver seated on the driver's seat on the horizontal plane. The right side mirror 100R is installed in the direction of 31 ° clockwise from the viewpoint P, and the left side mirror 100L is installed in the direction of 56 ° counterclockwise from the viewpoint P. Further, the operation panel 110 of the audio device or the air conditioner is installed in the direction of 23 ° counterclockwise from the viewpoint P.

  FIG. 3 is a histogram showing an example in which the number of angle information input by the face orientation detection unit 14 is integrated for each predetermined angle range of the angle indicated by the angle information. In the horizontal axis of FIG. 3, the angle in the clockwise direction with respect to the front direction of the vehicle from the viewpoint P is indicated by a positive value, and the angle in the counterclockwise direction is indicated by a negative value. Further, in the example shown in FIG. 3, the number of angle information (that is, the number of times the driver's face turned) n is set to a numerical value obtained by rounding the angle indicated by the angle information to the first place and dividing it by 10 °. Is accumulated.

  As shown in FIG. 3, the number of times that the driver's face turns to the direction (0 °) in front of the vehicle is the largest, and then the number of times the driver's face turns to the direction (−20 °) of the operation panel 110 of the audio equipment or air conditioner. The number of times facing the direction of the right side mirror 100R (30 °) is large, and then the number of times facing the direction of the left side mirror 100L (−60 °) is large.

  Here, an instruction value setting process in which the mirror angle setting unit 16 sets the instruction value in the direction of the right side mirror 100R and the instruction value in the direction of the left side mirror 100L will be described. The direction of the face when the driver looks at the right side mirror 100R and the direction of the face when the driver looks at the left side mirror 100L are slightly different depending on the driving posture, body shape, and the like of the driver. Therefore, the mirror angle setting means 16 is the face when the right side mirror 100R is viewed in the direction in which the number of times is the largest in the design range of 20 ° to 40 ° as a result of integration by the face direction angle analysis means 15. Set to the indicated value in the direction of. In the example shown in FIG. 3, the angle in the direction in which the number of times is the largest among 20 ° to 40 ° is 30 °. Therefore, the mirror angle setting unit 16 indicates the indication value of the face direction when viewing the right side mirror 100R. Is set to 30 °.

  Further, the mirror angle setting means 16 looks at the left side mirror 100L for the angle in the direction in which the number of times is the largest in the design range of −70 ° to −50 ° as a result of integration by the face direction angle analysis means 15. Set to the indicated value of the face direction. In the example shown in FIG. 3, the angle in the direction in which the number of times is the largest among −70 ° to −50 ° is −60 °. Therefore, the mirror angle setting unit 16 determines the direction of the face when viewing the left side mirror 100L. Is set to -60 °.

  Since the instruction value setting process as described above is performed, the direction of the right side mirror 100R and the direction of the left side mirror 100L from the viewpoint of the driver due to differences in the driver's driving posture, body shape, etc. Difference in the direction of the side mirror) is corrected, and it is possible to more accurately determine whether or not the driver has faced the direction of the side mirror.

  FIG. 4 is an explanatory diagram showing the number of times the driver's line of sight has moved beyond a predetermined range on a horizontal plane. (A) shows the case of a skilled driver, and (b) shows the case of an immature driver. Note that when the driver's line of sight faces the right side mirror 100R or the left side mirror 100L, the driver's line of sight exceeds a predetermined range (for example, a range of −40 ° to 10 °) on the horizontal plane. Move. That is, the number of times that the driver's line of sight has moved beyond a predetermined range on the horizontal plane corresponds to the number of times that the driver has visually recognized the right side mirror 100R or the left side mirror 100L.

  As shown in FIGS. 4A and 4B, the skilled driver visually recognizes the right side mirror 100R or the left side mirror 100L more than an immature driver. Therefore, it can be seen that there is an individual difference in the frequency of visually recognizing the right side mirror 100R or the left side mirror 100L depending on the skill level of driving. The inventors have found that the frequency of visually recognizing the right side mirror 100R or the left side mirror 100L tends to decrease as the driver's attention decreases.

  Therefore, in the present invention, the attention determining means 18 is within a predetermined period after the activation of the system (for example, 15 minutes after activation of the system, which may be 5 minutes, 10 minutes, 30 minutes, etc.). The frequency with which the driver who is considered to be before the attentiveness reduction visually views the right side mirror 100R or the left side mirror 100L is set as a reference value. By doing so, it is possible to set a reference value according to drivers having different driving skill levels. Then, the attention level determination means 18 determines that the attention level has decreased when the frequency with which the driver visually recognizes the right side mirror 100R or the left side mirror 100L is clearly reduced with respect to the reference value, and alarm means. 19 performs a warning action to prevent a reduction in attention.

  FIG. 5 is a flowchart showing the operation of the attention reduction detection system according to the embodiment of the present invention. As shown in FIG. 5, the attention level reduction detection system according to the embodiment of the present invention first performs a reference value setting process (step S100) for setting a reference value used for attention level determination. Note that the attention reduction detection system is activated, for example, when the vehicle speed exceeds 60 km / h, and performs the reference value setting process (step S100).

  Next, the attention level reduction detection system performs attention level determination processing (step S200) based on the reference value set in the reference value setting processing (step S100).

  When the attention level reduction detection system determines that the attention level has decreased as a result of the attention level determination process (step S200) (Yes in step S300), the warning level detection system performs a warning operation (step S400).

  The warning operation is an operation in which the warning means 19 outputs a sound to the driver, emits light, or vibrates the driver's seat to call the driver's attention. Say.

  When the end condition is satisfied (Yes in step S500), the attention reduction detection system ends the process. The end condition is assumed to be, for example, a change of the driver of the vehicle, and the vehicle speed is 0 km / h for 15 minutes or more, or a driver's break is assumed, and the vehicle engine is turned off. It has become a state.

  FIG. 6 is a flowchart showing the operation of the reference value setting process (step S100) shown in FIG. The lane change detection means 10 recognizes the lane change (step S101), and based on the recognition result, whether the lane change is in the process of step S102, is the lane change immediately after, or is not changing the lane? Determine. If the lane is being changed, the process returns to step S101. If the lane is not being changed (more specifically, if the lane is not being changed and not immediately after the lane change is completed), the process proceeds to step S103. If it is immediately after the lane change, the process proceeds to step S113. The process of step S113 will be described later.

  The lane change detection means 10 detects that the lane is being changed, for example, based on the blinking operation of the direction indicator, based on the steering pattern of the steering wheel, It is detected based on the angle of the lane ahead of the vehicle in an image taken by a photographing camera (for example, installed on a dashboard, not shown).

  Further, for example, when it is determined that the lane is being changed in the process of step S102, the lane change detecting unit 10 sets a lane changing flag that is a flag indicating that the lane is being changed. Then, for example, when the lane change flag is set and the lane change flag is set, the lane change detection means 10 determines that the lane change has just ended in the process of step S102, and the lane change is in progress. The flag is reset and the process proceeds to step S113.

  When the lane change detection means 10 determines in the process of step S102 that the lane change is neither during lane change nor immediately after the lane change, the face direction detection means 14 is based on the photographed image of the driver's face taken by the camera 12. Then, the direction in which the driver's face is facing is recognized (step S103).

  The face direction detection means 14 determines whether or not the driver's face is facing the side mirror based on the recognized direction (step S104).

  Specifically, since the above-described instruction value setting process is not performed before step S104 of the reference value setting process (step S100), the face orientation detection unit 14 has, for example, a driver face orientation of 20 °. When the driver recognizes that the angle is ˜40 ° (that is, the direction of the right side mirror 100R) or −70 ° to −50 ° (that is, the direction of the left side mirror 100L), the driver faces the direction of the side mirror. It is determined that

  When the face orientation detection unit 14 determines that the driver continues to face the side mirror (Yes in Step S104 and Yes in Step S105), the driver faces the side mirror. The timer value that counts the length of the current time is counted up (step S106), and the process proceeds to step S107. Note that the face orientation detection unit 14 specifically, in the process of step S105, for example, when the visual recognition continuation flag indicating that the driver continues to face the side mirror is not set ( In step S105, the visual continuation flag is set and the process proceeds to step S107. When the visual continuation flag is set (Yes in step S105), the process proceeds to step S106. The value is counted up (step S106), and the process proceeds to step S107. In addition, the set visual recognition continuation flag is reset by the process of step S112 mentioned later.

  If the driver continues to face the side mirror, the value of the timer is counted up until it is determined that a predetermined time has passed in the process of step S107 described later. That is, the timer that the face direction detection means 14 counts up in the process of step S106 is a timer for measuring the time during which the driver is continuously facing the side mirror.

When the face direction detection unit 14 determines that the driver is not facing the side mirror (No in Step S104), the timer value counted up in the process of Step S106 is a predetermined time t ₂ ( For example, it is determined whether or not a value corresponding to 0.5 seconds is exceeded (step S110).

Orientation detecting means 14, when the count-up value of the timer in the process of step S106 is determined not to exceed a value corresponding to t ₂ (No in step S110), and the process proceeds to step S112. Orientation detecting means 14, operation counts up the value of the timer in the process of step S106 is recognized by (Yes in step S110), the process of step S103 if it is determined to exceed the value corresponding to t ₂ Angle information indicating the direction of the person's face is input to the face direction angle analysis means 15.

  Then, the face orientation angle analysis means 15 counts up the value of the mirror gaze counter, which is a counter that counts the number of times the driver's face is directed to the right side mirror 100R and the left side mirror 100L (step) S111). Specifically, the face direction angle analyzing unit 15 rounds the number of angle information input by the face direction detecting unit 14 to the numerical value obtained by rounding the angle indicated by the angle information to the unit of 1 and dividing the number by 10 degrees. Integration is performed, and the process proceeds to step S112.

That is, when the driver turns to the side mirror for a longer time than t ₂ which is a predetermined time, the face direction detection means 14 inputs angle information to the face direction angle analysis means 15 to The angle analysis means 15 counts up the value of the mirror gaze counter. On the other hand, even if the driver turns to the side mirror for a short time equal to or less than t ₂ which is a predetermined time, the value of the mirror gaze counter is not counted up. Therefore, it is possible to appropriately count the number of times that the driver has surely viewed the side mirror.

  Then, the face direction angle analyzing means 15 resets the timer counted up in the process of step S106 in the process of step S112, resets if the visual recognition continuation flag is set, and proceeds to the process of step S107 (step S107). S112).

  Whether the mirror viewing frequency checking means 11 has passed a predetermined time (for example, 15 minutes, 5 minutes, 10 minutes, or 30 minutes), which is a predetermined period, after the activation of the system in the process of step S107. If it is determined (No in step S107) and it is determined that it has not elapsed (that is, if it is determined that it is within a predetermined period since the start of the system) (No in step S107), the system The time information indicating the time elapsed since the activation and the mirror gaze count counter value information indicating the value counted by the mirror gaze counter are associated with each other and stored in the storage unit 17 in a table format, and the process returns to step S101.

  Accordingly, the process up to this point in the reference value setting process (step S100) is repeated until a predetermined time, which is a predetermined period, has elapsed since the activation of the present system. In the process of step S111, the driver moves the side mirror. The number of times of visual recognition is counted appropriately.

  The attention determination unit 18 determines that the mirror viewing frequency confirmation unit 11 determines that a predetermined time has elapsed since the start of the present system in the process of step S107 (Yes in step S107). Then, an instruction value setting process for setting an instruction value in the direction of the right side mirror 100R and an instruction value in the direction of the left side mirror 100L is performed. The mirror angle setting unit 16 inputs instruction value information, which is information indicating the result of the instruction value setting process, to the mirror viewing frequency confirmation unit 11. As described above, in this example, the mirror angle setting unit 16 sets the instruction value of the face direction when viewing the right side mirror 100R to 30 °, and indicates the direction of the face when viewing the left side mirror 100L. Set the value to -60 °. Then, the mirror angle setting means 16 inputs instruction value information indicating these instruction values to the mirror viewing frequency confirmation means 11.

  And the mirror visual recognition frequency confirmation means 11 sets the value of the mirror gaze number counter counted up by the process of step S111 as a reference value (step S108). Specifically, the mirror viewing frequency confirmation unit 11 counts two instruction values (angles) indicated by the instruction value information input by the mirror angle setting unit 16 among the values counted by the mirror gaze number counter. The total value of is set as the reference value. In this example, the total value of the number of times corresponding to 30 ° and the number of times corresponding to −60 ° is set as the reference value among the values of the mirror gaze number counter accumulated by the face direction angle analysis means 15. By doing so, it is possible to appropriately count the number of times that the driver visually recognizes the side mirror within a predetermined period according to the driving posture, body shape, and the like of the driver.

  Then, the attention determination unit 18 resets the value of the mirror gaze counter (step S109), and ends the reference value setting process (step S100).

Note that the mirror viewing frequency checking means 11 is the latest in the mirror gaze count counter value information stored in the table format in the storage means 17 in the process of step S113 (information in the storage means 17 during lane change). Is stored, that is, the value indicated by the stored mirror gazing frequency counter value information and the mirror gazing stored immediately before the lane change t ₁ second (for example, 10 seconds) which is a predetermined period. The value of the difference from the value of the number of times of mirror counter (that is, the value of the mirror gaze number counter value information associated with the time information indicating the time corresponding to t ₁ second before the lane change) from the value of the mirror gaze number counter A gaze count correction process (subtraction process in the counting process), which is a subtraction process, is performed.

The reason for performing the gaze count correction process (step S113) will be described. When changing the lane of the vehicle, the driver watches the side mirror more times than usual before the lane change and during the lane change. Then, it is not preferable to set the number of times more than usual as the reference value of the side mirror gaze frequency and compare it with the side mirror gaze frequency in the normal driving state in the attention determination process (step S200). Therefore, the mirror viewing frequency confirmation means 11 shifts to the process of step S101 in the process of step S102 during the lane change, so the value of the mirror gaze number counter is not counted up (counting up is interrupted), and The number of times the side mirror is watched without storing information in the storage unit 17 is prevented from being used for setting the reference value. Moreover, the gaze count correction processing (step S113) performed after the lane change ends, prevents use the number of times the side mirror is gazing lane change immediately before t ₁ seconds set reference value, attention determination processing (step S200) can be performed more accurately.

  In the present embodiment, the number of times the side mirror is watched during lane change is not counted. Then, when the lane change is performed during the time from when the system is activated until the predetermined time elapses (the time until it is determined Yes in the process of step S107), the lane change is not performed. Depending on the case, there is a difference in the period in which the number of times the side mirror is watched is counted. Specifically, for example, when the predetermined time is 5 minutes, the number of times the side mirror is watched is counted when the lane change is performed and the time required for the lane change is 1 minute. Is 4 minutes, which is different from the predetermined time of 5 minutes, which is a period in which the number of times the side mirror is watched when the lane change is not performed.

  Therefore, it is necessary to perform a process according to the time required for the lane change in the gaze number correction process (step S113). Specifically, for example, when the predetermined time is 5 minutes, the time required for the lane change after the lane change is 1 minute, and the number of times the side mirror is watched is n times, The number of times that the side mirror is watched is adjusted with x5 / 4 being the number of times that the side mirror was watched.

  Further, the time (for example, 1 minute) required for the lane change when the lane change is performed is the time used for the determination of the process in step S107 (the time from when the system is started until the predetermined time elapses). For example, it may be added to 5 minutes (that is, the period in which the number of times the side mirror is watched is counted may be 6 minutes obtained by adding 1 minute to 5 minutes).

  FIG. 7 is a flowchart showing the operation of the attention determination process (step S200) shown in FIG. 7 is different from the reference value setting process (step S100) shown in FIG. 6 and the process corresponding to step S108 (step S208). Regarding the other processes, processes different from the processes in the reference value setting process (step S100) will be described in detail, and descriptions of common processes will be omitted.

  Since the processes of steps S201 to S203 and S213 in the attention determination process (step S200) are the same as the processes of steps S101 to S103 and S113 in the reference value setting process (step S100), the description thereof will be omitted.

  The process of step S204 in the attention determination process (step S200) is similar to the process of step S104 in the reference value setting process (step S100), based on the direction recognized by the face orientation detection unit 14, based on the driver's face. It is determined whether or not is directed to the side mirror. In the process of step S204 in the attention level determination process (step S200), since the instruction value setting process described above is performed, it is confirmed that the driver's face turned to the instruction value set in the instruction value setting process. When it is recognized (specifically, in this example, when the recognized driver's face angle is rounded off to the first place to be -60 ° or 30 °), the driver's face indicates the direction of the side mirror. Judged to be suitable.

  The processes in steps S205, S206, and S210 in the attention determination process (step S200) are the same as the processes in steps S105, S106, and S110 in the reference value setting process (step S100), and thus description thereof is omitted.

  Unlike the process of step S111 in the reference value setting process (step S100), the process of step S211 in the attention determination process (step S200) is performed by the face direction angle analysis unit 15 simply receiving the angle input by the face direction detection unit 14. The number of information may be integrated, and the angle indicated by the angle information need not be integrated for each numerical value that is rounded to the first place and divided in units of 10 °. The processing in step S111 in which the angle indicated by the angle information is rounded to the first decimal place and integrated for each numerical value divided in units of 10 ° is performed for the instruction value setting process, and is executed after the instruction value setting process. This is because it is not necessary to perform such processing in the attention determination processing (step S200). Even in such a configuration, the number of times that the driver has surely viewed the side mirror in the process of step S211 until the unit time, which is a predetermined period, has elapsed after the attention determination process (step S200) is started. Is counted appropriately.

  Since the processes of steps S212 and S207 in the attention determination process (step S200) are the same as the processes of steps S112 and S107 in the reference value setting process (step S100), the description thereof is omitted. Note that in the process of step S207, a unit time that is a predetermined period after the attention determination process (step S200) is started (the same time as the predetermined time used for the determination in the process of step S107. Specifically, For example, it is determined whether or not 15 minutes, 5 minutes, 10 minutes, or 30 minutes have elapsed, and when it is determined that it has not elapsed (No in step S207), the mirror viewing frequency confirmation unit 11 The storage means 17 stores the time information indicating the time elapsed since the attention determination process (step S200) is started and the mirror gaze count counter value information indicating the value counted by the mirror gaze count counter in association with each other in a table format. And return to the process of step S201.

  The attention level determination means 18 is the process of step S208 in the attention level determination process (step S200), and the value of the mirror gaze number counter counted by the face direction angle analysis means 15 in the process of step S211 and the reference value setting described above. In step S208, attention is determined by comparing with a predetermined value based on the reference value set in step S108 in step S100. Specifically, the attention level determination unit 18 determines that the level of attention level has decreased when, for example, the value of the mirror gaze counter is equal to or less than a predetermined value that is half the reference value. Then, the attention level determination unit 18 resets the value of the mirror gaze number counter (step S209), and ends the attention level determination process (step S200).

  According to the present embodiment, the mirror viewing frequency confirmation means 11 performs the counting process for counting the number of times the driver visually recognizes the side mirror based on the direction in which the driver's face of the vehicle is facing, and the attention determination means. 18 is configured to determine whether or not the driver's attention has been reduced based on the result of the counting process performed by the mirror viewing frequency confirmation unit 11, so whether or not the driver is in a non-wake state. Regardless of this, a decrease in the driver's attention can be detected well.

  Further, the attention level determination means 18 determines that the driver's attention level has decreased when the result of the counting process performed by the mirror viewing frequency confirmation means 11 is less than half of the reference value. It is possible to reliably detect that the attention of the user is reduced and the frequency of viewing the side mirror is clearly reduced.

  The reference value is a value based on the result of the counting process performed by the mirror viewing frequency confirmation unit 11 within a predetermined period after the attention level determination unit 18 starts up the attention level reduction detection system. Since it is determined whether or not the driver's attention to driving has been reduced based on the difference in processing results, the driver's attention to driving is reduced without being affected by individual differences such as the driver's skill level. Can be reliably detected.

  Further, when the lane change detection means 10 detects that the vehicle is changing lanes, and the mirror visibility frequency confirmation means 11 detects that the lane change detection means 11 is changing lanes, the counting process is performed. Therefore, the counting process is performed except when the driver changes the lane where the driver frequently looks at the side mirror, and the attention to driving is not affected by the lane change. Can be reliably detected.

  The counting process is an addition process for adding the number of times the driver has viewed the side mirror, and a predetermined period before the lane change detection means 10 detects that the lane change is detected from the value of the addition process. The subtraction process that subtracts the value of the result of the addition process performed in the subtracting process is performed, and the subtraction process that excludes the period before the lane change in which the driver frequently visually recognizes the side mirror is performed in the counting process. It is possible to reliably detect a decrease in driving attention without being affected by having performed.

  The mirror viewing frequency confirmation means 11 counts the driver's face as if the driver has viewed the side mirror when the face of the vehicle is continuously facing the direction in which the side mirror is installed in the vehicle for a predetermined time or more. Therefore, when the driver visually recognizes the side mirror, it is possible to reliably perform the counting process and reliably detect a reduction in the driver's attention.

  A camera 12 that captures the face of the driver of the vehicle, a face direction detection means 14 that recognizes the face direction of the driver of the vehicle based on the image captured by the camera 12, and a driver that is recognized by the face direction detection means 14 Based on the face orientation angle analysis means 15 for integrating the direction in which the driver's face is directed for each predetermined angle range with respect to the vehicle front direction on the horizontal plane, and the result of the integration of the face orientation angle analysis means 15 And a mirror angle setting unit 16 that performs a recognition process for recognizing a direction in which the driver faces the side mirror, and the mirror viewing frequency confirmation unit 11 is based on the result of the recognition process by the mirror angle setting unit 16. Therefore, it is determined whether the driver's face is facing the direction in which the side mirror is installed on the vehicle. Who corrects the direction of the difference in the side mirror from the viewpoint, the driver can determine whether directed toward the side mirror more precisely.

  Since the alarm means 19 is configured to perform a warning operation in response to the determination that the attention determination means 18 determines that the driver's attention has decreased, a warning operation is performed when the attention to driving decreases. And a reduction in the driver's attention can be satisfactorily suppressed.

  The present invention can be applied to a vehicle such as a passenger car or a cargo vehicle, and the cargo vehicle uses an inner rear view mirror that is a rearview mirror installed in the vehicle by loading or mounting a cargo on a cargo bed. In many cases, it is necessary to move the face direction relatively large in order for the driver to visually recognize the outer rear view mirror (side mirror) which is a rearview mirror installed outside the vehicle. Therefore, if the present invention is applied to a truck, it can be surely recognized whether or not the driver has visually recognized the side mirror. Therefore, the present invention is not limited to the application to the truck, but the application to the truck is more effective.

DESCRIPTION OF SYMBOLS 10 Lane change detection means 11 Mirror visual recognition frequency confirmation means 12 Camera 13 Illumination means 14 Face direction detection means 15 Face direction angle analysis means 16 Mirror angle setting means 17 Storage means 18 Attention force determination means 19 Alarm means

Claims (8)

Mirror viewing frequency confirmation means for performing a counting process for counting the number of times the driver visually recognizes the side mirror based on the face of the driver of the vehicle facing the direction in which the side mirror is installed in the vehicle; ,
Attention level reduction detection system, comprising: attentiveness determination means for determining whether or not the driver's attention level has decreased based on the result of the counting process of the mirror visual recognition frequency confirmation unit. The attention level determination unit determines that the driver's attention level has decreased when the result of the counting process performed by the mirror viewing frequency verification unit is equal to or less than a predetermined value. Degree of attention detection system described in 1. The predetermined value is a value based on a result of the counting process performed by the mirror viewing frequency confirmation unit within a predetermined period after the attention level determination unit starts up the attention level reduction detection system. Item 3. The attention lowering detection system according to Item 2. Lane change detection means for detecting that the vehicle is changing lanes,
The said mirror visual recognition frequency confirmation means interrupts the said counting process, when it is detected that the said lane change detection means is changing lanes. Any one of Claims 1-3 characterized by the above-mentioned. Described low attention level detection system. The counting process includes an addition process for adding the number of times the driver has visually recognized the side mirror, and a value before the lane change detection means detects that the lane change is being detected from the value of the addition process. The attraction reduction detection system according to claim 4, further comprising: a subtraction process for subtracting a value of a result of the addition process performed during a predetermined period. The mirror viewing frequency confirmation means is configured so that when the face of the driver of the vehicle is continuously facing a direction in which the side mirror is installed in the vehicle for a predetermined time or more, the driver The attention reduction detection system according to any one of claims 1 to 5, wherein the counting process is performed as having been visually recognized. Photographing means for photographing the face of the driver of the vehicle;
Face orientation detection means for recognizing the orientation of the driver's face of the vehicle based on an image taken by the photography means;
A face angle analysis unit that integrates the direction of the driver's face recognized by the face direction detection unit for each predetermined angle range with respect to the vehicle front direction on a horizontal plane, based on the direction of the driver's face recognized by the face direction detection unit;
Mirror angle setting means for performing recognition processing for recognizing a direction in which the driver faces to view the side mirror based on the integration result of the face angle analysis means,
The mirror viewing frequency confirmation means determines whether or not the driver's face has turned in the direction in which the side mirror is installed in the vehicle, based on the result of recognition processing by the mirror angle setting means. The attention fall detection system in any one of Claims 1-6 characterized by the above-mentioned. The caution according to any one of claims 1 to 7, further comprising warning means for performing a warning action in response to the caution determining means determining that the driver's attention has been reduced. Power drop detection system.

Images