JP5082620B2 - Judgment judgment device - Google Patents

Description

  The present invention relates to an aftersight determination apparatus for determining an oversight of a driver of a vehicle.

Conventionally, a driver's face direction is detected in order to determine the driver's look-ahead state, and it is determined that the driver is looking aside if the face angle is equal to or greater than a predetermined threshold for a predetermined time. There was an aside look determination device (see, for example, Patent Document 1).
JP 2006-308375 A

  In such a conventional look-ahead determination device, the driver's face angle is determined using a uniformly determined threshold value. That is, the threshold value used for this determination is a value that is uniformly derived for an unspecified number of drivers.

  Since there are individual differences in the physique, seat position, etc. of the driver who is assumed to drive the vehicle, in the determination using the uniformly derived threshold as described above, the determination accuracy of the looking-aside state should be improved. It was difficult.

  Since human faces have individual differences in characteristics between left and right (differences in contours, eye or nose positions, etc.), the method of detecting the face orientation based on the left-right symmetry of the face using the threshold values as described above It was difficult to ensure detection accuracy.

  Further, even when such a determination method using a threshold value is applied to the detection of the line-of-sight direction, it is difficult to ensure detection accuracy because there are individual differences in eye shapes.

  SUMMARY OF THE INVENTION An object of the present invention is to provide an after-effect determination apparatus that improves determination accuracy by performing determination in consideration of individual differences such as the physique of a vehicle driver.

An aspect finding determination apparatus according to an aspect of the present invention is an aspect finding determination apparatus mounted on a vehicle including a predetermined device that is operated by a driver facing a direction having an angle with respect to the front front, and the driver's face angle. When the operation of the predetermined device is detected by the operation detection unit, the face direction detection unit detects the operation of the predetermined device. The face angle holding means for holding the face angle at the time of operation of the predetermined device as a threshold for judging the look, the driver's face angle detected by the face detecting means during driving of the vehicle, and the face angle And a residual appearance determination means for determining a driver's residual appearance based on the face orientation angle held by the holding means, the predetermined device is an electrically adjustable outer mirror, and the operation detection means The adjustment device for a dynamic adjustment type outer mirror, wherein the face angle holding means uses the face angle during operation of the right outer mirror and the face angle during operation of the left outer mirror as thresholds for determining the look-out. holding and, looking away determination means determines the face direction angle during operation of the vehicle is greater than or equal to the face direction angle is represented by a threshold of the looking away determination, and looking away in the right direction or left direction of the driver.

Another aspect determination apparatus according to another aspect of the present invention is an additional aspect determination apparatus that is mounted on a vehicle including a predetermined device that is operated by a driver facing a direction having an angle with respect to the front front direction. A face direction detecting means for detecting an angle, an operation detecting means for detecting an operation of the predetermined device by a driver, and an operation of the predetermined device detected by the operation detecting means are detected by the face direction detecting means. A face angle holding means for holding the face angle during the operation of the predetermined device as a threshold for determining a look, a driver's face angle detected by the face detection means during driving of the vehicle, and the face direction. And a residual appearance determination means for determining the residual appearance of the driver based on the face orientation angle held by the angle holding means, the predetermined device is an electrically adjustable room mirror, and the operation detection means It is an adjustment device for a dynamic adjustment type rearview mirror, wherein the face direction angle holding means holds a face direction angle at the time of operation of the electric adjustment type rearview mirror as a threshold value of the extraordinary finding determination, If the face angle during driving of the vehicle is equal to or greater than the face angle represented by the threshold value for determining the finding , the driver's upward finding is determined.

Another aspect determination apparatus according to another aspect of the present invention is an additional aspect determination apparatus that is mounted on a vehicle including a predetermined device that is operated by a driver facing a direction having an angle with respect to the front front direction. A face direction detecting means for detecting an angle, an operation detecting means for detecting an operation of the predetermined device by a driver, and an operation of the predetermined device detected by the operation detecting means are detected by the face direction detecting means. A face angle holding means for holding the face angle during the operation of the predetermined device as a threshold for determining a look, a driver's face angle detected by the face detection means during driving of the vehicle, and the face direction. And a presence determination means for determining a driver's observation based on the face orientation angle held by the angle holding means, the predetermined device has a display unit in the meter panel, and the operation detection means is the driving Is an operating device for operating the predetermined device having the display unit while visually confirming the display content of the display unit, and the face angle holding means is a face angle when operating the predetermined device having the display unit Is stored as a threshold value for determining the look-off, and the face-finding determination means displays the look-down in the driver's downward direction when the face angle during driving of the vehicle is equal to or greater than the face-direction angle represented by the threshold value for determining the look-and- find. judge.

A position detecting unit configured to detect a position of the driver's seat; and a reset unit configured to reset the setting of the predetermined device to an initial state at the time of shipment when the position detecting unit detects a change in the position of the driver's seat. The face angle holding unit may further include a face angle detected by the face direction detecting unit during the operation when an operation of a predetermined device is detected after the reset unit is reset to the initial state. You may hold | maintain as a threshold value of a finding determination .

  Further, the camera further includes a gaze direction detecting unit that detects a gaze direction of the driver, and the extraneous eye determination unit is configured to detect the face angle held by the face angle holding unit and the driving detected by the face direction detecting unit. The driver's look may be determined based on the face angle of the driver and the line-of-sight direction.

  According to the present invention, it is possible to provide a peculiar effect that it is possible to provide a look determination device that improves the determination accuracy of a look determination by using a threshold value that takes into account individual differences.

  Hereinafter, an embodiment to which the device for determining a look-out of the present invention is applied will be described.

[Embodiment 1]
FIG. 1 is a diagram illustrating a configuration of the look-ahead determination apparatus according to the first embodiment. The remainder finding determination device of the present embodiment is included in a driving support ECU (Electronic Control Unit) 10, and the decision processing for the finding is realized by the driving assistance ECU 10.

  The driving support ECU 10 is connected to an alarm device 11 that issues an alarm (alarm sound or alarm lamp lighting, etc.) with respect to the driver's extraordinary findings. When the remaining observation is determined, an alarm is issued from the alarm device 11 to the driver. The alarm device 11 is composed of, for example, a well-known buzzer or alarm light.

  In addition to the alarm device 11, a driver monitor camera 12, an outer mirror switch 13, an outer mirror ECU 14, and a seat position detection unit 15 are connected to the driving support ECU 10.

  The driving support ECU 10 and the outer mirror ECU 14 are mainly configured by a microcomputer including a CPU (Central Processing Unit), a ROM (Read Only Memory), a RAM (Random Access Memory), and the like via a bus (not shown).

  This driving assistance ECU 10 may be an ECU dedicated to the driver assistance device of the present embodiment, for example, an ECU that provides driving assistance for detecting a driver's drowsiness and issuing an alarm, or a pre-crash It may be an ECU for a safety system, and at least in the present embodiment, it may be configured so that the processes shown in FIGS. 2 and 3 can be executed. Note that the driving assistance ECU 10 has an internal memory for holding a threshold value used in a later-described finding determination process. This internal memory is constituted by the above-described RAM, for example.

  The driver monitor camera 12 is, for example, a CCD (Charge Coupled Device) camera that is disposed on a steering column in a passenger compartment and captures a driver's face image. The driving assistance ECU 10 is configured to detect the driver's face orientation by analyzing the face image taken by the driver monitor camera 12. The detection of the face orientation is performed, for example, by performing pattern recognition on the image data representing the face image, thereby representing an angle representing the face orientation from the entire contour of the driver's nose, eyes, and face (hereinafter referred to as a face orientation angle). It is realized by seeking. Here, the face angle is zero when the driver is facing the front horizontal direction, positive when the driver is facing right, and negative when the driver is facing left. Shall be represented.

  The outer mirror switch 13 is a switch for adjusting the electrically adjustable outer mirror 16. In the present embodiment, the outer mirror switch 13 includes a selection switch for selecting one of the left and right outer mirrors, and an adjustment switch for adjusting the selected outer mirror vertically and horizontally.

  The outer mirror ECU 14 is configured by an ECU for adjusting the outer mirror 16 based on a control command sent from the outer mirror switch 13.

  The seat position detection unit 15 may be configured so as to be able to detect the position of an electrically adjustable driver's seat (not shown). For example, the seat position detecting unit 15 is used for adjusting the seat position used in an ECU for an electrically adjustable driver's seat. It is configured to detect a control command.

  Next, a threshold value setting process performed by the redundant look determination apparatus according to the present embodiment will be described with reference to FIG. This process is executed by the driving assistance ECU 10.

  The driving assistance ECU 10 determines whether or not the outer mirror switch 13 has been operated (step S1). This process is repeated until the outer mirror switch 13 is operated.

  When it is determined that the outer mirror switch 13 has been operated, the driving support ECU 10 analyzes the image data obtained by the driver monitor camera 12 and derives the face angle (step S2). This determination may be realized, for example, by a process that determines that the operation of the outer mirror switch 13 has been performed when the driving support ECU 10 detects that one of the left and right outer mirrors is adjusted vertically and horizontally.

  Next, the driving assistance ECU 10 determines whether the face direction angle indicates the right direction or the left direction (step S3). Here, when the face direction is right, the face direction angle is represented by a positive value, when the face direction is left, the face direction angle is represented by a negative value, and when the face direction is front, the face direction angle is 0 degree. Therefore, the determination may be made according to whether the face angle is a positive value or a negative value.

  When the face direction angle is a positive value, the driving assistance ECU 10 stores the face direction angle in the internal memory as a threshold value for determining a look in the right direction (step S4). This is because when the driver adjusts the right outer mirror 16 by operating the outer mirror switch 13, it is considered that he is looking at the right outer mirror 16. This is because the determination accuracy of the residual finding determination is improved by holding it as a threshold value for determining the redundant residual direction.

  On the other hand, when the face angle is a negative value, the driving assistance ECU 10 stores the face angle in the internal memory as a threshold value for determining a look in the left direction (step S5). Similarly to step S4, the driver's face angle when looking at the left outer mirror 16 is held as a threshold value for determining the left look, thereby improving the determination accuracy of the look finding. is there.

  As described above, in the remainder determination apparatus according to the present embodiment, the value of the face angle when the driver of the vehicle actually adjusts the left and right outer mirrors is set as the threshold used for the determination of the left and right findings. In addition, it is possible to improve the determination accuracy in the left-right direction look determination.

  There are individual differences in the physique and seat position of the driver, and since the absolute value of the face angle differs between when the driver looks at the right outer mirror 16 and when the driver looks at the left outer mirror 16, Using the face direction when the vehicle driver adjusts the outer mirror as a threshold value in the determination process is compared to using a uniformly derived threshold value for an unspecified number of drivers, The determination accuracy in the left-right direction determination can be greatly improved.

  Here, the face angle (measured value) when the driver is looking at the left and right outer mirrors 16 has been described as it is as a threshold for determining the look-off, but the measured value is used as it is as the threshold. Instead of this, a value obtained by adding a predetermined margin (for example, 2 to 3 degrees) to the actual measurement value may be used as the threshold value.

  Next, a threshold value setting process performed by the remainder determination apparatus according to the modification of the present embodiment will be described with reference to FIG. This process is executed by the driving assistance ECU 10. Steps S12 and S14 to S17 are the same processes as steps S1 to S5 shown in FIG.

  The driving assistance ECU 10 determines whether or not the seat position detected by the seat position detection unit 15 has been changed by a predetermined ratio or more (step S10). This is a determination process that is performed based on the change rate of the distance from the zero point (backward direction) to the position where the seat position is the frontmost in the front-rear direction. For example, the predetermined ratio is set to 20%. The The determination is similarly made for the seat position in the vertical direction and the inclination angle of the seat back. The process of step S10 is repeatedly executed until it is detected that the sheet position is changed by a predetermined ratio or more.

  When it is determined that the seat position has been changed by a predetermined ratio or more, the driving assistance ECU 10 sends a control command for adjusting the position of the outer mirror 16 to the default position to the outer mirror ECU 14 (step S11). As a result, the outer mirror ECU 14 adjusts the outer mirror 16 to the default position.

  Here, the default position may be, for example, a position in an initial state at the time of factory shipment. The reason for adjusting to the default position in this way is to urge the driver to adjust by shifting from the position adjusted by the driver.

  Next, the driving assistance ECU 10 determines whether or not the outer mirror 16 has been operated (step S12). This is the same process as step S1 shown in FIG. 2, and is a process for determining based on whether or not the outer mirror switch 13 is operated. In this modification, it may be configured to wait for a predetermined time (for example, about 30 seconds) for the driver's operation.

  When it is determined that the outer mirror switch 13 is not operated, the driving assistance ECU 10 sends a control command for adjusting the position of the outer mirror 16 to the standard position to the outer mirror ECU 14 (step S13). This is because the position of the outer mirror 16 is not adjusted by the driver and remains at the default position. Therefore, by adjusting the position to the unspecified number of drivers (standard position), the vehicle can be operated. This is to ensure a rear view when it starts.

  In this case, if the face angle during the operation of the outer mirror 16 has not been detected so far, and the threshold value for determining the look-off is not stored in the internal memory of the driving support ECU 10, as in the conventional case. It may be configured such that the look-off determination is performed using a threshold value derived for an unspecified number of drivers.

  Driving assistance ECU10 will complete | finish all the processes, after finishing the process by step S3.

  Note that if the driving assistance ECU 10 determines in step S12 that the outer mirror switch 13 has been operated, the driving support ECU 10 executes the processes in steps S14 to S17 that are the same as steps S2 to S5 shown in FIG. Thereby, the process ends.

  As described above, according to the remainder determination apparatus of the modification of the present embodiment, even when the seat position is changed by a predetermined ratio or more, the driver of the vehicle is actually adjusting the left and right outer mirrors. Since the face direction angle is used as a threshold value used for the left-right direction finding determination, the determination accuracy in the left-right direction finding determination can be improved.

  Further, when the outer mirror 16 is not adjusted even though the seat position has been changed by a predetermined ratio or more, the position of the outer mirror 16 is adjusted to the default position. It is possible to obtain a threshold value for the finding determination process corresponding to the driver at the position.

  In the above description, the position of the outer mirror 16 is adjusted to the default position in order to prompt the driver to readjust when the seat position detected by the seat position detection unit 15 is changed by a predetermined ratio or more. As described above, not only the change of the seat position but also a weight sensor is provided on the driver's seat, and when the driver's weight changes by a predetermined ratio or more, a sensor for detecting the amount of withdrawal of the seat belt is provided, The configuration may be such that the position of the outer mirror 16 is adjusted to the default position when the amount of extraction changes by a predetermined ratio or more.

  Further, in the above description, the mode of performing the finding determination based on the driver's face angle obtained by analyzing the image data obtained from the driver monitor camera 12 has been described, but instead of the face angle, or the face angle In addition to this, it may be configured to perform the extraordinary finding determination using the driver's line-of-sight angle obtained by analyzing the image data (hereinafter referred to as the line-of-sight angle). For example, the line-of-sight angle is obtained by recognizing the image data of the driver's eyes, and the direction in which the driver is viewing (hereinafter referred to as the visual direction) is specified based on the obtained line-of-sight angle and face angle. Further, it may be configured such that the look-off determination is performed by comparing the viewing direction with a threshold for determination of the look-out.

  In the above, when the face direction is the right direction, the face direction angle is represented by a positive value, when the face direction is the left side, the face direction angle is represented by a negative value, and when the face direction is the front, the face direction angle is represented. Although the configuration in which the angle is set to 0 degrees has been described, the face angle when the driver is adjusting the right or left outer mirror 16 is set to 0 degrees, and the look-out determination is performed based on the 0 degrees. Also good. In this case, reference points of 0 degrees can be created on the right side and the left side, respectively. When the face direction in the front direction is set to 0 degree, the outer mirror 16 is derived in order to derive 0 degree (reference point) in the front direction based on the face direction angle when the right or left outer mirror 16 is adjusted. The error (the error between the actual angle of the outer mirror 16 and the detected face angle) is included when deriving 0 degrees in the front direction, but the right or left outer mirror If the face angle when adjusting 16 is 0 degree, such an error can be eliminated, and the determination accuracy can be further improved. In addition, when only the right or left outer mirror 16 is adjusted, it is possible to maintain good determination accuracy at least on the side where the adjustment is performed.

[Embodiment 2]
FIG. 4 is a diagram illustrating a configuration of the look-ahead determination apparatus according to the second embodiment. In the second aspect determination apparatus according to the second embodiment, the point at which the threshold value for the driver's vertical face angle is set based on the actual measurement value sets the threshold value for the left and right face angle. Different from the device.

  The remaining appearance determination device of the present embodiment is included in the driving support ECU 20, and the remaining appearance determination process is realized by the driving support ECU 20. Further, an alarm device 21 is connected to the driving support ECU 20. This alarm device 21 may be composed of the same device as the alarm device 11 of the first embodiment.

  In addition to the alarm device 21, a driver monitor camera 22, an inner mirror switch 23, an inner mirror ECU 24, and a cruise control switch 25 are connected to the driving support ECU 20.

  The driving support ECU 20 and the inner mirror ECU 24 are mainly configured by a microcomputer including a CPU, a ROM, a RAM, and the like via a bus (not shown).

  Similar to the driving support ECU 10 of the first embodiment, the driving support ECU 20 may be an ECU dedicated to the driver support device of the present embodiment. For example, the driving support ECU 20 detects a driver's sleep state and issues an alarm. It may be an ECU that performs driving support for the purpose or an ECU for a pre-crash safety system, and at least in the present embodiment, it only needs to be configured to execute the process shown in FIG. Note that the driving assistance ECU 20 has an internal memory for holding a threshold value used in a later-described finding determination process. This internal memory is constituted by the above-described RAM, for example.

  As with the driver monitor camera 12 of the first embodiment, the driver monitor camera 22 is, for example, a CCD camera that is disposed on the steering column in the passenger compartment and captures a driver's face image. The driving support ECU 20 is configured to detect the face direction in the vertical direction of the driver by analyzing the face image taken by the driver monitor camera 22. In the present embodiment, since a threshold value for performing a vertical look determination is set, the angle representing the face direction is zero when the driver is facing the front and when the driver is facing upward. It is assumed that the value is expressed as a positive value and a negative value when facing down.

  The inner mirror switch 23 is a switch for adjusting the electrically adjustable inner mirror 26. The electrically adjustable inner mirror 26 may be any one that can electrically adjust the angle in the vertical and horizontal directions via the inner mirror ECU 24, for example. The inner mirror switch 23 for adjusting the electrically adjustable inner mirror 26 only needs to include an adjustment switch for adjusting up, down, left and right, and is configured to be used also as the outer mirror switch 13 in the first embodiment. May be.

  The inner mirror ECU 24 is configured by an ECU for adjusting the inner mirror 26 based on a control command sent from the inner mirror switch 23.

  The cruise control switch 25 is disposed in a meter panel disposed above the steering column of the vehicle (that is, below the front in the driver's field of view), and displayed on a display unit disposed in the meter panel. Any switch for adjusting the set vehicle speed for cruise control may be used. Here, at least when the driver operates the cruise control switch 25, a state in which the meter panel is viewed may be generated.

  Next, threshold value setting processing by the redundant look determination apparatus according to the present embodiment will be described with reference to FIG. This process is executed by the driving support ECU 20.

  The driving assistance ECU 20 determines whether or not the inner mirror switch 23 has been operated (step S21).

  When it is determined that the inner mirror switch 23 has been operated, the driving support ECU 20 analyzes the image data obtained by the driver monitor camera 22 and derives a face angle (step S22).

  Next, the driving assistance ECU 20 stores the face direction angle in the internal memory as a threshold value for determining an extra finding in the upward direction (step S23). This is because when the driver adjusts the inner mirror 26 by operating the inner mirror switch 23, it is considered that the driver is looking at the inner mirror 26. This is because the determination accuracy of the extrasight determination is improved by holding it as a threshold for determination.

  On the other hand, if it is determined that the inner mirror switch 23 is not operated, the driving support ECU 20 advances the procedure to step S24 and determines whether or not the cruise control switch 25 is operated (step S24).

  When it is determined that the cruise control switch 25 has been operated, the driving support ECU 20 analyzes the image data obtained by the driver monitor camera 22 and derives the face angle (step S25).

  Next, the driving support ECU 20 stores the face angle in the internal memory as a threshold value for determining a look-down in the downward direction (step S26). This is because when the driver is setting the cruise control by operating the cruise control switch 25, it is considered that he is looking at the display section in the meter panel. This is because the determination accuracy of the finding of the finding is improved by holding it as a threshold for judging the finding.

  As described above, in the remainder determination device according to the present embodiment, when the driver of the vehicle actually adjusts the inner mirror or when setting the cruise control, the facial angle is determined in the vertical direction. Since it is set as the threshold value used for the above, it is possible to improve the determination accuracy in the determination of the residual findings in the vertical direction.

  Because there are individual differences in the physique and seat position of the driver, using the face orientation when the driver actually adjusts the inner mirror or cruise control as the threshold value in the judgment process is not suitable for many unspecified drivers. As compared with the case of using a uniformly derived threshold value for a person, it is possible to greatly improve the determination accuracy in the determination of the observation in the vertical direction.

  Here, a mode has been described in which the face orientation angle when the driver is looking at the inner mirror or when cruise control is set is used as a threshold for judging the look, but the measured values are used as they are as the threshold. Instead of using as a threshold value, a value obtained by adding a predetermined value to an actual measurement value may be used as a threshold value.

  The second embodiment has been described with respect to the residual determination device that sets the threshold for determination of the upward and downward direction, but when combined with the residual determination device of Embodiment 1 that sets the threshold for the determination of the residual finding in the left and right direction, It is possible to provide a device for determining the presence of observation that can set the threshold for determining the presence of the direction based on the actual measurement value of the driver. In this case, it may be configured such that the look-off determination is performed by combining the angle in the vertical direction with respect to the face direction angle when the driver is facing in the horizontal direction in front of the front and the angle in the horizontal direction. For example, the driving assistance ECU 20 detects an operation of a navigation device or an air conditioner operation panel disposed in the center of the instrument panel, analyzes image data obtained by the driver monitor camera 22, and uses the face angle at that time. Alternatively, it may be configured to perform a look-down determination in the left diagonal direction.

  As mentioned above, although the remainder determination apparatus of exemplary embodiment of this invention was demonstrated, this invention is not limited to embodiment disclosed specifically, and does not deviate from a claim. Various modifications and changes are possible.

  The redundant finding determination apparatus of the present invention can be used for a driving support apparatus for a vehicle.

1 is a diagram illustrating a configuration of a look determination device according to a first embodiment. FIG. FIG. 6 is a processing procedure diagram illustrating threshold value setting processing by the look-ahead determination apparatus according to the first embodiment. FIG. 10 is a processing procedure diagram illustrating threshold value setting processing by the remainder determination apparatus according to the modification of the first embodiment. It is a figure which shows the structure of the remainder determination apparatus of Embodiment 2. FIG. FIG. 10 is a processing procedure diagram illustrating threshold value setting processing by the look-ahead determination apparatus according to the second embodiment.

Explanation of symbols

10, 20 Driving assistance ECU
12, 22 Driver monitor camera 13 Outer mirror switch 14 Outer mirror ECU
15 Seat position detection unit 16 Outer mirror 23 Inner mirror switch 24 Inner mirror ECU
25 Cruise control switch

Claims (7)

A look determination device mounted on a vehicle provided with a predetermined device for a driver to operate in a direction having an angle with respect to the front front,
Face detection means for detecting the driver's face angle;
Operation detecting means for detecting an operation of the predetermined device by a driver;
When the operation of the predetermined device is detected by the operation detection unit, a face angle holding unit that holds a face angle at the time of operation of the predetermined device detected by the face detection unit as a threshold for determining a look-off, and a vehicle An extraordinary finding determination unit that determines an extraordinary finding of the driver based on a facial angle of the driver detected by the facial orientation detection unit during driving and a facial direction angle held by the facial angle holding unit; Including
The predetermined device is an electrically adjustable outer mirror, and the operation detecting means is an electrically adjustable outer mirror adjusting device,
The face angle holding means holds the face angle during operation of the right outer mirror and the face angle during operation of the left outer mirror as threshold values for the above-mentioned finding determination.
Looking away determination means determines the face direction angle during operation of the vehicle is greater than or equal to the face direction angle is represented by a threshold of the looking away determination, and looking away in the right direction or left direction of the driver, looking away determination device. A look determination device mounted on a vehicle provided with a predetermined device for a driver to operate in a direction having an angle with respect to the front front,
Face detection means for detecting the driver's face angle;
Operation detecting means for detecting an operation of the predetermined device by a driver;
When the operation of the predetermined device is detected by the operation detection unit, a face angle holding unit that holds a face angle at the time of operation of the predetermined device detected by the face detection unit as a threshold for determining a look-off, and a vehicle An extraordinary finding determination unit that determines an extraordinary finding of the driver based on a facial angle of the driver detected by the facial orientation detection unit during driving and a facial direction angle held by the facial angle holding unit; Including
The predetermined device is an electrically adjustable room mirror, and the operation detecting means is an electrically adjusted room mirror adjusting device,
The face angle holding means holds a face angle at the time of operation of the electrically adjustable room mirror as a threshold for determining the look-off.
The surplus finding determination means is a surplus finding determination device that determines a surplus finding in the driver's upward direction when the face orientation angle during driving of the vehicle is equal to or greater than the face orientation angle represented by the threshold value of the surrogate determination. A look determination device mounted on a vehicle provided with a predetermined device for a driver to operate in a direction having an angle with respect to the front front,
Face detection means for detecting the driver's face angle;
Operation detecting means for detecting an operation of the predetermined device by a driver;
When the operation of the predetermined device is detected by the operation detection unit, a face angle holding unit that holds a face angle at the time of operation of the predetermined device detected by the face detection unit as a threshold for determining a look-off, and a vehicle An extraordinary finding determination unit that determines an extraordinary finding of the driver based on a facial angle of the driver detected by the facial orientation detection unit during driving and a facial direction angle held by the facial angle holding unit; Including
The predetermined device has a display unit in a meter panel, and the operation detection means is an operation device for a driver to operate the predetermined device having the display unit while visually recognizing the display content of the display unit.
The face angle holding means holds a face angle at the time of operation of a predetermined device having the display unit as a threshold for determining the look-off.
The surplus finding determination means is a surplus finding determination device that determines a surplus finding in the downward direction of the driver when the face orientation angle during driving of the vehicle is equal to or greater than the face orientation angle represented by the threshold value of the surrogate determination.   A look determination device mounted on a vehicle provided with a predetermined device for a driver to operate in a direction having an angle with respect to the front front,
  Face detection means for detecting the driver's face angle;
  Operation detecting means for detecting an operation of the predetermined device by a driver;
  A face angle holding unit that holds, when the operation detection unit detects an operation of the predetermined device, a face angle detected by the face direction detection unit during operation of the predetermined device as a threshold for determining a look-off.
  A surplus determination unit that determines a driver's remark based on the driver's face angle detected by the face direction detector during driving of the vehicle and the face angle held by the face angle holding unit. When
  Including
  The predetermined device is a navigation device or an air conditioner operating device, and the operation detecting means is the navigation device or the air conditioner operating device,
  The face angle holding means holds a face angle at the time of operation of the navigation device or the operation device of the air conditioner as a threshold for determining the look-off.
  The surplus finding determination means is a surplus finding determination device that determines a surplus finding in the lower left oblique direction of the driver when the face angle during driving of the vehicle is equal to or larger than the face orientation angle represented by the threshold value of the surrogate determination. Position detection means for detecting the position of the driver's seat;
  A reset unit that resets the setting of the predetermined device to an initial state at the time of shipment when a change in the position of the driver's seat is detected by the position detection unit;
  Further comprising
  When the operation of a predetermined device is detected after the resetting means is reset to the initial state by the resetting means, the face orientation angle holding means is configured to determine the face orientation angle detected by the face orientation detecting means during the operation. The remainder determination apparatus according to any one of claims 1 to 3, which is held as a threshold value. 6. If the operation of the predetermined device is not detected after being reset to the initial state by the reset means, the setting of the predetermined device is set to a standard position different from the initial state at the time of shipment. A redundant determination device according to claim 1. Further comprising gaze direction detection means for detecting the gaze direction of the driver,
The extra appearance determination means determines the extra appearance of the driver based on the face direction angle held by the face direction angle holding means, the face direction angle of the driver detected by the face direction detection means, and the line-of-sight direction. The remainder determination apparatus according to any one of claims 1 to 5 .

Images