JP2007233477A - Alarm device for vehicle - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an alarm device for a vehicle, capable of appropriately giving an alarm for a driver's looking aside driving while considering the significance of a detection result of the driver's looking aside. <P>SOLUTION: This alarm device for vehicle 1 includes an inattention degree detection means for detecting the degree of the driver's looking aside, and gives an alarm based on the degree of the driver's looking aside detected by the looking aside degree detection means. This device further includes a criterion setting means 20 for setting a criterion for whether to give an alarm or not based on the significance of the detection result by the looking aside degree detection means, and performs the alarming according to the criterion set by the setting means 20. <P>COPYRIGHT: (C)2007,JPO&INPIT

Description

  The present invention relates to an alarm device for a vehicle, and in particular, includes an armpit degree detection means for detecting the degree of a driver's side effect, and issues an alarm based on the degree of the driver's armpit detected by the armpit degree detection means. The present invention relates to a vehicle alarm device.

Conventionally, as this type of vehicle alarm device, the driver's driving concentration degree is determined based on the direction of the driver's line of sight imaged by the imaging device and the operation status of various switches provided in the vehicle, A device that outputs a steering assist force based on the determination result is known (for example, see Patent Document 1).
JP 2000-211153 A

  However, the above-described conventional apparatus does not consider the significance of the image captured by the imaging device. For example, the case where the reliability of the captured image is lowered due to the light receiving condition of the imaging device is not considered. In addition, since the time when the driver's line of sight is not facing the front is not taken into consideration, control is performed even for a short look aside, and annoyance may occur.

  The present invention is for solving such a problem, and it is for a vehicle capable of appropriately warning a driver's looking aside while considering the significance of the result of detecting the driver's looking aside. The main purpose is to provide an alarm device.

  One aspect of the present invention for achieving the above object is provided with a side-by-side detection means for detecting the degree of a driver's side-by-side, and issues an alarm based on the degree of the driver's side-by-side detected by the side-by-side detection unit. The vehicle warning device comprises a determination criterion setting means for setting a determination criterion as to whether or not to perform an alarm based on the significance of the detection result by the side-arm detection means, and is set by the determination criterion setting means It is characterized in that an alarm is issued in accordance with the determined criteria. Here, the degree of looking aside is a means for detecting a driver's looking aside using, for example, a camera or the like.

  According to this aspect of the present invention, since the judgment criterion for determining whether or not to perform the alarm is set based on the significance of the detection result by the degree of detection of the aside, the driver's aside A warning can be appropriately given to the driver's aside while taking into account the significance of the detection result.

  In the aspect of the present invention, the determination criterion setting unit may set, for example, as a determination criterion that the driver's degree of looking aside detected by the degree of looking aside is equal to or greater than a predetermined level. Alternatively, it may be set as a determination criterion that the state in which the driver's degree of looking aside detected by the degree of looking aside is equal to or greater than a predetermined level continues for a predetermined time or longer.

  Moreover, in this aspect of the present invention, the degree of looking aside includes, for example, an imaging unit that images at least the driver's head, and the driver's face recognized based on image data from the imaging unit. The angle of the direction from the reference direction may be detected as the degree of the driver's side look, or it becomes a reference for the direction of the driver's line of sight recognized based on the image data from the imaging means. It is good also as what detects the angle from direction as a driver | operator's side look degree.

  In the aspect of the present invention, preferably, the apparatus further includes a light reception amount detection unit that detects a light reception amount of the imaging unit, and the determination reference setting unit has a predetermined value of the light reception amount of the imaging unit detected by the light reception amount detection unit. In the case described above, the determination criterion is set so that an alarm is difficult to be issued.

  In the aspect of the present invention, preferably, the apparatus further includes a light reception amount detection unit that detects a light reception amount of the imaging unit, and the determination reference setting unit is a change amount of the light reception amount of the imaging unit detected by the light reception amount detection unit. When is equal to or greater than a predetermined value, a determination criterion is set so that an alarm is difficult to be issued. In this case, the amount of change in the amount of light received by the imaging unit may be, for example, the amount of change within a predetermined time, or may be the amount of change in one routine or several routines of the repeated processing flow.

  In one aspect of the present invention, the determination criterion setting means sets the determination criterion so that an alarm is easily generated when an operation is performed on a predetermined non-driving device that performs an operation other than driving the vehicle. It may be set. In this case, the predetermined non-drive device includes, for example, any of an air conditioner, a navigation device, and a driving seat position adjusting mechanism.

  ADVANTAGE OF THE INVENTION According to this invention, the warning device for vehicles which can perform a warning appropriately with respect to a driver's side aside can be provided, considering the significance of the result of having detected the driver's side aside.

  Hereinafter, the best mode for carrying out the present invention will be described with reference to the accompanying drawings.

  Hereinafter, an embodiment of an alarm device for a vehicle according to the present invention will be described with reference to FIGS. FIG. 1 is a diagram illustrating an example of the overall configuration of an alarm device 1 according to an embodiment of the present invention. As shown in the figure, an alarm device 1 is a device mounted on a vehicle. As main components, the alarm device 1 includes a camera 10, a camera electronic control unit (hereinafter referred to as a camera ECU) 12, and an alarm device electronic control unit. (Hereinafter referred to as an alarm device ECU) 20 and a navigation device 30.

  The camera 10 is, for example, a CCD camera attached to the upper part of the inner mirror in the passenger compartment, and the imaging angle is set so as to image the driver's head. The image captured by the camera 10 is transmitted to the camera ECU 12 that is communicably connected to the camera 10.

  The camera ECU 12 is a computer centered on a CPU, for example, and includes storage means such as a ROM and a RAM. The camera ECU 12 performs binarization processing and feature point extraction processing based on the video signal transmitted from the camera 10 to extract an image showing the driver's face, and based on the extracted image, the face orientation is extracted. The angle θ is detected. As a specific method for detecting the face orientation angle θ, for example, when only the horizontal angle is detected, the driver's face width and face center line are detected from the extracted image, and the left and right sides of the face on the image are detected. An interval ratio is calculated, and a face orientation angle θ from the front direction (vehicle traveling direction) may be detected from the left / right interval ratio. Further, the angle in the vertical direction may be detected by another method and taken into account.

  Further, the camera ECU 12 detects the average luminance L of the image transmitted from the camera 10 at predetermined intervals (for example, 0 comma [sec], etc.), for example, by calculating the average luminance in each pixel. .

  Information on the vehicle driver's face orientation angle θ and luminance average L detected by the camera ECU 12 is transmitted to the alarm device ECU 20, which is communicably connected to the camera ECU 12. The camera ECU 12 performs image processing by transmitting images from a camera for a blind corner monitor disposed at the front end of the vehicle and a camera for a back guide monitor disposed at the rear end of the vehicle. It may be shared with the ECU.

  The alarm device ECU 20 is, for example, a computer centered on a CPU, and includes storage means such as a ROM and a RAM. The alarm device ECU 20 determines whether or not to issue a warning to the driver based on the information on the face orientation angle θ and the luminance average L transmitted from the camera ECU 12, and instructs the navigation device 30 to issue the alarm. Do. Specifically, when the state in which the face orientation angle θ (whether positive or negative) exceeds the threshold θ1 continues for a predetermined time T1 or longer, it is determined that a side look has been detected, and a warning is given to the driver. The threshold value θ1 and the predetermined time T1 are pre-stored in the ROM by a characteristic process described later, and the luminance average L (and its change amount) and a predetermined non-operation for performing an operation other than driving the vehicle. It is changed based on whether or not an operation has been performed on the driving device. It should be noted that various electronic components (various sensors and other ECUs) in the vehicle are communicably connected to the alarm device ECU 20. In particular, in the case of the present embodiment, an ECU for controlling the air conditioner is connected.

  The navigation device 30 includes, for example, a position detection unit configured by a GPS antenna, a vehicle speed sensor, and the like to detect the azimuth and current position of the host vehicle, and map data on a storage medium such as a hard disk, a DVD, or a CD-ROM. The vehicle includes a map database, a display unit 32 such as a liquid crystal display that outputs a map display and route guidance display by video, an audio input / output unit 34 including a speaker, and an operation unit 36 such as a touch panel serving as a user interface. The azimuth and current position are displayed and voice-guided to the occupant along with the map information.

  The communication between the camera 10 and the camera ECU 12, the camera 12 and the alarm device ECU 20, the alarm device ECU 20 and the navigation device, and the alarm device ECU 20 and the electronic components included in the vehicle is an appropriate serial such as a CAN (Controller Area Network). This is done using a communication protocol.

  Hereinafter, an operation when the alarm device 1 performs an alarm will be described. FIG. 2 is a flowchart showing a flow of characteristic processing executed by the CPU of the alarm device ECU 20. This flow is repeatedly executed by the CPU of the alarm device ECU 20.

  First, the alarm device ECU 20 inputs the face angle θ and the luminance average L from the camera ECU 12, and executes a process of reading the threshold θ1 and the predetermined time T1 from the ROM (S100). Here, the threshold value θ1 may be arbitrarily determined within a range of, for example, about 5 to 60 [degrees], preferably about 10 to 40 [degrees], and more preferably about 15 to 20 [degrees]. The time T1 is, for example, about several [sec] to about ten [sec].

  Next, it is determined whether the input luminance average L is greater than or equal to the threshold L1 (S110). When the luminance average L is equal to or greater than the threshold L1, the threshold θ1 and the predetermined time T1 are reset to θ1h and T1h, which are larger values than the threshold θ1 and the predetermined time T1, respectively (S130). Here, T1h is, for example, about ten [sec] to several tens [sec] and is longer than the predetermined time T1. The significance of the threshold value L1 will be described later.

  This series of processing (S110, S130) makes it difficult to issue an alarm. This is because, for example, in a situation where the amount of light received by the camera 10 is large, such as a day when the sunlight is very strong, the reliability of the binarization process and the feature point extraction process performed by the camera ECU 12 described above decreases, and the image from the camera 10 This is based on the fact that the significance of detecting the driver's looking aside using the vehicle may be impaired. In such a case, since there is a relatively high possibility of erroneous detection of the driver's side look, the driver is prevented from feeling bothersome by making it difficult to issue an alarm. Note that the threshold value L1 can be obtained and determined by experiment or the like so that the reliability of the binarization process and the feature point extraction process by the camera ECU 12 is reduced.

  When the input luminance average L is less than the threshold L1, it is determined whether or not the amount of change in the luminance average L is equal to or greater than the threshold L2 (S120). Even when the amount of change in the luminance average L is equal to or greater than the threshold L2, the threshold θ1 and the predetermined time T1 are reset to θ1h and T1h, which are larger values than the threshold θ1 and the predetermined time T1, respectively (S130). . Here, the amount of change in the luminance average L may be stored in the RAM when the previous flow is executed, and may be compared with the current value or may be compared with the value before several flows. . Further, a comparison time (for example, 0 comma number [sec] to several [sec]) may be set in advance and compared with a value before the comparison time.

  This series of processing (S120, S130) makes it difficult to issue an alarm. For example, even when the amount of change in the amount of light received by the camera 10 is large, such as when passing through a tunnel or when a headlight of an oncoming vehicle is illuminated, the reliability of binarization processing and feature point extraction processing by the camera ECU 12 is high. This is because there is a case in which the significance of detecting the driver's side look using the image from the camera 10 is impaired. As with the threshold value L1, the threshold value L2 can be obtained and determined by an experiment or the like to determine the amount of change in luminance average that reduces the reliability of binarization processing, feature point extraction processing, and the like performed by the camera ECU 12.

  On the other hand, when the input luminance average L is less than the threshold value L1 and the change amount of the luminance average L is less than the threshold value L2, an operation on a predetermined non-driving device that performs an operation other than driving the vehicle is performed. It is determined whether or not it has been made (S140). Here, the predetermined non-drive device is, for example, an air conditioner, a navigation device 30, a driving seat position adjusting mechanism, or the like. When an operation is performed on a predetermined non-drive device, the threshold θ1 and the predetermined time T1 are changed to θ1l and T1l, which are smaller values than the threshold θ1 and the time T1, respectively (S150). Here, T1h is, for example, about 0 comma number [sec] to about several tens [sec] and shorter than the predetermined time T1.

  This series of processing (S140, S150) makes it easy to issue an alarm. This means that if it is detected that the driver is operating a predetermined non-driving device, the driver's look-aside is determined based on the face orientation angle θ and the luminance average L information transmitted from the camera ECU 12. It is based on the fact that the significance of judging that it has been detected increases. In such a case, by making it easy to issue an alarm, an appropriate alarm can be given to contribute to safe driving.

  When the processing of S100 to S150 is executed, it is determined whether or not the state in which the face orientation angle θ is equal to or greater than the threshold θ1 continues for a predetermined time T1 (S160). If an affirmative determination is obtained in S160, an instruction signal is transmitted to the navigation device 30 so as to issue an alarm (S170). In the navigation device 30 that has received the instruction signal, the voice input / output unit 34 warns the driver with voice. In addition, a warning screen may be displayed on the display unit 32 together with a warning by voice.

  Thus, according to the alarm device 1 according to the embodiment of the present invention, it is difficult to issue an alarm when the amount of light received by the camera 10 is large or when the amount of change in the amount of received light of the camera 10 is large. It is possible to prevent the driver from feeling annoyed by erroneously detecting the driver's side look and giving an alarm. Further, since the alarm is issued on the condition that the state where the face angle θ is equal to or greater than the threshold value θ1 has continued for a predetermined time T1, the driver is bothered because the alarm is issued for a short change in the face direction. Can be suppressed. Furthermore, when a predetermined non-driving device is operated, an alarm is easily output, which can contribute to safe driving.

  In other words, it is possible to appropriately issue an alarm for the driver's aside while considering the significance of the result of detecting the driver's aside.

  As mentioned above, although the best mode for carrying out the present invention has been described using one embodiment, the present invention is not limited to such one embodiment, and within the scope not departing from the gist of the present invention, Various modifications and substitutions can be made to the above-described embodiment.

  For example, the camera ECU 12 detects the face orientation angle θ based on the extracted image and transmits the detected face orientation angle θ to the alarm device ECU 20, but using a method such as pattern matching, the front direction of the line of sight (the progression of the vehicle) It is good also as what detects the angle from (direction) and transmits to alarm device ECU20. Alternatively, the look-aside may be detected by comprehensively determining the face orientation angle θ and the angle of the line of sight.

  Further, without considering the predetermined time T1, the determination in S160 may determine only whether or not the face orientation angle θ is equal to or greater than the threshold θ1.

  In addition, it is determined that the received light amount of the camera 10 and the change amount thereof are large using the luminance average L detected by the camera ECU 12. However, a sensor for detecting the received light amount is separately provided in the vicinity of the camera 10. Also good.

  Further, the camera ECU 12 and the alarm device ECU 20 may be integrated into either one and serve as both functions. Moreover, although the alarm is provided by the voice input / output unit 34 and the display unit 32 included in the navigation device 30, a speaker and a display device used for the alarm may be provided exclusively.

  INDUSTRIAL APPLICABILITY The present invention can be used for an apparatus that detects at least a driver's face direction or line-of-sight direction and issues a warning to the driver. The appearance, weight, size, running performance, etc. of the vehicle to be mounted are not limited.

It is a figure which shows an example of the whole structure of the alarm device 1 which concerns on one Example of this invention. It is a flowchart which shows the flow of the characteristic process which CPU of ECU20 for alarm devices which concerns on one Example of this invention performs.

Explanation of symbols

1 Alarm device 10 Camera 12 ECU for camera
20 ECU for alarm device
30 Navigation device 32 Display unit 34 Voice input / output unit 36 Operation unit

Claims (9)

A vehicular alarm device comprising a sidewatch degree detecting means for detecting a driver's degree of looking aside, and performing a warning based on the degree of a driver's sideview detected by the sidewatch degree detecting means,
A judgment criterion setting means for setting a judgment criterion as to whether or not to perform an alarm based on the significance of the detection result by the side-viewing degree detection means;
An alarm is issued according to the judgment standard set by the judgment standard setting means.
A vehicular alarm device characterized by the above. The vehicle alarm device according to claim 1,
The determination criterion setting means is a means for setting, as a determination criterion, that the driver's degree of looking aside detected by the degree of looking aside is equal to or greater than a predetermined degree.
Vehicle alarm device. The vehicle alarm device according to claim 1 or 2,
The determination criterion setting means is a means for setting, as a determination criterion, that the state where the driver's degree of looking aside detected by the degree of looking aside is equal to or higher than a predetermined level has continued for a predetermined time,
Vehicle alarm device. The vehicle alarm device according to any one of claims 1 to 3,
The armpit degree detecting means is
Having imaging means for imaging at least the driver's head;
A means for detecting the angle of the driver's face recognized based on the image data from the image pickup means from the reference direction as the degree of the driver's looking aside;
Vehicle alarm device. The vehicle alarm device according to any one of claims 1 to 3,
The armpit degree detecting means is
Having imaging means for imaging at least the driver's head;
A means for detecting the angle of the driver's line of sight recognized based on the image data from the image pickup means from the reference direction as the degree of the driver's sideways look;
Vehicle alarm device. The vehicle alarm device according to claim 4 or 5,
A received light amount detecting means for detecting the received light amount of the imaging means;
The determination criterion setting means sets the determination criterion so that an alarm is less likely to occur when the amount of light received by the imaging means detected by the light reception amount detection means is equal to or greater than a predetermined value;
Vehicle alarm device. The vehicle alarm device according to claim 4 or 5,
A received light amount detecting means for detecting the received light amount of the imaging means;
The determination criterion setting means sets the determination criterion so that an alarm is less likely to occur when the amount of change in the received light amount of the imaging means detected by the received light amount detection means is a predetermined value or more;
Vehicle alarm device. The vehicle alarm device according to any one of claims 1 to 7,
The determination criterion setting means sets the determination criterion so that an alarm is easily generated when an operation is performed on a predetermined non-driving device that performs an operation other than driving the vehicle.
Vehicle alarm device. The vehicle alarm device according to claim 8,
The predetermined non-driving device includes any of an air conditioner, a navigation device, and a driving seat position adjustment mechanism.
Vehicle alarm device.

Images