JP2011123653A - Test device for driver's arousal level - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a test device for a driver's arousal level which allows the driver to concentrate on driving and has high accuracy. <P>SOLUTION: The test device 2 for the arousal level includes: a driver information input unit 16; a face temperature measurement unit 8 for measuring the temperature of a facial skin in a contactless manner; a finger temperature measurement unit 10 for measuring the temperature of a finger skin; a pulse measurement unit 12 for measuring a pulse rate of the finger; a control unit 4; and a memory unit 6. The memory unit 6 stores each of threshold values for determining the temperature of the facial skin, the temperature of the finger skin, and the pulse rate. The control unit 4 determines the driver's arousal level based on data obtained from the temperature of the facial skin, the temperature of the finger skin and the pulse rate, each being measured, and each threshold value. The driver information input unit 61 is preferably equipped with a face recognition unit 63 having a camera 64 and an image processing device 66. The driver is identified based on an image data and face data obtained from the face recognition unit 63. <P>COPYRIGHT: (C)2011,JPO&INPIT

Description

  The present invention relates to an arousal level inspection apparatus that determines the arousal level of a driver such as a vehicle.

  The driver's arousal level may decrease due to poor physical condition or fatigue. A driver who has a reduced arousal level is less alert. Driving in this state is dangerous. There is an arousal level inspection device that issues a warning against a decrease in the driver's arousal level. By this arousal level inspection device, a decrease in the arousal level is determined. When the driver's arousal level decreases, the alarm device issues an alarm. A decrease in the driver's arousal level is suppressed.

  The wakefulness determination device of the wakefulness test device determines the driver's wakefulness from biological information such as the driver's body temperature, heart rate, and respiratory state. In order to measure the body temperature, heart rate, breathing state, etc., a measurement terminal is attached to the driver. Data for determining arousal level is acquired from the measurement terminal.

JP 2006-247055 A JP 2007-280 A

  In this arousal level determination device, a measurement terminal needs to be attached to the driver. The driver may feel annoying the attached measurement terminal. Such an arousal level determination device may prevent the driver from concentrating on driving.

  An object of the present invention is to provide a driver arousal level inspection device that is easy for a driver to concentrate on driving and is excellent in accuracy.

The arousal level inspection device according to the present invention includes a driver information input unit that identifies a driver, a face temperature measurement unit that measures the driver's facial skin temperature in a non-contact manner, and a finger that measures the driver's finger skin temperature. A temperature measurement unit, a pulse measurement unit that measures the pulse rate from the driver's fingers, a control device, and a storage device are provided. This storage device stores determination thresholds for facial skin temperature, finger skin temperature, and pulse rate. This control device determines the driver's arousal level from the measurement data obtained from the facial skin temperature, the finger skin temperature, and the pulse rate and the determination threshold.

  Preferably, the driver information input unit of the arousal level inspection device includes a face recognition unit having a camera and an image processing device. This face recognition unit is configured to acquire image data of the driver's face. The storage device stores facial data that identifies the driver. The control device is configured to identify the driver from the image data and the face data.

  Preferably, the facial temperature measurement unit repeatedly obtains facial skin temperature measurement data, the finger temperature measurement unit obtains finger skin temperature measurement data, and the pulse measurement unit repeatedly obtains pulse rate measurement data. The said control apparatus is updating the determination threshold value memorize | stored based on new measurement data. The control device determines the driver's arousal level using the updated determination threshold.

  Preferably, the control device of the arousal level inspection device makes a correct / incorrect determination of the arousal level. The control device is configured to correct the determination threshold when the arousal level determination is determined to be an erroneous determination.

  Preferably, the face recognition unit of this arousal level inspection device repeatedly obtains image data. The control device calculates the time when the eyes are meditated from the image data obtained repeatedly. The control device determines the driver's arousal level from the time when the eyes are meditated and the determination threshold.

  Preferably, the face temperature measuring unit of the arousal level inspection apparatus measures the skin temperature of a specific part of the driver's face.

  In the arousal level inspection apparatus according to the present invention, the face temperature is measured by a non-contact sensor. The finger temperature is measured from the finger holding the handle. The pulse is measured from the finger that holds the handle. In this arousal level inspection device, there is no need to newly install a measurement terminal which is troublesome for the driver. The arousal level is determined based on a plurality of pieces of biological information such as the face temperature, finger temperature, and pulse. In this arousal level inspection device, the arousal level is accurately determined without newly attaching a measurement terminal.

FIG. 1 is a block diagram of a wakefulness test apparatus according to an embodiment of the present invention. FIG. 2 is an external view showing a part of a passenger compartment of an automobile equipped with the arousal level inspection apparatus of FIG. FIG. 3 is a flowchart showing a processing flow of the arousal level inspection apparatus of FIG. FIG. 4 is a block diagram of a wakefulness test apparatus according to another embodiment of the present invention. FIG. 5 is an external view showing a part of a passenger compartment of an automobile equipped with the arousal level inspection apparatus of FIG. FIG. 6 is a flowchart showing a processing flow of the arousal level inspection apparatus of FIG.

  Hereinafter, the present invention will be described in detail based on preferred embodiments with appropriate reference to the drawings.

  With reference to FIGS. 1 and 2, the configuration of the driving arousal test apparatus 2 will be described. As shown in FIG. 1, the arousal test apparatus 2 includes a control device 4, a storage device 6, a face temperature measurement unit 8, a finger temperature measurement unit 10, a pulse measurement unit 12, a driver information input device 16, and an alarm device 18. And an alarm release switch (alarm release SW) 20.

  The face temperature measuring unit 8 includes a face temperature sensor 22 and a converter 24. The face temperature sensor 22 is a sensor that measures the face skin temperature of the driver in a non-contact manner. Here, this facial skin temperature is called facial temperature. The converter 24 converts the measurement signal obtained from the face temperature sensor 22 into heat distribution image data. As the face temperature measuring unit 8, for example, a thermography is used. By using thermography, a heat distribution image can be obtained by measuring the amount of infrared rays without contact. The face temperature measurement unit 8 obtains heat distribution image data as face temperature measurement data. The face temperature sensor 22 is attached to the top of the windshield 26 as shown in FIG. The attachment position of the face temperature sensor 22 may be a position where the temperature of the driver's face can be measured. The face temperature sensor 22 may be attached to the dashboard 28, the sun visor 30, or the room mirror 32.

  The finger temperature measurement unit 10 includes a finger temperature sensor 34 and a converter 36. The finger temperature sensor 10 is a sensor that measures the finger skin temperature of the driver. Here, this finger skin temperature is called finger temperature. The converter 36 converts the measurement signal obtained from the finger temperature sensor 10 into finger temperature measurement data. The finger temperature sensor 34 is exemplified by a thermistor or an infrared sensor. As shown in FIG. 2, the finger temperature sensor 34 is attached to the peripheral portion of the handle 38. The finger temperature sensor 34 is disposed at a position where the driver's fingers come in contact with the driver holding the handle 38.

  The pulse measuring unit 12 includes a pulse sensor 40 and a converter 42. The pulse sensor 40 is a sensor that measures a driver's pulse rate. The converter 42 converts the measurement signal obtained from the pulse sensor 40 into pulse rate measurement data. Examples of the pulse sensor 40 include a sensor that measures blood flow of a finger with infrared rays. As shown in FIG. 2, the pulse sensor 40 is attached to the peripheral portion of the handle 38. The pulse sensor 40 is arranged at a position where the driver's fingers come into contact with the driver holding the handle 38.

  The driver information input device 16 includes a switch 48 as an input device and a converter 50. The driver information input device 16 is a device to which driver data for specifying a driver is input. The converter 50 converts the input signal from the switch 48 into driver data. The switch 48 is arranged on the operation panel 54 as shown in FIG. The operation panel 54 is placed on the center console 52. The mounting position of the switch 48 may be at a position where the driver can easily operate. The switch 48 may be attached to the handle 38 or the dashboard 28.

  The alarm device 18 is a device that emits an alarm sound. The alarm 18 is attached to the dashboard 28. Alarm 18 may be attached to a driver's seat, console panel 52, door, or the like. An alarm light may be emitted together with or in place of the alarm sound. Moreover, in the alarm device 18 arranged on the seat, a device that generates vibration may be used.

  The alarm release switch 20 is disposed on the operation panel 54 as shown in FIG. This alarm release switch 20 is a switch for generating an alarm release signal of the alarm device 18. As with the switch 48, the alarm release switch 20 may be attached at a position where it can be easily operated by the driver. The alarm release switch 20 may be attached to the handle 38 or the dashboard 28.

  The storage device 6 stores driver data and biometric information determination threshold values corresponding to the driver data. In the storage device 6, the biological information is a face temperature, a finger temperature, and a pulse rate.

  The control device 4 includes an input unit 56, a calculation unit 58, and an output unit 60. The input unit 56 is connected to the converter 24, the converter 36, the converter 42, the converter 50, and the alarm release switch 20. The input unit 56 is connected to the calculation unit 58 and the storage device 6. The control device 4 receives data from the input unit 56.

  The computing unit 58 is connected to the storage device 6, the input unit 56, and the output unit 60. The calculation unit 58 determines the arousal level from the driver data and measurement data obtained from the input unit 56 and the determination threshold value obtained from the storage device 6. The output unit 60 is connected to the alarm device 18. The output unit 60 generates a signal that causes the alarm device 18 to generate or stop an alarm in response to the awakening level determination result of the calculation unit 58.

  The operation of the arousal level detection device 2 will be described with reference to FIG. The driver sits on the seat. The driver inputs a signal for identifying the driver from the switch 48. The driver information input device 16 converts this signal into driver data. This is the driver information input step (STEP 1) of FIG.

  The face temperature measuring unit 8 measures the driver's face temperature. The measured face temperature signal is converted into face temperature measurement data. The finger temperature measurement unit 10 measures the driver's finger temperature. The measured hand temperature signal is converted into hand temperature measurement data. The pulse measuring unit 12 measures the driver's pulse rate. The measured pulse rate is converted into pulse measurement data. In this way, measurement data of face temperature, finger temperature, and pulse rate is obtained as measurement data of biological information. This is the biological information measurement step (STEP 2) in FIG.

  Driver data and biometric information measurement data obtained in this way are transmitted to the input unit 56 of the control device 4. The input unit 56 transmits these data to the storage device 6. The storage device 6 identifies and stores these data for each driver. The calculation unit 58 extracts the determination threshold value from the storage device 6. This determination threshold corresponds to the driver data. The determination threshold value is updated from the measurement data of the biological information and the determination threshold value of the biological information. For example, the determination threshold value is updated and calculated by the moving average method in addition to the measurement data of the facial temperature calculated to the determination threshold value. The calculated new determination threshold value is stored in the storage device 6. Similarly, the determination threshold is updated from the finger temperature measurement data and the finger temperature determination threshold. The determination threshold is updated from the pulse rate measurement data and the pulse rate determination threshold. These updated determination threshold values are stored in the storage device 6 (STEP 3).

  The calculation unit 58 determines the arousal level from the measurement data of the biological information (face temperature, finger temperature, and pulse) and the determination threshold value of the biological information (face temperature, finger temperature, and pulse) (STEP 4).

  While the driver is driving, the biological information measurement step (STEP 2) to the arousal level determination step (STEP 4) are repeated at regular time intervals. The driver's arousal level is determined at regular intervals. Biometric information determination threshold data used for driver determination is updated at regular time intervals.

  When it is determined that the driver's arousal level is decreasing, the output unit 60 transmits an alarm signal to the alarm device 18. The alarm 18 issues an alarm. This is the step of the alertness reduction warning in FIG. 3 (STEP 5). This warning alerts the driver. The driver operates the alarm release switch 20. When the alarm release switch 20 is operated, the alarm of the alarm device 18 is stopped.

  When the alarm release switch 20 is operated, a release signal is transmitted to the input unit 56 of the control device 4. The calculation unit 58 measures a response time from when the output unit transmits an alarm signal until the input unit receives a release signal. If the response time is less than a predetermined determination threshold value, the calculation unit 4 determines that the arousal level determination is an error (NG). If the response time is equal to or greater than a predetermined determination threshold, it is determined that the arousal level determination is correct (OK). Thereby, the calculating part 58 judges the right / wrong of arousal level determination (STEP 6).

  If it is determined that this is correct (OK), even after the alarm device 18 is released, the awakening level is determined from the biological information measurement step (STEP 2) at regular intervals while the driver is driving. Is repeated.

  If it is determined in this correct / incorrect determination that there is an error (NG), the calculation unit 58 corrects the determination threshold value stored in the storage unit (STEP 7). Specifically, the biological information that is the main cause of the erroneous determination is specified from the measurement data of the face temperature, finger temperature, and pulse rate and the determination threshold. If the temperature is the face temperature or finger temperature, the determination threshold is increased by a certain temperature. If it is a pulse rate, the determination threshold value is lowered by a certain number. After the determination threshold is corrected in this way, the arousal level determination is repeated from the biological information measurement step (STEP 2). More specifically, the face temperature is, for example, the nose temperature.

  This arousal level inspection device 2 repeats the arousal level determination from the biological information measurement step (STEP 2) at regular intervals while the driver is driving even after the alarm device 18 is released.

  In this arousal level inspection device 2, the face temperature measurement unit 8 includes a non-contact temperature sensor. The finger temperature measurement unit 10 includes a temperature sensor that measures the temperature of the finger that holds the handle. The pulse measurement unit 12 is also provided with a pulse sensor that measures the pulse rate from the fingers that hold the handle. The driver does not need to wear a special measuring terminal. This arousal level inspection device 2 makes it easier for the driver to concentrate on driving as compared to the conventional arousal level inspection device.

  This arousal level inspection device 2 specifies a driver based on driver data. Three pieces of biological information are measured. The driver is identified, and the arousal level is determined based on the plurality of biological information of the driver. The determination accuracy of the arousal level is improved without wearing a special measurement terminal for the driver.

  The driver's biometric information changes over time due to physical condition, seasonal fluctuations, daily fluctuations, and the like. In the arousal level inspection device 2, the determination threshold value of the biological information is updated with the newly measured biological information data. By updating the determination threshold value, the determination threshold value changes corresponding to the temporal change of the biological information. In the awakening level determination device 2, erroneous determination of the awakening level due to changes over time is suppressed.

  When the arousal level inspection device 2 determines that the arousal level is erroneously determined, the determination threshold of the arousal level is corrected. In the arousal level inspection device 2, erroneous determination of the arousal level is suppressed.

  FIG. 4 shows an arousal level inspection device 62 according to another embodiment of the present invention. Here, a configuration different from the arousal level inspection apparatus 2 will be described. The description of the same configuration as the arousal level inspection device 2 is omitted.

  In this arousal level inspection device 62, the driver information input device 61 includes a face recognition unit 63. The face recognition unit 63 includes a camera 64 and an image processing device 66. The camera 64 captures the driver's face. The image processing device 66 converts the signal captured by the camera 64 into image data. As shown in FIG. 5, the camera 64 is attached to the upper portion of the windshield 26. The mounting position of the camera 64 may be a position where the driver's face can be measured, similarly to the mounting position of the face temperature sensor 22. The camera 64 may be attached to the dashboard 28, the sun visor 30, or the room mirror 32.

  As shown in FIG. 4, the input unit 56 of the control device 4 is connected to an image processing device 66. The storage device 6 stores facial data that identifies the driver.

  When the driver sits on the seat, the driver's face recognition is performed (STEP 1). The camera 64 captures the driver's face. The image processing device 66 converts a signal captured by the camera 64 into image data. This image data is transmitted to the input unit 56. The image data is transmitted to the input unit 56 of the control device 4. The calculation unit 58 extracts the face data stored in the storage device 6. The computing unit 58 compares the face data with the image data. The calculation unit 58 specifies the driver by this comparison, and the driver data is specified.

  The arousal level detection device 62 determines the driver's arousal level from the driver data and the biological information. As shown in FIG. 6, the steps other than the driver's face recognition (STEP 1) are the same as the steps of the arousal level detection device 2.

  In this arousal level inspection device 62, driver's face data is stored in the storage device 6 in advance. It is not necessary to input the driver data every time the driver sits in the driver's seat. The driver is not required to perform special operations. Misjudgment due to incorrect input of driver data is suppressed.

  In the arousal level inspection device 62, the time when the eyes are meditated may be used as the biological information. For example, the calculation unit 58 specifies the position of the pupil from the image data captured by the camera 64. Image data is captured at regular time intervals. The calculator 58 repeats the detection of the pupil position. Eyes cannot be detected when eyes are closed. The calculator 58 measures the time during which no pupil can be detected. When the time during which this pupil cannot be detected is equal to or greater than the determination threshold, the calculation unit 58 determines that the arousal level has decreased. The determination threshold is stored in advance for a certain time. This determination threshold value may be set and updated for each driver, similar to the determination threshold value of the face temperature described above.

  When the eye is meditating, the arousal level is determined in addition to the face temperature, finger temperature, and pulse rate, thereby further improving the accuracy of the arousal level determination. Further, instead of any one of the face temperature, the finger temperature, and the pulse rate, the time when the eyes are meditated may be used for the arousal level determination.

  The arousal level inspection device 62 includes the face recognition unit 63, so that the position of the driver's nose and forehead can be specified. The face temperature may be measured by specifying a plurality of parts or a part of the face, such as the nose or the forehead. By measuring the skin temperature of a specific part of the face and updating the determination threshold, the determination accuracy of the arousal level can be improved. From this point of view, as shown in FIG. 5, it is preferable that the face temperature sensor 22 and the camera 64 be arranged close to each other and be oriented in the same direction with respect to the driver's face.

  This driver alertness inspection device can be applied to driving a vehicle, maneuvering an airplane or a ship.

2, 62 ... Driver alertness inspection device 4 ... Control device 6 ... Storage device 8 ... Face temperature measurement unit 10 ... Finger temperature measurement unit 12 ... Pulse measurement unit 16, 61 ..Driver information input device 18 ... alarm 20 ... alarm release switch 22 ... facial temperature sensor 24, 36, 42, 50 ... converter 34 ... hand temperature sensor 40 ... Pulse sensor 48 ... Switch 56 ... Input unit 58 ... Calculating unit 60 ... Output unit 63 ... Face recognition unit
64... Camera 66... Image processing apparatus

Claims (6)

A driver information input unit for identifying the driver;
A face temperature measurement unit that measures the driver's face skin temperature in a non-contact manner;
A finger temperature measurement unit for measuring the finger skin temperature of the driver;
A pulse measuring unit and a control device for measuring the pulse rate from the driver's fingers;
A storage device;
With
This storage device stores facial skin temperature, finger skin temperature and pulse rate determination threshold,
An arousal level inspection device in which the control unit determines a driver's arousal level from measurement data obtained from the facial skin temperature, finger skin temperature, and pulse rate and a determination threshold value. The driver information input unit includes a face recognition unit having a camera and an image processing device,
This face recognition unit is adapted to acquire image data of the driver's face,
The storage device stores facial data that identifies the driver,
The arousal level inspection device according to claim 1, wherein the control device is configured to identify a driver from the image data and the face data. The facial temperature measurement unit has repeatedly obtained facial skin temperature measurement data, the finger temperature measurement unit has obtained finger skin temperature measurement data, and the pulse measurement unit has repeatedly obtained pulse rate measurement data,
The control device updates the determination threshold stored based on the new measurement data,
The arousal level inspection apparatus according to claim 1, wherein the control unit determines a driver's arousal level using the updated determination threshold value. This control device makes a right / wrong determination of the arousal level,
The arousal level inspection apparatus according to claim 1, wherein the control unit corrects the determination threshold when determining that the arousal level determination is an erroneous determination. The face recognition unit has repeatedly obtained image data,
5. The control device according to claim 2, wherein the control device calculates a time during which the eyes are meditated from the repeatedly obtained image data, and determines the driver's arousal level from the time during which the eyes are meditated and a determination threshold value. The device for determining arousal level according to crab.   The arousal level determination device according to claim 2, wherein the facial temperature measurement unit measures a skin temperature of a specific part of the driver's face.

Images