JP2021132999A - Vehicle control device - Google Patents

Abstract

To provide a vehicle control device which enables an improvement plan for improving detection accuracy to be set when the detection accuracy of biological information of an occupant of a vehicle is declined.SOLUTION: A vehicle control device comprises: a detection section which detects biological information of an occupant of a vehicle; a determination section which determines detection accuracy of the biological information detected through the detection section; and an improvement plan setting section which sets an improvement plan to improve the detection accuracy when the detection accuracy of the biological information is declined.SELECTED DRAWING: Figure 3

Description

The present invention relates to a vehicle control device.

Conventionally, various techniques for measuring biological information such as heartbeat, respiration, and body temperature of a driver who operates a vehicle have been proposed. When measuring the occupant's biological information, it is conceivable to use a wearable detector that comes into direct contact with the occupant's human body, such as a wearable device. However, when a wearable device is always used, the power of the wearable device is consumed and the usage time is limited. Further, in the wearable detector, the occupant may feel the troublesomeness of the mounting work and the troublesomeness during the mounting.

On the other hand, as a detector for biological information, it is also conceivable to use a non-wearable detector installed in a vehicle. For example, Patent Document 1 describes a technique of detecting the pulse of an occupant using a non-contact radio wave type pulse sensor built in the backrest of a driver's seat and a technique of detecting the body temperature of an occupant using an in-vehicle camera. Is disclosed. Further, Patent Document 2 discloses a technique for detecting the heartbeat of an occupant using a radio wave type unmodulated Doppler sensor. Further, Patent Document 3 discloses a technique for extracting a change in complexion corresponding to a pulse wave by using an in-vehicle camera.

Japanese Unexamined Patent Publication No. 2018-019882 Japanese Unexamined Patent Publication No. 2010-20493 JP-A-2018-127112

Here, the non-wearable type detector may have a reduced detection accuracy due to causes such as vibration and other running conditions of the vehicle and the light environment in the vehicle interior. Further, even if the detector is a wearable type, the accuracy of detecting biological information by the vehicle control device may decrease depending on the communication status with the vehicle control device, for example. When the detection accuracy of the biometric information is lowered, the accuracy of the control performed using the biometric information is lowered, so that measures such as stopping the execution of the control using the biometric information are taken. However, there are various causes for the deterioration of the detection accuracy of biological information, and in some cases, the cause can be resolved relatively easily by taking improvement measures. In such a case, the execution of the control using the biological information can be continued.

The present invention has been made in view of the above problems, and an object of the present invention is to set an improvement measure for improving the detection accuracy when the detection accuracy of the biological information of a vehicle occupant is lowered. The purpose is to provide a possible vehicle control device.

In order to solve the above problems, according to a certain viewpoint of the present invention, a detection unit that detects the biological information of the occupant of the vehicle, a determination unit that determines the detection accuracy of the biological information by the detection unit, and a detection accuracy of the biological information. Provided is a vehicle control device including an improvement measure setting unit for setting an improvement measure for improving the detection accuracy when the value is lowered.

Further, the improvement measure setting unit may estimate the cause of the deterioration of the detection accuracy and set the improvement measure for eliminating the cause.

Further, the improvement measure setting unit may set the improvement measure based on the priority according to the attribute or the state of the occupant.

Further, the improvement measure setting unit may set the improvement measure based on the priority according to the traveling state of the vehicle.

Further, the improvement measure setting unit may set the priority based on the difficulty level of executing the improvement measure.

In addition, a presentation unit may be further provided to present the improvement measures set by the improvement measure setting unit to the occupants.

Further, the improvement measure setting unit may transmit a control signal to a predetermined device that executes the improvement measure.

In addition, the detection unit detects the occupant's biological information based on the image taken by the camera that captures the occupant's face, and the improvement measure setting unit sets the occupant's face area to a predetermined state of external light irradiation. If so, a process of reducing the influence of external light on the facial area may be executed.

In addition, the improvement measure setting unit may set improvement measures for blocking the external light radiated to the occupant's face.

In addition, the biological information is information detected based on the imaging of a specific area of the occupant's face, and the improvement measure setting unit sets an improvement measure for blocking the external light irradiating the specific area. May be good.

Further, the improvement measure setting unit may execute a process of blocking the external light by controlling the external light adjusting unit provided in the vehicle.

Further, the external light adjusting unit may be a sun visor control device or a dimming glass control device.

In addition, when the occupant whose biological information is to be detected is the operator of the vehicle, the improvement measure setting unit sets improvement measures for blocking outside light so as not to obstruct the view of the operator. May be good.

In addition, when the occupant whose biological information is to be detected is the operator of the vehicle, it is presumed that the improvement measure setting unit obstructs the view of the operator by blocking the external light radiating to a specific area. If this is the case, the specific region used for detecting biometric information may be changed to another region.

In addition, the vehicle is a vehicle in which the automatic driving mode and the manual driving mode can be selected, and the improvement measure setting unit sets the improvement measures so as not to obstruct the view of the operator when the vehicle is in the manual driving mode. You may.

Further, the improvement measure setting unit may control the running of the vehicle so that the external light radiated to the facial region is blocked by the external environment of the vehicle.

Further, a reference image storage unit for storing a reference image captured in a state where the occupant's face area is not irradiated with external light together with information on the driving environment in the state is further provided, and the determination unit is acquired. The detection accuracy of the biological information may be determined by comparing the image of the occupant's face with the reference image matching the current driving environment.

Further, when the occupant whose biological information is to be detected is the operator of the vehicle, the reference image storage unit captures the reference image in a state where the occupant's face area is not irradiated with external light. , Even when the outside light to the area of the face of the operator is blocked, the control for blocking the outside light may be executed under the condition that the operation is not hindered, and the reference image may be acquired.

As described above, according to the present invention, when the detection accuracy of the biometric information of the occupant of the vehicle is lowered, an improvement measure for improving the detection accuracy is set and an attempt is made to maintain the detection accuracy of the biometric information. be able to.

It is a block diagram which shows the structural example of the control device for a vehicle which concerns on 1st Embodiment of this invention. It is explanatory drawing which shows an example of the estimation method of the detection accuracy of biological information. It is explanatory drawing which shows the setting example of the improvement measure of the detection accuracy of biological information. It is a flowchart which shows the operation example of the control device for vehicle which concerns on this embodiment. It is a flowchart which shows the improvement measure setting process by the control device for vehicle which concerns on this embodiment. It is a block diagram which shows the structural example of the control device for a vehicle which concerns on 2nd Embodiment of this invention. It is a flowchart which shows the operation example of the control device for vehicle which concerns on this embodiment. It is a flowchart which shows the improvement measure setting process by the control device for vehicle which concerns on this embodiment.

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings. In the present specification and the drawings, components having substantially the same functional configuration are designated by the same reference numerals, so that duplicate description will be omitted.

<< First Embodiment >>
<1. Configuration example of vehicle control device>
First, a configuration example of the vehicle control device according to the first embodiment of the present invention will be described. FIG. 1 is a block diagram showing a configuration example of the vehicle control device 50 according to the present embodiment.

The vehicle control device (hereinafter, also simply referred to as “control device”) 50 is mounted on the vehicle 1 and is configured to detect the biometric information of the occupant and execute a predetermined control using the detected biometric information. ing. In the present embodiment, an example will be described in which the control device 50 detects the occupant's heartbeat or pulse as biological information of the occupant and executes a predetermined control based on the detected heartbeat or pulse information. ..

The control device 50 includes, for example, an arithmetic processing device such as a CPU (Central Processing Unit) or an MPU (Micro Processing Unit), and a storage element such as a RAM (Random Access Memory) or a ROM (Read Only Memory). .. A part or all of the control device 50 may be configured by an updatable device such as firmware, or may be a program module or the like executed by a command from a CPU or the like.

In the present embodiment, the control device 50 includes an arithmetic processing unit 53 and a storage unit 55. The arithmetic processing device 53 is composed of at least one CPU or MPU as described above, and executes various arithmetic processing by executing a program stored in the storage unit 55. The storage unit 55 may be used in addition to a storage element such as a RAM or ROM, or instead of a storage element, an HDD (Hard Disk Drive), a CD (Compact Disc), a DVD (Digital Versatile Disc), an SSD (Solid State Drive), or the like. A storage medium such as a USB (Universal Serial Bus) flash or a storage device may be provided.

The control device 50 is connected to the occupant camera 41, the optical sensor 43, and the acceleration sensor 45 directly or via a communication means such as CAN (Controller Area Network) or LIN (Local Inter-Net).

The occupant camera 41 is a camera installed in the vehicle interior so that the occupant of the vehicle 1 can be photographed. The occupant camera 41 includes an image pickup element such as a CCD (Charge Coupled Device) or a CMOS (Complementary Metal Oxide Semiconductor), and the image pickup information acquired by the occupant camera 41 is transmitted to the control device 50. The control device 50 determines the presence / absence of an occupant whose biological information is to be detected and the position of the occupant's face based on the image pickup information of the occupant camera 41.

Further, in the present embodiment, the occupant camera 41 also functions as a detector of biological information for detecting the heartbeat of the occupant. The occupant camera 41 is a non-wearable detector that does not come into direct contact with the occupant's human body. For example, the control device 50 detects the heartbeat of the occupant based on the change in the color information of the face detected based on the image pickup information of the occupant camera 41.

The biometric information detector provided in the vehicle 1 is not attached to the occupant of the vehicle 1 such as a driver, but is a sensor device installed in the vehicle 1 to detect the biometric information of the occupant and detects the biometric information. It is preferable that the sensor device has a low sensation of being used. The detector provided in the vehicle 1 operates by receiving electric power supplied from, for example, the power source of the vehicle 1.

The biometric information detector provided in the vehicle 1 is not limited to the occupant camera 41 for detecting the heartbeat of the occupant. Further, the vehicle 1 may be provided with the above-mentioned non-wearable or wearable biometric information detector 47 in combination with the occupant camera 41 or separately from the occupant camera 41.

For example, the occupant camera 41 may be used to detect the body temperature of the occupant, the movement of the line of sight, and the face orientation. Further, the biometric information detector 47 may be a radio wave type Doppler sensor for detecting the heartbeat of the occupant, or may be a non-wearable pulse sensor for detecting the pulse of the occupant. Further, the detector 47 may be a set of electrodes embedded in the steering wheel for measuring the heartbeat or the electrocardiogram of the occupant. Further, the detector 47 may be a pressure measuring device embedded in the driver's seat in order to measure the sitting pressure distribution in the seated state in which the occupant is seated in the seat. Further, the detector 47 may be a displacement sensor that detects a change in the position of the seat belt in order to measure the heartbeat or respiration of the occupant. Further, the detector 47 may be a TOF (Time of Flight) sensor for detecting information on the position (living body position) of the occupant. Further, the detector 47 may be a thermography for measuring the surface temperature of the skin of the occupant.

Further, the control device 50 may be connected to a wearable biometric information detector 47 that is mounted on the occupant and detects the biometric information of the occupant. Examples of the wearable biological information detector include a wristwatch type or a head or arm wearable device. These wearable devices may have a function of detecting biological information such as a occupant's heartbeat, pulse, blood pressure, and body temperature. The wearable biometric detector is activated, for example, by the charging power of a built-in battery.

The wearable biometric information detector may be connected to the control device 50 directly or via a communication means such as CAN or LIN. Alternatively, the wearable detector can communicate with the control device 50 via wireless communication means such as Bluetooth (registered trademark), NFC (Near Field Communication), wifi (wireless fidelity), and wireless LAN (Local Area Network). It may be configured as follows.

The optical sensor 43 is installed in the vehicle interior and is used to measure an index value related to light and darkness in the vehicle. In particular, the optical sensor 43 is installed so as to be able to measure the brightness and darkness around the occupant's face. The index value of lightness and darkness may be, for example, either brightness, brightness or illuminance. The type of the optical sensor 43 is not particularly limited, and a known optical sensor can be used as appropriate. The sensor signal of the optical sensor 43 is transmitted to the control device 50. The acceleration sensor 45 is provided in the vehicle 1 and is used to measure the vibration of the vehicle 1. The acceleration sensor 45 may be an acceleration sensor provided for use in driving control of the vehicle 1. The sensor signal of the acceleration sensor 45 is transmitted to the control device 50.

The control device 50 detects the vibration of the vehicle 1 based on the sensor signal of the acceleration sensor 45. Further, the control device 50 determines the detection accuracy of the occupant's heartbeat based on the sensor signal of the optical sensor 43 and the vibration of the vehicle 1, or estimates the cause of the decrease in the detection accuracy. When another control device detects the vibration of the vehicle 1 based on the sensor signal of the acceleration sensor, the control device 50 may acquire the vibration information of the vehicle 1 from the other control device.

Further, the control device 50 is directly connected to the input unit 31, the presentation unit 33, and the vehicle drive control device 37 via a communication line such as CAN or LIN. The input unit 31 receives an operation input of a user (for example, an occupant) to the control device 50. The input unit 31 may be, for example, a touch panel type display or a dial type operation device.

The presentation unit 33 is, for example, a display panel provided on the dashboard or a HUD (Head Up Display) projected on the front window, and presents information so that the occupant can see it. However, the presentation unit 33 is not limited to the above display panel and HUD, and may be a meter display device in the instrument panel or a display device of a navigation system, and presents various information. It may be a multifunction display. Further, the presentation unit 33 may be integrated with the input unit 31.

The presentation unit 33 has a function of presenting information on the improvement measures set by the improvement measure setting unit 71 to an occupant such as a driver. When the improvement measure to be set involves the movement of the occupant, the presenting unit 33 presents the information of the operation instruction to the occupant as the improvement measure. Further, when the improvement measure to be set is controlled by the control device 50, the presenting unit 33 may present information for notifying the occupant of the control content. Further, in the present embodiment, the presentation unit 33 may be an information presentation device other than the display device. For example, the presentation unit 33 may be a speaker that generates sound or voice, or may be lamps that can be turned on as warning lights.

The vehicle drive control device 37 is a control unit that executes drive control of the vehicle 1, and drives an engine (not shown), one or more drive motors, a power transmission mechanism including a transmission, a steering system, a brake system, and the like. It is composed of one or a plurality of control devices for controlling the above. The vehicle drive control device 37 basically executes the travel control of the vehicle 1 based on the driving operation of the occupant who is the operation subject. Further, the vehicle drive control device 37 executes the travel control of the vehicle 1 for improving the decrease in the detection accuracy of the biological information based on the command from the control device 50.

The arithmetic processing unit 53 includes a detection unit 61, a determination unit 63, a control unit 65, and an improvement measure setting unit 71. The control unit 65 has a functional configuration for executing a predetermined control based on the detected biological information, and includes an emergency stop control unit 67 and a warning control unit 69. Each of these parts of the arithmetic processing unit 53 is, specifically, a function realized by executing a program by the arithmetic processing unit 53.

(Detection unit)
The detection unit 61 detects the biological information of the occupant of the vehicle 1. In the present embodiment, the detection unit 61 detects the heartbeat of the occupant based on the imaging information transmitted from the occupant camera 41. Specifically, the detection unit 61 executes image processing based on the image pickup information transmitted from the occupant camera 41, and measures the occupant's heartbeat based on the change in the color information of the face. When another biometric information detector is mounted on the vehicle 1, the detection unit 61 detects predetermined biometric information of the occupant based on the information transmitted from the other biometric information detector. ..

(Judgment unit)
The determination unit 63 determines the detection accuracy of the biological information. The determination unit 63 may determine the detection accuracy of the biological information by determining whether the value of the detected biological information shows an abnormal value or an abnormal change. For example, when the value of the detected biometric information shows an abnormally large change, the determination unit 63 determines that the detection accuracy of the biometric information is low. Alternatively, when the value of the detected biological information exceeds a preset threshold value and hardly changes or does not change at all, the determination unit 63 reduces the detection accuracy of the biological information. It may be determined that there is. In addition, the determination unit 63 may determine the detection accuracy of the biological information based on the information that can affect the detection accuracy of the biological information.

FIG. 2 is an explanatory diagram showing an example of a method for determining the detection accuracy of biological information using the occupant camera 41. In the present embodiment, the determination unit 63 determines the heartbeat based on the image pickup information of the occupant camera 41 based on the brightness and darkness in the vehicle interior, the amount of shadows generated on the occupant's face by the light, and the magnitude of the vibration of the vehicle 1. Determine the detection accuracy. In the example shown in FIG. 2, the determination unit 63 sets the level of the heartbeat detection accuracy based on the image pickup information of the occupant camera 41 into three levels from the first level (level 1) to the third level (level 3). Judge separately.

The brightness and darkness in the vehicle interior can be detected based on the sensor signal of the optical sensor 43. For example, the determination unit 63 determines whether or not the detected light / dark index value is within an appropriate range. Further, the magnitude of vibration of the vehicle 1 can be detected based on the sensor signal of the acceleration sensor 45. For example, the determination unit 63 specifies the magnitude of the vibration cycle or amplitude of the vehicle 1 in a predetermined direction based on the sensor signal of the acceleration sensor 45, and determines whether the vibration of the vehicle 1 is large or small. Further, the amount of shadows generated on the occupant's face by the light can be detected by performing image processing on the image pickup information of the occupant's face captured by the occupant camera 41. For example, the determination unit 63 uses light shadows based on the ratio of pixels or pixel groups whose brightness and darkness index values are less than a predetermined value to the pixels or pixel groups of the entire region corresponding to the occupant's face recognized by image processing. It may be determined whether the occurrence of is high or low.

In the example shown in FIG. 2, when the index value of the light and darkness in the vehicle interior is out of the appropriate range, the determination unit 63 sets the level of the heartbeat detection accuracy by the occupant camera 41 to the first level (level 1). .. For example, when the index value of light and darkness in the passenger compartment is too high (when it is too bright), such as when the west sun is dazzling, the occupant's face image taken by the occupant camera 41 becomes too bright and the occupant's face color information is displayed. It may be difficult to detect accurately. On the other hand, when the index value of lightness and darkness in the vehicle interior is too low (when it is too dark), the occupant's face image taken by the occupant camera 41 becomes too dark and the color information of the occupant's face can be detected accurately. It can be difficult. Therefore, when the index value of the light and darkness in the vehicle interior is out of the appropriate range, the determination unit 63 determines the level of the heartbeat detection accuracy by the occupant camera 41 regardless of the amount of shadow generated by the light and the magnitude of the vibration of the vehicle 1. Is set to the first level (level 1).

Further, when the index value of the lightness and darkness in the vehicle interior is within the appropriate range, the determination unit 63 uses the occupant camera 41 based on the amount of shadows generated on the occupant's face by the light and the magnitude of the vibration of the vehicle 1. The heartbeat detection accuracy level is set to one of the first level (level 1) to the third level (level 3). In this case, the determination unit 63 raises the level of heartbeat detection accuracy by the occupant camera 41 as the amount of shadows generated on the occupant's face by light decreases (the detection accuracy is higher), and the smaller the vibration of the vehicle 1, the higher the heartbeat. Increase the level of detection accuracy of. The level of the accuracy of detecting the heartbeat by the occupant camera 41 may not be three stages, may be two stages, or may be four or more stages. Further, the determination unit 63 may further estimate the detection accuracy of the heartbeat based on the movement of the occupant's face. For example, when traveling on a curve or an intersection, the occupant may turn his / her face in the direction of travel, and in such a case, the detection accuracy of the occupant's face color information may decrease. Therefore, the determination unit 63 may determine that the heartbeat detection accuracy is reduced when the orientation of the occupant's face imaged by the occupant camera 41 is outside the predetermined range.

The method for determining the detection accuracy of biological information using the occupant camera 41 is not limited to the above-mentioned example. For example, the determination unit 63 may determine the detection accuracy based on at least one of a change in the position of the occupant's face, a change in brightness, or a change in the acceleration of the vehicle 1 in the image captured by the occupant camera 41. For example, the greater the change in the position of the occupant's face, the lower the level of detection accuracy based on the captured image. Further, the larger the change in the brightness of the captured image, the lower the level of detection accuracy based on the captured image is set. The change in the position of the occupant's face in the captured image and the change in the brightness of the captured image can be obtained by image processing the captured image. Further, the larger the change in the acceleration of the vehicle 1, the lower the level of detection accuracy based on the captured image is set. The change in the acceleration of the vehicle 1 may be obtained based on the sensor signal of the acceleration sensor 45, or may be obtained based on the information of the acceleration request in the traveling control of the vehicle 1.

The detection accuracy of the biometric information when a biometric information detector other than the occupant camera 41 is used can be determined as follows, for example.
When the biometric information detector is a wristwatch-type wearable device having a function of detecting the pulse of the occupant, the wearable device detects the pulse based on the reflectance when the wrist is irradiated with near-outside light. do. In such a wearable device, if the skin surface is wet with sweat or there are gaps in the contacts, noise may increase and the detection accuracy may decrease. The determination unit 63 detects biological information using the wristwatch-type wearable device 20 when, for example, the outside air temperature or the temperature inside the vehicle interior is high, or when the occupant camera 41 determines that the amount of sweat of the occupant is large. Judge that the accuracy may decrease.

Further, when the biometric information detector is a detector using a wet electrode worn on the human body of an occupant, the detector detects the heartbeat based on the voltage change detected through the wet electrode. In such a detector, the detection accuracy may decrease when the position of the contact is deviated from the proper position, the contact is separated from the skin, or the electrode becomes dry. For example, when the amplitude of the detected voltage is within a predetermined range or the peak of the voltage is less than a predetermined value, the determination unit 63 may reduce the detection accuracy of the detector using the wet electrode. Judge that there is.

Further, when the biometric information detector is a radio wave type Doppler sensor, the detection accuracy of the heartbeat may decrease when radio wave noise is superimposed. The determination unit 63 determines that the accuracy of detecting the heartbeat by the Doppler sensor may decrease when the reception of radio waves by the mobile phone or smart phone continues, for example.

In addition, the detection accuracy may be lowered depending on the type of the biometric information detector and the biometric information detection method, and the determination unit 63 may affect the detected biometric information, the detection signal, and the detection accuracy. The detection accuracy of biometric information is determined based on the information in.

(Control unit)
The control unit 65 executes a predetermined control based on the biological information. For example, the emergency stop control unit 67 of the control unit 65 executes control to stop the vehicle 1 in an emergency when an abnormality in the body of the occupant is detected based on the detected biological information of the occupant. Specifically, the emergency stop control unit 67 transmits an emergency stop command to the vehicle drive control device 37 so as to stop the vehicle 1 safely and promptly. For example, the vehicle 1 is provided with a detection device such as a camera or a radar that detects the surrounding environment of the vehicle 1, and the vehicle drive control device 37 that has received the emergency stop command is an engine, one or more drive motors, and steering. By controlling the system and the braking system, the vehicle 1 is stopped in a roadside zone where space is secured so that the vehicle 1 does not collide with a person, another vehicle 1, or other obstacles.

Further, the warning control unit 69 of the control unit 65 executes a control to warn the abnormality of the body of the occupant when the abnormality of the body of the occupant is detected based on the detected biological information of the occupant. Specifically, when the warning control unit 69 detects an abnormality in the body of the occupant, the warning control unit 69 transmits a warning command to the warning device 35 to warn the abnormality of the body. Upon receiving the warning command, the warning device 35 performs a warning operation for an abnormality in the occupant's body by means such as a warning sound, a voice, lighting of a warning lamp, and generation of vibration.

(Improvement setting section)
The improvement measure setting unit 71 sets an improvement measure for improving the detection accuracy when it is determined that the detection accuracy of the biological information is lowered or the detection accuracy may be lowered. The improvement measures set by the improvement measure setting unit 71 include those by control executed based on the command by the control device 50 and those executed by the occupants. In the case of a control-based improvement measure, the improvement measure setting unit 71 generates and outputs a predetermined control command according to the set improvement measure. Further, in the case of the improvement measure executed by the occupant, the improvement measure setting unit 71 presents the set improvement measure to the occupant through the presentation unit 33.

As described in the above-mentioned example of the method for determining the detection accuracy of biometric information by the determination unit 63, there are several possible causes for the decrease in detection accuracy depending on the type of the biometric information detector. Therefore, a plurality of improvement measures set by the improvement measure setting unit 71 when the detection accuracy is lowered may be prepared in advance according to the type of the biometric information detector. For example, when the biometric information detector is a wearable device that comes into contact with the human body, the accuracy of biometric information detection may decrease due to sweating of the occupant. When the detection accuracy is lowered due to such a cause, the improvement measure setting unit 71 sets an improvement measure for suppressing sweating. For example, the improvement measure setting unit 71 presents advice to the occupant to wipe the sweat through the presentation unit 33, or controls the air conditioner of the vehicle 1 so as to lower the temperature in the vehicle interior. , Suppresses sweating.

In addition, when the biometric information detector is a wearable device that comes into contact with the human body or a detector that uses wet electrodes, biometric information can be detected by creating a gap in the contact point with the skin or shifting the position of the contact point. Accuracy may decrease. Further, in the case of a detector using a wet electrode, the detection accuracy of biometric information may decrease due to the drying of the electrode. If the detection accuracy is reduced due to such a cause, the remedy setting unit 71 should advise the occupant to correct the position of the detector, crimp the detector to the skin, or moisten the electrodes. This eliminates the cause of the decrease in detection accuracy.

Further, when the biometric information detector is the occupant camera 41, the vibration of the vehicle 1 may cause the position of the face region in the captured image to shift, and the accuracy of detecting the biometric information based on the captured information may decrease. When the detection accuracy is lowered due to such a cause, the improvement measure setting unit 71 sets an improvement measure for reducing the vibration of the vehicle 1. For example, the improvement measure setting unit 71 alleviates the high-frequency vibration of the vehicle 1 by changing the setting of the active suspension or lowering the vehicle speed.

Further, when the biometric information detector is the occupant camera 41, the detection accuracy of the biometric information based on the imaged information may decrease due to the change in the brightness due to the external light shining on the occupant's face region. When the detection accuracy is lowered due to such a cause, the improvement measure setting unit 71 sets an improvement measure for preventing the occupant's face area from being exposed to external light. For example, the improvement measure setting unit 71 advises the occupant to adjust the position of the sun visor, or advises the occupant to drive in a position where the face area is in the shadow. The change in the brightness of the captured image obtained by capturing the face region is suppressed.

Other than those illustrated here, the improvement measure setting unit 71 is configured to be able to set improvement measures for eliminating possible causes depending on the type of the detector of biological information.

Further, the improvement measure setting unit 71 may set a plurality of improvement measures in a preset order when the determination unit 63 determines that the detection accuracy of the biological information has decreased or may decrease. Often, the cause of the decrease in the detection accuracy of biological information may be estimated, and an improvement measure capable of eliminating the cause may be set from a plurality of improvement measures. By setting an improvement measure that can eliminate the probable cause, the detection accuracy of biological information can be improved at an early stage. For example, when the determination unit 63 determines the decrease in the detection accuracy based on the information that may affect the detection accuracy, the improvement measure setting unit 71 determines the cause of the decrease in the detection accuracy based on the information used for the determination. You may estimate. On the other hand, when the determination unit 63 determines the decrease in the detection accuracy based on the value of the detected biological information, the improvement measure setting unit 71 is based on the information that can affect the detection accuracy as illustrated in FIG. The cause of the decrease in detection accuracy may be estimated.

In addition, the improvement measure setting unit 71 may set priorities for a plurality of improvement measures and set improvement measures in sequence. For example, for each biometric information detector, the priority of the improvement measure for improving the cause of the high probability of occurrence and the decrease in the detection accuracy may be increased. By setting the priority and the improvement measure in this way, the detection accuracy can be improved more quickly even when the cause of the decrease in the detection accuracy is not estimated.

Further, the improvement measure setting unit 71 may change the priority of the plurality of improvement measures based on the difficulty of executing the improvement measures. Specifically, the improvement measure setting unit 71 may give priority to the improvement measure that is easy to execute. By setting priorities and setting improvement measures in this way, it is possible to increase the possibility of improving the detection accuracy by a simple method.

FIG. 3 is an explanatory diagram showing an example in which the priority of the improvement measure is set based on the probability of occurrence of the cause of the decrease in the detection accuracy and the difficulty of executing the improvement measure. FIG. 3 shows a wristwatch-type wearable device that detects a pulse based on the reflectance of the emitted proximity external light, a detector that detects a heartbeat based on a voltage change of a wet electrode, and a face image acquired by an occupant camera 41. An example is shown in which the priority is set when the detection accuracy of the detector that detects the pulse based on the change in the brightness of is lowered.

When the detector is a wristwatch-type wearable device, it is set that the probability of noise increase due to sweat is high, and then the probability of noise increase due to contact gaps is high as the cause of the decrease in detection accuracy. ing. As a remedy for the decrease in detection accuracy due to the increase in noise due to sweat, it is conceivable to wipe the sweat and reduce the temperature inside the vehicle interior. Of these, wiping sweat is set to be less difficult to carry out than lowering the temperature inside the vehicle interior. Further, as a remedy for the decrease in detection accuracy due to the increase in noise due to the gap between the contacts, it is conceivable to adjust the position of the wearable device.

Further, when the detector is a detector using a wet electrode, the cause of the decrease in detection accuracy is that the probability of occurrence of contact misalignment is high, followed by the probability of contact floating, and then the electrode. It is set as having a high probability of occurrence of drying. As a remedy for the decrease in detection accuracy due to the displacement of the contact position, it is conceivable to correct the electrode position. As a remedy for the decrease in detection accuracy due to the floating of contacts, it is conceivable to press the electrodes against the skin. As a remedy for the decrease in detection accuracy due to drying of the electrode, it is conceivable to moisten the electrode.

Further, when the detector is a detector using the occupant camera 41, there is a high probability that the brightness of the face region in the captured image changes due to external light as a cause of the decrease in detection accuracy, followed by the vehicle 1 It is set as having a high probability of occurrence of misalignment of the face region due to vibration (high frequency) of the camera. As a remedy for the decrease in detection accuracy due to the change in brightness due to external light, it is conceivable to adjust the position of the sun visor and run in the shade. Of these, adjusting the position of the sun visor is set to be less difficult to execute than running in the shade. In addition, as measures to improve the detection accuracy due to the displacement of the face region due to vibration, it is conceivable to change the setting of the active suspension and reduce the vehicle speed. Of these, changing the active suspension setting is set to be less difficult to execute than reducing the vehicle speed.

In the example shown in FIG. 3, improvement measures are set for each detector so that the probability of occurrence of the cause is high but the priority is high, and the difficulty of execution is low but the priority is high. The ranking is set. Therefore, when the improvement measure setting unit 71 does not estimate the cause of the decrease in the detection accuracy, the improvement measure setting unit 71 sequentially sets the improvement measure according to the preset priority and tries to improve the detection accuracy. This makes it possible to increase the possibility that the detection accuracy will be improved faster and more easily.

The improvement measure setting unit 71 may set the priority for executing the improvement measure based on the attribute or condition of the occupant or the condition of the vehicle for the plurality of improvement measures. If the occupant has a chronic illness such as a disease, the biometric information becomes more important, so it can be said that the priority is high to implement improvement measures to improve the detection accuracy when the detection accuracy of the biometric information decreases. On the other hand, when the occupant is a healthy person, it can be said that the priority for executing the improvement measure for improving the detection accuracy is low. Therefore, the improvement measure setting unit 71 may or may not execute the improvement measure or may change the timing of executing the improvement measure depending on the presence or absence of the illness of the occupant.

In addition, when the biometric information detector is a wearable device that comes into contact with the human body or a detector that uses wet electrodes, assuming that the occupant is a person who easily sweats, even if the sweat is wiped once, the detection accuracy will be reduced again in a short time. Therefore, it is unlikely that the effect of improving the detection accuracy by presenting the sweat as if it were wiped off is low. In this case, the improvement effect of the detection accuracy can be expected by outputting the control command that lowers the temperature inside the vehicle rather than presenting it to wipe the sweat, so the priority of executing the improvement measure by control is high. .. However, if the occupant is sweating due to heat generation, the occupant's physical condition may deteriorate by lowering the temperature inside the vehicle. Therefore, in this case, the presentation to wipe the sweat may be prioritized over the output of the control command for lowering the temperature inside the vehicle.

The occupant's attributes or condition may include various information about the occupant, such as age, gender, physical condition, personality, injured condition, physical health condition, mental and physical condition, driving skill, and the like. If the occupants are elderly or in poor physical condition or injured, it may be difficult for the occupants to implement improvement measures. In this case, it is considered that the improvement effect of the detection accuracy can be expected by executing the control of the vehicle 1 rather than presenting the occupant to execute the improvement measure. Therefore, the priority of executing the improvement measure by the control is set. Be raised. In addition, if the occupant is worried or has a cautious personality in driving, the occupant may actually implement the improvement measure even if he / she is offered to implement the improvement measure that interferes with the driving operation. Since it may be difficult, the priority of implementing improvement measures by control is high. In addition, when the driving skill of the occupant is high, even if the execution of the improvement measure accompanied by the movement of the occupant is suggested, the influence on the driving of the vehicle 1 is considered to be small. Is raised. In addition, the priority of improvement measures can be appropriately set according to the attributes or conditions of the occupants.

The occupant's attribute or state information may be input in advance by the occupant, or may be acquired based on information detected by the sensor such as image pickup information of the camera. In addition, setting the priority of the improvement measure may include setting whether or not the improvement measure can be executed, and the frequency of setting the improvement measure when it is estimated that the detection accuracy has deteriorated. May include changing.

Further, the improvement measure setting unit 71 may set the priority of the improvement measure to be set according to the state of the vehicle 1. For example, depending on whether the vehicle 1 is traveling on a general road or a highway, the feasible improvement measures may change. Specifically, when the vehicle 1 is traveling on the highway, it may be difficult to execute the improvement measures involving the action of the occupant releasing the steering wheel. Therefore, the priority of executing the improvement measures by control is set. Set high. Further, when the vehicle 1 is traveling on a sharp curve, it may be difficult to execute the improvement measures accompanied by the movement of the occupant or the improvement measures under the control of the vehicle 1. Therefore, the improvement measure setting unit 71 may set the priority of the improvement measure according to the traveling state of the vehicle 1. Alternatively, depending on the traveling state of the vehicle 1, it may be dangerous to reduce the vehicle speed. In this case, the implementation of the improvement measures for reducing the vehicle speed may be prohibited.

<2. Configuration example of vehicle control device>
Next, an example of the operation of the vehicle control device 50 according to the present embodiment will be specifically described with reference to the flowchart. The flowchart described below may be executed all the time, or may be executed at appropriate or random time intervals.

FIG. 4 is a flowchart showing an example of the detection accuracy improvement process executed by the vehicle control device 50.
First, the determination unit 63 of the control device 50 detects biological information based on the information transmitted from the detector (step S11). Next, the determination unit 63 estimates the detection accuracy of the biological information by the detector (step S13). The determination unit 63 may estimate the detection accuracy of the biological information based on the change in the value of the detected biological information, or may estimate the detection accuracy of the biological information based on the information that may affect the detection accuracy. good. When estimating the detection accuracy of biometric information based on the change in the value of the detected biometric information, it is not necessary to calculate the information that may affect the detection accuracy, so that the load on the control device 50 can be reduced. can.

Next, the determination unit 63 determines whether or not the detection accuracy of the biological information has deteriorated (step S15). It may be determined that the detection accuracy is lowered not only when the detection accuracy of the detected biological information is actually lowered but also when the detection accuracy of the biometric information may be lowered. The method for determining the decrease in detection accuracy is not particularly limited. For example, when the value of the detected biological information changes abnormally significantly or the value of the detected biological information becomes a value outside the appropriate range continuously for a predetermined time, the determination unit 63 determines the value of the biological information. It may be determined that the detection accuracy has deteriorated. Alternatively, as shown in FIG. 2, the determination unit 63 may classify the detection accuracy of the biological information into levels based on the information that may affect the detection accuracy of the biological information.

If the detection accuracy of the biometric information has not deteriorated (S15 / No), the process returns to step S11 and the detection of the biometric information and the determination of the detection accuracy are repeated. On the other hand, when the detection accuracy of the biological information is lowered (S15 / Yes), the improvement measure setting unit 71 of the control device 50 sets the improvement measure for improving the detection accuracy of the biological information (step S17). The improvement measure setting unit 71 may set an improvement measure for eliminating the cause after estimating the cause of the decrease in the detection accuracy, depending on the type of the biometric information detector whose detection accuracy has decreased. , You may set a preset improvement measure. At that time, the improvement measure setting unit 71 sets the priority based on the probability of occurrence of the cause of the decrease in detection accuracy, the attribute or state of the occupant, or the running state of the vehicle 1, and implements the improvement measure in descending order of priority. It may be set.

FIG. 5 is a flowchart showing a specific example of the improvement measure setting process. The flowchart described below is an example of estimating the cause of the decrease in the detection accuracy of biological information and setting improvement measures according to a predetermined priority.

First, the improvement measure setting unit 71 of the control device 50 estimates the cause of the decrease in the detection accuracy of the biological information (step S31). When the determination unit 63 has already determined the detection accuracy based on the information that can affect the detection accuracy of the biological information, the improvement measure setting unit 71 determines the detection accuracy based on the information used for the determination. The cause of the decline may be estimated. Alternatively, when the determination unit 63 determines the detection accuracy based on the value of the detected biometric information, the improvement measure setting unit 71 may affect the detection accuracy of the biometric information as shown in FIG. The cause of the decrease in detection accuracy may be estimated based on the information.

Next, the improvement measure setting unit 71 acquires information on the attributes or states of the occupants or information on the running state of the vehicle 1 (step S33). The occupant's attribute or state information may be information input in advance by the occupant, or may be information acquired based on information detected by a detector such as a camera. For example, the improvement measure setting unit 71 acquires information such as the age, gender, physical condition, personality, injured state, physical health state, mental and physical condition, and driving skill of the occupant. Further, the information on the traveling state of the vehicle 1 includes information on the speed, acceleration, steering angle, traveling position, environment in the vehicle interior, etc. of the vehicle 1, even if it is information acquired based on the information detected by the sensor. good.

Next, the improvement measure setting unit 71 sets a priority for the improvement measure according to the cause of the estimated deterioration of the detection accuracy, the information on the attribute or state of the occupant, or the information on the running state of the vehicle 1 ( Step S35). The priority of the improvement measure is set according to, for example, the importance of biometric information according to the attribute or state of the occupant, the effect of improving the detection accuracy, the difficulty of executing the improvement measure, and the like.

Next, the improvement measure setting unit 71 determines whether or not it is necessary to improve the detection accuracy of the biological information in consideration of the attributes of the occupant (step S37). For example, when the occupant is a healthy person, it is unlikely that the physical condition deteriorates, and it is considered that the need for improving the detection accuracy of biological information is relatively low. In this case, the improvement measure setting unit 71 determines that it is not necessary to improve the detection accuracy. In addition, the improvement measure setting unit 71 may determine whether or not it is necessary to improve the detection accuracy of the biological information based on the information related to the body such as the age of the occupant and the history of illness or medical condition.

When it is not necessary to improve the detection accuracy of the biological information (S37 / No), the improvement measure setting unit 71 ends this routine without setting the improvement measure. On the other hand, when it is necessary to improve the detection accuracy of the biological information (S37 / Yes), the improvement measure setting unit 71 determines whether or not there is an improvement measure that has not yet been set in response to the decrease in the detection accuracy this time. Determine (step S39). If all the improvement measures have been set and there is no improvement measure that has not been set (S39 / No), the improvement measure setting unit 71 determines that there is no possibility of improving the detection accuracy of the biological information, so that it is as it is. Terminate this routine.

On the other hand, when there is an improvement measure that has not been set yet (S39 / Yes), the improvement measure setting unit 71 sets the improvement measure having the highest priority among the improvement measures that have not been set as the improvement measure (step S41). That is, even when the already set improvement measures are executed, different improvement measures are sequentially set according to the priority unless the detection accuracy of the biological information is improved.

Returning to FIG. 4, when the improvement measure is set by the improvement measure setting unit 71 in step S17, if the set improvement measure involves the movement of the occupant, the presentation unit 33 prompts the execution of the improvement measure. Present information. The presentation may be a display on a display device, voice guidance, generation of a warning sound, or lighting of a warning light. Further, if the set improvement measure is based on a predetermined control, the improvement measure setting unit 71 generates and outputs a predetermined control command. For example, the improvement measure setting unit 71 generates and outputs a control command for changing the setting of the active suspension of the vehicle 1 and a control command for decelerating the vehicle 1.

Next, the improvement measure setting unit 71 determines whether or not the detection accuracy of the detected biological information has improved (step S19). Specifically, the improvement measure setting unit 71 determines whether or not the detection accuracy has deteriorated by the same procedure as in steps S11 to S15, and returns the detected accuracy that was in the lowered state to the state in which the detection accuracy has not deteriorated. If so, it is determined that the detection accuracy has improved. When the detection accuracy of the biological information is improved (S19 / Yes), the improvement measure setting unit 71 ends this routine.

On the other hand, when the detection accuracy of the biological information is not improved (S19 / No), the improvement measure setting unit 71 returns to step S17 and sets the improvement measure again. Also in step S17, improvement measures are set according to the flowchart shown in FIG. Specifically, since the detection accuracy of biometric information is not improved even by the improvement measures already executed, another improvement measure that has not been set yet is set. By setting the improvement measures in this way, the improvement measures that are likely to improve the biometric information or the improvement measures that are less difficult to execute are preferentially set, and the detection accuracy of the biometric information is faster or easier. Can be improved.

As described above, the vehicle control device 50 according to the first embodiment is an improvement in which an improvement measure for improving the detection accuracy is set when the detection accuracy of the biological information of the occupant of the vehicle 1 is lowered. The measure setting unit 71 is provided. Therefore, when the detection accuracy of the biometric information is lowered, the detection accuracy of the biometric information can be improved by executing the set improvement measure. As a result, it is possible to reduce the possibility that the control for urgently stopping the vehicle 1 based on the biological information and the control for warning the abnormality of the body are executed in an unstable state in which the detection accuracy of the biological information is lowered.

Further, the vehicle control device 50 according to the present embodiment may estimate the cause of the decrease in the detection accuracy of the biological information and set an improvement measure for eliminating the cause. Thereby, the detection accuracy of the biological information can be improved more quickly or surely. Further, the vehicle control device 50 according to the present embodiment may set improvement measures based on the attributes or states of the occupants, the running state of the vehicle 1, and the priority according to the difficulty of execution. good. As a result, the higher the importance of the biometric information, the higher the probability of improvement of the biometric information, or the easier it is to execute the improvement measure, the easier it is to be set as the improvement measure with priority, and the biometric information is improved. It is possible to increase the efficiency of making it.

<< Second Embodiment >>
Next, the vehicle control device according to the second embodiment of the present invention will be described. The vehicle control device according to the second embodiment has various improvement measures for improving the detection accuracy of the biometric information based on the imaged information of the occupant's face region when the biometric information detector is the occupant camera. Is configured to be configurable. Specifically, the vehicle control device according to the present embodiment reduces the influence of the external light on the facial area when the irradiation state of the external light on the occupant's face area is in a predetermined state. It is configured to perform processing. Hereinafter, the vehicle control device according to the present embodiment will be described as being different from the vehicle control device according to the first embodiment.

(1. Configuration example of vehicle control device)
FIG. 6 is a block diagram showing a configuration example of a vehicle control device (hereinafter, also simply referred to as “control device”) 50A according to the present embodiment. In the control device 50A according to the present embodiment, the ambient environment detector 48 and the GPS (Global Positioning System) device 49 communicate with the occupant camera 41, the optical sensor 43, and the acceleration sensor 45 described in the first embodiment. It is connected as possible.

The ambient environment detector 48 detects the ambient environment of the vehicle 1. For example, the ambient environment detector 48 may include a camera device that photographs the surroundings of the vehicle 1, or may include sensor devices such as a radar sensor, a RiDAR device, and an ultrasonic sensor that detect an object existing around the vehicle 1. good. Further, the GPS device 49 receives a satellite signal from a GPS satellite and identifies the current position of the vehicle 1. However, as long as it is a device that can specify the information of the current position of the vehicle 1, it may be a device that uses another satellite signal. Further, the control device 50A may be configured to be able to communicate with, for example, a control device mounted on another vehicle, an information distribution device installed on the road, or the like. The control device 50A is based on the information transmitted from the ambient environment detector 48, the GPS device 49, or an external device, and is based on the current season, the time zone or the position of the sun, the traveling area and traveling position of the vehicle 1, and the traveling direction. And so on.

Further, the control device 50A is communicably connected to the external light adjusting unit 39 together with the input unit 31, the presenting unit 33, and the vehicle drive control device 37 described in the first embodiment. In the present embodiment, the external light adjusting unit 39 has a function of executing control for adjusting the external light emitted to the face area of the occupant. The external light adjusting unit 39 includes a sun visor control device 39a and a dimming glass control device 39b. However, the external light adjusting unit 39 may be only one of the sun visor control device 39a and the dimming glass control device 39b.

The sun visor control device 39a is a device for adjusting the position or orientation of the sun visor provided in the vehicle 1. The sun visor may be a sun visor generally provided above the driver's seat and the passenger seat, or may be an additional sun visor provided at an appropriate position. For example, the sun visor control device 39a is not particularly limited as long as it is a device capable of adjusting the position or orientation of the sun visor, and may be, for example, a drive device that rotates a bar that supports the sun visor.

Further, the dimming glass control device 39b is a device for adjusting the translucency of the glass of the windshield or the side door. For example, the dimming glass control device 39b is not particularly limited as long as it is a device capable of adjusting the transparency of the windshield or the like, and for example, control for adjusting the voltage applied to the liquid crystal film provided on the windshield or the like. It may be a device. The dimming range of the dimming glass can be adjusted by controlling the range in which the voltage is applied.

The control device 50A according to the present embodiment includes a communication unit 51, an arithmetic processing unit 53, and a storage unit 55. The communication unit 51 includes an interface for transmitting and receiving signals to and from an external device of the vehicle 1.

The arithmetic processing unit 53 includes a detection unit 61, a determination unit 63, a control unit 65, and an improvement measure setting unit 71. Each of these parts of the arithmetic processing unit 53 is, specifically, a function realized by executing a program by the arithmetic processing unit 53. Of these, the control unit 65 has the same function as each unit of the control device 50 according to the first embodiment.

Further, the detection unit 61 detects biological information such as the occupant's heartbeat, line-of-sight movement, and face orientation based on the face image information acquired by the occupant camera 41. As described above, the heartbeat of the occupant can be detected based on the change in the color information of the face. The movement of the occupant's line of sight or the direction of the face can be detected based on the process of extracting the feature points of the eyes or the face from the face image.

The determination unit 63 determines the detection accuracy of the biological information based on the image pickup information of the occupant camera 41. The determination of the detection accuracy includes determining whether or not the detection accuracy may decrease. In the present embodiment, the determination unit 63 states that the detection accuracy of the biological information is lowered when the occupant's face region is irradiated with the external light in a state where the illuminance of the external light irradiating the vehicle 1 is high. judge. For example, when the change in the color temperature of the face is obtained based on the image pickup information of the occupant camera 41 and the heartbeat is detected based on the change in the color temperature, when the illuminance in the face area suddenly fluctuates or the light in the face area is detected. When the contrast between the image and the shadow occurs, the detection accuracy decreases. Further, when the movement of the line of sight is detected based on the image pickup information of the occupant camera 41, it is detected when the illuminance in the pupil area of the occupant suddenly fluctuates or when the contrast between light and shadow occurs in the pupil area. Accuracy is reduced.

The determination unit 63 determines whether or not the illuminance of the external light received by the vehicle 1 is equal to or greater than a predetermined threshold value. The predetermined threshold value is set to an appropriate value as a threshold value for determining that the current time is daytime and the weather is fine. Further, when the illuminance of the external light is equal to or higher than a predetermined threshold value, the determination unit 63 determines the detection accuracy of the biological information based on the image pickup information of the occupant camera 41 when the occupant's face area is irradiated with the external light. Judge that it is decreasing. At this time, the determination unit 63 may determine that the detection accuracy of the biological information is lowered when the occupant's face region is irradiated with external light for a predetermined time or longer set in advance. As a result, it is possible to prevent the improvement measures from being executed when the influence on the emergency stop control and the warning control is small. Whether or not the occupant's face area is irradiated with external light is determined by, for example, the current season, the time zone or the position of the sun, the position and orientation of the vehicle 1, the image pickup information of the occupant camera 41, and the seat position or the face. The judgment can be made based on the position information.

The determination unit 63 can acquire the current season and time zone from the date and time information. Further, the determination unit 63 can acquire the position of the sun from an external system such as a telematics service. Further, the determination unit 63 can acquire the position and orientation of the vehicle 1 from, for example, the GPS device 49. Further, the determination unit 63 can acquire the seat position or the face position from the sensor that detects the seat position or the image pickup information of the camera.

When the determination unit 63 determines the detection accuracy of the biometric information based on the value of the detected biometric information or the change in the output, the cause of the decrease in the detection accuracy is based on the information that may affect the detection accuracy described above. The improvement measure setting unit 71 may have a function of determining.

The improvement measure setting unit 71 sets an improvement measure for improving the detection accuracy when the determination unit 63 determines that the detection accuracy is lowered. In the present embodiment, the improvement measure setting unit 71 controls the external light adjustment unit 39 to set the improvement measure for adjusting the external light emitted to the face area of the occupant. In the present embodiment, the settable improvement measures include at least the improvement measures for controlling the sun visor control device 39a or the dimming glass control device 39b so that the occupant's face area is not irradiated with external light. The remedy setting unit 71 generates a control signal for controlling the external light adjusting unit 39, and transmits the control signal to the external light adjusting unit 39. The configurable remedy may include a remedy that presents the occupant with a recommendation to use the sun visor via the presentation unit 33. Further, the improvement measure setting unit 71 may be configured so that the improvement measure described in the first embodiment can be set together with the improvement measure by controlling the external light adjustment unit 39.

Upon receiving the control signal, the sun visor control device 39a adjusts at least one of the positions or angles of the sun visor according to the control signal. Alternatively, the dimming glass control device 39b that has received the control signal reduces the translucency of a part of the windshield or the side door glass according to the control signal. As a result, the outside light is blocked from irradiating the occupant's face area.

When the occupant whose biological information is to be detected is a driver, the improvement measure setting unit 71 sets the sun visor control device 39a or the dimming glass control device 39b so that a part of the occupant's face area is not irradiated with external light. In controlling, it is preferable to control so as not to block the view of the occupant. Specifically, the improvement measure setting unit 71 sets the position and orientation of the sun visor so that the area of the occupant's face area used for detecting biological information is not irradiated with external light while not obstructing the occupant's field of view. Alternatively, it is preferable to adjust the light-shielding range of the dimming glass. For example, when the heartbeat is detected based on the image of the cheek region in the face image acquired by the occupant camera 41, the cheek region is not irradiated with external light so as not to block the occupant's field of vision. It should be. Alternatively, when the movement of the line of sight is detected based on the image of the pupil in the face image acquired by the occupant camera 41, the area of the pupil is not irradiated with external light so as not to block the view of the occupant. It should be.

Further, when the sun visor control device 39a or the dimming glass control device 39b is controlled so that the occupant's face area is not irradiated with external light, the improvement measure setting unit 71 determines whether the operation mode of the vehicle 1 is the manual operation mode. The control may be changed depending on the automatic operation mode. For example, when the vehicle 1 is in automatic driving, even if the view of the occupant is obstructed, the influence on the operation of the vehicle 1 is small, but when the vehicle 1 is in manual driving, the view of the occupant is obstructed. That must be avoided. Therefore, when the improvement measure setting unit 71 controls the sun visor control device 39a or the dimming glass control device 39b during manual operation, the sun visor control device 39a or the dimming glass control device 39b is used so as not to block the view of the occupant. It is preferable to control. At this time, even if the vehicle 1 is in automatic driving, the light-shielding range may be different depending on the level of automatic driving (first level (level 1) to level 4). Specifically, the sun visor control device 39a or the dimming glass control device 39b may be controlled so that the lower the level of automatic driving, the smaller the range that blocks the view of the occupant.

Further, when the external light adjusting unit 39 is adjusted so that the specific area used for detecting the biological information is not irradiated with the external light and the visibility of the occupant is obstructed, the improvement measure setting unit 71 uses the living body in the facial image. A specific area used for detecting information may be changed. For example, when the detection unit 61 detects the heartbeat based on the image of the cheek region of the occupant, adjusting the external light adjustment unit 39 so that the cheek region is not irradiated with external light blocks the occupant's field of vision. The area used by the detection unit 61 for detecting the heartbeat may be changed to the forehead area. Alternatively, the improvement measure setting unit 71 may specify a region of the occupant's face region that is not irradiated with external light, and change the region so that the heartbeat is detected based on the image of the region. As a result, it is possible to form a region in a part of the face region where the influence of external light can be reduced without obstructing the occupant's field of view, and to suppress a decrease in heartbeat detection accuracy.

Further, the settable improvement measures may include an improvement measure that controls the driving of the vehicle 1 and prevents the face region from being irradiated with external light by utilizing the external environment. For example, the improvement measure setting unit 71 determines whether or not there is a large vehicle around the vehicle 1 based on the information on the surrounding environment of the vehicle 1 transmitted from the forward monitoring camera mounted on the vehicle 1, the RiDAR device, and the like. Is determined. Further, when the improvement measure setting unit 71 determines that there is a vehicle in the vicinity, the current season, the time zone or the position of the sun, the position and orientation of the vehicle 1, the image information of the occupant camera 41, and the seat position or face. It is determined whether or not the external light emitted to the face region by the shadow of the surrounding vehicle can be blocked by using the information on the position of the surrounding vehicle together with the information on the position of the surrounding vehicle. When the improvement measure setting unit 71 can block the external light radiated to the face region by the shadow of the surrounding vehicle, the improvement measure setting unit 71 controls the vehicle drive control device 37 so that the vehicle 1 travels at the position.

(2. Operation example of vehicle control device)
Next, an example of the operation of the control process by the control device 50A will be described with reference to the flowcharts shown in FIGS. 6 to 7.

First, the determination unit 63 of the control device 50A determines whether or not there is an occupant whose biological information is to be detected (step S41). For example, the determination unit 63 may determine whether or not there is an occupant based on the captured image acquired by the occupant camera 41. In addition, the determination unit 63 may determine whether or not there is an occupant by using various means such as a load sensor provided on the seat and a sensor for detecting the wearing of the seat belt. When there is no occupant to detect the biological information (S41 / No), the determination unit 63 ends this routine and returns to step S41.

On the other hand, when there is an occupant whose biological information is to be detected (S41 / Yes), the determination unit 63 determines whether or not the illuminance of the external light irradiating the vehicle 1 is high (step S43). For example, the determination unit 63 determines whether or not the illuminance of the outside light is 100,000 lux or more. Specifically, the determination unit 63 may determine whether or not the illuminance of the external light is high by determining whether or not the brightness of the captured image acquired by the occupant camera 41 is equal to or greater than a predetermined threshold value. good. In addition, the determination unit 63 may determine whether or not the illuminance of the outside light is high by using various means such as an illuminance meter installed in the vehicle 1. When the illuminance of the outside light is not high (S43 / No), the determination unit 63 ends this routine and returns to step S41.

On the other hand, when the illuminance of the external light is high (S43 / Yes), the determination unit 63 determines whether or not the occupant's face region is irradiated with the external light (step S45). For example, the determination unit 63 identifies the occupant's face area based on the image captured by the occupant camera 41 and determines whether or not the brightness of the face area is equal to or greater than a predetermined threshold value. It may be determined whether or not the face region of the camera is irradiated with external light. At this time, the determination unit 63 may determine whether or not the specific region of the occupant's face region used for detecting the biological information is irradiated with external light. Whether or not the occupant's face area is irradiated with external light is information such as the traveling area, traveling position, traveling direction, road surface inclination, time, sun direction, occupant's posture, and face position of the vehicle 1. It may be estimated based on. When the occupant's face area is not irradiated with external light (S45 / No), the determination unit 63 ends this routine and returns to step S41.

On the other hand, when the occupant's face area is irradiated with external light (S45 / Yes), the improvement measure setting unit 71 of the control device 50A prevents the occupant's face area from being irradiated with external light to detect biological information accurately. (Step S47). For example, the improvement measure setting unit 71 may control the sun visor control device 39a or the dimming glass control device 39b to block the outside light so that the area of the occupant's face is not irradiated with the outside light. The occupant may be notified to block the outside light by using a sun visor, or the occupant may block the outside light to the area of the occupant's face by using the external environment such as a large surrounding vehicle.

FIG. 7 is a flowchart showing an example of shading control processing by the improvement measure setting unit 71. In the operation example described here, the improvement measure setting unit 71 controls the dimming glass control device 39b to set an improvement measure for blocking the external light emitted to the face area of the occupant. When the improvement measure is set, the improvement measure setting unit 71 generates a control signal of the dimming glass control device 39b and transmits the control signal to the dimming glass control device 39b.

First, the improvement measure setting unit 71 calculates a dimming range A that can prevent the occupant's face region from being irradiated with external light in the dimming range by the dimming glass (step S51). For example, the improvement measure setting unit 71 sets the dimming range A based on information such as the traveling area, the traveling position, the traveling direction, the inclination of the road surface, the time, the direction of the sun, the posture of the occupant, and the position of the face of the vehicle 1. Can be calculated.

Next, the improvement measure setting unit 71 determines whether or not the driving mode of the vehicle 1 is the automatic driving mode (step S53). When the operation mode is the automatic operation mode (S53 / Yes), the improvement measure setting unit 71 generates a control signal that reduces the translucency of the dimming glass in the dimming range A, and sets the control signal to the dimming glass. It is transmitted to the control device 39b (step S55). As a result, the external light radiated to the occupant's face area is blocked. Since the vehicle 1 is in automatic driving, even if the field of view of the operator is obstructed, there is little hindrance to driving, and it is possible to improve the detection accuracy of biological information while ensuring the driving safety of the vehicle 1. ..

On the other hand, when the operation mode is not the automatic operation mode (S53 / No), the improvement measure setting unit 71 blocks the view of the occupant when the translucency is lowered in the dimming range by the dimming glass. The dimming range B is calculated (step S57). For example, the improvement measure setting unit 71 sets the dimming range B based on information such as the traveling area, the traveling position, the traveling direction, the inclination of the road surface, the time, the direction of the sun, the posture of the occupant, and the position of the face of the vehicle 1. Can be calculated. Specifically, the improvement measure setting unit 71 calculates a range in which the looking-up angle and the looking-down angle are appropriate angles with respect to the direction of the occupant's line of sight as the dimming range B that blocks the occupant's field of vision. As an example, the looking-up angle may be set to 3 degrees upward with respect to the direction of the line of sight, and the looking-down angle may be set to 1 degree downward with respect to the direction of the line of sight.

Next, the improvement measure setting unit 71 determines whether or not the dimming range A and the dimming range B overlap (step S59). When the dimming range A and the dimming range B do not overlap (S59 / No), there is no risk of obstructing the occupant's view even if the translucency of the dimming range A is reduced. 71 generates a control signal for reducing the translucency of the dimming glass in the dimming range A, and transmits the control signal to the dimming glass control device 39b (step S55).

On the other hand, when the dimming range A and the dimming range B overlap (S59 / Yes), if the translucency of the dimming range A is lowered, the view of the occupant may be obstructed. The unit 71 generates a control signal for reducing the translucency of the dimming glass in the dimming range A excluding the dimming range B, and transmits the control signal to the dimming glass control device 39b (step S61). As a result, the external light radiated to the face area is blocked within a range that does not block the occupant's field of vision. At this time, all the translucency of the dimming range A that does not overlap with the dimming range B may be lowered, and only the range of the dimming range A that does not overlap with the dimming range B and the detection accuracy is improved is transparent. The lightness may be reduced.

Therefore, even when the vehicle 1 is manually driven, the external light to the face region is blocked so as not to block the view of the occupant, and the detection accuracy of the biological information is suppressed while suppressing the deterioration of the driving safety of the vehicle 1. Can be improved. At that time, the improvement measure setting unit 71 may change a specific region of the face region in the captured image used for detecting biological information. Thereby, the detection accuracy of the biological information can be ensured.

As described above, according to the control device 50A according to the present embodiment, when the detection accuracy of the biological information detected based on the captured image acquired by the occupant camera 41 is lowered, the occupant's face area is irradiated to the outside. Improvement measures to block light are set. Therefore, it is possible to prevent the brightness and darkness in the region used for detecting the biological information from becoming too bright, and improve the detection accuracy. In addition, in the region used for detecting biological information, the region irradiated with external light and the region not irradiated with external light do not coexist, and the detection accuracy can be improved.

Further, according to the control device 50A according to the present embodiment, when the external light emitted to the occupant's face area is blocked so as not to block the occupant's field of view, the detection accuracy of the biological information is lowered. While suppressing it, it is possible to suppress a decrease in driving safety. Further, according to the control device 50A according to the present embodiment, when blocking the external light emitted to the face area so as not to block the view of the occupant, the external light is emitted depending on whether the vehicle 1 is in automatic driving or manual driving. The area to be blocked can be different. As a result, it is possible to further suppress the decrease in driving safety while suppressing the decrease in the detection accuracy of biological information.

Further, according to the control device 50A according to the present embodiment, if the external light is blocked so as not to block the view of the occupant, the irradiation of the external light to a specific area for detecting biological information cannot be blocked. Can be modified to a specific region for detecting the biometric information. Therefore, it is possible to continue the detection of the biological information while maintaining the detection accuracy of the biological information.

Although the preferred embodiments of the present invention have been described in detail with reference to the accompanying drawings, the present invention is not limited to such examples. It is clear that a person having ordinary knowledge in the field of technology to which the present invention belongs can come up with various modifications or modifications within the scope of the technical idea described in the claims. , These are also naturally understood to belong to the technical scope of the present invention.

For example, in each of the above embodiments, when it is determined that there is an abnormality in the body of the occupant, the control for stopping the vehicle safely and promptly is performed, but the vehicle is stopped urgently. Instead of control, automated driving control may be configured to guide the vehicle to an appropriate nearby hospital.

Further, in each of the above embodiments, when the biological information is detected based on the image pickup information acquired by the occupant camera 41, the determination unit 63 uses the image of the occupant's face acquired each time as a predetermined reference image. The detection accuracy of biological information may be determined by comparison. For example, the vehicle control device has a reference image storage unit that stores a reference image captured in a state where the occupant's face area is not irradiated with external light in the storage unit 55 together with information on the driving environment in the state. You may prepare. The information on the traveling environment of the vehicle associated with the reference image includes information such as the traveling area of the vehicle 1, the traveling position, the traveling direction, the inclination of the road surface, the time, the direction of the sun, the posture of the occupant, and the position of the face. The determination unit 63 determines the detection accuracy of the biological information by selecting a reference image that matches the current driving environment from the accumulated reference images and comparing it with the face image of the current occupant. This makes it possible to set improvement measures for improving biological information according to the traveling environment of the vehicle 1.

Further, when the occupant whose biological information is detected by the vehicle control device is the driver, the reference image storage unit interferes with the occupant's driving even if the external light radiated to the occupant's face area is blocked. The reference image may be acquired by causing the external light adjusting unit 39 to perform control to block external light under the condition that there is no light. This makes it possible to preset the shading range by the sun visor or the dimming glass in order to implement the improvement measures for improving the biological information according to the driving environment of the vehicle 1, and improve the detection accuracy of the biological information. Certainty can be increased.

31 ... Input unit, 33 ... Presentation unit, 37 ... Vehicle drive control device, 41 ... Crew camera, 43 ... Optical sensor, 45 ... Accelerometer, 47 ... Biological information detector, 50 ... Vehicle control device, 53 ... Arithmetic processing Device, 55 ... storage unit, 61 ... detection unit, 63 ... estimation unit, 65 ... control unit, 67 ... emergency stop control unit, 69 ... warning control unit, 71 ... improvement measure setting unit,

Claims (18)

A detector that detects the biological information of the occupants of the vehicle,
A determination unit that determines the detection accuracy of biological information by the detection unit, and
When the detection accuracy of the biometric information is lowered, the improvement measure setting unit for setting the improvement measure for improving the detection accuracy, and the improvement measure setting unit.
A vehicle control device. The vehicle control device according to claim 1, wherein the improvement measure setting unit estimates the cause of the decrease in detection accuracy and sets an improvement measure for eliminating the cause. The vehicle control device according to claim 1 or 2, wherein the improvement measure setting unit sets the improvement measure based on a priority according to an attribute or a state of the occupant. The vehicle control device according to claim 1 or 2, wherein the improvement measure setting unit sets the improvement measure based on a priority according to a traveling state of the vehicle. The vehicle control device according to any one of claims 1 to 4, wherein the improvement measure setting unit sets a priority based on the difficulty of executing the improvement measure. The vehicle control device according to any one of claims 1 to 5, further comprising a presentation unit for presenting the improvement measure set by the improvement measure setting unit to the occupant. The vehicle control device according to any one of claims 1 to 5, wherein the improvement measure setting unit transmits a control signal to a predetermined device that executes the improvement measure. The detection unit detects the biological information of the occupant based on the image taken by the camera that captures the face of the occupant.
The improvement measure setting unit executes a process of reducing the influence of the external light on the face area when the irradiation state of the external light on the face area of the occupant is in a predetermined state. The vehicle control device according to any one of claims 1 to 7. The vehicle control device according to claim 8, wherein the improvement measure setting unit sets an improvement measure for blocking the external light applied to the face of the occupant. The biological information is information detected based on an image of a specific region of the occupant's face.
The vehicle control device according to claim 8 or 9, wherein the improvement measure setting unit sets an improvement measure for blocking the external light emitted to the specific area. The vehicle control device according to claim 9 or 10, wherein the improvement measure setting unit executes a process of blocking the external light by controlling an external light adjusting unit provided in the vehicle. The vehicle control device according to claim 11, wherein the external light adjusting unit is a sun visor control device or a dimming glass control device. When the occupant whose body information is to be detected is the operator of the vehicle,
The vehicle control device according to any one of claims 8 to 12, wherein the improvement measure setting unit sets an improvement measure for blocking the outside light so as not to obstruct the view of the operator. When the occupant whose body information is to be detected is the operator of the vehicle,
When it is presumed that the field of view of the operator is obstructed by blocking the external light that irradiates the specific area, the improvement measure setting unit sets the specific area used for detecting the biological information. The vehicle control device according to claim 10, wherein the area is changed to. The vehicle is a vehicle in which an automatic driving mode and a manual driving mode can be selected.
The vehicle control device according to claim 13 or 14, wherein the improvement measure setting unit sets improvement measures so as not to obstruct the view of the operator when the vehicle is in the manual driving mode. The vehicle control device according to claim 8 or 9, wherein the improvement measure setting unit controls the running of the vehicle so that the external light emitted to the face region by the external environment of the vehicle is blocked. A reference image storage unit for storing a reference image captured in a state where the occupant's face area is not irradiated with external light together with information on the driving environment in the state is further provided.
Any one of claims 8 to 16, wherein the determination unit determines the detection accuracy of the biological information by comparing the acquired image of the occupant's face with the reference image matching the current driving environment. The vehicle control device according to. When the occupant whose body information is to be detected is the operator of the vehicle,
When the reference image storage unit blocks the external light to the facial area of the operator in order to capture the reference image in a state where the external light is not applied to the facial area of the occupant. The vehicle control device according to claim 17, wherein the control for blocking the outside light is executed and the reference image is acquired under conditions that do not hinder driving even if there is any.

Images