JP7376389B2 - Vehicle control system - Google Patents

Description

The present invention relates to a vehicle control system.

Conventionally, various techniques have been proposed for measuring biological information such as heartbeat, respiration, and body temperature of a driver who operates a vehicle. When measuring a driver's biological information, it is conceivable to measure it using a contact-type detector worn on the driver's body, such as a wearable device. For example, Patent Document 1 discloses a technology that measures a user's biological information using a wearable device worn by the user and utilizes it for predetermined control in a vehicle.

However, when using a wearable device all the time, the power of the wearable device is consumed and the usage time is limited. In addition, in the case of a human body-worn type detector, there is a risk that the driver may find it troublesome to wear the sensor or feel troublesome while wearing the sensor, so it is desirable to use a detector installed in the vehicle. For example, Patent Document 2 describes a technology that detects the driver's pulse using a non-contact radio pulse sensor built into the backrest of the driver's seat, and a technology that uses an in-vehicle camera to detect the driver's body temperature. is disclosed. Further, Patent Document 3 discloses a technique for detecting a driver's heartbeat using a radio wave-type non-modulated Doppler sensor. Additionally, Patent Document 4 discloses a technique for extracting changes in facial color corresponding to pulse waves using an in-vehicle camera.

Japanese Patent Application Publication No. 2017-131445 JP2018-019882A Japanese Patent Application Publication No. 2010-120493 Japanese Patent Application Publication No. 2018-127112

However, the detection accuracy of a detector installed in a vehicle may be reduced due to factors such as the driving condition of the vehicle and the light environment inside the vehicle. When the detection accuracy of biological information decreases, the accuracy of control performed using the biological information decreases. Additionally, if the detection accuracy of biometric information by a detector installed in a vehicle decreases, it is possible to stop the execution of control using the biometric information, but such control often stops. If this happens, biometric information will not be used effectively.

The present invention has been made in view of the above-mentioned problems, and an object of the present invention is to provide a detector mounted on an occupant according to the detection accuracy of biological information detected by a detector installed in a vehicle. An object of the present invention is to provide a vehicle control system that can perform control utilizing biological information while suppressing power consumption of a detector attached to an occupant by effectively utilizing biological information detected by the vehicle occupant.

In order to solve the above problems, according to one aspect of the present invention, a first detector is provided in a vehicle to detect biometric information of an occupant of the vehicle, and a first detector is attached to the occupant to detect biometric information of the occupant. The controller includes a second detector, an estimation unit that estimates detection accuracy of biological information by the first detector, and a control unit that executes a predetermined control process based on the biological information. When the detection accuracy of the second detector is estimated to be high, the detection function of the second detector is stopped and a predetermined control process is executed using the biological information detected by the first detector, and the first When the detection accuracy of the second detector is estimated to be low, a predetermined control process is executed using the biological information detected by the second detector , and the detection function of the second detector is stopped. A vehicle control system is provided that allows a second detector to share biological information detected by a first detector .

The control unit also stops the detection function of the second detector when the detection accuracy of the first detector is estimated to be high, and stops the detection function of the second detector when the detection accuracy of the first detector is estimated to be low. Additionally, the detection function of the second detector may be activated.

The control unit may also correct the biological information detected by the first detector based on the biological information detected by the second detector while the detection function of the second detector is activated. good.

In addition, when the detection accuracy of the first detector is estimated to be low, the control unit corrects the biological information detected by the first detector based on the biological information detected by the second detector. You may.

In addition, the control unit adjusts the correction coefficient when correcting the biological information detected by the first detector based on the biological information detected by the second detector, as the detection accuracy by the first detector is lower. may be made larger.

The control unit also includes a correction coefficient for correcting the biological information detected by the first detector based on the detection accuracy by the first detector and the biological information detected by the second detector; After calculating the correlation, the detection function of the second detector may be stopped, and the biological information detected by the first detector may be corrected based on the correlation.

In addition, the first detector includes a camera that photographs the occupant, a pressure measuring device that measures the sitting pressure distribution when the occupant is seated, a microwave sensor that detects the occupant's heartbeat, and a sensor embedded in the steering wheel that measures the occupant's seat pressure. at least one of an electrode set for measuring the heartbeat or electrocardiogram of the passenger, a displacement sensor for detecting changes in the position of the seat belt, a TOF sensor for detecting the passenger's position, or a thermography for detecting the passenger's body temperature. May include.

Furthermore, the second detector may be a wearable device that is operated by charging power of a built-in battery.

As explained above, according to the present invention, by effectively utilizing the biological information detected by the detector mounted on the occupant according to the detection accuracy of the biological information detected by the detector installed in the vehicle, It is possible to perform control utilizing biological information while suppressing power consumption of a detector attached to an occupant.

1 is a block diagram showing an example of a schematic configuration of a vehicle control system according to a first embodiment of the present invention. FIG. 2 is an explanatory diagram illustrating an example of a method for estimating detection accuracy of biological information. It is a flow chart which shows an example of control performed by a control device of a control system for vehicles concerning the same embodiment. It is a flow chart which shows another example of control performed by a control device of a control system for vehicles concerning the same embodiment.

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings. Note that, in this specification and the drawings, components having substantially the same functional configurations are designated by the same reference numerals and redundant explanation will be omitted.

<1. Configuration example of vehicle control system>
First, a configuration example of a vehicle control system according to an embodiment of the present invention will be described. FIG. 1 is a block diagram showing a configuration example of a vehicle control system 10 according to the present embodiment. In this embodiment, an example will be described in which a heartbeat is detected as the occupant's biological information and a predetermined control is executed based on the detected heartbeat.

The vehicle control system 10 includes an occupant camera 41 as a first detector, a wearable device 20 as a second detector, and a control device 50. The control device 50 includes, for example, an arithmetic processing unit such as a CPU (Central Processing Unit) or an MPU (Micro Processing Unit), and a storage element such as a RAM (Random Access Memory) or a ROM (Read Only Memory). . Part or all of the control device 50 may be configured with something that can be updated, such as firmware, or may be a program module or the like executed by a command from a CPU or the like.

The occupant camera 41 as a first detector is connected to the control device 50 directly or via a communication line such as a CAN (Controller Area Network) or a LIN (Local Inter-Net). The occupant camera 41 is one aspect of a first detector installed in the vehicle interior and used to detect biological information of the occupant. In this embodiment, the passenger camera 41 is a non-contact type detector that does not come into direct contact with the human body of the passenger, and is installed so as to be able to photograph at least the driver's face. The occupant camera 41 includes an imaging device such as a CCD (Charge Coupled Device) or a CMOS (Complementary Metal Oxide Semiconductor), and the imaging information acquired by the occupant camera 41 is transmitted to the control device 50. The control device 50 detects the passenger's heartbeat based on changes in facial color information detected based on imaging information from the passenger camera 41.

Note that the first detector provided in the vehicle is not limited to the occupant camera 41 for detecting the heartbeat of the occupant. For example, the occupant camera 41 may be used to detect the occupant's body temperature. Further, the first detector may be a radio wave (microwave) type Doppler sensor for detecting the passenger's heartbeat, or a non-contact type pulse sensor for detecting the passenger's pulse. good. Further, the first detector may be an electrode set embedded in the steering wheel to measure the heartbeat or electrocardiogram of the occupant. Further, the first detector may be a pressure measuring device embedded in the seat of the driver's seat in order to measure the distribution of sitting pressure when the occupant is seated in the driver's seat. Furthermore, the first detector may be a displacement sensor that detects changes in the position of the seat belt in order to measure the heartbeat or respiration of the occupant. Further, the first detector may be a TOF (Time of Flight) sensor for detecting information on the position of the occupant (biological position). Further, the first detector may be a thermograph for measuring the surface temperature of the skin of the occupant.

Wearable device 20, which serves as a second detector worn by the occupant, is connected to control device 50 via wired or wireless communication means. The wearable device 20 is one embodiment of a contact-type second detector that is worn on an occupant and used to detect biological information of the occupant. For example, the wearable device 20 has a function of being worn on the passenger's wrist, arm, or the like and measuring the passenger's heartbeat. The biometric information detected by the wearable device 20 includes at least the same biometric information as the biometric information detected by the occupant camera 41. The biometric information detected by the wearable device 20 is configured to be transmitted to the control device 50. Furthermore, at least the function of detecting heartbeat among the functions of the wearable device 20 is configured to be activated or deactivated by remote control from the control device 50.

Note that the first detector installed in the vehicle is not attached to a vehicle occupant such as a driver, but is a sensor device installed in the vehicle to detect the occupant's biological information. It is a sensor device with a low sense of what is happening. The first detector operates by receiving power from the vehicle's power source, for example. In addition, the second detector worn on the occupant is a sensor device that is attached to the occupant of the vehicle such as the driver to detect the occupant's biological information, and is a wristwatch type or a head or arm type sensor device. The following devices are exemplified. The second detector is operated by charging power from a built-in battery.

In this embodiment, the control device 50 includes a communication section 51, an arithmetic processing device 53, and a storage section 55. The communication unit 51 has an interface function for transmitting and receiving signals between the wearable device 20 and the control device 50. For example, the communication unit 51 can communicate with the wearable device 20 via wireless communication means such as Bluetooth (registered trademark), NFC (Near Field Communication), WiFi (wireless fidelity), and wireless LAN (Local Area Network). It is configured.

The arithmetic processing unit 53 is configured of at least one CPU or MPU as described above, and executes various arithmetic processes by executing programs stored in the storage unit 55. In addition to or instead of a memory element such as a RAM or ROM, the memory unit 55 includes a HDD (Hard Disk Drive), a CD (Compact Disc), a DVD (Digital Versatile Disc), an SSD (Solid State Drive), It may also include a storage medium such as a USB (Universal Serial Bus) flash or a storage device.

The control device 50 is connected to the optical sensor 43 and the acceleration sensor 45 directly or via a communication line such as a CAN (Controller Area Network) or a LIN (Local Inter-Net).

The optical sensor 43 is installed inside the vehicle interior and is used to measure an index value related to the brightness and darkness inside the vehicle. In particular, in this embodiment, the optical sensor 43 is installed so as to be able to measure the brightness and darkness around the driver's face in the driver's seat. The index value of brightness may be, for example, brightness, brightness, or illuminance. The type of optical sensor 43 is not particularly limited, and any known optical sensor can be used as appropriate. A sensor signal from the optical sensor 43 is transmitted to the control device 50 . The control device 50 estimates the detection accuracy of the passenger's heartbeat based on the sensor signal from the optical sensor 43.

The acceleration sensor 45 is provided in a vehicle and used to measure vibrations of the vehicle. The acceleration sensor 45 may be an acceleration sensor provided for use in drive control of the vehicle. A sensor signal from acceleration sensor 45 is transmitted to control device 50 . Control device 50 detects vibrations of the vehicle based on a sensor signal from acceleration sensor 45. Note that when another control device detects vehicle vibration based on a sensor signal of an acceleration sensor, the control device 50 may acquire information on vehicle vibration from the other control device.

Further, the control device 50 is connected to the input section 31, the display section 33, and the vehicle drive control device 37 directly or via a communication line such as CAN or LIN. The input unit 31 receives operation input from a user (for example, a passenger) to the control device 50 . The input unit 31 may be, for example, a touch panel display or a dial operation device.

The display unit 33 is, for example, a display panel provided on a dashboard or a HUD (Head Up Display) projected onto a front window, and presents information so that the occupant can view it. The display unit 33 may be a meter display device in an instrument panel, a display device of a navigation system, or a multi-function display that presents various information. However, the display section 33 is not limited to the above-described display panel or HUD. Further, the display section 33 may be integrated with the input section 31.

The vehicle drive control device 37 is a control unit that executes drive control of the vehicle, and includes one or more controls that control the drive of an engine (not shown), one or more drive motors, a steering system, a brake system, etc. Consists of devices. The vehicle drive control device 37 basically executes drive control of the vehicle based on the driving operation of the occupant. Further, the vehicle drive control device 37 executes control to emergency stop the vehicle based on a command from the control device 50 according to the present embodiment.

The arithmetic processing device 53 includes a detection section 61, an estimation section 63, and a control section 65. The control section 65 includes an emergency stop control section 67 and a warning control section 69. Specifically, each of these units of the arithmetic processing device 53 is a function realized by execution of a program by the arithmetic processing device 53.

The detection unit 61 detects biological information of a vehicle occupant. In this embodiment, the detection unit 61 detects the passenger's heartbeat based on imaging information transmitted from the passenger camera 41. Specifically, the detection unit 61 executes image processing based on the imaging information transmitted from the passenger camera 41, and measures the passenger's heartbeat based on changes in facial color information.

The estimation unit 63 estimates the detection accuracy of biological information by the occupant camera 41. In the present embodiment, the estimation unit 63 estimates the heartbeat detection accuracy based on information that may affect the detection accuracy of the passenger's facial color information by the passenger camera 41. FIG. 2 is an explanatory diagram showing an example of a method for estimating the heartbeat detection accuracy by the estimation unit 63. In the present embodiment, the estimating unit 63 estimates the accuracy of heartbeat detection by the occupant camera 41 based on the brightness and darkness of the vehicle interior, the amount of shadow cast on the occupant's face by light, and the magnitude of vehicle vibration. . In the present embodiment, the estimating unit 63 estimates the level of accuracy of heartbeat detection by the occupant camera 41 by dividing it into three levels: a first level (level 1) to a third level (level 3).

The brightness and darkness in the vehicle interior can be detected based on a sensor signal from the optical sensor 43. For example, the estimation unit 63 determines whether the detected brightness/darkness index value is within an appropriate range. Further, the magnitude of vibration of the vehicle can be detected based on a sensor signal from the acceleration sensor 45. For example, the estimation unit 63 specifies the cycle or amplitude of vibration of the vehicle in a predetermined direction based on the sensor signal of the acceleration sensor 45, and determines whether the vibration of the vehicle is large or small. Further, the amount of shadow cast on the occupant's face by light can be detected by image processing the image information of the occupant's face captured by the occupant camera 41. For example, the estimating unit 63 calculates the shadow caused by light based on the ratio of pixels or pixel groups whose brightness index value is less than a predetermined value to the pixels or pixel groups of the entire area corresponding to the passenger's face recognized by image processing. It may also be determined whether the number of occurrences is high or low.

In the example shown in FIG. 2, when the index value of the brightness in the vehicle interior is outside the appropriate range, the estimation unit 63 sets the level of accuracy of heartbeat detection by the passenger camera 41 to the first level (level 1). . For example, when the brightness index value in the vehicle interior is too high (too bright), such as when the setting sun is dazzling, the facial image of the passenger photographed by the passenger camera 41 becomes too bright, and the color information of the passenger's face is lost. Accurate detection may become difficult. On the other hand, if the index value of the brightness in the vehicle interior is too low (too dark), the facial image of the passenger photographed by the passenger camera 41 becomes too dark, making it difficult to accurately detect the color information of the passenger's face. There is a risk of it becoming. Therefore, when the index value of brightness and darkness in the vehicle interior is outside the appropriate range, the estimation unit 63 determines the level of heartbeat detection accuracy by the passenger camera 41 regardless of the amount of shadows caused by light and the magnitude of vehicle vibration. Set to the first level (level 1).

Further, when the index value of the brightness and darkness in the vehicle interior is within the appropriate range, the estimation unit 63 calculates the heart rate detected by the occupant camera 41 based on the amount of shadows cast on the occupant's face by light and the magnitude of vibration of the vehicle. The detection accuracy level is set to one of the first level (level 1) to the third level (level 3). In this case, the estimation unit 63 increases the level of accuracy in detecting the heartbeat by the occupant camera 41 (higher detection accuracy) as the amount of shadow cast on the passenger's face by light is smaller, and the smaller the vibration of the vehicle, the higher the level of heartbeat detection accuracy. Increase the level of detection accuracy. Note that the level of accuracy of heartbeat detection by the occupant camera 41 does not need to be three levels, but may be two levels, or may be four levels or more. The greater the number of levels of heartbeat detection accuracy, the higher the accuracy of heartbeats after correction processing, which will be described later. Furthermore, the estimation unit 63 may further estimate the heartbeat detection accuracy based on the movement of the occupant's face. For example, when driving around a curve or an intersection, the occupant may turn his/her head in the direction of travel, and in such a case, there is a risk that the accuracy of detecting the color information of the occupant's face may decrease. Therefore, the estimating unit 63 may determine that the heartbeat detection accuracy is reduced when the passenger's face imaged by the passenger camera 41 faces outside a predetermined range.

The control unit 65 executes predetermined control based on biological information. For example, the emergency stop control unit 67 of the control unit 65 executes control to bring the vehicle to an emergency stop when an abnormality in the occupant's body is detected based on the detected heartbeat of the occupant. Specifically, the emergency stop control unit 67 transmits an emergency stop command to the vehicle drive control device 37 to stop the vehicle safely and quickly. For example, the vehicle is equipped with detection equipment such as a camera or radar that detects the surrounding environment of the vehicle, and the vehicle drive control device 37 that receives the emergency stop command is configured to control the engine, one or more drive motors, the steering system, and the like. Controls the brake system to stop the vehicle on the side of the road where there is enough space to prevent the vehicle from colliding with people, other vehicles, or other obstacles.

Further, the warning control unit 69 of the control unit 65 executes control to issue a warning of a physical abnormality when an abnormality in the body of the occupant is detected based on the detected heartbeat of the occupant. Specifically, when an abnormality in the body of the occupant is detected, the warning control unit 69 transmits a warning command to the warning device 35 to warn of the abnormality in the body. Upon receiving the warning command, the warning device 35 performs an operation to warn the occupant of an abnormality in the body by means of a warning sound, voice, lighting of a warning lamp, generation of vibration, or the like.

Here, when the accuracy of heartbeat detection by the occupant camera 41 is estimated to be high, the control unit 65 of the control device 50 according to the present embodiment generates information about the heartbeat detected by the occupant camera 41 (hereinafter, first information). The biological information detected by the detector (also referred to as "first biological information") is used to execute control to warn of abnormalities in the body and control to emergency stop the vehicle. In addition, when it is estimated that the accuracy of heartbeat detection by the passenger camera 41 is low, the control unit 65 controls the information about the heartbeat detected by the wearable device 20 (hereinafter referred to as the biological information detected by the second detector). control to warn of abnormalities in the body and control to emergency stop the vehicle is executed using the second biological information).

If the heartbeat detection accuracy by the occupant camera 41 is high or low, it can be set in advance according to the level of heartbeat detection accuracy estimated by the estimation unit 63. For example, if the level of accuracy of heartbeat detection by the passenger camera 41 is a third level (level 3), it is determined that the heartbeat detection accuracy is high, but if the level of accuracy of heartbeat detection by the passenger camera 41 is a second level It may be determined that the heartbeat detection accuracy is low when the level (level 2) or the first level (level 1) is reached.

When the accuracy of heartbeat detection by the occupant camera 41 is high, the control unit 65 performs predetermined control using the first biological information detected by the occupant camera 41, so that the control unit 65 detects at least a heartbeat with respect to the wearable device 20. Sends a command to stop the function. Furthermore, when the heartbeat detection function of the wearable device 20 is in a stopped state and the accuracy of heartbeat detection by the occupant camera 41 becomes low, the control unit 65 uses the second biological information detected by the wearable device 20 to perform a predetermined detection function. In order to perform this control, a command to activate at least a heartbeat detection function is transmitted to the wearable device 20. As a result, predetermined control can be executed using heartbeat information with high detection accuracy, and during a period when the passenger camera 41 has high heartbeat detection accuracy, the power consumption of at least the heartbeat detection function of the wearable device 20 is reduced. is suppressed.

Further, the control unit 65 transmits the first biological information detected by the occupant camera 41 to the wearable device 20 during the period when the heartbeat detection function of the wearable device 20 is in a stopped state. As a result, the heartbeat detection data stored in the wearable device 20 is supplemented, and the function of detecting biological information by the wearable device 20 alone is ensured. When the wearable device 20 is switched from the stopped state to the activated state, the control unit 65 transmits to the wearable device 20 all the first biological information detected and stored while the wearable device 20 is in the stopped state. Alternatively, the first biological information detected and stored at predetermined time intervals may be transmitted to the wearable device 20 while the wearable device 20 is in a stopped state. Furthermore, while the wearable device 20 is in a stopped state, the control unit 65 may transmit the first biometric information to the wearable device 20 each time the first biometric information is detected. From the viewpoint of suppressing consumption, it is preferable to transmit the first biological information detected and stored during a predetermined period to the wearable device 20 all at once.

<2. Operation example of vehicle control system>
Next, an example of the operation of the vehicle control system 10 according to the present embodiment will be described. FIG. 4 is a flowchart schematically showing an example of control operation by the control device 50.

First, the estimation unit 63 of the control device 50 calculates information used for estimating the detection accuracy of biological information by the first detector (step S11). As described above, in this embodiment, the estimating unit 63 uses the imaging information of the occupant camera 41 based on the brightness and darkness of the vehicle interior, the amount of shadow cast on the occupant's face by light, and the magnitude of vehicle vibration. Estimate the heartbeat detection accuracy based on Specifically, the estimation unit 63 calculates an index value of brightness in the vehicle interior, particularly an index value of brightness near the face of the occupant, based on the sensor signal of the optical sensor 43. Furthermore, the estimation unit 63 calculates the amount of shadow cast on the face of the passenger by light by image processing the image information of the face of the passenger captured by the passenger camera 41. Furthermore, the estimation unit 63 calculates the magnitude of vibration of the vehicle based on the sensor signal of the acceleration sensor 45.

Next, the estimation unit 63 estimates the detection accuracy of biological information by the first detector (step S13). In this embodiment, the estimating unit 63 sets the level of heartbeat detection accuracy by the passenger camera 41 to a first level (level 1) to a third level according to a preset detection accuracy estimation method (see FIG. 2). The estimation is divided into three levels (Level 3). Next, the control unit 65 determines whether the estimated heartbeat detection accuracy is high (step S15). For example, the control unit 65 determines that the detection accuracy is high when the level of heartbeat detection accuracy is the third level (level 3), and determines that the detection accuracy is high when the level is the first level (level 1) and 2. is determined to be low.

If the detection accuracy of the heartbeat by the passenger camera 41 is high (S15/Yes), the control unit 65 uses the first biological information detected by the passenger camera 41 to perform control to warn of abnormalities in the body and emergency stop of the vehicle. A setting is made to execute control to cause the change to occur (step S17). Thereby, the emergency stop control section 67 and the warning control section 69 can perform predetermined control based on highly reliable heartbeat information.

Next, the control unit 65 determines whether the heartbeat detection function of the wearable device 20, which is the second detector, is activated (step S19). For example, if the wearable device 20 is configured to transmit a signal indicating that the heartbeat detection function has been switched to start or stop, the control unit 65 can determine whether the heartbeat detection function of the wearable device 20 is activated based on the information stored in the storage unit 55. Further, when the control unit 65 transmits a command to the wearable device 20 to switch the heartbeat detection function by starting or stopping, if the transmitted record is stored in the storage unit 55, the control unit 65: Based on the information stored in the storage unit 55, it can be determined whether the heartbeat detection function of the wearable device 20 is activated. Further, the control unit 65 may inquire of the wearable device 20 each time whether the heartbeat detection function is activated.

If the heartbeat detection function of the wearable device 20 is activated (S19/Yes), the control unit 65 transmits a command to the wearable device 20 to stop at least the heartbeat detection function (step S21). , proceed to step S23. On the other hand, if the heartbeat detection function of the wearable device 20 is in a stopped state (S19/No), the process directly advances to step S23.

Next, the control unit 65 transmits the first biological information detected by the occupant camera 41 to the wearable device 20 while the heartbeat detection function of the wearable device 20 is in a stopped state (step S23). As described above, when the wearable device 20 is switched from the stopped state to the activated state, the control unit 65 transfers all the first biological information detected and stored while the wearable device 20 is in the stopped state to the wearable device. 20, or the first biological information detected and stored at predetermined time intervals may be transmitted to the wearable device 20 while the wearable device 20 is in a stopped state. Further, the control unit 65 may transmit the first biometric information to the wearable device 20 each time the first biometric information is detected while the wearable device 20 is in a stopped state.

In step S15 described above, if the accuracy of heartbeat detection by the occupant camera 41 is not high (S15/No), the control unit 65 detects the heartbeat of the wearable device 20, which is the second detector, in the same procedure as step S19. It is determined whether the detection function is activated (step S25). If the heartbeat detection function of the wearable device 20 is in the stopped state (S25/No), the control unit 65 transmits a command to the wearable device 20 to activate at least the heartbeat detection function (step S27). , proceed to step S29. On the other hand, if the heartbeat detection function of the wearable device 20 is activated (S25/Yes), the process directly advances to step S29.

In step S29, the control unit 65 uses the second biological information detected by the wearable device 20 to perform a control to warn of a physical abnormality and a control to make an emergency stop of the vehicle (step S29). Thereby, the emergency stop control section 67 and the warning control section 69 can perform predetermined control based on highly reliable heartbeat information.

As described above, according to the vehicle control system 10 according to the first embodiment, the first biological information (heartbeat) detected by the occupant camera 41 as the first detector provided in the vehicle If the detection accuracy is high, predetermined control is executed based on the first biological information. On the other hand, when the detection accuracy of the first biological information detected by the passenger camera 41 is low, the second biological information (heartbeat) detected by the wearable device 20 as a second detector worn by the passenger. Predetermined control is executed based on. Therefore, predetermined control can be performed using heartbeat information with high detection accuracy.

Further, according to the vehicle control system 10 according to the present embodiment, when the detection accuracy of the first biological information detected by the occupant camera 41 installed in the vehicle and receiving power from the vehicle power source is high, the wearable device The detection function of at least the second biometric information of 20 is stopped, and the first biometric information is used preferentially to execute predetermined control. Therefore, it is possible to suppress the power consumption of the wearable device 20, which operates using the charging power of the built-in battery.

Further, according to the vehicle control system 10 according to the present embodiment, the first biometric information detected by the occupant camera 41 during the period in which the second biometric information detection function of the wearable device 20 is in a stopped state is , is transmitted to the wearable device 20. As a result, the biometric information data during the period when the second biometric information detection function of the wearable device 20 is in a stopped state is stored as the first biometric information with high detection accuracy, and the function of the wearable device 20 alone is stored. Guaranteed.

<<Second embodiment>>
Next, a vehicle control system according to a second embodiment of the present invention will be described. In the vehicle control system according to the present embodiment, when the detection accuracy of the first biological information detected by the first detector installed in the vehicle is low, the control system detects the first biological information by the second detector attached to the occupant. A predetermined control is executed based on the second biological information, and the correlation between the correction coefficient of the first biological information and the detection accuracy of the first detector is learned. After learning such a correlation, the vehicle control system continues to use the first biological information when the detection accuracy of the first biological information detected by the first detector provided in the vehicle is low. Predetermined control is executed while correcting the first biological information based on the learned correlation. Hereinafter, mainly differences from the first embodiment will be explained.

FIG. 4 is a flowchart specifically illustrating an operational example of processing by the control device 50 of the vehicle control system according to the present embodiment, and shows processing that can be replaced with the processing of steps S25 to S29 shown in FIG. 3. .

In step S15 described in the first embodiment, the control unit 65 determines that the level of heartbeat detection accuracy estimated by the estimation unit 63 is not high in the heartbeat detection accuracy by the passenger camera 41 as the first detector. If it is determined that (S15/No), the control unit 65 determines whether data on the correlation between the correction coefficient of the information on the heartbeat detected by the passenger camera 41 and the accuracy of heartbeat detection by the passenger camera 41 is stored. (Step S41). If correlation data is not stored (S41/No), the control unit 65 executes the processes of steps S25 to S29 in accordance with the procedure described in the first embodiment. That is, the control unit 65 uses the second biological information detected by the wearable device 20 to perform a control to warn of a physical abnormality and a control to emergency stop the vehicle.

Next, the control unit 65 calculates a correction coefficient for the first biological information detected by the occupant camera 41 (step S51). Specifically, the control unit 65 compares heartbeat information detected by the occupant camera 41 and the wearable device 20 at the same time, and determines a correction coefficient for matching the first biological information with the second biological information. calculate. In this case, the lower the accuracy of heartbeat detection by the occupant camera 41 is estimated to be, the larger the correction coefficient becomes. Next, the control unit 65 associates the detection accuracy of heartbeat information by the occupant camera 41 at the same time estimated in step S13 described in the first embodiment with the calculated correction coefficient and stores it in the storage unit 55. It is stored (step S53).

Next, the control unit 65 learns the correlation between the detection accuracy of heartbeat information by the occupant camera 41 and the calculated correction coefficient (step S55). The learned correlation data is stored in the storage unit 55. When learning of the correlation is completed, the process returns to step S11. The accuracy of the learned correlation becomes higher as the number of samples of data linking detection accuracy and correction coefficient increases. Therefore, the control unit 65 may learn the correlation when the number of stored samples reaches a preset number. Further, the more the levels of estimation accuracy of heartbeat information by the occupant camera 41, the higher the accuracy of the learned correlation becomes. Therefore, in this embodiment, it is preferable that the level of accuracy of estimating heartbeat information by the occupant camera 41 is increased to four or more levels. Further, even after learning the correlation once, the learning may be continued and the correlation may be updated constantly or at appropriate intervals.

Once the correlation data is learned, it is determined in step S41 that the correlation data is stored (S41/Yes). Next, the control unit 65 determines whether the heartbeat detection function of the wearable device 20, which is the second detector, is in a stopped state (step S43). If the heartbeat detection function of the wearable device 20 is in the activated state (S43/No), the control unit 65 transmits a command to the wearable device 20 to stop at least the heartbeat detection function (step S45). , proceed to step S47. On the other hand, if the heartbeat detection function of the wearable device 20 is in a stopped state (S43/Yes), the process directly advances to step S47.

In step S47, the control unit 65 corrects the heartbeat information detected by the occupant camera 41 based on the correlation (step S47). Specifically, the control unit 65 refers to the correlation data to obtain a correction coefficient corresponding to the detection accuracy of heartbeat information by the passenger camera 41 estimated by the estimation unit 63, Correct heart rate information. Next, the control unit 65 uses the corrected heartbeat information to perform a control to warn of a physical abnormality and a control to emergency stop the vehicle (step S49).

As a result, even if the detection accuracy of the heartbeat information detected by the passenger camera 41 is low, after correlation data is obtained, the passenger can leave the heartbeat detection function of the wearable device 20 in a stopped state. Predetermined control can be executed while correcting the information on the heartbeat detected by the camera 41. Therefore, according to the vehicle control system 10 according to the second embodiment, it is possible to obtain the effects of the vehicle control system 10 according to the first embodiment, and further suppress the power consumption of the wearable device 20. can do.

Although preferred embodiments of the present invention have been described above in detail with reference to the accompanying drawings, the present invention is not limited to such examples. It is clear that a person with ordinary knowledge in the technical field to which the present invention pertains can come up with various changes or modifications within the scope of the technical idea stated in the claims. It is understood that these also naturally fall within the technical scope of the present invention.

For example, in the above embodiment, the control is configured to safely and quickly stop the vehicle when it is determined that there is an abnormality in the body of the occupant. Alternatively, the configuration may be such that automatic driving control is performed to guide the vehicle to a nearby appropriate hospital.

DESCRIPTION OF SYMBOLS 10... Vehicle control system, 20... Wearable device (2nd detector), 41... Occupant camera (1st detector), 43... Optical sensor, 45... Acceleration sensor, 50... Control device, 51... Communication unit , 53... Arithmetic processing unit, 55... Storage section, 61... Detection section, 63... Estimation section, 65... Control section, 67... Emergency stop control section, 69... Warning control section

Claims (8)

a first detector provided in the vehicle to detect biological information of an occupant of the vehicle;
a second detector attached to the occupant to detect biological information of the occupant;
an estimation unit that estimates the detection accuracy of the biological information by the first detector;
a control unit that executes a predetermined control process based on the biological information,
The control unit includes:
If the detection accuracy by the first detector is estimated to be high , the detection function of the second detector is stopped and a predetermined control process is performed using the biological information detected by the first detector. Run
executing a predetermined control process using biological information detected by the second detector when the detection accuracy by the first detector is estimated to be low ;
A vehicle control system that causes the second detector to share biological information detected by the first detector while the detection function of the second detector is stopped. The control unit includes:
The vehicle control system according to claim 1, wherein when the detection accuracy by the first detector is estimated to be low, a detection function by the second detector is activated. The control unit includes:
According to claim 1, the biological information detected by the first detector is corrected based on the biological information detected by the second detector while the detection function of the second detector is activated. Control system for the vehicle described. The control unit includes:
correcting the biological information detected by the first detector based on the biological information detected by the second detector when the detection accuracy by the first detector is estimated to be low; The vehicle control system according to claim 3 . The control unit includes:
The lower the detection accuracy by the first detector, the larger the correction coefficient when correcting the biological information detected by the first detector based on the biological information detected by the second detector. The vehicle control system according to claim 4 . The control unit includes:
Correlation between the detection accuracy by the first detector and a correction coefficient when correcting biological information detected by the first detector based on biological information detected by the second detector learn relationships,
6. After learning the correlation, the detection function of the second detector is stopped , and the biological information detected by the first detector is corrected based on the correlation. control systems for vehicles. The first detector includes a camera that photographs the occupant, a pressure measuring device that measures the sitting pressure distribution when the occupant is seated, a microwave sensor that detects the occupant's heartbeat, and a microwave sensor that is embedded in the steering wheel to detect the occupant. At least one of an electrode set for measuring heartbeat or electrocardiogram, a displacement sensor for detecting changes in the position of a seat belt, a TOF sensor for detecting the position of the occupant, or a thermography for detecting the body temperature of the occupant. The vehicle control system according to any one of claims 1 to 6 , comprising: The vehicle control system according to any one of claims 1 to 7 , wherein the second detector is a wearable device operated by charging power of a built-in battery.

Images