WO2019130993A1

WO2019130993A1 - Driving assistance device and driving assistance method

Info

Publication number: WO2019130993A1
Application number: PCT/JP2018/044318
Authority: WO
Inventors: 莉絵子小川; 足立　佳久; 勇樹江戸
Original assignee: シャープ株式会社
Priority date: 2017-12-27
Filing date: 2018-11-30
Publication date: 2019-07-04

Abstract

Provided is a technology for carrying out driving assistance suitable for both a driver and a passenger. Biological information for a driver and a passenger in a moving body is referenced, the physical/mental state of the driver and the passenger is assessed, assistance information for carrying out driving assistance in accordance with the physical/mental state of the driver after the physical/mental state of the driver or the passenger has been presented is generated, and a driving assistance operation is carried out.

Description

Driving support device and driving support method

The present disclosure relates to a driving support device and a driving support method.

2. Description of the Related Art Conventionally, there is known a technology for detecting a living condition such as poor physical condition of a driver or a passenger in a moving object such as an automobile and outputting driving support information according to the detected living condition (for example, Reference 1).

Unexamined-Japanese-Patent No. 2016-184282 (October 20, 2016 publication)

However, it is assumed that the parent who is the driver can not calmly take an action in accordance with the driving support information, for example, when outputting the driving support information according to the sudden physical condition abnormality of the child who is the passenger. .

One aspect of the present disclosure is made in view of the above-described circumstances, and it is an object of the present disclosure to provide a technology capable of providing driving assistance suitable for both a driver and a passenger.

In order to solve the above problems, a driving assistance apparatus according to an aspect of the present disclosure includes a biological information acquisition unit that acquires biological information of a driver of a moving body and a passenger, and a living body of the driver and the passenger. A mind-body condition determination unit that determines the mind-body condition of the driver and the fellow passenger by referring to the information, a presentation unit that presents the mind-body condition of the driver or the fellow passenger, and the driver or the fellow passenger A support information generation unit that generates support information for performing driving support according to the driver's mental and physical state after presenting the physical and mental state, and a support operation unit that performs a driving support operation according to the support information , Is a configuration provided with.

Further, the driving assistance apparatus according to an aspect of the present disclosure may refer to the biological information acquisition unit for acquiring the biological information of the driver of the moving body and the passenger, and the biological information of the driver and the passenger. In the psychosomatic state of the driver after presenting the psychosomatic state of the driver, the psychosomatic state determination unit which determines the psychosomatic state of the driver and the passenger, the presenting unit which presents the psychosomatic state of the passenger, and the mental state of the passenger Accordingly, the configuration includes a support information generation unit that generates support information for performing the drive support of the driver, and a support operation unit that performs a drive support operation according to the support information.

In addition, the driving support method according to an aspect of the present disclosure determines the mind-body state of the passenger with reference to the biological information acquisition step of acquiring the biological information of the passenger of the moving body and the biological information of the passenger. After presenting the mind-body state determination step to be performed, the presenting step presenting the mind-body state of the fellow passenger, and presenting the mind-body state of the fellow passenger, acquire the driver's biometric information and refer to the driver's biometric information A support information generation step of determining the mental and physical state and generating support information for performing the drive support of the driver according to the mental and physical state of the driver, and a support operation for performing a drive support operation according to the support information And step.

In the driving support method according to an aspect of the present disclosure, the biological information acquisition step of acquiring the biological information of the driver of the moving body and the passenger, the biological information of the driver and the passenger, and In the mind-body condition of the driver after presenting the mind-body condition of the driver, the mind-body condition determination step for determining the mind-body condition of the driver, the presenting step for presenting the mind-body condition of the passenger, and In response, the method includes a support information generation step of generating support information for performing the drive support of the driver, and a support operation step of performing a drive support operation according to the support information.

According to one aspect of the present disclosure, driving assistance suitable for both the driver and the passenger can be provided.

FIG. 1 is a block diagram showing a schematic configuration of a driving support device according to a first embodiment. It is a figure which shows the example of the region of interest which is an area | region which detects a pulse wave from a captured image. It is a figure which shows the relationship between a pulse wave and a pulse. (A) is an image figure which performs frequency analysis to the time series data waveform of RR interval, and separates and extracts it into a low frequency band and a high frequency band. It is a figure which shows the example of a presentation of a presentation part. It is a flowchart which shows the flow of the processing operation of a driving assistance device. FIG. 7 is a block diagram showing a schematic configuration of a driving support device according to a second embodiment. It is a figure which shows the change of the parameter | index which shows a driver | operator's mind-body state. It is a figure which shows the change of the mind-body state of a driver. FIG. 10 is a block diagram showing a schematic configuration of a driving support device according to a third embodiment. It is a figure which shows the relationship between the pulse rate of a passenger | crew, the determination by the mind-body state determination part, and the assistance information produced | generated by the assistance information generation part. FIG. 14 is a block diagram showing a schematic configuration of a driving support device according to a fourth embodiment. It is a figure which shows the normal value of the pulse rate according to age.

Embodiment 1
The first embodiment of the present disclosure will be described in detail below. FIG. 1 is a block diagram showing a schematic configuration of the driving support apparatus 100 according to the first embodiment. As described in detail below, the driving support apparatus 100 detects a pulse wave of a driver (pilot) of a moving object such as a vehicle, an aircraft, or a ship, and a passenger, and based on the detected pulse wave, Determine the mental and physical condition of the driver and the passenger. In addition, the driving support apparatus 100 provides support for performing driving support according to the driver's mental and physical state after presenting the mental and physical state of the passenger in a manner that allows the driver to check. Generates information to assist the driver in driving.

As shown in FIG. 1, the driving support apparatus 100 includes an imaging unit 105, a control unit 110, a presentation unit 106, and a support operation unit 107.

The imaging unit 105 captures an image including the face of the driver of the moving body and the passenger. The imaging unit 105 is a camera in which an image sensor such as a CMOS or a CCD and a lens are combined, and is a commonly used color filter of Bayer array of RGB, or a color of Cy (cyan) in RGB. A color filter suitable for observing increase and decrease of blood volume, such as RGBCy with a filter added and RGBIR obtained by adding an IR (near infrared) color filter to RGB is provided. The color filter is not limited to the above-described filter, and may include, for example, only an IR color filter.

The imaging unit 105 may be configured integrally with the driving support device 100 or may be configured separately from the driving support device 100. In a configuration in which the imaging unit 105 is separate from the driving support device 100, the imaging unit 105 may communicate with the driving support device 100 via, for example, wireless communication, and supply the captured image to the driving support device 100.

The imaging unit 105 is configured to be capable of imaging a driver of a mobile object and a plurality of passengers. The imaging unit 105 may be, for example, a camera attached to a position at which a driver of a moving body and a plurality of passengers can be imaged together. In addition, the imaging unit 105 may be configured to be able to sequentially image the driver of the moving body and each of the plurality of fellow passengers. In addition, the imaging unit 105 may be configured to include a camera for imaging a driver of a moving body and a plurality of cameras for imaging a plurality of fellow passengers.

Under the control of the control unit 110, the presentation unit 106 presents information on the physical and mental state of the passenger by means of a display by means of a liquid crystal display and an audio output by means of a speaker. In addition, the presentation method of the information by the presentation part 106 is not restricted to the audio | voice output by a display display and a speaker, You may be other methods, such as lighting of a warning lamp.

The support operation unit 107 performs a drive support operation for supporting the driving of the mobile object by the driver according to the support information generated by the support information generation unit 150 included in the control unit 110. The support operation unit 107 may be, for example, a control unit that performs speed restriction so that the traveling speed of the moving object does not exceed a predetermined speed based on the support information. Further, the support operation unit 107 may be a speed monitoring device that issues a warning when the traveling speed of the moving object exceeds a predetermined speed based on the support information. Further, the support operation unit 107 may be a car navigation device that performs route guidance to a destination based on support information. In the first embodiment, the support operation unit 107 will be described below by exemplifying a case where the control unit performs speed limitation.

[Configuration of Control Unit 110]
The control unit 110 is an arithmetic device provided with a function to control each part of the driving support device 100 in an integrated manner. For example, the control unit 110 executes the programs stored in one or more memories (e.g., RAM, ROM, etc.) by one or more processors (e.g., CPU etc.) to execute each component of the driving support apparatus 100. Control.

The control unit 110 includes a biological information acquisition unit 120, a biological condition estimation unit 130, a mind-body condition determination unit 140, and a support information generation unit 150.

(Configuration of biometric information acquisition unit 120)
The biometric information acquisition unit 120 refers to the image captured by the imaging unit 105 to acquire biometric information of the driver of the moving object and the passenger. The biological information of the driver and the passenger is, for example, information on human biological activity such as pulse wave, heartbeat, sweating, cardiac activity, pulse, blood pressure, temperature, and respiration. In the present embodiment, the case where the biological information acquisition unit 120 includes the pulse wave detection unit 121 and detects the pulse waves of the driver and the passenger as biological information will be described below as an example. The pulse wave detection unit 121 detects a pulse wave from the images of the driver's and the passenger's face included in the captured image. When there are a plurality of passengers, the pulse wave detection unit 121 detects pulse waves for each passenger.

The pulse wave detection unit 121 detects the area of the face of the driver of the moving body and the passenger from the image captured by the imaging unit 105 for each fixed frame. The pulse wave detection unit 121 sets a region of interest 15 for detecting a pulse wave in the detected face region. FIG. 2 is a diagram showing an example of the region of interest 15 set in the region of the face 10 detected from the captured image. In FIG. 2, the region of interest 15 is indicated by a hatched region surrounded by a square.

The pulse wave detection unit 121 acquires a signal of temporal change in pixel average of the luminance value of each color (R, G, B when photographed by the RGB camera) in the region of interest 15. The pulse wave detection unit 121 performs independent component analysis on the acquired signal, and takes out the same number of independent components as the number of colors. The pulse wave detection unit 121 removes low frequency and high frequency components from these independent components using, for example, a digital band pass filter of 0.75 to 4.0 Hz. Then, the pulse wave detection unit 121 performs fast Fourier transform on the signal after the band pass filter to calculate the power spectrum of the frequency. The pulse wave detection unit 121 calculates the peak of the power spectrum at 0.75 to 4.0 Hz from the power spectrum of the calculated frequency, and the independent component having the largest peak value is compared with the peak value of each independent component. Is detected as a pulse wave signal.

Thus, the biological information acquisition unit 120 acquires the pulse waves of the driver of the mobile unit and the passenger detected by the pulse wave detection unit 121 as the biological information of the driver of the mobile unit and the passenger.

(Configuration of living body state estimation unit 130)
The living body state estimation unit 130 includes a driver living body state estimation unit 131 that estimates a living body state of the driver, and a fellow passenger living state estimation unit 132 that estimates a living body state of a fellow passenger. Here, the biological condition can be estimated from pulse waves which are biological information of the driver and the passenger, and is an index that quantitatively determines the physical condition of the driver and the passenger. In the present disclosure, the biological condition estimation unit 130 calculates the pulse rates (pulses) of the driver and the fellow passenger and the index value indicating the balance of the autonomic nerve from the pulse wave to obtain the biological status of the driver and the fellow passenger. Estimate the state.

When there are a plurality of passengers, the passenger's living state estimation unit 132 estimates the living state for each passenger. The driver's biological condition estimation unit 131 and the fellow passenger's biological condition estimation unit 132 estimate the biological condition of the driver and the fellow passenger by the same method. A process of the biological state estimation unit 130 will be described.

The biological condition estimation unit 130 refers to the pulse wave of the driver and the passenger acquired by the biological information acquisition unit 120, and calculates the pulse of the driver and the passenger and the balance of the autonomic nerve. FIG. 3 is a diagram showing the relationship between the pulse wave and the pulse. As shown in FIG. 3, the biological condition estimation unit 130 detects the peak of the pulse wave, and counts the number of peaks of the pulse wave in a fixed time. Then, the living body state estimation unit 130 calculates the pulse rate by converting the number of pulse wave peaks in a given time into the number per minute.

FIG. 4 shows the result of frequency analysis for RR interval (heart rate) fluctuation of the electrocardiogram. FIG. 4A is an image diagram in which frequency analysis is performed on the time-series data waveform of the RR interval to separate and extract the low frequency band and the high frequency band. Fig. 4 (b) shows the power spectral density of the RR interval (heart rate) fluctuation (Reference: Anesthesia 21 Century Vol. 13 No. 2-40 2011 P20-25 "Autonomic Nervous System Using Frequency Analysis" Function Evaluation Equipment ").

As shown in FIG. 4, the autonomic nervous balance can be evaluated by fluctuation of the pulse wave and the pulse wave interval. Specifically, the biological condition estimation unit 130 first detects the peak of the pulse wave, and performs fast Fourier transform on the time interval between the peaks to calculate the power spectrum of the frequency, as in the case of the calculation of the pulse rate. Then, the biological condition estimation unit 130 sets the integral value of the power spectrum of 0.04-0.15 Hz as the low frequency component (LF) and the integral value of the power spectrum of 0.15-0.4 Hz as the high frequency component (HF). It extracts and calculates LF / HF as an index value which shows autonomic nervous balance. The LF and HF frequencies may have widths around 0.04-0.15 Hz and 0.15-0.4 Hz, respectively.

The living body condition estimation unit 130 may communicate with the driving support apparatus 100 via wireless communication, calculate information on the physical and mental states of the driver and the passenger, and supply the calculated information to the driving support apparatus 100.

(Configuration of mind-body state determination unit 140)
The mind and body condition determination unit 140 includes a fellow passenger mind and body condition determination unit 141 that determines the mind and body condition of the passenger and a driver mind and body condition determination unit 142 that determines the mind and body condition of the driver. Here, the mind-body condition refers to a mental condition such as stress or a sense of exacerbation, and a physical condition such as pain, respiration, or pulse. When there are a plurality of passengers, the passenger's mind and body state determination unit 141 determines the mind and body state of each passenger.

Since the passenger's mind and body state determination unit 141 and the driver's mind and body state judgment unit 142 determine the mind and body state of the driver and the passenger in the same manner, in the following description, A process of the state determination unit 140 will be described.

The mind-body condition determination unit 140 refers to the pulse of the driver and the fellow passenger calculated by the physical condition estimation unit 130 and the index value (LF / HF) indicating the balance of the autonomic nerve, and the driver and fellow passenger Determine your mind and body condition.

The mind-body state determination unit 140 operates when the pulse rate calculated by the living body state estimation unit 130 and the index value (LF / HF) indicating the balance of the autonomic nerve are each equal to or greater than a predetermined threshold or less than the threshold. It is determined that the physical or mental condition of the passenger or passenger is abnormal. The mind-body state determination unit 140 determines that the mind-body state of the driver or the passenger is abnormal when either one of the pulse rate and the index value indicating the autonomic balance is equal to or more than a predetermined threshold or less than the threshold. May be

For example, the mind-body state determination unit 140 determines the mind-body state by comparing the pulse of the driver and the passenger with a preset threshold. Generally, in adults, it can be determined that the pulse rate is 100 or more per minute as tachycardia, and the pulse rate is less than 60 per minute as bradycardia, and the mind-body state is not normal. The mind-body state determination unit 140 may determine whether the mind-body state is normal based on such a general pulse rate threshold.

If the passenger's mind and body state judgment unit 141 judges that the passenger's mind and body state is abnormal, the judgment result is outputted to the presentation unit 106, and the function of the presentation unit 106 displays the passenger's abnormality on the liquid crystal display, It is presented to the driver by audio output from the speaker. FIG. 5 is a diagram showing a presentation example in which the presentation unit 106 presents an anomaly of the passenger by displaying on the liquid crystal display. As shown in FIG. 5, the presentation unit 106 may present instructions and messages for the driver on the balance state of the autonomic nerve of the passenger and on the pulse state. The instruction or message to the driver may include, for example, “Please check the condition of the rear seat 1” and other information indicating the position of the passenger who has an abnormality in the physical and mental condition.

(Configuration of support information generation unit 150)
When it is determined by the mind-body state determination unit 140 that the mind-body state of the passenger is abnormal, the support information generation unit 150 performs driving support according to the mind-body state of the driver or the mind state of the driver and the passenger. Generate support information for For example, when the support information generation unit 150 determines that the mind-body state determination unit 140 determines that the passenger's mind and body state is abnormal, and the driver's mind and body state after presenting the abnormality state of the passenger is abnormal. And generating support information for performing speed limitation so that the moving object can not move beyond a predetermined speed. As a result, the driver knows the abnormality in the passenger's mind and body state, and can not make a calm judgment, thereby assisting the driver's driving so as not to excessively increase the moving speed of the moving body.

In addition, the support information generation unit 150 changes the reference of the moving speed limitation of the moving body in a step-by-step manner with reference to the LF / HF and the pulse rate calculated by the living body state estimation unit 130 and respective threshold values. Support information for supporting the driver's driving may be generated. The support information generation unit 150 outputs, to the support operation unit 107, support information for supporting the driver's driving, which is generated according to the driver's mental and physical state or the driver and the passenger's physical and mental state.

The support operation unit 107 refers to the support information generated by the support information generation unit 150, and executes a driving support operation for supporting the driver's driving according to the support information. The support operation unit 107 may be, for example, a control unit that controls the moving speed of the moving object. In this case, the support information generated by the support information generating unit 150 is, for example, for limiting the moving speed of the moving object. It may be control information.

In addition, the support operation unit 107 may be an on-vehicle device such as a car navigation device, and in this case, the support information generated by the support information generation unit 150 displays, for example, the moving speed of the mobile object recommended to the driver. It may be information to be presented by audio output from a speaker or a speaker.

[Example of usage scene of driving support device 100]
The driving support apparatus 100 can be suitably used, for example, when a mother who is a driver in a driver's seat of a moving body and an infant who is a passenger in a rear seat are on the same seat as a parent and a child. . Unlike adults, infants can not successfully convey mental and physical abnormalities such as changes in their physical condition to others. In addition, while driving a car, it is difficult for the mother to see the situation of the infant, so it is difficult to notice the infant's mental and physical abnormality.

It is conventionally known that an index value indicating autonomic nervous balance is closely involved in stress level, aggravation, occurrence of pain and chronicity. Therefore, the pulse wave that can be detected from the image of the infant taken by the imaging unit 105 is monitored, and the index value indicating the pulse and the autonomic nervous balance is calculated from the pulse wave, thereby causing a sudden change in physical condition accompanied by pain in the infant. You can quickly determine your mental and physical state and present it to your mother. Further, the mind-body state of the passenger that can be determined by the mind-body state determination unit 140 is not limited to the pain, but may be an abnormal state or an unpleasant state different from usual.

By the way, it is assumed that it is difficult for the mother to take a calm action when the infant suddenly changes in physical condition while the mother who is the driver and the infant only get on the car. The driving support apparatus 100 determines the driver's mental and physical state after presenting the abnormality in the passenger's physical and mental state to the presentation unit 106, and performs support according to the driver's physical and mental state. Specifically, the driving support device 100 performs speed limitation so that the vehicle can not move beyond a predetermined speed. In this way, appropriate support may be provided such that the vehicle can not be released beyond a predetermined speed according to the degree of immorality or coolness of the mother who is the driver in an emergency such as a baby's sudden change in physical condition in the car Can.

In addition, the driving support apparatus 100 is not limited to the configuration in which speed limitation is performed when an abnormality occurs in the mind-body state of the passenger and the mind-body state of the driver is abnormal after presenting the effect in the presentation unit. When an abnormality occurs in the mind and body state of the passenger and the driver's mind and body state is abnormal after presenting the effect at the presentation unit, for example, (i) switching to automatic driving is performed. Or (ii) giving priority to a safe route such as a wide road based on the current position information by car navigation device, and (iii) a place where parking can be made, such as a convenience store, supermarket, parking area, etc. You may be guided to

[Operation of Driving Support Device 100]
FIG. 6 is a flowchart showing the flow of the processing operation of the driving support device 100.

(Step S1)
The biological information acquisition unit 120 of the control unit 110 detects the pulse waves of the driver and the passenger from the captured image of the imaging unit 105 by the function of the pulse wave detection unit 121. The pulse wave detection unit 121 outputs the detected pulse waves of the driver and the passenger to the biological state estimation unit 130. Alternatively, the pulse wave detection unit 121 detects a pulse wave of only the passenger and outputs the pulse wave to the biological condition estimation unit 130.

(Step S2)
The biological condition estimation unit 130 indicates the balance between the pulse rate and the autonomic nerve, which is an index indicating the physical condition of the driver and the passenger by the functions of the driver biological condition estimation unit 131 and the fellow human condition estimation unit 132. Calculate the index value. The living body state estimation unit 130 outputs the calculated pulse rates of the driver and the fellow passenger and the index value indicating the balance of the autonomic nerve to the mind and body state judgment unit 140. Alternatively, the living body state estimation unit 130 outputs the pulse rate of only the passenger and the index value indicating the balance of the autonomic nerve to the mind and body state judgment unit 140.

(Step S3)
With the function of the passenger's mind and body state judgment unit 141, the mind and body state judgment unit 140 refers to the pulse rate of the passenger, the index value indicating the balance of the autonomic nerve, and the respective threshold values. It is determined whether or not it is normal. When the passenger's mind-body state determination unit 141 determines that the mind-body state of the passenger is normal (Yes in step S3), the process returns to step S1. When the passenger's mind and body state determination unit 141 determines that the mind and body state of the passenger is not normal (No in step S3), the judgment result is output to the presentation unit 106, and the process proceeds to step S4.

(Step S4)
The control unit 110 causes the presentation unit 106 to present information indicating that the passenger's physical and mental condition is abnormal.

(Step S5)
After the control unit 110 presents information indicating that the physical and mental state of the passenger is abnormal by the presentation unit 106, the pulse wave of the driver is obtained from the captured image of the imaging unit 105 by the function of the pulse wave detection unit 121. To detect. Then, the control unit 110 uses the function of the driver's physical condition estimation unit 131 to make an index indicating the balance between the pulse rate and the autonomic nerve, which is an indicator that indicates the driver's mental and physical condition based on the pulse wave of the driver. And calculate. Further, the control unit 110 may determine whether or not the driver's mind and body state is normal by the function of the driver's mind and body state determination unit 142.

(Step S6)
The control unit 110 generates support information for supporting the driving of the driver by the function of the support information generation unit 150 according to the physical and mental state of the driver. The support information generation unit 150 may generate support information that limits the speed of the vehicle, for example, according to the pulse rate and the index value indicating the balance of the autonomic nerve.

(Step S7)
The control unit 110 controls the support operation unit 107 according to the support information generated by the function of the support information generation unit 150, and executes the driving support operation according to the support information.

(Step S8)
Control unit 110 determines whether or not driving support has ended. For example, when the moving object is stopped, the control unit 110 may determine that the driving support has ended. In addition, the control unit 110 may determine that the driving support has ended according to the driving support end operation by the driver. If control unit 110 determines that driving support has ended, the process ends. If it is determined that the driving support has not ended, the control unit 110 returns to step S1 and continues the processing.

[Effect of Embodiment 1]
According to these configurations, it is possible to present the driver with the abnormality when a sudden abnormality such as poor physical condition occurs in the passenger while the moving body is moving. In addition, the mental and physical state of the driver after presenting the passenger's abnormality is estimated, and it is determined whether the driver can perform normal calm judgment and movement. Then, it is possible to generate appropriate support information in accordance with the driver's mental and physical state, and perform the drive support operation. Therefore, driving assistance suitable for both the driver and the passenger can be provided.

The driver's and the passenger's physical condition may be estimated based on heart rate, sweating, heart activity, pulse, blood pressure, body temperature, respiration and the like as well as pulse waves. The driving support apparatus 100 is not limited to the pulse wave detection unit 121 as a pulse wave sensor that detects a pulse wave based on a captured image, and a heart rate sensor, a sweat sensor, an electrocardiogram sensor, a pulse sensor, a blood pressure sensor, a body temperature sensor, The configuration may include various sensors such as a respiration sensor. In addition, these sensors may use contact or non-contact, and may use multiple sensors to estimate the driver's and passenger's physical condition.

The biological information acquisition unit 120 refers to sensor values from various sensors such as a heart rate sensor, a sweat sensor, an electrocardiogram sensor, a pulse sensor, a blood pressure sensor, a body temperature sensor, a respiration sensor, etc. Activity, pulse, blood pressure, body temperature, respiration, etc. of the driver of the moving body and the passenger may be able to be acquired.

In addition, the living body condition estimation unit 130 is a driver from the living body information such as pulse waves, heartbeats, sweating, heart activity, pulse, blood pressure, body temperature, and respiration of the driver and the passenger acquired by the living body information acquisition unit 120. And the physical condition of the passenger may be estimated.

In addition, the mind-body state determination unit is a driving state estimated by the biological condition estimation unit 130 with reference to biological information such as pulse waves, heartbeats, sweating, heart activity, pulse, blood pressure, temperature, and respiration of the driver and the passenger. The physical condition of the driver and the passenger may be determined with reference to the physical condition of the person and the passenger.

Further, the support operation by the driving support apparatus 100 is not limited to the case where an abnormality occurs in the mind and body state of the passenger, and may be executed by detecting that the abnormal state has become a normal state. In this case, if the driving support apparatus 100 detects that the physical and mental state of the passenger has changed from the abnormal state to the normal state, and returns to the normal state as to the physical and physical state of the driver, for example, You may perform the assistance operation | movement which cancels | releases a moving speed.

Although the light source conditions for acquiring the biological information of the driver and the passenger are not described in detail in the present embodiment, the ambient light at the time of acquiring the biological information is not sufficient for acquiring the biological information. In such a case, the light source may illuminate the skin area of the driver and the passenger, and the light source is not limited to visible light and may be infrared light.

Second Embodiment
Embodiment 2 of the present disclosure will be described below. In addition, about the member which has the same function as the member demonstrated in the said Embodiment 1 for convenience of explanation, the same code | symbol is appended and the description is not repeated.

FIG. 7 is a block diagram showing a schematic configuration of the driving support device 200 according to the second embodiment. As shown in FIG. 7, the driving assistance apparatus 200 differs from the driving assistance apparatus 100 of the first embodiment in that the mind and body state determination unit 240 further includes a driver's mind and body state change detection unit 243.

The driver's mind-body state change detection unit 243 has a memory function of recording the mind-body state of the driver for a predetermined period. The driver's mind-body state change detection unit 243 indicates the index value indicating the balance of the driver's pulse and the autonomic nerve calculated by the driver's living body state estimation unit 131 at predetermined time intervals, and the balance of the pulse and the autonomic nerve. The determination result determined by the driver's mind-body state determination unit 142 based on the index value may be recorded for a predetermined period. The driver's mind-body state change detection unit 243 detects a change in the driver's mind-body state before and after the abnormal presentation of the passenger with reference to the mind-body state of the driver for a predetermined period recorded in the memory.

FIG. 8 is a graph showing a change in an indicator indicating the mind-body state of the driver that the mind-body state change detection unit 243 has recorded in the memory. The change in the indicator that indicates the driver's mental and physical state may be, for example, a change in the pulse of the driver, or a change in an indicator value that indicates the balance of the autonomic nerve. As shown in FIG. 8, the driver's mental and physical state may greatly change before and after the abnormality in the passenger's physical and mental state is presented. The driver's mind-body state change detection unit 243 may output, to the support information generation unit 150, the amount of change in the indicator indicating the driver's mind-body state before and after the abnormality in the mind-body state of the passenger is presented.

FIG. 9 is a diagram showing the influence on the change in the driver's mental and physical state by the presentation of the abnormality in the passenger's physical and mental state. As shown in FIG. 9, the driver's mind-body state change detection unit 243 detects that the driver is not in a state of being able to perform normal calm judgment or movement by presenting an abnormality in the mind and body state of the passenger. Has a threshold of. For example, before presentation of an abnormality in the mind and body condition of the passenger, the indicator indicating the mind and body condition of the driver is less than or equal to the threshold, and after presenting the abnormality in mind and body condition of the passenger, for example, within 60 seconds, There is a case where the index indicating the mental and physical state remarkably exceeds the threshold. In such a case, the driver's mind-body state change detection unit 243 changes the mind-body state of the driver into a state where normal calm judgment or movement can not be performed in response to presenting the abnormality in the mind-body state of the passenger. May be detected.

As described above, the driver's mind-body state change detection unit 243 detects a change in the driver's mind-body state before and after the presentation of an abnormality in the mind-body state of the passenger according to the amount of change in the indicator indicating the mind-body state for each individual. You may In addition, the driver's mind-body state change detection unit 243 may detect a change in the driver's mind-body state before and after presentation of an abnormality in the mind-body state of the passenger by comparison with a preset threshold.

The support information generation unit 150 generates support information for supporting the driving of the driver according to the change or the change amount of the driver's physical and mental state detected by the driver's physical and mental state change detection unit 243.

For example, when the amount of change in the mind-body state is large, the support information generation unit 150 can predict that the driver is very upset due to an abnormal situation. , And may instruct to stop the mobile. Further, the support information generation unit 150 may guide the driver to a route to a nearby parking available place such as a convenience store, a supermarket, a parking area, etc. based on the current position information by the car navigation device.

In addition, when the amount of change in the physical and mental state is small, the support information generation unit 150 may give the driver a route by giving priority to a road easier to drive safely such as a wide road by the car navigation device. .

In this way, by presenting the driver's mind-body state before presenting the passenger's mind-body state abnormality with the driver's mind-body state after presenting the driver's mind-body state abnormality. Changes in the driver's mental and physical state due to In particular, among the parameters reflecting the biological condition calculated by the biological condition estimation unit 130, parameters having large individual differences even in normal time (parameters in which it is difficult to determine the biological condition by only the absolute value), By referring to the change in the driver's physical condition before and after the abnormal presentation of the passenger instead of the predetermined threshold, the driver's physical condition is determined to make a determination reflecting the driver's mental and physical condition Can do.

Therefore, it is possible to generate support information for supporting the driver's driving, considering the influence on the driver's mental and physical state by presenting the abnormality in the physical and mental state of the passenger. Therefore, driving assistance suitable for both the driver and the passenger can be provided.

Third Embodiment
Embodiment 3 of the present disclosure will be described below. In addition, about the member which has the same function as the member demonstrated in the said Embodiment 1 for convenience of explanation, the same code | symbol is appended and the description is not repeated.

FIG. 10 is a block diagram showing a schematic configuration of the driving support device 300 according to the third embodiment. As shown in FIG. 10, the driving support apparatus 300 is different from the driving support apparatus 100 of the first embodiment in that the driving support apparatus 300 further includes a position detection unit (position information acquisition unit) 360.

The driving support device 300 generates support information for supporting the driving of the driver in consideration of the physical and mental state of the passenger as well as the mental and physical state of the driver after presenting the abnormality in the physical and mental state of the passenger. Do. In addition to the physical and mental states of the driver and the passenger, the driving support device 300 generates support information in consideration of the position information of the moving object.

The case where the support operation unit 107 of the driving support device 300 is a car navigation device that provides route guidance to a destination will be described as an example.

The position detection unit 360 has a function of detecting the direction to which the moving object is facing, such as a GPS antenna, a Wi-Fi (registered trademark) antenna, a bearing magnet, and an acceleration sensor, and the current position. Obtain position information based on the direction in which you are facing and the current position.

FIG. 11 is a diagram showing the relationship between the pulse rate of the passenger, the determination by the mind-body state determination unit 140, and the support information generated by the support information generation unit 150. As shown in FIG. 11, when the pulse rate of the passenger exceeds, for example, the upper limit of the threshold 115, the mind-body state determination unit 140 determines that the mind-body state of the passenger is abnormal (state X). . The support information generation unit 150 refers to the determination result of the mind-body state determination unit 140 and the pulse rate of the passenger, and generates support information according to the position information of the moving object. For example, when it is necessary to guide the driver to the hospital immediately, the support information generation unit 150 supports the route guidance from the current position of the mobile to the hospital according to the position information of the mobile. 107 generates support information for execution.

The support information generation unit 150 may be configured to store map information in advance. When the support information generation unit 150 needs to go to the hospital immediately, the position information detected by the position detection unit 360 (the direction in which the moving object is facing or the current position of the moving object) and the state of the fellow passenger Then, the support operation unit 107 generates support information for executing route guidance to the hospital. The support information generation unit 150 may perform, for example, route search from the current position to the hospital which is the destination, and may generate support information for the support operation unit 107 to execute route guidance by route display or voice guidance. . In addition, according to the condition of the passenger, the support information generation unit 150 searches a map information for a hospital with treatment of a medical treatment department capable of necessary treatment, and provides route guidance to the hospital from the current position of the mobile body. The support information for performing may be generated.

Further, as shown in FIG. 11, the mind-body state determination unit 140 immediately goes to the hospital when the pulse rate is 115 or more or less than 45, as shown in FIG. The determination may be made, and the determination (state Δ) may be made to observe when the pulse rate is 100 to 115 or 45 to 60.

Even if it is determined by the mind-body state determination unit 140 that the mind-body state of the passenger is to go to the hospital right now, the mind-body state of the driver after presenting an abnormality in the mind-body state of the passenger It may be determined that you can not act calmly. In this case, the support information generation unit 150 searches for the nearest hospital from the current position of the mobile. As a result, even if the driver can not take a calm action, it is possible to reduce the secondary damage such as a traffic accident by guiding the route to the nearest hospital. On the other hand, when it is determined by the mind-body state determination unit 140 that the mind-body state of the driver after presenting the abnormality in the mind-body state of the passenger is a state where calm behavior can be taken, the support information generation unit 150 Find a hospital that is more suitable for the condition of the passenger who has a medical department treatment that can provide necessary treatment.

When it is determined by the mind-body state determination unit 140 that the driver's mind-body state after presenting the abnormality in the mind-body state of the passenger is not able to act calmly, the support information generation unit 150 generates a normal car Route guidance information may be generated as support information in which the amount of information to be conveyed at one time is reduced compared to the route guidance instruction by navigation. Further, the support information generation unit 150 may also generate the route guidance information as the support information so as to transmit the instruction more slowly than usual for the route guidance by voice.

According to these configurations, not only the mental and physical state of the driver after presenting the abnormal physical and mental state of the passenger, but also the mental and physical state of the passenger, the support information for supporting the driver's driving is generated can do. Therefore, it is possible to assist the driver to take appropriate actions appropriately when a quick response is required due to sudden illness or the like of the passenger. Therefore, it is possible to perform a support operation suitable for both the driver and the passenger.

Embodiment 4
The fourth embodiment of the present disclosure will be described below. In addition, about the member which has the same function as the member demonstrated in the said Embodiment 1 for convenience of explanation, the same code | symbol is appended and the description is not repeated.

FIG. 12 is a block diagram showing a schematic configuration of the driving support device 400 according to the fourth embodiment. As shown in FIG. 12, the driving support device 400 differs from the driving support device 100 of the first embodiment in that the driving support device 400 further includes a storage unit 470.

The storage unit 470 stores values of indices indicating the mental and physical state such as an index value indicating the past pulse rate and autonomic nerve balance of the driver and the passenger for each individual. Even if the memory unit 470 stores an index value indicating the balance between the pulse rates and autonomic nerves of the driver and the passenger when it is determined by the mind-body condition determination unit 140 that the mind-body condition is normal. Good. In addition, the storage unit 470 may store standard values of indices indicating the mind-body state for each age and gender.

FIG. 13 is a diagram showing normal values of pulse rate by age (refer to http://www.myakuhaku-check.com/score.html). As shown in FIG. 13, the normal value of the pulse rate varies with the age. In addition, it is known that the normal value of the pulse rate differs depending on the gender. For example, in the case of neonates and infants, the pulse rate per minute is 110 to 140 as a normal value. On the other hand, in the case of adults, the pulse rate per minute is 50 to 90 as a normal value. In other words, if it is determined that the mind and body condition is abnormal when the pulse rate is 115 or more using the normal value of an adult, the case where the pulse rate is 130 for the same person as the neonate or infant, etc. In spite of the value, it is determined that the mind-body state is abnormal.

The mind-body state determination unit 140 is an index value indicating the balance of the pulse rates and autonomic nerves of the driver and the passenger calculated by the biological condition estimation unit 130, and the driver and the passenger stored in the storage unit 470, The physical and mental state of the driver and the passenger may be determined by comparing the past pulse rate and an index value indicating the balance of the autonomic nerve. In addition, the mind-body state determination unit 140 stores, in the storage unit 470, an index value indicating the balance of the pulse rates and autonomic nerves of the driver and the passenger calculated by the body condition estimation unit 130. The mental and physical states of the driver and the passenger may be determined in comparison with standard values of the state indicators.

In this way, comparison with the value of the index indicating the physical and mental state at the normal time in the past, and the standard value of the index indicating the physical and physical state at the normal time by gender and age, which are calculated from accumulated data More accurate judgments that are more suitable for individuals can be made by comparison with or comparison with standard values of indicators that indicate physical and mental condition according to gender and age as generally reported.

In addition, since it is assumed that the value of the index indicating the physical and mental state in the past normal state of the individual also has a certain amount of fluctuation, storage unit 470 stores the range in consideration of the fluctuation as a standard value. It may be

As described above, it is determined whether or not the mind-body state is normal, using the value of the indicator indicating the mind-body state in the past normal state of the individual stored in the storage unit 470, the age-by-age, and the normal value for each gender. It can be performed. Therefore, it is possible to generate the support information according to the criteria tailored to the individual, and to perform the support operation for supporting the driver's driving more appropriately.

Fifth Embodiment
Although the foregoing embodiments have described the case of providing driving assistance to the driver, the opposite case, that is, the case of becoming a driving assistance apparatus for a passenger will be described. This embodiment basically has the same configuration as that of the first embodiment, and refers to the biological information acquisition unit 120 for acquiring the biological information of the driver of the moving body and the passenger, and the biological information of the driver and the passenger. And the driver's mind and body state determination unit 140 for determining the mind and body state of the driver and the passenger, the presenter 106 for presenting the mind and body state of the driver, and the driver's mind and body state are presented. The driving support apparatus 100 includes a support information generation unit 150 that generates support information for performing a program, and a support operation unit 107 that performs a drive support operation according to the support information.

A specific driving support method will be described below.

The driver and the passenger of the moving body are acquired the biological information, and the mental and physical state is determined with reference to the acquired biological information. The biometric information acquisition unit 120 acquires biometric information of the driver of the moving object and the passenger. The mind-body condition determination unit 140 determines the mind-body condition of the driver and the fellow passenger by referring to the biometric information of the driver and the fellow passenger acquired by the biometric information acquisition unit 120. The mind-body state determination unit 140 compares the index value based on the driver's and the passenger's heartbeat, sweating, heart activity, pulse, blood pressure, body temperature, respiration, etc. with a preset threshold value, thereby Determine the physical and mental condition of the passenger.

The presentation unit 106 presents the physical and mental state of the driver and the passenger by a method such as display display, voice output by a speaker, lighting of a warning lamp, and the like. For example, if the driver is in a physical and mental state in which driving is difficult due to physical abnormality (for example, a nap or onset of heart attack, etc.), the presentation unit 106 indicates that the physical and mental state of the driver is abnormal.

Furthermore, support information for performing driving support is generated according to the driver's mental and physical condition after presenting the driver's or passenger's physical and mental condition. The support information generation unit 150 refers to the determination result of the psychosomatic state of the driver by the psychosomatic state determination unit 140 after presenting the psychosomatic state of the driver or the passenger, and supports information according to the psychosomatic state of the driver. To play. For example, if the driver's mental and physical state after presenting the driver's or passenger's physical and mental state is abnormal, it can be estimated that the driver can not make a cool judgment. The support information generation unit 150 generates information for supporting the driver's driving so as not to excessively increase the moving speed of the moving object.

The support information generated by the support information generation unit 150 is presented. The support operation unit 107 performs speed restriction so that the traveling speed of the moving object does not exceed a predetermined speed, for example, based on the support information. Further, if the driver is in a physical and mental state where driving is difficult, for example, in the case of a physical and mental state in which the driver is sleeping, support information indicating that the driver is asked to wake up the driver is generated. The support operation unit 107 executes the support operation. The support operation unit 107 may present a message for prompting the passenger to cause the driver to make a call by display or by audio output from a speaker. In addition, for example, if the driver is in a physical and mental state requiring emergency such as the onset of a heart attack, the support operation for avoiding the danger is presented not only to the driver but also to the passenger by the display and the voice output from the speaker. Do.

According to the first to fifth embodiments described above, it is possible to provide a technology capable of providing driving assistance suitable for both the driver and the passenger.

[Example of software implementation]
Control blocks of the driving

support devices

100, 200, 300, and 400 (in particular, the biological information acquisition unit 120, the biological condition estimation unit 130, the physical and mental

state determination units

140 and 240, and the support information generation unit 150) are integrated circuits (IC chips). Or the like may be realized by a logic circuit (hardware) or software.

In the latter case, the driving

support devices

100, 200, 300, and 400 each include a computer that executes instructions of a program that is software that realizes each function. The computer includes, for example, at least one processor (control device) and at least one computer readable storage medium storing the program. Then, in the computer, the processor reads the program from the recording medium and executes the program to achieve the object of the present disclosure. For example, a CPU (Central Processing Unit) can be used as the processor. As the above-mentioned recording medium, a tape, a disk, a card, a semiconductor memory, a programmable logic circuit or the like can be used besides “a non-temporary tangible medium”, for example, a ROM (Read Only Memory). In addition, a RAM (Random Access Memory) or the like for developing the program may be further provided. The program may be supplied to the computer via any transmission medium (communication network, broadcast wave, etc.) capable of transmitting the program. Note that one aspect of the present disclosure may also be realized in the form of a data signal embedded in a carrier wave in which the program is embodied by electronic transmission.

The driving support apparatus according to each aspect of the present disclosure may be realized by a computer, and in this case, the computer is operated as each unit (software element) included in the driving support apparatus, and A control program of a driving support device to be realized and a computer readable recording medium recording the same also fall within the scope of the present disclosure.

The present disclosure is not limited to the above-described embodiments, and various modifications are possible within the scope of the claims, and embodiments obtained by appropriately combining the technical means disclosed in the different embodiments. Is also included in the technical scope of the present disclosure. Furthermore, new technical features can be formed by combining the technical means disclosed in each embodiment.

(Cross-reference to related applications)
This application claims the benefit of priority to Japanese Patent Application No. 2017-252203 filed on Dec. 27, 2017, the entire contents of which are hereby incorporated by reference. Included in this book.

100, 200, 300, 400 Driving support device 105 Imaging unit 106 Presentation unit 107

Support operation unit

110, 210, 310, 410 Control unit 120 Biological information acquisition unit 121 Pulse wave detection unit 130 Biological condition estimation unit 131 Driver biological condition estimation Unit 132 passenger physical

condition estimation unit

140, 240 physical and mental condition determination unit 141 passenger physical and physical condition determination unit 142 Driver physical and physical condition determination unit 150 Support information generation unit 243 Driver physical and physical condition change detection unit 360 Position detection unit (position information acquisition Department)
470 storage unit

Claims

A biometric information acquisition unit for acquiring biometric information of the driver of the moving body and the passenger;
A mind-body state determination unit that determines the mind-body state of the driver and the passenger with reference to the biometric information of the driver and the passenger;
A presentation unit that presents the mind and body state of the driver or the passenger;
A support information generation unit that generates support information for performing driving support according to the mental and physical state of the driver or the passenger after presenting the physical and mental state of the driver or the passenger;
A driving support apparatus comprising: a support operation unit for performing a driving support operation according to the support information.
A biometric information acquisition unit for acquiring biometric information of the driver of the moving body and the passenger;
A mind-body state determination unit that determines the mind-body state of the driver and the passenger with reference to the biometric information of the driver and the passenger;
A presentation unit that presents the mind and body condition of the passenger;
A support information generation unit that generates support information for performing driving support of the driver according to the driver's mental and physical state after presenting the physical and mental state of the passenger;
A driving support apparatus comprising: a support operation unit for performing a driving support operation according to the support information.
And a biological condition estimation unit for estimating the biological condition of the driver and the fellow passenger with reference to the biometric information of the driver and the fellow passenger acquired by the biometric information acquisition unit,
3. The mind-body state determination unit according to claim 1 or 2, wherein the mind-body state of the driver and the fellow passenger is determined with reference to the living body state estimated by the living body state estimation unit. Driving support device.
The support information generation unit
The said support information is produced | generated according to the change of the said mind-body state of the said driver | operator before and after showing the mind-body state of the said passenger to the said presentation part, The said assistance information is either The driving support device according to any one of the items.
The support information generation unit
The driving support apparatus according to any one of claims 1 to 4, further generating the support information according to the physical and mental state of the passenger.
A storage unit for storing the pulse waves of the driver and the passenger and the mind-body state;
The driving support apparatus according to any one of claims 1 to 5, wherein the support information generation unit generates the support information based on the information stored in the storage unit.
It further comprises a position information acquisition unit for acquiring the position information of the moving body,
The driving support apparatus according to any one of claims 1 to 6, wherein the support information generation unit generates the support information according to position information of the mobile unit.
The biological information acquisition unit includes a pulse wave detection unit that detects pulse waves of the driver and the fellow passenger from captured images of faces of the driver and the fellow passenger. The driving assistance device according to any one of the preceding claims.
A biological information acquisition step of acquiring biological information of a passenger of the moving body;
A mind-body state determination step of determining the mind-body state of the passenger with reference to the biometric information of the passenger;
A presentation step for presenting the physical and mental state of the passenger;
After presenting the physical and mental state of the passenger, the biological information of the driver is acquired, and the physical and physical state is determined with reference to the biological information of the driver, and the physical condition of the driver is A support information generation step of generating support information for performing driving support;
A driving support method, comprising: a support operation step of performing a driving support operation according to the support information.
A biometric information acquisition step of acquiring biometric information of the driver of the moving body and the passenger;
A mind-body state determination step of determining the mind-body state of the driver and the passenger with reference to the biometric information of the driver and the passenger;
A presentation step for presenting the physical and mental state of the passenger;
A support information generation step of generating support information for performing driving support of the driver according to the driver's mental and physical state after presenting the physical and mental state of the passenger;
A driving support method, comprising: a support operation step of performing a driving support operation according to the support information.