CN111845759A

CN111845759A - Driving assistance system and driving assistance method

Info

Publication number: CN111845759A
Application number: CN202010017442.2A
Authority: CN
Inventors: 杨明桓; 范光庆; 李正中
Original assignee: Industrial Technology Research Institute ITRI
Current assignee: Industrial Technology Research Institute ITRI
Priority date: 2019-04-03
Filing date: 2020-01-08
Publication date: 2020-10-30
Also published as: TW202332607A; TWI816008B; TW202037513A

Abstract

The invention discloses a driving assistance system and a driving assistance method. The driving assistance system includes a physiological information sensing system, an explicit performance detection system, and a processing device. The physiological information sensing system is used for sensing the physiological information of driving. The explicit expression detection system is used for detecting the explicit expression of driving. The processing device is coupled with the physiological information sensing system and the explicit performance detection system. When the physiological information of the driving is abnormal and the explicit expression is also abnormal, the processing device starts an emergency measure.

Description

Driving assistance system and driving assistance method

Technical Field

The present invention relates to an assistance system and an assistance method, and more particularly, to a driving assistance system and a driving assistance method.

Background

In recent years, vehicles have become popular all over the world as vehicle technology has matured, and although it brings convenience to human life, casualties caused by traffic accidents are high. The traffic accidents are mostly caused by drivers, and the main reasons of the accidents are also caused by drunk driving, overspeed driving or physiological problems of the drivers, such as heart diseases, dozing and the like. Aiming at sudden physical discomfort of a driver, if the driver cannot find and handle the sudden physical discomfort, traffic accidents are easy to happen, and personnel are hurt.

Disclosure of Invention

The embodiment of the invention provides a driving assistance system and a driving assistance method, which can reduce driving risks caused by sudden physical discomfort of a driver.

The driving assistance system of the embodiment of the invention comprises a physiological information sensing system, an explicit performance detection system and a processing device. The physiological information sensing system is used for sensing the physiological information of driving. The explicit expression detection system is used for detecting the explicit expression of driving. The processing device is coupled with the physiological information sensing system and the explicit performance detection system. When the driving physiological information is abnormal and the external display performance is abnormal, the processing device starts an emergency measure.

In one embodiment of the present invention, the physiological information sensing system and the explicit performance detection system continuously monitor the driving physiological information and the explicit performance at the same time.

In an embodiment of the present invention, the physiological information sensing system is first activated, and when the driving physiological information is abnormal, the explicit expression detecting system is then activated.

In an embodiment of the invention, the explicit performance detection system is activated first, and when the explicit performance of the driving is abnormal, the physiological information sensing system is activated.

In an embodiment of the invention, the physiological information sensing system includes a plurality of physiological information sensing modules, a microcontroller and a switching circuit. The plurality of physiological information sensing modules are configured on at least one operation part of the vehicle and are coupled with the switching circuit. The microcontroller is coupled with the switching circuit and the processing device. The microcontroller controls the switching circuit to transmit the physiological information detected by the physiological information sensing module of the driver contacter, which is arranged in the at least one operating portion, to the processing device.

In an embodiment of the invention, at least one of the operation portions is a steering wheel of a vehicle, and at least three of the physiological information sensing modules are included in a range of 70 mm.

In one embodiment of the present invention, the at least one operation part includes at least two of a steering wheel, an activation button, a gearshift lever, a door of a vehicle seat, and a hand brake.

In an embodiment of the invention, the processing device starts the emergency measure when the driving performance is abnormal and maintains for a preset time.

In one embodiment of the present invention, the physiological information sensing system includes an Electrocardiogram (ECG) sensor. The plurality of first electrodes or the plurality of second electrodes of the ECG sensor are disposed on a steering wheel of the vehicle and include at least three of the plurality of first electrodes or the plurality of second electrodes within a range of 70 mm.

In an embodiment of the present invention, the second electrode of the ECG sensor is disposed on a steering wheel, an activation button, a gearshift lever, a door of a vehicle cabin, or a hand brake of the vehicle.

In an embodiment of the present invention, the third electrode of the ECG sensor is disposed on a driver's seat of the vehicle for contacting one of the legs of the driver, and the reference electrode of the ECG sensor is disposed on the driver's seat. The third electrode and the reference electrode are respectively used for contacting with the legs of a driver.

In an embodiment of the invention, the physiological information sensing system includes an Electrocardiography (ECG) sensor, a Photoplethysmography (PPG) sensor, and a compensation module including a phase retarder, a photo interrupter (photo interrupter) or an RC retarder to synchronize heart rate information in the PPG provided by the PPG sensor with heart rate information in the ECG provided by the ECG sensor.

The driving assistance method of the embodiment of the invention includes the following steps. Physiological information of the driving is detected. Detecting the explicit expression of driving. And when the physiological information and the explicit expression of the driving are abnormal, starting emergency measures.

In one embodiment of the invention, the physiological information comprises an Electrocardiogram (ECG) or a photoplethysmogram (PPG), and the explicit representation comprises at least one of expression, posture, speech and motion.

In one embodiment of the invention, the emergency action includes at least one of issuing a warning, automatic driving, warning, parking by side, and hospitalizing.

In an embodiment of the present invention, the step of detecting the physiological information of the driver includes using a plurality of physiological information sensing modules respectively disposed in at least one operation portion of the vehicle, and acquiring the physiological information detected by the physiological information sensing module of the driver disposed in the at least one operation portion.

In an embodiment of the invention, the physiological information of the driving is corrected according to at least one of a pressure value and skin impedance of the detected portion of the driving.

The driving assistance system of the embodiment of the invention includes a physiological information sensing system and a processing device. The physiological information sensing system is used for sensing the physiological information of driving. The processing device is coupled with the physiological information sensing system. When the physiological information of the driving is abnormal, the processing device starts emergency measures. The physiological information sensing system comprises a plurality of physiological information sensing modules, a microcontroller and a switching circuit. The plurality of physiological information sensing modules are configured on at least one operation part of the vehicle and are coupled with the switching circuit. The microcontroller is coupled with the switching circuit and the processing device. The microcontroller controls the switching circuit to transmit the physiological information detected by the physiological information sensing module of the driver contacter, which is arranged in the at least one operating portion, to the processing device. Each physiological information sensing module comprises an ECG sensor, a PPG sensor and a compensation module. The microcontroller selects to perform ECG sensing mode measurement or PPG sensing mode measurement through the switching circuit.

In an embodiment of the present invention, the at least one operation part is a steering wheel of the vehicle, and at least three physiological information sensing modules are included in a range of 70 mm.

In an embodiment of the invention, the physiological information sensing system performs the PPG sensing mode measurement first, and when it is detected that two physiological information sensing modules provide PPG, the mode is switched to the ECG sensing mode measurement.

In an embodiment of the present invention, each compensation module is a phase delayer, a photo interrupter or an RC delayer to synchronize heart rate information in the PPG provided by the PPG sensor with heart rate information in the ECG provided by the ECG sensor.

Based on the above, in the driving assistance system and the driving assistance method of the embodiment of the invention, the physiological information and the explicit expression of driving are detected at the same time, so that emergency measures can be started immediately and accurately to reduce the probability of accidents. Alternatively, in the driving assistance system and the driving assistance method according to the embodiments of the present invention, the ECG sensing mode measurement or the PPG sensing mode measurement may be automatically switched, so that the physiological information may be obtained by performing the PPG sensing mode measurement, and the accuracy may be improved by performing the ECG sensing mode measurement.

In order to make the present invention more comprehensible, embodiments accompanied with figures are described in detail below.

Drawings

FIG. 1 is a schematic diagram of a driving assistance system according to an embodiment of the invention;

fig. 2A is a timing chart of a driving assistance method according to an embodiment of the invention;

fig. 2B is a timing chart of a driving assistance method according to another embodiment of the invention;

fig. 3 is a flowchart of the driving assistance method of fig. 2A;

fig. 4 is a configuration diagram of the driving assistance system of fig. 1;

fig. 5 is a schematic configuration diagram of sensors of a part of the driving assistance system of fig. 1;

FIG. 6 is a schematic diagram of a physiological signal sensing module of the driving assistance system of FIG. 1;

fig. 7 is a schematic configuration diagram of sensors of another part of the driving assistance system of fig. 1;

FIG. 8 is a schematic view of the electrode of FIG. 7;

fig. 9A and 9B are schematic diagrams of two PPG sensors of the driving assistance system of fig. 1;

fig. 10 is a schematic configuration diagram of a driving assistance system according to another embodiment of the invention;

FIG. 11 is a schematic diagram of a physiological signal sensing module of the driving assistance system of FIG. 10;

FIG. 12 is a schematic diagram of the relative positions of the palm and the physiological signal sensing module when the driver holds the steering wheel in the driving assistance system of FIG. 10 according to one embodiment of the invention;

Fig. 13 is a flowchart illustrating the physiological signal sensing in the driving assistance method according to the embodiment of the invention.

Description of the symbols

50A: private cloud

50B: hybrid cloud

50C: public cloud

1000. 2000: driving assistance system

1100. 2100: physiological information sensing system

1110. 2110: physiological information sensing module

1110A, 2112: ECG sensor

1110B, 2114: PPG sensor

1110C: body temperature-sweat sensor

1120. 2120: micro-controller

1130. 2130: switching circuit

1140. 1220: pressure sensor

1150: skin impedance sensor

1200: external appearance performance detection system

1210: camera with a lens having a plurality of lenses

1230: tension sensor

1240: microphone (CN)

1250: touch screen

1300: processing apparatus

1310: warning module

1312: haptic unit

1314: visual unit

1316: sound unit

T1, T2, T3: time of day

Delta T: preset time

J102, J104, …, J116, J202, J204, J206, J208: blocks 1110a1, 2112A: a first electrode

1110A 2: second electrode

1110A 3: third electrode

1110a4, 2112B: reference electrode

1110B1, 2116: compensation module

1110B 1': compensation unit

1110B 2: emitter

1110B 3: receiver with a plurality of receivers

2118: sensor with a sensor element

12: electrode plate

14: conducting liquid pipeline

16: moisture permeable piece

20: blood vessel

30: chair cushion

T0-1, T0-2, T1, T2: time of day

Detailed Description

Fig. 1 is a schematic configuration diagram of a driving assistance system according to an embodiment of the present invention. Referring to fig. 1, the driving assistance system 1000 of the present embodiment includes a physiological information sensing system 1100, an explicit performance detection system 1200, and a processing device 1300. The physiological information sensing system 1100 is used to sense physiological information of a driver. Physiological information includes, but is not limited to, Electrocardiogram (ECG), photoplethysmogram (PPG), body temperature, and sweat. The explicit expression detection system 1200 is used to detect explicit expression of driving. The processing device 1300 is coupled to the physiological information sensing system 1100 and the explicit performance detection system 1200.

Fig. 2A is a timing chart of a driving assistance method according to an embodiment of the present invention. Referring to fig. 1 and fig. 2A, in the driving assistance system 1000 and the driving assistance method of the present embodiment, when the physiological information of the driver is abnormal, that is, at time T1, the processing device 1300 activates the explicit expression detecting system 1200 to detect the explicit expression of the driver. When the explicit behavior of driving is abnormal, that is, at time T2, the processing device 1300 starts an emergency measure.

As can be seen from the above, in the driving assistance system 1000 and the driving assistance method of the present embodiment, the physiological information sensing system 1100 can continuously and instantly monitor the driving physiological information. Once the physiological information is abnormal, the explicit expression detection system 1200 may further detect the explicit expression of the driving to determine what physical discomfort is present in the driving. Accordingly, the processing device 1300 can activate an appropriate emergency measure according to the aforementioned determination result, avoid erroneous activation of an emergency measure due to only a temporary abnormality of physiological information, and can transmit the determination result to a hospital, a police unit, or other emergency unit so as to give the quickest and correct help to the driving. In addition, the driving assistance system 1000 and the driving assistance method of the embodiment detect the ECG and the PPG simultaneously, and even if the ECG single lead loop cannot be formed due to the steering wheel being operated by a single hand or the steering wheel being rotated by the driver, the PPG can still obtain basic physiological information such as heart rate.

In addition, in the driving assistance method of the embodiment, in addition to directly starting the emergency measure at the time T2, the processing device 1300 may start the emergency measure only after the driving performance is abnormal (time T2) and maintained for a preset time Δ T, that is, at the time T3. The probability of misjudgment can be reduced by setting the preset time (delta T). In addition, although the explicit expression detecting system 1200 is started from the time T1, the explicit expression detecting system 1200 may be kept in a constantly on state like the physiological information sensing system 1100.

The ECG records the electrophysiological activity of the heart in time units via the thoracic cavity, and by using electrodes that are in contact with the skin, the potential changes of the heart as a whole can be detected. The results of the electrocardiogram are usually shown in wave form. The heart rate is obtained from the ECG, basically calculated from the R-wave to R-wave separation time in the ECG. When the interval time between the R wave and the R wave is longer, the heart rate is lower, and the interval time between the R wave and the R wave is shorter, the heart rate is higher. Alternatively, the heart rate may be derived from an ECG. Heart rate refers to the number of beats per minute of the heart, while heart rate refers to the rhythm of the heart's beats. PPG is a non-invasive detection method of detecting changes in blood volume in living tissue via electro-optical means. When a light beam of a certain wavelength is irradiated onto the skin surface, the contraction and expansion of blood vessels affects the transmission or reflection of light every heartbeat. When the light beam passes through the skin tissue and is reflected to the light receiver, the amount of light is attenuated, and the change in the amount of light is correlated with the change in the amount of blood in the artery caused by the heartbeat. Therefore, information such as heart rate and blood pressure can be obtained by analyzing the change in the light quantity.

When the driver drives various vehicles such as automobiles, ships, airplanes and the like, the brain of the driver needs blood to provide nutrition and oxygen. When insufficient blood flow is provided to the brain, consciousness may be suddenly lost. Therefore, the physical condition which is possibly safe for driving can be preliminarily judged by detecting physiological information such as ECG, PPG and the like of driving.

Fig. 3 is a flowchart of the driving assistance method of fig. 2A. Referring to fig. 1 and 3, for example, the physiological information sensing system 1100 can further include a body temperature-sweat sensor 1110C. If the body temperature and sweat of the driver are normal, i.e. the body temperature and sweat level of the driver are normal, as determined at block J102 according to the sensing result of the body temperature-sweat sensor 1110C, the information that the driving condition is normal is transmitted to the processing device 1300. On the other hand, if the body temperature of the driver is normal but the sweating level is abnormal, i.e. the driver is cold sweating, or other abnormal body temperature and/or abnormal sweating conditions are determined at block J102, the blood pressure level is further determined at block J104 according to the PPG provided by the PPG sensor 1110B of the physiological information sensing system 1100. If the blood pressure is determined to be low at block J104, then it is determined at block J106 whether the ECG sensor 1110A has a loop formed based on whether the ECG sensor 1110A of the physiological information sensing system 1100 can provide an ECG. If it is determined at block J106 that the ECG sensor 1110A has formed a loop, the heart rhythm condition may be determined at block J108 from the ECG provided by the ECG sensor 1110A. If the heart rhythm condition is determined to be normal at block J108, information that the driving condition is normal is transmitted to the processing device 1300. If the rhythm condition is determined to be abnormal at block J108, information indicating that the rhythm condition of the driver determined at block J110 is fast or slow is transmitted to the processing device 1300.

If it is determined at block J106 that ECG sensor 1110A is not forming a loop, then the heart rhythm condition is determined at block J108 from the PPG provided by PPG sensor 1110B. If the blood pressure is determined to be high at block J104, then a determination is made at block J112 as to whether the ECG sensor 1110A is looping based on whether the ECG sensor 1110A is capable of providing an ECG. If it is determined at block J112 that the ECG sensor 1110A has formed a loop, the heart rhythm condition may be determined at block J114 from the ECG provided by the ECG sensor 1110A. If it is determined at block J114 that the heart rate is too fast, the heart rate status of the driving is communicated to the processing device 1300. If a arrhythmia is determined at block J114, a determination may again be made at block J116 as to whether the ECG provided by ECG sensor 1110A is normal. If the ECG is determined to be normal at block J116, information that the driving condition is normal is communicated to the processing device 1300. If an ECG abnormality is determined at block J116, information of the ECG abnormality of the driving is also transmitted to the processing means 1300. Additionally, if it is determined at block J112 that ECG sensor 1110A is not forming a loop, then the heart rhythm condition is determined at block J114 from the PPG provided by PPG sensor 1110B.

On the other hand, the external performance detection system 1200 of the present embodiment may include the camera 1210, the pressure sensor 1220, the tension sensor 1230, the microphone 1240 and the touch screen 1250, but in other embodiments, the external performance detection system 1200 may include only some of the aforementioned components or other components capable of detecting the external performance. At block J202, it can be determined whether the driver has twitching, facial distortion, tilted mouth, hands stroking, increased eye cleft, abnormal tone, or other image and sound abnormalities based on the detection results of the camera 1210 and the microphone 1240. At block J204, it may be determined whether the driver has suffered a strong impact, unilateral weakness, restlessness, general weakness, or other overt performance abnormalities that may be determined from the pressure detection results based on the detection results of the pressure sensor 1220. The pressure sensor 1220 is installed in a driver seat or a section where a seat belt mainly contacts a driver, for example. At block J206, it can be determined whether the driver has violent jerk, unilateral incline, oblique twist, slow motion, or other external performance abnormality that can be determined from the tension detection result according to the detection result of the tension sensor 1230. At block J208, it can be determined whether there is abnormal behavior of the touch screen 1250 due to irregular use of the touch screen 1250, such as multiple touches, during driving. In addition, the touch screen 1250 can also be replaced by an element having only a touch sensing function and no display function. In integration, the explicit expression detection system 1200 is configured to detect at least one expression, gesture, speech, motion, or other explicit expression.

The results of the determinations at blocks J202, J204, J206, J208 are all passed to the processing device 1300. The processing device 1300 can further determine whether the driving is normal or has other diseases after combining the information provided by the physiological information sensing system 1100 and the explicit performance detection system 1200. For example, when the driver is in a normal body temperature and has the symptoms of sweating, hypertension, fast heart rate, convulsion, strong impact, violent twitching, dizziness, irregular touch, repeated actions, screaming and the like, the epilepsy is possibly caused. When the driving is normal in body temperature and sweating, hypertension, irregular heart rate and normal ECG are accompanied by facial distortion, mouth and mouth inclination, unclear mouth and teeth, dizziness, body unilateral weakness, unilateral inclination, irregular touch and other external manifestations, the driving is possibly suffered from cerebral apoplexy. When the driving is under normal body temperature, sweating, hypertension, irregular heart rate and abnormal ECG are accompanied by chest stroking, angina pectoris, sitting posture, left and right interactive oblique and wriggling, asthma, chest pain, restlessness, abnormal tone, irregular touch and other external expressions, the driving may be suffered from psychogenic diseases. When the driving is under normal body temperature, sweating, hypotension, fast heart rate accompanied by trembling, general weakness, slow movement, abnormal tone, irregular touch and other external manifestations indicate that the driving may have hypoglycemia. When the driving is under normal body temperature, with sweating, hypotension, slow heart rate accompanied by eye chapping, general weakness, slow movement, abnormal tone, irregular touch, etc., it indicates that the driving may be stimulated by vagus nerve, i.e. frightened. For example, hypertension is above 140 millimeters of mercury (mmHg), hypotension is below 90 millimeters of mercury (mmHg), fast heart rate is above 100 beats per minute (min), slow heart rate is below 60 beats per minute (min), and cardiac arrhythmia refers to heart rate variability, i.e., the beat-to-beat difference is greater than 50 milliseconds (msec).

After the processing device 1300 has determined the condition of the driving relatively accurately, appropriate emergency measures may be initiated. For example, issuing a warning, initiating automated driving, parking at the side, attending a medical emergency, or other suitable emergency action. Referring again to fig. 1, the driven private cloud 50A may transfer basic data of driving to the hybrid cloud 50B. The basic data of driving is, for example, basic physiological information, health examination reports, special medical history, and the like. The processing device 1300 may also transmit the detection results of the physiological information sensing system 1100 and the explicit performance detection system 1200 to the hybrid cloud 50B. The hybrid cloud 50B may communicate the aforementioned items of information to the public cloud 50C of the hospital, police station, or other emergency department in order to give the most rapid and accurate assistance to driving. For example, a hospital may know that a drive is to be sent to the hospital and prepare an appropriate medical treatment based on the received information before the drive arrives at the hospital. In this section of initiating automatic driving, route planning is also included, of course, and the details thereof are not described herein.

Additionally, the processing device 1300 may also include a warning module 1310 to warn driving or surrounding passers-by when physiological information or explicit manifestations of driving are detected to be abnormal. For example, the alert module 1310 may include a haptic unit 1312, a visual unit 1314, and an audio unit 1316. The haptic unit 1312 is used to alert the driver by vibrating the driver's seat or by other means that can make the driver feel a tactile response. The vision unit 1314 may be, for example, flashing a light on the dashboard or otherwise creating an alert in a manner that visually responds to driving, or may activate an external flashing light on the vehicle to alert surrounding passers-by. The sound unit 1316 may be activated to sound a buzzer or alert the driver by other means that may be audibly responsive to driving, or may be activated to a vehicle horn to alert surrounding passers-by.

In one embodiment, the physiological information sensing system 1100 can continuously and instantly monitor the physiological information and the explicit performance of the driving simultaneously with the explicit performance detection system 1200. As shown in the timing chart of fig. 2A, the physiological information sensing system 1100 may be activated first, and when the physiological information of the driving is abnormal, the processing device 1300 may activate the explicit expression detecting system 1200 to detect the explicit expression of the driving. The processing device 1300 determines the time and processing mode for starting the emergency measure according to the driving physiological information or explicit performance. For example, if the physiological information or the explicit manifestations are abnormal and it is determined that the driver cannot or should not continue to drive, the emergency measure can be immediately started, instead of starting the emergency measure after the abnormality lasts for a period of time as shown in fig. 2A.

Fig. 2B is a timing chart of a driving assistance method according to another embodiment of the invention. As shown in the timing chart of fig. 2B, in another embodiment, the explicit expression detecting system 1200 of fig. 1 may be activated first, and when an explicit expression abnormality of driving is observed at time T1, the processing device 1300 of fig. 1 activates the physiological information sensing system 1100 again to obtain the physiological information, and thereby determines whether driving is impossible or should not be continued, for example, at time T2, when the physiological information of driving is abnormal, the processing device 1300 may further activate an emergency measure.

Fig. 4 is a configuration diagram of the driving assistance system of fig. 1. Referring to fig. 1 and 4, in the present embodiment, the physiological information sensing system 1100 includes a plurality of physiological information sensing modules 1110, a microcontroller 1120 and a switching circuit 1130. The physiological information sensing modules 1110 are disposed on at least one operation portion (shown in fig. 4) of the vehicle and coupled to the switching circuit 1130. The microcontroller 1120 is coupled to the switching circuit 1130 and the processing device 1300. The microcontroller 1120 controls the switching circuit 1130 to transmit the physiological information detected by the physiological information sensing module 1110 of the driving contacter, which is disposed in the operation portion, to the processing device 1300. For example, fig. 4 shows that the components of the vehicle that can be used as the operation portion include at least a steering wheel, a start button, a gear lever, a door, a hand brake, etc., but may include other parts that are usually touched by the driver. By disposing the plurality of physiological information sensing modules 1110 at the plurality of operation portions of the vehicle, it is possible to detect physiological information even when driving is performed with different driving habits. For example, when both hands of a driver hold the steering wheel, desired physiological information may be provided through two of the plurality of physiological information sensing modules 1110 placed on the steering wheel in contact with the driver. Alternatively, when the driver holds the steering wheel with only one hand and the other hand contacts the activation button, the gearshift lever, the door of the cabin, or the handbrake, the desired physiological information may also be provided by one physiological information sensing module 1110 placed on the steering wheel in contact with the driver and one physiological information sensing module 1110 placed on the other operation part. Even when the driver does not hold the steering wheel with both hands, the required physiological information can still be provided by two driving-contacted physiological information sensing modules 1110 placed on the activation button, the gearshift lever, the cabin door, or the handbrake. The micro-controller 1120 and the switching circuit 1130 can quickly determine which operation portion of the physiological information sensing module 1110 is configured to provide the physiological information. In addition, fig. 4 also illustrates locations where the camera 1210, the microphone 1240 and the touch screen 1250 of the explicit performance detection system 1200 can be installed, but the invention is not limited thereto.

Fig. 5 is a schematic configuration diagram of a sensor of a part of the driving assistance system of fig. 1. Referring to fig. 1 and 5, in the present embodiment, the physiological information sensing system 1100 includes an ECG sensor 1110A. The plurality of first electrodes 1110A1 of the ECG sensor 1110A are disposed on a steering wheel of a vehicle and include at least three of the plurality of first electrodes 1110A1 in a range of 70 millimeters (mm). Human females had an average height of 1.6 meters, a palm length of 171 millimeters (mm), and a width of 73 millimeters (mm). Human males have an average height of 1.75 meters, a palm length of 188 millimeters (mm), and a width of 83 millimeters (mm). According to the above design, it is ensured that at least one palm of the hand touches more than three first electrodes 1110a1 in both male and female driving. The fully touched first electrode 1110A1 will serve as the sensing electrode for the ECG sensor 1110A in this test.

Fig. 6 is a schematic diagram of a physiological signal sensing module of the driving assistance system of fig. 1. The module may be deployed on the steering wheel, activation buttons, gear levers, cabin doors, handbrake or other areas that are routinely touched by drivers. Referring to fig. 1, 5 and 6, in the present embodiment, the plurality of second electrodes 1110A2 of the ECG sensor 1110A, similar to the first electrode 1110A1, may also be disposed on the steering wheel of the vehicle, and at least includes three of the plurality of second electrodes 1110A2 within a range of 70 millimeters (mm). With the first electrode 1110A1 and the second electrode 1110A2 in driving contact, a single lead ECG sensor 1110A can be constructed. Based on the convenience of installation and the quality assurance, each sensor can be modularized. In the module of fig. 6, a compensation module 1110B1 may be provided. The compensation module 1110B1 may be the skin impedance sensor 1150, the pressure sensor 1140, or a compensation unit (phase retarder, photo interrupter, or RC retarder) of fig. 1, etc. The processing device 1300 can utilize the compensation module 1110B1 to correct the sensing result of the physiological information sensing module 1110. For example, the skin conductivity is affected by the dryness of the environment, which causes the resistance of the two hands touching the steering wheel to change, thereby affecting the accuracy of the single lead ECG measurement. By measuring the skin impedance value, the ECG can be corrected by table lookup or by linear correction.

In addition, as the driving force level varies, the blood vessel of the measured portion may also deform to reduce the volume of the blood vessel, thereby reducing the signal strength detected by the PPG sensor 1110B. Further, when the cross section of the blood vessel is approximately circular, assuming that the length of the blood vessel is L and the radius of the cross section of the blood vessel is r, the volume of the blood vessel detected by the PPG sensor 1110B is about pi r²And L. When the driver drives the vehicle harder to make the cross section of the blood vessel approximate an ellipse, assuming that the length of the blood vessel is L, the semi-major axis of the cross section of the blood vessel is a, and the semi-minor axis of the cross section of the blood vessel is B, the volume of the blood vessel detected by the PPG sensor 1110B is about pi abL. Since the volume pi abL of the oval blood vessel is smaller than the volume pi r of the circular blood vessel²L，I.e., the blood vessel is deformed such that the total volume of the blood vessel being measured is reduced, the signal strength detected by the PPG sensor 1110B will decrease. In one embodiment, the effect on the detected PPG at different pressures may be pre-taken and a look-up table established to record the compensation values needed to compensate for the effect. Therefore, the corresponding compensation value can be obtained by looking up from the pre-stored comparison table according to the sensing result of the pressure sensor 1140, so as to correct the PPG.

Fig. 7 is a schematic configuration diagram of sensors of another part of the driving assistance system of fig. 1. Referring to fig. 1 and 7, in the present embodiment, the ECG sensor 1110A may further include a third electrode 1110A3 disposed on the driver's seat of the vehicle for contacting one of the legs of the driver. With the first electrode 1110A1, second electrode 1110A2, and third electrode 1110A3 being in driving contact, a triple lead ECG sensor 1110A can be constructed providing an ECG containing more information. For example, when arrhythmia is determined at block J114 of fig. 3, an ECG can be provided by the triple lead ECG sensor 1110A to determine whether the driving ECG is normal again at block J116. The ECG sensor 1110A may further include a reference electrode 1110A4 provided in the driver seat. The third electrode 1110A3 and the reference electrode 1110A4 are used to contact the legs of the driver, respectively. In addition, the pressure sensor 1220 may be disposed at a section of the safety belt mainly subjected to the pressure of driving, so that when the driving body is weak and a large pressure is applied to the safety belt, the occurrence of the condition may be sensed by the pressure sensor 1220. The tension sensor 1230 may be disposed at the end of the seat belt so that the occurrence of the condition can be sensed by the tension sensor 1230 when the seat belt is pulled by driving the body powerless or twisting.

Fig. 8 is a schematic view of the electrode of fig. 7. Referring to fig. 1 and 8, since the three lead ECG sensor 1110A is not normally required, electrical contact between the third electrode 1110A3 and the driver can be established only when needed. In the present embodiment, the third electrode 1110a3 is disposed on the seat cushion 30 of the driver's seat, and includes an electrode sheet 12, a conductive liquid conduit 14, and a moisture permeable member 16. The processing device 1300 controls the conductive liquid pipeline 14 to deliver the conductive liquid to the moisture permeable member 16. The moisture permeable member 16 is used for contacting and conducting the electrode sheet 12 with one of the legs of the driver through the conductive liquid. In other words, when a driver needs to wear trousers, skirts or other clothes, the conductive liquid can be delivered to the moisture permeable member 16 through the conductive liquid pipeline 14, so that the conductive liquid can wet the part of the clothes contacting the moisture permeable member 16, and an electrical conduction path between the electrode plate 12 on the seat cushion 30 and one of the legs of the driver is established. In addition, the conductive liquid can have the characteristic of quick-drying, so that the driver seat can be restored to the original state quickly.

Fig. 9A and 9B are schematic diagrams of two PPG sensors of the driving assistance system of fig. 1. Referring to fig. 1, fig. 9A and fig. 9B, in the present embodiment, the PPG sensor 1110B of the physiological information sensing system 1100 includes a transmitter 1110B2, a receiver 1110B3 and a compensation unit 1110B 1'. The compensation unit 1110B1 'in fig. 9A is a phase retarder, and the compensation unit 1110B 1' in fig. 9B is a photo interrupter. In an embodiment not shown, the compensation unit 1110B 1' may also be an RC delay. The compensation unit 1110B 1' serves to synchronize the heart rate information in the PPG with the heart rate information in the ECG. In addition, the heart rate information in the PPG and the heart rate information in the ECG may also be synchronized by an algorithm. According to the detection principle of PPG and ECG, the peak value of ECG is from the contraction of ventricle, and the peak value of PPG is caused by the contraction or expansion of blood vessel. Therefore, by comparing the peak occurrence Time points of the PPG and the ECG, we can obtain the transmission Time of the blood from the heart to the measurement site, i.e. the Pulse Transit Time (PTT). The speed of pulse wave transmission is directly related to blood pressure, and when the blood pressure is high, the pulse wave transmission is fast, otherwise, the pulse wave transmission is slow. Therefore, by obtaining the pulse transmission time of the driver in advance, the heart rate information in the PPG and the heart rate information in the ECG can be synchronized using an algorithm or an RC delay. On the other hand, the peak occurrence time point of the PPG may also be delayed by means of a phase delayer or a photo interrupter, and the heart rate information in the PPG may likewise be synchronized with the heart rate information in the ECG.

Fig. 10 is a schematic configuration diagram of a driving assistance system according to another embodiment of the present invention. Referring to fig. 10, the driving assistance system 2000 of the present embodiment is similar to the driving assistance system of fig. 1, and details of a part of the same are not repeated herein, and various variations of the driving assistance system of fig. 1 can also be applied to the driving assistance system 2000 of the present embodiment. The driving assistance system 2000 of the present embodiment includes the physiological information sensing system 2100 and the processing device 1300, i.e., does not include the explicit expression detecting system, but may include the explicit expression detecting system 1200 same as that in fig. 1. The physiological information sensing system 2100 is configured to sense physiological information of a driver. The processing device 1300 is coupled to the physiological information sensing system 2100. When the physiological information of the driving is abnormal, the processing device starts emergency measures.

The physiological information sensing system 2100 includes a plurality of physiological information sensing modules 2110, a microcontroller 2120, and a switching circuit 2130. The physiological information sensing modules 2110 are disposed on at least one operation portion of the vehicle shown in fig. 4 and coupled to the switching circuit 2130. The microcontroller 2120 is coupled to the switching circuit 2130 and the processing device 1300. The microcontroller 2120 controls the switching circuit 2130 to transmit the physiological information detected by the physiological information sensing module 2110 of the driving contacter, which is disposed in at least one of the operation portions, to the processing device 1300.

Fig. 11 is a schematic diagram of a physiological signal sensing module of the driving assistance system of fig. 10. Referring to fig. 11, each physiological information sensing module 2110 includes an ECG sensor 2112, a PPG sensor 2114 and a compensation module 2116. Microcontroller 2120 selects either ECG sensing mode measurement or PPG sensing mode measurement by switching circuit 2130. The ECG sensor 2112 includes, for example, a first electrode 2112A and a reference electrode 2112B. In addition, each physiological information sensing module 2110 may optionally further include other sensors 2118, and the sensors 2118 may be body temperature-sweat sensors. The compensation module 2116 may be the skin impedance sensor 1150, the pressure sensor 1140, or a compensation unit (phase retarder, photo interrupter, or RC retarder) of fig. 1, etc.

In the driving assistance system 2000 of fig. 10, the physiological information sensing module 2110 is provided with both the ECG sensor 2112 and the PPG sensor 2114, so that the ECG sensing mode measurement or the PPG sensing mode measurement can be selected according to actual conditions. Fig. 12 is a schematic diagram of relative positions of a palm and a physiological signal sensing module when a driver holds a steering wheel in the driving assistance system of fig. 10 according to another embodiment of the present invention. Referring to fig. 12, when the driver's hand holds the steering wheel, each palm of the driver's hand may contact at least a complete one of the plurality of physiological information sensing modules 2110 placed on the steering wheel. When the driver touches more than two physiological information sensing modules 2110, for example, the left and right hands of the driver touch one complete physiological information sensing module 2110, the ECG sensing mode is activated to obtain more accurate physiological information of the driver. When the driver touches only one ECG sensor (single lead loop cannot be formed), the PPG sensing mode is activated, and the PPG of the driver is measured by the PPG sensor 2114, without ever obtaining physiological information of the driver because the driver operates the steering wheel with one hand.

Fig. 13 is a flowchart illustrating a physiological signal sensing process in the driving assistance method according to an embodiment of the present invention. Referring to fig. 10 and 13, at time T0-1, a scan is performed to determine whether the PPG can be sensed. At time T0-2, it is confirmed whether there are more than two physiological information sensing modules 2110 that can sense the PPG, that is, whether there are two physiological information sensing modules 2110 that can provide the ECG. If there are more than two, the ECG sensing mode measurement is switched to before time T1. If there are not more than two, the PPG sensing mode measurement is switched to before time T1. Then, physiological information, possibly ECG, PPG, or both, is taken at time T1. Finally, the physiological information is transmitted to the processing device 1300 at time T2 and uploaded to the hybrid cloud 50B as necessary.

Taking the example of the driver holding the steering wheel with both hands, in the ECG sensing mode, the first physiological signal sensing module 2110 that is touched by one of the hands of the driver is recognized based on Galvanic Skin Response (GSR), for example, and the physiological signal sensing module 2110 is set to "positive". Then, for example, the driver sequentially searches downward in a clockwise manner until recognizing the physiological signal sensing module 2110 touched by the other hand of the driver, and sets the physiological signal sensing module 2110 to "negative". Thus, the ECG can be measured by the two physiological signal sensing modules 2110 forming a single lead loop with the body of the driver.

In summary, in the driving assistance system and the driving assistance method of the present invention, it can be determined whether the physiological information and the explicit performance are normal, and the emergency measure can be started in real time and accurately, so as to reduce the probability of accidents. Optionally, the physiological information may include at least one of ECG and PPG, so as to improve the accuracy of the sensed physiological information, and the physiological information and the explicit expression may be sensed and detected simultaneously, or the physiological information may be sensed to be abnormal and then the explicit expression may be further detected to determine what physical discomfort occurs during driving.

Although the present invention has been described with reference to the above embodiments, it should be understood that the invention is not limited thereto, and that various changes and modifications can be made by those skilled in the art without departing from the spirit and scope of the invention.

Claims

1. A driving assistance system characterized by comprising:

a physiological information sensing system for sensing physiological information of the driver;

an explicit expression detection system for detecting an explicit expression of said driving; and

and the processing device is coupled with the physiological information sensing system and the explicit performance detection system, wherein when the physiological information of the driving is abnormal and the explicit performance is abnormal, the processing device starts an emergency measure.

2. The driving assistance system according to claim 1,

the physiological information sensing system and the explicit expression detection system continuously monitor the physiological information and the explicit expression of the driving at the same time, or

The physiological information sensing system is started first, and when the physiological information of the driving is abnormal, the explicit expression detection system is started.

3. The driving assistance system according to claim 1,

starting the explicit expression detection system, and starting the physiological information sensing system when the explicit expression of the driving is abnormal.

4. The driving assistance system according to claim 1, wherein the physiological information sensing system includes a plurality of physiological information sensing modules disposed in at least one operating portion of a vehicle and coupled to the switching circuit, a microcontroller coupled to the switching circuit and the processing device, and a switching circuit, the microcontroller controlling the switching circuit to transmit the physiological information detected by the physiological information sensing modules of the driving contacter disposed in the at least one operating portion to the processing device.

5. The driving assist system according to claim 4, wherein the at least one operating portion is a steering wheel of a vehicle, and includes at least three of the physiological information sensing modules in a range of 70 mm.

6. The driver assistance system of claim 4, wherein the at least one operating portion includes at least two of a steering wheel, an activation button, a gearshift lever, a cabin door, and a handbrake.

7. The driving assistance system according to claim 1, wherein the processing means starts an emergency measure when the explicit performance of the driving is abnormal and maintained for a preset time.

8. The driving assistance system according to claim 1, wherein the physiological information sensing system includes an electrocardiogram sensor of which a plurality of first electrodes or a plurality of second electrodes are arranged at a steering wheel of a vehicle and at least three of the plurality of first electrodes or the plurality of second electrodes are included within a range of 70 mm.

9. The driver-assistance system of claim 8, wherein the second plurality of electrodes of the electrocardiogram sensor are configured to a steering wheel, an activation button, a gearshift lever, a cabin door, or a hand brake of the vehicle.

10. The driving assistance system according to claim 8, wherein a third electrode of the electrocardiogram sensor is provided to an operator's seat of the vehicle to contact one of the legs of the operator, a reference electrode of the electrocardiogram sensor is provided to the operator's seat, and the third electrode and the reference electrode are provided to contact the legs of the operator, respectively.

11. The driver assistance system of claim 1, wherein the physiological information sensing system includes an electrocardiogram sensor, a photoplethysmogram sensor, and a compensation module including a phase retarder, a photo interrupter, or an RC retarder to synchronize heart rate information in a photoplethysmogram provided by the photoplethysmogram sensor with heart rate information in an electrocardiogram provided by the electrocardiogram sensor.

12. A driving assistance method comprising:

detecting physiological information of the driving;

detecting an overt performance of the driving; and

and when the physiological information and the explicit expression of the driving are abnormal, starting emergency measures.

13. The driving assistance method according to claim 12, wherein the physiological information includes an electrocardiogram or a photoplethysmogram, and the explicit expression includes at least one of an expression, a posture, a speech, and an action.

14. The driving assistance method according to claim 12,

15. The driving assistance method according to claim 12,

16. The driving assistance method according to claim 12, wherein the emergency measure includes at least one of issuing a warning, automatic driving, warning, parking by side, and hospitalizing.

17. The driving assistance method according to claim 12, wherein the step of detecting the physiological information of the driving includes using a plurality of physiological information sensing modules respectively arranged in at least one operating portion of a vehicle, and acquiring the physiological information detected by the physiological information sensing modules of the driving contacter arranged in the at least one operating portion.

18. The driving assistance method according to claim 12, wherein the processing device activates the emergency measure after the explicit performance of the driving is abnormal and maintained for a preset time.

19. The driving assistance method according to claim 12, wherein the physiological information of the driving is corrected according to at least one of a pressure value and skin impedance of a detected portion of the driving.

20. A driving assistance system characterized by comprising:

a physiological information sensing system for sensing physiological information of the driver; and

a processing device coupled to the physiological information sensing system, wherein the processing device initiates an emergency measure when the physiological information of the driving is abnormal,

wherein the physiological information sensing system comprises a plurality of physiological information sensing modules, a microcontroller and a switching circuit, the plurality of physiological information sensing modules are configured in at least one operating part of a vehicle and are coupled with the switching circuit, the microcontroller is coupled with the switching circuit and the processing device, the microcontroller controls the switching circuit to transmit the physiological information detected by the physiological information sensing modules of the driving contacter configured in the at least one operating part to the processing device,

wherein each physiological information sensing module comprises an electrocardiogram sensor, a photoplethysmogram sensor and a compensation module, and the microcontroller selects to carry out electrocardiogram sensing mode measurement or photoplethysmogram sensing mode measurement through the switching circuit.

21. The driving assistance system according to claim 20, the at least one operating portion being a steering wheel of a vehicle, and including at least three of the physiological information sensing modules in a range of 70 millimeters.

22. The driver assistance system of claim 20, wherein the at least one operating portion includes at least two of a steering wheel, an activation button, a gearshift lever, a cabin door, and a handbrake.

23. The driving assistance system of claim 20, wherein the physiological information sensing system performs a photoplethysmogram sensing mode measurement first, and switches to perform an electrocardiographic sensing mode measurement when two of the physiological information sensing modules are detected to provide photoplethysmograms.

24. The driver assistance system of claim 20, wherein each of the compensation modules is a phase retarder, a photo interrupter, or an RC retarder to synchronize heart rate information in a photoplethysmogram provided by the photoplethysmogram sensor with heart rate information in an electrocardiogram provided by the electrocardiogram sensor.