KR20180065663A - Apparatus and method for monitoring status of driver - Google Patents

Abstract

The present invention relates to an apparatus and a method for monitoring a status of a driver. The apparatus according to the present invention comprises: a plurality of sensors arranged in at least one of a seat back support and a seat belt of a vehicle; a sound source analyzing portion for analyzing specific information of each sound source measured by the sensors when the vehicle is started; a sound source location checking portion for determining the sound sources measured by an identical sound source based on the result of specific information analysis of each sound source, and checking the location of the sound source generation based on a measuring time of the sound sources and on the location of each sensor measuring the corresponding sound sources; and a driver status determination portion for determining a heartbeat and breathing status of the driver based on the location of the generation of the sound sources and the specific information of the sound sources.

Description

[0001] APPARATUS AND METHOD FOR MONITORING STATUS OF DRIVER [0002]

The present invention relates to an apparatus and method for detecting a driver's condition.

Recently, there are many cases of driving while driving under tired conditions. Accordingly, conventionally, the driver's state is monitored by measuring the driver's biomedical signal, for example, an electrocardiogram or EMG, and measures are taken according to the driver's condition.

However, in order to measure a bio-signal such as an ECG or an EMG of a driver, a sensor for measuring a physical phenomenon must be in direct contact with the driver's skin.

It is an object of the present invention to provide an apparatus and method for monitoring a driver's condition by monitoring the driver's condition through sound measurement without directly contacting the driver's skin.

In particular, an object of the present invention is to provide a driver (driver) who is capable of acquiring a sound of a driver's heartbeat or respiration using a microphone (or a stethoscope) mounted on a vehicle and removing noise in the vehicle, State monitoring apparatus and method.

The technical problems of the present invention are not limited to the above-mentioned technical problems, and other technical problems which are not mentioned can be understood by those skilled in the art from the following description.

According to an aspect of the present invention, there is provided an apparatus for detecting a collision of a vehicle, comprising: a plurality of sensors disposed on at least one of a seat back and a seat belt of a vehicle; A sound source analyzing unit for analyzing the characteristic information of each sound source, determining the sound sources measured by the same signal source on the basis of the analysis result of the characteristic information of each sound source, measuring the measurement time of the sound sources, And a driver state determiner for determining a heartbeat and a breathing state of the driver based on the sound source generating position identified for the sound sources and the characteristic information of the sound sources, .

According to another aspect of the present invention, there is provided a method for measuring a sound source by a plurality of sensors disposed on at least one of a seat back and a seat belt of a vehicle when a vehicle is turned on, Analyzing characteristics information of each of the measured sound sources, determining sound sources measured by the same signal source based on the analysis result of the characteristics information of the respective sound sources, measuring the measurement time of the sound sources, And determining the heartbeat and breathing state of the driver on the basis of the sound source generating position identified for the sound sources and the characteristic information of the sound sources. do.

According to the present invention, there is an effect that the state of the driver can be monitored by measuring the sound of the driver's heartbeat or breath using a microphone (or a stethoscope) mounted on the vehicle without directly contacting the skin of the driver, So that an accident can be prevented in advance.

1 is a view showing a vehicle to which a driver condition monitoring apparatus according to an embodiment of the present invention is applied.
2 is a diagram illustrating a configuration of a driver condition monitoring apparatus according to an embodiment of the present invention.
FIGS. 3A through 5 are views illustrating an operation of the driver condition monitoring apparatus according to an exemplary embodiment of the present invention. Referring to FIG.
6 is a flowchart illustrating an operation of a driver condition monitoring method according to an exemplary embodiment of the present invention.
Figure 7 is a diagram of a computing system in which a method according to one embodiment of the invention is implemented.

Hereinafter, some embodiments of the present invention will be described in detail with reference to exemplary drawings. It should be noted that, in adding reference numerals to the constituent elements of the drawings, the same constituent elements are denoted by the same reference symbols as possible even if they are shown in different drawings. In the following description of the embodiments of the present invention, a detailed description of known functions and configurations incorporated herein will be omitted when it may make the difference that the embodiments of the present invention are not conclusive.

In describing the components of the embodiment of the present invention, terms such as first, second, A, B, (a), and (b) may be used. These terms are intended to distinguish the constituent elements from other constituent elements, and the terms do not limit the nature, order or order of the constituent elements. Also, unless otherwise defined, all terms used herein, including technical or scientific terms, have the same meaning as commonly understood by one of ordinary skill in the art to which this invention belongs. Terms such as those defined in commonly used dictionaries should be interpreted as having a meaning consistent with the meaning in the context of the relevant art and are to be interpreted in an ideal or overly formal sense unless explicitly defined in the present application Do not.

1 is a view showing a vehicle to which a driver condition monitoring apparatus according to an embodiment of the present invention is applied.

1, when the sound source data is input from the sensors attached to one area of at least one of the seat back 11 and the seat belt 15 of the vehicle 10, And distinguishes between heart sound and / or breathing and noise according to the location and sound source characteristics of the input sound source data. At this time, the driver condition monitoring apparatus 100 can determine the driver's state according to the heart sound and / or breath of the driver, and can perform an operation corresponding thereto.

The driver condition monitoring apparatus 100 according to the present invention can be implemented inside the vehicle 10. [ At this time, the driver condition monitoring apparatus 100 may be integrally formed with the internal control units of the vehicle, or may be implemented as a separate apparatus and connected to the control units of the vehicle by separate connecting means.

The detailed configuration of the driver condition monitoring apparatus 100 will be described in detail with reference to FIG.

2 is a diagram illustrating a configuration of a driver condition monitoring apparatus according to an embodiment of the present invention. 2, the driver condition monitoring apparatus 100 includes a control unit 110, an interface unit 120, a sensor unit 130, a communication unit 140, a storage unit 150, a sound source analysis unit 160, A position determination unit 170, and a driver state determination unit 180. [ Here, the controller 110 may process signals transmitted between the respective components of the driver condition monitoring apparatus 100. [

The interface unit 120 may include an input means for receiving a control command from a user and an output means for outputting an operation state and a result of the driver condition monitoring apparatus 100.

Here, the input means may include a key button, and may include a mouse, a joystick, a jog shuttle, a stylus pen, or the like. Further, the input means may comprise a soft key implemented on the display.

The output means may comprise a display and may comprise a voice output means such as a speaker. In this case, when a touch sensor such as a touch film, a touch sheet, or a touch pad is provided on the display, the display operates as a touch screen, and the input means and the output means may be integrated.

The display may be a liquid crystal display (LCD), a thin film transistor liquid crystal display (TFT LCD), an organic light-emitting diode (OLED), a flexible display, , A field emission display (FED), and a 3D display (3D display).

The sensor unit 130 may include a sensor for collecting sounds generated by the driver and outputting sound source data for the collected sounds. For example, the sensor may include a microphone, a stethoscope, etc., which collects the driver's heartbeat and / or breath sounds. Of course, it is a matter of course that the sensor can be any device capable of collecting the heartbeat sound and the breathing sound of the driver in addition to the microphone and the stethoscope.

Here, a plurality of sensors may be provided, and a plurality of sensors may include at least three sensors. 2, the sensor unit 130 may include three sensors, that is, a first sensor 131, a second sensor 133, and a third sensor 135.

The first sensor 131 to the third sensor 135 may be disposed at different positions on the seat back of the vehicle, respectively. Further, the first sensor 131 to the third sensor 135 may be disposed at different positions on the seat belt of the vehicle seat, respectively. Further, some of the first sensor 131 to the third sensor 135 may be disposed on the seat back of the vehicle, and the remaining portions thereof may be respectively disposed on the seatbelt of the vehicle seat.

At this time, it is assumed that the first sensor 131 to the third sensor 135 are all arranged to face different body parts of the driver who boarded the vehicle.

For example, two of the first to third sensors 131 to 135 may be disposed at positions close to the driver's heart and lungs, respectively.

If sounds are generated in the driver's body or in the vicinity of the driver's mouth, the first sensor 131 to the third sensor 135 may be positioned in the driver's body or around the driver's mouth The generated sounds can be respectively collected.

Of course, in the embodiment of the present invention, three sensors are provided. However, the number of sensors disposed in at least one of the seat back and the seat belt of the vehicle is not limited to one, .

The communication unit 140 may include a communication module that supports communication interfaces with electrical components and / or control units provided in the vehicle.

Here, the communication module may include a module supporting vehicle network communication such as CAN (Controller Area Network) communication, LIN (Local Interconnect Network) communication, and Flex-Ray communication.

The communication unit 140 may include a module for wireless Internet access or a communication module for short range communication.

Here, the wireless Internet technology may include a wireless LAN (WLAN), a wireless broadband, a wi-fi, a Wi-Fi, a World Interoperability for Microwave Access (WiMAX) Technology may include Bluetooth, ZigBee, Ultra Wideband (UWB), Radio Frequency Identification (RFID), Infrared Data Association (IrDA), and the like.

The storage unit 150 may store data and / or algorithms necessary for the driver condition monitoring apparatus 100 to operate.

The storage unit 150 may store sound source data collected by the first sensor 131 and the third sensor 135, respectively. The storage unit 150 analyzes the characteristics of the sound source data collected by the first sensor 131 and the third sensor 135 and confirms the position of each sound source, / Or the algorithm can be stored.

Here, the storage unit 150 may be a random access memory (RAM), a static random access memory (SRAM), a read-only memory (ROM), a programmable read-only memory (PROM), an electrically erasable programmable read- -Only Memory).

The sound source analyzing unit 160 analyzes the sound source data of sounds collected by the first sensor 131 and the third sensor 135. At this time, the sound source analyzing unit 160 can analyze characteristics of each sound source data, for example, frequency, measurement time, duration, sound pressure, occurrence frequency and occurrence pattern.

The first sound source measured by the first sensor 131 and the third sensor 135 for one sound is equal in frequency and duration. However, since the positions of the respective sensors are different even if they are the same sound, the measurement time and sound pressure of the sound source measured by the first sensor 131 and the third sensor 135 of the first sensor 131 may be different.

For example, the heartbeat sound of the driver is measured by the first sensor 131 and the second sensor 133 disposed at the driver's chest region, and the third sensor 135 disposed farther from the chest, The measurement time of the sound source measured by the sound source becomes slower.

Accordingly, the sound source position confirmation unit 170 determines the sound source position using the frequency, measurement time, duration, and sound pressure of each sound source measured by the first sensor 131 and the third sensor 135, The location of occurrence can be confirmed. At this time, the heartbeat sound and breathing sound of the driver and the sound source generated from the outside are different from each other in sound source characteristics and sound source generation positions.

This embodiment will be described in more detail with reference to Figs. 3A to 5.

First, FIG. 3A shows a location where the first sensor 131 to the third sensor 135 are disposed and a location where the sound source is generated.

3A, the first sensor 131 is disposed on the left chest area of the driver, the second sensor 133 is disposed on the right chest area of the driver, and the third sensor 135 is disposed on the abdominal area of the driver .

At this time, when the heartbeat sound 311 and the external noise 321 are generated in the driver's body, the first sensor 131 to the third sensor 135 generate sound signals corresponding to the heartbeat sound 311 and the noise 321 The sound source can be measured individually.

4 shows sound sources measured by the heartbeat sound 311, the noise 321 and the first sensor 131 to the third sensor 135. FIG.

First, FIG. 4 (a) shows a heartbeat sound source, and FIG. 4 (b) shows a noise source. 4 (c) shows the sound sources measured by the first sensor 131, (d) shows the sound sources measured by the second sensor 133, (e) shows the sound sources measured by the third sensor 133, (135). ≪ / RTI >

Since the heart rate sound source corresponds to one sound generated from the heart of the driver, the heart rate sound sources measured by each sensor all have the same frequency and duration. It can be seen that the sound sources 431, 441, and 451 of FIGS. 4 (c) to 4 (e) all have the same frequency characteristics as the heartbeat sound source 411.

In addition, since the heartbeat sound source is a sound generated from the heart of the driver, the measurement time of the heartbeat sound source is accelerated according to the order of the sensors disposed close to the heart. In other words, the heart sound source can be measured first by the first sensor 131 disposed on the left chest area of the driver. Next, the heart sound source is measured in the order of the second sensor 133 -> the third sensor 135 Can be measured. Further, the closer the sound source is, the larger the sound pressure of the sound source measured by the sensor.

On the other hand, since the noise also corresponds to one sound, the heartbeat sound sources measured by each sensor all have the same frequency and duration. It can be seen that all of the sound sources 435, 445, and 455 in FIGS. 4C to 4E have the same frequency characteristics as the noise source 421.

 The sound sources 435, 445, 455, and 465 having the same frequency characteristics as the noise source 421 are connected to the first sensor 131, the second sensor 133, It can be seen that the generation position of the noise source is the lower left direction of the driver close to the position of the third sensor 135. [

Accordingly, the sound source position determining unit 170 identifies the sound sources measured from the same signal source according to the frequency characteristics among the sound sources measured by the first sensor 131 and the third sensor 135, The position of the sound source can be confirmed according to the measurement time of the sound source and the position of the sensor measuring the sound source and the sound pressure.

FIG. 3B shows an embodiment different from FIG. 3A, in which four sensors, that is, a first sensor 131 to a fourth sensor 137 are disposed, and a location where sound sources are generated.

3B, the first sensor 131 is disposed on the left chest area of the driver, the second sensor 133 is disposed on the right chest area of the driver, and the third sensor 135 is disposed on the right lower abdomen area of the driver And the fourth sensor 137 may be disposed at the left lower abdomen portion of the driver.

At this time, when a heartbeat sound 311 and an external noise 321 are generated in the driver's body, the first sensor 131 to the fourth sensor 137 generate sound signals corresponding to the heartbeat sound 311 and the noise 321 The sound source can be measured individually.

5 shows the sound source measured by the heartbeat sound 311, the noise 321, and the first sensor 131 to the fourth sensor 137. FIG.

First, FIG. 5 (a) shows a heart rate sound source, and FIG. 5 (b) shows a noise source. 5 (c) shows the sound sources measured by the first sensor 131, (d) shows the sound sources measured by the second sensor 133, (e) shows the sound sources measured by the third sensor 133, (F) shows the sound sources measured by the fourth sensor 137, and FIG.

Since the heart rate sound source corresponds to one sound generated from the heart of the driver, the heart rate sound sources measured by each sensor all have the same frequency and duration. It can be confirmed that the sound sources 431, 441, 451, and 461 in FIGS. 5C to 5F have the same frequency characteristics as those of the heartbeat sound source 411. FIG.

In addition, since the heartbeat sound source is a sound generated from the heart of the driver, the measurement time of the heartbeat sound source is accelerated according to the order of the sensors disposed close to the heart. In other words, the heart sound source can be measured first by the first sensor 131 disposed on the left chest area of the driver, and then the second sensor 133, the third sensor 135, (137), the heart rate sound source can be measured. Further, the closer the sound source is, the larger the sound pressure of the sound source measured by the sensor.

On the other hand, since the noise also corresponds to one sound, the heartbeat sound sources measured by each sensor all have the same frequency and duration. It can be seen that the sound sources 435, 445, 455, and 465 in FIGS. 5C to 5F all have the same frequency characteristics as the noise source 421.

 The sound sources 435, 445, 455, and 465 having the same frequency characteristics as the noise source 421 are connected to the fourth sensor 137, the third sensor 135, the first sensor 131, 2 sensor 133, the generation position of the noise source is the lower left direction of the driver who is close to the position of the fourth sensor 137.

The driver state determination unit 180 can determine the heartbeat sound and the breathing sound of the driver based on the sound source characteristics and the sound generating position, and can distinguish the heartbeat sound and the breathing sound from the noise.

For example, both heartbeat and breath sounds may occur at the driver's chest position. However, the sound source of heartbeat sound may occur once per second, and the sound source of respiration sound may occur about once per 4 seconds. As described above, the heartbeat sound and the breathing sound are different in frequency and occurrence pattern.

Therefore, the driver state determiner 180 can monitor the sound source data corresponding to the heartbeat sound and the breath sound in real time and determine the driver's state.

If it is confirmed that the frequency of occurrence of the heartbeat sound is high within a predetermined range, the driver state determination unit 180 can determine that the driver is in a state of tension. In this case, the control unit 110 can control a preset operation for relieving the driver's tensions. For example, the control unit 110 may control the MP3 device in the vehicle to provide music contents for relaxation, and may limit additional load factors such as telephone connection. Also, the controller 110 may set the navigation guidance period of the navigation device to be shorter.

If the occurrence frequency of the heartbeat sound exceeds the predetermined range or the occurrence pattern changes irregularly, the control unit 110 can determine that there is an abnormality in the driver's heart. In this case, the control unit 110 can control a preset operation to cope with the emergency situation of the driver. For example, the control unit 110 may attempt to make a call connection to a telephone number registered in advance or transmit a message registered in advance.

In addition, when the occurrence pattern of the breathing sound is low, the duration of the breathing is long, and the fricatives having a large sound pressure are generated, the driver's condition determination unit 180 can determine that the driver is sleepy have. In this case, the control unit 110 may control a preset operation to wake the driver. For example, the control unit 110 can control the volume in the vehicle by controlling the MP3 device in the vehicle, and can operate the shaking device of the vehicle seat or the steering wheel.

The operation flow of the apparatus according to the present invention will be described in more detail as follows.

6 is a flowchart illustrating an operation of a driver condition monitoring method according to an exemplary embodiment of the present invention.

6, when a driver sits on a seat of a vehicle and wears a seat belt, the driver's condition monitoring apparatus 100 according to the present invention includes a first sensor 131 disposed on a seatbelt of the vehicle and a seat back, To the third sensor 135 (S110).

At this time, the driver condition monitoring apparatus 100 analyzes each sound source measured by the first sensor 131 to the third sensor 135 (S120). In step 'S120', the driver condition monitoring apparatus 100 can analyze characteristic information of each sound source, for example, frequency, measurement time, duration, sound pressure, occurrence frequency and occurrence pattern.

The driver condition monitoring apparatus 100 confirms the sound source generation position using the analyzed characteristic information of each sound source through the process 'S120' (S130). At this time, the driver condition monitoring apparatus 100 distinguishes the sound sources measured from the same signal source according to the frequency characteristics among the sound sources measured by the first sensor 131 to the third sensor 135, The position of the sound source can be confirmed according to the measurement time of the sound source and the position of the sensor measuring the sound source and the sound pressure.

Then, the driver condition monitoring apparatus 100 checks the heartbeat sound and the breathing sound of the driver on the basis of the sound source generating position and the sound source characteristic confirmed in the process of 'S130'. Based on the heartbeat sound and the checking result of the breathing sound, (S140).

If it is determined that the driver is in an abnormal state as a result of the driver's state determination in step S140, the driver's condition monitoring apparatus 100 performs a control operation corresponding thereto (S150).

For example, when the driver is determined to be in any one of a tense state, a sleeping state, and a cardiac abnormal state, the driver state monitoring apparatus 100 performs a control operation for eliminating a tense state or a sleeping state of the driver, can do.

The apparatus according to the present embodiment operating as described above may be implemented in the form of an independent hardware apparatus and may be implemented as at least one processor included in another hardware apparatus such as a microprocessor or a general purpose computer system .

Figure 7 is a diagram of a computing system in which a method according to one embodiment of the invention is implemented.

7, a computing system 1000 includes at least one processor 1100, a memory 1300, a user interface input device 1400, a user interface output device 1500, (1600), and a network interface (1700).

The processor 1100 may be a central processing unit (CPU) or a memory device 1300 and / or a semiconductor device that performs processing for instructions stored in the storage 1600. Memory 1300 and storage 1600 may include various types of volatile or non-volatile storage media. For example, the memory 1300 may include a ROM (Read Only Memory) and a RAM (Random Access Memory).

Thus, the steps of a method or algorithm described in connection with the embodiments disclosed herein may be embodied directly in hardware, in a software module executed by processor 1100, or in a combination of the two. The software module may reside in a storage medium (i.e., memory 1300 and / or storage 1600) such as a RAM memory, a flash memory, a ROM memory, an EPROM memory, an EEPROM memory, a register, a hard disk, a removable disk, You may. An exemplary storage medium is coupled to the processor 1100, which can read information from, and write information to, the storage medium. Alternatively, the storage medium may be integral to the processor 1100. [ The processor and the storage medium may reside within an application specific integrated circuit (ASIC). The ASIC may reside within the user terminal. Alternatively, the processor and the storage medium may reside as discrete components in a user terminal.

The foregoing description is merely illustrative of the technical idea of the present invention, and various changes and modifications may be made by those skilled in the art without departing from the essential characteristics of the present invention.

Therefore, the embodiments disclosed in the present invention are intended to illustrate rather than limit the scope of the present invention, and the scope of the technical idea of the present invention is not limited by these embodiments. The scope of protection of the present invention should be construed according to the following claims, and all technical ideas within the scope of equivalents should be construed as falling within the scope of the present invention.

100: driver condition monitoring device 110:
120: interface unit 130: sensor unit
131: first sensor 133: second sensor
135: third sensor 140:
150: storage unit 160: sound source analysis unit
170: sound source position confirmation unit 180: driver state determination unit

Claims (20)

A plurality of sensors disposed on at least one of a seat back of the vehicle and a seat belt;
A sound source analyzer for analyzing characteristics information of each sound source measured by the plurality of sensors when the vehicle is turned on;
Determining sound sources measured by the same signal source on the basis of the analysis result of the characteristic information of each sound source, determining a sound source position for confirming a sound source generation position based on the measurement time of the sound sources and the position of each sensor measuring the sound source part; And
A driver state determining unit for determining a heartbeat and a breathing state of the driver based on the sound source generating position identified for the sound sources and the characteristic information of the sound sources,
And a controller for controlling the driver of the vehicle. The method according to claim 1,
Wherein the plurality of sensors comprise:
And are arranged to face different body parts of a driver aboard the vehicle. The method of claim 2,
Further comprising a storage unit in which position information of each of the plurality of sensors is stored. The method according to claim 1,
Wherein the plurality of sensors comprise:
Wherein at least three sensors are included. The method according to claim 1,
Wherein the sound source analyzing unit comprises:
And analyzing at least one of frequency, measurement time, duration, sound pressure, occurrence frequency, and occurrence pattern of each sound source measured by the plurality of sensors. The method according to claim 1,
The sound source position determination unit may determine,
And determines the sound sources measured by the same signal source based on the frequency and duration information of each sound source. The method of claim 6,
The sound source position determination unit may determine,
Wherein the sound source generation position is confirmed based on a measurement time of the sound sources, sound pressure, and position information of a sensor that measures the sound source. The method according to claim 1,
The driver state determination unit may determine,
Wherein the heart rate sound source and the breathing sound source are classified based on the sound source generating position identified for the sound sources, the occurrence frequency and pattern of the sound sources, and the like. The method of claim 8,
The driver state determination unit may determine,
Sleep state, or abnormal state of the driver based on the occurrence frequency and pattern of the heartbeat sound source and the breathing sound source. The method of claim 9,
Further comprising: a controller for processing a predetermined control operation according to a tense state, a sleeping state, or an abnormal state of the driver. The method according to claim 1,
The driver state determination unit may determine,
Wherein the noise source classification unit classifies the noise sources based on the identified sound source generating positions for the sound sources, the occurrence frequency of the sound sources, and the pattern. Measuring a sound source by a plurality of sensors disposed on at least one of a seat back and a seat belt of the vehicle when the vehicle is turned on;
Analyzing the measured characteristic information of each sound source;
Determining sound sources measured by the same signal source on the basis of the analysis result of the characteristics information of each sound source and confirming a sound source generation position based on the measurement time of the sound sources and the position of each sensor measuring the sound source; And
Determining a heart rate and a breathing state of the driver based on the sound source generating position identified for the sound sources and the characteristic information of the sound sources
And monitoring the driver condition. The method of claim 12,
Wherein the plurality of sensors comprise:
A plurality of vehicle body parts arranged to face different body parts of a driver aboard the vehicle,
Further comprising the step of storing location information of each of the plurality of sensors. The method of claim 12,
The step of analyzing the characteristic information of each sound source includes:
Wherein at least one of frequency, measurement time, duration, sound pressure, occurrence frequency and occurrence pattern of each sound source measured by the plurality of sensors is analyzed. The method of claim 12,
Wherein the step of confirming the sound source generating position comprises:
And determining sound sources measured by the same signal source based on frequency and duration information of each sound source. 16. The method of claim 15,
Wherein the step of confirming the sound source generating position comprises:
Further comprising the step of confirming the sound source generation position based on the measurement time of the sound sources, the sound pressure, and the position information of the sensor measuring the sound source. The method of claim 12,
The method further comprises the step of classifying the heart rate sound source and the breathing sound source on the basis of the sound source generation position identified with respect to the sound sources, the occurrence frequency and the pattern of the sound sources prior to the step of determining the heartbeat and respiration state of the driver The driver status monitoring method comprising: 18. The method of claim 17,
The step of determining the driver's heartbeat and respiration state comprises:
Wherein the driver is determined to be in a tense state, a sleeping state, or an abnormal state based on the occurrence frequency and pattern of the heartbeat sound source and the breathing sound source. 19. The method of claim 18,
Further comprising the step of processing a predetermined control operation according to a tense state, a sleeping state, or an abnormal state of the driver. The method of claim 12,
Further comprising the step of classifying the noise source based on the sound source generating position identified for the sound sources, the frequency and pattern of the sound sources before the step of determining the driver's heartbeat and respiration state, State monitoring method.

Images