TWI727819B - Fatigue driving identification system and its identification method - Google Patents

Abstract

A fatigue driving identification system and its identification method. The optical identification module and the monitoring module are mainly assembled by the vehicle. The optical identification module includes an image capturing unit, an image receiving unit, an estimation calculation processing unit, a transmission unit and a power supply. The supply unit. The image capture unit emits a laser beam or LED beam on the face of the object to be measured, and captures facial image information. The wavelength of the laser beam is between 940nm and 1400nm. The transmission unit transmits eye identification and head Part of the position information is provided to the monitoring module, and the optical recognition module uses the optical recognition module to perform the on-the-fly ranging recognition steps and procedures on the face of the object to be measured; thereby, when the driver is tired or naps, the driver can be notified in real time, Prevent the driver from getting involved in a traffic accident when the driver is physically exhausted.

Description

Fatigue driving identification system and its identification method

The present invention relates to an identification system, in particular to a fatigue driving identification system and an identification method thereof.

According to the current situation, 20% of traffic accidents and up to a quarter of fatal major traffic accidents are caused by drivers’ physical fatigue, illness, fever, or drunk driving. Therefore, prevention of fatigue driving, sick driving and drunk driving is important for reducing traffic accidents. It is of great significance to protect the personal safety of drivers. For fatigue driving, the current detection methods are mainly divided into subjective evaluation and objective evaluation.

Subjective evaluation is through the driver's self-evaluation or the evaluation of the driver by others. This method is obviously affected by human factors and the evaluation standards are inconsistent, so objective evaluation is required. Studies have shown that many indicators of the human body’s ECG signal are closely related to the degree of fatigue of the human body. The existing human body needs to be detected by skin-adhesive electrode contact and by new capacitive electrode and ordinary ground electrode non-contact detection to realize the driver ECG monitoring, in order to achieve the purpose of detecting fatigue driving.

However, the traditional ECG detection method of the former human skin contact type is not suitable for the driver's application; while the specific method of the latter non-contact detection is: the detection device is designed, and the capacitance electrode of the detection device is made of double panels and placed in On the driver’s seat, it is used as a signal electrode: the ground electrode is made of a thick same skin, installed on the outer edge of the left half circle of the steering wheel, connected to the analog ground in the circuit, and directly contacted with the driver’s left hand during driving. In this way, the electrode configuration detection method is formed. The driver wears ordinary clothes and drives normally. The ECG signal is transmitted to the post-amplification circuit through the coupling effect of the capacitor electrode, and captured by the analog-to-digital converter (ADC) The digitized ECG signal can be detected by the host computer, which helps to reduce the interference caused by the upper body movement of the driver. However, this non-contact method is theoretically feasible, but the practical application is not enough; the capacitive signal electrode is made of PCB, It is not easy to withstand the collision impact of the vehicle body while the driver is sitting in the driver's seat, and the ground electrode still needs to be touched by the left hand of the person, which is not a true non-contact detection.

Preventing fatigue driving is not only to detect the driver’s fatigue level through the human body’s ECG for prevention and treatment, but more importantly, when the driver’s fatigue has been detected, especially when the driver’s attention is not concentrated and the ability to respond is reduced. It is difficult to control the vehicle in real time, and the driver can be warned in real time to avoid traffic accidents.

Therefore, after observing the above-mentioned deficiencies, the inventor of the present case came to the present invention.

The main purpose of the present invention is to provide a fatigue driving identification system and identification method, which can quickly obtain the driver's facial information and the driver's eye information, identify the fatigue state, and send out warning messages to remind driving in real time In order to improve the safety in the process of driving, so as to reduce the occurrence of traffic accidents.

In order to achieve the above objective, the present invention provides a fatigue driving identification system, which includes: a vehicle; and an optical identification module, which is assembled on at least one side pillar inside the vehicle, and the side pillar is located in the vehicle On one side of a driver’s seat inside, the optical identification module includes a plurality of image capturing units, at least one image receiving unit, an estimation processing unit, at least one transmission unit, and a power supply unit. The optical identification The module illuminates the face of an object to be measured; wherein the image capturing units emit multiple laser beams or multiple LED beams to the face of the object to be measured, and capture multiple facial image information. The wavelength of the laser beam is between 940nm and 1400nm; the image receiving unit is electrically connected to the image capturing units, and is used to obtain face scale information by using at least one face comparison image information to correct the scale , And convert the laser beams or the corresponding transmission paths of the LED beams to the corresponding transmission and reflection paths to convert the complex structured beams, and calculate to form complex facial image information of the object to be measured and complex beam flight time information; the estimation calculation processing The unit is electrically connected to the image receiving unit, and the estimation calculation processing unit receives the face image information of the object to be measured and the light beam flight time information provided by the image receiving unit, and calculates the object to be measured At least one eye recognition information, at least one head position information, and at least one eye-closing time information of the face in the measurement environment; the transmission unit is electrically connected to the image capturing units, the image receiving unit, and the estimation A measurement processing unit, the transmission unit transmits the eye identification information to at least one monitoring module; and the power supply unit, which is electrically connected to the transmission unit.

Preferably, the wavelength of the laser beams emitted by the image capturing units is between 1310 nm and 1350 nm.

Preferably, the distance at which the image capturing units emit the laser beams or the LED beams is between 1 m and 3 m.

Preferably, the structured light beams are projected on an image projection area and form a plurality of superimposed patterns, the image projection area has a plurality of sub-projection areas arranged in an array and adjacent to each other, and the superimposed pattern is projected on each of the sub-projections. The pattern distribution of the areas are different from each other, and the image information of the waiting object and the flight time information of the beams are formed by calculation.

Preferably, the horizontal viewing angle of the monitoring viewing angle of the optical identification module ranges from 0 degrees to 120 degrees, and the vertical viewing angle ranges from 0 degrees to 90 degrees.

Preferably, the transmission unit includes at least one antenna, at least one signal transmission component and at least one power transmission component, and the transmission unit is used for information transmission of wireless signals or wired signals.

Preferably, the monitoring module is a vehicle computer, and the vehicle is equipped with a central control processing module, and the transmission module is connected to at least one control area network confluence in the central control processing module The control area network bus is selected from one or a combination of a serial communication network (Local Interconnect Network) and a control bus network (Controller Area Network), and in addition, the transmission unit can be transmitted through the signal The software is connected to the monitoring module via Ethernet.

In order to achieve the above objective, the identification method of a fatigue driving identification system provided by the present invention includes the following steps: the image capturing units of the optical identification module emit the mines to the face of the object under test The laser beam or the LED beams, the wavelength of the laser beams is between 940nm and 1350nm; scans the face of the object to be measured, and captures the facial image information; the image receiving unit uses at least one face Compare the image information to obtain facial scale information to correct the scale; the laser beams or the LED beams correspond to the transmission and reflection transmission paths to convert the structured beams, and calculate the face image of the object to be measured Information and the flight time information of the light beams; the estimation calculation processing unit receives the face image information of the object to be measured and the light beam flight time information provided by the image receiving unit, and calculates the face of the object to be measured The eye recognition information in the measurement environment; the optical recognition module performs a comparison data procedure based on the eye recognition information, and the comparison data procedure is to determine the degree of closure of the eyes of the face of the object to be measured, and to determine The gaze position of the eyes of the face of the object to be measured; when the eyes of the face of the object to be measured are closed or half-closed in a set time sensing interval, the transmission unit sends an alarm notification to the monitoring module Information; and when the gaze position of the face of the object under test is downward or upward, the transmission unit sends an alarm notification information to the monitoring module.

Preferably, the wavelength of the laser beams emitted by the image capturing units is between 1310nm and 1350nm, and the distance between the laser beams or the LED beams is between 1m and 3m, and, The time sensing interval is 2 seconds to 5 seconds; the structured light beams are projected on an image projection area and form a plurality of superimposed patterns. The image projection area has a plurality of sub-projection areas arranged in an array and adjacent to each other, and the The pattern distribution of the superimposed pattern in each sub-projection area is different from each other, and the image information of the object to be measured and the flight time information of the beams are formed by calculation

Preferably, wherein the optical identification module performs the comparison data procedure according to the head position information, and the comparison data procedure is to identify the inclined position of the head of the object to be tested; when the head of the object to be tested When the head is lowered, the transmission unit sends out an alarm notification message to the monitoring module; and when the head of the object to be measured is leaned to the left and right sides, the transmission unit sends out an alarm notification message to the monitoring module.

The fatigue driving identification system and the identification method thereof provided by the present invention mainly set up the optical identification module through the side pillar of the vehicle, and identify the face of the object under test by the optical identification module. Quickly obtain the eye recognition information of the face of the test object, recognize the fatigue state, and send out warning messages to remind the driver in real time, thereby improving the safety during driving and reducing the occurrence of traffic accidents.

(First embodiment)

Hereinafter, with reference to the drawings, an embodiment of the first embodiment of the fatigue driving recognition system of the present invention will be described.

Please refer to Figures 1 to 4. Figure 1 is a schematic diagram of the system of the first embodiment of the invention, Figure 2 is a schematic diagram of the installation location of the first embodiment of the invention, and Figure 3 is a schematic diagram of the system architecture of the first embodiment of the invention 4 is a schematic diagram of the identification of the projection area of the displayed image in the first embodiment of the present invention. The present invention discloses a fatigue driving identification system 100, which includes:

One vehicle 10.

An optical recognition module 20, which is assembled on at least one side post 11 inside the vehicle 10, the side post 11 is located on one side of a driver's seat in the vehicle 10, and the optical recognition module 20 includes a plurality of An image capturing unit 21, at least one image receiving unit 22, an estimation processing unit 23, at least one transmission unit 24 and a power supply unit 25, the optical recognition module 20 illuminates the face of an object 200 .

The image capturing units 21 emit multiple laser beams or multiple LED beams to the face of the test object 200, and capture multiple facial image information. The wavelengths of the laser beams are between 940nm and 1400nm . It should be further explained that, in this embodiment, the wavelength of the laser beams emitted by the image capturing units 21 is between 1310 nm and 1350 nm.

In addition, the image capturing units 21 are provided with a plurality of laser diodes (not shown in the figure). The laser diodes are mainly made of AlGaInAs and InGaAsP material series and require an operating power greater than tens of mW. For laser diodes above 1W, the most important aspect of the present invention is to use single-mode, frequency-stabilized laser diodes with a beam wavelength of 1310nm as the emitting light source; in addition, these laser diodes are Multiple semiconductor lasers or multiple light-emitting diodes arranged in an array. The semiconductor laser is, for example, a Vertical-Cavity Surface-Emitting Laser (VCSEL) or a photonic crystal laser (Photonic crystal laser).

Furthermore, the wavelengths of these laser beams are used from 1310nm to 1350nm. The biggest feature is that they can generate lasers of multiple wavelengths at the same time. The wavelength distribution is based on the center frequency. Lasers of other wavelengths are generated every 3nm or 6nm. If the center is assumed When the wavelength is 1315nm, the lasers of other wavelengths are 1318/1315/1312/1309...etc. In more detail, it has the characteristics of multi-mode (wavelength) when in use; it is important that long eyes are generally used It is sensitive to purple light with a wavelength of 400 nm to red light at 700 nm; however, the laser beams have longer wavelengths and are invisible to the naked eye. Therefore, the eyes of the test object 200 can be protected.

1角度範圍介於0度至120度，而垂直視角

2角度範圍為0度至90度。 Please refer to FIG. 5 and FIG. 6 in conjunction with FIG. 4. FIG. 5 is a schematic diagram of the recognition state of the optical recognition device according to the first embodiment of the present invention, and FIG. 6 is the recognition range of the image capturing unit according to the first embodiment of the present invention Schematic. The horizontal viewing angle of the monitoring angle of view (FOV) of the optical identification module 20

1 The angle range is from 0 degrees to 120 degrees, and the vertical viewing angle

2The angle range is from 0 degrees to 90 degrees.

The image receiving unit 22 is electrically connected to the image capturing units 21, and is used to obtain facial scale information to correct the scale by using at least one face comparison image information, and to adjust the laser beams or the laser beams. The LED light beam corresponds to the transmission path of the transmission and reflection to convert the complex structured light beam, and calculate and form a complex number of face image information of the object to be measured and complex number of light beam flight time information.

In this embodiment, as shown in FIG. 4, the structured light beams are projected on an image projection area 221 and form a complex superimposed pattern 222. The image projection area 221 has a plurality of sub-projection areas 2211 arranged in an array and adjacent to each other. And the pattern distribution of the superimposed pattern 222 in each sub-projection area is different from each other, and the image information of the object to be measured and the flight time information of the light beams are formed by calculation. In more detail, the present invention can recognize the facial information of the object 200 based on the difference in the pattern distribution in each projection area and the amount of change.

In addition, the calculation of the facial information also includes that the laser beams reflected from the target arrive at the image receiving unit 22 (for example, a photodetector), and the electric signal output is converted to stop the time counting, so as to know the flight time of the beam ; The method of measuring the round-trip ToF Δt time can calculate the distance R to the reflection point, and the distance R is determined by the following formula:

In the formula, c is the speed of light in vacuum, n is the refractive index of the propagation medium (approximately 1 for air). There are two factors that affect the distance resolution ΔR: the uncertainty δΔt when measuring Δt and the pulse width. Spatial error w (w = cτ).

The estimation operation processing unit 23 is electrically connected to the image receiving unit 22, and the estimation operation processing unit 23 receives the face image information of the object to be measured and the flight time of the light beams provided by the image receiving unit 22 Information, and calculate at least one eye recognition information 231, at least one head position information 232, and at least one eye-closing time information of the face of the test object 200 in the measurement environment.

The transmission unit 24 is electrically connected to the image capturing unit 21, the image receiving unit 22, and the estimation operation processing unit 23. The transmission unit 24 transmits the eye identification information 231, the head position information 232, and The closed-eye time data is given to at least one monitoring module 30. In this embodiment, as shown in FIG. 1, the transmission unit 24 includes at least one antenna, at least one signal transmission component, and at least one power transmission component. The transmission unit 24 is used for information transmission of wireless signals or wired signals. .

It should be further explained that the antenna of the transmission unit 24 is used for information transmission of wireless signals, which is selected from the group consisting of Bluetooth, third-generation mobile communications (3G), fourth-generation mobile communications (4G), and wireless One of the wireless communication protocols of local area network (Wi-Fi), wireless local area network (WLAN), and fifth-generation mobile communication (5G); in addition, the signal transmission component of the transmission unit 24 is information of a wired signal Transmission, which is Ethernet. In this embodiment, as shown in FIG. 3, the monitoring module 30 is a vehicle computer, and the vehicle 10 is equipped with a central control processing module 40, and the transmission module is connected to the central control processing module At least one control area network bus within 40, the control area network bus is selected from one of a serial communication network (LIN, Local Interconnect Network) and a control bus network (CAN, Controller Area Network) or In combination, the transmission unit 24 can be connected to the monitoring module 30 via the signal transmission unit via Ethernet; in addition, the central control processing module 40 is selected from the group of central control carriers and dashboards One or a combination of them.

The power supply unit 25 is electrically connected to the transmission unit 24. In this embodiment, the power supply unit 25 can supply power to an internal replaceable battery or connect to an external power line, but the present invention is not limited to this. In another preferred embodiment, the power supply The unit 25 is a replaceable battery power supply mode as an example.

In order to further understand the structural features of the present invention, the technical means used and the expected effects, the use of the present invention is described. It is believed that a more in-depth and specific understanding of the present invention can be obtained from this, as follows:

Please refer to FIG. 7 and FIG. 8 in conjunction with FIG. 3 to FIG. 6. FIG. 7 and FIG. 8 are schematic diagrams of the identification result of the image capturing unit according to the first embodiment of the present invention. The image capturing units 21 of the optical identification module 20 emit the laser beams or the LED beams to the face of the test object 200, and the wavelengths of the laser beams are between 940nm and 1350nm , Scan the face of the test object 200, and capture the facial image information, the image receiving unit 22 uses at least one facial comparison image information to obtain facial scale information to correct the scale, the laser beams Or the LED beams correspond to the transmission and reflection transmission paths to convert the structured beams, and calculate and form the face image information of the object to be measured and the flight time information of the beams, and the estimation calculation processing unit 23 receives the image The face image information of the object to be measured and the flight time information of the light beams provided by the receiving unit 22, and the eye recognition information 231 and the head position information 232 of the face of the object to be measured 200 in the measurement environment are calculated And the closing time data.

It should be further explained that, as shown in FIG. 3, FIG. 7 and FIG. 8, the estimation calculation processing unit 23 calculates the eye recognition information 231 and head position information of the face of the test object 200 in the measurement environment. 232, when the eye closure of the eye identification information 231 is closed or half-closed, the monitoring module sends an alarm notification message to the central control processing module 40, and the eye closure of the eye identification information 231 The time is between 2 seconds and 5 seconds, and when the head of the head position information 232 is lowered or leaned to the left and right, the monitoring module sends an alarm notification information to the central control processing module 40, so as to remind in real time driver.

Therefore, it can be further understood from the above description that the present invention uses the arrangement of the optical identification module 20, and the image capturing units 21 of the optical identification module 20 scan the face of the test object 200, The image receiving unit 22 uses at least one face comparison image information to obtain face scale information to correct the scale, and the laser beams correspond to the transmission and reflection transmission paths to convert the structured beams, and calculate the waiting The face image information of the object to be measured and the light beam flight time information, and the estimation calculation processing unit 23 receives the face image information of the object to be measured and the light beam flight time information provided by the image receiving unit 22, and calculates Obtain the eye recognition information 231, the head position information 232, and the eye-closing time data of the face of the test object 200 in the measurement environment, so that the fatigue degree of the test object 200 can be recognized in real time. When the optical recognition model When the group 20 recognizes the fatigue state of the test object 200, the transmission unit 24 sends the alarm notification information to the monitoring module 30, and the monitoring module 30 transmits the alarm notification information to the central control processing module 40. In order to achieve immediate notification to the driver, so as to reduce the occurrence of traffic accidents.

(Second embodiment)

Please refer to FIG. 9, which is a schematic diagram of the system architecture of the second embodiment of the present invention. Compared with the first embodiment, the main structural difference of the second embodiment is that the fatigue driving recognition system 100 further includes at least one warning module 50 which is electrically connected to the monitoring module 30. When the optical recognition module 20 recognizes the fatigue state of the test object 200, the transmission unit 24 sends the alarm notification information to the monitoring module 30, and at the same time activates the warning module 50 to remind the driver, In this embodiment, the warning module 50 is a speaker, and the warning module 50 emits a sound to remind the driver. However, the present invention is not limited to this. In another preferred embodiment, the warning module 50 is a smart phone or a steering wheel, and when the warning module 50 is a smart phone, the transmission unit 24 is directed to the The monitoring module 30 sends out the alarm notification information, and at the same time transmits the alarm notification information to the warning module 50, the warning module 50 sounds and vibrates to remind the driver; when the warning module 50 is a steering wheel, the The transmission unit 24 sends the alarm notification information to the monitoring module 30, and at the same time activates the warning module 50, the warning module 50 vibrates, and the driver's two hands hold the direction, so that the driver can be notified in real time . In addition, the warning module 50 can be selected from one or a combination of a speaker, a smart phone, and a steering wheel.

Thereby, the second embodiment can not only achieve the effect of the first embodiment, but also provide a different structure. The second embodiment can increase the convenience and practicability of use through the arrangement of the warning module 50, and Improve the driving safety of drivers, so as to reduce the occurrence of traffic accidents.

(Step flow of the identification method of the first embodiment)

Please refer to FIG. 10 in conjunction with FIG. 1 to FIG. 9. FIG. 10 is a schematic diagram of the process steps of the identification method according to the first embodiment of the present invention. The present invention is based on the aforementioned fatigue driving identification system 100, and further provides an identification method of the fatigue driving identification system 100, which includes the following steps:

Step S1: The image capturing units 21 of the optical identification module 20 emit the laser beams or the LED beams to the face of the object 200, and the wavelengths of the laser beams are between 940 nm and 940 nm. Between 1350nm.

Step S2: Scan the face of the test object 200, and capture the facial image information.

Step S3: The image receiving unit 22 uses at least one face to compare image information to obtain face scale information to correct the scale.

Step S4: The corresponding transmission and reflection transmission paths of the laser beams or the LED beams are converted to the structured beams, and the facial image information of the object to be measured and the flight time information of the beams are formed by calculation.

Step S5: The estimation calculation processing unit 23 receives the face image information of the object to be measured and the light beam flight time information provided by the image receiving unit 22, and calculates that the face of the object to be measured 200 is in the measurement environment The eye identification information in 231.

Step S6: The optical recognition module 20 performs a comparison data procedure based on the eye recognition information 231. The comparison data procedure is to determine the degree of closure of the eyes of the face of the test object 200 and determine the test object The gaze position of the eyes of the face of 200. In this embodiment, the step S6 includes the following steps, among which:

Step S6A: When the eyes of the face of the test object 200 are closed or half-closed in a set time sensing interval, the time sensing interval is 2 to 5 seconds.

Step S61A: The transmission unit 24 sends an alarm notification message to the monitoring module 30.

Step S6B: When the gaze position of the face of the object 200 is downward or upward.

Step S61B: The transmission unit 24 sends an alarm notification message to the monitoring module 30.

In this embodiment, when the eyes of the face of the test object 200 are closed or half-closed, or when the gaze position of the eyes of the face of the test object 200 is downward or upward, when the monitoring module 30 is In the case of a car computer, the alarm notification information sends out a warning pattern on the operating interface of the central control processing module 40; in addition, the monitoring module 30 sends out the alarm notification information, and at the same time activates the warning module 50, the alarm The notification information can be sounded or vibrated through the warning module 50.

In addition, when the results of step S6A and step S6B are not closed or half closed, and the gaze position of the eye is not downward or upward, steps S1, S2, S3, S4, and S5 are sequentially repeated. , Step S6, Step S6A, and Step S6B.

It should be further explained that, please refer to FIG. 11A and FIG. 11B. FIG. 11A and FIG. 11B are schematic diagrams of the process steps of the identification method according to the second embodiment of the present invention. In step S6, the optical identification module 20 performs the comparison data procedure according to the head position information 232. The comparison data procedure is to identify the tilt position of the head of the object 200. The step S6 includes There are the following steps, among them:

Step S6C: When the head of the test object 200 is lowered.

Step S61C: The transmission unit 24 sends an alarm notification message to the monitoring module 30.

Step S6D: When the head of the test object 200 leans to the left and right sides.

Step S61D: The transmission unit 24 sends an alarm notification message to the monitoring module 30.

In addition, when the judgment results of step S6A, step S6B, step S6C, and step S6D are not closed or half-closed, and the gaze position of the eyes is not downward or upward, and the head is not lowered or leaned to the left and right, it Step S1, step S2, step S3, step S4, step S5, step S6, step S6A, step S6B, step S6C, and step S6D are repeated sequentially.

It is worth mentioning that because the wavelength of the laser used for identification in general mobile phones or surveillance equipment is 940nm, and infrared lasers of this wavelength have also been medically proven to be harmful to the human eye, which can cause cataracts and retinal burns; The wavelength of the laser beams used in the present invention is 1310 nm, and in more detail, it is harmless to the driver’s eyes.

It is worth mentioning that when the optical identification module 20 of the present invention can emit the LED light beams, the red light wavelength of the LED light beams ranges from 620 nm to 900 nm.

Hereinafter, the characteristics of the present invention and the expected effects that can be achieved are stated as follows:

The fatigue driving identification system 100 and the identification method thereof of the present invention mainly set the optical identification module 20 through the side pillar 11 of the vehicle 10, and use the optical identification module 20 to detect the face of the test object 200 It can quickly obtain the eye recognition information 231, the head position information 232, and the eye-closing time data of the face of the test object 200, and identify the fatigue state, and send out a warning message to remind the driver in real time. Improve safety in the process of driving, so as to reduce the occurrence of traffic accidents.

The present invention has the following implementation effects and technical effects:

First, through the arrangement of the optical recognition module 20, the optical recognition module 20 recognizes through time-of-flight distance measurement, so that the fatigue driving recognition system 100 has the ability to accurately recognize the face of the test object 200 and has low calculations. The advantages of volume.

Second, the present invention adopts the arrangement of the optical identification module 20 and the arrangement of the monitoring module and the central control processing module 40. The image capturing units 21 of the optical identification module 20 scan the For the face of the test object 200, when the optical recognition module 20 recognizes that the test object 200 is in a fatigue state, the transmission unit 24 sends the alarm notification information to the monitoring module 30, and the monitoring module 30 The alarm notification information is sent to the central control processing module 40, so as to notify the driver in real time, so as to reduce the occurrence of traffic accidents.

Third, the present invention adopts the arrangement of the image capturing units 21, and the laser beams emitted by the image capturing units 21 have a wavelength between 1310 nm and 1350 nm, so as to reduce the driver's eye damage.

In summary, the present invention has excellent practicality in similar products. At the same time, we have checked the domestic and foreign technical information about this type of structure. The literature has not found the same structure. Therefore, The present invention actually has the requirements for a patent for invention, and an application is filed in accordance with the law.

However, the above are only the preferred and feasible embodiments of the present invention, so any equivalent structural changes made by applying the specification of the present invention and the scope of the patent application should be included in the patent scope of the present invention.

100: Fatigue driving recognition system

10: Vehicle

11: Side column

20: Optical identification module

21: Image capture unit

22: Image receiving unit

221: Image projection area

2211: Sub-projection area

222: superimposed pattern

23: Estimated calculation processing unit

231: Eye Recognition Information

232: head position information

24: Transmission unit

25: power supply unit

30: Monitoring module

40: Central control processing module

50: Warning module

200: DUT

S1: Step

S2: Step

S3: steps

S4: Step

S5: steps

S6: steps

S6A: steps

S61A: Step

S6B: steps

S61B: Step

S6C: steps

S61C: Step

S6D: steps

S61D: steps

1:水平視角

1: Horizontal viewing angle

2:垂直視角

2: Vertical viewing angle

Fig. 1 is a schematic diagram of the system of the first embodiment of the present invention. Fig. 2 is a schematic diagram of the installation position of the first embodiment of the present invention. FIG. 3 is a schematic diagram of the system architecture of the first embodiment of the present invention. 4 is a schematic diagram of the identification of the projection area of the displayed image in the first embodiment of the present invention. 5 is a schematic diagram of the recognition state of the optical recognition device according to the first embodiment of the present invention. 6 is a schematic diagram of the recognition range of the image capturing unit according to the first embodiment of the present invention. FIG. 7 is a schematic diagram of the identification result of the image capturing unit according to the first embodiment of the present invention. FIG. 8 is a schematic diagram of the identification result of the image capturing unit according to the first embodiment of the present invention. FIG. 9 is a schematic diagram of the system architecture of the second embodiment of the present invention. FIG. 10 is a schematic diagram of the flow steps of the identification method according to the first embodiment of the present invention. 11A is a schematic diagram of the process steps of the identification method according to the second embodiment of the present invention.

FIG. 11B is a schematic diagram of the flow steps of the identification method according to the second embodiment of the present invention.

100: Fatigue driving recognition system

20: Optical identification module

21: Image capture unit

22: Image receiving unit

23: Estimated calculation processing unit

24: Transmission unit

25: power supply unit

30: Monitoring module

Claims (10)

A fatigue driving identification system, which includes: A vehicle; and An optical identification module, which is assembled on at least one side pillar inside the vehicle, the side pillar is located on one side of a driver's seat in the vehicle, and the optical identification module includes a plurality of image capturing units, At least one image receiving unit, one estimation operation processing unit, at least one transmission unit and one power supply unit, the optical identification module illuminates the face of an object to be measured; Among them, the image capturing units emit multiple laser beams or multiple LED beams to the face of the object to be measured, and capture multiple facial image information, and the wavelengths of the laser beams are between 940nm and 1400nm ； The image receiving unit is electrically connected to the image capturing units, and is used for obtaining facial scale information by using at least one face comparison image information to correct the scale, and combining the laser beams or the LED beams Corresponding to the transmission and reflection transmission paths to convert the complex structured light beams, and calculate and form complex facial image information of the object to be measured and complex light beam flight time information; The estimation operation processing unit is electrically connected to the image receiving unit. The estimation operation processing unit receives the face image information of the object to be measured and the light beam flight time information provided by the image receiving unit, and calculates At least one eye identification information, at least one head position information, and at least one eye-closing time data of the face of the object under test in the measurement environment; The transmission unit is electrically connected to the image capturing units, the image receiving unit, and the estimation operation processing unit, and the transmission unit transmits the eye identification information, the head position information, and the closed eye time data to at least one Monitoring module; and The power supply unit is electrically connected to the transmission unit. For example, the fatigue driving identification system of claim 1, wherein the wavelength of the laser beams emitted by the image capturing units is between 1310 nm and 1350 nm. For example, the fatigue driving identification system of claim 1, wherein the distance at which the image capturing units emit the laser beams or the LED beams is between 1m and 3m. For example, the fatigue driving identification system of claim 1, wherein the structured light beams are projected on an image projection area and image a complex superimposed pattern, the image projection area has a plurality of sub-projection areas arranged in an array and adjacent to each other, and the superposition The pattern distribution of the patterns in each sub-projection area is different from each other, and the image information of the waiting object and the flight time information of the light beams are formed by calculation. For example, the fatigue driving identification system of claim 1, wherein the horizontal viewing angle of the monitoring viewing angle of the optical identification module is in the range of 0 degrees to 120 degrees, and the vertical viewing angle is in the range of 0 degrees to 90 degrees. For example, the fatigue driving identification system of claim 1, wherein the transmission unit includes at least one antenna, at least one signal transmission component and at least one power transmission component, and the transmission unit is used for information transmission of wireless signals or wired signals. For example, the fatigue driving identification system of claim 6, wherein the monitoring module is a vehicle computer, and the vehicle is equipped with a central control processing module, and the transmission module is connected to at least one of the central control processing modules A control area network bus, the control area network bus is selected from one or a combination of a serial communication network and a control bus network, in addition, the transmission unit can transmit an Ethernet through the signal The monitoring module is connected to the network. An identification method using the fatigue driving identification system of claim 1, which includes the following steps: The image capturing units of the optical identification module emit the laser beams or the LED beams to the face of the object to be measured, and the wavelength of the laser beams is between 940nm and 1400nm; Scan the face of the object to be tested, and capture the facial image information; The image receiving unit uses at least one face comparison image information to obtain face scale information to correct the scale; The laser beams or the LED beams correspond to the transmission and reflection transmission paths to convert the structured beams, and calculate and form the face image information of the waiting object and the flight time information of the beams; The estimation calculation processing unit receives the face image information of the object to be measured and the light beam flight time information provided by the image receiving unit, and calculates the eye recognition information of the face of the object to be measured in the measurement environment ； The optical recognition module performs a comparison data procedure based on the eye recognition information. The comparison data procedure is to determine the degree of closure of the eyes of the face of the object to be tested, and to determine the degree of closure of the eyes of the face of the object to be tested. Gaze position When the eyes of the face of the object to be tested are closed or half-closed in a set time sensing interval, the transmission unit sends an alarm notification message to the monitoring module; and When the eye gaze position of the face of the object to be measured is downward or upward, the transmission unit sends an alarm notification message to the monitoring module. For example, the identification method of the fatigue driving identification system of claim 8, wherein the wavelength of the laser beams emitted by the image capturing units is between 1310 nm and 1350 nm, and the distance between the laser beams or the LED beams Between 1m and 3m, and the time sensing interval is 2 seconds to 5 seconds; The structured light beams are projected on an image projection area and form a plurality of superimposed patterns. The image projection area has a plurality of sub-projection areas arranged in an array and adjacent to each other, and the pattern distribution of the superimposed pattern in each sub-projection area is different from each other , And calculate and form the image information of the waiting object and the flight time information of the beams. For example, the identification method of the fatigue driving identification system of claim 8, wherein the optical identification module performs the comparison data procedure according to the head position information, and the comparison data procedure is to identify the tendency of the head of the test object position; When the head of the object to be tested is lowered, the transmission unit sends out an alarm notification message to the monitoring module; and When the head of the test object leans to the left and right sides, the transmission unit sends out an alarm notification message to the monitoring module.

Images