CN112438728A

CN112438728A - Safe driving detection device and detection method

Info

Publication number: CN112438728A
Application number: CN201910803290.6A
Authority: CN
Inventors: 林钟权
Original assignee: Shenzhen Chaojie Communication Co ltd
Current assignee: Dutch mobile drive Co.
Priority date: 2019-08-28
Filing date: 2019-08-28
Publication date: 2021-03-05

Abstract

The invention provides a safe driving detection device which comprises a face collector, a heart rate monitor, a processor and a memory. The face collector is used for collecting the face information of the driver; the heart rate monitor is used for monitoring heart rate information of a driver, and the heart rate monitor is used for monitoring the heart rate by adopting a millimeter wave radar; the memory stores a plurality of modules that are executed by the processor. The invention also provides a safe driving detection method. This safe driving detection device adopts the millimeter wave radar to carry out heart rate information detection, further combines face's collector to the detection of face's information, and whether fatigue driving or heart are unusual appear in the accurate judgement driver driving vehicle in-process, in time carries out safe warning to the driver to accident takes place. Furthermore, the millimeter wave radar is used for collecting the heart rate information, the heart rate information can be monitored only by sitting on the driving seat, the wearing is not needed, and the use process is convenient and quick.

Description

Safe driving detection device and detection method

Technical Field

The present invention relates to an electronic device, and more particularly, to a safe driving detection device and a safe driving detection method suitable for safe driving.

Background

With the development of society, automobiles have become indispensable transportation tools for people to go out. However, as the number of automobiles increases, safe driving of automobiles has become a problem of great social attention. When people are tired to a certain degree, conditions such as distraction, small difference and the like can occur, driving behaviors can also change, traffic accidents such as lane departure, rear-end collision, collision and the like are easily caused, certain potential safety hazards exist, and meanwhile, a driver is highly nervous in the driving process, cannot relieve the situations, and is easy to fatigue. When a person is tired, the physiological characteristics of the person slightly change, such as the heart beat rate is reduced, the vibration frequency of eyelids is reduced, and the like. Among the prior art, generally adopt wearing formula heartbeat inductor response heartbeat rate, it is troublesome to dress, inconvenient use.

Disclosure of Invention

In view of the above, it is necessary to provide a safe driving detection apparatus and a detection method with millimeter wave radar for assisting safe driving to solve the above problems.

The invention provides a safe driving detection device, which comprises: the face collector is used for collecting the face information of the driver; the heart rate monitor is used for monitoring the heart rate information of the driver, and the heart rate monitor adopts a millimeter wave radar to monitor the heart rate; a processor; and a memory storing a plurality of modules for execution by the processor, the plurality of modules comprising: the acquisition module is used for acquiring the face information of the driver collected by the face collector and the heart rate information of the driver monitored by the heart rate monitor; the analysis module is used for analyzing whether the face information and the heart rate information have abnormal information or not; and the transmission module is used for transmitting the abnormal information to a monitoring center.

A safe driving detection method, the detection method comprising the steps of: the face collector collects face information of a driver; monitoring heart rate information of the driver through a millimeter wave radar; analyzing whether the face information and the heart rate information have abnormal information or not; and when abnormal information exists, transmitting the abnormal information to a monitoring center.

According to the safe driving detection device and the safe driving detection method provided by the invention, the safe driving detection device adopts the millimeter wave radar to monitor the heart rate information, and further combines the detection of the face information by the face collector, so that whether fatigue driving or heart abnormity occurs in the process of driving a vehicle by a driver is accurately judged, and the driver is timely and safely reminded to avoid accidents. Furthermore, the millimeter wave radar is used for collecting the heart rate information, the heart rate information can be monitored only by sitting on the driving seat, the wearing is not needed, and the use process is convenient and quick.

Drawings

Fig. 1 is an internal structural diagram of a safe driving detection apparatus in one embodiment of the present invention.

FIG. 2 is a functional block diagram of a detection system in one embodiment of the invention.

Fig. 3 is a flowchart of a safe driving detection method in an embodiment of the invention.

Description of the main elements

The following detailed description will further illustrate the invention in conjunction with the above-described figures.

Detailed Description

So that the manner in which the above recited objects, features and advantages of the present invention can be understood in detail, a more particular description of the invention, briefly summarized above, may be had by reference to the embodiments thereof which are illustrated in the appended drawings. In addition, the embodiments and features of the embodiments of the present application may be combined with each other without conflict.

In the following description, numerous specific details are set forth to provide a thorough understanding of the present invention, and the described embodiments are merely a subset of the embodiments of the present invention, rather than a complete embodiment. All other embodiments, which can be obtained by a person skilled in the art without any inventive step based on the embodiments of the present invention, are within the scope of the present invention.

Unless defined otherwise, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this invention belongs. The terminology used herein in the description of the invention is for the purpose of describing particular embodiments only and is not intended to be limiting of the invention.

As used herein, the term "and/or" includes any and all combinations of one or more of the associated listed items.

Referring to fig. 1, in one embodiment, the present invention provides a safe driving detection apparatus 100, which is mounted on a vehicle and is used for detecting a driving state of the vehicle, the safe driving detection apparatus 100 includes a face collector 110, a heart rate monitor 120, a processor 130, a memory 140 and an alarm 150, a safe driving detection system 141 is stored in the memory 140, and a plurality of modules are included in the safe driving detection system 141. The face collector 110, the heart rate monitor 120, the processor 130, the memory 140 and the alarm 150 are electrically connected to each other. The driving safety detecting device 100 is also connected to a monitoring center 200 in communication. The monitoring center 200 is used for monitoring whether the driver of the vehicle is in fatigue driving or in abnormal driving.

Specifically, the face collector 110 is configured to collect face information of the driver, and the face collector 110 collects the face information by using a camera, but is not limited to the above collection method. Face harvester 110 specifically employs an infrared camera that is disposed on the dashboard in front of the vehicle interior. The infrared camera collects the face information of the driver in real time. In addition, the infrared camera can closely observe the situation of the driver even in the night.

The facial information may include one or more of a blink frequency, an eyeball visible area, and a cheek state. Further, the abnormal information of the face information includes that the blinking frequency is lower than the blinking frequency threshold, the eyeball visible area is lower than the eyeball area threshold, and the cheek color is reddened or whitened.

When the driver is in a fatigue or drowsy state, the blinking frequency of his eyes is significantly reduced in a period of time, and the threshold value of the blinking frequency may be set to 5 times/min. When the blinking frequency of the driver is lower than 5 times/min, the driver can be judged to be in a fatigue driving state, and potential safety driving hazards exist.

Similarly, when a driver is in a fatigue or drowsy state, the eyes of the driver are in a closed or semi-closed state, and the visible area of the eyeballs is obviously reduced in a period of time. When the eyeball area threshold value is 10% of the eyeball visible area in the normal state. In a period of time, if the visual area of the eyeball is less than 10% of the visual area of the eyeball in a normal state, the driver can be judged to be in a fatigue driving state, and the potential safety driving hazard exists.

When the driver's body is abnormal, such as sudden heart failure or gastrointestinal failure, the cheek color changes significantly, such as reddening or whitening, in a short time. When the infrared camera detects that the color of the cheek of the driver obviously turns red or white, the body of the driver can be judged to be abnormal, and the driver has potential safety driving hazards.

In some preferred embodiments, the face collector 110 is further configured to collect an image of the face of the driver, the processor confirms the identification number of the driver through face recognition, and the camera collects the image of the face of the driver. If the information on the face image of the driver shot by the camera and the identity number does not correspond to each other, the safe driving detection device 100 sends a prompt of the abnormal information of the driver to the monitoring center 200, and the monitoring center 200 performs corresponding processing according to the prompt information, for example, the vehicle is prohibited from starting. It is understood that the abnormal information may also be sent directly by short message or be notified to the relevant manager by other communication methods.

The heart rate monitor 120 is used to monitor the heart rate information of the driver. The heart rate monitor 120 employs millimeter wave radar for heart rate monitoring. The millimeter wave radar is provided on the instrument panel in front of the vehicle interior, as is the camera. The millimeter wave radar and the camera monitor the state of the driver together, accurately judge the abnormal information of the driver and find out the potential safety driving hazard in time. Adopt millimeter wave radar monitoring driver's rhythm of the heart information, do not need the driver to dress on one's body, the driver sits on the driver's seat, rhythm of the heart information that can real-time supervision driver, the monitoring process is high-efficient convenient.

The heart rate information includes heart rate or heart beat regularity. The abnormal information of the heart rate information comprises that the heart rate is lower than a heart rate threshold value or the heart rate is irregular. In general, after a person enters a sleep state, the heartbeat frequency is lower than 50 times/min, so the heartbeat threshold is set to be 50 times/min.

When the heartbeat frequency of the driver is lower than 50 times/min, the driver can be judged to be in a fatigue driving state, namely, the driver is about to enter a sleeping state, and potential safety driving hazards exist.

When the heartbeat of the driver is monitored to be irregular, the heart of the driver is indicated to be in a problem, the potential safety driving hazard exists, and the driver should stop driving the vehicle immediately so as to avoid accidents.

It is understood that when the driver's heartbeat is too fast, such as a sudden change in mood, excitement, fear, or tension, etc. When the heartbeat frequency is more than 100 times/min, the body of the driver can have some abnormal situations, which affects the safe driving of the driver.

The processor 130 is configured to analyze the face information and the heart rate information, and analyze whether there is abnormal information in the face information and the heart rate information of the driver. The processor 130 is preset with related Processing logic, and the processor 130 may be a Central Processing Unit (CPU), a digital signal processor, or a single chip, and is suitable for implementing each instruction.

The memory 140 is used for storing various data, such as program codes, and the like, and realizes high-speed and automatic access to programs or data during the operation of the processor 130.

The Memory 140 may be, but is not limited to, a Read-Only Memory (ROM), a Random Access Memory (RAM), a Programmable Read-Only Memory (PROM), an Erasable Programmable Read-Only Memory (EPROM), a One-time Programmable Read-Only Memory (OTPROM), an electronically Erasable rewritable Read-Only Memory (EEPROM), a Compact Disc Read-Only Memory (CD-ROM) or other optical Disc storage, magnetic disk storage, magnetic tape storage, or any other medium readable by a computer that can be used to carry or store data.

The alarm 150 is configured to receive the abnormal information transmitted by the processor 130 and send an alarm to warn a driver of the vehicle of a potential safety driving hazard. Specifically, this attention device 150 adopts the warning light, and the outside of vehicle is located to the warning light, can set up place ahead, rear and side at the vehicle, and the warning light flashing light is in order to remind external vehicle or pedestrian not to be close to the vehicle that has the driving safety hidden danger. It is understood that the warning light may also flash while the alert sound is occurring.

Further, referring to fig. 2, the safe driving detection system 141 may be partitioned into one or more modules, which are stored in the memory 140 and executed by the processor 130. The module of the invention can complete a program segment with a specific function. Included within the safe driving detection system 141 are an acquisition module 1411, an analysis module 1412, and a transmission module 1413. The acquisition module 1411, the analysis module 1412, and the transmission module 1413 are interconnected.

Specifically, the obtaining module 1411 is used for obtaining face information of the driver and heart rate information of the driver. The analysis module 1412 is configured to analyze whether the facial information and the heart rate information have abnormal information. The transmission module 1413 is used for transmitting the abnormal information to a monitoring center 200.

The monitoring center 200 may perform an early warning process on the abnormal information, where the early warning process may be a warning program preset by the monitoring center 200, and the monitoring center 200 starts the program according to the abnormal information to warn a driver of safety. It can be understood that the monitoring center 200 may also send the abnormal information to the relevant responsible person through a short message or other communication methods, and the relevant responsible person reminds the driver of safety through the communication method.

Further, the vehicle is equipped with GPS navigation, and if the driver has a large physical abnormality, the monitoring center 200 can monitor the position of the GPS navigation positioning, and can immediately start a recourse procedure after confirming the vehicle position.

Referring to fig. 3, the present invention provides a safe driving detection method for detecting whether a driving state of a vehicle is safe. The detection method specifically comprises the following steps:

step S301, facial information of the driver is collected.

Specifically, the face collector 110 collects face information of the driver including one or more of a blink frequency, an eyeball visible area, and a cheek state, using a camera. The acquisition module 1411 acquires the above-described face information.

And step S302, monitoring the heart rate information of the driver through the millimeter wave radar.

Specifically, the heart rate monitor 120 monitors the heart rate information of the driver, which includes the heart rate or the heart beat law, using millimeter wave radar. The acquisition module 1411 also acquires the heart rate information described above.

Step S303, whether the face information and the heart rate information have abnormal information or not is analyzed.

Specifically, the processor 130 invokes a running program of the analysis module 1412 to analyze whether the facial information and the heart rate information have abnormal information.

The step of analyzing whether the face information has abnormal information comprises the steps of judging whether the blinking frequency is lower than a blinking frequency threshold value, whether the eyeball visible area is lower than an eyeball area threshold value and judging whether the cheek color turns red or white.

In a period of time, when the blinking frequency of the driver is lower than 5 times/min, the driver can be judged to be in a fatigue driving state, and potential safety driving hazards exist. If the visual area of the eyeball is less than 10% of the visual area of the eyeball in the normal state, the driver can be judged to be in a fatigue driving state, and potential safety driving hazards exist. When the face collector 110 obviously detects that the color of the cheek of the driver turns red or white, it can be determined that the body of the driver is abnormal, and the driver has a hidden danger of safe driving.

The step of analyzing whether the heart rate information has abnormal information includes judging whether the heart rate is lower than a heart rate threshold or judging whether arrhythmia exists. When the heartbeat frequency of the driver is lower than 50 times/min, the driver can be judged to be in a fatigue driving state, namely, the driver is about to enter a sleeping state, and potential safety driving hazards exist. When the heartbeat of the driver is monitored to be irregular, the heart of the driver is indicated to be in a problem, the potential safety driving hazard exists, and the driver should be stopped driving the vehicle immediately so as to avoid accidents.

If the abnormality information is present, the process proceeds to step S304, and if the abnormality information is not present, the process returns to step S301 or step S302.

Step S304, transmitting the abnormal information to a monitoring center 200.

The transmission module 1413 transmits the abnormal information to the monitoring center 200, and the monitoring center 200 performs an early warning process after receiving the abnormal information.

Specifically, the transmitter 124 transmits the abnormal information to the monitoring center 200, and the monitoring center 200 reminds the driver of safe driving according to a preset reminding program. The monitoring center 200 may also send the abnormal information to the relevant responsible person through a short message or other communication methods, and the relevant responsible person reminds the driver of safety through the communication method.

In some preferred embodiments, step S301 is preceded by step S305 of capturing an image of the face of the driver by the face collector 110, and step S306 of confirming the identification number of the driver.

If the face image of the driver shot by the camera does not correspond to the information on the identity number, the step S304 is performed, the safe driving detection system 141 transmits the abnormal information to the monitoring center 200, and the monitoring center 200 performs corresponding processing according to the abnormal information, such as prohibiting the vehicle from starting. If the face image of the driver corresponds to the information on the identity number, step S301 is performed to continue to collect the face information of the driver.

In other preferred embodiments, the safe driving detection method provided by the present invention further includes step S307, when the face information and the heart rate information of the driver are analyzed to be abnormal in step S303, step S304 and step S307 are performed simultaneously, and step S307 sends a warning to an external vehicle and a pedestrian according to the abnormal information.

Specifically, after receiving the abnormal information transmitted by the transmission module 1413, the warning device 150 uses a warning light to remind the outside vehicle or pedestrian of safety. The warning light is arranged outside the vehicle and can be arranged in the front, the rear and the side of the vehicle to remind external vehicles or pedestrians not to approach the vehicle with the potential safety driving hazard.

In addition, each functional device in the embodiments of the present invention may be integrated into the same data processor, or each functional device may exist alone physically, or two or more functional devices may be integrated into the same device. The integrated device can be realized in a hardware mode, and can also be realized in a mode of hardware and a software functional module.

It will be evident to those skilled in the art that the invention is not limited to the details of the foregoing illustrative embodiments, and that the present invention may be embodied in other specific forms without departing from the spirit or essential attributes thereof. The present embodiments are therefore to be considered in all respects as illustrative and not restrictive, the scope of the invention being indicated by the appended claims rather than by the foregoing description, and all changes which come within the meaning and range of equivalency of the claims are therefore intended to be embraced therein. Any reference sign in a claim should not be construed as limiting the claim concerned. Furthermore, it is to be understood that the word "comprising" does not exclude other elements or steps, and the singular does not exclude the plural. The devices or computer means recited in the computer means claims may also be implemented by the same device or computer means, either in software or hardware. The terms first, second, etc. are used to denote names, but not any particular order.

Finally, it should be noted that the above embodiments are only for illustrating the technical solutions of the present invention and not for limiting, and although the present invention is described in detail with reference to the preferred embodiments, it should be understood by those skilled in the art that modifications or equivalent substitutions may be made on the technical solutions of the present invention without departing from the spirit and scope of the technical solutions of the present invention.

Claims

1. A safe driving detection device, characterized in that the detection device comprises:

the face collector is used for collecting the face information of the driver;

the heart rate monitor is used for monitoring the heart rate information of the driver, and the heart rate monitor adopts a millimeter wave radar to monitor the heart rate;

a processor; and

a memory storing a plurality of modules for execution by the processor, the plurality of modules comprising:

the acquisition module is used for acquiring the face information of the driver collected by the face collector and the heart rate information of the driver monitored by the heart rate monitor;

the analysis module is used for analyzing whether the face information and the heart rate information have abnormal information or not; and

and the transmission module is used for transmitting the abnormal information to a monitoring center.

2. The safe-driving detection device according to claim 1, characterized in that:

the heart rate information includes a heart rate or a heart beat law,

the abnormal information of the heart rate information comprises that the heart rate is lower than a heart rate threshold value or is irregular in heart rate.

3. The safe-driving detection device according to claim 1, characterized in that:

the face collector adopts a camera to collect the face information, and the face information comprises one or more of blink frequency, eyeball visible area and cheek state;

the abnormal information of the face information comprises that the blinking frequency is lower than a blinking frequency threshold value, the eyeball visible area is lower than an eyeball area threshold value, and the cheek color is red or white.

4. The safe-driving detection device according to claim 1, characterized in that:

the analysis module is further used for identifying the facial information to confirm the identity number of the driver.

5. The safe-driving detection device according to claim 1, characterized in that:

the safe driving detection device further comprises an alarm, and the alarm receives the abnormal information transmitted by the transmission module and gives out an alarm.

6. A safe driving detection method is characterized by comprising the following steps:

the face collector collects face information of a driver;

monitoring heart rate information of the driver through a millimeter wave radar;

analyzing whether the face information and the heart rate information have abnormal information or not; and

and when abnormal information exists, transmitting the abnormal information to a monitoring center.

7. The safe driving detection method according to claim 6, characterized in that:

the heart rate information comprises heart rate or heart beat rule;

the step of analyzing whether the heart rate information has abnormal information includes judging whether the heart rate is lower than a heart rate threshold or judging whether arrhythmia exists.

8. The safe driving detection method according to claim 6, characterized in that:

the facial information comprises one or more of blink frequency, eyeball visible area and cheek state;

the step of analyzing whether the face information has abnormal information comprises the steps of judging whether the blink frequency is lower than a blink frequency threshold value, judging whether the eyeball visible area is lower than an eyeball area threshold value, and judging whether the cheek color turns red or white.

9. The safe driving detection method according to claim 6, characterized in that: the step of collecting the face information of the driver further comprises the following steps: and acquiring a face image of the driver, and carrying out face recognition according to the face image to confirm the identity number of the driver.

10. The safe driving detection method according to claim 6, characterized in that: the step of transmitting the abnormal information to the monitoring center also includes:

and sending out warnings to external vehicles and pedestrians according to the abnormal information.