CN111754729A - Fatigue driving prompting device and prompting method - Google Patents
Fatigue driving prompting device and prompting method Download PDFInfo
- Publication number
- CN111754729A CN111754729A CN202010582554.2A CN202010582554A CN111754729A CN 111754729 A CN111754729 A CN 111754729A CN 202010582554 A CN202010582554 A CN 202010582554A CN 111754729 A CN111754729 A CN 111754729A
- Authority
- CN
- China
- Prior art keywords
- fatigue
- signal
- image
- driver
- feedback
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B21/00—Alarms responsive to a single specified undesired or abnormal condition and not otherwise provided for
- G08B21/02—Alarms for ensuring the safety of persons
- G08B21/06—Alarms for ensuring the safety of persons indicating a condition of sleep, e.g. anti-dozing alarms
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/50—Context or environment of the image
- G06V20/59—Context or environment of the image inside of a vehicle, e.g. relating to seat occupancy, driver state or inner lighting conditions
- G06V20/597—Recognising the driver's state or behaviour, e.g. attention or drowsiness
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B21/00—Alarms responsive to a single specified undesired or abnormal condition and not otherwise provided for
- G08B21/18—Status alarms
- G08B21/182—Level alarms, e.g. alarms responsive to variables exceeding a threshold
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B7/00—Signalling systems according to more than one of groups G08B3/00 - G08B6/00; Personal calling systems according to more than one of groups G08B3/00 - G08B6/00
- G08B7/06—Signalling systems according to more than one of groups G08B3/00 - G08B6/00; Personal calling systems according to more than one of groups G08B3/00 - G08B6/00 using electric transmission, e.g. involving audible and visible signalling through the use of sound and light sources
Abstract
The invention discloses a fatigue driving prompting device, which comprises: the fatigue state detection component, the fatigue reminding interaction component and the communication component. The fatigue state detection assembly collects and processes images of a driver and outputs driving characteristic information according to the images of the driver. The fatigue reminding interactive component is connected to the fatigue state detection component and generates fatigue grade information according to the driving characteristic information. The communication assembly is connected with the fatigue reminding interaction assembly and the vehicle feedback assembly, the communication assembly sends fatigue grade information generated by the fatigue reminding interaction assembly to the vehicle feedback assembly, and the vehicle feedback assembly carries out corresponding feedback prompt on a driver according to the fatigue grade information. The vehicle feedback assembly is various vehicle-mounted components originally arranged on the vehicle. The invention also discloses a fatigue driving prompting method. The invention can provide various sensory stimuli comprising auditory sensation, visual sensation, olfactory sensation and tactile sensation according to the real-time state of the driver to relieve fatigue.
Description
Technical Field
The invention relates to the technical field of automobile intellectualization, in particular to a technology for judging and prompting fatigue driving behaviors of a driver.
Background
In the using process of the automobile, fatigue driving is one of the major hidden dangers of traffic safety. When a driver is in a fatigue state, the sensing and judging ability to the surrounding environment and the control ability to the vehicle are reduced in different degrees, and traffic accidents are easy to happen. At present, the fatigue driving detection system in the vehicle mainly uses two modes: the method is used for judging whether a driver is tired to drive or not by analyzing the driving behaviors of the driver such as rotating a steering wheel, stepping on a brake and the like, and has the problems of great influence by the driving habit of the driver and high false alarm rate. Another type of fatigue driving determination using an image processing technique is performed based on a single detection amount such as the eye state or head-down state of the driver, and since the single detection amount is greatly disturbed by the driver's habit movement, accidental movement, or the like, there is a problem in that the determination accuracy is low.
After finding driver fatigue driving, to driver fatigue driving's warning interactive approach, the single warning modes such as timing voice broadcast, steering wheel vibrations are mostly adopted at present, have the relatively poor problem of real-time and adaptability. Under the state of fatigue driving of a driver, along with the increase of prompting times, the human body is easy to form immunity to single stimulation, and the prompting effect is limited. When detecting that the driver is tired to drive, the most correct way is to stop the vehicle in time for rest and relieve fatigue. However, in the actual driving process, the situations that the service area, the rest area, the inconvenient parking and the like cannot be found in time and the rest cannot be performed often occur. In addition, in a state where fatigue has occurred, the driver is required to go to the service area for a stop and rest, which increases the driving risk.
Disclosure of Invention
The invention aims to provide a novel technology for detecting and prompting fatigue driving.
According to an embodiment of the present invention, there is provided a fatigue driving prompting device including: the fatigue state detection component, the fatigue reminding interaction component and the communication component. The fatigue state detection assembly collects and processes images of a driver and outputs driving characteristic information according to the images of the driver. The fatigue reminding interactive component is connected to the fatigue state detection component and generates fatigue grade information according to the driving characteristic information. The communication assembly is connected with the fatigue reminding interaction assembly and the vehicle feedback assembly, the communication assembly sends fatigue grade information generated by the fatigue reminding interaction assembly to the vehicle feedback assembly, and the vehicle feedback assembly carries out corresponding feedback prompt on a driver according to the fatigue grade information. The vehicle feedback assembly is various vehicle-mounted components originally arranged on the vehicle.
According to an embodiment of the present invention, a fatigue state detection module is installed in the cabin, the fatigue state detection module acquires a face image of the driver, extracts an eye feature image and a mouth feature image from the face image, and outputs driving feature information based on the eye feature image and the mouth feature image.
According to an embodiment of the invention, the fatigue state detection assembly comprises: an image acquisition device and an image processing device. The image capturing device captures an image of a driver. The image processing device is connected to the image capturing device, acquires a face image of the driver from the image of the driver captured by the image capturing device, extracts an eye feature image and a mouth feature image from the face image, and outputs driving feature information on the basis of the eye feature image and the mouth feature image.
According to one embodiment of the invention, the image acquisition device is an interior camera, the interior camera is aligned to the driver seat area, the interior camera is an infrared camera with an active infrared light source, the field angle of the interior camera covers all the activity areas of the head of the driver in a normal driving state, and the resolution of the interior camera meets the identification requirements of eye actions and mouth actions of the driver.
According to an embodiment of the present invention, an image processing apparatus includes: the device comprises a face detection module, an eye image module, a mouth image module and an image analysis module. The face detection module locates the position of the face image from the image of the driver and acquires the face image of the driver. The eye image module locates and extracts an eye image from the face image. The mouth image module locates and extracts a mouth image from the face image. The image analysis module is connected to the eye image module and the mouth image module and outputs driving feature information according to the eye feature image and the mouth feature image.
According to an embodiment of the present invention, the driving characteristic information includes:
the eye opening degree is greater than 20% of the maximum opening degree and is an eye opening signal;
the eye opening degree is less than or equal to 20% of the maximum opening degree, and the eye opening degree is an eye closing signal;
the continuous eye opening signal, the eye closing signal and the eye opening signal form a blink signal;
the eye-closing signal lasts for 3 seconds or more, and is a drowsiness signal;
the mouth signal can not be positioned for 3 seconds or more, and the signal is a drowsy signal;
the opening degree of the mouth is larger than the width of the mouth, and the mouth is a Hardgree signal.
According to an embodiment of the present invention, the fatigue reminding interactive component generates fatigue level information according to the driving feature information, counts the number of times of the driving feature information in unit time, and generates four kinds of fatigue level information: normal, mild, moderate and severe fatigue.
In accordance with an embodiment of the present invention,
the drowsiness signal is more than or equal to 1 time within a period of 1 minute, which is severe fatigue;
the blink signal is more than or equal to 30 times but no drowsiness signal within a period of 1 minute, or the yawning signal is more than or equal to 4 times but no drowsiness signal within a period of 1 minute, and the fatigue is moderate;
the blink signal is more than or equal to 24 times and less than 30 times in a 1-minute period without the drowsiness signal, or the yawning signal is more than or equal to 2 times and less than 4 times in a 1-minute period without the drowsiness signal, and the fatigue is light;
the rest is normal.
According to an embodiment of the invention, a vehicle feedback assembly comprises: instrument panel, air conditioner controller and infotainment equipment. The dashboard provides visual and audible feedback cues to the driver. The air conditioner controller provides somatosensory feedback prompts to the driver. The infotainment device provides mental and informational feedback cues to the driver.
According to an embodiment of the invention, the vehicle feedback assembly further comprises: a fragrance device and a seat massage controller. The fragrance device provides olfactory feedback cues to the driver. The seat massage controller provides tactile feedback cues to the driver.
In accordance with an embodiment of the present invention,
under light fatigue, the vehicle feedback assembly carries out low-intensity prompt, and the low-intensity prompt is executed by at least one of an instrument panel and an air conditioner controller: the instrument panel provides mild visual and auditory feedback prompts, and the air conditioner controller reduces the temperature and increases the fresh air volume to perform somatosensory feedback prompts;
under moderate fatigue, the vehicle feedback component performs medium intensity prompt, and the medium intensity prompt is executed by at least one of an instrument panel, an air conditioner controller, an infotainment device and a fragrance device: the instrument panel provides prompt visual and auditory feedback prompts, the air conditioner controller reduces the temperature and increases the fresh air volume to perform somatosensory feedback prompts, the information entertainment equipment provides mental feedback prompts for playing music and information feedback prompts for indicating a rest area navigation route, and the fragrance equipment releases refreshing fragrance to provide olfactory feedback prompts;
under severe fatigue, the vehicle feedback assembly performs high-intensity prompting, which is performed by at least one of an instrument panel, an air conditioning controller, an infotainment device, a fragrance device, and a seat massage controller: the instrument panel provides prompt visual and auditory feedback prompts, the air conditioner controller reduces the temperature and increases the fresh air volume to perform somatosensory feedback prompts, the information entertainment equipment provides mental feedback prompts for playing music and information feedback prompts for indicating a rest area navigation route, the fragrance equipment releases refreshing fragrance to provide olfactory feedback prompts, and the seat massage controller starts seat massage to provide tactile feedback prompts for a driver.
According to an embodiment of the invention, the communication component is an onboard gateway.
According to an embodiment of the present invention, a method for prompting fatigue driving is provided, including:
a fatigue detection step, namely acquiring and processing an image of a driver, and outputting driving characteristic information according to the image of the driver;
a fatigue reminding step, namely generating fatigue grade information according to the driving characteristic information;
and a feedback prompting step, namely sending the fatigue grade information to a vehicle feedback component, and carrying out corresponding feedback prompting on the driver by the vehicle feedback component according to the fatigue grade information.
According to an embodiment of the present invention, the fatigue detection step acquires a face image of the driver, extracts an eye feature image and a mouth feature image from the face image, and outputs the driving feature information based on the eye feature image and the mouth feature image.
According to an embodiment of the present invention, the driving characteristic information includes:
the eye opening degree is greater than 20% of the maximum opening degree and is an eye opening signal;
the eye opening degree is less than or equal to 20% of the maximum opening degree, and the eye opening degree is an eye closing signal;
the continuous eye opening signal, the eye closing signal and the eye opening signal form a blink signal;
the eye-closing signal lasts for 3 seconds or more, and is a drowsiness signal;
the mouth signal can not be positioned for 3 seconds or more, and the signal is a drowsy signal;
the opening degree of the mouth is larger than the width of the mouth, and the mouth is a Hardgree signal.
According to an embodiment of the present invention, in the fatigue reminding step, fatigue level information is generated according to the driving characteristic information, the fatigue reminding interactive component counts the number of times of the driving characteristic information in unit time, and generates four kinds of fatigue level information: normal, mild, moderate and severe fatigue.
In accordance with an embodiment of the present invention,
the drowsiness signal is more than or equal to 1 time within a period of 1 minute, which is severe fatigue;
the blink signal is more than or equal to 30 times but no drowsiness signal within a period of 1 minute, or the yawning signal is more than or equal to 4 times but no drowsiness signal within a period of 1 minute, and the fatigue is moderate;
the blink signal is more than or equal to 24 times and less than 30 times in a 1-minute period without the drowsiness signal, or the yawning signal is more than or equal to 2 times and less than 4 times in a 1-minute period without the drowsiness signal, and the fatigue is light;
the rest is normal.
In accordance with an embodiment of the present invention,
under light fatigue, the vehicle feedback assembly carries out low-intensity prompt, and the low-intensity prompt is executed by at least one of an instrument panel and an air conditioner controller: the instrument panel provides mild visual and auditory feedback prompts, and the air conditioner controller reduces the temperature and increases the fresh air volume to perform somatosensory feedback prompts;
under moderate fatigue, the vehicle feedback component performs medium intensity prompt, and the medium intensity prompt is executed by at least one of an instrument panel, an air conditioner controller, an infotainment device and a fragrance device: the instrument panel provides prompt visual and auditory feedback prompts, the air conditioner controller reduces the temperature and increases the fresh air volume to perform somatosensory feedback prompts, the information entertainment equipment provides mental feedback prompts for playing music and information feedback prompts for indicating a rest area navigation route, and the fragrance equipment releases refreshing fragrance to provide olfactory feedback prompts;
under severe fatigue, the vehicle feedback assembly performs high-intensity prompting, which is performed by at least one of an instrument panel, an air conditioning controller, an infotainment device, a fragrance device, and a seat massage controller: the instrument panel provides prompt visual and auditory feedback prompts, the air conditioner controller reduces the temperature and increases the fresh air volume to perform somatosensory feedback prompts, the information entertainment equipment provides mental feedback prompts for playing music and information feedback prompts for indicating a rest area navigation route, the fragrance equipment releases refreshing fragrance to provide olfactory feedback prompts, and the seat massage controller starts seat massage to provide tactile feedback prompts for a driver.
The fatigue driving prompting device and the prompting method can provide various sensory stimuli comprising auditory sensation, visual sensation, olfactory sensation and tactile sensation according to the real-time state of the driver, reduce the influence of fatigue driving from two aspects of relieving fatigue and helping the driver to stop and rest in time, effectively ensure the safe driving of the driver, and avoid traffic accidents caused by the fatigue driving and harm the life and property safety of the driver and other people.
Drawings
Fig. 1 is a block diagram showing a fatigue driving prompting apparatus according to an embodiment of the present invention.
Fig. 2 is a block diagram showing a structure of a fatigue state detecting unit in the fatigue driving prompting apparatus according to an embodiment of the present invention.
Fig. 3 discloses a block diagram of the image processing device in the fatigue driving prompting apparatus according to an embodiment of the invention.
Fig. 4 discloses a process of performing fatigue level determination in the fatigue driving prompting device according to an embodiment of the invention.
Fig. 5 discloses an operation process of the fatigue driving prompting device according to an embodiment of the invention.
Fig. 6 discloses a flowchart of a fatigue driving prompting method according to an embodiment of the invention.
Detailed Description
Fig. 1 is a block diagram showing a fatigue driving prompting apparatus according to an embodiment of the present invention. Referring to fig. 1, the fatigue driving prompting device includes: a fatigue state detection component 100, a fatigue reminder interaction component 200, and a communication component 300. The fatigue state detection assembly 100 collects and processes an image of the driver, and outputs driving characteristic information according to the image of the driver. The fatigue alert interaction component 200 is connected to the fatigue state detection component 100, and the fatigue alert interaction component 200 generates fatigue level information according to the driving characteristic information. The communication component 300 is connected with the fatigue reminding interactive component 200 and the vehicle feedback component, the communication component 300 sends fatigue grade information generated by the fatigue reminding interactive component to the vehicle feedback component, and the vehicle feedback component carries out corresponding feedback prompt on a driver according to the fatigue grade information.
The fatigue state detection module 100 is installed in the cabin, acquires a face image of the driver, extracts an eye feature image and a mouth feature image from the face image, and outputs driving feature information based on the eye feature image and the mouth feature image. By collecting data of the eye characteristic image and the mouth characteristic image, the information for detecting whether the driver is in fatigue driving is more comprehensive, and the situation that the misjudgment probability is high due to the fact that the sampling information is single is reduced. Fig. 2 is a block diagram showing a structure of a fatigue state detecting unit in the fatigue driving prompting apparatus according to an embodiment of the present invention. In the illustrated embodiment, the fatigue state detection assembly 100 includes: an image acquisition device 110 and an image processing device 120.
The image capture device 110 captures an image of the driver. In one embodiment, image capture device 110 is an interior cabin camera that is aimed at the driver's seat area, which is an infrared camera with an active infrared light source. The field angle of the inner cabin camera covers the whole moving area of the head of the driver in a normal driving state so as to ensure that the eye characteristic image and the mouth characteristic image of the driver can be acquired in the normal driving state. The resolution ratio of the inner cabin camera meets the identification requirements of the eye action and the mouth action of the driver. Since the range of the eye movement and the mouth movement is small, it is necessary to ensure a sufficiently high resolution of the interior camera and to clearly recognize the eye movement and the mouth movement. In one implementation example, the inner cabin camera is installed in front of the driver and can be selectively placed at the position of an instrument panel behind the steering wheel, a left A column of the driver or a front windshield frame, and the like, and the lens of the camera is aligned with the area for collecting the driver seat. The inner cabin camera is an infrared camera and an active infrared light source, and the active infrared light source can enable image acquisition to be free from the influence of external illumination conditions. The horizontal field angle of the inner cabin camera is larger than 60 degrees, the vertical field angle is larger than 35 degrees, so that all moving areas of the head of a driver in a normal driving state can be within the field angle range of the camera, and the facial image of the driver can be acquired in normal driving. The resolution of the inner chamber camera is 1280(H) x 720(V), and eye movements and mouth movements can be clearly identified at this resolution. The imager of the inner cabin camera adopts a global shutter.
The image processing device 120 is connected to the image acquisition device 110. The image processing device 120 acquires a face image of the driver from the image of the driver acquired by the image acquisition device 110, extracts an eye feature image and a mouth feature image from the face image, and outputs driving feature information from the eye feature image and the mouth feature image. Fig. 3 discloses a block diagram of the image processing device in the fatigue driving prompting apparatus according to an embodiment of the invention. In the embodiment shown in fig. 3, the image processing apparatus 120 includes: a face detection module 121, an eye image module 122, a mouth image module 123 and an image analysis module 124. The face detection module 121 locates the position of the face image from the image of the driver and acquires the face image of the driver. The eye image module 122 locates and extracts an eye image from the face image. The mouth image module 123 locates and extracts a mouth image from the face image. The image analysis module 124 is connected to the eye image module 122 and the mouth image module 123, and the image analysis module 124 outputs driving feature information according to the eye feature image and the mouth feature image. In one embodiment, the driving characteristic information mainly includes the following three actions of the driver: blink, yawn, and doze. Specifically, the driving feature information output from the eye feature image and the mouth feature image includes:
the eye opening degree is greater than 20% of the maximum opening degree, and is an eye opening signal.
The eye opening degree is less than or equal to 20% of the maximum opening degree, and the eye closing signal is obtained.
The continuous eye-open signal, eye-closed signal and eye-open signal constitute a blink signal.
The eye-closing signal lasts for 3 seconds or more, and is a drowsy signal.
The mouth signal cannot be located for 3 seconds or more, and is a drowsy signal. The driver is usually in a head-down position when drowsy, and the mouth is blocked and thus the mouth signal cannot be positioned. The continuous inability to locate mouth signals will also serve as drowsiness signals.
The opening degree of the mouth is larger than the width of the mouth, and the mouth is a Hardgree signal.
The fatigue reminding interactive component 200 generates fatigue grade information according to the driving characteristic information, counts the times of the driving characteristic information in unit time and generates four kinds of fatigue grade information: normal, mild, moderate and severe fatigue. In one embodiment, the fatigue reminding interactive component counts the times of blinking, yawning and dozing three driving feature information in a 1-minute period to judge the fatigue level. In one embodiment, the criteria used are as follows:
the drowsiness signal is more than or equal to 1 time within a period of 1 minute, which is severe fatigue;
the blink signal is more than or equal to 30 times but no drowsiness signal within a period of 1 minute, or the yawning signal is more than or equal to 4 times but no drowsiness signal within a period of 1 minute, and the fatigue is moderate;
the blink signal is more than or equal to 24 times and less than 30 times in a 1-minute period without the drowsiness signal, or the yawning signal is more than or equal to 2 times and less than 4 times in a 1-minute period without the drowsiness signal, and the fatigue is light;
the rest is normal.
Fig. 4 discloses a process of performing fatigue level determination in the fatigue driving prompting device according to an embodiment of the invention. In the embodiment shown in fig. 4, the determination is made once in the order of heavy fatigue, medium fatigue, light fatigue, and normal according to the amount of the driving characteristic information corresponding to the fatigue level. Referring to fig. 4, after the characteristic images of the eyes and the mouth of the driver are collected, it is first determined whether the number of times of drowsiness in 1 minute is 1 or more, if so, it is determined that the driver is heavily fatigued, otherwise, the next determination is performed. The second part judges whether the blink signal is equal to or more than 30 times (no drowsy signal) in a period of 1 minute or the yawning signal is equal to or more than 4 times (no drowsy signal) in a period of 1 minute, if so, the driver is in moderate fatigue driving, otherwise, the driver goes to the next judgment. And thirdly, judging whether the blink signal is more than or equal to 24 times and less than 30 times (no drowsy signal) in a 1-minute period or the yawning signal is more than or equal to 2 times and less than 4 times (no drowsy signal) in a 1-minute period, if so, judging that the driver is light fatigue driving, and if not, entering the next step. The above conditions are not met, and the state is judged to be a normal state.
In one embodiment, the communication component 300 is an in-vehicle gateway. And the vehicle-mounted gateway sends the fatigue grade information generated by the fatigue reminding interactive component 200 to the vehicle feedback component, and the vehicle feedback component carries out corresponding feedback prompt on the driver according to the fatigue grade information. In one embodiment, a vehicle feedback assembly comprises: an instrument panel 310, an air conditioning controller 320, and an infotainment device 330.
The dashboard 310 provides visual and audible feedback cues to the driver. The dashboard 310 provides visual and auditory stimuli using the light tube combination and the alarm sound, and the intensity of the prompts can be adjusted according to the fatigue level. When detecting that the driver is in a light fatigue driving state, the instrument panel fatigue driving alarm lamp relaxes and flickers, and sends out a relaxation alarm prompt tone to remind the driver of being in a fatigue state. If the driver is detected to be in a moderate fatigue driving state or a severe fatigue driving state, the fatigue driving alarm lamp of the instrument panel flashes suddenly and a prompt alarm sound is sent out. The stimulation to the auditory sense of the driver is strengthened by changing the urge degree of the prompt tone, the warning effect is enhanced, and the driver is reminded to stop and have a rest in time.
The infotainment device 330 provides mental and informational feedback cues to the driver. The infotainment device 330 may give the driver a mental stimulus and trigger the navigation module to provide real-time stop-and-rest advice. When the driver is detected to be in a moderate fatigue driving state or a severe fatigue driving state, refreshing music is played to enable the driver to be excited, a nearest service area or a rest area is displayed, a navigation route is provided, and the driver is advised to have a rest nearby. The music which is helpful for refreshing is suddenly started, and the driver is distracted by switching navigation information, so that the function is started only under the state of moderate fatigue or severe fatigue driving.
In another embodiment, for a more abundantly configured top class vehicle model, the vehicle feedback assembly further comprises: a fragrance device 340 and a seat massage controller 350.
The fragrance device 340 provides olfactory feedback cues to the driver. When the somatosensory, visual and auditory stimulation with lower intensity does not reach the ideal prompt effect and the driver is detected to be in a moderate fatigue driving state. For a vehicle type with the vehicle-mounted fragrance device, the fragrance device 340 releases refreshing fragrance, so that olfactory stimulation is provided for a driver, the spirit and emotion of the driver are adjusted, driving fatigue is temporarily relieved, and time is won for parking and resting.
The seat massage controller 350 provides tactile feedback cues to the driver. When the driver drives for a long time, the posture of the driver is fixed, the action is limited, unsmooth blood circulation is easy to cause uncomfortable symptoms such as muscle stiffness and body fatigue. When detecting that a driver is in a severe fatigue driving state, for a vehicle type with a seat massage function, the seat massage controller 350 starts seat massage, directly stimulates the body sense of the driver by massaging muscles of the waist, the back, the cervical vertebra and the like of the driver, promotes the blood circulation of the human body, and effectively improves fatigue symptoms caused by long-time driving. However, sudden actuation of the seat massage may affect the normal driving of the driver, and therefore this function is only triggered when the low-intensity or medium-intensity reminding effect is not good.
Fig. 5 discloses an operation process of the fatigue driving prompting device according to an embodiment of the invention. The working process of the fatigue state detection component 100 and the fatigue reminder interaction component 200 is shown: the method comprises the following steps of high-intensity reminding corresponding to severe fatigue driving, medium-intensity reminding corresponding to moderate fatigue driving, low-intensity reminding corresponding to mild fatigue driving and normal state reminding. In particular, the method of manufacturing a semiconductor device,
in light fatigue, the vehicle feedback component provides a low intensity prompt, the low intensity prompt being performed by at least one of the instrument panel 310 and the climate controller 320: the instrument panel provides mild visual and auditory feedback prompts, and the air conditioner controller reduces the temperature and increases the fresh air volume to perform somatosensory feedback prompts. The dashboard 310 and the air conditioner controller 320 may select only one of the components for prompting, or may prompt both components simultaneously.
At moderate fatigue, the vehicle feedback component performs a medium intensity prompt, the medium intensity prompt being performed by at least one of the dashboard 310, the air conditioning controller 320, the infotainment device 330, and the fragrance device 340: the instrument panel provides prompt visual and auditory feedback prompts, the air conditioner controller reduces the temperature and increases the fresh air volume to perform somatosensory feedback prompts, the information entertainment equipment provides mental feedback prompts for playing music and information feedback prompts for indicating a rest area navigation route, and the fragrance equipment releases refreshing fragrance to provide olfactory feedback prompts. The dashboard 310, the air conditioner controller 320, the infotainment device 330, and the fragrance device 340 may select only one of the components to prompt, or may select a combination of a plurality of the components to prompt. Typically for moderate fatigue, a 2-3 component combination is used to indicate it.
Under severe fatigue, the vehicle feedback assembly performs a high intensity prompt, the high intensity prompt being performed by at least one of the instrument panel 310, the air conditioning controller 320, the infotainment device 330, the fragrance device 340, and the seat massage controller 350: the instrument panel provides prompt visual and auditory feedback prompts, the air conditioner controller reduces the temperature and increases the fresh air volume to perform somatosensory feedback prompts, the information entertainment equipment provides mental feedback prompts for playing music and information feedback prompts for indicating a rest area navigation route, the fragrance equipment releases refreshing fragrance to provide olfactory feedback prompts, and the seat massage controller starts seat massage to provide tactile feedback prompts for a driver. The dashboard 310, the air conditioner controller 320, the infotainment device 330, the fragrance device 340, and the seat massage controller 350 may be prompted by selecting only one of the components, or by selecting a combination of a plurality of the components. Typically for severe fatigue, a combination of 4-5 parts is used to indicate it.
The invention also discloses a fatigue driving prompting method, and fig. 6 discloses a flow chart of the fatigue driving prompting method according to an embodiment of the invention. Referring to fig. 6, the fatigue driving prompting method includes the following steps:
and a fatigue detection step 410 of acquiring and processing the image of the driver and outputting driving characteristic information according to the image of the driver. In the fatigue detection step, a face image of the driver is acquired, an eye feature image and a mouth feature image are extracted from the face image, and driving feature information is output according to the eye feature image and the mouth feature image. Wherein the driving characteristic information includes: the eye opening degree is greater than 20% of the maximum opening degree and is an eye opening signal; the eye opening degree is less than or equal to 20% of the maximum opening degree, and the eye opening degree is an eye closing signal; the continuous eye opening signal, the eye signal and the eye opening signal form a blink signal; the eye-closing signal lasts for 3 seconds or more, and is a drowsiness signal; the mouth signal can not be positioned for 3 seconds or more, and the signal is a drowsy signal; the opening degree of the mouth is larger than the width of the mouth, and the mouth is a Hardgree signal. The fatigue detection step 410 is performed by the fatigue state detection module, and the specific implementation details are consistent with those described above and will not be repeated here.
And a fatigue reminding step 420, generating fatigue grade information according to the driving characteristic information. In the fatigue reminding step 420, fatigue grade information is generated according to the driving characteristic information, the fatigue reminding interactive component counts the times of the driving characteristic information in unit time, and generates four kinds of fatigue grade information: normal, mild, moderate and severe fatigue. Wherein: the drowsiness signal is more than or equal to 1 time within a period of 1 minute, which is severe fatigue; the blink signal is more than or equal to 30 times but no drowsiness signal within a period of 1 minute, or the yawning signal is more than or equal to 4 times but no drowsiness signal within a period of 1 minute, and the fatigue is moderate; the blink signal is more than or equal to 24 times and less than 30 times in a 1-minute period without the drowsiness signal, or the yawning signal is more than or equal to 2 times and less than 4 times in a 1-minute period without the drowsiness signal, and the fatigue is light; the rest is normal. The fatigue reminding step 420 is executed by the fatigue reminding interactive module, and the specific implementation details are consistent with those described above and are not repeated here.
And a feedback prompting step 430, namely sending the fatigue grade information to a vehicle feedback component, and performing corresponding feedback prompting on the driver by the vehicle feedback component according to the fatigue grade information. Under light fatigue, the vehicle feedback assembly carries out low-intensity prompt, and the low-intensity prompt is executed by at least one of an instrument panel and an air conditioner controller: the instrument panel provides mild visual and auditory feedback prompts, and the air conditioner controller reduces the temperature and increases the fresh air volume to perform somatosensory feedback prompts. Under moderate fatigue, the vehicle feedback component performs medium intensity prompt, and the medium intensity prompt is executed by at least one of an instrument panel, an air conditioner controller, an infotainment device and a fragrance device: the instrument panel provides prompt visual and auditory feedback prompts, the air conditioner controller reduces the temperature and increases the fresh air volume to perform somatosensory feedback prompts, the information entertainment equipment provides mental feedback prompts for playing music and information feedback prompts for indicating a rest area navigation route, and the fragrance equipment releases refreshing fragrance to provide olfactory feedback prompts. Under severe fatigue, the vehicle feedback assembly performs high-intensity prompting, which is performed by at least one of an instrument panel, an air conditioning controller, an infotainment device, a fragrance device, and a seat massage controller: the instrument panel provides prompt visual and auditory feedback prompts, the air conditioner controller reduces the temperature and increases the fresh air volume to perform somatosensory feedback prompts, the information entertainment equipment provides mental feedback prompts for playing music and information feedback prompts for indicating a rest area navigation route, the fragrance equipment releases refreshing fragrance to provide olfactory feedback prompts, and the seat massage controller starts seat massage to provide tactile feedback prompts for a driver. The feedback prompting step 430 is performed by the communication assembly, the dashboard, the air conditioning controller, the infotainment device, the fragrance device, and the seat massage controller, and the implementation details are consistent with those described above and will not be repeated here.
The fatigue driving prompting device and the prompting method can provide various sensory stimuli comprising auditory sensation, visual sensation, olfactory sensation and tactile sensation according to the real-time state of the driver, reduce the influence of fatigue driving from two aspects of relieving fatigue and helping the driver to stop and rest in time, effectively ensure the safe driving of the driver, and avoid traffic accidents caused by the fatigue driving and harm the life and property safety of the driver and other people.
It should also be noted that the above-mentioned embodiments are only specific embodiments of the present invention. It is apparent that the present invention is not limited to the above embodiments and similar changes or modifications can be easily made by those skilled in the art from the disclosure of the present invention and shall fall within the scope of the present invention. The embodiments described above are provided to enable persons skilled in the art to make or use the invention and that modifications or variations can be made to the embodiments described above by persons skilled in the art without departing from the inventive concept of the present invention, so that the scope of protection of the present invention is not limited by the embodiments described above but should be accorded the widest scope consistent with the innovative features set forth in the claims.
Claims (18)
1. A fatigue driving prompting device, comprising:
the fatigue state detection component acquires and processes the image of the driver and outputs driving characteristic information according to the image of the driver;
the fatigue reminding interactive component is connected to the fatigue state detection component and generates fatigue grade information according to the driving characteristic information;
the communication component is connected with the fatigue reminding interaction component and the vehicle feedback component, the communication component sends fatigue grade information generated by the fatigue reminding interaction component to the vehicle feedback component, and the vehicle feedback component carries out corresponding feedback prompt on a driver according to the fatigue grade information.
2. The fatigue driving prompting device according to claim 1, wherein the fatigue state detecting component is mounted in the cabin, the fatigue state detecting component acquires a face image of the driver, extracts an eye feature image and a mouth feature image from the face image, and outputs the driving feature information based on the eye feature image and the mouth feature image.
3. The fatigue driving prompting device according to claim 2, wherein the fatigue state detecting component includes:
the image acquisition equipment acquires an image of the driver;
and an image processing device connected to the image capturing device, the image processing device acquiring a face image of the driver from the image of the driver captured by the image capturing device, extracting an eye feature image and a mouth feature image from the face image, and outputting driving feature information based on the eye feature image and the mouth feature image.
4. The fatigue driving prompting device according to claim 3, wherein the image acquisition device is an interior camera, the interior camera is directed at the driver seat area, the interior camera is an infrared camera with an active infrared light source, the field angle of the interior camera covers the whole active area of the driver's head in a normal driving state, and the resolution of the interior camera meets the identification requirements of the driver's eye action and mouth action.
5. The fatigue driving prompting apparatus according to claim 3, wherein the image processing device includes:
the face detection module is used for positioning the position of the face image from the image of the driver and acquiring the face image of the driver;
the eye image module is used for positioning and extracting an eye image from the face image;
a mouth image module that locates and extracts a mouth image from the face image;
and the image analysis module is connected to the eye image module and the mouth image module and outputs driving characteristic information according to the eye characteristic image and the mouth characteristic image.
6. The fatigue driving presentation device according to claim 5, wherein the driving characteristic information includes:
the eye opening degree is greater than 20% of the maximum opening degree and is an eye opening signal;
the eye opening degree is less than or equal to 20% of the maximum opening degree, and the eye opening degree is an eye closing signal;
the continuous eye opening signal, the eye closing signal and the eye opening signal form a blink signal;
the eye-closing signal lasts for 3 seconds or more, and is a drowsiness signal;
the mouth signal can not be positioned for 3 seconds or more, and the signal is a drowsy signal;
the opening degree of the mouth is larger than the width of the mouth, and the mouth is a Hardgree signal.
7. The fatigue driving prompting device according to claim 6, wherein the fatigue prompting interacting component generates fatigue grade information according to the driving characteristic information, the fatigue prompting interacting component counts the number of times of the driving characteristic information in unit time and generates four kinds of fatigue grade information: normal, mild, moderate and severe fatigue.
8. The fatigue driving prompting device according to claim 7,
the drowsiness signal is more than or equal to 1 time within a period of 1 minute, which is severe fatigue;
the blink signal is more than or equal to 30 times but no drowsiness signal within a period of 1 minute, or the yawning signal is more than or equal to 4 times but no drowsiness signal within a period of 1 minute, and the fatigue is moderate;
the blink signal is more than or equal to 24 times and less than 30 times in a 1-minute period without the drowsiness signal, or the yawning signal is more than or equal to 2 times and less than 4 times in a 1-minute period without the drowsiness signal, and the fatigue is light;
the rest is normal.
9. The fatigue driving prompting device according to claim 7, wherein the vehicle feedback component includes:
the instrument panel provides visual and auditory feedback prompts for a driver;
the air conditioner controller provides somatosensory feedback prompts for a driver;
an infotainment device provides mental and informational feedback cues to a driver.
10. The fatigue driving prompting device according to claim 9, wherein the vehicle feedback assembly further includes:
the fragrance device provides olfactory feedback prompts for a driver;
a seat massage controller that provides tactile feedback cues to the driver.
11. The fatigue driving prompting device according to claim 10,
under light fatigue, the vehicle feedback assembly carries out low-intensity prompt, and the low-intensity prompt is executed by at least one of an instrument panel and an air conditioner controller: the instrument panel provides mild visual and auditory feedback prompts, and the air conditioner controller reduces the temperature and increases the fresh air volume to perform somatosensory feedback prompts;
under moderate fatigue, the vehicle feedback component performs medium intensity prompt, and the medium intensity prompt is executed by at least one of an instrument panel, an air conditioner controller, an infotainment device and a fragrance device: the instrument panel provides prompt visual and auditory feedback prompts, the air conditioner controller reduces the temperature and increases the fresh air volume to perform somatosensory feedback prompts, the information entertainment equipment provides mental feedback prompts for playing music and information feedback prompts for indicating a rest area navigation route, and the fragrance equipment releases refreshing fragrance to provide olfactory feedback prompts;
under severe fatigue, the vehicle feedback assembly performs high-intensity prompting, which is performed by at least one of an instrument panel, an air conditioning controller, an infotainment device, a fragrance device, and a seat massage controller: the instrument panel provides prompt visual and auditory feedback prompts, the air conditioner controller reduces the temperature and increases the fresh air volume to perform somatosensory feedback prompts, the information entertainment equipment provides mental feedback prompts for playing music and information feedback prompts for indicating a rest area navigation route, the fragrance equipment releases refreshing fragrance to provide olfactory feedback prompts, and the seat massage controller starts seat massage to provide tactile feedback prompts for a driver.
12. The fatigue driving prompting device of claim 1, wherein the communication component is an in-vehicle gateway.
13. A fatigue driving prompting method, comprising:
a fatigue detection step, namely acquiring and processing an image of a driver, and outputting driving characteristic information according to the image of the driver;
a fatigue reminding step, namely generating fatigue grade information according to the driving characteristic information;
and a feedback prompting step, namely sending the fatigue grade information to a vehicle feedback component, and carrying out corresponding feedback prompting on the driver by the vehicle feedback component according to the fatigue grade information.
14. The fatigue driving presentation method according to claim 13, wherein the fatigue detection step acquires a face image of the driver, extracts an eye feature image and a mouth feature image from the face image, and outputs the driving feature information based on the eye feature image and the mouth feature image.
15. The fatigue driving presentation device according to claim 14, wherein the driving characteristic information includes:
the eye opening degree is greater than 20% of the maximum opening degree and is an eye opening signal;
the eye opening degree is less than or equal to 20% of the maximum opening degree, and the eye opening degree is an eye closing signal;
the continuous eye opening signal, the eye closing signal and the eye opening signal form a blink signal;
the eye-closing signal lasts for 3 seconds or more, and is a drowsiness signal;
the mouth signal can not be positioned for 3 seconds or more, and the signal is a drowsy signal;
the opening degree of the mouth is larger than the width of the mouth, and the mouth is a Hardgree signal.
16. The fatigue driving prompting device according to claim 15, wherein in the fatigue prompting step, fatigue grade information is generated according to the driving characteristic information, the fatigue prompting interactive component counts the number of times of the driving characteristic information in a unit time, and generates four kinds of fatigue grade information: normal, mild, moderate and severe fatigue.
17. The fatigue driving prompting device according to claim 16,
the drowsiness signal is more than or equal to 1 time within a period of 1 minute, which is severe fatigue;
the blink signal is more than or equal to 30 times but no drowsiness signal within a period of 1 minute, or the yawning signal is more than or equal to 4 times but no drowsiness signal within a period of 1 minute, and the fatigue is moderate;
the blink signal is more than or equal to 24 times and less than 30 times in a 1-minute period without the drowsiness signal, or the yawning signal is more than or equal to 2 times and less than 4 times in a 1-minute period without the drowsiness signal, and the fatigue is light;
the rest is normal.
18. The fatigue driving prompting device according to claim 16,
under light fatigue, the vehicle feedback assembly carries out low-intensity prompt, and the low-intensity prompt is executed by at least one of an instrument panel and an air conditioner controller: the instrument panel provides mild visual and auditory feedback prompts, and the air conditioner controller reduces the temperature and increases the fresh air volume to perform somatosensory feedback prompts;
under moderate fatigue, the vehicle feedback component performs medium intensity prompt, and the medium intensity prompt is executed by at least one of an instrument panel, an air conditioner controller, an infotainment device and a fragrance device: the instrument panel provides prompt visual and auditory feedback prompts, the air conditioner controller reduces the temperature and increases the fresh air volume to perform somatosensory feedback prompts, the information entertainment equipment provides mental feedback prompts for playing music and information feedback prompts for indicating a rest area navigation route, and the fragrance equipment releases refreshing fragrance to provide olfactory feedback prompts;
under severe fatigue, the vehicle feedback assembly performs high-intensity prompting, which is performed by at least one of an instrument panel, an air conditioning controller, an infotainment device, a fragrance device, and a seat massage controller: the instrument panel provides prompt visual and auditory feedback prompts, the air conditioner controller reduces the temperature and increases the fresh air volume to perform somatosensory feedback prompts, the information entertainment equipment provides mental feedback prompts for playing music and information feedback prompts for indicating a rest area navigation route, the fragrance equipment releases refreshing fragrance to provide olfactory feedback prompts, and the seat massage controller starts seat massage to provide tactile feedback prompts for a driver.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010582554.2A CN111754729A (en) | 2020-06-23 | 2020-06-23 | Fatigue driving prompting device and prompting method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010582554.2A CN111754729A (en) | 2020-06-23 | 2020-06-23 | Fatigue driving prompting device and prompting method |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN111754729A true CN111754729A (en) | 2020-10-09 |
Family
ID=72677582
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010582554.2A Pending CN111754729A (en) | 2020-06-23 | 2020-06-23 | Fatigue driving prompting device and prompting method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111754729A (en) |
Cited By (20)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112258790A (en) * | 2020-10-26 | 2021-01-22 | 上海工程技术大学 | Rail transit train driver on-duty fatigue level and body state detection system |
| CN112319483A (en) * | 2020-10-15 | 2021-02-05 | 浙江吉利控股集团有限公司 | Driving state improving device and driving state improving method |
| CN112406469A (en) * | 2020-11-23 | 2021-02-26 | 珠海格力电器股份有限公司 | Anti-fatigue circuit, method and device for air conditioner and storage medium |
| CN112455452A (en) * | 2020-11-30 | 2021-03-09 | 恒大新能源汽车投资控股集团有限公司 | Method, device and equipment for detecting driving state |
| CN112733683A (en) * | 2020-12-31 | 2021-04-30 | 深圳市元征科技股份有限公司 | Driver health care method, vehicle-mounted device and computer-readable storage medium |
| CN113212337A (en) * | 2021-06-01 | 2021-08-06 | 北京现代汽车有限公司 | Cabin control method and system and vehicle |
| CN113345204A (en) * | 2021-05-27 | 2021-09-03 | 云度新能源汽车有限公司 | Vehicle-mounted remote fatigue awakening method and awakening system thereof |
| CN113331846A (en) * | 2021-06-30 | 2021-09-03 | 易念科技（深圳）有限公司 | Driving state detection method, detection device and computer readable storage medium |
| CN113362566A (en) * | 2021-06-25 | 2021-09-07 | 广汽本田汽车有限公司 | Reminding system, method and storage medium for preventing fatigue driving |
| CN113570824A (en) * | 2021-07-23 | 2021-10-29 | 衡阳国脉电子科技有限公司 | Driver face recognition fatigue driving early warning equipment based on three dimensions |
| CN113844459A (en) * | 2021-08-31 | 2021-12-28 | 江铃汽车股份有限公司 | Lighting control system for safe driving and control method thereof |
| CN113888890A (en) * | 2021-09-29 | 2022-01-04 | 四川奇石缘科技股份有限公司 | Electronic warning system for preventing accident on highway |
| CN113942453A (en) * | 2021-11-29 | 2022-01-18 | 阿维塔科技(重庆)有限公司 | Vehicle-mounted intelligent fragrance control method, control equipment, vehicle and storage medium |
| CN113954848A (en) * | 2021-11-29 | 2022-01-21 | 阿维塔科技(重庆)有限公司 | Driving assistance method and system, vehicle and computer storage medium |
| CN114140986A (en) * | 2021-11-23 | 2022-03-04 | 奇瑞汽车股份有限公司 | Fatigue driving early warning method, system and storage medium |
| CN114132326A (en) * | 2021-11-26 | 2022-03-04 | 北京经纬恒润科技股份有限公司 | Method and device for processing fatigue driving |
| CN114132330A (en) * | 2021-12-17 | 2022-03-04 | 奇瑞新能源汽车股份有限公司 | Method and device for reminding driver of abnormal driving state |
| CN114176606A (en) * | 2021-12-23 | 2022-03-15 | 宏谷信息科技（珠海）有限公司 | Brain wave detection intelligent early warning device |
| CN114476076A (en) * | 2021-12-31 | 2022-05-13 | 中国航空工业集团公司西安飞机设计研究所 | Self-adaptive comfort adjusting system |
| CN114771379A (en) * | 2022-05-19 | 2022-07-22 | 一汽丰田汽车有限公司 | Seat headrest, vehicle and fatigue grade detection method |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102254151A (en) * | 2011-06-16 | 2011-11-23 | 清华大学 | Driver fatigue detection method based on face video analysis |
| CN104240446A (en) * | 2014-09-26 | 2014-12-24 | 长春工业大学 | Fatigue driving warning system on basis of human face recognition |
| CN105700682A (en) * | 2016-01-08 | 2016-06-22 | 北京乐驾科技有限公司 | Intelligent gender and emotion recognition detection system and method based on vision and voice |
| CN105788176A (en) * | 2016-05-25 | 2016-07-20 | 厦门理工学院 | Fatigue driving monitoring and prompting method and system |
| CN108573210A (en) * | 2018-03-02 | 2018-09-25 | 成都高原汽车工业有限公司 | A kind of alarming method for fatigue drive and device |
| CN111098860A (en) * | 2019-12-16 | 2020-05-05 | 东风汽车有限公司 | Automobile driving fatigue relieving method, electronic equipment, fatigue driving judging method and server |
-
2020
- 2020-06-23 CN CN202010582554.2A patent/CN111754729A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102254151A (en) * | 2011-06-16 | 2011-11-23 | 清华大学 | Driver fatigue detection method based on face video analysis |
| CN104240446A (en) * | 2014-09-26 | 2014-12-24 | 长春工业大学 | Fatigue driving warning system on basis of human face recognition |
| CN105700682A (en) * | 2016-01-08 | 2016-06-22 | 北京乐驾科技有限公司 | Intelligent gender and emotion recognition detection system and method based on vision and voice |
| CN105788176A (en) * | 2016-05-25 | 2016-07-20 | 厦门理工学院 | Fatigue driving monitoring and prompting method and system |
| CN108573210A (en) * | 2018-03-02 | 2018-09-25 | 成都高原汽车工业有限公司 | A kind of alarming method for fatigue drive and device |
| CN111098860A (en) * | 2019-12-16 | 2020-05-05 | 东风汽车有限公司 | Automobile driving fatigue relieving method, electronic equipment, fatigue driving judging method and server |
Cited By (23)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112319483A (en) * | 2020-10-15 | 2021-02-05 | 浙江吉利控股集团有限公司 | Driving state improving device and driving state improving method |
| CN112258790A (en) * | 2020-10-26 | 2021-01-22 | 上海工程技术大学 | Rail transit train driver on-duty fatigue level and body state detection system |
| CN112406469A (en) * | 2020-11-23 | 2021-02-26 | 珠海格力电器股份有限公司 | Anti-fatigue circuit, method and device for air conditioner and storage medium |
| CN112455452A (en) * | 2020-11-30 | 2021-03-09 | 恒大新能源汽车投资控股集团有限公司 | Method, device and equipment for detecting driving state |
| CN112733683A (en) * | 2020-12-31 | 2021-04-30 | 深圳市元征科技股份有限公司 | Driver health care method, vehicle-mounted device and computer-readable storage medium |
| CN113345204A (en) * | 2021-05-27 | 2021-09-03 | 云度新能源汽车有限公司 | Vehicle-mounted remote fatigue awakening method and awakening system thereof |
| CN113212337A (en) * | 2021-06-01 | 2021-08-06 | 北京现代汽车有限公司 | Cabin control method and system and vehicle |
| CN113362566A (en) * | 2021-06-25 | 2021-09-07 | 广汽本田汽车有限公司 | Reminding system, method and storage medium for preventing fatigue driving |
| CN113331846A (en) * | 2021-06-30 | 2021-09-03 | 易念科技（深圳）有限公司 | Driving state detection method, detection device and computer readable storage medium |
| CN113331846B (en) * | 2021-06-30 | 2024-01-02 | 易念科技（深圳）有限公司 | Driving state detection method, detection device and computer readable storage medium |
| CN113570824B (en) * | 2021-07-23 | 2022-08-26 | 衡阳国脉电子科技有限公司 | Driver face recognition fatigue driving early warning equipment based on three dimensions |
| CN113570824A (en) * | 2021-07-23 | 2021-10-29 | 衡阳国脉电子科技有限公司 | Driver face recognition fatigue driving early warning equipment based on three dimensions |
| CN113844459A (en) * | 2021-08-31 | 2021-12-28 | 江铃汽车股份有限公司 | Lighting control system for safe driving and control method thereof |
| CN113888890A (en) * | 2021-09-29 | 2022-01-04 | 四川奇石缘科技股份有限公司 | Electronic warning system for preventing accident on highway |
| CN114140986A (en) * | 2021-11-23 | 2022-03-04 | 奇瑞汽车股份有限公司 | Fatigue driving early warning method, system and storage medium |
| CN114132326A (en) * | 2021-11-26 | 2022-03-04 | 北京经纬恒润科技股份有限公司 | Method and device for processing fatigue driving |
| CN113954848A (en) * | 2021-11-29 | 2022-01-21 | 阿维塔科技(重庆)有限公司 | Driving assistance method and system, vehicle and computer storage medium |
| CN113942453A (en) * | 2021-11-29 | 2022-01-18 | 阿维塔科技(重庆)有限公司 | Vehicle-mounted intelligent fragrance control method, control equipment, vehicle and storage medium |
| CN113942453B (en) * | 2021-11-29 | 2023-12-15 | 阿维塔科技(重庆)有限公司 | Vehicle-mounted intelligent fragrance control method, control equipment, vehicle and storage medium |
| CN114132330A (en) * | 2021-12-17 | 2022-03-04 | 奇瑞新能源汽车股份有限公司 | Method and device for reminding driver of abnormal driving state |
| CN114176606A (en) * | 2021-12-23 | 2022-03-15 | 宏谷信息科技（珠海）有限公司 | Brain wave detection intelligent early warning device |
| CN114476076A (en) * | 2021-12-31 | 2022-05-13 | 中国航空工业集团公司西安飞机设计研究所 | Self-adaptive comfort adjusting system |
| CN114771379A (en) * | 2022-05-19 | 2022-07-22 | 一汽丰田汽车有限公司 | Seat headrest, vehicle and fatigue grade detection method |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111754729A (en) | Fatigue driving prompting device and prompting method | |
| US10752252B2 (en) | System and method for responding to driver state | |
| US20210009149A1 (en) | Distractedness sensing system | |
| US10875536B2 (en) | Coordinated vehicle response system and method for driver behavior | |
| CN107832748B (en) | Shared automobile driver replacing system and method | |
| JP4500369B2 (en) | Distraction detection device, distraction detection method, and computer program | |
| US8823792B2 (en) | Wakefulness level estimation apparatus | |
| US8698639B2 (en) | System and method for responding to driver behavior | |
| EP2497670B1 (en) | Method and apparatus for monitoring the alertness of the driver of a vehicle | |
| WO2014149657A1 (en) | Coordinated vehicle response system and method for driver behavior | |
| AU2012218054A1 (en) | System and method for responding to driver behavior | |
| US20150125126A1 (en) | Detection system in a vehicle for recording the speaking activity of a vehicle occupant | |
| JP2019195377A (en) | Data processing device, monitoring system, awakening system, data processing method, and data processing program | |
| KR20230002180A (en) | Device for attract attention of driver method thereof | |
| JP7087286B2 (en) | Awakening maintenance device | |
| CN111243235A (en) | Driving assistance method and device | |
| KR102507038B1 (en) | Surveillant system of driver for safety | |
| CN114103959A (en) | Device and method for monitoring drunk driving | |
| Kurhe et al. | Implementation on Alcohol Sensing Alert | |
| JP2023114500A (en) | State determination device, state determination method, and program |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20201009 |
|
| RJ01 | Rejection of invention patent application after publication |