CN114821966A - Fatigue driving early warning method, device, terminal and fatigue driving early warning system - Google Patents
Fatigue driving early warning method, device, terminal and fatigue driving early warning system Download PDFInfo
- Publication number
- CN114821966A CN114821966A CN202110785650.1A CN202110785650A CN114821966A CN 114821966 A CN114821966 A CN 114821966A CN 202110785650 A CN202110785650 A CN 202110785650A CN 114821966 A CN114821966 A CN 114821966A
- Authority
- CN
- China
- Prior art keywords
- fatigue driving
- vehicle
- early warning
- driver
- grade
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 41
- 230000000007 visual effect Effects 0.000 claims abstract description 14
- 230000035943 smell Effects 0.000 claims abstract 3
- 239000011159 matrix material Substances 0.000 claims description 28
- 238000004590 computer program Methods 0.000 claims description 22
- 239000003205 fragrance Substances 0.000 claims description 10
- 238000012545 processing Methods 0.000 claims description 8
- 238000007664 blowing Methods 0.000 claims description 5
- 102100034112 Alkyldihydroxyacetonephosphate synthase, peroxisomal Human genes 0.000 claims description 4
- 101000799143 Homo sapiens Alkyldihydroxyacetonephosphate synthase, peroxisomal Proteins 0.000 claims description 4
- 238000000848 angular dependent Auger electron spectroscopy Methods 0.000 claims description 4
- 230000000694 effects Effects 0.000 abstract description 6
- 230000006870 function Effects 0.000 description 10
- 238000012544 monitoring process Methods 0.000 description 9
- 230000008569 process Effects 0.000 description 8
- 238000010586 diagram Methods 0.000 description 6
- 210000000744 eyelid Anatomy 0.000 description 5
- 210000001747 pupil Anatomy 0.000 description 5
- 230000003993 interaction Effects 0.000 description 4
- 230000008878 coupling Effects 0.000 description 3
- 238000010168 coupling process Methods 0.000 description 3
- 238000005859 coupling reaction Methods 0.000 description 3
- 239000004576 sand Substances 0.000 description 3
- 230000035807 sensation Effects 0.000 description 3
- 206010039203 Road traffic accident Diseases 0.000 description 2
- 230000004397 blinking Effects 0.000 description 2
- 210000004556 brain Anatomy 0.000 description 2
- 238000004891 communication Methods 0.000 description 2
- 238000013461 design Methods 0.000 description 2
- 230000001815 facial effect Effects 0.000 description 2
- 230000004886 head movement Effects 0.000 description 2
- 230000008447 perception Effects 0.000 description 2
- 235000006679 Mentha X verticillata Nutrition 0.000 description 1
- 235000002899 Mentha suaveolens Nutrition 0.000 description 1
- 235000001636 Mentha x rotundifolia Nutrition 0.000 description 1
- 230000002159 abnormal effect Effects 0.000 description 1
- 238000009825 accumulation Methods 0.000 description 1
- 238000007792 addition Methods 0.000 description 1
- 238000013473 artificial intelligence Methods 0.000 description 1
- 230000002567 autonomic effect Effects 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 239000000428 dust Substances 0.000 description 1
- 238000011156 evaluation Methods 0.000 description 1
- 238000007667 floating Methods 0.000 description 1
- 230000007246 mechanism Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 210000005036 nerve Anatomy 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000035790 physiological processes and functions Effects 0.000 description 1
- 230000008433 psychological processes and functions Effects 0.000 description 1
- 238000005070 sampling Methods 0.000 description 1
- 230000015541 sensory perception of touch Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 238000010257 thawing Methods 0.000 description 1
- 230000002618 waking effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B21/00—Alarms responsive to a single specified undesired or abnormal condition and not otherwise provided for
- G08B21/02—Alarms for ensuring the safety of persons
- G08B21/06—Alarms for ensuring the safety of persons indicating a condition of sleep, e.g. anti-dozing alarms
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B7/00—Signalling systems according to more than one of groups G08B3/00 - G08B6/00; Personal calling systems according to more than one of groups G08B3/00 - G08B6/00
- G08B7/06—Signalling systems according to more than one of groups G08B3/00 - G08B6/00; Personal calling systems according to more than one of groups G08B3/00 - G08B6/00 using electric transmission, e.g. involving audible and visible signalling through the use of sound and light sources
Landscapes
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Business, Economics & Management (AREA)
- Emergency Management (AREA)
- Emergency Alarm Devices (AREA)
Abstract
The invention provides a fatigue driving early warning method, a fatigue driving early warning device, a terminal and a fatigue driving early warning system. The method comprises the following steps: determining a fatigue driving level of a driver; if the fatigue driving grade is one grade, executing an early warning scheme based on hearing and vision; if the fatigue driving grade is in the second grade, executing an early warning scheme based on hearing, vision and smell; if the fatigue driving grade is three grades, executing an early warning scheme based on auditory sense, visual sense and touch sense; wherein, the fatigue driving degree of the first stage, the second stage and the third stage is gradually increased. The invention adopts different early warning schemes aiming at the fatigue driving of different levels, can achieve better early warning effect and reduce the potential safety hazard caused by the fatigue driving.
Description
Technical Field
The invention relates to the technical field of fatigue driving, in particular to a fatigue driving early warning method, a fatigue driving early warning device, a terminal and a fatigue driving early warning system.
Background
The traffic accident easily caused by fatigue driving refers to the phenomenon that after a driver drives a vehicle continuously for a long time, the physiological function and the psychological function are disordered, and the driving skill is objectively reduced. The fatigue driving is easy to cause traffic accidents, so that the early warning of the fatigue driving is necessary for the driver.
At present, the fatigue driving early warning usually adopts a single mode to carry out early warning when detecting the fatigue driving of a driver, for example, voice reminding, and the like, however, the early warning mode is single, cannot achieve a good early warning effect, and still has high potential safety hazards brought by the fatigue driving.
Disclosure of Invention
The embodiment of the invention provides a fatigue driving early warning method, a fatigue driving early warning device, a terminal and a fatigue driving early warning system, and aims to solve the problems that an early warning mode is single, a good early warning effect cannot be achieved, and high potential safety hazards caused by fatigue driving still exist.
In a first aspect, an embodiment of the present invention provides a fatigue driving early warning method, including:
determining a fatigue driving level of a driver;
if the fatigue driving grade is one grade, executing an early warning scheme based on hearing and vision;
if the fatigue driving grade is in the second grade, executing an early warning scheme based on hearing, vision and smell;
if the fatigue driving grade is three grades, executing an early warning scheme based on auditory sense, visual sense and touch sense;
wherein, the fatigue driving degree of the first stage, the second stage and the third stage is gradually increased.
In one possible implementation, an audible, visual, and tactile based alert scheme is implemented, comprising:
sending a three-level control instruction to the vehicle machine system and the intelligent hardware system; the third-level control instruction is used for indicating the intelligent hardware system to control at least one of a safety belt, a steering wheel and a seat to perform early warning; the three-level control instruction is used for indicating the vehicle-mounted device system to prompt a driver whether to start a refreshing mode or a taking-over mode through voice and/or a display screen, and starting the refreshing mode or the taking-over mode based on the selection of the driver;
in the refreshing mode, the vehicle-mounted system controls a vehicle-mounted air conditioner, a vehicle window and vehicle-mounted multimedia so as to relieve the fatigue driving degree of a driver; under the takeover mode, the vehicle machine system controls the intelligent navigation system and the ADAS to navigate to the nearest rest area or the rest area designated by the driver.
In a possible implementation mode, in a refreshing mode, the vehicle-mounted air conditioner system controls the target temperature of the vehicle-mounted air conditioner to be a preset temperature, the air volume gear is a preset gear, the air outlet mode is a blowing mode, and the circulation mode is internal circulation;
in the refreshing mode, the car machine system controls the opening proportion of the car window according to the car speed;
under the mode of refreshing, the car machine system controls the multimedia to increase the music playing volume.
In one possible implementation, an auditory, visual, and olfactory based early warning scheme is implemented, comprising:
sending a secondary control instruction to the vehicle machine system and the intelligent hardware system; the secondary control instruction is used for instructing the vehicle-mounted computer system to carry out dialogue with the driver by adopting sounds interested by the driver; and the secondary control instruction is used for indicating the intelligent hardware system to control the atmosphere lamp in the vehicle to carry out light reminding and controlling the vehicle-mounted fragrance equipment to start working.
In one possible implementation, an auditory and visual based early warning scheme is implemented, comprising:
sending a primary control instruction to the vehicle machine system and the intelligent hardware system; the primary control instruction is used for instructing the vehicle machine system to carry out voice reminding by adopting virtual images and sounds which are interested by a driver; the primary control instruction is used for indicating the intelligent hardware system to control the atmosphere lamp in the vehicle to carry out light reminding.
In one possible implementation, determining a driver's fatigue driving level includes:
acquiring continuous multi-frame images of a driver shot in a preset time before the current time;
determining an eye area of each frame of image, and performing binarization processing on the eye area of the frame of image to obtain a histogram matrix of the eye area of the frame of image; calculating a first difference sum of a histogram matrix of an eye region of the frame of image and a predetermined eye-open state standard histogram matrix; calculating a second difference sum of a histogram matrix of the eye area of the frame of image and a predetermined standard histogram matrix of the eye closing state; if the first difference sum is smaller than the second difference sum, determining that the driver is in an eye opening state at the moment corresponding to the frame image, otherwise, determining that the driver is in an eye closing state at the moment corresponding to the frame image;
calculating a PERCLOS value and an average eye closing time length corresponding to the preset time length according to the eye state of the driver at each moment in the preset time length;
and if the PERCLOS value corresponding to the preset time length is greater than the preset threshold value, determining the fatigue driving grade of the driver according to the average eye-closing time length.
In a second aspect, an embodiment of the present invention provides a fatigue driving warning apparatus, including:
the fatigue driving grade determining module is used for determining the fatigue driving grade of the driver;
the first early warning module is used for executing an early warning scheme based on hearing sense and vision if the fatigue driving grade is one grade;
the second early warning module is used for executing an early warning scheme based on hearing, vision and smell if the fatigue driving grade is in a second level;
the third early warning module is used for executing an early warning scheme based on auditory sense, visual sense and touch sense if the fatigue driving grade is three grades;
wherein, the fatigue driving degree of the first stage, the second stage and the third stage is gradually increased.
In a third aspect, an embodiment of the present invention provides a terminal, including a memory, a processor, and a computer program stored in the memory and executable on the processor, where the processor, when executing the computer program, implements the steps of the fatigue driving warning method according to the first aspect or any possible implementation manner of the first aspect.
In a fourth aspect, an embodiment of the present invention provides a fatigue driving early warning system, including a vehicle machine system, an intelligent hardware system, and the terminal according to the third aspect;
and the terminal is respectively connected with the vehicle machine system and the intelligent hardware system.
In a fifth aspect, the present invention provides a computer-readable storage medium, which stores a computer program, and when the computer program is executed by a processor, the computer program implements the steps of the fatigue driving warning method according to the first aspect or any one of the possible implementation manners of the first aspect.
The embodiment of the invention provides a fatigue driving early warning method, a fatigue driving early warning device, a terminal and a fatigue driving early warning system. When the fatigue driving grade is the first grade, executing an early warning scheme based on hearing and vision, when the fatigue driving grade is the second grade, executing an early warning scheme based on hearing, vision and smell, when the fatigue driving grade is the third grade, executing an early warning scheme based on hearing, vision and touch, and along with the increase of the fatigue driving degree, adopting a more proper early warning scheme, achieving a better early warning effect and reducing potential safety hazards brought by fatigue driving.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings required to be used in the embodiments or the prior art description will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and for those skilled in the art, other drawings may be obtained according to these drawings without inventive labor.
Fig. 1 is a schematic structural diagram of a fatigue driving warning system provided in an embodiment of the present invention;
FIG. 2 is a flowchart of an implementation of a fatigue driving warning method according to an embodiment of the present invention;
FIG. 3 is a schematic graph of PERCLOS provided by an embodiment of the present invention;
fig. 4 is a schematic structural diagram of a fatigue driving warning device provided in an embodiment of the present invention;
fig. 5 is a schematic diagram of a terminal according to an embodiment of the present invention.
Detailed Description
In the following description, for purposes of explanation and not limitation, specific details are set forth, such as particular system structures, techniques, etc. in order to provide a thorough understanding of the embodiments of the invention. It will be apparent, however, to one skilled in the art that the present invention may be practiced in other embodiments that depart from these specific details. In other instances, detailed descriptions of well-known systems, devices, circuits, and methods are omitted so as not to obscure the description of the present invention with unnecessary detail.
In order to make the objects, technical solutions and advantages of the present invention more apparent, the following description is made by way of specific embodiments with reference to the accompanying drawings.
Fig. 1 is a schematic structural diagram of a fatigue driving warning system according to an embodiment of the present invention. As shown in fig. 1, the fatigue driving early warning system may include a vehicle machine system 5, an intelligent hardware system 6, and a terminal 4; and the terminal 4 is respectively connected with the vehicle machine system 5 and the intelligent hardware system 6.
The terminal 4 may be an in-vehicle terminal including a DMS (driver monitoring system), and may acquire a monitoring video of the driver through a camera, where the camera may be disposed at a position where the facial features of the driver can be captured. The real-time monitoring image of the driver is obtained according to the monitoring video, so that the fatigue driving level of the driver can be judged, different commands are sent to the intelligent hardware system 6 and the car machine system 5 according to the fatigue driving level, so that the intelligent hardware system 6 and the car machine system 5 can execute different early warning schemes according to the different commands, for example, active voice interaction, intelligent hobby ecological pushing, waking up fragrance system, intelligent cruise system, intelligent driving assistance and other AI artificial intelligent algorithm innovation functions can be used, pushing is carried out step by step in a five-sense cabin pushing mode, the innovation scene improves user experience, user complaints caused by hardware accumulation are avoided, and the traffic safety situation is improved.
Referring to fig. 2, it shows a flowchart of implementing the fatigue driving warning method provided by the embodiment of the present invention, which is detailed as follows:
in S201, the fatigue driving level of the driver is determined.
In the embodiment of the invention, the fatigue driving grade of the driver is determined firstly, so that the early warning scheme corresponding to the fatigue driving grade can be realized in real time.
The fatigue driving grade of the driver can be monitored in real time, and the early warning scheme can be switched at any time according to the change of the fatigue driving grade of the driver.
Wherein the fatigue driving level may represent a fatigue driving degree of the driver.
In some embodiments of the present invention, the above S201 may include the following steps:
acquiring continuous multi-frame images of a driver shot in a preset time before the current time;
determining an eye area of each frame of image, and performing binarization processing on the eye area of the frame of image to obtain a histogram matrix of the eye area of the frame of image; calculating a first difference sum of a histogram matrix of an eye region of the frame of image and a predetermined eye-open state standard histogram matrix; calculating a second difference sum of a histogram matrix of the eye area of the frame of image and a predetermined standard histogram matrix of the eye closing state; if the first difference sum is smaller than the second difference sum, determining that the driver is in an eye opening state at the moment corresponding to the frame image, otherwise, determining that the driver is in an eye closing state at the moment corresponding to the frame image;
calculating a PERCLOS value and an average eye closing time length corresponding to the preset time length according to the eye state of the driver at each moment in the preset time length;
and if the PERCLOS value corresponding to the preset time length is greater than the preset threshold value, determining the fatigue driving grade of the driver according to the average eye-closing time length.
In the embodiment of the invention, the continuous multi-frame images of the driver shot in the preset time before the current time can be obtained according to the shot monitoring video of the driver, namely, the monitoring video shot in the preset time before the current time is decomposed into the continuous multi-frame images. The preset duration before the current time may include the current time. The preset time period may be set according to actual requirements, for example, may be set to several blinking periods.
PERCLOS, defined as the degree of closure of the eye over time, has become a scientific and effective way to measure fatigue. A state of fatigue is considered when the proportion of time taken for the eyes to close over a certain time interval exceeds 15%. The PERCLOS method determines fatigue driving by the proportion of time that the eyes are closed. However, the size of the eyes varies from person to person, the area of the eyes is also dynamically changed due to the scene and the head movement, and the degree of opening of the eyes is relative to the maximum opening state of the eyes.
At present, the PERCLOS method has three different criteria for fatigue judgment, namely an EM criterion, a P70 criterion and a P80 criterion. The specific meanings are as follows:
the EM criterion is as follows: the pupil is covered by the eyelid over 50% of the area, the eye is considered closed;
p70 criteria: the pupil is covered by the eyelid for more than 70% of the area, the eye is considered closed;
p80 criteria: the pupil is covered by the eyelids over an area of 80%, the eye is considered closed.
The P80 criterion is used in this embodiment because the eyelid may cover more than 50% or even 70% of the pupil when the person is particularly focused or in a state of meditation.
FIG. 3 is a schematic graph of PERCLOS, as shown in FIG. 3, t 0 -t 5 Is a closed eye period, t 0 -t 1 For a time of 80% of the time when the eyes are fully open, t 1 -t 2 80% to 20% of the time the eyes are open, t 3 -t 4 20% to 80% of the time that the eyes are open, t 4 ～t 5 80% of the eyes open to full eye open time. Then, the PERCLOS value PERCLOS (t) during the closed eye period 0 -t 5 ) Comprises the following steps:
during the eye-closing period, the eye-closing time period T (T) 0 -t 5 ) Comprises the following steps:
T(t 0 -t 5 )＝t 3 -t 2
similarly, the PERCLOS value and the average eye-closing time within the time duration of 1-2 min can be deduced, n eye-closing periods are set within the time duration T, and the kth eye-closing periodThe time period during which the eyelid covers more than 80% of the pupil is T k Then the PERCLOS value over the duration T is
Within the time period T, the average eye-closing time period T is
The specific process for determining the driver's fatigue driving level is detailed as follows:
1) and (4) field video input, namely acquiring the monitoring video of the driver shot in a preset time before the current moment.
2) And image acquisition, namely capturing frames in real time to obtain a monitoring image in a YUV format based on the monitoring image.
3) And (3) face recognition, matching a face area in each frame of image through a face model, if the matching is successful, continuing to execute the step 4), otherwise, returning to the step 1), adjusting the angle of the camera, and shooting the video again.
4) And (4) detecting human eyes, and determining eye areas in each frame of image according to the relative positions of the eyes in the human face model.
5) The human eye state is recognized, that is, whether the eye is open or closed. Carrying out binarization processing on the eye area of each frame of image to obtain a histogram matrix of the eye area of the frame of image; calculating a first difference value sum S1 between the histogram matrix of the eye region of the frame image and a predetermined eye-open state criterion histogram matrix; calculating a second difference sum S2 between the histogram matrix of the eye region of the frame image and a predetermined standard histogram matrix of the closed-eye state; and if the S1 is smaller than the S2, determining that the eyes of the driver are open at the moment corresponding to the frame image, and otherwise, determining that the eyes of the driver are closed at the moment corresponding to the frame image.
Where the histogram matrix may be represented as H ═ H { x 1 ，f(x1)}，……，h{x m ，f(x m )}]，x 1 -x m Is m gray levels, f (x) m ) The frequency with which the mth gray level appears. Eye-open state standard histogram matrix and eye-closed stateThe standard histogram matrix may be pre-calibrated. The sum of the differences of the two histogram matrices may be the sum of the frequency differences of each gray level in the two histogram matrices.
6) The method comprises the steps of calculating a PERCLOS value and an average eye closing time length, calculating the PERCLOS value and the average eye closing time length corresponding to a preset time length before the current time according to the formula, specifically determining the eye opening time length and the eye closing time length in the preset time length according to the eye state corresponding to each frame of image, and further calculating the PERCLOS value and the average eye closing time length corresponding to the preset time length before the current time.
7) Determining the fatigue driving grade of the driver at the current moment, and if the PERCLOS value corresponding to the preset time length is greater than the preset threshold value, determining the fatigue driving grade of the driver according to the average eye-closing time length, for example, if the average eye-closing time length is within a first preset time length range, the average eye-closing time length is in a first grade, if the average eye-closing time length is within a second preset time length range, the average eye-closing time length is in a second grade, and if the average eye-closing time length is within a third preset time length range, the average eye-closing time length is in a third grade. The duration in the third preset duration range is greater than the duration in the second preset duration range, the duration in the second preset duration range is greater than the duration in the first preset duration range, and the specific range can be set according to actual requirements, and is not specifically limited herein. The preset threshold may also be set according to actual requirements, and is not particularly limited herein.
In a possible implementation manner, the fatigue degree comprehensive judgment can be performed by using the PERCLOS fatigue degree evaluation indexes (the PERCLOS value and the average eye closing duration) in combination with the eye blinking frequency, the mouth opening degree and the head movement track, and the driving fatigue grades are divided into mild fatigue, moderate fatigue and severe fatigue, namely, the first grade, the second grade and the third grade.
In this embodiment, the terminal may continuously collect and analyze key facial markers through a visual algorithm and an artificial intelligence algorithm with sufficient performance, flexibly connect new sensors through an SoC solution and support different system topologies, such as an independent single-box design, an integrated cluster/infotainment system + DMS solution ECU, a remote sensor, and the like, and issue different commands according to the determination result to trigger an early warning scheme of a corresponding level.
In S202, if the fatigue driving level is one level, an early warning scheme based on hearing and vision is performed.
In some embodiments of the present invention, the performing of the hearing and vision based early warning scheme may include:
sending a primary control instruction to the vehicle machine system and the intelligent hardware system; the primary control instruction is used for instructing the vehicle machine system to carry out voice reminding by adopting virtual images and sounds which are interested by a driver; the primary control instruction is used for indicating the intelligent hardware system to control the atmosphere lamp in the vehicle to carry out light reminding.
Wherein the primary control instruction may be an instruction identifier. The terminal can send control commands containing different command identifiers to the vehicle-mounted machine system and the intelligent hardware system according to different fatigue driving grades. The in-vehicle machine system and the intelligent hardware system can determine whether the instruction is executed or not based on the respective identifier filters according to the allocated identifiers, if the identifiers exist in the queue, the instruction is executed, otherwise, the instruction is not executed; an optimal balance between performance and ease of use is achieved according to application requirements, and problems in synchronization and data sampling are minimized. When the terminal carries out grade judgment on the current driver state, the judgment result is transmitted to the vehicle machine system and the intelligent hardware system through the instruction identifier, and the vehicle machine system and the intelligent hardware system can send the instruction identifier to the corresponding operation system, such as a central operation system, a vehicle machine operation system, each ECU operation system and the like.
When the vehicle-mounted machine system receives the primary control instruction, the primary control instruction is transmitted to each corresponding ECU, so that the corresponding scheme is executed, and particularly the primary control instruction is transmitted to an intelligent voice system and an intelligent AI image management system. The intelligent voice system can select the voice playing voice prompt interested by the driver according to the usual habit of the driver based on the primary control instruction, and the intelligent AI image management system can select the virtual AI image interested by the user based on the primary control instruction, display the virtual AI image on the display screen, and perform voice early warning on the driver by combining voice. The voice of some stars can be preset in the cloud corpus for the driver to select and download, and the voice of some family members can also be preset. Some virtual images can be preset in the virtual image library of the cloud end for the user to select.
When the intelligent hardware system receives the primary control instruction, the primary control instruction is transmitted to the atmosphere lamp in the vehicle, so that the atmosphere lamp in the vehicle flickers.
The terminal continuously monitors the fatigue driving level of the driver, and when the level is reduced, an early warning scheme based on hearing and vision is not executed any more; when the level thereof is raised to the second level, S203 may be performed.
In S203, if the fatigue driving level is two-level, an early warning scheme based on hearing, vision, and smell is performed.
In some embodiments of the present invention, the performing of the early warning scheme based on hearing, vision and smell may include:
sending a secondary control instruction to the vehicle machine system and the intelligent hardware system; the secondary control instruction is used for instructing the vehicle-mounted computer system to carry out dialogue with the driver by adopting sounds interested by the driver; and the secondary control instruction is used for indicating the intelligent hardware system to control the atmosphere lamp in the vehicle to carry out light reminding and controlling the vehicle-mounted fragrance equipment to start working.
And when the vehicle-mounted machine system receives the secondary control instruction, the secondary control instruction is sent to the intelligent voice system and the intelligent ecological push system. The intelligent voice system may actively initiate a dialogue with the driver using sounds of interest to the driver, such as: "is a handsome boy, detect you tired, is it not to need to come to a music to improve spirit? ". The driver actively carries out continuous conversation, the attention of the user is dispersed, and the brain nerves are stimulated by the continuous operation and the activity of the brain, so that the feeling of fatigue is dispersed.
According to the answer of the driver and the access of the intelligent ecological pushing system, the multimedia information or other related information and interfaces can be pushed to the driver, and the smoothness of conversation with a user can be more intelligently completed, so that the intelligent interaction perception of the driver to the automobile is continuously remodeled, and the user experience is improved.
When the intelligent hardware system receives the secondary control instruction, the secondary control instruction can be transmitted to the vehicle-mounted fragrance equipment and the vehicle interior fragrance lamp. The in-vehicle ambience light may be tuned to the blue-green band based on the instruction. The vehicle-mounted fragrance device may be pre-set with a mint resuscitation fragrance, and based on the instruction, initiate the fragrance taste.
The terminal continuously monitors the fatigue driving grade of the driver, and when the grade is reduced, a corresponding early warning scheme of the first grade is executed; when the level thereof is raised to three levels, S204 may be performed.
In S204, if the fatigue driving level is three levels, performing an early warning scheme based on auditory sense, visual sense, and tactile sense;
wherein, the fatigue driving degree of the first stage, the second stage and the third stage is gradually increased.
In some embodiments of the present invention, the performing of the early warning scheme based on auditory sensation, visual sensation and tactile sensation may include:
sending a three-level control instruction to the vehicle machine system and the intelligent hardware system; the third-level control instruction is used for indicating the intelligent hardware system to control at least one of a safety belt, a steering wheel and a seat to perform early warning; the three-level control instruction is used for indicating the vehicle-mounted device system to prompt a driver whether to start a refreshing mode or a taking-over mode through voice and/or a display screen, and starting the refreshing mode or the taking-over mode based on the selection of the driver;
in the refreshing mode, the vehicle-mounted system controls a vehicle-mounted air conditioner, a vehicle window and vehicle-mounted multimedia so as to relieve the fatigue driving degree of a driver; under the takeover mode, the vehicle machine system controls the intelligent navigation system and the ADAS to navigate to the nearest rest area or the rest area designated by the driver.
In some embodiments of the invention, in the refreshing mode, the vehicle-mounted air conditioner system controls the target temperature of the vehicle-mounted air conditioner to be a preset temperature, the air volume gear is a preset gear, the air outlet mode is a face blowing mode, and the circulation mode is internal circulation;
in the refreshing mode, the car machine system controls the opening proportion of the car window according to the car speed;
under the mode of refreshing, the car machine system controls the multimedia to increase the music playing volume.
In this embodiment, when the fatigue driving level is three levels, a three-level control command may be first sent to the intelligent hardware system, and the intelligent hardware system triggers the vehicle seat belt vibration, steering wheel vibration and/or seat massage according to the command, and at least one of the seat belt, steering wheel and seat may be simultaneously activated in combination with the vehicle configuration.
After a period of time, for example, 30 seconds, a tertiary control command is sent to the vehicle machine system. The vehicle-mounted system can inquire whether a driver starts a refreshing mode or a taking-over mode or not through an intelligent voice system, and/or display the refreshing mode or the taking-over mode through a display screen. The driver can select one of the modes by voice or a display screen. If the driver does not make a selection within a certain period of time, for example, within 30s, the refreshment mode may be automatically entered.
triggering a precondition: and a third-level control instruction and the air conditioner are in a non-front defrosting state.
a) The refreshing mode is started:
and the check mark display screen displays the turn-on refreshing mode. The driver can select 'cancel' on the display screen to cancel the refreshing mode;
the sound prompt "detects your fatigue, i.e. will turn on the refreshment mode for your.
b) Refreshing mode execution:
v-shaped vehicle-mounted air conditioner
i. The air conditioner sets the target temperature to be the preset temperature. Wherein the preset temperature may be a lower temperature, for example, 18 degrees;
the air volume gear is changed into a preset gear, for example, the gear can be 3;
iii, switching the air outlet mode to the face blowing mode; the circulation mode is switched to inner circulation;
v-shaped vehicle window
i. The window state:
only be in safe state, just control the door window, otherwise, under the mode of refreshing, do not control the door window.
When the vehicle speed is not greater than the first preset vehicle speed, the safe state can be determined.
Further, when the vehicle speed is not greater than the first preset vehicle speed and no user calls in the vehicle, the safety state can be determined.
Further, when the speed of a motor vehicle is not more than a first preset speed of a motor vehicle, and no user is making a call in the motor vehicle, and the anti-pinch function of the window of the motor vehicle is opened, the motor vehicle can be identified as a safe state.
If the current window is in the non-closing state, the window can not be controlled, and the non-closing state is continuously kept.
in a safe state:
if the second preset vehicle speed <, which is the vehicle speed < the third preset vehicle speed, the vehicle window is completely opened, namely the whole vehicle window is completely opened;
if the third preset vehicle speed < ═ first preset vehicle speed, the window is opened 1/2, namely the whole window is opened half and half.
The first preset vehicle speed can be 90km/h, the second preset vehicle speed can be 30km/h, and the third preset vehicle speed can be 60 km/h.
Abnormal weather:
if the weather of the area where the user is located is sand raising, floating dust, sand storm and strong sand storm, the vehicle window is not opened;
when the door window has been opened, if discerning rainy, pronunciation or display screen suggestion: "if it is rained, remember to close the window";
when the refreshing mode is closed, if the car window is not closed, the car window is closed;
user autonomic adjustment: if the user adjusts the car window in the process of controlling the car window in the refreshing mode, the voice or the display screen prompts that the refreshing car window is relieved, and the car window is not closed after 3 minutes;
vehicle-mounted multimedia
i. If the music is started in the car, the volume tone of the music being played is increased;
if the music is not started in the car, the strategy is not executed;
special case iii:
if the user selects to close the music and pause the music in the music playing volume adjusting process, the voice or the display screen prompts: "refreshing music has been released".
c) Turning off a refreshing mode:
the vehicle window and the air conditioner are closed after being opened for a period of time, for example, after 3 minutes, if the user operates the vehicle window to be fully opened or operates the window to be one half of the full window halfway, the vehicle window is not closed any more when the refreshing mode is closed, but the voice or the display screen normally reminds that: "will turn off the refreshment mode for you".
V. music: and if the user is still in the second-level/third-level fatigue state and the volume of the user is not adjusted, continuing to play the music until the user operates or the fatigue state is first-level or not fatigue.
triggering a precondition: a third-level control instruction and a user actively select a takeover mode;
a) starting a take-over mode:
the method comprises the following steps: actively inquiring 'please say your rest place, not more than 30 kilometers', if the address is more than 30 kilometers, confirming with the user; during the navigation task execution, performing active voice interaction according to the navigation strategy;
navigation, namely actively starting a navigation mode and carrying out next-step service for the user according to the address input by the user;
if the navigation distance is less than 30km, the user task is normally executed;
when the navigation distance is between 30km and 50km, actively inquiring a user and confirming an address, and if the user selects to execute, executing a user navigation task by the whole vehicle;
when the navigation distance is more than 50km, the user navigation task is not executed, the user is actively informed that the vehicle cannot execute the auxiliary driving function in the early warning mode due to long distance, and whether the vehicle exits the early warning mode of fatigue driving is actively inquired;
interface V: and actively prompting various types of bullet frames according to the navigation task during the execution of the navigation strategy.
b) Take over mode execution:
when the vehicle is detected to be driven at a high speed, starting a high-speed auxiliary driving function, and navigating to the nearest service area;
and when the vehicle is detected to run on the ordinary road, starting a low-speed auxiliary driving combination function and navigating to the rest area selected by the user.
c) Take over mode off:
In the embodiment of the invention, the fatigue driving grade is divided into three grades, and the fatigue driving degree is gradually increased from one grade to three grades. For example, one level may indicate light fatigue, two levels may indicate medium fatigue, and three levels may indicate heavy fatigue. In practical applications, the fatigue driving level may be divided according to actual requirements, for example, the fatigue driving level may be divided into two levels, four levels, five levels, and the like, which is not limited herein.
As can be seen from the above description, the embodiment of the present invention classifies the fatigue driving degree of the driver, and adopts different early warning schemes for different grades of fatigue driving. When the fatigue driving grade is the first grade, executing an early warning scheme based on hearing and vision, when the fatigue driving grade is the second grade, executing an early warning scheme based on hearing, vision and smell, when the fatigue driving grade is the third grade, executing an early warning scheme based on hearing, vision and touch, and along with the increase of the fatigue driving degree, adopting a more proper early warning scheme, achieving a better early warning effect and reducing potential safety hazards brought by fatigue driving.
The embodiment of the invention considers the omnibearing requirements of a driver and passengers in a vehicle, adopts an upgrading perception and active interaction strategy from the perspective of user experience, follows the principles of experience energy use, easy use and good use, flexibly reminds the driver to warn fatigue and intelligently take over, the interface is seen and obtained, the triggering mechanism corresponds to the early warning result, the scheme can finally solve the fundamental problem of fatigue driving, and the driver navigates to the nearest rest area according to the development stage of automatic driving to carry out sufficient sleep.
It should be understood that, the sequence numbers of the steps in the foregoing embodiments do not imply an execution sequence, and the execution sequence of each process should be determined by its function and inherent logic, and should not constitute any limitation to the implementation process of the embodiments of the present invention.
The following are embodiments of the apparatus of the invention, reference being made to the corresponding method embodiments described above for details which are not described in detail therein.
Fig. 4 is a schematic structural diagram of a fatigue driving warning device according to an embodiment of the present invention, and for convenience of description, only the parts related to the embodiment of the present invention are shown, which are detailed as follows:
as shown in fig. 4, the fatigue driving warning apparatus 30 includes: a fatigue driving level determination module 31, a first warning module 32, a second warning module 33 and a third warning module 34.
A fatigue driving level determination module 31 for determining a fatigue driving level of the driver;
a first warning module 32, configured to execute a warning scheme based on hearing and vision if the fatigue driving level is one level;
the second early warning module 33 is used for executing an early warning scheme based on hearing, vision and smell if the fatigue driving grade is two-level;
a third warning module 34, configured to execute a warning scheme based on hearing, vision, and touch if the fatigue driving level is three levels;
wherein, the fatigue driving degree of the first stage, the second stage and the third stage is gradually increased.
In one possible implementation, the third warning module 34 is further configured to:
sending a three-level control instruction to the vehicle machine system and the intelligent hardware system; the third-level control instruction is used for indicating the intelligent hardware system to control at least one of a safety belt, a steering wheel and a seat to perform early warning; the three-level control instruction is used for indicating the vehicle-mounted device system to prompt a driver whether to start a refreshing mode or a taking-over mode through voice and/or a display screen, and starting the refreshing mode or the taking-over mode based on the selection of the driver;
in the refreshing mode, the vehicle-mounted system controls a vehicle-mounted air conditioner, a vehicle window and vehicle-mounted multimedia so as to relieve the fatigue driving degree of a driver; under the takeover mode, the vehicle machine system controls the intelligent navigation system and the ADAS to navigate to the nearest rest area or the rest area designated by the driver.
In a possible implementation mode, in a refreshing mode, the vehicle-mounted air conditioner system controls the target temperature of the vehicle-mounted air conditioner to be a preset temperature, the air volume gear is a preset gear, the air outlet mode is a blowing mode, and the circulation mode is internal circulation;
in the refreshing mode, the car machine system controls the opening proportion of the car window according to the car speed;
under the mode of refreshing, the car machine system controls the multimedia to increase the music playing volume.
In a possible implementation manner, the second warning module 33 is further configured to:
sending a secondary control instruction to the vehicle machine system and the intelligent hardware system; the secondary control instruction is used for instructing the vehicle-mounted computer system to carry out dialogue with the driver by adopting sounds interested by the driver; and the secondary control instruction is used for indicating the intelligent hardware system to control the atmosphere lamp in the vehicle to carry out light reminding and controlling the vehicle-mounted fragrance equipment to start working.
In one possible implementation, the first warning module 32 may be further configured to:
sending a primary control instruction to the vehicle machine system and the intelligent hardware system; the primary control instruction is used for instructing the vehicle machine system to carry out voice reminding by adopting virtual images and sounds which are interested by a driver; the primary control instruction is used for indicating the intelligent hardware system to control the atmosphere lamp in the vehicle to carry out light reminding.
In one possible implementation, the fatigue driving level determination module 31 may be further configured to:
acquiring continuous multi-frame images of a driver shot in a preset time before the current time;
determining an eye area of each frame of image, and performing binarization processing on the eye area of the frame of image to obtain a histogram matrix of the eye area of the frame of image; calculating a first difference sum of a histogram matrix of an eye region of the frame of image and a predetermined eye-open state standard histogram matrix; calculating a second difference sum of a histogram matrix of the eye area of the frame of image and a predetermined standard histogram matrix of the eye closing state; if the first difference sum is smaller than the second difference sum, determining that the driver is in an eye opening state at the moment corresponding to the frame image, otherwise, determining that the driver is in an eye closing state at the moment corresponding to the frame image;
calculating a PERCLOS value and an average eye closing time length corresponding to the preset time length according to the eye state of the driver at each moment in the preset time length;
and if the PERCLOS value corresponding to the preset time length is greater than the preset threshold value, determining the fatigue driving grade of the driver according to the average eye-closing time length.
Fig. 5 is a schematic diagram of a terminal according to an embodiment of the present invention. As shown in fig. 5, the terminal 4 of this embodiment includes: a processor 40, a memory 41 and a computer program 42 stored in said memory 41 and executable on said processor 40. The processor 40 executes the computer program 42 to implement the steps in the above-mentioned embodiments of the method for warning fatigue driving, such as S201 to S204 shown in fig. 2. Alternatively, the processor 40, when executing the computer program 42, implements the functions of the modules/units in the above-mentioned device embodiments, such as the modules/units 31 to 34 shown in fig. 4.
Illustratively, the computer program 42 may be partitioned into one or more modules/units that are stored in the memory 41 and executed by the processor 40 to implement the present invention. The one or more modules/units may be a series of computer program instruction segments capable of performing specific functions, which are used to describe the execution of the computer program 42 in the terminal 4. For example, the computer program 42 may be divided into the modules/units 31 to 34 shown in fig. 4.
The terminal 4 may include, but is not limited to, a processor 40, a memory 41. Those skilled in the art will appreciate that fig. 5 is only an example of a terminal 4 and is not intended to be limiting of terminal 4, and may include more or fewer components than shown, or some components in combination, or different components, e.g., the terminal may also include input-output devices, network access devices, buses, etc.
The Processor 40 may be a Central Processing Unit (CPU), other general purpose Processor, a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), a Field Programmable Gate Array (FPGA) or other Programmable logic device, discrete Gate or transistor logic, discrete hardware components, etc. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like.
The memory 41 may be an internal storage unit of the terminal 4, such as a hard disk or a memory of the terminal 4. The memory 41 may also be an external storage device of the terminal 4, such as a plug-in hard disk, a Smart Media Card (SMC), a Secure Digital (SD) Card, a Flash memory Card (Flash Card) and the like provided on the terminal 4. Further, the memory 41 may also include both an internal storage unit and an external storage device of the terminal 4. The memory 41 is used for storing the computer program and other programs and data required by the terminal. The memory 41 may also be used to temporarily store data that has been output or is to be output.
Referring to fig. 1, an embodiment of the present invention further provides a fatigue driving early warning system, which includes a vehicle machine system 5, an intelligent hardware system 6, and the terminal 4;
and the terminal 4 is respectively connected with the vehicle machine system 5 and the intelligent hardware system 6.
For a detailed description of the fatigue driving warning system, reference may be made to the detailed description of the method/apparatus, and details are not repeated herein.
It will be apparent to those skilled in the art that, for convenience and brevity of description, only the above-mentioned division of the functional units and modules is illustrated, and in practical applications, the above-mentioned function distribution may be performed by different functional units and modules according to needs, that is, the internal structure of the apparatus is divided into different functional units or modules to perform all or part of the above-mentioned functions. Each functional unit and module in the embodiments may be integrated in one processing unit, or each unit may exist alone physically, or two or more units are integrated in one unit, and the integrated unit may be implemented in a form of hardware, or in a form of software functional unit. In addition, specific names of the functional units and modules are only for convenience of distinguishing from each other, and are not used for limiting the protection scope of the present application. The specific working processes of the units and modules in the system may refer to the corresponding processes in the foregoing method embodiments, and are not described herein again.
In the above embodiments, the descriptions of the respective embodiments have respective emphasis, and reference may be made to the related descriptions of other embodiments for parts that are not described or illustrated in a certain embodiment.
Those of ordinary skill in the art will appreciate that the various illustrative elements and algorithm steps described in connection with the embodiments disclosed herein may be implemented as electronic hardware or combinations of computer software and electronic hardware. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the implementation. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present invention.
In the embodiments provided in the present invention, it should be understood that the disclosed apparatus/terminal and method may be implemented in other ways. For example, the above-described apparatus/terminal embodiments are merely illustrative, and for example, the division of the modules or units is only one logical division, and there may be other divisions when actually implemented, for example, a plurality of units or components may be combined or may be integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, devices or units, and may be in an electrical, mechanical or other form.
The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.
In addition, functional units in the embodiments of the present invention may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit. The integrated unit can be realized in a form of hardware, and can also be realized in a form of a software functional unit.
The integrated modules/units, if implemented in the form of software functional units and sold or used as separate products, may be stored in a computer readable storage medium. Based on such understanding, all or part of the processes in the method according to the above embodiments may be implemented by a computer program, which may be stored in a computer readable storage medium, and when the computer program is executed by a processor, the computer program may implement the steps of the above embodiments of the fatigue driving warning method. Wherein the computer program comprises computer program code, which may be in the form of source code, object code, an executable file or some intermediate form, etc. The computer-readable medium may include: any entity or device capable of carrying the computer program code, recording medium, usb disk, removable hard disk, magnetic disk, optical disk, computer Memory, Read-Only Memory (ROM), Random Access Memory (RAM), electrical carrier wave signals, telecommunications signals, software distribution medium, and the like. It should be noted that the computer readable medium may contain suitable additions or subtractions depending on the requirements of legislation and patent practice in jurisdictions, for example, in some jurisdictions, computer readable media may not include electrical carrier signals or telecommunication signals in accordance with legislation and patent practice.
The above-mentioned embodiments are only used for illustrating the technical solutions of the present invention, and not for limiting the same; although the present invention has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some technical features may be equivalently replaced; such modifications and substitutions do not substantially depart from the spirit and scope of the embodiments of the present invention, and are intended to be included within the scope of the present invention.
Claims (10)
1. A fatigue driving early warning method is characterized by comprising the following steps:
determining a fatigue driving level of a driver;
if the fatigue driving grade is one grade, executing an early warning scheme based on hearing and vision;
if the fatigue driving grade is in the second grade, executing an early warning scheme based on hearing, vision and smell;
if the fatigue driving level is three levels, executing an early warning scheme based on auditory sense, visual sense and touch sense;
wherein the degree of fatigue driving of the first stage, the second stage, and the third stage is gradually increased.
2. The fatigue driving warning method according to claim 1, wherein the executing of the audible, visual and tactile based warning scheme comprises:
sending a three-level control instruction to the vehicle machine system and the intelligent hardware system; the third-level control instruction is used for instructing the intelligent hardware system to control at least one of a safety belt, a steering wheel and a seat to perform early warning; the three-level control instruction is used for indicating the vehicle-mounted device system to prompt a driver whether to start a refreshing mode or a taking-over mode through voice and/or a display screen, and starting the refreshing mode or the taking-over mode based on the selection of the driver;
in the refreshing mode, the vehicle-mounted system controls a vehicle-mounted air conditioner, a vehicle window and vehicle-mounted multimedia so as to relieve the fatigue driving degree of the driver; and under the takeover mode, the vehicle-mounted machine system controls the intelligent navigation system and the ADAS to navigate to the nearest rest area or the rest area appointed by the driver.
3. The fatigue driving early warning method according to claim 2, wherein in the refreshing mode, the vehicle-mounted air conditioner system controls a target temperature of the vehicle-mounted air conditioner to be a preset temperature, an air volume gear is a preset gear, an air outlet mode is a blowing mode, and a circulation mode is an inner circulation mode;
in the refreshing mode, the vehicle-mounted machine system controls the opening proportion of the vehicle window according to the vehicle speed;
and under the refreshing mode, the car machine system controls the multimedia to increase the music playing volume.
4. The fatigue driving warning method according to claim 1, wherein the performing an auditory, visual and olfactory based warning scheme comprises:
sending a secondary control instruction to the vehicle machine system and the intelligent hardware system; the secondary control instruction is used for instructing the vehicle-mounted machine system to carry out dialogue with a driver by adopting sounds which are interesting to the driver; and the secondary control instruction is used for indicating the intelligent hardware system to control the atmosphere lamp in the vehicle to carry out light reminding and control the vehicle-mounted fragrance equipment to start working.
5. The method of claim 1, wherein the performing an audible and visual based warning scheme comprises:
sending a primary control instruction to the vehicle machine system and the intelligent hardware system; the primary control instruction is used for instructing the vehicle-mounted machine system to carry out voice reminding by adopting virtual images and sounds which are interesting to a driver; and the primary control instruction is used for indicating the intelligent hardware system to control the atmosphere lamp in the vehicle to carry out light reminding.
6. The fatigue driving warning method according to any one of claims 1 to 5, wherein the determining the fatigue driving level of the driver includes:
acquiring continuous multi-frame images of a driver shot in a preset time before the current time;
determining an eye area of each frame of image, and performing binarization processing on the eye area of the frame of image to obtain a histogram matrix of the eye area of the frame of image; calculating a first difference sum of a histogram matrix of an eye region of the frame of image and a predetermined eye-open state standard histogram matrix; calculating a second difference sum of a histogram matrix of the eye area of the frame of image and a predetermined standard histogram matrix of the eye closing state; if the first difference sum is smaller than the second difference sum, determining that the driver is in an eye opening state at the moment corresponding to the frame image, otherwise, determining that the driver is in an eye closing state at the moment corresponding to the frame image;
calculating a PERCLOS value and an average eye closing time length corresponding to the preset time length according to the eye state of the driver at each moment in the preset time length;
and if the PERCLOS value corresponding to the preset time length is greater than a preset threshold value, determining the fatigue driving grade of the driver according to the average eye-closing time length.
7. A fatigue driving warning device, comprising:
the fatigue driving grade determining module is used for determining the fatigue driving grade of a driver;
the first early warning module is used for executing an early warning scheme based on hearing sense and vision if the fatigue driving grade is one grade;
the second early warning module is used for executing an early warning scheme based on hearing, vision and smell if the fatigue driving grade is in a second level;
the third early warning module is used for executing an early warning scheme based on auditory sense, visual sense and touch sense if the fatigue driving grade is three grades;
wherein the degree of fatigue driving of the first stage, the second stage, and the third stage is gradually increased.
8. A terminal comprising a memory, a processor and a computer program stored in the memory and executable on the processor, wherein the processor when executing the computer program implements the steps of the fatigue driving warning method according to any one of claims 1 to 6.
9. A fatigue driving early warning system is characterized by comprising a vehicle machine system, an intelligent hardware system and the terminal as claimed in claim 8;
and the terminal is respectively connected with the vehicle machine system and the intelligent hardware system.
10. A computer-readable storage medium, in which a computer program is stored, which, when being executed by a processor, carries out the steps of the fatigue driving warning method according to any one of claims 1 to 6 above.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110785650.1A CN114821966A (en) | 2021-07-12 | 2021-07-12 | Fatigue driving early warning method, device, terminal and fatigue driving early warning system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110785650.1A CN114821966A (en) | 2021-07-12 | 2021-07-12 | Fatigue driving early warning method, device, terminal and fatigue driving early warning system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN114821966A true CN114821966A (en) | 2022-07-29 |
Family
ID=82525788
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110785650.1A Pending CN114821966A (en) | 2021-07-12 | 2021-07-12 | Fatigue driving early warning method, device, terminal and fatigue driving early warning system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114821966A (en) |
Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105243790A (en) * | 2015-11-13 | 2016-01-13 | 清华大学苏州汽车研究院（吴江） | Safety belt vibration fatigue early-warning system based on wireless communication |
| CN108798351A (en) * | 2018-05-29 | 2018-11-13 | 重庆海德世拉索系统（集团）有限公司 | Automotive window speed control circuit and method |
| CN109435959A (en) * | 2018-10-24 | 2019-03-08 | 斑马网络技术有限公司 | Fatigue driving processing method, vehicle, storage medium and electronic equipment |
| CN110319545A (en) * | 2019-07-04 | 2019-10-11 | 珠海格力电器股份有限公司 | Environment management method and device and air conditioner |
| CN111391858A (en) * | 2020-02-18 | 2020-07-10 | 吉利汽车研究院（宁波）有限公司 | Intelligent cabin system control method and system and automobile |
| CN111583609A (en) * | 2020-04-20 | 2020-08-25 | 惠州市德赛西威智能交通技术研究院有限公司 | Differential setting method for early warning strategy |
| US20200308895A1 (en) * | 2019-03-25 | 2020-10-01 | Honda Motor Co., Ltd. | Agent device, agent device control method, and storage medium |
| CN111762094A (en) * | 2019-04-02 | 2020-10-13 | 上海博泰悦臻网络技术服务有限公司 | Vehicle safety control method, vehicle machine and vehicle |
| CN111783687A (en) * | 2020-07-03 | 2020-10-16 | 佛山市海协科技有限公司 | Teaching live broadcast method based on artificial intelligence |
-
2021
- 2021-07-12 CN CN202110785650.1A patent/CN114821966A/en active Pending
Patent Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105243790A (en) * | 2015-11-13 | 2016-01-13 | 清华大学苏州汽车研究院（吴江） | Safety belt vibration fatigue early-warning system based on wireless communication |
| CN108798351A (en) * | 2018-05-29 | 2018-11-13 | 重庆海德世拉索系统（集团）有限公司 | Automotive window speed control circuit and method |
| CN109435959A (en) * | 2018-10-24 | 2019-03-08 | 斑马网络技术有限公司 | Fatigue driving processing method, vehicle, storage medium and electronic equipment |
| US20200308895A1 (en) * | 2019-03-25 | 2020-10-01 | Honda Motor Co., Ltd. | Agent device, agent device control method, and storage medium |
| CN111762094A (en) * | 2019-04-02 | 2020-10-13 | 上海博泰悦臻网络技术服务有限公司 | Vehicle safety control method, vehicle machine and vehicle |
| CN110319545A (en) * | 2019-07-04 | 2019-10-11 | 珠海格力电器股份有限公司 | Environment management method and device and air conditioner |
| CN111391858A (en) * | 2020-02-18 | 2020-07-10 | 吉利汽车研究院（宁波）有限公司 | Intelligent cabin system control method and system and automobile |
| CN111583609A (en) * | 2020-04-20 | 2020-08-25 | 惠州市德赛西威智能交通技术研究院有限公司 | Differential setting method for early warning strategy |
| CN111783687A (en) * | 2020-07-03 | 2020-10-16 | 佛山市海协科技有限公司 | Teaching live broadcast method based on artificial intelligence |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108688677B (en) | Vehicle driving support system and vehicle driving support method | |
| CN108216264B (en) | Information providing system for vehicle and method for providing information for vehicle | |
| CN108688676B (en) | Vehicle driving support system and vehicle driving support method | |
| JP4572889B2 (en) | Automotive user hospitality system | |
| JP4332813B2 (en) | Automotive user hospitality system | |
| CN110390932A (en) | Method of speech processing and its equipment based on recognition of face | |
| CN108688675B (en) | Vehicle driving support system | |
| GB2486943A (en) | Driver assistance system with fatigue ascertainment devices | |
| DE102018001365A1 (en) | Vehicle driving assistance system, method for operating a vehicle driving assistance system and computer program product | |
| CN114445888A (en) | Vehicle-mounted interaction system based on emotion perception and voice interaction | |
| CN114132328B (en) | Auxiliary driving system and method for automatically adjusting driving environment and storage medium | |
| CN112041201B (en) | Method, system, and medium for controlling access to vehicle features | |
| JP6958982B2 (en) | Electronic devices with awakening function, awakening programs and awakening methods | |
| CN114261335A (en) | Warning sound control method and related equipment | |
| CN113771859A (en) | Intelligent driving intervention method, device and equipment and computer readable storage medium | |
| CN118205507A (en) | Method, apparatus, related device and computer program product for assisting sleep of vehicle-mounted passenger | |
| CN115195637A (en) | Intelligent cabin system based on multimode interaction and virtual reality technology | |
| CN112437246B (en) | Video conference method based on intelligent cabin and intelligent cabin | |
| WO2023138563A1 (en) | Volume adjustment method and apparatus, and automobile | |
| CN212579832U (en) | Man-machine interaction system for vehicle driving safety and vehicle | |
| CN114821966A (en) | Fatigue driving early warning method, device, terminal and fatigue driving early warning system | |
| CN115520205A (en) | Method, system and device for adjusting voice interaction based on driving state | |
| CN107031494A (en) | Vehicle front lighting lamp control method based on voice recognition | |
| CN116001707A (en) | Control method and device for vehicle equipment, electronic equipment and storage medium | |
| CN110944149A (en) | Child care system and method for vehicle |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |