CN114132330A

CN114132330A - Method and device for reminding driver of abnormal driving state

Info

Publication number: CN114132330A
Application number: CN202111552703.1A
Authority: CN
Inventors: 白彦梅; 高洁
Original assignee: Chery New Energy Automobile Co Ltd
Current assignee: Chery New Energy Automobile Co Ltd
Priority date: 2021-12-17
Filing date: 2021-12-17
Publication date: 2022-03-04

Abstract

The application relates to a method and a device for reminding a driver of an abnormal driving state, wherein the method comprises the following steps: collecting current facial information of a driver, and detecting an operation relation between a steering wheel and the driver; judging whether the driver is in an abnormal driving state or not according to the current face information and the operation relation; and when the driver is in an abnormal driving state, controlling at least one visual reminding device, at least one auditory reminding device, at least one tactile reminding device and at least one olfactory reminding device of the automobile to carry out multi-dimensional danger reminding on the driver. Therefore, the technical problems that the accuracy of monitoring the driving state of the driver is low, the reminding mode of the driver is single, the effect is poor and the like in the related technology are solved.

Description

Method and device for reminding driver of abnormal driving state

Technical Field

The application relates to the technical field of vehicle safety, in particular to a method and a device for reminding a driver of an abnormal driving state.

Background

At present, intelligent functions such as intelligent driving, intelligent cabins and the like are released by various large vehicle enterprises and industry-related part companies. With the popularization of automobiles, on one hand, traffic conditions become more and more complicated, and on the other hand, drivers are also in situations of inattention or fatigue driving during driving, so that the drivers are difficult to deal with the complicated traffic conditions in such a state, and traffic accidents are easily caused, and therefore, monitoring of the driving states of the drivers is particularly important.

Among the correlation technique, the electric automobile who carries the driving state monitoring function, the driving state that can only be through gathering driver's face and eyes information monitors the driver, it is not accurate enough to the state monitoring of driver, easily cause the erroneous judgement, and when the driving state monitoring function monitors that the driver is in improper driving state, subsequent warning, the measure of handling is mostly pronunciation or buzzer warning, the effect is single, and can't deal with emergency, need to improve urgently.

Content of application

The application provides a method and a device for reminding a driver of an abnormal driving state, which are used for solving the problems that the accuracy of monitoring the driving state of the driver is low, the reminding mode of the driver is single, the effect is poor and the like in the related art.

An embodiment of a first aspect of the present application provides a method for reminding a driver of an abnormal driving state, including the following steps: acquiring current facial information of a driver, and detecting an operation relation between a steering wheel and the driver; judging whether the driver is in an abnormal driving state or not according to the current facial information and the operation relation; and when the driver is in the abnormal driving state, controlling at least one visual reminding device, at least one auditory reminding device, at least one tactile reminding device and at least one olfactory reminding device of the automobile to carry out multidimensional danger reminding on the driver.

Optionally, in an embodiment of the present application, the controlling at least one visual reminding device, at least one auditory reminding device, at least one tactile reminding device, and at least one olfactory reminding device of the automobile to perform a multidimensional danger reminder for the driver includes: controlling the vehicle-mounted instrument to display a danger mark; controlling a vehicle-mounted large screen to display danger reminding; controlling the vehicle-mounted air conditioner to enter a danger reminding mode; controlling a vehicle-mounted fragrance system to emit reminding odor; controlling the vehicle seat to execute a reminding action; and controlling the vehicle safety belt to execute tightening reminding action.

Optionally, in an embodiment of the present application, the method further includes: identifying the current danger level corresponding to the abnormal driving state according to the front information and the operation relation; and determining a target reminding parameter of each device according to the current danger level.

Optionally, in an embodiment of the present application, the method further includes: acquiring the current position of the automobile; generating navigation information or a driving planning path according to the current position and the rest area with the nearest distance; pushing the navigation information to the driver, and/or controlling the automobile to drive to the rest area along the driving planning path.

Optionally, in an embodiment of the present application, the method further includes: acquiring the duration of multidimensional danger reminding of the driver; when the duration is longer than the preset duration and the driver is still detected to be in the abnormal driving state, the automobile is controlled to decelerate according to a preset deceleration strategy until the automobile stops running, and warning and reminding light of the automobile is turned on.

Optionally, in an embodiment of the present application, the detecting an operational relationship between the steering wheel and the driver includes: collecting a current image of the steering wheel; and extracting at least one relation feature according to the current image, and determining the operation relation according to the at least one relation feature.

An embodiment of a second aspect of the present application provides a device for reminding a driver of an abnormal driving state, including: the system comprises an acquisition module, a display module and a display module, wherein the acquisition module is used for acquiring the current facial information of a driver and detecting the operation relationship between a steering wheel and the driver; the judging module is used for judging whether the driver is in an abnormal driving state or not according to the current facial information and the operation relation; and the reminding module is used for controlling at least one visual reminding device, at least one auditory reminding device, at least one touch reminding device and at least one olfactory reminding device of the automobile to carry out multi-dimensional danger reminding on the driver when the driver is in the abnormal driving state.

An embodiment of a third aspect of the present application provides a vehicle, comprising: the warning device comprises a memory, a processor and a computer program which is stored on the memory and can run on the processor, wherein the processor executes the program to realize the warning method for the abnormal driving state of the driver according to the embodiment.

A fourth aspect of the present application provides a computer-readable storage medium, on which a computer program is stored, the program being executed by a processor for implementing the method for reminding a driver of an abnormal driving state according to any one of claims 1 to 7.

The embodiment of the application has the advantages that the judgment on the relation between the driver and the steering wheel is increased, so that the judgment on the current driving state of the driver is more accurate, the multi-dimensional reminding mode is adopted after the driver is monitored to be in the abnormal driving state, the dangerous reminding effect is improved, the driver can be helped to leave the abnormal driving state quickly, and the driving safety is improved. Therefore, the problems that the accuracy of monitoring the driving state of the driver is low, the reminding mode of the driver is single, the effect is poor and the like in the related technology are solved.

Additional aspects and advantages of the present application will be set forth in part in the description which follows and, in part, will be obvious from the description, or may be learned by practice of the present application.

Drawings

The foregoing and/or additional aspects and advantages of the present application will become apparent and readily appreciated from the following description of the embodiments, taken in conjunction with the accompanying drawings of which:

fig. 1 is a flowchart of a method for reminding a driver of an abnormal driving state according to an embodiment of the present application;

FIG. 2 is a schematic diagram illustrating a method for reminding a driver of an abnormal driving state according to an embodiment of the present application;

FIG. 3 is a schematic block diagram of a device for reminding a driver of an abnormal driving state according to an embodiment of the present application;

FIG. 4 is a schematic view of a vehicle according to an embodiment of the present application.

Detailed Description

Reference will now be made in detail to embodiments of the present application, examples of which are illustrated in the accompanying drawings, wherein like or similar reference numerals refer to the same or similar elements or elements having the same or similar function throughout. The embodiments described below with reference to the drawings are exemplary and intended to be used for explaining the present application and should not be construed as limiting the present application.

The following describes a method and an apparatus for reminding a driver of an abnormal driving state according to an embodiment of the present application with reference to the accompanying drawings. In the method, judgment of the current driving state of the driver is more accurate by increasing judgment of the relation between the driver and a steering wheel, and after the driver is monitored to be in the abnormal driving state, a multidimensional reminding mode is adopted, so that the danger reminding effect is improved, the driver is helped to leave the abnormal driving state quickly, and the driving safety is improved. Therefore, the problems that the accuracy of monitoring the driving state of the driver is low, the reminding mode of the driver is single, the effect is poor and the like in the related technology are solved.

Specifically, fig. 1 is a schematic flow chart of a method for reminding a driver of an abnormal driving state according to an embodiment of the present application.

As shown in fig. 1, the method for reminding the driver of the abnormal driving state includes the following steps:

in step S101, current face information of the driver is acquired, and an operation relationship between the steering wheel and the driver is detected.

In some embodiments, a speed value may be preset, and when the vehicle is started and the vehicle speed is greater than the preset value, the vehicle is defaulted to be in a driving state at this time, and in this state, the in-vehicle monitoring camera may collect image information of the face, eyes and a steering wheel of the driver in real time, for example, the face orientation, the eyes open and close state, whether both hands are on the steering wheel, and the like of the driver at this time. In the actual driving process, part of information acquired by the driver from the face and the eyes indicates that the driver is in a normal driving state, but both hands may leave the steering wheel due to article searching, console key adjustment and the like, so that traffic accidents are caused, therefore, the detection of the operation relationship between the steering wheel and the driver is necessary, the information acquisition is carried out on the current driving state of the driver in multiple aspects, the accuracy of information acquisition is improved, and the driving safety of the vehicle is improved.

It should be noted that the preset speed value may be set by a person skilled in the art according to actual situations, and is not limited in particular here.

Optionally, in an embodiment of the present application, detecting an operational relationship between the steering wheel and the driver includes: collecting a current image of a steering wheel; and extracting at least one relation feature according to the current image, and determining an operation relation according to the at least one relation feature.

Specifically, in the embodiment of the application, the current image of the steering wheel is acquired, the positions of the two hands of the driver and the state of the steering wheel in the image are determined according to skin color analysis, and the relationship between the two hands of the driver and the steering wheel is obtained from the image analysis result, for example, whether the driver drives with two hands or with one hand currently, the driver rotates the steering wheel to perform steering operation, the driver adjusts the control keys of the steering wheel, or the two hands of the driver leave the steering wheel, and the like. Through image acquisition, the driving state of the driver can be further determined, and the accuracy of judging the driving state of the driver is improved.

Optionally, in an embodiment of the present application, detecting an operational relationship between the steering wheel and the driver includes: detecting the current force applied to the steering wheel; and matching the operation relation according to the current stress.

It can be understood that, when the driver operates the steering wheel, the steering wheel can be pressed from above and the torque force around the bearing, and according to the current stress condition of the steering wheel, the current state of the driver operating the steering wheel can be judged, so that the operation relation between the driver and the steering wheel can be more accurately obtained, and the current driving state of the driver can be further obtained.

In step S102, it is determined whether the driver is in an abnormal driving state based on the current face information and the operation relationship.

As will be understood by those skilled in the art, the abnormal driving state may be driver inattention, fatigue driving, sudden illness, etc., and unlike the normal driving of the driver, the abnormal driving state is likely to cause a traffic accident, and the current driving state of the driver may be determined by the facial information and the operational relationship of the driver. For example, when the system analyzes that the face of the driver is facing beyond a specified range within a preset time or both hands are completely separated from the steering wheel within the preset time, it is determined that the driver is not attentive. For another example, whether the driver is tired or not may be determined by acquiring blink frequency in the face information of the driver in real time or whether the eyes of the driver are in a continuous closed state within a preset time, it may be understood that, according to statistics, a normal person needs to blink ten times per minute on average, the frequency is usually 2 to 6 seconds, and each blink needs 0.2 to 0.4 seconds, when the attention of the person is relatively concentrated, the blink frequency may be reduced to 4 to 5 times per minute, and after the person is tired, the blink frequency is often accelerated, and the time spent by each blink is correspondingly lengthened, so that the fatigue state of the driver may be obtained by comparing the detected blink frequency with the database.

It should be noted that the preset time may be set by a person skilled in the art according to an actual situation, the database may be downloaded from a cloud, or the preset time may be set by a person skilled in the art offline, which is not limited herein.

In step S103, when the driver is in an abnormal driving state, controlling at least one visual reminding device, at least one auditory reminding device, at least one tactile reminding device, and at least one olfactory reminding device of the automobile to perform multidimensional danger reminding for the driver.

When judging that the driver is in the abnormal driving state according to the facial information and the operation relation, the embodiment of the application can transmit the abnormal driving state signal to each reminding device, and each reminding device is matched for reminding, wherein the reminding devices include but are not limited to: visual reminding device, auditory reminding device, tactile reminding device and smell reminding device. Carry out danger through the multidimension degree to the driver and remind, can effectively reduce the effect uncertainty that the single mode was reminded, reduce the traffic accident quantity that the driver leads to because of the inattention or fatigue driving, improve driver's driving experience.

Optionally, in an embodiment of the present application, controlling at least one visual reminder, at least one audible reminder, at least one tactile reminder, at least one olfactory reminder of a vehicle to perform a multidimensional hazard reminder for a driver includes: controlling the vehicle-mounted instrument to display a danger mark; controlling a vehicle-mounted large screen to display danger reminding; controlling the vehicle-mounted air conditioner to enter a danger reminding mode; controlling a vehicle-mounted fragrance system to emit reminding odor; controlling the vehicle seat to execute a reminding action; and controlling the vehicle safety belt to execute tightening reminding action.

In a specific embodiment of the present application, the multidimensional danger alert may include: the instrument sends corresponding characters and alarm sound and reminds, dangerous warning is shown to on-vehicle big screen display, the extrinsic cycle mode is opened to the air conditioner, the relevance of fragrance circulation system is opened, the seat, the safety belt, the steering wheel and the wearing equipment that matches with the vehicle produce vibrations and remind, carry out dangerous warning to the driver through multiple dimensions such as vision, sense of hearing, sense of touch, sense of smell and environmental change, realize more efficient dangerous warning effect, and after short-term warning, opening of lasting fragrance circulation system and air conditioner extrinsic cycle mode helps helping the driver to maintain normal driving state.

Optionally, in an embodiment of the present application, the method further includes: identifying the current danger level corresponding to the abnormal driving state according to the front face information and the operation relation; and determining target reminding parameters of each device according to the current danger level.

Specifically, for the danger levels of different abnormal driving states, the parameter settings of each reminding device should be adjusted accordingly, for example, low-frequency reminding is difficult to wake up a driver in a severe fatigue state, so that it is necessary to classify the abnormal driving state of the driver into danger levels according to the acquired facial information and operational relationship of the driver, for example, the time duration for the driver to turn to an abnormal position, or blink frequency, or eye-closing time, and the like, and such classification can be adjusted according to different specific actual situations, and is not limited specifically herein. Aiming at different danger levels, parameters of corresponding reminding devices, such as the color and the flashing frequency of a warning icon, the size and the frequency of reminding volume, the vibration amplitude and the duration of cabin equipment and the like, are all subjected to adaptive adjustment, so that a driver can be ensured to recover to a normal driving state in a short time.

Optionally, in an embodiment of the present application, the method further includes: acquiring the current position of the automobile; generating navigation information or a driving planning path according to the current position and the rest area with the nearest distance; and pushing navigation information to a driver, and/or controlling the automobile to drive to a rest area along a driving planning path.

It can be understood that the abnormal driving state of the driver can be relieved in a short time, but the driver who is separated from the abnormal driving state can more easily enter the abnormal driving state than the driver who is continuously in the normal driving state, and aiming at the phenomenon, the embodiment of the application can plan the route according to the current position and advise the driver to drive to the nearest rest area for rest, when the fatigue degree of the driver is too heavy, the vehicle can be controlled to automatically drive to the nearest rest area, so that the driving safety of the driver is ensured, and the driver is prevented from entering the vicious circle of fatigue, reminding and relighting.

Optionally, in an embodiment of the present application, the method further includes: acquiring the duration of multidimensional danger reminding of a driver; when the duration is longer than the preset duration and the driver is still detected to be in an abnormal driving state, the automobile is controlled to decelerate by a preset deceleration strategy until the automobile stops driving, and warning and reminding light of the automobile is turned on.

As a possible implementation mode, the embodiment of the application records the duration of the multidimensional danger prompt, the multidimensional danger prompt is started when the condition that the driver is in an abnormal driving state is detected, and is closed after the condition that the driver is separated from the abnormal driving state is detected, and when the duration of the multidimensional danger prompt exceeds the duration preset to help the driver to separate from the abnormal driving state, the embodiment of the application follows a preset deceleration strategy to control the automobile to decelerate until the automobile stops driving, and the warning prompt light of the automobile is turned on to avoid the collision between the rear automobile and the automobile, so that other people can conveniently and timely rescue the driver.

Hereinafter, a specific embodiment of the present application will be described in detail with reference to fig. 2.

As shown in fig. 2, a specific embodiment of the present application includes the following steps:

step S201: whether the vehicle is in a running state is detected.

Step S202: when the vehicle is in the driving state, gather driver face, eyes and steering wheel image in real time, this detection includes: whether the face orientation of the driver is out of a specified range within a certain time, whether the hands of the driver are separated from the steering wheel within a certain time, and whether the eyes of the driver are in a continuous closing state within a certain time. Through the acquisition of facial information and the operation relation between the driver and the steering wheel, the current driving state of the driver can be judged more accurately, the possibility of misjudgment is reduced, the driving safety of the vehicle is improved, and excellent driving experience is provided for the driver. The time range may be set by a person skilled in the art within a certain time, and is not limited herein.

Step S203: when the face orientation of the driver does not exceed the specified range within a certain time, the step S202 is continued, and when the face orientation of the driver exceeds the specified range within a certain time, the driver inattention signal is judged and sent, and each device in the vehicle performs multidimensional danger reminding on the driver, wherein the steps include: instrument text, alarm sound prompt; vibrating a steering wheel; the seat shakes; the safety belt vibrates; wearing equipment vibrations, when reminding, generating driving behavior analysis record, the help driver carries out follow-up bad driving behavior and corrects.

It can be understood that, during the driving process of the vehicle, the driver needs to always visually observe the front, and during the actual driving process, the driver may need to observe the surrounding environment and the indication board, so that the face orientation deviation is generated, and therefore, only when the face of the driver deviates beyond a certain range of angles for a long time, the driver can be determined to be in the state of inattention at the moment. When the driver is in the state of inattentive attention, the driver needs to be reminded through multiple dimensions such as vision, hearing and touch at the moment, so that the driver can be ensured to concentrate attention as soon as possible, and the driving safety of the vehicle is further ensured.

Step S204: when the driver 'S both hands do not break away from the steering wheel in a certain time, then continue to carry out step S202, when the driver' S both hands break away from the steering wheel in a certain time, then judge and send driver attention not concentrated signal, each equipment carries out the dangerous warning of multidimension degree to the driver in the car, wherein includes: instrument text, alarm sound prompt; vibrating a steering wheel; the seat shakes; the safety belt vibrates; wearing equipment vibrations, when reminding, generating driving behavior analysis record, the help driver carries out follow-up bad driving behavior and corrects.

In general, the fact that the driver's hands are separated from the steering wheel means that the driver's hands are performing operations other than driving, in this case, the driver's attention is attracted by the actions of the driver's hands, and thus the driver is in an inattentive state at this time, and in this state, the driver cannot deal with sudden road conditions at the first time, and traffic accidents are easily caused.

Step S205: when the eyes of the driver are not in the continuous closed state within a certain time, the step S202 is continued, when the eyes of the driver are in the continuous closed state within a certain time, a fatigue driving signal of the driver is judged and sent, and each device in the vehicle performs multi-dimensional danger reminding on the driver, wherein the method comprises the following steps: instrument text, alarm sound prompt; vibrating a steering wheel; the seat shakes; the safety belt vibrates; the wearable equipment vibrates; opening a fragrance system; the air conditioner starts the external circulation. And when reminding, the navigation recommends a rest area nearby to remind the driver to rest, and generates a driving behavior analysis record to help the driver to correct follow-up adverse driving behaviors.

Under the normal condition, the frequency that the driver blinks under the condition of being absorbed in can reduce to some extent, when driver's frequency of blinking improves or is in continuous closed state for a long time, can judge that the driver is in the tired driving state, tired driving can reduce driver's reaction rate, and then lead to the emergence of traffic accident, consequently need through the sense of hearing, the sense of touch, the vision, sense of smell and environment multidimension degree remind, and after the driver breaks away from the fatigue state, for it provides the regional information of rest, remind the driver to have a rest, guarantee driver's safe driving.

According to the reminding method for the abnormal driving state of the driver, the judgment on the current driving state of the driver is more accurate by increasing the judgment on the relation between the driver and the steering wheel, and after the driver is monitored to be in the abnormal driving state, a multi-dimensional reminding mode is adopted, so that the danger reminding effect is improved, the driver can be helped to leave the abnormal driving state quickly, and the driving safety is improved. Therefore, the problems that the accuracy of monitoring the driving state of the driver is low, the reminding mode of the driver is single, the effect is poor and the like in the related technology are solved.

Next, a description is given of a warning device for an abnormal driving state of a driver according to an embodiment of the present application with reference to the drawings.

Fig. 3 is a block diagram schematically illustrating a reminding device for an abnormal driving state of a driver according to an embodiment of the present application.

As shown in fig. 3, the warning device 10 for the abnormal driving state of the driver includes: the system comprises an acquisition module 100, a judgment module 200 and a reminding module 300.

The acquiring module 100 is configured to acquire current facial information of a driver, and detect an operation relationship between a steering wheel and the driver.

And the judging module 200 is used for judging whether the driver is in an abnormal driving state according to the current face information and the operation relation.

The reminding module 300 is configured to control at least one visual reminding device, at least one auditory reminding device, at least one tactile reminding device, and at least one olfactory reminding device of the automobile to perform multidimensional danger reminding on the driver when the driver is in an abnormal driving state.

It should be noted that the foregoing explanation of the embodiment of the method for reminding a driver of an abnormal driving state is also applicable to the reminding device of the abnormal driving state of the driver in this embodiment, and is not repeated here.

According to the reminding device for the abnormal driving state of the driver, the judgment on the relation between the driver and the steering wheel is increased, so that the judgment on the current driving state of the driver is more accurate, and after the driver is monitored to be in the abnormal driving state, a multi-dimensional reminding mode is adopted, the dangerous reminding effect is improved, the driver can be helped to leave the abnormal driving state quickly, and the driving safety is improved. Therefore, the problems that the accuracy of monitoring the driving state of the driver is low, the reminding mode of the driver is single, the effect is poor and the like in the related technology are solved.

Fig. 4 is a schematic structural diagram of a vehicle according to an embodiment of the present application. The vehicle may include:

memory 401, processor 402, and computer programs stored on memory 401 and executable on processor 402.

The processor 402 executes the program to implement the method for reminding the driver of the abnormal driving state provided in the above-described embodiment.

Further, the vehicle further includes:

a communication interface 403 for communication between the memory 401 and the processor 402.

A memory 401 for storing computer programs executable on the processor 402.

Memory 401 may comprise high-speed RAM memory, and may also include non-volatile memory (non-volatile memory), such as at least one disk memory.

If the memory 401, the processor 402 and the communication interface 403 are implemented independently, the communication interface 403, the memory 401 and the processor 402 may be connected to each other through a bus and perform communication with each other. The bus may be an Industry Standard Architecture (ISA) bus, a Peripheral Component Interconnect (PCI) bus, an Extended ISA (EISA) bus, or the like. The bus may be divided into an address bus, a data bus, a control bus, etc. For ease of illustration, only one thick line is shown in FIG. 4, but this does not indicate only one bus or one type of bus.

Optionally, in a specific implementation, if the memory 401, the processor 402, and the communication interface 403 are integrated on a chip, the memory 401, the processor 402, and the communication interface 403 may complete mutual communication through an internal interface.

The processor 402 may be a Central Processing Unit (CPU), an Application Specific Integrated Circuit (ASIC), or one or more Integrated circuits configured to implement embodiments of the present Application.

The present embodiment also provides a computer-readable storage medium on which a computer program is stored, which when executed by a processor, implements the above method for reminding a driver of an abnormal driving state.

In the description herein, reference to the description of the term "one embodiment," "some embodiments," "an example," "a specific example," or "some examples," etc., means that a particular feature, structure, material, or characteristic described in connection with the embodiment or example is included in at least one embodiment or example of the application. In this specification, the schematic representations of the terms used above are not necessarily intended to refer to the same embodiment or example. Furthermore, the particular features, structures, materials, or characteristics described may be combined in any suitable manner in any one or N embodiments or examples. Furthermore, various embodiments or examples and features of different embodiments or examples described in this specification can be combined and combined by one skilled in the art without contradiction.

Furthermore, the terms "first", "second" and "first" are used for descriptive purposes only and are not to be construed as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include at least one such feature. In the description of the present application, "N" means at least two, e.g., two, three, etc., unless specifically limited otherwise.

Any process or method descriptions in flow charts or otherwise described herein may be understood as representing modules, segments, or portions of code which include one or more N executable instructions for implementing steps of a custom logic function or process, and alternate implementations are included within the scope of the preferred embodiment of the present application in which functions may be executed out of order from that shown or discussed, including substantially concurrently or in reverse order, depending on the functionality involved, as would be understood by those reasonably skilled in the art of implementing the embodiments of the present application.

The logic and/or steps represented in the flowcharts or otherwise described herein, e.g., an ordered listing of executable instructions that can be considered to implement logical functions, can be embodied in any computer-readable medium for use by or in connection with an instruction execution system, apparatus, or device, such as a computer-based system, processor-containing system, or other system that can fetch the instructions from the instruction execution system, apparatus, or device and execute the instructions. For the purposes of this description, a "computer-readable medium" can be any means that can contain, store, communicate, propagate, or transport the program for use by or in connection with the instruction execution system, apparatus, or device. More specific examples (a non-exhaustive list) of the computer-readable medium would include the following: an electrical connection (electronic device) having one or N wires, a portable computer diskette (magnetic device), a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber device, and a portable compact disc read-only memory (CDROM). Additionally, the computer-readable medium could even be paper or another suitable medium upon which the program is printed, as the program can be electronically captured, via for instance optical scanning of the paper or other medium, then compiled, interpreted or otherwise processed in a suitable manner if necessary, and then stored in a computer memory.

It should be understood that portions of the present application may be implemented in hardware, software, firmware, or a combination thereof. In the above embodiments, the N steps or methods may be implemented in software or firmware stored in a memory and executed by a suitable instruction execution system. If implemented in hardware, as in another embodiment, any one or combination of the following techniques, which are known in the art, may be used: a discrete logic circuit having a logic gate circuit for implementing a logic function on a data signal, an application specific integrated circuit having an appropriate combinational logic gate circuit, a Programmable Gate Array (PGA), a Field Programmable Gate Array (FPGA), or the like.

It will be understood by those skilled in the art that all or part of the steps carried by the method for implementing the above embodiments may be implemented by hardware related to instructions of a program, which may be stored in a computer readable storage medium, and when the program is executed, the program includes one or a combination of the steps of the method embodiments.

In addition, functional units in the embodiments of the present application may be integrated into one processing module, or each unit may exist alone physically, or two or more units are integrated into one module. The integrated module can be realized in a hardware mode, and can also be realized in a software functional module mode. The integrated module, if implemented in the form of a software functional module and sold or used as a stand-alone product, may also be stored in a computer readable storage medium.

The storage medium mentioned above may be a read-only memory, a magnetic or optical disk, etc. Although embodiments of the present application have been shown and described above, it is understood that the above embodiments are exemplary and should not be construed as limiting the present application, and that variations, modifications, substitutions and alterations may be made to the above embodiments by those of ordinary skill in the art within the scope of the present application.

Claims

1. A method for reminding a driver of an abnormal driving state is characterized by comprising the following steps:

acquiring current facial information of a driver, and detecting an operation relation between a steering wheel and the driver;

judging whether the driver is in an abnormal driving state or not according to the current facial information and the operation relation; and

and when the driver is in the abnormal driving state, controlling at least one visual reminding device, at least one auditory reminding device, at least one tactile reminding device and at least one olfactory reminding device of the automobile to carry out multi-dimensional danger reminding on the driver.

2. The method of claim 1, wherein the controlling at least one visual alert device, at least one audible alert device, at least one tactile alert device, at least one olfactory alert device of the automobile to provide a multidimensional hazard alert to the driver comprises:

controlling the vehicle-mounted instrument to display a danger mark;

controlling a vehicle-mounted large screen to display danger reminding;

controlling the vehicle-mounted air conditioner to enter a danger reminding mode;

controlling a vehicle-mounted fragrance system to emit reminding odor;

controlling the vehicle seat to execute a reminding action;

and controlling the vehicle safety belt to execute tightening reminding action.

3. The method of claim 1, further comprising:

identifying the current danger level corresponding to the abnormal driving state according to the front information and the operation relation;

and determining a target reminding parameter of each device according to the current danger level.

4. The method of claim 1, further comprising:

acquiring the current position of the automobile;

generating navigation information or a driving planning path according to the current position and the rest area with the nearest distance;

pushing the navigation information to the driver, and/or controlling the automobile to drive to the rest area along the driving planning path.

5. The method of claim 1, further comprising:

acquiring the duration of multidimensional danger reminding of the driver;

when the duration is longer than the preset duration and the driver is still detected to be in the abnormal driving state, the automobile is controlled to decelerate according to a preset deceleration strategy until the automobile stops running, and warning and reminding light of the automobile is turned on.

6. The method according to any one of claims 1-5, wherein said detecting an operational relationship between a steering wheel and the driver comprises:

collecting a current image of the steering wheel;

and extracting at least one relation feature according to the current image, and determining the operation relation according to the at least one relation feature.

7. The method of claim 1, wherein detecting the operational relationship between the steering wheel and the driver comprises:

detecting the current force applied to the steering wheel;

and matching the operation relation according to the current received force.

8. A reminding device for abnormal driving state of a driver is characterized by comprising:

the system comprises an acquisition module, a display module and a display module, wherein the acquisition module is used for acquiring the current facial information of a driver and detecting the operation relationship between a steering wheel and the driver;

the judging module is used for judging whether the driver is in an abnormal driving state or not according to the current facial information and the operation relation; and

and the reminding module is used for controlling at least one visual reminding device, at least one auditory reminding device, at least one touch reminding device and at least one olfactory reminding device of the automobile to carry out multi-dimensional danger reminding on the driver when the driver is in the abnormal driving state.

9. A vehicle, characterized by comprising: a memory, a processor and a computer program stored on the memory and operable on the processor, the processor executing the program to implement the method of alerting of an abnormal driving state of a driver as claimed in any one of claims 1 to 7.

10. A computer-readable storage medium, on which a computer program is stored, characterized in that the program is executed by a processor for implementing a method for reminding a driver of an abnormal driving state according to any one of claims 1 to 7.