CN112849149A - Driver state detection method, driver state detection device, driver state detection apparatus, driver state detection medium, and driver state detection program product - Google Patents

Driver state detection method, driver state detection device, driver state detection apparatus, driver state detection medium, and driver state detection program product Download PDF

Info

Publication number
CN112849149A
CN112849149A CN202110118454.9A CN202110118454A CN112849149A CN 112849149 A CN112849149 A CN 112849149A CN 202110118454 A CN202110118454 A CN 202110118454A CN 112849149 A CN112849149 A CN 112849149A
Authority
CN
China
Prior art keywords
driver
state detection
information
state
driving state
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202110118454.9A
Other languages
Chinese (zh)
Inventor
梁冠华
何裕康
毛宁元
许亮
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shanghai Sensetime Lingang Intelligent Technology Co Ltd
Original Assignee
Shanghai Sensetime Lingang Intelligent Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shanghai Sensetime Lingang Intelligent Technology Co Ltd filed Critical Shanghai Sensetime Lingang Intelligent Technology Co Ltd
Priority to CN202110118454.9A priority Critical patent/CN112849149A/en
Publication of CN112849149A publication Critical patent/CN112849149A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W40/00Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models
    • B60W40/08Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models related to drivers or passengers

Abstract

The application provides a method, a device, equipment, a medium and a product for detecting a driver state, wherein the method for detecting the driver state comprises the following steps: acquiring image information of a driver and driving state information of a vehicle driven by the driver; determining a preset state detection strategy corresponding to the driving state information of the vehicle; and determining the state detection result of the driver according to the image information and a preset state detection strategy. When the driving state detection is carried out, the driving state detection method and the driving state detection device not only obtain the image information of the driver, but also obtain the driving state information of the vehicle, so that the state detection of the driver is carried out by adopting the preset state detection strategy corresponding to the driving state information, when the vehicle is in different driving states, the corresponding state detection strategies are different, the state detection result of the driver can be enabled to be more in line with the actual situation, the accuracy of the state judgment result of the driver is improved, and unnecessary alarming is reduced.

Description

Driver state detection method, driver state detection device, driver state detection apparatus, driver state detection medium, and driver state detection program product
Technical Field
The present application relates to the field of intelligent transportation technologies, and in particular, to a method, an apparatus, a device, a medium, and a program product for detecting a driver status.
Background
With the rapid development of modern transportation and automobile industry, the automobile holding amount is in a state of continuously rising, but the number of traffic accidents is also continuously increasing. The driving state of the driver is the main reason influencing the occurrence rate of the traffic accident, and when the driving state of the driver is poor, the occurrence rate of the traffic accident can be greatly improved.
In the prior art, the state information of a driver is collected to judge the state of the driver, and the driver is correspondingly reminded when the abnormal driving state is judged.
However, the state of the driver is determined only from the state information of the driver, and the determination result is liable to be inconsistent with the actual situation, for example, when the vehicle is turning, the driver may turn the head to the left or right, and at this time, the driving state abnormality is determined and an alarm is given only from the head displacement state of the driver, and an unnecessary alarm is generated.
Disclosure of Invention
The application provides a method, a device, equipment, a medium and a program product for detecting a driver state, which are used for solving the problem of low accuracy of a driving state judgment result in the prior art.
In a first aspect, the present application provides a driver state detection method, including:
acquiring image information of a driver and driving state information of a vehicle driven by the driver;
determining a preset state detection strategy corresponding to the driving state information of the vehicle;
and determining the state detection result of the driver according to the image information and the preset state detection strategy.
In some embodiments, the determining a preset state detection strategy corresponding to the driving state information includes:
determining a preset state detection strategy corresponding to the driving state information of the vehicle according to a preset corresponding relation between the state detection strategy and the driving state information; or
Determining a type of motion of the vehicle based on the driving state information;
and determining the state detection strategy corresponding to the motion type of the vehicle as the preset state detection strategy corresponding to the running state information according to the preset corresponding relation between the state detection strategy and the motion type.
In some embodiments, the type of motion comprises at least one of: advancing, backing, accelerating, decelerating, turning, lane changing, braking and stopping.
In some embodiments, acquiring the driving state information of the vehicle driven by the driver includes:
detecting driving state information of the driver according to the image information;
acquiring running state information of a vehicle driven by the driver in response to determining that the driving state of the driver belongs to a preset dangerous driving state according to the driving state information; and/or
The determining the state detection result of the driver according to the image information and the preset state detection strategy comprises:
detecting driving state information of the driver according to the image information;
and determining a state detection result of the driver according to the driving state information of the driver and the preset state detection strategy.
In some embodiments, the driving state information includes at least one of: head offset angle information, line-of-sight offset angle information, motion information, seating information representing a seating condition of a driver in a driving area.
In some embodiments, the driving state information includes vehicle speed information and/or gear information;
the preset state detection strategy comprises at least one of the following:
under the condition that the vehicle speed information does not exceed a first speed threshold value and the gear information is a forward gear, responding to the condition that the head offset angle or the sight offset angle of the driver exceeds a first angle threshold value and the duration that the head offset angle or the sight offset angle of the driver exceeds the first angle threshold value exceeds a first time threshold value, and determining that the state detection result of the driver is a dangerous driving state;
under the condition that the vehicle speed information does not exceed a first speed threshold value and the gear information is a reverse gear, in response to the fact that the head offset angle or the sight line offset angle of the driver exceeds a second angle threshold value and the duration of the head offset angle or the sight line offset angle of the driver exceeding the second angle threshold value exceeds a second time threshold value, determining that the state detection result of the driver is a dangerous driving state, wherein the second angle threshold value is larger than or equal to the first angle threshold value, and the second time threshold value is larger than or equal to the first time threshold value;
under the condition that the vehicle speed information exceeds a first speed threshold value and the gear information is a forward gear, in response to the fact that the head offset angle or the sight line offset angle of the driver exceeds a third angle threshold value and the duration of the head offset angle or the sight line offset angle of the driver exceeding the third angle threshold value exceeds a third time threshold value, determining that the state detection result of the driver is a dangerous driving state, wherein the third angle threshold value is smaller than or equal to the first angle threshold value, and the third time threshold value is smaller than or equal to the first time threshold value;
under the condition that the vehicle speed information is not zero and/or the gear information is not a parking gear, responding to the action information of a driver including dangerous driving action, and determining that the state detection result of the driver is a dangerous driving state;
and under the condition that the vehicle speed information is not zero and/or the gear information is not a parking gear, responding to the sitting information that the driver is not sitting in the driving area, and determining that the state detection result of the driver is a dangerous driving state.
In some embodiments, the dangerous driving action comprises at least one of a drinking action, a calling action, a smoking action, a head lowering action, a yawning action, an eye closing time reaching a preset duration.
In some embodiments, further comprising:
and when the state detection result of the driver is determined to be a dangerous driving state, outputting corresponding dangerous driving prompt information according to the driving state information and the driving state information.
In some embodiments, further comprising:
in response to detecting an instruction to turn off the driver state detection function, or in the case where the vehicle speed information is zero or the gear information is a parking gear, the state detection of the driver is stopped.
In a second aspect, the present application provides a driving state detection device, comprising:
an information acquisition module configured to acquire image information of a driver and driving state information of a vehicle driven by the driver;
a policy determination module configured to determine a preset state detection policy corresponding to the driving state information of the vehicle;
the state determining module is configured to determine a state detection result of the driver according to the image information and the preset state detection strategy.
In a third aspect, the present application provides a computer device comprising: the driver state detection system comprises a memory, a processor and a computer program stored on the memory and capable of running on the processor, wherein the processor realizes the driver state detection method when executing the program.
In a fourth aspect, the present application provides a computer-readable storage medium having stored therein computer-executable instructions for implementing the above-mentioned driver state detection method when the computer-executable instructions are executed by a processor.
In a fifth aspect, the present application provides a computer program product comprising a computer program which, when executed by a processor, implements the driver state detection method described above.
The application provides a method, a device, equipment, a medium and a program product for detecting the state of a driver, wherein the method for detecting the state of the driver comprises the following steps: acquiring image information of a driver and driving state information of a vehicle driven by the driver; determining a preset state detection strategy corresponding to the driving state information of the vehicle; and determining the state detection result of the driver according to the image information and a preset state detection strategy. When the driving state detection is carried out, the driving state detection method and the driving state detection device not only obtain the image information of the driver, but also obtain the driving state information of the vehicle, so that the state detection of the driver is carried out by adopting the preset state detection strategy corresponding to the driving state information, when the vehicle is in different driving states, the corresponding state detection strategies are different, the state detection result of the driver can be enabled to be more in line with the actual situation, the accuracy of the state judgment result of the driver is improved, and unnecessary alarming is reduced.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and together with the description, serve to explain the principles of the disclosure.
Fig. 1 is a schematic diagram of a driving state detection method provided in an embodiment of the present application;
fig. 2 is a schematic view of the arrangement of the image pickup apparatus in the embodiment of the present application;
FIG. 3 is a schematic view of the driver's head/line of sight offset;
FIG. 4 is a schematic diagram of a driver making a call;
FIG. 5 is a schematic diagram of a driver performing a smoking maneuver;
FIG. 6 is a schematic view of a driver performing a sleeping maneuver;
fig. 7 is a schematic view of a driving state detection device according to an embodiment of the present application.
With the foregoing drawings in mind, certain embodiments of the disclosure have been shown and described in more detail below. These drawings and written description are not intended to limit the scope of the disclosed concepts in any way, but rather to illustrate the concepts of the disclosure to those skilled in the art by reference to specific embodiments.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, but not all, embodiments of the present invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
The terminology used in the embodiments of the present application is for the purpose of describing particular embodiments only and is not intended to be limiting of the invention. As used in the embodiments of the present application, the singular forms "a", "an" and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise.
It should be understood that the term "and/or" as used herein is merely one type of association that describes an associated object, meaning that three relationships may exist, e.g., a and/or B may mean: a exists alone, A and B exist simultaneously, and B exists alone. In addition, the character "/" herein generally indicates that the former and latter related objects are in an "or" relationship.
The words "if", as used herein, may be interpreted as "at … …" or "at … …" or "in response to a determination" or "in response to a detection", depending on the context. Similarly, the phrases "if determined" or "if detected (a stated condition or event)" may be interpreted as "when determined" or "in response to a determination" or "when detected (a stated condition or event)" or "in response to a detection (a stated condition or event)", depending on the context.
It is also noted that the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a good or system that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such good or system. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a commodity or system that includes the element.
First, the terms related to the present application will be explained:
1. vehicle gear: the automatic transmission automobile is an automobile which adopts an automatic transmission clutch and does not need manual gear shifting of a driver, and for the automatic transmission automobile, the automobile gears are generally divided into an N gear (Neutral), a P gear (park), an R gear (Reverse) and a D gear (Drive).
The N-gear is a neutral gear, and is used when the driver temporarily stops the vehicle, and at this time, the braking device of the vehicle is not locked, and the vehicle may automatically change its state due to external environmental factors. For example, N-gear is engaged on a downhill slope, while the vehicle still slips downward.
The P gear is a parking gear and is used when the automobile is flamed out and parked or the automobile is static, when the gear is engaged into the P gear, a braking device of the automobile can be locked, and the automobile cannot automatically generate state change due to external environmental factors. For example, in a P-gear engaged on a downhill grade, the vehicle will not actively slip downward.
The R range is a reverse range and is used when the driver performs a reverse operation.
The D range is a forward range and is used when the driver performs a forward travel operation of the vehicle.
2. DMS: a Driver monitoring System (Driver Monitor System) mainly realizes the functions of identifying the identity of a Driver, monitoring the fatigue of the Driver and monitoring dangerous driving behaviors, and an alarm mechanism is designed to remind the Driver, so that the intelligent driving safety level can be better improved, and the driving safety of a vehicle is ensured.
In the prior art, the state information of a driver is collected to judge the state of the driver, and the driver is correspondingly reminded when the abnormal driving state is judged. However, the state of the driver is determined only from the state information of the driver, and the determination result is liable to be inconsistent with the actual situation, for example, when the vehicle is turning, the driver may turn the head to the left or right, and in this case, the driver driving state is determined to be abnormal and an alarm is given in the conventional technology. Therefore, the conventional driving state determination result has a problem of low accuracy due to non-conformity with an actual scene.
The application provides a driver state detection method, a driver state detection device, driver state detection equipment, a driver state detection medium and a driver state detection product, and aims to solve the technical problems in the prior art. The application provides a driver state detection method, a device, equipment, a medium and a product, when the application detects the driving state, the application not only acquires the image information of the driver, but also acquires the driving state information of the vehicle, thereby adopting the preset state detection strategy corresponding to the driving state information to detect the state of the driver, when the vehicle is in different driving states, the corresponding state detection strategies are different, thereby enabling the state detection result of the driver to better accord with the actual situation, being beneficial to improving the accuracy of the state judgment result of the driver, and reducing unnecessary alarming.
It can be understood that the technical solutions in the embodiments of the present application can be applied to an actual scene in which a driving state of a driver needs to be detected. For example, the method can be applied to operation vehicles such as public transport vehicles, buses and rail transit vehicles, so that the driving state of an on-duty driver driving the operation vehicles can be detected more accurately; in addition, the method can also be applied to private cars, so that the state detection can be performed on drivers more accurately.
The following describes the technical solutions of the present application and how to solve the above technical problems with specific embodiments. The following several specific embodiments may be combined with each other, and details of the same or similar concepts or processes may not be repeated in some embodiments. Embodiments of the present application will be described below with reference to the accompanying drawings.
It is understood that the processing steps of the driving state detection method in the present application may be implemented by a terminal or a server, and in particular, may be applied to the DMS.
The driving state detection method according to the present invention is performed when the driver sets the vehicle to the start state by the vehicle key. When the driver pulls out the car key to make the vehicle in the flameout state, the driving state detection of the driver is stopped.
Fig. 1 is a schematic diagram of a driving state detection method provided in an embodiment of the present application, and as shown in fig. 1, the method mainly includes the following steps:
s100, acquiring image information of a driver and driving state information of a vehicle driven by the driver.
The driver refers to a person sitting at a driving position of the vehicle, and the image information of the driver refers to image information including the driver, which is shot by the image acquisition equipment. Optionally, the image information may be acquired by a shooting device such as a vehicle-mounted camera, and the shooting device may be disposed in front of the driver.
Fig. 2 is a setting schematic diagram of the camera device in the embodiment of the application, and as shown in fig. 2, the camera device can be specifically arranged in the front lower part of the driver, so that the driver can not be shielded by sight while the image information of the driver can be collected, and the driving safety is ensured.
Optionally, the camera device may be an infrared camera device, so that the image information of the driver can be collected even at night.
In addition, the running state information refers to each running state parameter of the vehicle, and when the running state information is acquired, the running state information CAN be acquired in real time by communicating with a CAN bus module of the vehicle so as to acquire each running state parameter of the vehicle in real time.
And S200, determining a preset state detection strategy corresponding to the running state information of the vehicle.
After the driving state information of the vehicle is obtained, a preset state detection strategy corresponding to the driving state information of the vehicle is determined first, so that state detection is performed according to the determined state detection strategy.
Here, the state detection strategy may include a determination rule and/or a detection method for determining whether the driver is in the abnormal driving state or the dangerous driving state. It can be understood that the corresponding state detection strategies are different for different driving state information, so that the best matching state detection strategy can be selected according to actual conditions to detect the state of the driver.
S300, determining a state detection result of the driver according to the image information and a preset state detection strategy.
After the corresponding preset state detection strategy is determined according to the driving state information of the vehicle, the state of the driver can be detected through the preset state detection strategy according to the image information of the driver, and the accuracy of the state detection result of the driver can be effectively improved because the preset state detection strategy is most matched with the current driving state information of the vehicle.
The following is a specific comparison description of the process of the present application and the prior art in performing state detection:
for the state detection strategies in the prior art, when the vehicle is in different driving states, the state detection is carried out by the same state detection strategy. For example, when the traveling state of the vehicle is the a state or the B state, the state detection is performed by using the state detection policy X based on the video information. For the same image information C, when the state detection strategy X is adopted for state detection, as long as the image information C does not accord with the vehicle running standard set in the state detection strategy X, no matter the vehicle is in the A state or the B state, the detection result is that the driving state is abnormal. However, in the case where the vehicle is in the B state, there may be a case where the driver does not substantially have an abnormal driving state with respect to the video information C.
Therefore, when the state detection method of the prior art is adopted, the situation that the judgment result is not in accordance with the actual situation is easy to occur, so that false alarm is caused, and the driving state judgment result has the problem of low accuracy.
In the present application, when the vehicle is in different driving states, the corresponding state detection strategies are different. For example, when the traveling state of the vehicle is the a state, the state detection may be performed using the state detection strategy a corresponding to the a state. When the image information C of the driver is subjected to state detection by adopting the state detection strategy a, if the image information C does not accord with the vehicle running standard corresponding to the state detection strategy a, the detection result is abnormal driving state.
When the driving state of the vehicle is the B state, the state detection may be performed using the state detection strategy B corresponding to the B state. And when the image information C of the driver is subjected to state detection by adopting the state detection strategy b, if the image information C accords with the vehicle running specification corresponding to the state detection strategy b, the detection result is that the driving state is normal.
Therefore, according to the driving state detection method of the present application, when the driving state of the vehicle is the a state, the detection result is that the driving state is abnormal with respect to the video information C of the driver. And when the driving state of the vehicle is the B state, the detection result is that the driving state is normal, so that the judgment result is more in line with the actual situation, and the accuracy of the judgment result of the driving state is improved.
The driving state detection method provided by the application, when the driving state is detected, besides obtaining the image information of the driver, the driving state information of the vehicle is obtained, so that the state detection of the driver is carried out by adopting the preset state detection strategy corresponding to the driving state information, when the vehicle is in different driving states, the corresponding state detection strategies are different, so that the state detection result of the driver can better accord with the actual situation, the accuracy of the state judgment result of the driver is improved, and unnecessary alarming is reduced.
In some embodiments, determining a preset state detection strategy corresponding to the driving state information includes: determining a preset state detection strategy corresponding to the driving state information of the vehicle according to the preset corresponding relation between the state detection strategy and the driving state information; or, determining a type of motion of the vehicle based on the driving state information; and determining the state detection strategy corresponding to the motion type of the vehicle as a preset state detection strategy corresponding to the driving state information according to the preset corresponding relation between the state detection strategy and the motion type.
Specifically, a preset corresponding relationship between the state detection policy and the driving state information may be preset, and after the current driving state information of the vehicle is obtained, the preset state detection policy corresponding to the current driving state information of the vehicle is directly determined according to the preset corresponding relationship.
For example, the state detection strategies X1, X2, and X3 are preset in correspondence with the running state information a1, a2, and A3, respectively, and when the current running state information of the vehicle is a2, the corresponding state detection strategy is directly determined to be X2, so that the state detection of the driver is performed according to the state detection strategy X2.
In addition, a preset state detection strategy corresponding to the running state information may be determined according to the motion type of the vehicle. Firstly, a preset corresponding relation between a state detection strategy and a motion type can be preset, and after the current running state information of the vehicle is obtained, the motion type of the vehicle is determined based on the current running state information; and finally, determining the state detection strategy corresponding to the motion type of the vehicle as a preset state detection strategy corresponding to the running state information.
For example, the state detection strategies X1, X2, and X3 are preset to correspond to the respective row motion types B1, B2, and B3, and after the current driving state information of the vehicle is obtained, if the current motion type of the vehicle is determined to be B1 from the driving state information, the corresponding state detection strategy is determined to be X1, and the state detection of the driver is performed according to the state detection strategy X1.
In this embodiment, the corresponding preset state detection strategy may be directly determined according to the driving state information, or the preset state detection strategy corresponding to the driving state information may be indirectly determined according to the motion type corresponding to the driving state information, so that the state detection result of the driver may better meet the actual situation, which is helpful for improving the accuracy of the state detection result of the driver and reducing unnecessary alarm.
In some embodiments, the type of motion comprises at least one of: advancing, backing, accelerating, decelerating, turning, lane changing, braking and stopping.
Specifically, the motion types of the vehicle may be divided according to different actual driving states of the vehicle, for example, the motion types of the vehicle may be divided into forward and backward according to a driving direction, the motion types of the vehicle may be divided into acceleration and deceleration according to a driving speed, the motion types of the vehicle may be divided into turning and lane changing according to a driving path, and the motion types of the vehicle may be divided into braking and parking according to a motion displacement of the vehicle.
Therefore, when the preset state detection strategy corresponding to the driving state information is indirectly determined according to the motion type corresponding to the driving state information, the corresponding strategy can be selected from a plurality of different state detection strategies according to the current motion type of the vehicle to carry out state detection, and therefore the state detection result of the driver is more matched with the actual situation.
In some embodiments, acquiring the driving state information of the vehicle driven by the driver includes: detecting driving state information of a driver according to the image information; the driving state information of the vehicle driven by the driver is acquired in response to determining that the driving state of the driver belongs to a preset dangerous driving state according to the driving state information.
Specifically, a triggering condition for acquiring the driving state information of the vehicle may be preset, where the triggering condition may be, for example, that the driver belongs to a dangerous driving state, after acquiring the image information of the driver, it is determined whether the triggering condition is satisfied according to the image information, and if the triggering condition is satisfied, it indicates that the driver has dangerous driving behavior, and the operation for acquiring the driving state information of the vehicle driven by the driver may be performed; if the driving state information does not satisfy the predetermined condition, it indicates that there is no dangerous driving behavior for the driver, and at this time, the operation of acquiring the driving state information of the vehicle driven by the driver may not be performed.
Therefore, by setting the trigger condition for acquiring the running state information of the vehicle driven by the driver, unnecessary running state information acquisition operations can be reduced, and the processing flow of driver state detection is simplified.
Optionally, determining a state detection result of the driver according to the image information and a preset state detection strategy, including: detecting driving state information of a driver according to the image information; and determining a state detection result of the driver according to the driving state information of the driver and a preset state detection strategy.
Specifically, when the state detection is performed according to the image information and the determined state detection strategy, the driving state information of the driver is obtained according to the image information, and then the state detection is performed on the driver according to the driving state information and the determined state detection strategy, so as to determine the state detection result of the driver. Therefore, according to the driving state information of the driver, a more accurate state detection result can be obtained by combining the state detection strategy matched with the actual situation.
In some embodiments, the driving status information includes at least one of: head offset angle information, line-of-sight offset angle information, motion information, seating information representing a seating condition of a driver in a driving area.
During the driving of the vehicle, it may happen that the driver looks to the left or to the right at other vehicles or obstacles on the road, at which time the driver's head or line of sight may shift. In this embodiment, the head offset angle information specifically includes an angle at which the head of the driver is offset from the vehicle forward direction and a corresponding offset duration; the gaze offset angle information includes in particular the angle at which the driver's gaze is offset in front of the vehicle and the corresponding offset duration.
Furthermore, during driving of the vehicle, in addition to normal driving actions, the driver may also take other actions that are not related to the driving behavior. In each embodiment of the present application, the motion information specifically includes motion information of a body part such as a face or a hand of the driver.
In addition, the driver is located at the vehicle driving position during the driving of the vehicle, and therefore, the driving state information may further include seating information indicating the seating condition of the driver in the driving area.
In this embodiment, at least one of the head offset angle information, the sight line offset angle information, the motion information, or the seating information representing the seating condition of the driver in the driving area can be detected and obtained from the image information, thereby contributing to determining the state of the driver and improving the accuracy of the state determination result.
In some embodiments, the driving state information includes vehicle speed information and/or vehicle gear information. The vehicle speed information is the current running speed of the vehicle, and the vehicle gear information is the gear currently engaged by the vehicle.
The preset state detection strategy comprises at least one of the following items:
under the condition that the vehicle speed information does not exceed a first speed threshold value and the gear information is a forward gear, in response to the fact that the head deviation angle or the sight line deviation angle of the driver exceeds a first angle threshold value and the duration that the head deviation angle or the sight line deviation angle of the driver exceeds the first angle threshold value exceeds a first time threshold value, determining that the state detection result of the driver is a dangerous driving state;
under the condition that the vehicle speed information does not exceed a first speed threshold value and the gear information is a reverse gear, in response to the fact that the head offset angle or the sight line offset angle of the driver exceeds a second angle threshold value and the duration time that the head offset angle or the sight line offset angle of the driver exceeds the second angle threshold value exceeds a second time threshold value, determining that the state detection result of the driver is a dangerous driving state, wherein the second angle threshold value is larger than or equal to the first angle threshold value, and the second time threshold value is larger than or equal to the first time threshold value;
under the condition that the vehicle speed information exceeds a first speed threshold value and the gear information is a forward gear, in response to the fact that the head offset angle or the sight line offset angle of the driver exceeds a third angle threshold value and the duration that the head offset angle or the sight line offset angle of the driver exceeds the third angle threshold value exceeds a third time threshold value, determining that the state detection result of the driver is a dangerous driving state, wherein the third angle threshold value is smaller than or equal to a first angle threshold value, and the third time threshold value is smaller than or equal to a first time threshold value;
under the condition that the vehicle speed information is not zero and/or the gear information is not a parking gear, responding to the action information of the driver including dangerous driving action, and determining that the state detection result of the driver is a dangerous driving state;
and under the condition that the vehicle speed information is not zero and/or the gear information is not a parking gear, responding to the sitting information that the driver is not sitting in the driving area, and determining that the state detection result of the driver is a dangerous driving state.
Specifically, the explanation of the state detection strategy is given by taking an example of indirectly determining a preset state detection strategy corresponding to the driving state information according to the motion type corresponding to the driving state information:
(1) and when the vehicle speed does not exceed a first speed threshold value and the vehicle gear is a forward gear, determining that the current motion type of the vehicle is a first type.
Correspondingly, when the current motion type is the first type, if it is detected that the head deviation angle or the sight line deviation angle of the driver is larger than the first angle threshold value and the duration that the head deviation angle or the sight line deviation angle is larger than the first angle threshold value exceeds the first time threshold value, the driving state of the driver is determined to be a dangerous driving state.
Fig. 3 is a schematic diagram of a head/sight line of a driver being shifted, when a user needs to observe left and right road conditions, the head/sight line of the driver may be shifted, and at this time, a head shift angle or a sight line shift angle of the driver and a corresponding duration may be calculated to determine whether the driver is in a dangerous driving state.
For example, the first speed threshold may specifically be, for example, 10km/h, etc., and at this time, the current motion type of the vehicle may be considered as the first type, i.e., low-speed forward motion, and may specifically correspond to a driver making a left-right turn or other actual scene requiring slow deceleration.
When the current motion type is the first type, at which time the driver needs to look to the left or right at other vehicles or obstacles on the road, the first angle threshold may be set to be, for example, ± 30 °, and the first time threshold may be, for example, 3 seconds.
In the strategy, the situation that the driver is judged to be abnormal in the driving state due to slight head deviation or short sight line deviation in the actual scene corresponding to the first type can be avoided, so that the driving state detection result is more consistent with the actual situation.
(2) And when the vehicle speed does not exceed the first speed threshold value and the vehicle gear is the reverse gear, determining that the current motion type of the vehicle is the second type.
Correspondingly, when the current motion type is the second type, if it is detected that the head offset angle or the sight line offset angle of the driver is larger than the second angle threshold value and the duration that the head offset angle or the sight line offset angle is larger than the second angle threshold value exceeds the second time threshold value, the driving state of the driver is determined to be a dangerous driving state. Wherein the second angle threshold is greater than or equal to the first angle threshold, and the second time threshold is greater than or equal to the first time threshold.
For example, the first speed threshold may specifically be, for example, 10km/h, and at this time, the current motion type of the vehicle may be considered as a second type, that is, a low-speed backward motion, and may specifically correspond to an actual scene that needs to be decelerated and slowed down, such as when the driver backs up.
When the current motion type is the second type, at this time, the driver needs to watch the reverse road condition to the left or to the right, and at this time, compared with the first type, in order to ensure the safety of reverse, the head or the sight line of the driver may need to deviate by a larger angle, and the corresponding time may also be longer, so that the second angle threshold value may be set to be greater than or equal to the first angle threshold value, and the second time threshold value may be greater than or equal to the first time threshold value. Specifically, the second angle threshold may be, for example, ± 45 °, and the second time threshold may be, for example, 4 seconds.
In the strategy, for the actual conditions that the driver needs to decelerate and walk slowly, such as backing a car, the situation that the driver is judged to be abnormal in the driving state due to slight head deviation or short sight line deviation in the actual scene corresponding to the second type can be avoided by setting the corresponding second angle threshold and the second time threshold, so that the driving state detection result is more in line with the actual conditions. In addition, the second angle threshold is set to be larger than or equal to the first angle threshold, and the second time threshold is larger than or equal to the first time threshold, so that a driver can have more sufficient time to observe the road condition, and the safety of reversing is guaranteed.
(3) And when the vehicle speed exceeds a first speed threshold value and the vehicle gear is a forward gear, determining that the current motion type of the vehicle is a third type.
Correspondingly, when the current motion type is the third type, if it is detected that the head deviation angle or the sight line deviation angle of the driver is larger than the third angle threshold value and the duration that the head deviation angle or the sight line deviation angle is larger than the third angle threshold value exceeds the third time threshold value, the driving state of the driver is determined to be a dangerous driving state. And the third angle threshold is smaller than or equal to the first angle threshold, and the third time threshold is smaller than or equal to the first time threshold.
For example, the first speed threshold may specifically be, for example, 10km/h, etc., at which time the current type of motion of the vehicle may be considered as a third type, i.e. normal forward motion, which may specifically correspond to an actual scene where the driver is driving normally forward.
When the current motion type is the third type, the driver needs to observe the road condition in the forward direction of the vehicle more attentively, in this case, the third angle threshold may specifically be ± 25 °, and the third time threshold may specifically be 2 seconds, for example.
Compared with the situation of turning left and right or backing a car, when the vehicle normally runs forwards, the driver needs to watch more road conditions in front of the vehicle, therefore, the judgment standard of the abnormal driving state is improved by setting the third angle threshold value to be smaller than or equal to the first angle threshold value and setting the third time threshold value to be smaller than or equal to the first time threshold value, so that the running safety is ensured, and the matching performance of the state detection strategy and an actual scene is improved.
In the strategy, for the actual situation that the driver normally drives forwards, the corresponding third angle threshold value is set to be smaller than or equal to the first angle threshold value, and the third time threshold value is smaller than or equal to the first time threshold value, so that the driver can be determined to be in the abnormal driving state under the conditions that the head/sight line of the driver deviates by a small angle and the duration is short, namely, the judgment standard of the abnormal driving state is improved, and the driver can be ensured to drive the vehicle by focusing on more attention, so that the safety is ensured.
(4) When the vehicle speed is not zero and/or the vehicle gear is not in park, determining that the current type of motion of the vehicle is a fourth type.
Correspondingly, when the current motion type is the fourth type, the driver needs to execute a normal vehicle driving action, and if the action information of the driver is detected to include a dangerous driving action, the driving state of the driver is determined to be a dangerous driving state.
Optionally, the dangerous driving action comprises at least one of a drinking action, a calling action, a smoking action, a head lowering action, a yawning action and an eye closing time reaching a preset duration, wherein the eye closing time reaching the preset duration can be regarded as a sleeping action.
Fig. 4 is a schematic view showing a call-making action by a driver, fig. 5 is a schematic view showing a smoking action by the driver, and fig. 6 is a schematic view showing a sleeping action by the driver, and as shown in fig. 4 to 6, the drinking action, the call-making action, the smoking action, the lowering action, the yawning action, or the sleeping action may cause a distracting influence on the driving of the driver, and thus may be considered as a dangerous driving action. Therefore, when the at least one dangerous driving action is detected, the driving state of the driver can be determined to be a dangerous driving state.
Alternatively, when determining whether the driver's motion is an abnormal motion, the driver's motion image may be collected by a camera based on motion characteristic recognition and compared with various abnormal motion models in a database to recognize the abnormal motion of the driver.
In the strategy, the actual condition that the driver performs normal vehicle driving actions is detected by the action detection of the driver, and when dangerous driving actions are detected, the driving state of the driver is determined to be the dangerous driving state, so that the accuracy of the driving state detection result can be improved.
(5) And when the current motion type is a fourth type, determining that the state detection result of the driver is a dangerous driving state in response to the seating information being that the driver is not seated in the driving area.
Correspondingly, when the current motion type is the fourth type, the driver needs to execute normal vehicle driving actions, if the driver is detected not to be seated in the driving area, the vehicle is in a state of unmanned driving control, and the driving state of the driver is determined to be a dangerous driving state.
In this strategy, in the actual situation in which the driver is required to drive the vehicle normally, it is possible to detect whether or not the driver is seated in the driving area, thereby detecting an abnormality in the situation in which the driver is not in the driving seat but the vehicle is in a normal driving state, and ensuring driving safety.
In some embodiments, the driver state detection method further comprises: and when the state detection result of the driver is determined to be the dangerous driving state, outputting corresponding dangerous driving prompt information according to the driving state information and the driving state information.
Optionally, the output form of the dangerous driving prompt message includes an audio alarm, a visual alarm (such as light and text), an APP (Application) alarm, and the like.
Optionally, the alarm information may include corresponding specific abnormal content, for example, the specific abnormal content is broadcasted by voice, the specific abnormal content is displayed by a display screen/dashboard, and the like.
Therefore, through outputting dangerous driving prompt information, relevant personnel can timely know the current state detection result of the driver, driving accidents are avoided, and driving safety is guaranteed.
In some embodiments, the driver state detection method further comprises: in response to detecting an instruction to turn off the driver state detection function, or in the case where the vehicle speed information is zero or the gear information is a parking gear, the state detection of the driver is stopped.
Specifically, when the instruction to turn off the driver state detection function is detected, it is described that the state detection of the driver is not currently required, and therefore, the process of performing the driver state detection may be stopped.
In addition, when the vehicle speed information is zero or the shift position information is the parking position, it is described that the vehicle is not currently in the traveling state, and at this time, the driver performs another operation, so that the process of detecting the driver state may be stopped.
It can be understood that, in the embodiments of the present application, specific values related to the vehicle speed, the angle, and the duration are only examples of the technical solution of the present application, and in practical applications, the specific values may be adjusted according to practical situations, and the present application is not particularly limited.
It should be understood that, although the respective steps in the flowcharts in the above-described embodiments are sequentially shown as indicated by arrows, the steps are not necessarily performed sequentially as indicated by the arrows. The steps are not performed in the exact order shown and may be performed in other orders unless explicitly stated herein. Moreover, at least some of the steps in the figures may include multiple sub-steps or multiple stages that are not necessarily performed at the same time, but may be performed at different times, in different orders, and may be performed alternately or at least partially with respect to other steps or sub-steps of other steps.
In some embodiments, a driving state detection device is provided.
Fig. 7 is a schematic view of a driving state detection device according to an embodiment of the present application, and as shown in fig. 7, the device includes:
an information acquisition module 100 configured to acquire image information of a driver and driving state information of a vehicle driven by the driver;
a policy determination module 200 configured to determine a preset state detection policy corresponding to the driving state information of the vehicle;
and the state determining module 300 is configured to determine a state detection result of the driver according to the image information and a preset state detection strategy.
The application provides a driving state detection device, when carrying out driving state detection, except acquireing driver's image information, still including the travel state information who acquires the vehicle to the state detection that adopts the state detection strategy of predetermineeing that the travel state information corresponds carries out driver, when the vehicle is in different travel states, the state detection strategy that corresponds is also different, thereby can make driver's state detection result accord with actual conditions more, help improving the accuracy of driver state judgement result, reduce unnecessary and report to the police.
For specific limitations of the driving state detection device, reference may be made to the above limitations of the driving state detection method, which are not described herein again. The various modules in the driving state detection device described above may be implemented in whole or in part by software, hardware, and combinations thereof. The modules can be embedded in a hardware form or independent from a processor in the computer device, and can also be stored in a memory in the computer device in a software form, so that the processor can call and execute operations corresponding to the modules.
In some embodiments, there is provided a computer device comprising: the system comprises a memory, a processor and a computer program stored on the memory and capable of running on the processor, wherein the processor executes the program to realize the steps of the method embodiments of the application.
In some embodiments, a computer-readable storage medium having stored thereon computer-executable instructions for performing the steps of the method embodiments of the present application when executed by a processor is provided.
In some embodiments, a computer program product is provided, comprising a computer program which, when executed by a processor, performs the steps of the method embodiments of the present application.
It will be understood by those skilled in the art that all or part of the processes of the methods of the embodiments described above can be implemented by hardware related to instructions of a computer program, which can be stored in a non-volatile computer-readable storage medium, and when executed, the computer program can include the processes of the embodiments of the methods described above. Any reference to memory, storage, database, or other medium used in the embodiments provided herein may include non-volatile and/or volatile memory, among others. Non-volatile memory can include read-only memory (ROM), Programmable ROM (PROM), Electrically Programmable ROM (EPROM), Electrically Erasable Programmable ROM (EEPROM), or flash memory. Volatile memory can include Random Access Memory (RAM) or external cache memory. By way of illustration and not limitation, RAM is available in a variety of forms such as Static RAM (SRAM), Dynamic RAM (DRAM), Synchronous DRAM (SDRAM), Double Data Rate SDRAM (DDRSDRAM), Enhanced SDRAM (ESDRAM), Synchronous Link DRAM (SLDRAM), Rambus Direct RAM (RDRAM), direct bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM).
Other embodiments of the present disclosure will be apparent to those skilled in the art from consideration of the specification and practice of the application disclosed herein. This application is intended to cover any variations, uses, or adaptations of the disclosure following, in general, the principles of the disclosure and including such departures from the present disclosure as come within known or customary practice within the art to which the disclosure pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the disclosure being indicated by the following claims.
It will be understood that the present disclosure is not limited to the precise arrangements described above and shown in the drawings and that various modifications and changes may be made without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.

Claims (13)

1. A driver state detection method characterized by comprising:
acquiring image information of a driver and driving state information of a vehicle driven by the driver;
determining a preset state detection strategy corresponding to the driving state information of the vehicle;
and determining the state detection result of the driver according to the image information and the preset state detection strategy.
2. The method of claim 1, wherein determining a preset state detection strategy corresponding to the driving state information comprises:
determining a preset state detection strategy corresponding to the driving state information of the vehicle according to a preset corresponding relation between the state detection strategy and the driving state information; or
Determining a type of motion of the vehicle based on the driving state information;
and determining the state detection strategy corresponding to the motion type of the vehicle as the preset state detection strategy corresponding to the running state information according to the preset corresponding relation between the state detection strategy and the motion type.
3. The method of claim 2, wherein the type of motion comprises at least one of: advancing, backing, accelerating, decelerating, turning, lane changing, braking and stopping.
4. The method according to any one of claims 1 to 3, wherein acquiring the running state information of the vehicle driven by the driver includes:
detecting driving state information of the driver according to the image information;
acquiring running state information of a vehicle driven by the driver in response to determining that the driving state of the driver belongs to a preset dangerous driving state according to the driving state information; and/or
The determining the state detection result of the driver according to the image information and the preset state detection strategy comprises:
detecting driving state information of the driver according to the image information;
and determining a state detection result of the driver according to the driving state information of the driver and the preset state detection strategy.
5. The method of claim 4, wherein the driving state information comprises at least one of: head offset angle information, line-of-sight offset angle information, motion information, seating information representing a seating condition of a driver in a driving area.
6. The method according to claim 4, characterized in that the driving state information comprises vehicle speed information and/or gear information;
the preset state detection strategy comprises at least one of the following:
under the condition that the vehicle speed information does not exceed a first speed threshold value and the gear information is a forward gear, responding to the condition that the head offset angle or the sight offset angle of the driver exceeds a first angle threshold value and the duration that the head offset angle or the sight offset angle of the driver exceeds the first angle threshold value exceeds a first time threshold value, and determining that the state detection result of the driver is a dangerous driving state;
under the condition that the vehicle speed information does not exceed a first speed threshold value and the gear information is a reverse gear, in response to the fact that the head offset angle or the sight line offset angle of the driver exceeds a second angle threshold value and the duration of the head offset angle or the sight line offset angle of the driver exceeding the second angle threshold value exceeds a second time threshold value, determining that the state detection result of the driver is a dangerous driving state, wherein the second angle threshold value is larger than or equal to the first angle threshold value, and the second time threshold value is larger than or equal to the first time threshold value;
under the condition that the vehicle speed information exceeds a first speed threshold value and the gear information is a forward gear, in response to the fact that the head offset angle or the sight line offset angle of the driver exceeds a third angle threshold value and the duration of the head offset angle or the sight line offset angle of the driver exceeding the third angle threshold value exceeds a third time threshold value, determining that the state detection result of the driver is a dangerous driving state, wherein the third angle threshold value is smaller than or equal to the first angle threshold value, and the third time threshold value is smaller than or equal to the first time threshold value;
under the condition that the vehicle speed information is not zero and/or the gear information is not a parking gear, responding to the action information of a driver including dangerous driving action, and determining that the state detection result of the driver is a dangerous driving state;
and under the condition that the vehicle speed information is not zero and/or the gear information is not a parking gear, responding to the sitting information that the driver is not sitting in the driving area, and determining that the state detection result of the driver is a dangerous driving state.
7. The method of claim 6, wherein the dangerous driving action comprises at least one of a drinking action, a phone call action, a smoking action, a head lowering action, a yawning action, an eye closing time up to a preset duration.
8. The method of any one of claims 1-7, further comprising:
and when the state detection result of the driver is determined to be a dangerous driving state, outputting corresponding dangerous driving prompt information according to the driving state information and the driving state information.
9. The method according to any one of claims 1-8, further comprising:
in response to detecting an instruction to turn off the driver state detection function, or in the case where the vehicle speed information is zero or the gear information is a parking gear, the state detection of the driver is stopped.
10. A driver state detection device characterized by comprising:
an information acquisition module configured to acquire image information of a driver and driving state information of a vehicle driven by the driver;
a policy determination module configured to determine a preset state detection policy corresponding to the driving state information of the vehicle;
the state determining module is configured to determine a state detection result of the driver according to the image information and the preset state detection strategy.
11. A computer device, comprising: a memory, a processor and a computer program stored on the memory and executable on the processor, the processor implementing the driver state detection method as claimed in any one of claims 1-9 when executing the program.
12. A computer-readable storage medium having computer-executable instructions stored therein, which when executed by a processor, are configured to implement the driver state detection method according to any one of claims 1 to 9.
13. A computer program product comprising a computer program, characterized in that the computer program, when being executed by a processor, carries out the driver state detection method as set forth in any one of the preceding claims 1-9.
CN202110118454.9A 2021-01-28 2021-01-28 Driver state detection method, driver state detection device, driver state detection apparatus, driver state detection medium, and driver state detection program product Pending CN112849149A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202110118454.9A CN112849149A (en) 2021-01-28 2021-01-28 Driver state detection method, driver state detection device, driver state detection apparatus, driver state detection medium, and driver state detection program product

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202110118454.9A CN112849149A (en) 2021-01-28 2021-01-28 Driver state detection method, driver state detection device, driver state detection apparatus, driver state detection medium, and driver state detection program product

Publications (1)

Publication Number Publication Date
CN112849149A true CN112849149A (en) 2021-05-28

Family

ID=75987682

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202110118454.9A Pending CN112849149A (en) 2021-01-28 2021-01-28 Driver state detection method, driver state detection device, driver state detection apparatus, driver state detection medium, and driver state detection program product

Country Status (1)

Country Link
CN (1) CN112849149A (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115035502A (en) * 2022-07-08 2022-09-09 北京百度网讯科技有限公司 Driver behavior monitoring method and device, electronic equipment and storage medium
CN115512457A (en) * 2022-09-21 2022-12-23 展讯半导体(南京)有限公司 Vehicle condition detection method and system based on automobile data recorder, recorder and medium
CN116189117A (en) * 2023-04-24 2023-05-30 天翼交通科技有限公司 Dangerous driving behavior recognition method, system, electronic equipment and storage medium

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE102016002931A1 (en) * 2016-03-10 2016-10-06 Daimler Ag Method for operating a driver assistance system
US20190005341A1 (en) * 2016-01-21 2019-01-03 Robert Bosch Gmbh Method for classifying driver movements
CN109969195A (en) * 2019-03-25 2019-07-05 陕西科技大学 A kind of driver's face abnormal behavior alarm system and method and the vehicle based on it
CN110390285A (en) * 2019-07-16 2019-10-29 广州小鹏汽车科技有限公司 System for distraction of driver detection method, system and vehicle
CN110909718A (en) * 2019-12-11 2020-03-24 深圳市锐明技术股份有限公司 Driving state identification method and device and vehicle
CN111645694A (en) * 2020-04-15 2020-09-11 南京航空航天大学 Driver driving state monitoring system and method based on attitude estimation
CN112141119A (en) * 2020-09-23 2020-12-29 上海商汤临港智能科技有限公司 Intelligent driving control method and device, vehicle, electronic equipment and storage medium

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20190005341A1 (en) * 2016-01-21 2019-01-03 Robert Bosch Gmbh Method for classifying driver movements
DE102016002931A1 (en) * 2016-03-10 2016-10-06 Daimler Ag Method for operating a driver assistance system
CN109969195A (en) * 2019-03-25 2019-07-05 陕西科技大学 A kind of driver's face abnormal behavior alarm system and method and the vehicle based on it
CN110390285A (en) * 2019-07-16 2019-10-29 广州小鹏汽车科技有限公司 System for distraction of driver detection method, system and vehicle
CN110909718A (en) * 2019-12-11 2020-03-24 深圳市锐明技术股份有限公司 Driving state identification method and device and vehicle
CN111645694A (en) * 2020-04-15 2020-09-11 南京航空航天大学 Driver driving state monitoring system and method based on attitude estimation
CN112141119A (en) * 2020-09-23 2020-12-29 上海商汤临港智能科技有限公司 Intelligent driving control method and device, vehicle, electronic equipment and storage medium

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115035502A (en) * 2022-07-08 2022-09-09 北京百度网讯科技有限公司 Driver behavior monitoring method and device, electronic equipment and storage medium
CN115512457A (en) * 2022-09-21 2022-12-23 展讯半导体(南京)有限公司 Vehicle condition detection method and system based on automobile data recorder, recorder and medium
CN116189117A (en) * 2023-04-24 2023-05-30 天翼交通科技有限公司 Dangerous driving behavior recognition method, system, electronic equipment and storage medium

Similar Documents

Publication Publication Date Title
CN112849149A (en) Driver state detection method, driver state detection device, driver state detection apparatus, driver state detection medium, and driver state detection program product
Morando et al. Drivers anticipate lead-vehicle conflicts during automated longitudinal control: Sensory cues capture driver attention and promote appropriate and timely responses
CN107010055B (en) Control system and control method
US8762021B2 (en) Driving support system
EP2046598B1 (en) Operation assist apparatus
CN112644514B (en) Driving data processing method, device, equipment, storage medium and program product
DE102017218443A1 (en) Driving support device
CN106971620B (en) Vehicle control system and control method
CN111114539B (en) Vehicle and safe driving method and device of vehicle
JP2010023769A (en) Vehicle control system
CN110533958A (en) Vehicle lane change based reminding method and system
DE102016122599A1 (en) Vehicle and method for supporting the driving safety thereof
CN109808613A (en) Intelligent driving system driving event evaluation detection method
CN110682864B (en) Early warning method and device for preventing rear-end collision in abnormal braking and vehicle
JP6593011B2 (en) Safe driving promotion device and safe driving promotion method
JP2010125923A (en) Emergency refuge device
CN111768651B (en) Early warning method and device for preventing vehicle collision
JP2017004492A (en) Method and device for limiting overspeed of vehicle
US20130166164A1 (en) Gear selection device for a motor vehicle
CN112319366A (en) Parking monitoring and early warning method and system
JP2012162122A (en) Vehicle traveling control system
CN111572449A (en) Intelligent automobile backing warning system and control method thereof
CN114802230B (en) Vehicle control method and device, intelligent vehicle and readable storage medium
Schädler et al. Experimental evaluation of the controllability of interacting advanced driver assistance systems
JP4561333B2 (en) Driver's control dependence detecting device and vehicle deceleration control device having the same

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20210528