CN112991684A - Driving early warning method and device - Google Patents
Driving early warning method and device Download PDFInfo
- Publication number
- CN112991684A CN112991684A CN201911287896.5A CN201911287896A CN112991684A CN 112991684 A CN112991684 A CN 112991684A CN 201911287896 A CN201911287896 A CN 201911287896A CN 112991684 A CN112991684 A CN 112991684A
- Authority
- CN
- China
- Prior art keywords
- driver
- current vehicle
- determining
- information
- attention index
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 50
- 230000001815 facial effect Effects 0.000 claims description 10
- 238000004590 computer program Methods 0.000 claims description 9
- 230000036772 blood pressure Effects 0.000 claims description 7
- 230000029058 respiratory gaseous exchange Effects 0.000 claims description 4
- 230000036387 respiratory rate Effects 0.000 claims description 3
- 238000010586 diagram Methods 0.000 description 15
- 230000008569 process Effects 0.000 description 10
- 238000012545 processing Methods 0.000 description 9
- 238000004891 communication Methods 0.000 description 7
- 238000005516 engineering process Methods 0.000 description 5
- 230000009286 beneficial effect Effects 0.000 description 4
- 238000006243 chemical reaction Methods 0.000 description 3
- 238000001514 detection method Methods 0.000 description 3
- 230000007613 environmental effect Effects 0.000 description 3
- 230000006870 function Effects 0.000 description 3
- 230000004044 response Effects 0.000 description 3
- 230000006399 behavior Effects 0.000 description 2
- 230000008859 change Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000012544 monitoring process Methods 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 230000036632 reaction speed Effects 0.000 description 2
- 241001282135 Poromitra oscitans Species 0.000 description 1
- 206010039203 Road traffic accident Diseases 0.000 description 1
- 206010048232 Yawning Diseases 0.000 description 1
- 238000007792 addition Methods 0.000 description 1
- 230000004075 alteration Effects 0.000 description 1
- 238000004458 analytical method Methods 0.000 description 1
- 238000007405 data analysis Methods 0.000 description 1
- 238000000354 decomposition reaction Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 239000000835 fiber Substances 0.000 description 1
- 230000014509 gene expression Effects 0.000 description 1
- 238000010191 image analysis Methods 0.000 description 1
- 230000007246 mechanism Effects 0.000 description 1
- 230000005055 memory storage Effects 0.000 description 1
- 230000003340 mental effect Effects 0.000 description 1
- 230000006996 mental state Effects 0.000 description 1
- 239000013307 optical fiber Substances 0.000 description 1
- 238000005457 optimization Methods 0.000 description 1
- 230000002265 prevention Effects 0.000 description 1
- 230000006798 recombination Effects 0.000 description 1
- 238000005215 recombination Methods 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 239000013589 supplement Substances 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B21/00—Alarms responsive to a single specified undesired or abnormal condition and not otherwise provided for
- G08B21/02—Alarms for ensuring the safety of persons
- G08B21/06—Alarms for ensuring the safety of persons indicating a condition of sleep, e.g. anti-dozing alarms
-
- G—PHYSICS
- G08—SIGNALLING
- G08G—TRAFFIC CONTROL SYSTEMS
- G08G1/00—Traffic control systems for road vehicles
- G08G1/01—Detecting movement of traffic to be counted or controlled
- G08G1/017—Detecting movement of traffic to be counted or controlled identifying vehicles
Landscapes
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Business, Economics & Management (AREA)
- Emergency Management (AREA)
- Traffic Control Systems (AREA)
Abstract
Disclosed are a driving early warning method and device, comprising: acquiring state information of a current vehicle and information of the surrounding environment of the current vehicle; determining an attention index of a driver of a current vehicle; determining a corresponding time threshold according to the attention index; determining collision time according to the state information of the current vehicle and the surrounding environment information of the current vehicle; if the collision time is less than or equal to the time threshold, early warning information is sent to the driver; the attention index of the driver is determined, a corresponding time threshold, namely the time lead of early warning, is determined according to the attention index of the driver, and early warning is carried out when the collision event is smaller than or equal to the time threshold, so that the early warning time is related to the attention of the driver, the driver is ensured to finish necessary operation in time, and accidents are avoided.
Description
Technical Field
The disclosure relates to the technical field of data analysis, and in particular relates to a driving early warning method and device.
Background
The driving assistance technology is an important component in the intelligent automobile. The existing auxiliary driving technology can send various prompts to a driver by combining with actual conditions in the driving process, and can also give an early warning to the driver in an emergency, so that driving accidents are effectively avoided.
The existing driving assistance technology can give an early warning in advance for a driver to react and take corresponding measures when an accident is predicted to happen. Typically the advance over time is fixed. However, the speed of response varies under different mental states of the driver. Therefore, the early warning is carried out by adopting the fixed time lead, which cannot be adapted to the reaction speed of the driver and is not beneficial to the operation of the driver.
Disclosure of Invention
The present disclosure is proposed to solve the above technical problems. The embodiment of the disclosure provides a driving early warning method and device, which can perform early warning by combining the current attention condition of a driver, so that the driver can be ensured to react in time.
According to a first aspect of the present disclosure, there is provided a driving warning method, comprising:
acquiring state information of a current vehicle and information of the surrounding environment of the current vehicle;
determining an attention index of a driver of a current vehicle;
determining a corresponding time threshold according to the attention index;
determining collision time according to the state information of the current vehicle and the surrounding environment information of the current vehicle;
and if the collision time is less than or equal to the time threshold, sending early warning information to the driver.
According to a second aspect of the present disclosure, there is provided a driving warning apparatus, comprising:
the information acquisition module is used for acquiring the state information of the current vehicle and the surrounding environment information of the current vehicle;
an attention determination module for determining an attention index of a driver of a current vehicle;
the time threshold value determining module is used for determining a corresponding time threshold value according to the attention index;
the collision time determining module is used for determining collision time according to the state information of the current vehicle and the surrounding environment information of the current vehicle;
and the early warning module is used for sending early warning information to the driver when the collision time is less than or equal to the time threshold.
According to a third aspect of the present disclosure, there is provided a computer-readable storage medium storing a computer program for executing the driving warning method according to the first aspect.
According to a fourth aspect of the present disclosure, there is provided an electronic apparatus comprising: a processor; a memory for storing the processor-executable instructions;
the processor is configured to read the executable instructions from the memory and execute the executable instructions to implement the driving warning method according to the first aspect.
Compared with the prior art, the driving early warning method and device provided by the disclosure are adopted to determine the attention index of the driver, determine the corresponding time threshold value, namely the early warning time lead according to the attention index of the driver, and perform early warning when the collision event is less than or equal to the time threshold value, so that the early warning time is related to the attention of the driver, the driver is ensured to finish necessary operation in time, and accidents are avoided.
Drawings
The above and other objects, features and advantages of the present disclosure will become more apparent by describing in more detail embodiments of the present disclosure with reference to the attached drawings. The accompanying drawings are included to provide a further understanding of the embodiments of the disclosure and are incorporated in and constitute a part of this specification, illustrate embodiments of the disclosure and together with the description serve to explain the principles of the disclosure and not to limit the disclosure. In the drawings, like reference numbers generally represent like parts or steps.
Fig. 1 is a schematic structural diagram of a driving warning system according to an exemplary embodiment of the present disclosure;
FIG. 2 is a schematic flow chart diagram illustrating a method of driving warning provided by an exemplary embodiment of the present disclosure;
FIG. 3 is a schematic flow chart diagram illustrating a method of driving warning provided by an exemplary embodiment of the present disclosure;
fig. 4 is a schematic structural diagram of a driving warning device according to an exemplary embodiment of the present disclosure;
fig. 5 is a schematic structural diagram of an attention determining module in a driving warning apparatus according to an exemplary embodiment of the disclosure;
fig. 6 is a schematic structural diagram of a time threshold determination module in the driving warning apparatus according to an exemplary embodiment of the disclosure;
fig. 7 is a schematic structural diagram of an early warning module in an apparatus for driving early warning provided in an exemplary embodiment of the present disclosure;
fig. 8 is a block diagram of an electronic device provided in an exemplary embodiment of the present disclosure.
Detailed Description
Hereinafter, example embodiments according to the present disclosure will be described in detail with reference to the accompanying drawings. It is to be understood that the described embodiments are merely a subset of the embodiments of the present disclosure and not all embodiments of the present disclosure, with the understanding that the present disclosure is not limited to the example embodiments described herein.
It should be noted that: the relative arrangement of the components and steps, the numerical expressions, and numerical values set forth in these embodiments do not limit the scope of the present disclosure unless specifically stated otherwise.
It will be understood by those of skill in the art that the terms "first," "second," and the like in the embodiments of the present disclosure are used merely to distinguish one element from another, and are not intended to imply any particular technical meaning, nor is the necessary logical order between them.
It is also understood that in embodiments of the present disclosure, "a plurality" may refer to two or more and "at least one" may refer to one, two or more.
It is also to be understood that any reference to any component, data, or structure in the embodiments of the disclosure, may be generally understood as one or more, unless explicitly defined otherwise or stated otherwise.
In addition, the term "and/or" in the present disclosure is only one kind of association relationship describing an associated object, and means that three kinds of relationships may exist, for example, a and/or B may mean: a exists alone, A and B exist simultaneously, and B exists alone. In addition, the character "/" in the present disclosure generally indicates that the former and latter associated objects are in an "or" relationship.
It should also be understood that the description of the various embodiments of the present disclosure emphasizes the differences between the various embodiments, and the same or similar parts may be referred to each other, so that the descriptions thereof are omitted for brevity.
Meanwhile, it should be understood that the sizes of the respective portions shown in the drawings are not drawn in an actual proportional relationship for the convenience of description.
The following description of at least one exemplary embodiment is merely illustrative in nature and is in no way intended to limit the disclosure, its application, or uses.
Techniques, methods, and apparatus known to those of ordinary skill in the relevant art may not be discussed in detail but are intended to be part of the specification where appropriate.
It should be noted that: like reference numbers and letters refer to like items in the following figures, and thus, once an item is defined in one figure, further discussion thereof is not required in subsequent figures.
The disclosed embodiments may be applied to electronic devices such as terminal devices, computer systems, servers, etc., which are operational with numerous other general purpose or special purpose computing system environments or configurations. Examples of well known terminal devices, computing systems, environments, and/or configurations that may be suitable for use with electronic devices, such as terminal devices, computer systems, servers, and the like, include, but are not limited to: personal computer systems, server computer systems, thin clients, thick clients, hand-held or laptop devices, microprocessor-based systems, set top boxes, programmable consumer electronics, network pcs, minicomputer systems, mainframe computer systems, distributed cloud computing environments that include any of the above systems, and the like.
Electronic devices such as terminal devices, computer systems, servers, etc. may be described in the general context of computer system-executable instructions, such as program modules, being executed by a computer system. Generally, program modules may include routines, programs, objects, components, logic, data structures, etc. that perform particular tasks or implement particular abstract data types. The computer system/server may be practiced in distributed cloud computing environments where tasks are performed by remote processing devices that are linked through a communications network. In a distributed cloud computing environment, program modules may be located in both local and remote computer system storage media including memory storage devices.
Summary of the application
The driving assistance technology is an important component in the intelligent automobile. The existing auxiliary driving technology can send various prompts to a driver by combining with actual conditions in the driving process, and can also give an early warning to the driver in an emergency, so that driving accidents are effectively avoided.
For example, Advanced Driving Assistance Systems (ADAS) are already commercialized in some vehicle models, and have a collision prevention System, which can warn about potential emergency situations and traffic accidents. The principle is that the state information (such as running speed, direction and the like) of the current vehicle and the surrounding environment information (such as positions, speeds and the like of other surrounding vehicles or various objects) of the current vehicle are detected through various sensors, so that whether collision is possible in a certain time range in the future is judged, and the time when the collision is about to occur is predicted. Thus, the ADAS may forewarn a certain time ahead before the occurrence of the predicted collision. Usually, the advance amount of the early warning time is fixed and constant.
It will be appreciated that the driver should in principle remain highly attentive throughout a long driving period, but in practice the attentiveness conditions will inevitably change to some extent. The speed of response may vary under different mental conditions of the driver. If attention is reduced, the reaction rate is necessarily reduced. When the early warning is carried out by the fixed time lead, if the attention of a driver is insufficient, the driver may not be in time to react and effectively carry out emergency operation, so that accidents are caused. Therefore, the early warning is carried out by adopting the fixed time lead, which cannot be adapted to the reaction speed of the driver and is not beneficial to the driving safety.
Exemplary System
Fig. 1 illustrates an exemplary system architecture 100 to which the method of driving warning or the apparatus of driving warning of an embodiment of the present disclosure may be applied.
As shown in fig. 1, the system architecture 100 may include a terminal device 101, a network 102, a server 103, and a vehicle 104. Network 102 is the medium used to provide communication links between terminal devices 101 and server 103. Network 102 may include various connection types, such as wired, wireless communication links, or fiber optic cables, to name a few.
The vehicle 104 may be provided with a plurality of target detection devices 105 (e.g., lidar) each of which may collect current vehicle state information and current vehicle surrounding environment information. The plurality of object detection devices 105 may be connected to the terminal device 101 in a communication manner, or connected to the server 103 in a communication manner via the network 102, and transmit the collected current vehicle state information and the current vehicle surrounding environment information to the terminal device 101 or the server 104.
The terminal apparatus 101 interacts with the server 103 through the network 102 to receive or transmit messages and the like. Various applications, such as a data processing type application, a map type application, an image processing type application, and the like, may be installed on the terminal apparatus 101.
The terminal device 101 may be various electronic devices including, but not limited to, a mobile terminal such as a mobile phone, a notebook computer, a digital broadcast receiver, a PDA (personal digital assistant), a PAD (tablet computer), a PMP (portable multimedia player), a vehicle-mounted terminal (e.g., a car navigation terminal), and the like.
The server 103 may be a server that provides various services, such as a background data processing server that analyzes the current vehicle state information and the current vehicle surrounding environment information uploaded by the terminal device 101. The background data processing server may process the received status information of the current vehicle and the information of the surrounding environment of the current vehicle to obtain a processing result (e.g., determining a collision time).
It should be noted that the driving warning method provided by the embodiment of the present disclosure may be executed by the server 103, or may be executed by the terminal device 101, and accordingly, the target detection apparatus may be disposed in the server 103, or may be disposed in the terminal device 101.
It should be understood that the number of terminal devices, networks, servers, and vehicles in fig. 1 is merely illustrative. There may be any number of terminal devices, networks, servers, and vehicles, as desired for implementation. In the case where the state information of the current vehicle and the information of the environment around the current vehicle do not need to be remotely processed, the system architecture may not include a network and a server.
Exemplary method
Fig. 2 is a flowchart illustrating a driving warning method according to an exemplary embodiment of the disclosure. The embodiment can be applied to an electronic device, as shown in fig. 2, and includes the following steps:
The current vehicle is the vehicle for which the warning in the present embodiment is directed. The current vehicle state information is various information and parameters representing the current vehicle running state. Such as the current vehicle's speed of travel, direction, location information, lane of presence, etc. The state information can be acquired by sensors such as an IMU and a GPS of the current vehicle.
The environmental information around the current vehicle refers to various potential factors which may cause a collision accident within a certain range around the position where the current vehicle is located. Such as the location of nearby pedestrians or vehicles, the speed and direction of travel, the location of nearby obstacles, etc. The image information may be acquired by a camera or a laser radar installed on the current vehicle, and the environmental information around the current vehicle is identified from the image information.
For the current vehicle configured with the ADAS, the state information and the environment information can be acquired through the ADAS. In other cases, the status information and the environmental information may be acquired by various sensors not belonging to the ADAS currently mounted on the vehicle. This is not limited in this embodiment.
In this embodiment, the attention index of the driver may be determined by performing corresponding analysis based on various physiological characteristics currently exhibited by the driver. The attention index may be considered to be a quantitative representation of the driver's concentration. Depending on the value of the attention index, it may represent varying degrees of driver attention from concentration to distraction.
In addition, the ADAS of the related art also has a physiological status monitoring system for the driver, which can detect the face of the driver by using a camera, determine the attention index of the driver, and determine that the driver has a discrete attention such as dozing or playing a mobile phone. Of course in other cases the driver's attention index may be determined by other means than ADAS. This is not limited in this embodiment.
The value of the attention index may represent the degree to which the driver's attention is drawn from concentration to distraction. With varying degrees of attention, the speed of response of the driver, and the speed at which effective emergency operation is undertaken in an emergency situation, vary. In this step, the corresponding time threshold will be determined from the attention index. The time threshold is a time length of the warning time relative to the collision occurrence time, in other words, a time advance of the warning.
It will be appreciated that if the attention index indicates that the driver is more attentive, the speed of reaction and emergency operation should be faster and the length of time threshold required is shorter. That is, a shorter time threshold is sufficient for the driver to complete the necessary operations, thereby avoiding an accident. Conversely, if the attention index indicates that the driver is less attentive, the slower its speed of reaction and emergency operation should be, the longer the length of the time threshold required. That is, the driver can be ensured to have time to complete the necessary operation by performing the early warning more in advance. For example, the time threshold may be set to 1.2 seconds at a particular attention index, i.e., it is considered that a warning is needed if a collision will occur within 1.2 seconds in the future.
And step 204, determining the collision time according to the state information of the current vehicle and the surrounding environment information of the current vehicle.
According to the state information of the current vehicle and the information of the surrounding environment of the current vehicle, whether potential possibility of collision accidents exists currently can be determined. That is, it is analyzed whether a collision will occur in the future in the case where the current vehicle and all other surrounding vehicles, pedestrians, and obstacles keep the current physical movement trend unchanged. If a collision is about to occur in the future, the time when the collision occurs and the time difference between the time when the collision occurs and the current time are further calculated. The time difference between the collision occurrence time and the current time is the collision time involved in this step. In other words, the time of collision reflects how long after the collision will occur.
In the existing ADAS, the Collision Time may be determined by a Collision Time function (i.e., Time to Collision, TTC). Of course in other cases the time of collision may be determined by other means than ADAS. This is not limited in this embodiment.
And step 205, if the collision time is less than or equal to the time threshold, sending early warning information to the driver.
After the collision time and the time threshold are determined, the collision time and the time threshold can be compared to judge whether the driver needs to be warned at present. Specifically, if the collision time is less than or equal to the time threshold, the warning information is sent to the driver.
For example, a time threshold is determined to be 1.2 seconds at a certain time, that is, if a collision will occur within 1.2 seconds in the future, an early warning is required; the collision event is determined to be 1.1 seconds, i.e., it is considered that a collision may occur after 1.1 seconds in the future. It is apparent that the time to collision is less than the time threshold at this time. That is, it is necessary to transmit warning information to the driver at that time so that it can cope with a collision accident that will occur in the future.
According to the technical scheme, the beneficial effects of the embodiment are as follows: the attention index of the driver is determined, a corresponding time threshold, namely the time lead of early warning, is determined according to the attention index of the driver, and early warning is carried out when the collision event is smaller than or equal to the time threshold, so that the early warning time is related to the attention of the driver, the driver is ensured to finish necessary operation in time, and accidents are avoided.
Fig. 2 shows only a basic embodiment of the method of the present disclosure, and based on this, certain optimization and expansion can be performed, and other preferred embodiments of the method can also be obtained.
Fig. 3 is a schematic flow chart of a driving warning method according to another exemplary embodiment of the present disclosure. The embodiment can be applied to electronic equipment. This embodiment will be explained in more detail based on the embodiment shown in fig. 2. In this embodiment, the method includes the steps of:
and 301, acquiring the state information of the current vehicle and the surrounding environment information of the current vehicle.
This step is consistent with the embodiment shown in fig. 2, and will not be repeated here.
In this embodiment, it may be preferable to start a subsequent process to warn a driver of the current vehicle when the state information of the current vehicle satisfies a preset state condition. Specifically, whether the current vehicle is in the driving state or not can be judged according to the state information of the current vehicle, and if the current vehicle is in the driving state, the current vehicle is considered to meet the preset condition. That is, the subsequent process may be started for warning only when the current vehicle is running, and warning is unnecessary when the current vehicle is stationary. Or, the speed of the vehicle can be judged according to the current state information of the vehicle, and when the speed of the vehicle is greater than a preset speed threshold, the vehicle is considered to meet the preset condition. That is, the subsequent process may be started to perform the warning only when the current vehicle speed is high, and the warning is unnecessary when the current vehicle speed is low. Therefore, the embodiment can start the subsequent flow only when necessary, and avoids unnecessary occupation of computing resources.
After the current vehicle is determined to need to be warned according to the subsequent process, the physiological information of the driver can be further acquired so as to calculate and determine the attention index of the driver. In this embodiment, the physiological information may include facial feature information of the driver, and the facial feature information may be obtained by acquiring a facial image of the driver through a camera. The physiological information may also include heart rate, breathing rate and/or blood pressure of the driver, and this part of the physiological information may be obtained through a wearable smart device worn by the driver.
When the physiological information includes facial feature information, the facial feature information may be identified to determine an attention index. The identification of facial feature information may be based on current image analysis techniques. For example, the driver can determine whether the driver has behaviors such as squinting and yawning by analyzing the movement and the form of the eyes and the mouth of the driver. If this occurs, the driver may be considered tired and attentive. From which its attention index can be determined. Or the sight line direction of the driver can be analyzed through the eye characteristics, and the sight line is judged to be the road watching condition, or the eyes are distracted, or the driver can watch the mobile phone. The attention index can also be determined according to different situations reflected by the sight line. For example, it may be determined whether the frequency with which the driver looks at the left and right mirrors is low, and if so, it may mean that the attention is low. Or whether the driver watches the mobile phone for a long time and makes a call, whether the driver turns around to watch other passengers and converses, and the like. Such a situation means a decrease in the attention of the driver. In the embodiment, the corresponding attention index can be calculated by sight line through similar behaviors capable of reflecting the attention state of the driver.
In the existing ADAS, there is a physiological status monitoring system, which can detect the face of the driver by using a camera to determine whether the driver is dozing. The attention index may be determined by ADAS in this embodiment, or may be determined by other devices besides ADAS, which is not limited herein.
In addition, when the physiological information may further include a heart rate, a breathing rate, and/or a blood pressure according to the driver, the attention index of the driver may be determined according to the above-described physiological characteristics. In general, it is considered that physiological information such as a heart rate, a respiratory rate, and a blood pressure of a person may change to some extent when the person is attentive or not attentive, and therefore, in this embodiment, an attention index of a driver may be reversely estimated based on such a principle.
In this embodiment, the two ways of determining the attention index may be implemented independently or in combination, so as to verify and supplement each other, and further improve the accuracy of the attention index.
And step 304, determining a corresponding time threshold according to the attention index.
In this embodiment, at least one threshold value may be set for the attention index, and a corresponding time threshold value may be determined according to the threshold value. Specifically, if the attention index is higher than a preset threshold value, determining the first time length as a time threshold value; and if the attention index is not higher than a preset threshold value, determining the second time length as a time threshold value.
For example, assume that the values of the attention index include 1, 2, 3, 4, 5; the driver's attention increases as the value of the attention index increases. The threshold value may be set to 3. Namely, when the attention index is considered to be higher than 3, the attention index is relatively more focused; the time threshold may be set to a relatively short first time threshold of 0.6 seconds. Otherwise, when the attention index is not higher than 3, the attention index is relatively inattentive; the time threshold may be set to a relatively long second time threshold of 2 seconds.
And step 305, determining the collision time according to the state information of the current vehicle and the surrounding environment information of the current vehicle.
And step 306, if the collision time is less than or equal to the time threshold, sending early warning information to the driver.
The above steps 305 to 306 are consistent with the embodiment shown in fig. 2, and will not be repeated here.
And 307, if the collision time is larger than the time threshold, determining the attention index of the driver of the current vehicle.
If the collision time is larger than the time threshold, the collision accident is not considered to occur within the range of the time threshold. For example, a time threshold is determined to be 2 seconds at a certain time, that is, if a collision will occur within 2 seconds in the future, an early warning is required; a collision event is determined to be 30 seconds, i.e., a collision is considered to be likely to occur after 30 seconds in the future. It is apparent that the time to collision is greater than the time threshold at this time. That is, no warning is required at this time. In this embodiment, when it is determined that the driver does not need to perform the warning, the process may return to step 303, that is, the attention index of the driver is determined again, whether the attention of the driver changes is determined, and then the subsequent process is executed again to form a loop, so as to determine whether the driver needs to be warned in real time.
In addition, if it is determined that a collision accident does not occur within a future predictable time range based on the current vehicle state information and the current vehicle surrounding environment information, the process may also return to step 303 to be circulated.
The embodiment further has the following beneficial effects on the basis of the embodiment shown in fig. 2: the subsequent flow is started only when necessary, so that unnecessary occupation of operation resources is avoided; the attention index is determined in various ways so as to be mutually verified and supplemented, and the accuracy of the attention index is further improved; under the condition of no need of early warning, the attention index of the driver can be judged again to form a circulation flow, and whether the driver is early warned or not is judged in real time.
Exemplary devices
Fig. 4 is a schematic structural diagram of a driving warning device according to an exemplary embodiment of the present disclosure. The apparatus of this embodiment is a physical apparatus for executing the methods of fig. 2 to 3. The technical solution is essentially the same as that in the above embodiment, and the corresponding description in the above embodiment is also applicable to this embodiment.
The device in the embodiment comprises:
the information acquiring module 401 is configured to acquire state information of a current vehicle and information of a surrounding environment of the current vehicle.
An attention determination module 402 for determining an attention index of a driver of the current vehicle;
a time threshold determination module 403, configured to determine a corresponding time threshold according to the attention index.
And a collision time determining module 404, configured to determine a collision time according to the state information of the current vehicle and the information of the surrounding environment of the current vehicle.
And the early warning module 405 is used for sending early warning information to the driver when the collision time is less than or equal to the time threshold.
Fig. 5 is a schematic structural diagram of the attention force determination module 402 in the driving warning apparatus according to another exemplary embodiment of the disclosure. As shown in FIG. 5, in an exemplary embodiment, the attention determination module 402 includes:
the physiological information acquiring unit 511 is configured to acquire the physiological information of the driver when the state information of the current vehicle satisfies a preset state condition. The physiological information includes facial feature information of the driver; and/or the heart rate, respiratory rate and/or blood pressure of the driver.
A first attention index determining unit 512, configured to identify the facial feature information to determine an attention index.
A second attention index determination unit 513 for determining an attention index based on the heart rate, the breathing rate and/or the blood pressure of the driver.
Fig. 6 is a schematic structural diagram of a time threshold determination module 403 in the driving warning apparatus according to another exemplary embodiment of the disclosure. As shown in fig. 6, in an exemplary embodiment, the time threshold determination module 403 includes:
a first time threshold determination unit 611, configured to determine a first time length as a time threshold when the attention index is higher than a preset threshold;
a second time threshold determining unit 612, configured to determine the second duration as the time threshold when the attention index is not higher than the preset threshold.
Fig. 7 is a schematic structural diagram of an early warning module 405 in an apparatus for driving early warning provided in another exemplary embodiment of the present disclosure. As shown in fig. 7, in an exemplary embodiment, the early warning module 405 includes:
an early warning information transmitting unit 711 for transmitting early warning information to the driver when the collision time is less than or equal to the time threshold
And a loop warning unit 712, configured to determine an attention index of a driver of the current vehicle when the collision time is greater than the time threshold.
Exemplary electronic device
Next, an electronic apparatus according to an embodiment of the present disclosure is described with reference to fig. 8. The electronic device may be either or both of the first device 100 and the second device 200, or a stand-alone device separate from them that may communicate with the first device and the second device to receive the collected input signals therefrom.
FIG. 8 illustrates a block diagram of an electronic device in accordance with an embodiment of the disclosure.
As shown in fig. 8, the electronic device 10 includes one or more processors 11 and memory 12.
The processor 11 may be a Central Processing Unit (CPU) or other form of processing unit having data processing capabilities and/or instruction execution capabilities, and may control other components in the electronic device 10 to perform desired functions.
Memory 12 may include one or more computer program products that may include various forms of computer-readable storage media, such as volatile memory and/or non-volatile memory. The volatile memory may include, for example, Random Access Memory (RAM), cache memory (cache), and/or the like. The non-volatile memory may include, for example, Read Only Memory (ROM), hard disk, flash memory, etc. One or more computer program instructions may be stored on the computer-readable storage medium and executed by processor 11 to implement the method of driving warnings of the various embodiments of the present disclosure described above and/or other desired functions. Various contents such as an input signal, a signal component, a noise component, etc. may also be stored in the computer-readable storage medium.
In one example, the electronic device 10 may further include: an input device 13 and an output device 14, which are interconnected by a bus system and/or other form of connection mechanism (not shown).
For example, when the electronic device is the first device 100 or the second device 200, the input device 13 may be a microphone or a microphone array as described above for capturing an input signal of a sound source. When the electronic device is a stand-alone device, the input means 13 may be a communication network connector for receiving the acquired input signals from the first device 100 and the second device 200.
The input device 13 may also include, for example, a keyboard, a mouse, and the like.
The output device 14 may output various information including the determined distance information, direction information, and the like to the outside. The output devices 14 may include, for example, a display, speakers, a printer, and a communication network and its connected remote output devices, among others.
Of course, for simplicity, only some of the components of the electronic device 10 relevant to the present disclosure are shown in fig. 8, omitting components such as buses, input/output interfaces, and the like. In addition, the electronic device 10 may include any other suitable components depending on the particular application.
Exemplary computer program product and computer-readable storage Medium
In addition to the above-described methods and apparatus, embodiments of the present disclosure may also be a computer program product comprising computer program instructions that, when executed by a processor, cause the processor to perform the steps in the method of driving warning according to various embodiments of the present disclosure described in the "exemplary methods" section of this specification above.
The computer program product may write program code for carrying out operations for embodiments of the present disclosure in any combination of one or more programming languages, including an object oriented programming language such as Java, C + + or the like and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computing device, partly on the user's device, as a stand-alone software package, partly on the user's computing device and partly on a remote computing device, or entirely on the remote computing device or server.
Furthermore, embodiments of the present disclosure may also be a computer-readable storage medium having stored thereon computer program instructions that, when executed by a processor, cause the processor to perform the steps in the method of driving warning according to various embodiments of the present disclosure described in the "exemplary methods" section above in this specification.
The computer-readable storage medium may take any combination of one or more readable media. The readable medium may be a readable signal medium or a readable storage medium. A readable storage medium may include, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or a combination of any of the foregoing. More specific examples (a non-exhaustive list) of the readable storage medium include: an electrical connection having one or more wires, a portable disk, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.
The foregoing describes the general principles of the present disclosure in conjunction with specific embodiments, however, it is noted that the advantages, effects, etc. mentioned in the present disclosure are merely examples and are not limiting, and they should not be considered essential to the various embodiments of the present disclosure. Furthermore, the foregoing disclosure of specific details is for the purpose of illustration and description and is not intended to be limiting, since the disclosure is not intended to be limited to the specific details so described.
The block diagrams of devices, apparatuses, systems referred to in this disclosure are only given as illustrative examples and are not intended to require or imply that the connections, arrangements, configurations, etc. must be made in the manner shown in the block diagrams. These devices, apparatuses, devices, systems may be connected, arranged, configured in any manner, as will be appreciated by those skilled in the art. Words such as "including," "comprising," "having," and the like are open-ended words that mean "including, but not limited to," and are used interchangeably therewith. The words "or" and "as used herein mean, and are used interchangeably with, the word" and/or, "unless the context clearly dictates otherwise. The word "such as" is used herein to mean, and is used interchangeably with, the phrase "such as but not limited to".
It is also noted that in the devices, apparatuses, and methods of the present disclosure, each component or step can be decomposed and/or recombined. These decompositions and/or recombinations are to be considered equivalents of the present disclosure.
The previous description of the disclosed aspects is provided to enable any person skilled in the art to make or use the present disclosure. Various modifications to these aspects will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other aspects without departing from the scope of the disclosure. Thus, the present disclosure is not intended to be limited to the aspects shown herein but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.
The foregoing description has been presented for purposes of illustration and description. Furthermore, this description is not intended to limit embodiments of the disclosure to the form disclosed herein. While a number of example aspects and embodiments have been discussed above, those of skill in the art will recognize certain variations, modifications, alterations, additions and sub-combinations thereof.
Claims (10)
1. A method of driving warning, comprising:
acquiring state information of a current vehicle and information of the surrounding environment of the current vehicle;
determining an attention index of a driver of a current vehicle;
determining a corresponding time threshold according to the attention index;
determining collision time according to the state information of the current vehicle and the surrounding environment information of the current vehicle;
and if the collision time is less than or equal to the time threshold, sending early warning information to the driver.
2. The method of claim 1, wherein the method further comprises:
and when the state information of the current vehicle meets a preset state condition, determining the attention index of the driver of the current vehicle.
3. The method of claim 1, wherein the determining an attention index of a driver of the current vehicle comprises:
acquiring physiological information of the driver;
determining the attention index from the driver's physiological information.
4. The method of claim 3, wherein the physiological information includes facial feature information of the driver;
the determining the attention index from the driver's physiological information comprises:
identifying the facial feature information to determine the attention index.
5. The method of claim 3, wherein the physiological information includes a heart rate, a breathing rate, and/or a blood pressure of the driver;
the determining the attention index from the driver's physiological information comprises:
determining the attention index from the heart rate, respiratory rate and/or blood pressure of the driver.
6. The method of claim 1, further comprising:
and if the collision time is larger than the time threshold, determining the attention index of the driver of the current vehicle.
7. The method of any of claims 1-6, wherein said determining a respective time threshold from said attention index comprises:
if the attention index is higher than a preset threshold value, determining a first time length as the time threshold value;
and if the attention index is not higher than the preset threshold value, determining a second time length as the time threshold value.
8. A device for driving warning, comprising:
the information acquisition module is used for acquiring the state information of the current vehicle and the surrounding environment information of the current vehicle;
an attention determination module for determining an attention index of a driver of a current vehicle;
the time threshold value determining module is used for determining a corresponding time threshold value according to the attention index;
the collision time determining module is used for determining collision time according to the state information of the current vehicle and the surrounding environment information of the current vehicle;
and the early warning module is used for sending early warning information to the driver when the collision time is less than or equal to the time threshold.
9. A computer-readable storage medium storing a computer program for executing the driving warning method according to any one of claims 1 to 7.
10. An electronic device, the electronic device comprising:
a processor;
a memory for storing the processor-executable instructions;
the processor is used for reading the executable instructions from the memory and executing the instructions to realize the driving warning method of any one of the claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911287896.5A CN112991684A (en) | 2019-12-15 | 2019-12-15 | Driving early warning method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911287896.5A CN112991684A (en) | 2019-12-15 | 2019-12-15 | Driving early warning method and device |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN112991684A true CN112991684A (en) | 2021-06-18 |
Family
ID=76342765
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201911287896.5A Pending CN112991684A (en) | 2019-12-15 | 2019-12-15 | Driving early warning method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112991684A (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113682112A (en) * | 2021-09-15 | 2021-11-23 | 深圳地平线机器人科技有限公司 | Method and device for controlling gas in vehicle |
| CN113726464A (en) * | 2021-10-21 | 2021-11-30 | 浙江吉利控股集团有限公司 | Bidirectional early warning method, system, equipment and storage medium for vehicle and rider |
| CN115148050A (en) * | 2022-06-27 | 2022-10-04 | 中国第一汽车股份有限公司 | Collision early warning method, device, equipment and storage medium |
| CN115951692A (en) * | 2023-03-15 | 2023-04-11 | 珠海骏驰智联科技有限公司 | Unmanned trajectory control system based on model predictive control |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| DE102007050962A1 (en) * | 2007-10-23 | 2009-04-30 | Deutsches Zentrum für Luft- und Raumfahrt e.V. | Collision warning system for warning driver of vehicle before collisions with object in periphery of vehicle, has control device to generate control signal |
| CN104794855A (en) * | 2014-01-22 | 2015-07-22 | 径卫视觉科技（上海）有限公司 | Driver's attention comprehensive assessment system |
| CN105303830A (en) * | 2015-09-15 | 2016-02-03 | 成都通甲优博科技有限责任公司 | Driving behavior analysis system and analysis method |
| CN109741630A (en) * | 2019-01-18 | 2019-05-10 | 爱驰汽车有限公司 | Away from threshold value of warning adjusting method, system, equipment and storage medium when automobile |
| CN109801511A (en) * | 2017-11-16 | 2019-05-24 | 华为技术有限公司 | A kind of anti-collision warning method and device |
-
2019
- 2019-12-15 CN CN201911287896.5A patent/CN112991684A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| DE102007050962A1 (en) * | 2007-10-23 | 2009-04-30 | Deutsches Zentrum für Luft- und Raumfahrt e.V. | Collision warning system for warning driver of vehicle before collisions with object in periphery of vehicle, has control device to generate control signal |
| CN104794855A (en) * | 2014-01-22 | 2015-07-22 | 径卫视觉科技（上海）有限公司 | Driver's attention comprehensive assessment system |
| CN105303830A (en) * | 2015-09-15 | 2016-02-03 | 成都通甲优博科技有限责任公司 | Driving behavior analysis system and analysis method |
| CN109801511A (en) * | 2017-11-16 | 2019-05-24 | 华为技术有限公司 | A kind of anti-collision warning method and device |
| CN109741630A (en) * | 2019-01-18 | 2019-05-10 | 爱驰汽车有限公司 | Away from threshold value of warning adjusting method, system, equipment and storage medium when automobile |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113682112A (en) * | 2021-09-15 | 2021-11-23 | 深圳地平线机器人科技有限公司 | Method and device for controlling gas in vehicle |
| CN113726464A (en) * | 2021-10-21 | 2021-11-30 | 浙江吉利控股集团有限公司 | Bidirectional early warning method, system, equipment and storage medium for vehicle and rider |
| CN115148050A (en) * | 2022-06-27 | 2022-10-04 | 中国第一汽车股份有限公司 | Collision early warning method, device, equipment and storage medium |
| CN115951692A (en) * | 2023-03-15 | 2023-04-11 | 珠海骏驰智联科技有限公司 | Unmanned trajectory control system based on model predictive control |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11295143B2 (en) | Information processing apparatus, information processing method, and program | |
| WO2022062659A1 (en) | Intelligent driving control method and apparatus, vehicle, electronic device, and storage medium | |
| CN112991684A (en) | Driving early warning method and device | |
| KR102205240B1 (en) | Unexpected Impulse Change Collision Detector | |
| US20200017124A1 (en) | Adaptive driver monitoring for advanced driver-assistance systems | |
| CN109455180B (en) | Method and device for controlling unmanned vehicle | |
| EP3756966A1 (en) | Method and apparatus for controlling unmanned vehicle | |
| US11945435B2 (en) | Devices and methods for predicting collisions and/or intersection violations | |
| US10336252B2 (en) | Long term driving danger prediction system | |
| US20140125474A1 (en) | Adaptive actuator interface for active driver warning | |
| CN109720348B (en) | In-vehicle device, information processing system, and information processing method | |
| CN109712431B (en) | Driving support device and driving support system | |
| CN111547043A (en) | Automatic response to emergency service vehicle by autonomous vehicle | |
| US11567509B2 (en) | Control system, control method, and non-transitory storage medium | |
| US20180162267A1 (en) | Contextual priority signal in autonomous environment | |
| CN109624985B (en) | Early warning method and device for preventing fatigue driving | |
| CN113619588A (en) | Driving behavior reminding method and device, storage medium and electronic equipment | |
| CN112997229A (en) | Information processing apparatus, information processing method, and program | |
| US20210312193A1 (en) | Devices and methods for predicting intersection violations and/or collisions | |
| US20230166731A1 (en) | Devices and methods for assisting operation of vehicles based on situational assessment fusing expoential risks (safer) | |
| JP2021163345A (en) | Driving support device and data collection system | |
| CN110254442B (en) | Method and apparatus for controlling vehicle display | |
| Lashkov et al. | Smartphone-based intelligent driver assistant: context model and dangerous state recognition scheme | |
| CN111278708A (en) | Method and device for assisting driving | |
| US20210309221A1 (en) | Devices and methods for determining region of interest for object detection in camera images |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20210618 |