CN107284449A - A kind of traffic safety method for early warning and system, automobile, readable storage medium storing program for executing - Google Patents
A kind of traffic safety method for early warning and system, automobile, readable storage medium storing program for executing Download PDFInfo
- Publication number
- CN107284449A CN107284449A CN201710448230.8A CN201710448230A CN107284449A CN 107284449 A CN107284449 A CN 107284449A CN 201710448230 A CN201710448230 A CN 201710448230A CN 107284449 A CN107284449 A CN 107284449A
- Authority
- CN
- China
- Prior art keywords
- driver
- image
- information
- driving
- image data
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 27
- 210000005252 bulbus oculi Anatomy 0.000 claims description 44
- 210000001508 eye Anatomy 0.000 claims description 8
- 238000010606 normalization Methods 0.000 claims description 6
- 230000003287 optical effect Effects 0.000 claims description 5
- 230000009977 dual effect Effects 0.000 claims description 3
- 230000011514 reflex Effects 0.000 abstract 2
- 230000006399 behavior Effects 0.000 description 7
- 238000010586 diagram Methods 0.000 description 6
- 230000006870 function Effects 0.000 description 6
- 238000004590 computer program Methods 0.000 description 3
- 239000000284 extract Substances 0.000 description 3
- 230000008569 process Effects 0.000 description 3
- 241000282414 Homo sapiens Species 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 206010039203 Road traffic accident Diseases 0.000 description 1
- 230000008878 coupling Effects 0.000 description 1
- 238000010168 coupling process Methods 0.000 description 1
- 238000005859 coupling reaction Methods 0.000 description 1
- 238000001514 detection method Methods 0.000 description 1
- 239000000463 material Substances 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000007781 pre-processing Methods 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 239000000758 substrate Substances 0.000 description 1
- 238000012795 verification Methods 0.000 description 1
Classifications
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W40/00—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models
- B60W40/08—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models related to drivers or passengers
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W40/00—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models
- B60W40/08—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models related to drivers or passengers
- B60W40/09—Driving style or behaviour
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W50/00—Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
- B60W50/08—Interaction between the driver and the control system
- B60W50/14—Means for informing the driver, warning the driver or prompting a driver intervention
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W40/00—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models
- B60W40/08—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models related to drivers or passengers
- B60W2040/0809—Driver authorisation; Driver identity check
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W50/00—Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
- B60W50/08—Interaction between the driver and the control system
- B60W50/14—Means for informing the driver, warning the driver or prompting a driver intervention
- B60W2050/143—Alarm means
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W50/00—Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
- B60W50/08—Interaction between the driver and the control system
- B60W50/14—Means for informing the driver, warning the driver or prompting a driver intervention
- B60W2050/146—Display means
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W2540/00—Input parameters relating to occupants
- B60W2540/18—Steering angle
Landscapes
- Engineering & Computer Science (AREA)
- Automation & Control Theory (AREA)
- Transportation (AREA)
- Mechanical Engineering (AREA)
- Physics & Mathematics (AREA)
- Mathematical Physics (AREA)
- Human Computer Interaction (AREA)
- Traffic Control Systems (AREA)
Abstract
A kind of traffic safety method for early warning and system, the system includes image collecting device, vehicle-mounted direction sensor, digital signal processor and vehicle alarming device, because the application is according to vehicle-mounted direction sensor collection vehicle traveling direction information or/and wheel steering angle information, direction should be paid close attention to by obtaining current drive, and utilize the ocular reflex view data of image acquisition device driver, vehicle steering is extracted from ocular reflex image, the object of reference information such as front windshield and rearview mirror image, driver's current gaze direction is obtained by analyzing these object of reference information, can real-time judge pilot's line of vision whether with current driving should to pay close attention to direction consistent, alarm is sent in time when inconsistent, the dangerous driving of driver can be avoided, traffic safety is ensured.Correspondingly, present invention also provides a kind of automobile including the traffic safety early warning system and a kind of readable storage medium storing program for executing.
Description
Technical Field
The invention relates to the technical field of vehicle-mounted safety, in particular to a driving safety early warning method and system, an automobile and a readable storage medium.
Background
With the progress of economy and society, the automobile industry is rapidly developed, the number of automobiles is continuously increased, the transportation is increasingly busy, personal casualties and property loss caused by the increase of automobile accidents become a social problem which is not ignored, the importance of driving safety to human beings is self-evident, and the driving safety problem needs to be paid attention urgently.
The existing technologies such as anti-lock braking system (ABS), brake force distribution (EBD/CBC), brake assist (EBA/BAS/BA), traction control (ASR/TCS/TRC), vehicle body stability control (ESP/DSC/VSC), vehicle-mounted anti-collision radar, fatigue driving detection and early warning can guarantee the safety of a driver to a certain extent, but the technologies can only prevent the possibility that the vehicle will generate uncontrollable danger, pay little attention to the sight problem of the driver, and cannot timely early warn the dangerous driving behavior of the driver.
Disclosure of Invention
The application provides a driving safety early warning method and system, an automobile and a readable storage medium, wherein whether the sight of a driver is in the current driving attention direction or not is judged, and an alarm is given out when the sight deviates, so that the behavior of dangerous driving of the driver is early warned in time.
According to a first aspect of the present application, the present application provides a driving safety early warning system, including:
the image acquisition device is used for acquiring eyeball reflection image data of the driver in real time;
the vehicle-mounted direction sensor is used for acquiring the driving direction information of the automobile or/and the steering angle information of a steering wheel in real time;
the digital signal processor is used for obtaining the direction to be paid attention to by current driving according to the automobile driving direction information or/and the steering wheel steering angle information acquired by the vehicle-mounted direction sensor; the image acquisition device is used for acquiring eyeball reflection image data of a driver, acquiring reference object image information from the eyeball reflection image data acquired by the image acquisition device, wherein the reference object image information at least comprises image information of a steering wheel, a front windshield and a rearview mirror of the driver, and acquiring the current sight direction of the driver according to the reference object image information; judging whether the current sight line direction of the driver is consistent with the current driving attention direction;
and the vehicle-mounted alarm device is used for warning and reminding when the judgment result of the digital signal processor is inconsistent.
In some embodiments of the present invention, the,
the image acquisition device is also used for acquiring iris image data or face image data of a driver;
the digital signal processor is also used for identifying the identity of the driver and locking the driver according to the iris image data or the face image data.
In some embodiments, the image capture device further comprises an infrared lamp for projecting infrared light toward the driver's eyes and an IR-CUT dual filter for shielding visible light.
In some embodiments, the image acquisition apparatus comprises: the camera lens is used for acquiring the iris image or the face image of the driver and shooting the eyeball reflection image of the driver in real time, and the image sensor is used for converting the image from an optical image into a digital electronic signal.
According to a second aspect of the present application, the present application provides a driving safety warning method, including:
the method comprises the following steps of data acquisition, namely acquiring eyeball reflection image data of a driver and automobile driving direction information or/and steering wheel steering angle information in real time;
a data processing step, namely obtaining the direction to be paid attention to by current driving according to the automobile driving direction information or/and the steering wheel steering angle information; extracting reference object image information from the eyeball reflection image data, wherein the reference object image information at least comprises image information of an automobile steering wheel, a front windshield and a rearview mirror, and obtaining the current sight direction of a driver according to the reference object image information;
and analyzing and judging, namely judging whether the current sight direction of the driver is consistent with the current direction to be paid attention to, and outputting an alarm signal when the current sight direction of the driver is inconsistent with the current direction to be paid attention to.
In some embodiments of the present invention, the,
the data acquisition step further comprises: acquiring iris image data or face image data of a driver;
the data processing step further comprises: and identifying the identity of the driver and locking the driver according to the iris image data or the face image data.
In some embodiments, the data processing step further comprises: before extracting the reference object image information from the eyeball reflection image data, normalization processing is further performed on the eyeball reflection image by positioning the central point of each eyeball.
In some embodiments of the present invention, the,
the analyzing and judging step further comprises: and analyzing the driving behavior habit information of the driver according to the iris image or the face image data and the alarm signal data.
According to a third aspect of the present application, there is provided an automobile comprising: a driving safety warning system according to any one of the first aspect of the present application.
According to a fourth aspect of the application, the application provides a readable storage medium comprising a program executable by a processor to implement the method according to any one of the second aspects of the application.
According to the driving safety early warning method and system, the current driving attention direction is obtained according to the automobile driving direction information or/and the steering wheel steering angle information, the reference object information such as the automobile steering wheel, the front windshield and the rearview mirror image is extracted from the eyeball reflection image of the driver, the current sight line direction of the driver is obtained by analyzing the reference object information, whether the sight line of the driver is consistent with the current driving attention direction or not can be judged in real time, the alarm is given in time when the sight line of the driver is inconsistent, the dangerous driving of the driver can be avoided, and the driving safety is guaranteed.
Drawings
Fig. 1 is a schematic structural diagram of a driving safety warning system according to the present application;
FIG. 2 is a schematic view of an eyeball reflection image;
FIG. 3 is a schematic diagram illustrating an internal configuration of the driving safety warning system according to an embodiment;
FIG. 4 is a schematic diagram of the internal components of a driving safety warning system implementing a data processing process diagram of a routine vehicle safety warning system;
fig. 5 is a flow chart of a driving safety warning method.
Detailed Description
The present invention will be described in further detail with reference to the following detailed description and accompanying drawings. Wherein like elements in different embodiments are numbered with like associated elements. In the following description, numerous details are set forth in order to provide a better understanding of the present application. However, those skilled in the art will readily recognize that some of the features may be omitted or replaced with other elements, materials, methods in different instances. In some instances, certain operations related to the present application have not been shown or described in detail in order to avoid obscuring the core of the present application from excessive description, and it is not necessary for those skilled in the art to describe these operations in detail, so that they may be fully understood from the description in the specification and the general knowledge in the art.
Furthermore, the features, operations, or characteristics described in the specification may be combined in any suitable manner to form various embodiments. Also, the various steps or actions in the method descriptions may be transposed or transposed in order, as will be apparent to one of ordinary skill in the art. Thus, the various sequences in the specification and drawings are for the purpose of describing certain embodiments only and are not intended to imply a required sequence unless otherwise indicated where such sequence must be followed.
The numbering of the components as such, e.g., "first", "second", etc., is used herein only to distinguish the objects as described, and does not have any sequential or technical meaning. The term "connected" and "coupled" when used in this application, unless otherwise indicated, includes both direct and indirect connections (couplings).
It is known that when driving a car, the driver should pay attention to the direction of the attention, for example, when driving straight at high speed, the driver should pay attention to the front side, and when turning, the driver should pay attention to the rear view mirror and the direction to be turned, but the driver cannot keep looking at the rear view mirror for too long time to avoid danger. In order to guarantee driving safety, the method extracts reference object information such as an automobile steering wheel, a front windshield image and a rearview mirror image from an eyeball reflection image of the driver, judges whether the sight line of the driver is in the current driving attention direction in real time by analyzing the reference object information, and gives an alarm in time when the sight line deviates to avoid dangerous driving of the driver.
The first embodiment is as follows:
please refer to fig. 1, which is a driving safety early warning system according to the present application, the driving safety early warning system includes an image acquisition device 1, a vehicle-mounted direction sensor 6, a digital signal processor 2 and a vehicle-mounted alarm device 3, which will be described in detail below.
The image acquisition device 1 is used for acquiring eyeball reflection image data of a driver in real time. Fig. 2 is a schematic view of an eyeball reflection image.
The vehicle-mounted direction sensor 6 is used for collecting the driving direction information of the automobile or/and the steering angle information of the steering wheel in real time.
The input end of the digital signal processor 2 is connected with the image acquisition device 1 and the vehicle-mounted direction sensor 6, and the output end is connected with the vehicle-mounted alarm device 3.
The digital signal processor 2 is used for obtaining the direction to be paid attention to by current driving according to the automobile driving direction information or/and the steering wheel steering angle information acquired by the vehicle-mounted direction sensor 6; the device is used for extracting reference object image information from eyeball reflection image data acquired by the image acquisition device 1, wherein the reference object image information at least comprises image information of a steering wheel, a front windshield and a rearview mirror of an automobile, and the current sight direction of a driver is obtained according to the reference object image information; and judging whether the current sight direction of the driver is consistent with the current direction to be paid attention to the driving, and outputting an alarm signal when the current sight direction of the driver is inconsistent with the current direction to be paid attention to the driving.
And the vehicle-mounted alarm device 3 is used for sending out corresponding alarm reminding according to the alarm signal, and the alarm reminding at least comprises voice reminding, buzzing alarm or/and display reminding.
In some embodiments, the dsp 2 further performs normalization of the eye reflection image by locating the center point of each eyeball, and extracts reference image information from the normalized eyeball reflection image data. In one embodiment, the dsp 2 uses an integral projection algorithm to achieve center point positioning for each eye. In other embodiments, the digital signal processor 2 further uses some existing image preprocessing techniques, such as image enhancement and image binarization, to eliminate noise interference of the eye reflection image by using an integral projection curve, so as to obtain real image information.
In some embodiments, the alarm signal from the DSP 2 may be used to rank the types of alarms based on the extent of dangerous driving, and preset different types of alarm signals.
Specifically, the judging whether the current sight line direction of the driver is consistent with the current driving attention-paying direction includes: judging whether the sight of the driver is right ahead of the running of the automobile or not according to the position of the front windshield in the extracted eyeball reflection image of the driver; judging whether the driving sight of the driver is consistent with the current driving direction of the automobile according to the rotation angle of the steering wheel in the extracted eyeball reflection image of the driver; and judging whether the driver is performing driving steering behavior according to the rearview mirror image in the extracted eyeball reflection image of the driver.
Example 1: in high-speed driving, the sight line of a driver is stared at the right front of the driving of the automobile, and if the sight line of the driver is detected not to be in the right front from the eyeball reflection image and the duration time exceeds the preset time, the digital signal processor 2 sends out a corresponding alarm signal.
Example 2: when the vehicle turns the steering wheel during driving, the sight line of the driver should rotate along with the rotation of the steering wheel, if the difference between the current sight line of the driver and the rotation angle of the steering wheel is detected from the eyeball reflection image and the duration time exceeds the preset time, the digital signal processor 2 sends out a corresponding alarm signal.
Example 3: when the driver turns, if the time for keeping looking at the rearview mirror is detected from the eyeball reflection image and exceeds the preset time, the digital signal processor 2 sends out a corresponding alarm signal according to the alarm instruction.
Therefore, according to the method and the device, the direction which needs to be paid attention by current driving is obtained according to the information of the driving direction of the automobile or/and the steering angle information of the steering wheel, the information of reference objects such as the automobile steering wheel, the front windshield and the rearview mirror image is extracted from the eyeball reflection image of the driver, the current sight line direction of the driver is obtained by analyzing the information of the reference objects, whether the sight line of the driver is consistent with the direction which needs to be paid attention by current driving can be judged in real time, an alarm is given out in time when the sight line of the driver is inconsistent with the current direction, dangerous driving of the driver can be avoided.
Example two:
in order to further guarantee driving safety, the identity of the driver is recognized before the automobile is started, so that the driver is prevented from driving the automobile.
Fig. 3 is a schematic diagram illustrating an internal configuration of the driving safety warning system according to an embodiment. Wherein,
the image pickup apparatus 1 includes: the camera lens 11 is used for acquiring the iris image or the face image of the driver and shooting the reflection image of the eyeball of the driver in real time, and the image sensor 12 is used for converting the image from an optical image into a digital electronic signal so as to transmit the digital electronic signal to the digital signal processor 2; the digital signal processor 2 includes: a first data processing module 21 and a second data processing module 22.
The first data processing module 21 is configured to obtain iris image data or face image data, identify the identity of the driver according to the iris image data or the face image data, and lock the driver during driving, so as to prevent an unauthorized driver from driving an automobile and guarantee driving safety.
The second data processing module 22 is configured to obtain eyeball-reflected image data, and perform normalization processing on the eyeball-reflected image by locating a central point of each eyeball. In some embodiments, the second data processing module 22 uses an integral projection algorithm to locate the center points of both eyes, and completes the normalization processing of the human eye reflection image.
The second data processing module 22 is further configured to extract reference object image information from the normalized eyeball-reflected image data, where the reference object image information at least includes: image information of a steering wheel, a front windshield and a rearview mirror of the automobile; and judging whether the current sight direction of the driver is consistent with the current attention direction of the driver according to the image information of the reference object, and outputting an alarm signal when the current sight direction of the driver is inconsistent with the attention direction of the driver.
As shown in fig. 2, the safety precaution system further includes: and the memory 5 is used for storing iris image data or face image data so as to read corresponding data when identity recognition is carried out.
In some embodiments, the image capturing apparatus 1 further includes an infrared lamp 13, the infrared lamp 13 is used for projecting infrared light to the eyes of the driver, and the lens 11 includes an R-CUT dual filter for shielding visible light, so as to avoid the visible light from affecting the accuracy and definition of the eyeball-reflected image data, and further ensure that the eyeball-reflected image captured by the lens 11 has high definition.
In one embodiment, the driving safety early warning system further comprises: the switch 4, the digital signal processor 2 further comprises: and the control module 23 can control the opening/closing of the lens 11 and/or the infrared lamp 13 through the control module 23 when the switch 4 is opened/closed.
In conclusion, the identity of the driver is identified by using the collected iris image data or the face image data of the driver before the automobile is started, and the driver is locked in the automobile driving process, so that the driver can be prevented from driving the automobile, and the safe driving is guaranteed.
Example three:
compared with the first embodiment or the second embodiment, the memory 5 of the present embodiment is used not only for iris image or face image data but also for storing alarm data and eyeball-reflex image data.
On the basis of the first embodiment, the second embodiment or the third embodiment, the driving safety early warning system can also read and analyze iris images or face image data and historical warning data of the driver through the digital signal processor 2 to obtain driving behavior habit information of the driver, and display related reminding information on the vehicle-mounted warning device 3 or the mobile phone APP, so that the driver is reminded to pay attention, and driving safety is further guaranteed.
In some embodiments, since the image capturing apparatus 1 and the digital signal processor 2 are built in the interior rearview mirror, the eyeball-reflected image stored in the memory 5 can also be played back through the interior rearview mirror.
Fig. 4 is a data processing process diagram of a driving safety warning system according to an embodiment. The method specifically comprises the following steps:
firstly, an iris image or a face image is obtained through an image acquisition device 1, after the digital signal processor 2 identifies identity image data, a driver obtains identity verification, and an automobile can be started;
secondly, the vehicle-mounted direction sensor 6 acquires the driving direction information of the vehicle or/and the steering angle information of the steering wheel in real time, and the digital signal processor 2 obtains the current driving attention direction according to the driving direction information of the vehicle or/and the steering angle information of the steering wheel; the image acquisition device 1 acquires eyeball reflection images in real time, the digital signal processor 2 normalizes the eyeball reflection images by positioning the central point of each eyeball, extracts reference object image information from normalized eyeball reflection image data, and acquires the current sight direction of a driver according to the reference object image information;
thirdly, the digital signal processor 2 judges whether the current sight direction of the driver is consistent with the current direction to be paid attention to by driving, and outputs an alarm signal when the current sight direction of the driver is inconsistent with the current direction to be paid attention to by driving, so that the vehicle-mounted alarm device 3 sends out corresponding alarm to remind the driver of paying attention to the vehicle-mounted alarm device in time, danger is avoided, and driving safety is guaranteed;
finally, for iris images or face image data and historical alarm data of each driver, the digital signal processor 2 obtains driving behavior habit information of the driver by comprehensively analyzing the data, and displays the relevant analysis result on the vehicle-mounted alarm device 3 or the mobile phone APP, so that the driver is reminded to pay attention to and driving safety is further guaranteed.
Example four:
the embodiment provides an automobile, which includes: the driving safety early warning system according to any one of embodiments one to four.
Example five:
as shown in fig. 5, based on the driving safety early warning system, the present application further provides a driving safety early warning method, including:
a data acquisition step 100, acquiring eyeball reflection image data of a driver and automobile driving direction information or/and steering wheel steering angle information in real time;
a data processing step 200, namely obtaining the direction to be paid attention to by current driving according to the information of the driving direction of the automobile or/and the steering angle information of a steering wheel; extracting reference object image information from eyeball reflection image data, wherein the reference object image information at least comprises image information of an automobile steering wheel, a front windshield and a rearview mirror, and obtaining the current sight direction of a driver according to the reference object image information;
and an analyzing and judging step 300, namely judging whether the current sight line direction of the driver is consistent with the current attention direction of the driver, and outputting an alarm signal when the current sight line direction of the driver is inconsistent with the attention direction of the driver.
In some embodiments of the present invention, the,
the data acquisition step 100 further comprises: collecting an iris image or a face image of a driver;
the data processing step 200 further comprises: and identifying the identity of the driver and locking the driver according to the iris image or the face image data.
In some embodiments of the present invention, the,
the data processing step 200 further comprises: before extracting the reference object image information from the eyeball reflection image data, normalization processing is further performed on the eyeball reflection image by positioning the central point of each eyeball.
In other embodiments of the present invention, the substrate may be,
the analyzing and determining step 300 further comprises: and analyzing the driving behavior habit information of the driver according to the iris image or the face image data and the alarm signal data.
Those skilled in the art will appreciate that all or part of the functions of the various methods in the above embodiments may be implemented by hardware, or may be implemented by computer programs. When all or part of the functions of the above embodiments are implemented by a computer program, the program may be stored in a computer-readable storage medium, and the storage medium may include: a read only memory, a random access memory, a magnetic disk, an optical disk, a hard disk, etc., and the program is executed by a computer to realize the above functions. For example, the program may be stored in a memory of the device, and when the program in the memory is executed by the processor, all or part of the functions described above may be implemented. In addition, when all or part of the functions in the above embodiments are implemented by a computer program, the program may be stored in a storage medium such as a server, another computer, a magnetic disk, an optical disk, a flash disk, or a removable hard disk, and may be downloaded or copied to a memory of a local device, or may be version-updated in a system of the local device, and when the program in the memory is executed by a processor, all or part of the functions in the above embodiments may be implemented.
The present invention has been described in terms of specific examples, which are provided to aid understanding of the invention and are not intended to be limiting. For a person skilled in the art to which the invention pertains, several simple deductions, modifications or substitutions may be made according to the idea of the invention.
Claims (10)
1. The utility model provides a driving safety early warning system which characterized in that includes:
the image acquisition device is used for acquiring eyeball reflection image data of the driver in real time;
the vehicle-mounted direction sensor is used for acquiring the driving direction information of the automobile or/and the steering angle information of a steering wheel in real time;
the digital signal processor is used for obtaining the direction to be paid attention to by current driving according to the automobile driving direction information or/and the steering wheel steering angle information acquired by the vehicle-mounted direction sensor; the image acquisition device is used for acquiring eyeball reflection image data of a driver, acquiring reference object image information from the eyeball reflection image data acquired by the image acquisition device, wherein the reference object image information at least comprises image information of a steering wheel, a front windshield and a rearview mirror of the driver, and acquiring the current sight direction of the driver according to the reference object image information; judging whether the current sight line direction of the driver is consistent with the current driving attention direction;
and the vehicle-mounted alarm device is used for warning and reminding when the judgment result of the digital signal processor is inconsistent.
2. The traffic safety warning system according to claim 1, comprising:
the image acquisition device is also used for acquiring iris image data or face image data of a driver;
the digital signal processor is also used for identifying the identity of the driver and locking the driver according to the iris image data or the face image data.
3. The traffic safety warning system according to claim 1, wherein the image capturing device further comprises an infrared lamp for projecting infrared light to the eyes of the driver and an IR-CUT dual filter for shielding visible light.
4. A driving safety warning system according to any one of claims 1 to 3, wherein the image capturing device comprises: the camera lens is used for acquiring the iris image or the face image of the driver and shooting the eyeball reflection image of the driver in real time, and the image sensor is used for converting the image from an optical image into a digital electronic signal.
5. A driving safety early warning method is characterized by comprising the following steps:
the method comprises the following steps of data acquisition, namely acquiring eyeball reflection image data of a driver and automobile driving direction information or/and steering wheel steering angle information in real time;
a data processing step, namely obtaining the direction to be paid attention to by current driving according to the automobile driving direction information or/and the steering wheel steering angle information; extracting reference object image information from the eyeball reflection image data, wherein the reference object image information at least comprises image information of an automobile steering wheel, a front windshield and a rearview mirror, and obtaining the current sight direction of a driver according to the reference object image information;
and analyzing and judging, namely judging whether the current sight direction of the driver is consistent with the current direction to be paid attention to, and outputting an alarm signal when the current sight direction of the driver is inconsistent with the current direction to be paid attention to.
6. The traffic safety warning method according to claim 5,
the data acquisition step further comprises: acquiring iris image data or face image data of a driver;
the data processing step further comprises: and identifying the identity of the driver and locking the driver according to the iris image data or the face image data.
7. The driving safety warning method according to claim 5, wherein the data processing step further comprises: before extracting the reference object image information from the eyeball reflection image data, normalization processing is further performed on the eyeball reflection image by positioning the central point of each eyeball.
8. A driving safety pre-warning method according to any one of claims 5 to 7,
the analyzing and judging step further comprises: and analyzing the driving behavior habit information of the driver according to the iris image or the face image data and the alarm signal data.
9. An automobile, comprising: a driving safety warning system according to any one of claims 1 to 4.
10. A readable storage medium, characterized by comprising a program executable by a processor to implement the method of any one of claims 5-8.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710448230.8A CN107284449A (en) | 2017-06-14 | 2017-06-14 | A kind of traffic safety method for early warning and system, automobile, readable storage medium storing program for executing |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710448230.8A CN107284449A (en) | 2017-06-14 | 2017-06-14 | A kind of traffic safety method for early warning and system, automobile, readable storage medium storing program for executing |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN107284449A true CN107284449A (en) | 2017-10-24 |
Family
ID=60096402
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710448230.8A Pending CN107284449A (en) | 2017-06-14 | 2017-06-14 | A kind of traffic safety method for early warning and system, automobile, readable storage medium storing program for executing |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107284449A (en) |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108492073A (en) * | 2018-03-29 | 2018-09-04 | 惠龙易通国际物流股份有限公司 | A kind of vehicle-mounted box and the method for obtaining matching freight orders |
| CN109766735A (en) * | 2017-11-02 | 2019-05-17 | 北京嘀嘀无限科技发展有限公司 | Travel monitoring method, device, mobile terminal and computer readable storage medium |
| CN110765807A (en) * | 2018-07-25 | 2020-02-07 | 阿里巴巴集团控股有限公司 | Driving behavior analysis method, driving behavior processing method, driving behavior analysis device, driving behavior processing device and storage medium |
| CN111114552A (en) * | 2020-01-16 | 2020-05-08 | 北京未动科技有限公司 | Image acquisition device and system, vehicle |
| CN112401887A (en) * | 2020-11-10 | 2021-02-26 | 恒大新能源汽车投资控股集团有限公司 | Driver attention monitoring method and device and electronic equipment |
| CN113442884A (en) * | 2021-07-08 | 2021-09-28 | 的卢技术有限公司 | Intelligent brake assisting method and carrier |
-
2017
- 2017-06-14 CN CN201710448230.8A patent/CN107284449A/en active Pending
Cited By (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109766735A (en) * | 2017-11-02 | 2019-05-17 | 北京嘀嘀无限科技发展有限公司 | Travel monitoring method, device, mobile terminal and computer readable storage medium |
| CN108492073A (en) * | 2018-03-29 | 2018-09-04 | 惠龙易通国际物流股份有限公司 | A kind of vehicle-mounted box and the method for obtaining matching freight orders |
| CN110765807A (en) * | 2018-07-25 | 2020-02-07 | 阿里巴巴集团控股有限公司 | Driving behavior analysis method, driving behavior processing method, driving behavior analysis device, driving behavior processing device and storage medium |
| CN110765807B (en) * | 2018-07-25 | 2024-04-05 | 斑马智行网络(香港)有限公司 | Driving behavior analysis and processing method, device, equipment and storage medium |
| CN111114552A (en) * | 2020-01-16 | 2020-05-08 | 北京未动科技有限公司 | Image acquisition device and system, vehicle |
| CN112401887A (en) * | 2020-11-10 | 2021-02-26 | 恒大新能源汽车投资控股集团有限公司 | Driver attention monitoring method and device and electronic equipment |
| CN112401887B (en) * | 2020-11-10 | 2023-12-12 | 恒大新能源汽车投资控股集团有限公司 | Driver attention monitoring method and device and electronic equipment |
| CN113442884A (en) * | 2021-07-08 | 2021-09-28 | 的卢技术有限公司 | Intelligent brake assisting method and carrier |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107284449A (en) | A kind of traffic safety method for early warning and system, automobile, readable storage medium storing program for executing | |
| CN108351968B (en) | Alarming method, device, storage medium and server for criminal activities | |
| US10235768B2 (en) | Image processing device, in-vehicle display system, display device, image processing method, and computer readable medium | |
| US10430677B2 (en) | Method for classifying driver movements | |
| Doshi et al. | A comparative exploration of eye gaze and head motion cues for lane change intent prediction | |
| CN106467057B (en) | The method, apparatus and system of lane departure warning | |
| WO2014188648A1 (en) | Driver confirmation device | |
| CN109740433B (en) | Vehicle avoiding method and vehicle-mounted terminal | |
| CN102310771A (en) | Motor vehicle safety control method and system based on driver face identification | |
| US10262219B2 (en) | Apparatus and method to determine drowsiness of a driver | |
| CN107408338A (en) | Driver assistance system | |
| CN107924466A (en) | Vision system and method for motor vehicles | |
| WO2020161610A2 (en) | Adaptive monitoring of a vehicle using a camera | |
| CN109131321B (en) | Lane changing auxiliary method and device based on image processing and risk coefficient calculation | |
| CN208789584U (en) | Driving support device | |
| CN107323343A (en) | A kind of safe driving method for early warning and system, automobile and readable storage medium storing program for executing | |
| CN208789581U (en) | Multifunctional driving auxiliary device | |
| CN108674342A (en) | Safety instruction method, apparatus, storage medium and the automobile of opening door of vehicle | |
| CN113239827B (en) | Intelligent anti-collision method, system, equipment and storage medium based on deep learning | |
| US20190193753A1 (en) | Providing relevant alerts to a driver of a vehicle | |
| CN113561983A (en) | Intelligent security detection system for personnel in vehicle and detection method thereof | |
| CN106541948B (en) | A kind of driving safety auxiliary method, system and AR equipment | |
| US10945651B2 (en) | Arousal level determination device | |
| KR101680833B1 (en) | Apparatus and method for detecting pedestrian and alert | |
| CN116552542A (en) | Vehicle control method, device, electronic equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| DD01 | Delivery of document by public notice |
Addressee: Xue Liantong Document name: Notice of commencement of preservation procedure |
|
| DD01 | Delivery of document by public notice |