CN106467057A - The method of lane departure warning, apparatus and system - Google Patents
The method of lane departure warning, apparatus and system Download PDFInfo
- Publication number
- CN106467057A CN106467057A CN201510519943.XA CN201510519943A CN106467057A CN 106467057 A CN106467057 A CN 106467057A CN 201510519943 A CN201510519943 A CN 201510519943A CN 106467057 A CN106467057 A CN 106467057A
- Authority
- CN
- China
- Prior art keywords
- driver
- vehicle
- road
- deviation
- subjective
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Landscapes
- Image Processing (AREA)
- Traffic Control Systems (AREA)
Abstract
The invention discloses a kind of method of lane departure warning, apparatus and system, the method for described lane departure warning comprises the following steps:Obtain the turn signal state of the facial image of driver of backsight collecting unit collection, the deviation image of forward sight collecting unit collection and the collection of steering indicating light signal gathering unit of vehicle;When the steering indicating light described automotive run-off-road and described vehicle is detected is not opened, the direction according to described facial image and described automotive run-off-road carries out lane change early warning.The present invention can improve the accuracy rate of vehicle lane change early warning, reduces security incident odds.
Description
Technical field
The present invention relates to vehicle drive security technology area, more particularly, to a kind of method of lane departure warning,
Apparatus and system.
Background technology
Lane Departure Warning System be a kind of by report to the police by way of assist driver reduce automobile because track inclined
From and there is the system of vehicle accident.Current Lane Departure Warning System is by picture processing chip, control
Device, sensor etc. form.When deviation system is opened, it is arranged on the side of vehicle or taking the photograph of front portion
As head can gather the image of traveling lane the moment, the image collecting is carried out with image procossing acquisition vehicle and exists
Location parameter in current lane, when automotive run-off-road is detected, the row of sensor sensing to vehicle
The data such as vehicle speed and turn signal state, when speed is larger and steering indicating light is not opened, is sent by controller
Alarm signal, whole process about completed at 0.5 second, provided more response time for driver.And
If steering indicating light is opened, it is normally carried out modified line and travels, then Lane Departure Warning System will not do any prompting.
But vehicle is in the process of moving, when surrounding vehicles are less, vehicle lane change is very safe, driver
May will not open steering indicating light, and Lane Departure Warning System is reported to the police, and false alarm;Or have
A little driver habits travel near sideline or short time line ball travels, and at this moment steering indicating light will not be opened, and car
Road deviates early warning system and is still reported to the police, and false alarm;Or when steering indicating light is breech-loading, pass
Sensor cannot obtain the on off state of steering indicating light, and false alarm also easily in Lane Departure Warning System;Report
Alert accuracy rate is not high.
Content of the invention
Present invention is primarily targeted at providing a kind of method of lane departure warning, apparatus and system, purport
When solving existing Lane Departure Warning System in vehicle lane change, the not high technology of the accuracy rate of early warning is asked
Topic.
For achieving the above object, the present invention provides a kind of method of lane departure warning, described deviation
The method of early warning comprises the following steps:
Obtain the facial image of driver of backsight collecting unit collection, the collection of forward sight collecting unit of vehicle
Deviation image and steering indicating light signal gathering unit collection turn signal state;
When the steering indicating light described automotive run-off-road and described vehicle is detected is not opened, according to described people
The direction of face image and described automotive run-off-road carries out lane change early warning.
The method of lane departure warning according to the present invention, apparatus and system, dispose backsight to adopt in vehicle
Collect unit to gather the facial image of driver, when steering automotive run-off-road and described vehicle is detected
When lamp is not opened, switch according to steering indicating light is judging whether driver has being intended to and being forbidden of subjective lane change
Really, now by the facial image of driver is analyzed obtain with driver subjective deviate be intended to and body
Body state etc., and combine the direction integrated decision-making of automotive run-off-road, carry out lane change early warning, it is possible to increase
The accuracy rate of vehicle lane change early warning, reduces security incident odds.
Brief description
Fig. 1 is the schematic flow sheet of the method first embodiment of lane departure warning of the present invention;
Fig. 2 is pre- for carrying out lane change according to the direction of described facial image and described automotive run-off-road in Fig. 1
The refinement schematic flow sheet of alert step;
Fig. 3 is to obtain the subjective of described driver according to described facial image in Fig. 2 to deviate intention and body
The refinement schematic flow sheet of the step of state;
Fig. 4 is the schematic flow sheet of the method second embodiment of lane departure warning of the present invention;
Fig. 5 is the high-level schematic functional block diagram of the device first embodiment of lane departure warning of the present invention;
Fig. 6 is the refinement high-level schematic functional block diagram of warning module in Fig. 5;
Fig. 7 is the refinement high-level schematic functional block diagram of acquiring unit in Fig. 6;
Fig. 8 is the high-level schematic functional block diagram of the device second embodiment of lane departure warning of the present invention;
Fig. 9 is the high-level schematic functional block diagram of system one embodiment of lane departure warning of the present invention.
The realization of the object of the invention, functional characteristics and advantage will be done further in conjunction with the embodiments referring to the drawings
Explanation.
Specific embodiment
It should be appreciated that specific embodiment described herein, only in order to explain the present invention, is not used to limit
Determine the present invention.
The present invention provides a kind of method of lane departure warning, with reference to Fig. 1, in one embodiment, this car
The method that road deviates early warning includes:
Step S101, obtains the facial image of driver of backsight collecting unit collection of vehicle, forward sight is adopted
The deviation image of collection unit collection and the turn signal state of steering indicating light signal gathering unit collection;
In the present embodiment, backsight collecting unit is arranged in vehicle, and direction backwards, can be just to driver
Or tiltedly to driver, so as to collecting the facial image of driver, track in the present embodiment
When deviateing early warning system unlatching, backsight collecting unit starts to gather the facial image of driver.Facial image
Such as subjective deviation intention when can reflect that driver drives and condition etc..
Wherein, backsight collecting unit can be that industrial camera, camera lens or image pick-up card etc. carry shooting
The device of head.
In the present embodiment, can gather in the side of vehicle or anterior installation forward sight collecting unit, this forward sight
Unit tiltedly points to track.Forward sight collecting unit Real-time Collection deviation image, by this deviation
Image is analyzed, and can know road ahead or the change of environment.
Wherein, forward sight collecting unit can also be industrial camera, camera lens or image pick-up card etc. carry take the photograph
Device as head.
In the present embodiment, steering indicating light signal gathering unit can be OBD (On Board
Diagnostics, OBD).
Step S102, when the steering indicating light described automotive run-off-road and described vehicle is detected is not opened,
Direction according to described facial image and described automotive run-off-road carries out lane change early warning.
In the present embodiment, after obtaining deviation image, can directly carry out on deviation image
Process it is also possible to be processed on rational top view being generated by IPM, thus extracting lane line ginseng
Number.First deviation image is carried out with pretreatment, Threshold segmentation and edge strengthen, then utilize Hough
The method of Hough transform or other extraction straight lines, to extract left and right lane line parameter, needs finally according to actual
Choose suitable lane departure warning model, such as TLC or additive method, to judge the deviation of vehicle
State.Wherein, the deviation state of the vehicle of the present embodiment or the direction of run-off-road are included normally, to the left
Deviation, left pressure measurement line, be deviated to the right, right side line ball totally 5 kinds of states.
In the present embodiment, if vehicle lane occurs to deviate and when steering indicating light opens it is believed that driver
Need vehicle lane change subjective, and think that driver is in clear-headed state, as long as driver concentrates note
Meaning power typically will not be caused danger situation, does not now need to be reported to the police.
If vehicle lane occur to deviate and steering indicating light when not opening it is impossible to judge that driver is subjective whether
Need vehicle to carry out lane change, and cannot determine whether driver is in waking state, at this time, it may be necessary to according to
The facial image of the driver of backsight collecting unit collection is judged, for example, pass through to drive on facial image
The eye motion of member and mouth action may determine that whether it is in fatigue state, the attitude according to its head
Judge that it whether subjective needs vehicle to carry out lane change.
It is understood that speed when vehicle is in traveling, when vehicle lane occurs to deviate and turns
To lamp do not open when, need quickly to carry out to judge whether driver is to need vehicle to enter in the state of clear-headed
Row lane change, therefore, forward sight collecting unit and backsight collecting unit can simultaneously enter working condition, respectively
Obtain the facial image of corresponding deviation image and driver in real time.
In the present embodiment, the control process that lane change early warning can be refined, when vehicle to the left or to the right
During deviation, an open instruction lamp is reminded, and unlatching warning light prompting will not cause very big to driver
Interference;When line ball to the left or to the right travels, the color of change instruction lamp flashing is reminded, meanwhile,
In the case that steering indicating light is not opened, by the analysis to facial image, if driver is subjective lane change
Intention, for example to the right line ball travel when driver to the right yaw or to the right line ball travel first 2 seconds in drive
The person of sailing to the right yaw it is believed that driver just concentrating one's energy drive it is not necessary to carry out sound early warning again, if
The subjective intention not having lane change of driver, for example to the right line ball travel when or to the right line ball travel front 2
When driver is less than yaw to the right in second, further its condition is judged by facial image, non-tired
Also without carrying out sound early warning under labor state, but if it is in fatigue driving state, then need with
When send alarm sound, there is stronger reminding effect to driver, it can in addition contain combine take other
Stronger alerting pattern, such as direction of vibration disk etc..When the present embodiment considers if there is false alarm,
Very big to the interference of driver using strong alerting pattern, therefore, after comprehensive various possible factors,
Only in above-mentioned vehicle, line ball travels and steering indicating light is not opened, driver does not have lane change to the left or to the right
Just carry out audible alarm when being intended to and being under fatigue driving state, reduce to greatest extent to driver's
Interference, simultaneously above-mentioned alarm mode reduces rate of false alarm.
Compared with prior art, the present embodiment disposes backsight collecting unit to gather driver's in vehicle
Facial image, when steering indicating light automotive run-off-road and described vehicle is detected is not opened, according to steering
The switch of lamp judging whether driver has the intention of subjective lane change to be inaccurate, now by driver
Facial image be analyzed obtaining driver subjective deviate be intended to and condition etc., and combine vehicle
The direction integrated decision-making of run-off-road, carries out lane change early warning, it is possible to increase the accuracy rate of vehicle lane change early warning,
Reduce security incident odds.
In a preferred embodiment, as shown in Fig. 2 on the basis of the embodiment of above-mentioned Fig. 1, on
State step S102 to include:
Step S1021, when steering indicating light automotive run-off-road and described vehicle is detected is not opened, root
Obtain the subjective of described driver according to described facial image and deviate intention and condition;
Step S1022, judge described subjective deviate be intended to and the direction of described automotive run-off-road whether
Cause, if so, then enter step S1025, otherwise enter step S1023;
Step S1023, judges whether the condition of described driver is fatigue, if so, then enters step
Rapid S1024, otherwise enters step S1025;
Step S1024, at least carries out audible alarm;
Step S1025, does not carry out audible alarm.
The subjective deviation of driver in the present embodiment, by being analyzed, can be got to facial image
Be intended to and condition, subjective deviate be intended to include doubling to the left, doubling to the right, normal totally three kinds, lead to
Cross the analysis to facial image and get subjective deviation intention, for example, can pass through being flapped toward of driver head
(i.e. head pose) knows that subjective deviation is intended to, or knows subjective deviation by the direction of eye gaze
Be intended to, or with reference to driver head be flapped toward and eye gaze direction know subjective deviate be intended to etc.,
Preferably, know that subjective deviation is intended to by being flapped toward of driver head.Condition includes regaining consciousness (i.e.
Non- fatigue) and fatigue totally two kinds it is also possible to be divided into clear-headed, medium tired, seriously tired according to actual needs
Lao Gongsan kind, by getting condition to the analysis of facial image, for example, by the closure of eye
Degree duration knows condition, or knows condition by the elevation angle of head, or
By the change of mouth, or partly to know body shape with reference at least two of eye, head and mouth
State etc. is it is preferable that know condition by the closure degree duration of eye.
When subjective deviation is intended to consistent with the direction of automotive run-off-road, refer to:Subjective deviation is intended to
For during doubling to the left, then vehicle is deviated to the left or left pressure measurement line;When subjective deviation is intended to doubling to the right,
Then vehicle is deviated to the right or right pressure measurement line.The subjective intention that deviates is inconsistent with the direction of automotive run-off-road
Scene is the scene in addition to above-mentioned consistent scene.When the subjective direction deviateed and be intended to automotive run-off-road
When inconsistent, judge whether the condition of driver is tired.
The present embodiment when steering indicating light automotive run-off-road and vehicle is detected is not opened, by face figure
Subjectivity as obtaining driver deviates intention and condition, deviates intention and automotive run-off-road subjective
Direction consistent when, illustrate driver just concentrating one's energy drive it is not necessary to carry out sound early warning, to prevent
Interfere with driver;When subjective deviation is intended to inconsistent with the direction of automotive run-off-road, need to judge
The condition of driver, if driver is in non-fatigue state it is also possible to explanation driver just concentrates
Energy drive it is not necessary to carry out sound early warning, to prevent from interfering with driver, if driver be in tired
Labor state, then at least need to carry out sound early warning, and can be in conjunction with the mode of such as display lamp and steering wheel vibration
Carry out early warning, so that driver is played with strong suggesting effect, so can improve the accuracy rate of warning.
In the present embodiment, such as when surrounding vehicles are less or no carry out lane change in the case of car, if driven
The person of sailing is not turned on steering indicating light, in the case of showing the intention wanting lane change, will not carry out on body posture
Report to the police, but in the case that the intention wanting lane change is not shown on body posture, due to driving is detected
Member is in the state of regaining consciousness, and also will not be reported to the police, and can carry out audible alarm in driver fatigue;
Or driver habit travels near sideline or short time line ball travels but steering indicating light is not opened, in body appearance
Do not show, in state, the intention wanting lane change, but due to detect driver be in clear-headed in the state of,
Will not be reported to the police, and audible alarm can be carried out in driver fatigue;Or when steering indicating light is Rear mounted
, now the on off state further according to steering indicating light does not determine whether to report to the police, but according to automotive run-off-road
Direction, driver subjective deviate be intended to and condition integrated decision-making, carry out lane change early warning, improve
The accuracy rate of early warning, and it is reduced as far as the interference to driver.
In a preferred embodiment, as shown in figure 3, on the basis of the embodiment of above-mentioned Fig. 2, on
State step S1021 to include:
Step S10211, extracts human eye feature point and face feature point according to described facial image;
Step S10212, obtains described condition according to described human eye feature point, special according to described face
Levy the described subjective deviation of an acquisition to be intended to.
In the present embodiment, after collecting facial image, extract human eye feature point and face feature point, its
In, human eye feature point preferably includes the characteristic point at canthus and the peak of upper lower eyelid and minimum point,
Face feature point is more, for example, can include characteristic point of head several organs therein etc., here is not done
Excessive restriction.
The present embodiment preferably obtains condition according to human eye feature point, extracts people first from facial image
Multiple characteristic points of eye, the method identification eye state of Land use models classification is opened or is closed, and
The degree of closure.It is then passed through statistical analysiss, typically can judge by PERCLOS method to drive
Whether member is tired.Furthermore it is also possible to further combined with frequency of wink, mouth change, state of head etc.
Index comes whether comprehensive assessment driver is tired, and the degree of fatigue.
The present embodiment extracts human eye feature point and face feature point according to facial image, by human eye feature point
Obtain condition and subjective deviation intention is obtained by face feature point, and combine automotive run-off-road
Direction integrated decision-making is carrying out the mode of lane change early warning, it is possible to increase the accuracy of vehicle lane change early warning.
The present embodiment preferably obtains subjective deviation according to face feature point and is intended to, including:According to facial characteristics
Point obtains the deflection average of the driver elevation angle average of head and head in Preset Time;When the elevation angle is equal
When value is more than predetermined angle threshold value, judge whether deflection average is more than default amount of yaw, and judge
Whether it is less than default effective time more than the persistent period of default amount of yaw;If the result judging is equal
It is yes, then subjective deviation is obtained according to deflection average and be intended to.
In the present embodiment, the elevation angle average of head and the deflection average of head can be used to judge driver
It is to eye to the front, still see to the left or to the right.I.e. when the elevation angle average of head is more than predetermined angle threshold value,
It is considered that facing front, then judge whether deflection average is more than default amount of yaw again, that is, sentence
Whether disconnected driver sees to the left or to the right, finally determines that driver is intended to doubling to the left and is also intended to doubling to the right.
The principle that the present embodiment obtains subjective deviation intention according to face feature point is as follows:Transport in vehicle first
Under dynamic state, the head elevation angle average of (such as 1 minute) driver and deflection in statistics a period of time
Average, then, arranges rational predetermined angle threshold value and amount of yaw;First according to predetermined angle threshold value
And head elevation angle average judges whether driver bows, when that is, head elevation angle average is more than predetermined angle threshold value
Judge that it is not bowed, for facing the state in front it is believed that driver is in waking state, further according to side
Judge whether yaw to the left or to the right to angle average, after obtaining head pose, that is, if to the left or
To the right during yaw, then immediate record time stamp T 0, recover normal condition in head, then record current time
Stamp T, effective time TX is preferably set to 2s, represents the effective time of head pose, if
T-T0<TX, driver to left swing head, then represents that driver is subjective to be thought to the left in effective time TX
Doubling;Yaw to the right in effective time TX, then represent that driver is subjective to think doubling to the right.
In a preferred embodiment, as shown in figure 4, on the basis of the embodiment of above-mentioned Fig. 1,
Also include before above-mentioned steps S101:
Step S100, when the speed of described vehicle is more than pre-set velocity threshold value, before obtaining described vehicle
Depending on the deviation image of collecting unit collection, according to described deviation image detection, whether vehicle
Run-off-road.
In the present embodiment, during the traveling of vehicle, vehicle can be obtained with Negotiation speed sensor current
Speed, judge that whether this speed be more than pre-set velocity threshold value, if being not more than this pre-set velocity threshold value,
It is considered that the current travel speed of vehicle is less, typically do not result in security incident, can not carry out pre-
Alert.When speed be more than pre-set velocity threshold value when, in order to maximum speed limit prevent security incident, need
Open the present embodiment in Lane Departure Warning System, with by Lane Departure Warning System to due to vehicle
Lane change and cause it may happen that the situation of danger carries out early warning, to remind driver.Certainly, work as speed
When being not more than pre-set velocity threshold value, Lane Departure Warning System can be closed.
The forward sight collecting unit of side or front portion by being arranged on vehicle for the present embodiment gathers track slip chart
Picture, by the analysis of the deviation image to collection it can be determined that vehicle whether run-off-road.
The present invention also provides a kind of device of lane departure warning, as shown in figure 5, in one embodiment,
The device of this lane departure warning includes:
Acquisition module 101, the facial image of the driver that the backsight collecting unit for obtaining vehicle gathers,
The deviation image of forward sight collecting unit collection and the steering indicating light shape of steering indicating light signal gathering unit collection
State;
In the present embodiment, backsight collecting unit is arranged in vehicle, and direction backwards, can be just to driver
Or tiltedly to driver, so as to collecting the facial image of driver, track in the present embodiment
When deviateing early warning system unlatching, backsight collecting unit starts to gather the facial image of driver.Facial image
Such as subjective deviation intention when can reflect that driver drives and condition etc..
Wherein, backsight collecting unit can be that industrial camera, camera lens or image pick-up card etc. carry shooting
The device of head.
In the present embodiment, can gather in the side of vehicle or anterior installation forward sight collecting unit, this forward sight
Unit tiltedly points to track.Forward sight collecting unit Real-time Collection deviation image, by this deviation
Image is analyzed, and can know road ahead or the change of environment.
Wherein, forward sight collecting unit can also be industrial camera, camera lens or image pick-up card etc. carry take the photograph
Device as head.
In the present embodiment, steering indicating light signal gathering unit can be OBD (On Board
Diagnostics, OBD).
Warning module 102, when the steering indicating light described automotive run-off-road and described vehicle is detected is not opened
When, the direction according to described facial image and described automotive run-off-road carries out lane change early warning.
In the present embodiment, after obtaining deviation image, can directly carry out on deviation image
Process it is also possible to be processed on rational top view being generated by IPM, thus extracting lane line ginseng
Number.First deviation image is carried out with pretreatment, Threshold segmentation and edge strengthen, then utilize Hough
The method of Hough transform or other extraction straight lines, to extract left and right lane line parameter, needs finally according to actual
Choose suitable lane departure warning model, such as TLC or additive method, to judge the deviation of vehicle
State.Wherein, the deviation state of the vehicle of the present embodiment or the direction of run-off-road are included normally, to the left
Deviation, left pressure measurement line, be deviated to the right, right side line ball totally 5 kinds of states.
In the present embodiment, if vehicle lane occurs to deviate and when steering indicating light opens it is believed that driver
Need vehicle lane change subjective, and think that driver is in clear-headed state, as long as driver concentrates note
Meaning power typically will not be caused danger situation, does not now need to be reported to the police.
If vehicle lane occur to deviate and steering indicating light when not opening it is impossible to judge that driver is subjective whether
Need vehicle to carry out lane change, and cannot determine whether driver is in waking state, at this time, it may be necessary to according to
The facial image of the driver of backsight collecting unit collection is judged, for example, pass through to drive on facial image
The eye motion of member and mouth action may determine that whether it is in fatigue state, the attitude according to its head
Judge that it whether subjective needs vehicle to carry out lane change.
It is understood that speed when vehicle is in traveling, when vehicle lane occurs to deviate and turns
To lamp do not open when, need quickly to carry out to judge whether driver is to need vehicle to enter in the state of clear-headed
Row lane change, therefore, forward sight collecting unit and backsight collecting unit can simultaneously enter working condition, respectively
Obtain the facial image of corresponding deviation image and driver in real time.
In the present embodiment, the control process that lane change early warning can be refined, when vehicle to the left or to the right
During deviation, an open instruction lamp is reminded, and unlatching warning light prompting will not cause very big to driver
Interference;When line ball to the left or to the right travels, the color of change instruction lamp flashing is reminded, meanwhile,
In the case that steering indicating light is not opened, by the analysis to facial image, if driver is subjective lane change
Intention, for example to the right line ball travel when driver to the right yaw or to the right line ball travel first 2 seconds in drive
The person of sailing to the right yaw it is believed that driver just concentrating one's energy drive it is not necessary to carry out sound early warning again, if
The subjective intention not having lane change of driver, for example to the right line ball travel when or to the right line ball travel front 2
When driver is less than yaw to the right in second, further its condition is judged by facial image, non-tired
Also without carrying out sound early warning under labor state, but if it is in fatigue driving state, then need with
When send alarm sound, there is stronger reminding effect to driver, it can in addition contain combine take other
Stronger alerting pattern, such as direction of vibration disk etc..When the present embodiment considers if there is false alarm,
Very big to the interference of driver using strong alerting pattern, therefore, after comprehensive various possible factors,
Only in above-mentioned vehicle, line ball travels and steering indicating light is not opened, driver does not have lane change to the left or to the right
Just carry out audible alarm when being intended to and being under fatigue driving state, reduce to greatest extent to driver's
Interference, reduces rate of false alarm simultaneously.
Compared with prior art, the present embodiment disposes backsight collecting unit to gather driver's in vehicle
Facial image, when steering indicating light automotive run-off-road and described vehicle is detected is not opened, according to steering
The switch of lamp judging whether driver has the intention of subjective lane change to be inaccurate, now by driver
Facial image be analyzed obtaining driver subjective deviate then and combine be intended to and condition etc.,
The direction integrated decision-making of automotive run-off-road, carries out lane change early warning, it is possible to increase the standard of vehicle lane change early warning
Really rate, reduces security incident odds.
In a preferred embodiment, as shown in fig. 6, on the basis of the embodiment of above-mentioned Fig. 5, sentencing
Disconnected module 102 includes:
Acquiring unit 1021, for when detecting automotive run-off-road and the steering indicating light of described vehicle is not opened
When, the subjective of described driver is obtained according to described facial image and deviates intention and condition;
First judging unit 1022, for judging described subjective deviation intention and described automotive run-off-road
Whether direction is consistent;
Second judging unit 1023, if for the described subjective side deviateing intention and described automotive run-off-road
To inconsistent, judge whether the condition of described driver is fatigue;
First alarm unit 1024, if the condition for described driver is fatigue, is at least carried out
Audible alarm;
Second alarm unit 1025 is if the condition for described driver is non-fatigue or described
When subjective deviation is intended to consistent with the direction of described automotive run-off-road, then do not carry out audible alarm.
The subjective deviation of driver in the present embodiment, by being analyzed, can be got to facial image
Be intended to and condition, subjective deviate be intended to include doubling to the left, doubling to the right, normal totally three kinds, lead to
Cross the analysis to facial image and get subjective deviation intention, for example, can pass through being flapped toward of driver head
(i.e. head pose) knows that subjective deviation is intended to, or knows subjective deviation by the direction of eye gaze
Be intended to, or with reference to driver head be flapped toward and eye gaze direction know subjective deviate be intended to etc.,
Preferably, know that subjective deviation is intended to by being flapped toward of driver head.Condition includes clear-headed and tired
Labor totally two kinds it is also possible to be divided into according to actual needs clear-headed, medium fatigue, totally three kinds of major fatigue, lead to
Cross the analysis to facial image and get condition, for example, lasting by the closure degree of eye
Time knows condition, or knows condition by the elevation angle of head, or by the change of mouth
Change, or partly to know condition etc. with reference at least two of eye, head and mouth it is preferable that
Condition is known by the closure degree duration of eye.
When subjective deviation is intended to consistent with the direction of automotive run-off-road, refer to:Subjective deviation is intended to
For during doubling to the left, then vehicle is deviated to the left or left pressure measurement line;When subjective deviation is intended to doubling to the right,
Then vehicle is deviated to the right or right pressure measurement line.The subjective intention that deviates is inconsistent with the direction of automotive run-off-road
Scene is the scene in addition to above-mentioned consistent scene.When the subjective direction deviateed and be intended to automotive run-off-road
When inconsistent, judge whether the condition of driver is tired.
The present embodiment when steering indicating light automotive run-off-road and vehicle is detected is not opened, by face figure
Subjectivity as obtaining driver deviates intention and condition, deviates intention and automotive run-off-road subjective
Direction consistent when, illustrate driver just concentrating one's energy drive it is not necessary to carry out sound early warning, to prevent
Interfere with driver;When subjective deviation is intended to inconsistent with the direction of automotive run-off-road, need to judge
The condition of driver, if driver is in non-fatigue state it is also possible to explanation driver just concentrates
Energy drive it is not necessary to carry out sound early warning, to prevent from interfering with driver, if driver be in tired
Labor state, then at least need to carry out sound early warning, and can be in conjunction with the mode of such as display lamp and steering wheel vibration
Carry out early warning, so that driver is played with strong suggesting effect, so can improve the accuracy rate of warning.
In the present embodiment, such as when surrounding vehicles are less or no carry out lane change in the case of car, if driven
The person of sailing is not turned on steering indicating light, in the case of showing the intention wanting lane change, will not carry out on body posture
Report to the police, but in the case that the intention wanting lane change is not shown on body posture, due to driving is detected
Member is in the state of regaining consciousness, and also will not be reported to the police, and can carry out audible alarm in driver fatigue;
Or driver habit travels near sideline or short time line ball travels but steering indicating light is not opened, in body appearance
Do not show, in state, the intention wanting lane change, but due to detect driver be in clear-headed in the state of,
Will not be reported to the police, and audible alarm can be carried out in driver fatigue;Or when steering indicating light is Rear mounted
, now the on off state further according to steering indicating light does not determine whether to report to the police, but according to automotive run-off-road
Direction, driver subjective deviate be intended to and condition integrated decision-making, carry out lane change early warning, improve
The accuracy rate of early warning, and it is reduced as far as the interference to driver.
In a preferred embodiment, as shown in fig. 7, on the basis of the embodiment of above-mentioned Fig. 6, obtaining
Unit 1021 is taken to include:
Extract subelement 10211, for human eye feature point and facial characteristics are extracted according to described facial image
Point;
Obtain subelement 10212, for described condition is obtained according to described human eye feature point, according to
Described face feature point obtains described subjective deviation and is intended to.
In the present embodiment, after collecting facial image, extract human eye feature point and face feature point, its
In, human eye feature point preferably includes the characteristic point at canthus and the peak of upper lower eyelid and minimum point,
Face feature point is more, for example, can include characteristic point of head several organs therein etc., here is not done
Excessive restriction.
The present embodiment preferably obtains condition according to human eye feature point, extracts people first from facial image
Multiple characteristic points of eye, the method identification eye state of Land use models classification is opened or is closed, and
The degree of closure.It is then passed through statistical analysiss, typically can judge by PERCLOS method to drive
Whether member is tired.Furthermore it is also possible to further combined with frequency of wink, mouth change, state of head etc.
Index comes whether comprehensive assessment driver is tired, and the degree of fatigue.
The present embodiment extracts human eye feature point and face feature point according to facial image, by human eye feature point
Obtain condition and subjective deviation intention is obtained by face feature point, and combine automotive run-off-road
Direction integrated decision-making is carrying out the mode of lane change early warning, it is possible to increase the accuracy of vehicle lane change early warning.
Wherein, obtain subelement specifically for described driver is obtained default according to described face feature point
The deflection average of the elevation angle average of head and head in time;When described elevation angle average is more than predetermined angle
During threshold value, judge whether described deflection average is more than default amount of yaw, and judge more than default
Whether the persistent period of amount of yaw is less than default effective time;If the result judging is being, root
Obtain described subjective deviation according to described deflection average to be intended to.
In the present embodiment, the elevation angle average of head and the deflection average of head can be used to judge driver
It is to eye to the front, still see to the left or to the right.I.e. when the elevation angle average of head is more than predetermined angle threshold value,
It is considered that facing front, then judge whether deflection average is more than default amount of yaw again, that is, sentence
Whether disconnected driver sees to the left or to the right, finally determines that driver is intended to doubling to the left and is also intended to doubling to the right.
The principle that the present embodiment obtains subjective deviation intention according to face feature point is as follows:Transport in vehicle first
Under dynamic state, the head elevation angle average of (such as 1 minute) driver and deflection in statistics a period of time
Average, then, arranges rational predetermined angle threshold value and amount of yaw;First according to predetermined angle threshold value
And head elevation angle average judges whether driver bows, when that is, head elevation angle average is more than predetermined angle threshold value
Judge that it is not bowed, for facing the state in front it is believed that driver is in waking state, further according to side
Judge whether yaw to the left or to the right to angle average, after obtaining head pose, that is, if to the left or
To the right during yaw, then immediate record time stamp T 0, recover normal condition in head, then record current time
Stamp T, effective time TX is preferably set to 2s, represents the effective time of head pose, if
T-T0<TX, driver to left swing head, then represents that driver is subjective to be thought to the left in effective time TX
Doubling;Yaw to the right in effective time TX, then represent that driver is subjective to think doubling to the right.
In a preferred embodiment, as shown in figure 8, on the basis of the embodiment of above-mentioned Fig. 5, institute
The device stating lane departure warning also includes:
Detection module 100, for when the speed of described vehicle is more than pre-set velocity threshold value, obtaining described
The deviation image of the forward sight collecting unit collection of vehicle, according to described deviation image detection
Vehicle whether run-off-road.
In the present embodiment, during the traveling of vehicle, vehicle can be obtained with Negotiation speed sensor current
Speed, judge that whether this speed be more than pre-set velocity threshold value, if being not more than this pre-set velocity threshold value,
It is considered that the current travel speed of vehicle is less, typically do not result in security incident, can not carry out pre-
Alert.When speed be more than pre-set velocity threshold value when, in order to maximum speed limit prevent security incident, need
Open the present embodiment in Lane Departure Warning System, with by Lane Departure Warning System to due to vehicle
Lane change and cause it may happen that the situation of danger carries out early warning, to remind driver.Certainly, work as speed
When being not more than pre-set velocity threshold value, Lane Departure Warning System can be closed.
The forward sight collecting unit of side or front portion by being arranged on vehicle for the present embodiment gathers track slip chart
Picture, by the analysis of the deviation image to collection it can be determined that vehicle whether run-off-road.
The present invention also provides a kind of system of lane departure warning, as shown in figure 9, in one embodiment,
The system of this lane departure warning includes forward sight collecting unit, backsight collecting unit, steering indicating light signals collecting
Unit and Logical processing unit, wherein:
Forward sight collecting unit, for gathering track slip chart picture;
Backsight collecting unit, for gathering the facial image of driver;
Steering indicating light signal gathering unit, for gathering turn signal state;
Logical processing unit, for obtaining described deviation image, facial image and turn signal state,
When the steering indicating light described automotive run-off-road and described vehicle is detected is not opened, according to described face figure
The direction of picture and described automotive run-off-road carries out lane change early warning.
Wherein, the device of aforesaid lane departure warning is loaded on Logical processing unit.Forward sight gathers
Unit is arranged on side or the front portion of vehicle, and Real-time Collection deviation image, then by deviation
, to Logical processing unit, Logical processing unit Built-in Image process chip, obtaining, track is inclined for image transmitting
After image, can directly be processed on deviation image it is also possible to close being generated by IPM
Processed, thus extracting lane line parameter on the top view of reason.First deviation image is carried out pre-
Process, Threshold segmentation and edge strengthen, then utilize Hough Hough transform or the side of other extraction straight lines
Method, to extract left and right lane line parameter, chooses suitable lane departure warning model finally according to being actually needed,
Such as TLC or additive method, to judge the deviation state of vehicle, the deviation state of vehicle or run-off-road
Direction include normally, be deviated to the left, left pressure measurement line, be deviated to the right, right side line ball totally 5 kinds of states;
Backsight collecting unit is installed in vehicle, for gathering the facial image of driver, and by face figure
As being transferred to described Logical processing unit, so that Logical processing unit is carried out to the facial image of driver point
Analysis:
When steering indicating light automotive run-off-road and described vehicle is detected is not opened, carried according to facial image
Take human eye feature point and face feature point, described condition is obtained according to human eye feature point, according to face
Characteristic point obtains described subjectivity and deviates intention, deviates intention in subjectivity consistent with the direction of automotive run-off-road
When, do not carry out audible alarm, when subjective deviation is intended to inconsistent with the direction of automotive run-off-road, enter
One step judges whether the condition of driver is fatigue, if being in non-fatigue state, does not also carry out sound
Sound is reported to the police, but if being in fatigue state, then at least carries out audible alarm, finally transmits alarm command
To man-machine interaction unit, reported to the police by man-machine interaction unit, in this way, can be according to forward sight
The facial image of the driver of the deviation image of collecting unit collection and the collection of backsight collecting unit is comprehensive
Decision-making, carries out lane change early warning, it is possible to increase the accuracy rate of vehicle lane change early warning, reduces security incident and occurs
Probability.
It should be noted that herein, term " inclusion ", "comprising" or its any other variant
Be intended to comprising of nonexcludability so that include a series of process of key elements, method, article or
Person's device not only includes those key elements, but also includes other key elements being not expressly set out, or also
Including for this process, method, article or the intrinsic key element of device.In the feelings not having more restrictions
Under condition, the key element that limited by sentence "including a ..." it is not excluded that include this key element process,
Also there is other identical element in method, article or device.
The embodiments of the present invention are for illustration only, do not represent the quality of embodiment.
Through the above description of the embodiments, those skilled in the art can be understood that above-mentioned
Embodiment method can be realized by the mode of software plus necessary general hardware platform naturally it is also possible to lead to
Cross hardware, but the former is more preferably embodiment in many cases.Based on such understanding, the present invention's
Technical scheme substantially in other words prior art is contributed partly can in the form of software product body
Reveal to come, this computer software product is stored in a storage medium (as ROM/RAM, magnetic disc, light
Disk) in, including some instructions with so that a station terminal equipment (can be mobile phone, computer, service
Device, air-conditioner, or network equipment etc.) execution each embodiment of the present invention described in method.
These are only the preferred embodiments of the present invention, not thereby limit the scope of the claims of the present invention, every
The equivalent structure made using description of the invention and accompanying drawing content or equivalent flow conversion, or directly or
Connect and be used in other related technical fields, be included within the scope of the present invention.
Claims (11)
1. a kind of method of lane departure warning is it is characterised in that the method bag of described lane departure warning
Include following steps:
Obtain the facial image of driver of backsight collecting unit collection, the collection of forward sight collecting unit of vehicle
Deviation image and steering indicating light signal gathering unit collection turn signal state;
When the steering indicating light described automotive run-off-road and described vehicle is detected is not opened, according to described people
The direction of face image and described automotive run-off-road carries out lane change early warning.
2. the method for lane departure warning as claimed in claim 1 is it is characterised in that described work as detection
To automotive run-off-road and when the steering indicating light of described vehicle does not open, according to described facial image and described car
The step that the direction of run-off-road carries out lane change early warning includes:
When steering indicating light automotive run-off-road and described vehicle is detected is not opened, according to described face figure
Deviate intention and condition as obtaining the subjective of described driver;
Judge whether described subjective deviation is intended to consistent with the direction of described automotive run-off-road;
If the described subjective intention that deviates is inconsistent with the direction of described automotive run-off-road, drive described in judgement
Whether the condition of the person of sailing is fatigue;
If the condition of described driver is fatigue, at least carry out audible alarm;
If the condition of described driver is non-fatigue, or described subjective deviation is intended to and described vehicle
When the direction of run-off-road is consistent, then do not carry out audible alarm.
3. lane departure warning as claimed in claim 2 method it is characterised in that described according to institute
The step stating the subjective deviation intention and condition that facial image obtains described driver includes:
Human eye feature point and face feature point are extracted according to described facial image;
Described condition is obtained according to described human eye feature point, according to described face feature point obtains
Subjective deviation is intended to.
4. lane departure warning as claimed in claim 3 method it is characterised in that described according to institute
State the described subjective step being intended to that deviates of face feature point acquisition to include:
Described the driver elevation angle average of head and head in Preset Time are obtained according to described face feature point
The deflection average in portion;
When described elevation angle average is more than predetermined angle threshold value, judge described deflection average whether more than pre-
If amount of yaw, and judge more than default amount of yaw persistent period whether less than default effectively
Time;
If the result judging is being, described subjective deviation being obtained according to described deflection average and is intended to.
5. the lane departure warning as described in any one of Claims 1-4 method it is characterised in that
Include before the step of the facial image of driver that the described backsight collecting unit obtaining vehicle gathers:
When the speed of described vehicle is more than pre-set velocity threshold value, obtain the forward sight collecting unit of described vehicle
The deviation image of collection, vehicle whether run-off-road according to described deviation image detection.
6. a kind of device of lane departure warning is it is characterised in that the device bag of described lane departure warning
Include:
Acquisition module, the facial image, front of the driver that the backsight collecting unit for obtaining vehicle gathers
Depending on the deviation image of collecting unit collection and the turn signal state of steering indicating light signal gathering unit collection;
Warning module, for when detecting described automotive run-off-road and the steering indicating light of described vehicle is not opened
When, the direction according to described facial image and described automotive run-off-road carries out lane change early warning.
7. the device of lane departure warning as claimed in claim 6 is it is characterised in that described early warning mould
Block includes:
Acquiring unit, during for not opening when steering indicating light automotive run-off-road and described vehicle is detected,
The subjective of described driver is obtained according to described facial image and deviates intention and condition;
First judging unit, for judging the described subjective direction deviateing intention and described automotive run-off-road
Whether consistent;
Second judging unit, if for described subjective deviate be intended to the direction of described automotive run-off-road not
Unanimously, then whether the condition judging described driver is fatigue;
First alarm unit, if the condition for described driver is fatigue, at least carries out sound
Report to the police;
Second alarm unit, if the condition for described driver is non-fatigue, or described subjectivity
When deviation is intended to consistent with the direction of described automotive run-off-road, then do not carry out audible alarm.
8. the device of lane departure warning as claimed in claim 7 is it is characterised in that described acquisition list
Unit includes:
Extract subelement, for human eye feature point and face feature point are extracted according to described facial image;
Obtain subelement, for described condition is obtained according to described human eye feature point, according to described face
Portion's characteristic point obtains described subjective deviation and is intended to.
9. the device of lane departure warning as claimed in claim 8 is it is characterised in that described acquisition is sub
Unit specifically for obtaining the elevation angle of described driver head in Preset Time according to described face feature point
The deflection average of average and head;When described elevation angle average is more than predetermined angle threshold value, judge described
Whether deflection average is more than default amount of yaw, and judge more than default amount of yaw lasting when
Between whether be less than default effective time;If the result judging is being, according to described deflection average
Obtain described subjective deviation to be intended to.
10. the lane departure warning as described in any one of claim 6 to 9 device it is characterised in that
The device of described lane departure warning also includes:
Detection module, for when the speed of described vehicle is more than pre-set velocity threshold value, obtaining described vehicle
Forward sight collecting unit collection deviation image, vehicle according to described deviation image detection
Whether run-off-road.
A kind of 11. systems of lane departure warning are it is characterised in that the system of described lane departure warning
Including forward sight collecting unit, backsight collecting unit, steering indicating light signal gathering unit and Logical processing unit,
Wherein:
Described forward sight collecting unit, for gathering track slip chart picture;
Described backsight collecting unit, for gathering the facial image of driver;
Described steering indicating light signal gathering unit, for gathering turn signal state;
Described Logical processing unit, for obtaining described deviation image, facial image and steering indicating light shape
State, when the steering indicating light described automotive run-off-road and described vehicle is detected is not opened, according to described people
The direction of face image and described automotive run-off-road carries out lane change early warning.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201510519943.XA CN106467057B (en) | 2015-08-21 | 2015-08-21 | The method, apparatus and system of lane departure warning |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201510519943.XA CN106467057B (en) | 2015-08-21 | 2015-08-21 | The method, apparatus and system of lane departure warning |
Publications (2)
Publication Number | Publication Date |
---|---|
CN106467057A true CN106467057A (en) | 2017-03-01 |
CN106467057B CN106467057B (en) | 2019-01-08 |
Family
ID=58229087
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201510519943.XA Active CN106467057B (en) | 2015-08-21 | 2015-08-21 | The method, apparatus and system of lane departure warning |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN106467057B (en) |
Cited By (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN109017813A (en) * | 2018-06-14 | 2018-12-18 | 安徽江淮汽车集团股份有限公司 | A kind of deviation alarm method and device |
TWI646001B (en) * | 2017-08-18 | 2019-01-01 | 神達電腦股份有限公司 | Lane departure warning method and system |
CN109299674A (en) * | 2018-09-05 | 2019-02-01 | 重庆大学 | A kind of lane change detection method violating the regulations of the tunnel based on car light |
CN109398355A (en) * | 2017-08-18 | 2019-03-01 | 郑州宇通客车股份有限公司 | It is a kind of for lane keeping method and vehicle based on distributed motor-driven vehicle |
CN109515313A (en) * | 2017-09-18 | 2019-03-26 | 佛山市顺德区顺达电脑厂有限公司 | Lane departure warning method and its system |
CN110491126A (en) * | 2019-08-25 | 2019-11-22 | 吴新胜 | A kind of non-motor vehicle crossing travel control method and system based on technology of Internet of things |
CN112289075A (en) * | 2020-10-28 | 2021-01-29 | 武汉极目智能技术有限公司 | Self-adaptive setting method and system for alarm strategy of vehicle active safety system |
CN113525346A (en) * | 2020-04-21 | 2021-10-22 | 丰田自动车株式会社 | Vehicle control system and vehicle control method |
CN113581196A (en) * | 2021-08-30 | 2021-11-02 | 上海商汤临港智能科技有限公司 | Vehicle driving early warning method and device, computer equipment and storage medium |
Citations (10)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
DE102004034748A1 (en) * | 2004-07-17 | 2006-02-02 | Conti Temic Microelectronic Gmbh | Driver assistance system has warning device activated depending on how strongly/how long for/how often set driving direction/current lane occupation and current lane course/desired lane occupation to be maintained deviate from each other |
US20080186154A1 (en) * | 2004-10-01 | 2008-08-07 | Robert Bosch Gmbh | Method and Device for Driver Support |
CN101574970A (en) * | 2009-03-06 | 2009-11-11 | 北京中星微电子有限公司 | Method and device for monitoring vehicle to change lane |
CN102424017A (en) * | 2011-11-11 | 2012-04-25 | 长安大学 | Intelligent automobile lane change warning system and warning method thereof |
CN102509418A (en) * | 2011-10-11 | 2012-06-20 | 东华大学 | Fatigue driving estimation and early-warning method and device of multi-sensor information fusion |
CN103204122A (en) * | 2012-01-16 | 2013-07-17 | 深圳职业技术学院 | Alarm system and alarm method for vehicle lane change |
CN103552560A (en) * | 2013-11-01 | 2014-02-05 | 扬州瑞控汽车电子有限公司 | Driver driving state recognition-based lane departure alarming method |
CN103895512A (en) * | 2012-12-26 | 2014-07-02 | 比亚迪股份有限公司 | Traffic safety warning method and traffic safety warning system |
CN104736391A (en) * | 2012-07-25 | 2015-06-24 | 标致·雪铁龙汽车公司 | Lane changing support system for vehicles |
CN104794856A (en) * | 2014-01-22 | 2015-07-22 | 径卫视觉科技(上海)有限公司 | Driver's attention comprehensive evaluation system |
-
2015
- 2015-08-21 CN CN201510519943.XA patent/CN106467057B/en active Active
Patent Citations (10)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
DE102004034748A1 (en) * | 2004-07-17 | 2006-02-02 | Conti Temic Microelectronic Gmbh | Driver assistance system has warning device activated depending on how strongly/how long for/how often set driving direction/current lane occupation and current lane course/desired lane occupation to be maintained deviate from each other |
US20080186154A1 (en) * | 2004-10-01 | 2008-08-07 | Robert Bosch Gmbh | Method and Device for Driver Support |
CN101574970A (en) * | 2009-03-06 | 2009-11-11 | 北京中星微电子有限公司 | Method and device for monitoring vehicle to change lane |
CN102509418A (en) * | 2011-10-11 | 2012-06-20 | 东华大学 | Fatigue driving estimation and early-warning method and device of multi-sensor information fusion |
CN102424017A (en) * | 2011-11-11 | 2012-04-25 | 长安大学 | Intelligent automobile lane change warning system and warning method thereof |
CN103204122A (en) * | 2012-01-16 | 2013-07-17 | 深圳职业技术学院 | Alarm system and alarm method for vehicle lane change |
CN104736391A (en) * | 2012-07-25 | 2015-06-24 | 标致·雪铁龙汽车公司 | Lane changing support system for vehicles |
CN103895512A (en) * | 2012-12-26 | 2014-07-02 | 比亚迪股份有限公司 | Traffic safety warning method and traffic safety warning system |
CN103552560A (en) * | 2013-11-01 | 2014-02-05 | 扬州瑞控汽车电子有限公司 | Driver driving state recognition-based lane departure alarming method |
CN104794856A (en) * | 2014-01-22 | 2015-07-22 | 径卫视觉科技(上海)有限公司 | Driver's attention comprehensive evaluation system |
Cited By (12)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
TWI646001B (en) * | 2017-08-18 | 2019-01-01 | 神達電腦股份有限公司 | Lane departure warning method and system |
CN109398355A (en) * | 2017-08-18 | 2019-03-01 | 郑州宇通客车股份有限公司 | It is a kind of for lane keeping method and vehicle based on distributed motor-driven vehicle |
CN109515313A (en) * | 2017-09-18 | 2019-03-26 | 佛山市顺德区顺达电脑厂有限公司 | Lane departure warning method and its system |
CN109017813A (en) * | 2018-06-14 | 2018-12-18 | 安徽江淮汽车集团股份有限公司 | A kind of deviation alarm method and device |
CN109299674A (en) * | 2018-09-05 | 2019-02-01 | 重庆大学 | A kind of lane change detection method violating the regulations of the tunnel based on car light |
CN109299674B (en) * | 2018-09-05 | 2022-03-18 | 重庆大学 | Tunnel illegal lane change detection method based on car lamp |
CN110491126A (en) * | 2019-08-25 | 2019-11-22 | 吴新胜 | A kind of non-motor vehicle crossing travel control method and system based on technology of Internet of things |
CN113525346A (en) * | 2020-04-21 | 2021-10-22 | 丰田自动车株式会社 | Vehicle control system and vehicle control method |
CN113525346B (en) * | 2020-04-21 | 2023-09-12 | 丰田自动车株式会社 | Vehicle control system and vehicle control method |
CN112289075A (en) * | 2020-10-28 | 2021-01-29 | 武汉极目智能技术有限公司 | Self-adaptive setting method and system for alarm strategy of vehicle active safety system |
CN113581196A (en) * | 2021-08-30 | 2021-11-02 | 上海商汤临港智能科技有限公司 | Vehicle driving early warning method and device, computer equipment and storage medium |
CN113581196B (en) * | 2021-08-30 | 2023-08-22 | 上海商汤临港智能科技有限公司 | Method and device for early warning of vehicle running, computer equipment and storage medium |
Also Published As
Publication number | Publication date |
---|---|
CN106467057B (en) | 2019-01-08 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN106467057A (en) | The method of lane departure warning, apparatus and system | |
CN106709420B (en) | Method for monitoring driving behavior of commercial vehicle driver | |
CN104183091A (en) | System for adjusting sensitivity of fatigue driving early warning system in self-adaptive mode | |
CN106218405A (en) | Fatigue driving monitoring method and cloud server | |
CN107031553A (en) | A kind of tailgating-proof system and method for vehicle | |
CN111434553B (en) | Brake system, method and device, and fatigue driving model training method and device | |
CN109740477A (en) | Study in Driver Fatigue State Surveillance System and its fatigue detection method | |
CN109435844A (en) | A kind of driving auxiliary and drivers ' behavior detection method | |
CN106228756A (en) | The intelligent driving safety assisting system of vehicle | |
CN108021875A (en) | A kind of vehicle driver's personalization fatigue monitoring and method for early warning | |
CN103700220A (en) | Fatigue driving monitoring device | |
CN112220480A (en) | Driver state detection system and vehicle based on millimeter wave radar and camera fusion | |
CN109367540A (en) | A kind of driver's response identifying system based on Risk-warning | |
CN104299363A (en) | Fatigue driving pre-warning system based on multi-feature fusion | |
CN107403541A (en) | The system of real-time eye recognition monitoring fatigue driving | |
CN114872713A (en) | Device and method for monitoring abnormal driving state of driver | |
CN107221156A (en) | The method and system that a kind of real-time monitoring is driven when intoxicated | |
CN107284449A (en) | A kind of traffic safety method for early warning and system, automobile, readable storage medium storing program for executing | |
CN113838265A (en) | Fatigue driving early warning method and device and electronic equipment | |
CN115937830A (en) | Special vehicle-oriented driver fatigue detection method | |
CN107506698A (en) | The method of public transportation vehicle anti-fatigue-driving management based on Internet of Things | |
CN107085720A (en) | A kind of vehicle-mounted alarm system and method | |
CN110310488A (en) | A kind of large-sized truck is broken rules and regulations method for generating message and system | |
CN112277940B (en) | Driver state control system based on image information | |
CN210000130U (en) | automobile self-recognition deceleration system |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant | ||
TR01 | Transfer of patent right |
Effective date of registration: 20230717 Address after: 518000 Tencent Building, No. 1 High-tech Zone, Nanshan District, Shenzhen City, Guangdong Province, 35 Floors Patentee after: TENCENT TECHNOLOGY (SHENZHEN) Co.,Ltd. Patentee after: TENCENT CLOUD COMPUTING (BEIJING) Co.,Ltd. Address before: 2, 518000, East 403 room, SEG science and Technology Park, Zhenxing Road, Shenzhen, Guangdong, Futian District Patentee before: TENCENT TECHNOLOGY (SHENZHEN) Co.,Ltd. |
|
TR01 | Transfer of patent right |