CN108859963A - Multifunctional driving assistance method, multifunctional driving assistance device, and storage medium - Google Patents
Multifunctional driving assistance method, multifunctional driving assistance device, and storage medium Download PDFInfo
- Publication number
- CN108859963A CN108859963A CN201810686742.2A CN201810686742A CN108859963A CN 108859963 A CN108859963 A CN 108859963A CN 201810686742 A CN201810686742 A CN 201810686742A CN 108859963 A CN108859963 A CN 108859963A
- Authority
- CN
- China
- Prior art keywords
- information
- default
- vehicle
- lane line
- early
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 71
- 238000003860 storage Methods 0.000 title claims abstract description 16
- 238000004088 simulation Methods 0.000 claims abstract description 35
- 230000004888 barrier function Effects 0.000 claims description 78
- 238000005286 illumination Methods 0.000 claims description 20
- 238000004590 computer program Methods 0.000 claims description 18
- 238000002788 crimping Methods 0.000 claims description 14
- 230000001133 acceleration Effects 0.000 claims description 11
- 238000010276 construction Methods 0.000 claims description 10
- 239000000284 extract Substances 0.000 claims description 6
- 230000008569 process Effects 0.000 abstract description 23
- 238000010586 diagram Methods 0.000 description 22
- 238000012790 confirmation Methods 0.000 description 16
- 230000006870 function Effects 0.000 description 15
- 241000894007 species Species 0.000 description 10
- 230000003068 static effect Effects 0.000 description 9
- 230000006872 improvement Effects 0.000 description 8
- 238000004364 calculation method Methods 0.000 description 4
- 238000012545 processing Methods 0.000 description 4
- 238000004891 communication Methods 0.000 description 3
- 238000010168 coupling process Methods 0.000 description 3
- 238000005859 coupling reaction Methods 0.000 description 3
- 238000003384 imaging method Methods 0.000 description 3
- 230000003287 optical effect Effects 0.000 description 3
- 230000006399 behavior Effects 0.000 description 2
- 230000008878 coupling Effects 0.000 description 2
- 238000005520 cutting process Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 241000208340 Araliaceae Species 0.000 description 1
- 235000005035 Panax pseudoginseng ssp. pseudoginseng Nutrition 0.000 description 1
- 235000003140 Panax quinquefolius Nutrition 0.000 description 1
- 238000004422 calculation algorithm Methods 0.000 description 1
- 238000012937 correction Methods 0.000 description 1
- 230000003111 delayed effect Effects 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000009826 distribution Methods 0.000 description 1
- 238000000605 extraction Methods 0.000 description 1
- 235000008434 ginseng Nutrition 0.000 description 1
- 230000014759 maintenance of location Effects 0.000 description 1
- 238000005192 partition Methods 0.000 description 1
- 238000003825 pressing Methods 0.000 description 1
- 230000009467 reduction Effects 0.000 description 1
- 238000005070 sampling Methods 0.000 description 1
- 239000004575 stone Substances 0.000 description 1
- 230000009466 transformation Effects 0.000 description 1
Classifications
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60R1/00—Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60Q—ARRANGEMENT OF SIGNALLING OR LIGHTING DEVICES, THE MOUNTING OR SUPPORTING THEREOF OR CIRCUITS THEREFOR, FOR VEHICLES IN GENERAL
- B60Q9/00—Arrangement or adaptation of signal devices not provided for in one of main groups B60Q1/00 - B60Q7/00, e.g. haptic signalling
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60R16/00—Electric or fluid circuits specially adapted for vehicles and not otherwise provided for; Arrangement of elements of electric or fluid circuits specially adapted for vehicles and not otherwise provided for
- B60R16/02—Electric or fluid circuits specially adapted for vehicles and not otherwise provided for; Arrangement of elements of electric or fluid circuits specially adapted for vehicles and not otherwise provided for electric constitutive elements
- B60R16/023—Electric or fluid circuits specially adapted for vehicles and not otherwise provided for; Arrangement of elements of electric or fluid circuits specially adapted for vehicles and not otherwise provided for electric constitutive elements for transmission of signals between vehicle parts or subsystems
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60R2300/00—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
- B60R2300/10—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of camera system used
Landscapes
- Engineering & Computer Science (AREA)
- Mechanical Engineering (AREA)
- Multimedia (AREA)
- Human Computer Interaction (AREA)
- Signal Processing (AREA)
- Traffic Control Systems (AREA)
Abstract
The invention discloses a multifunctional driving assistance method, a multifunctional driving assistance device and a storage medium, wherein the method comprises the following steps: acquiring an initial image in front of the automobile through a binocular camera; extracting at least one image characteristic information of the initial image; judging whether target image characteristic information in at least one image characteristic information meets a preset early warning condition or not; when the target image characteristic information accords with the preset early warning condition, the early warning prompt tone is sent out through the vehicle-mounted loudspeaker box, an animation simulation video is constructed according to the target image characteristic information, and the animation simulation video is output and displayed on the vehicle-mounted display screen. According to the invention, when the condition that the automobile needs early warning in the current driving process is confirmed by analyzing the initial image shot by the binocular camera, the reminding information is sent out to remind a driver of avoiding in time, so that the probability of safety accidents is reduced.
Description
Technical field
The present invention relates to automobile driving safe field more particularly to a kind of multifunctional driver householder methods, multifunctional driver
Auxiliary device and storage medium.
Background technique
Attention with people to traffic safety, automobile data recorder start the standard configuration as automobile.Row currently on the market
Most of vehicle recorder has a single function, and generally there was only video record function and captures function.And with the rapid hair of auto industry
Exhibition, road get on the car data sharp increase, how to improve driving safety and intelligence, in critical traffic conditions assist drive
Member and help to avoid accident or mitigate collision consequence be just particularly important, therefore, how to be assisted by automobile data recorder
Driver safety drives, and is current technical problem urgently to be resolved.
Summary of the invention
The present invention provides a kind of multifunctional driver householder method, multifunctional driver auxiliary device and storage mediums, with solution
Certainly the automobile data recorder on existing market does not have the problem of drive assistance function.
To solve the above-mentioned problems, the present invention provides a kind of multifunctional driver householder methods comprising:
The initial pictures of vehicle front are acquired by binocular camera;
Extract at least one image feature information of initial pictures;
Judge to meet default early-warning conditions with the presence or absence of target image characteristics information at least one image feature information;
When meeting default early-warning conditions there are target image characteristics information, early warning sound is issued by vehicle-mounted sound box,
And according to target image characteristics information architecture animation simulation video, and in output display animation simulation video on vehicle-carrying display screen.
As a further improvement of the present invention, presetting early-warning conditions is barrier early-warning conditions, judges at least one image
The step of meeting default early-warning conditions with the presence or absence of target image characteristics information in characteristic information, including:
Judge that vehicle front whether there is default obstacle information according at least one image feature information;
When in the presence of default obstacle information, judge that default obstacle information is default stationary obstruction information or presets
Dynamic barrier information;
When default obstacle information is default stationary obstruction information, by presetting binocular camera shooting principle analysis at least one
A image feature information obtains the first current distance between automobile and stationary obstruction;
The current vehicle speed of automobile is obtained by acceleration transducer;
The required duration at running car to barrier is calculated according to the first current distance and current vehicle speed;
Judge whether required duration is less than preset time threshold;
When being less than preset time threshold between when running, there are target image characteristics letters at least one image feature information
Breath meets barrier early-warning conditions, and target image characteristics information is stationary obstruction.
As a further improvement of the present invention, according to target image characteristics information architecture animation simulation video, and in vehicle-mounted
On display screen the step of output display animation simulation video, including:
The corresponding first object obstacle identity of stationary obstruction is identified from the first default obstacle identity library, and first is default
Obstacle identity library includes various disorders species type;
Obtain first object animation types corresponding with first object obstacle identity, each obstacle identity corresponding one
A animation model;
Stationary obstruction animated video is constructed according to first object animation model, and quiet in output display on vehicle-carrying display screen
Only barrier animated video and the first current distance.
As a further improvement of the present invention, presetting early-warning conditions is that front truck moves early-warning conditions, judges default barrier
After the step of information is default stationary obstruction information or default dynamic barrier information, further include:
When default obstacle information is default dynamic barrier information, by presetting binocular camera shooting principle analysis at least one
A image feature information obtains the second current distance between automobile and dynamic barrier;
Judge whether the second current distance is less than pre-determined distance threshold value;
When the second current distance is less than pre-determined distance threshold value, there are target image spies at least one image feature information
Reference breath meets front truck movement early-warning conditions.
As a further improvement of the present invention, according to target image characteristics information architecture animation simulation video, and in vehicle-mounted
On display screen the step of output display animation simulation video, including:
The corresponding second target obstacle type of dynamic barrier is identified from the second default obstacle identity library, and second is default
Obstacle identity library includes various disorders species type;
Obtain the second target animation type corresponding with the second target obstacle type, each obstacle identity corresponding one
A animation model;
According to the second target animation model construction dynamic barrier animated video, and it is dynamic in output display on vehicle-carrying display screen
State barrier animated video and the second current distance.
As a further improvement of the present invention, presetting early-warning conditions is lane departure warning condition, judges at least one figure
As the step of meeting default early-warning conditions with the presence or absence of target image characteristics information in characteristic information, including:
It analyzes at least one image feature information and obtains first lane line characteristic information and the first headstock location information;
Left-hand lane line position information and right side are determined according to the first headstock location information and first lane line characteristic information
Lane line position information;
Judge that automobile is according to left-hand lane line position information, right-hand lane line position information and the first headstock location information
No crimping;
When automobile crimping, if automobile does not carry out default steering operation, there are mesh at least one image feature information
Logo image characteristic information meets lane departure warning condition.
As a further improvement of the present invention, according to target image characteristics information architecture animation simulation video, and in vehicle-mounted
On display screen the step of output display animation simulation video, including:
Deviation animated video is constructed according to first lane line characteristic information and the first headstock location information;
Vapour is judged according to left-hand lane line position information, right-hand lane line position information and the first automobile head location information
Vehicle presses left-hand lane line or right-hand lane line;
If automobile presses left-hand lane line, in the left-hand lane for highlighting deviation animated video on vehicle-carrying display screen
Line;
If automobile presses right-hand lane line, in the right-hand lane for highlighting deviation animated video on vehicle-carrying display screen
Line.
As a further improvement of the present invention, presetting early-warning conditions is low-light (level) early-warning conditions, judges at least one image
The step of meeting default early-warning conditions with the presence or absence of target image characteristics information in characteristic information, including:
It analyzes at least one image feature information and obtains second lane line characteristic information and the second headstock location information;
The target lane where automobile is determined according to second lane line characteristic information and the second headstock location information;
The Pixel Information of target lane region is obtained, and the light of target lane region is obtained according to Pixel Information
According to strength mean value;
Judge whether intensity of illumination mean value is lower than default Intensity threshold;
When intensity of illumination mean value is lower than default Intensity threshold, there are target image spies at least one image feature information
Reference breath meets low-light (level) early-warning conditions.
To solve the above-mentioned problems, the present invention also provides a kind of multifunctional driver auxiliary devices comprising memory, place
Device, vehicle-carrying display screen, vehicle-mounted sound box, binocular camera and acceleration transducer are managed, processor couples memory, car-mounted display
Screen, vehicle-mounted sound box, binocular camera, acceleration transducer are stored with the computer journey that can be run on a processor on memory
Sequence;
Processor executes computer program, realizes the step in any of the above-described multifunctional driver householder method.
To solve the above-mentioned problems, the present invention also provides a kind of storage mediums, are stored thereon with computer program, calculate
When machine program is executed by processor, the step in any of the above-described multifunctional driver householder method is realized.
Compared with the prior art, the present invention shoots the initial pictures of vehicle front by binocular camera, and it is first to analyze this
Beginning image judges whether there is target image characteristics information further according to analysis result and meets default early-warning conditions, when there are targets
When image feature information meets default early-warning conditions, early warning sound is issued, to remind driver to drive with caution, while according to mesh
Logo image characteristic information constructs animation simulation video and is exported by vehicle-carrying display screen and shown, driver is facilitated to confirm automobile early warning
Concrete condition, thus play the role of assist driver-operated, reduce safety accident occur probability.
Detailed description of the invention
Fig. 1 is the flow diagram of multifunctional driver householder method one embodiment of the present invention;
Fig. 2 is the process signal of barrier early warning process one embodiment in multifunctional driver householder method of the present invention
Figure;
Fig. 3 is that binocular camera shooting principle simulation schematic diagram is preset in multifunctional driver householder method of the present invention;
Fig. 4 is the process signal of second embodiment of barrier early warning process in multifunctional driver householder method of the present invention
Figure;
Fig. 5 is the process signal of barrier early warning process third embodiment in multifunctional driver householder method of the present invention
Figure;
Fig. 6 is the process signal of the 4th embodiment of barrier early warning process in multifunctional driver householder method of the present invention
Figure;
Fig. 7 is the process signal of lane departure warning process one embodiment in multifunctional driver householder method of the present invention
Figure;
Fig. 8 is the process signal of second embodiment of lane departure warning process in multifunctional driver householder method of the present invention
Figure;
Fig. 9 is the flow diagram of low-light (level) early warning process one embodiment in multifunctional driver householder method of the present invention;
Figure 10 is the functional block diagram of multifunctional driver auxiliary device one embodiment of the present invention;
Figure 11 is the functional block diagram of judgment module one embodiment in multifunctional driver auxiliary device of the present invention;
Figure 12 is the functional block diagram of warning module one embodiment in multifunctional driver auxiliary device of the present invention;
Figure 13 is the functional block diagram of second embodiment of judgment module in multifunctional driver auxiliary device of the present invention;
Figure 14 is the functional block diagram of second embodiment of warning module in multifunctional driver auxiliary device of the present invention;
Figure 15 is the functional block diagram of judgment module third embodiment in multifunctional driver auxiliary device of the present invention;
Figure 16 is the functional block diagram of warning module third embodiment in multifunctional driver auxiliary device of the present invention;
Figure 17 is the functional block diagram of the 4th embodiment of judgment module in multifunctional driver auxiliary device of the present invention;
Figure 18 is the circuit theory schematic diagram of multifunctional driver auxiliary device one embodiment of the present invention.
Specific embodiment
In order to make the objectives, technical solutions, and advantages of the present invention clearer, with reference to the accompanying drawings and embodiments, right
The present invention is further elaborated.It should be appreciated that the specific embodiments described herein are merely illustrative of the present invention, and
It is not used to limit the present invention.
Fig. 1 illustrates one embodiment of multifunctional driver householder method of the present invention.The multifunctional driver householder method is answered
For multifunctional driver auxiliary device, in the present embodiment, as shown in Figure 1, the multifunctional driver householder method includes:
Step S1 acquires the initial pictures of vehicle front by binocular camera.
Specifically, the multifunctional driver householder method of the embodiment of the present invention is applied to multifunctional driver auxiliary device, this is more
Function drive assistance device includes at least one binocular camera, which is used to acquire the initial graph of vehicle front
Picture.
Step S2 extracts at least one image feature information of initial pictures.
It should be noted that the focal length of the binocular camera in the application is longer, so as to take vehicle front foot
Enough remote regions, and using the black and white camera of high dynamic range, halation phenomenon is effectively inhibited, the thin of dark place is enhanced
Section, after the processing such as the linear correction of the image of shooting, noise remove, bad point removal, interpolation, white balance, auto-exposure control,
Live details is restored, preferably so as to obtain more accurate image feature information according to the live details of reduction.Wherein, should
Image feature information includes the characteristic information of vehicle front lane lane line, the characteristic information of vehicle front barrier, and automobile is worked as
Illumination intensity information etc. around preceding locating lane.
Step S3 judges to meet default early warning with the presence or absence of target image characteristics information at least one image feature information
Condition.When meeting default early-warning conditions there are target image characteristics information, step S4 is executed.
Specifically, which is to preset.
Step S4 issues early warning sound by vehicle-mounted sound box, and according to target image characteristics information architecture animation simulation
Video, and in output display animation simulation video on vehicle-carrying display screen.
Specifically, when meeting default early-warning conditions there are target image characteristics information, early warning is issued by vehicle-mounted sound box
Prompt tone, to remind driver to drive with caution, and meanwhile it is dynamic according to the target image characteristics information architecture for meeting default early-warning conditions
Analog video is drawn, and output shows the animation simulation video on vehicle-carrying display screen, further facilitates driver and confirm that automobile is pre-
Alert concrete condition, such as:Vehicle front has barrier to need evacuation etc..
The present embodiment shoots the initial pictures of vehicle front by binocular camera, and analyzes the initial pictures, further according to
Analysis result judges whether there is target image characteristics information and meets default early-warning conditions, when there are target image characteristics information symbols
When closing default early-warning conditions, early warning sound is issued, to remind driver to drive with caution, while according to target image characteristics information
It constructs animation simulation video and is exported by vehicle-carrying display screen and shown, driver is facilitated to confirm the concrete condition of automobile early warning, from
And play the role of assisting driver-operated, reduce the probability of safety accident appearance.
Fig. 2 is the process signal of barrier early warning process one embodiment in multifunctional driver householder method of the present invention
Figure.In the present embodiment, presetting early-warning conditions is barrier early-warning conditions, as shown in Fig. 2, the multifunctional driver householder method packet
Include following step:
Step S10 acquires the initial pictures of vehicle front by binocular camera.
The step is similar with step S1, specifically refers to the description of step S1, details are not described herein.
Step S11 extracts at least one image feature information of initial pictures.
The step is similar with step S2, specifically refers to the description of step S2, details are not described herein.
Step S12 judges that vehicle front whether there is default obstacle information according at least one image feature information.When
There are when default obstacle information, step S13 is executed.
Specifically, when default early-warning conditions are barrier early-warning conditions, at least one extracted from initial pictures
Image feature information is analyzed, and analysis is wherein with the presence or absence of default obstacle information, when there is default obstacle information, i.e.,
Execute step S13.
Step S13 judges that default obstacle information is default stationary obstruction information or default dynamic barrier information.
When default obstacle information is default stationary obstruction information, step S14 is executed.
Specifically, the barrier of vehicle front includes static barrier and mobile barrier, wherein static obstacle
The corresponding default stationary obstruction information of object, the corresponding default dynamic barrier information of mobile barrier.
Step S14 obtains automobile and static barrier by default at least one image feature information of binocular camera shooting principle analysis
Hinder the first current distance between object.
Specifically, when default obstacle information is default stationary obstruction information, i.e., there are static obstacles for vehicle front
Object, by presetting at least one above-mentioned image feature information of binocular camera shooting principle analysis, to obtain the static of automobile and front
The first current distance between barrier.
It should be noted that as shown in figure 3, the default binocular camera shooting principle is specially:P is a certain on target object
Point, ORWith OTIt is the optical center of two cameras respectively, imaging point of the point P on two cameras is respectively P1And P2(camera
Imaging plane has been placed in front of camera lens after rotation), f is camera focal length, b be two cameras center away from, z be P point extremely
The distance between binocular camera, XRAnd XTIt is the distance of two imaging points range image left edge in two image planes in left and right, if
Point P1To point P2Distance be d, then:
D=b- (XR-XT)
According to similar triangle theory:
It can obtain:
Wherein, focal length f and camera center can be obtained away from b during camera calibration, therefore, as long as obtaining XR-XT
The distance between target object and camera z can be calculated in the value of (i.e. the parallax of two cameras shooting image).
Step S15 obtains the current vehicle speed of automobile by acceleration transducer.
Specifically, the current vehicle speed of automobile can be measured by acceleration transducer.
Being taken at running car to barrier is calculated according to the first current distance and current vehicle speed in step S16
It is long.
Specifically, after obtaining the first current distance and current vehicle speed, the institute at running car to stationary obstruction is calculated
Take length.
Step S17, judges whether required duration is less than preset time threshold.It is less than preset time threshold between when running
When, execute step S18.
Specifically, which presets.The time needed at running car to stationary obstruction is less than
When preset time threshold, step S18 is executed.
Step S18, there are target image characteristics information to meet barrier early-warning conditions at least one image feature information,
Target image characteristics information is stationary obstruction.
Specifically, confirm that meet barrier pre- there are target image characteristics information in above-mentioned at least one image feature information
Alert condition, i.e., there are barriers for confirmation vehicle front.
Step S19 issues early warning sound by vehicle-mounted sound box, and according to target image characteristics information architecture animation simulation
Video, and in output display animation simulation video on vehicle-carrying display screen.
The step is similar with step S4, specifically refers to the description of step S4, details are not described herein.
The present embodiment confirms that vehicle front whether there is default obstacle by the initial pictures of analysis binocular camera shooting
Object information judges whether the default obstacle information is to preset static obstacle when vehicle front has default obstacle information
Object information, when default obstacle information is default stationary obstruction information, i.e., there are stationary obstructions for confirmation vehicle front, lead to
It crosses default binocular camera shooting principle and calculates the first current distance between automobile and stationary obstruction, further according to the first current distance
Taken length at running car to stationary obstruction is calculated with the current vehicle speed of automobile, when required duration is less than threshold between default
When value, i.e. there are the target image characteristics for meeting barrier early-warning conditions in confirmation vehicle front, needs to remind driver, prevents vapour
It collides between vehicle and stationary obstruction.
On the basis of the above embodiments, in other embodiments, referring to fig. 4, step S19 includes:
Step S191 identifies the corresponding first object obstacle species of stationary obstruction from the first default obstacle identity library
Type.
Specifically, the first default obstacle identity library includes various disorders species type, for example, dustbin, stone etc., when true
When recognizing vehicle front in the presence of the stationary obstruction for needing to carry out early warning, obstacle species are matched in the first default obstacle identity library
Type.It should be noted that when stationary obstruction is mismatched with obstacle identity all in the first default obstacle identity library
When, it is classified in the first general obstacle identity.
Step S192 obtains first object animation types corresponding with first object obstacle identity.
Specifically, the corresponding animation model of each obstacle identity, and the first general obstacle identity corresponding first
General animation model.
Step S193 constructs stationary obstruction animated video according to first object animation model, and on vehicle-carrying display screen
Output display stationary obstruction animated video and the first current distance.
Specifically, after obtaining the corresponding first object animation model of stationary obstruction, according to the first object animation model
Stationary obstruction animated video is constructed, and shows the stationary obstruction animated video with output on vehicle-carrying display screen, is exported simultaneously
It shows the first current distance, driver is facilitated to confirm the distance between automobile and stationary obstruction.
The present embodiment is by constructing stationary obstruction animated video according to stationary obstruction and in exporting on vehicle-carrying display screen
It has been shown that, so that driver be facilitated quickly to confirm the concrete condition of vehicle front stationary obstruction, while display automobile and static barrier
Hinder the distance between object, driver is further facilitated to make correct driving behavior according to the case where stationary obstruction, reduces
The probability that safety accident occurs.
On the basis of the above embodiments, in other embodiments, when default early-warning conditions are that front truck moves early-warning conditions, ginseng
See Fig. 5, after step s 13, when default obstacle information is default dynamic barrier information, executes following step:
Step S20 obtains automobile by default at least one image feature information of binocular camera shooting principle analysis and dynamic hinders
Hinder the second current distance between object.
Specifically, please refer to binocular camera shooting principle analysis described in above-described embodiment obtain automobile and dynamic barrier it
Between the second current distance.
It should be noted that the dynamic barrier includes mobile human or animal, automobile etc..
Step S21, judges whether the second current distance is less than pre-determined distance threshold value.When the second current distance be less than it is default away from
When from threshold value, step S22 is executed.
Specifically, when vehicle front is there are when dynamic barrier, by judging second between automobile and dynamic barrier
Whether current distance is less than pre-determined distance threshold value, to confirm vehicle front with the presence or absence of the target image for meeting default early-warning conditions
Characteristic information.When the second current distance is less than pre-determined distance threshold value, step S22 is executed.
Step S22, there are target image characteristics information to meet front truck movement early warning item at least one image feature information
Part.
Specifically, when the second current distance be less than pre-determined distance threshold value when, illustrate between automobile and dynamic barrier away from
From getting too close to, there are the risks of collision, then confirm that there are target image characteristics information symbols at least one image feature information
It closes front truck and moves early-warning conditions.
Step S23 issues early warning sound by vehicle-mounted sound box, and according to target image characteristics information architecture animation simulation
Video, and in output display animation simulation video on vehicle-carrying display screen.
The step is similar with step S4, specifically refers to the description of step S4, details are not described herein.
The present embodiment is by determining that default obstacle information is after presetting dynamic barrier information, to pass through binocular camera shooting principle
Analysis obtains the second current distance between automobile and dynamic barrier, when the second current distance is less than pre-determined distance threshold value,
I.e. there are target image characteristics information to meet front truck movement early-warning conditions for confirmation, issues early warning sound by vehicle-mounted sound box, and
And the dynamic barrier is highlighted on the second image shown in vehicle-carrying display screen, to remind driver to pay attention to avoiding.
On the basis of the above embodiments, in other embodiments, referring to Fig. 6, step S23 includes:
Step S231 identifies the corresponding second target disorders species of dynamic barrier from the second default obstacle identity library
Type, the second default obstacle identity library include various disorders species type.
Specifically, the second default obstacle identity library includes various disorders species type, for example, automobile, bicycle, pedestrian
Deng, when confirm vehicle front exist need to carry out early warning dynamic barrier when, matched in the second default obstacle identity library
Obstacle identity.It should be noted that when obstacle identity all in dynamic barrier and the second default obstacle identity library
When mismatching, it is classified in the second general obstacle identity.
Step S232 obtains the second target animation type corresponding with the second target obstacle type, each barrier
Type corresponds to an animation model.
Specifically, the corresponding animation model of each obstacle identity, and the second general obstacle identity corresponding second
General animation model.
Step S233, according to the second target animation model construction dynamic barrier animated video, and on vehicle-carrying display screen
Output display dynamic barrier animated video and the second current distance.
Specifically, after obtaining the corresponding second target animation model of dynamic barrier, according to the second target animation model
Dynamic barrier animated video is constructed, and shows the dynamic barrier animated video with output on vehicle-carrying display screen, is exported simultaneously
It shows the second current distance, driver is facilitated to confirm the distance between automobile and dynamic barrier.
The present embodiment is by constructing dynamic barrier animated video according to dynamic barrier and in exporting on vehicle-carrying display screen
It has been shown that, thus facilitate driver quickly confirm vehicle front dynamic barrier concrete condition, while display automobile and dynamic
The distance between barrier further facilitates driver to make correct driving behavior according to the case where dynamic barrier, drop
The probability that lower security accident occurs.
Fig. 7 is the process signal of lane departure warning process one embodiment in multifunctional driver householder method of the present invention
Figure.In the present embodiment, presetting early-warning conditions is lane departure warning condition, as shown in fig. 7, the multifunctional driver householder method
Including:
Step S30 acquires the initial pictures of vehicle front by binocular camera.
The step is similar with step S1, specifically refers to the description of step S1, details are not described herein.
Step S31 extracts at least one image feature information of initial pictures.
The step is similar with step S2, specifically refers to the description of step S2, details are not described herein.
Step S32 analyzes at least one image feature information and obtains first lane line characteristic information and the first headstock position
Information.
Specifically, score characteristic information is obtained by analyzing at least one image feature information, score feature is believed
Breath is compared with default lane line characteristic information, to confirm and save lane line characteristic information therein, to obtain vapour
The first lane line characteristic information of front side.And first headstock location information can be obtained according to image feature information.
Step S33 determines that left-hand lane line position is believed according to the first headstock location information and first lane line characteristic information
Breath and right-hand lane line position information.
Specifically, in the initial pictures of binocular camera shooting, it may include a plurality of lane line, therefore, obtaining first
It is the lane that can determine automobile and be presently in conjunction with the first headstock location information, so that it is determined that lane after lane line characteristic information
Left-hand lane line position information and right-hand lane line position information.
Step S34 sentences according to left-hand lane line position information, right-hand lane line position information and the first headstock location information
Vehicle of cutting steam whether crimping.When automobile crimping, step S35 is executed.
Specifically, left-hand lane line position information, right-hand lane line position information and the first headstock location information are being obtained
Afterwards, that is, it can determine whether the first headstock position is overlapped with left-hand lane line position or right-hand lane line position, when the first headstock position
It sets when being overlapped with left-hand lane line position or right-hand lane line position, automobile crimping, executes step S35.
Step S35, if automobile does not carry out default steering operation, there are target images at least one image feature information
Characteristic information meets lane departure warning condition.
Specifically, when automobile crimping, judge whether automobile is carrying out default steering operation, specifically, can pass through
Whether the angle or automobile of automobile steering disc spins, which open turn signal, judges whether automobile is carrying out steering operation, if automobile is not
Default steering operation is carried out, then there are target image characteristics information to meet lane departure warning at least one image feature information
Condition.
Step S36 issues early warning sound by vehicle-mounted sound box, and according to target image characteristics information architecture animation simulation
Video, and in output display animation simulation video on vehicle-carrying display screen.
The step is similar with step S4, specifically refers to the description of step S4, details are not described herein.
The present embodiment is sentenced by the first headstock location information, left-hand lane line position information and right-hand lane line position information
Whether crimping, if automobile does not carry out default steering operation, illustrates that automobile is just travelled in crimping when automobile crimping to vehicle of cutting steam,
Lane is deviated from, there are target image characteristics information to meet lane departure warning condition at least one image feature information, into
And driver's automobile is reminded to deviate current lane, it needs to adjust in time, to prevent there is safety accident.
On the basis of above-described embodiment, in other embodiments, referring to Fig. 8, step S36 includes the following steps:
Step S361, according to first lane line characteristic information and the first headstock location information building deviation animation view
Frequently.
Step S362, according to left-hand lane line position information, right-hand lane line position information and the first automobile head position
Information judges automobile pressure left-hand lane line or right-hand lane line.If automobile presses left-hand lane line, S363 is thened follow the steps;If vapour
Vehicle presses right-hand lane line, thens follow the steps S364.
Specifically, there are target image characteristics information, to meet deviation pre- in confirming at least one image feature information
After alert condition, early warning sound is issued by vehicle-mounted sound box, while according to left-hand lane line position information, right-hand lane line position
Information and the first headstock location information judge automobile pressure left-hand lane line or right-hand lane line;If left-hand lane line position and
One headstock position is overlapped, then illustrates that automobile presses left-hand lane line, execute step S362;If right-hand lane line position and the first headstock
Position is overlapped, then illustrates that automobile presses right-hand lane line, execute step S363.
Step S363, in the left-hand lane line for highlighting deviation animated video on vehicle-carrying display screen.
Specifically, when automobile presses left-hand lane line, in highlighting deviation animated video on vehicle-carrying display screen
Left-hand lane line, for example, left-hand lane line mark is red, and flashed.
Step S364, in the right-hand lane line for highlighting deviation animated video on vehicle-carrying display screen.
Specifically, when automobile presses right-hand lane line, in highlighting deviation animated video on vehicle-carrying display screen
Right-hand lane line, for example, right-hand lane line mark is red, and flashed.
The present embodiment is delayed unloading in confirmation automobile after diatom, automobile pressure left-hand lane line or right-hand lane line is judged, if vapour
Vehicle presses left-hand lane line, then highlights the left-hand lane line of deviation animated video;If automobile presses right-hand lane line, dash forward
The right-hand lane line of deviation animated video is shown out, to quickly, accurately remind whether user's automobile currently deviates from vehicle
Road turns left if deviating from lane and deviates or turn right deviation, so that user be facilitated to adjust automobile according to automobile crimping situation
Position.
Fig. 9 is the flow diagram of low-light (level) early warning process one embodiment in multifunctional driver householder method of the present invention.
In the present embodiment, presetting early-warning conditions is low-light (level) early-warning conditions, as shown in figure 9, the multifunctional driver householder method includes:
Step S40 acquires the initial pictures of vehicle front by binocular camera.
The step is similar with step S1, specifically refers to the description of step S1, details are not described herein.
Step S41 extracts at least one image feature information of initial pictures.
The step is similar with step S2, specifically refers to the description of step S2, details are not described herein.
Step S42 analyzes at least one image feature information and obtains second lane line characteristic information and the second headstock position
Information.
Specifically, score characteristic information is obtained by analyzing at least one image feature information, score feature is believed
Breath is compared with default lane line characteristic information, to confirm and save lane line characteristic information therein, to obtain vapour
The second lane line characteristic information of front side.And second headstock location information can be obtained according to image feature information.
Step S43 determines the target carriage where automobile according to second lane line characteristic information and the second headstock location information
Road.
Step S44 obtains the Pixel Information of target lane region, and obtains target lane place according to Pixel Information
The intensity of illumination mean value in region.
Specifically, behind the target lane that confirmation automobile is presently in, the vehicle front target lane region is obtained
Pixel Information, target lane region is divided into multiple portions, point is then chosen from each part as adopting
Sampling point analyzes the illumination intensity value of each sampled point to obtain multiple illumination intensity values, to multiple light further according to the Pixel Information
The intensity of illumination mean value that the target lane region can be obtained is averaged according to intensity value.
Step S45, judges whether intensity of illumination mean value is lower than default Intensity threshold.When intensity of illumination mean value is lower than default light
When strong threshold value, step S46 is executed.
Step S46, there are target image characteristics information to meet low-light (level) early-warning conditions at least one image feature information.
Specifically, when intensity of illumination mean value is lower than default Intensity threshold, illustrate the lane illumination of automobile current driving not
It is enough, meet low-light (level) early-warning conditions.
Step S47 issues early warning sound by vehicle-mounted sound box, and according to target image characteristics information architecture animation simulation
Video, and in output display animation simulation video on vehicle-carrying display screen.
Specifically, there are target image characteristics information to meet low-light (level) early warning in confirming at least one image feature information
After condition, early warning sound is issued by vehicle-mounted sound box, and according to target image characteristics information architecture animation simulation video, example
Such as, pop-up reminds driver to open the animated video of car light on vehicle-carrying display screen, and early warning sound is cooperated to drive to reach prompting
The purpose of the person's of sailing unlatching car light.
The intensity of illumination mean value that the present embodiment is presently in target lane by obtaining automobile, and determine intensity of illumination mean value
When lower than default Intensity threshold, confirm that meet low-light (level) pre- there are target image characteristics information at least one image feature information
Alert condition, thus by vehicle-mounted sound box sending early warning sound, and according to target image characteristics information architecture animation simulation video,
To remind driver to open car light in time, vehicle front intensity of illumination is improved, facilitates the clearer vehicle front that observes
Travel situations prevent safety accident.
Figure 10 is the functional block diagram of multifunctional driver auxiliary device one embodiment of the present invention.Refering to fig. 10,
The multifunctional driver auxiliary device includes image capture module 10, characteristic extracting module 11, judgment module 12 and warning module 13.
Wherein, image capture module 10, for acquiring the initial pictures of vehicle front by binocular camera;Feature extraction
Module 11, for extracting at least one image feature information of initial pictures;Judgment module 12, for judging at least one image
Meet default early-warning conditions with the presence or absence of target image characteristics information in characteristic information;Warning module 13, for when there are targets
When image feature information meets default early-warning conditions, early warning sound is issued by vehicle-mounted sound box, and according to target image characteristics
Information architecture animation simulation video, and in output display animation simulation video on vehicle-carrying display screen.
Figure 11 is the functional block diagram of second embodiment of multifunctional driver auxiliary device of the present invention.Refering to fig. 11,
Default early-warning conditions are barrier early-warning conditions, which includes the first judging unit 1201, second judgment unit
1202, first distance acquiring unit 1203, speed acquiring unit 1204, duration calculation unit 1205, third judging unit 1206
With the first confirmation unit 1207.
Wherein, the first judging unit 1201, for judging whether vehicle front deposits according at least one image feature information
In default obstacle information;Second judgment unit 1202, for when there is default obstacle information, judging default barrier letter
Breath is default stationary obstruction information or default dynamic barrier information;First distance acquiring unit 1203, for when default
When obstacle information is default stationary obstruction information, by presetting at least one image feature information of binocular camera shooting principle analysis
Obtain the first current distance between automobile and stationary obstruction;Speed acquiring unit 1204, for passing through acceleration transducer
Obtain the current vehicle speed of automobile;Duration calculation unit 1205, for vapour to be calculated according to the first current distance and current vehicle speed
Vehicle travels the required duration to barrier;Third judging unit 1206, for judging whether required duration is less than preset time
Threshold value;First confirmation unit 1207, when being less than preset time threshold between being used for when running, at least one image feature information
There are target image characteristics information to meet barrier early-warning conditions, and target image characteristics information is stationary obstruction.
Figure 12 is the functional block diagram of multifunctional driver auxiliary device third embodiment of the present invention.Refering to fig. 12,
The warning module 13 includes the first recognition unit 1301, first kind acquiring unit 1302 and the first video construction unit 1303.
Wherein, the first recognition unit 1301, for corresponding from the first default obstacle identity library identification stationary obstruction
First object obstacle identity, the first default obstacle identity library include various disorders species type;First kind acquiring unit
1302, for obtaining first object animation types corresponding with first object obstacle identity, each obstacle identity is corresponding
One animation model;First video construction unit 1303, for constructing stationary obstruction animation according to first object animation model
Video, and in output display stationary obstruction animated video and the first current distance on vehicle-carrying display screen.
Figure 13 is the functional block diagram of the 4th embodiment of multifunctional driver auxiliary device of the present invention.Refering to fig. 13,
Default early-warning conditions are that front truck moves early-warning conditions, which further includes that second distance acquiring unit the 1211, the 4th is sentenced
Disconnected unit 1212 and the second confirmation unit 1213.
Wherein, second distance acquiring unit 1211, for when default obstacle information is default dynamic barrier information,
Second between automobile and dynamic barrier is obtained by default at least one image feature information of binocular camera shooting principle analysis to work as
Front distance;4th judging unit 1212, for judging whether the second current distance is less than pre-determined distance threshold value;Second confirmation unit
1213, for when the second current distance is less than pre-determined distance threshold value, there are target images at least one image feature information
Characteristic information meets front truck movement early-warning conditions.
Figure 14 is the functional block diagram of the 5th embodiment of multifunctional driver auxiliary device of the present invention.Refering to fig. 14,
The warning module 13 includes the second recognition unit 1311, Second Type acquiring unit 1312 and the second video construction unit 1313.
Wherein, the second recognition unit 1311 identifies dynamic barrier corresponding second from the second default obstacle identity library
Target obstacle type, the second default obstacle identity library include various disorders species type;Second Type acquiring unit 1312, is obtained
Take the second target animation type corresponding with the second target obstacle type, the corresponding animation mould of each obstacle identity
Type;Second video construction unit 1313, according to the second target animation model construction dynamic barrier animated video, and in vehicle-mounted aobvious
Output display dynamic barrier animated video and the second current distance in display screen.
Figure 15 is the functional block diagram of the 6th embodiment of multifunctional driver auxiliary device of the present invention.Refering to fig. 15,
Default early-warning conditions are lane departure warning condition, which includes the first analytical unit 1221, position acquisition unit
1222, the 5th judging unit 1223 and third confirmation unit 1224.
Wherein, the first analytical unit 1221 obtains first lane line feature for analyzing at least one image feature information
Information and the first headstock location information;Position acquisition unit 1222, for according to the first headstock location information and first lane line
Characteristic information determines left-hand lane line position information and right-hand lane line position information;5th judging unit 1223 is used for basis
Left-hand lane line position information, right-hand lane line position information and the first headstock location information judge automobile whether crimping;Third
Confirmation unit 1224 is used for when automobile crimping, if automobile does not carry out default steering operation, at least one image feature information
In there are target image characteristics information to meet lane departure warning condition.
Figure 16 is the functional block diagram of the 7th embodiment of multifunctional driver auxiliary device of the present invention.Refering to fig. 16,
The warning module 13 includes third video construction unit 1321, lane line judging unit 1322, the first display unit 1323 and the
Two display units 1324.
Wherein, third video construction unit 1321, for being believed according to first lane line characteristic information and the first headstock position
Breath building deviation animated video;Lane line judging unit 1322, for according to left-hand lane line position information, right-hand lane
Line position information and the first automobile head location information judge automobile pressure left-hand lane line or right-hand lane line;First display is single
Member 1323, if left-hand lane line is pressed for automobile, in the left side for highlighting deviation animated video on vehicle-carrying display screen
Lane line;Second display unit 1324, it is inclined in highlighting lane on vehicle-carrying display screen if pressing right-hand lane line for automobile
Right-hand lane line from animated video.
Figure 17 is the functional block diagram of the 8th embodiment of multifunctional driver auxiliary device of the present invention.Refering to fig. 17,
Default early-warning conditions are low-light (level) early-warning conditions, which includes the second analytical unit 1231, lane confirmation unit
1232, light intensity acquiring unit 1233, the 6th judging unit 1234 and the 4th confirmation unit 1235.
Wherein, the second analytical unit 1231 obtains second lane line feature for analyzing at least one image feature information
Information and the second headstock location information;Lane confirmation unit 1232, for according to second lane line characteristic information and the second headstock
Location information determines the target lane where automobile;Light intensity acquiring unit 1233, for obtaining the picture of target lane region
Prime information, and the intensity of illumination mean value of target lane region is obtained according to Pixel Information;6th judging unit 1234, is used for
Judge whether intensity of illumination mean value is lower than default Intensity threshold;4th confirmation unit 1235, for being lower than when intensity of illumination mean value
When default Intensity threshold, there are target image characteristics information to meet low-light (level) early-warning conditions at least one image feature information.
It is apparent to those skilled in the art that for convenience of description and succinctly, only with above-mentioned each function
Can unit, module division progress for example, in practical application, can according to need and by above-mentioned function distribution by different
Functional unit, module are completed, i.e., the internal structure of multifunctional driver auxiliary device is divided into different functional unit or module,
To complete all or part of the functions described above.Each functional unit in embodiment, module can integrate to be handled at one
In unit, it is also possible to each unit and physically exists alone, can also be integrated in one unit with two or more units,
Above-mentioned integrated unit both can take the form of hardware realization, can also realize in the form of software functional units.In addition,
Each functional unit, module specific name be also only for convenience of distinguishing each other, the protection scope being not intended to limit this application.
The specific work process of unit in above-mentioned apparatus, module, can refer to corresponding processes in the foregoing method embodiment, herein no longer
It repeats.
Figure 18 illustrates the schematic block diagram for the multifunctional driver auxiliary device that another embodiment of the invention provides, referring to figure
18, the multifunctional driver auxiliary device in the embodiment includes:It is one or at least two processors 80, memory 81, vehicle-mounted aobvious
Display screen 82, vehicle-mounted sound box 83, binocular camera 84, acceleration transducer 85, and be stored in the memory 81 and can locate
The computer program 810 run on reason device 80.When processor 80 executes computer program 810, above-described embodiment description is realized
Step in the control method of scheduling process, such as:Step S1- step S4 shown in FIG. 1.Alternatively, processor 80 executes calculating
When machine program 810, the function of each module/unit in above-mentioned server example is realized, such as:The module of module 10- shown in Figure 10
13 function.
Computer program 810 can be divided into one or more module/units, one or more module/unit quilt
It is stored in memory 81, and is executed by processor 80, to complete the application.One or more module/units can be can
The series of computation machine program instruction section of specific function is completed, the instruction segment is for describing computer program 810 in the server
Implementation procedure.
Multifunctional driver auxiliary device includes but are not limited to processor 80, memory 81, vehicle-carrying display screen 82, vehicle-mounted sound
Case 83, binocular camera 84, acceleration transducer 85.It will be understood by those skilled in the art that Figure 18 is only multifunctional driver
One example of auxiliary device, does not constitute the restriction to multifunctional driver auxiliary device, may include more or more than illustrating
Few component perhaps combines certain components or different components, such as multifunctional driver auxiliary device can also include input
Equipment, output equipment, network access equipment, bus etc..
Processor 80 can be central processing unit (Central Processing Unit, CPU), can also be other
General processor, digital signal processor (Digital Signal Processor, DSP), specific integrated circuit
(Application Specific Integrated Circuit, ASIC), ready-made programmable gate array (Field-
Programmable Gate Array, FPGA) either other programmable logic device, discrete gate or transistor logic,
Discrete hardware components etc..General processor can be microprocessor or the processor is also possible to any conventional processor
Deng.
Memory 81 can be read-only memory, the static storage device that can store static information and instruction, arbitrary access
Memory or the dynamic memory that can store information and instruction are also possible to Electrically Erasable Programmable Read-Only Memory, read-only
CD or other optical disc storages, optical disc storage, magnetic disk storage medium or other magnetic storage apparatus.Memory 81 and processor
80 can be connected by communication bus, can also be integrated with processor 80.
In the above-described embodiments, it all emphasizes particularly on different fields to the description of each embodiment, is not described in detail or remembers in some embodiment
The part of load may refer to the associated description of other embodiments.
Those of ordinary skill in the art may be aware that list described in conjunction with the examples disclosed in the embodiments of the present disclosure
Member and algorithm steps can be realized with the combination of electronic hardware or computer software and electronic hardware.These functions are actually
It is implemented in hardware or software, the specific application and design constraint depending on technical solution.Professional technician
Each specific application can be used different methods to achieve the described function, but this realization is it is not considered that exceed
Scope of the present application.
In embodiment provided herein, it should be understood that disclosed multifunctional driver auxiliary device and more function
Energy driving assistance method, may be implemented in other ways.For example, multifunctional driver auxiliary device described above is implemented
Example is only schematical, for example, the division of module or unit, only a kind of logical function partition in actual implementation can be with
There is other division mode, such as multiple units or components can be combined or can be integrated into another system or some spies
Sign can be ignored, or not execute.Another point, shown or discussed mutual coupling or direct-coupling or communication connection can
To be the INDIRECT COUPLING or communication connection of device or unit through some interfaces, it can be electrical property, mechanical or other forms.
It, can also be in addition, each functional unit in each embodiment of the application can integrate in one processing unit
It is that each unit physically exists alone, can also be integrated in one unit with two or more units.Above-mentioned integrated list
Member both can take the form of hardware realization, can also realize in the form of software functional units.
The embodiment of the present application also provides a kind of storage mediums, and for storing computer program, it includes for executing sheet
Apply for program data designed by above-mentioned multifunctional driver householder method embodiment.By executing the meter stored in the storage medium
Multifunctional driver householder method provided by the present application may be implemented in calculation machine program.
If integrated module/unit is realized in the form of SFU software functional unit and sells or use as independent product
When, it can store in a computer readable storage medium.Based on this understanding, the application realizes above-described embodiment side
All or part of the process in method can also instruct relevant hardware to complete, computer program by computer program 810
810 can be stored in a computer readable storage medium, the computer program 810 by processor 80 execute when, it can be achieved that on
The step of stating each embodiment of the method.Wherein, computer program 810 includes computer program code, and computer program code can
Think source code form, object identification code form, executable file or certain intermediate forms etc..Computer-readable medium can wrap
It includes:Any entity or device, recording medium, USB flash disk, mobile hard disk, magnetic disk, CD, meter of computer program code can be carried
Calculation machine memory, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access
Memory), electric carrier signal, telecommunication signal and software distribution medium etc..It should be noted that computer-readable medium includes
Content can be according to making laws in jurisdiction and the requirement of patent practice carries out increase and decrease appropriate, such as in certain judicial pipes
Area under one's jurisdiction, according to legislation and patent practice, computer-readable medium do not include be electric carrier signal and telecommunication signal.
The specific embodiment of invention is described in detail above, but it is only used as example, the present invention is not intended to limit
In specific embodiments described above.For a person skilled in the art, any equivalent modifications that the invention is carried out
Or substitute also all among scope of the invention, therefore, the made equalization in the case where not departing from the spirit and principles in the present invention range
Transformation and modification, improvement etc., all should be contained within the scope of the invention.
Claims (10)
1. a kind of multifunctional driver householder method, which is characterized in that it includes:
The initial pictures of vehicle front are acquired by binocular camera;
Extract at least one image feature information of the initial pictures;
Judge to meet default early-warning conditions with the presence or absence of target image characteristics information at least one described image feature information;
When meeting default early-warning conditions there are target image characteristics information, early warning sound, and root are issued by vehicle-mounted sound box
The animation mould is shown according to the target image characteristics information architecture animation simulation video, and in output on the vehicle-carrying display screen
Quasi- video.
2. multifunctional driver householder method according to claim 1, which is characterized in that the default early-warning conditions are obstacle
Object early-warning conditions meet at least one image feature information described in the judgement default with the presence or absence of target image characteristics information
The step of early-warning conditions, including:
Judge that the vehicle front whether there is default obstacle information according at least one described image feature information;
When there is default obstacle information, judge that the default obstacle information is default stationary obstruction information or presets
Dynamic barrier information;
When the default obstacle information is default stationary obstruction information, by presetting described in binocular camera shooting principle analysis extremely
A few image feature information obtains the first current distance between the automobile and stationary obstruction;
The current vehicle speed of the automobile is obtained by acceleration transducer;
The institute at the running car to the barrier is calculated according to first current distance and the current vehicle speed
Take length;
Judge whether the required duration is less than preset time threshold;
When the running time is less than preset time threshold, there are the target figures at least one described image feature information
As characteristic information meets the barrier early-warning conditions, the target image characteristics information is the stationary obstruction.
3. multifunctional driver householder method according to claim 2, which is characterized in that described special according to the target image
Information architecture animation simulation video is levied, and in exporting the step of showing the animation simulation video on the vehicle-carrying display screen, is wrapped
It includes:
The corresponding first object obstacle identity of the stationary obstruction is identified from the first default obstacle identity library, described first
Default obstacle identity library includes various disorders species type;
Obtain first object animation types corresponding with the first object obstacle identity, each obstacle identity corresponding one
A animation model;
Stationary obstruction animated video is constructed according to the first object animation model, and aobvious in exporting on the vehicle-carrying display screen
Show the stationary obstruction animated video and first current distance.
4. multifunctional driver householder method according to claim 2, which is characterized in that the default early-warning conditions are front truck
Early-warning conditions are moved, the judgement default obstacle information is default stationary obstruction information or default dynamic barrier
After the step of information, further include:
When the default obstacle information is default dynamic barrier information, pass through the default binocular camera shooting principle analysis institute
It states at least one image feature information and obtains the second current distance between the automobile and dynamic barrier;
Judge whether second current distance is less than pre-determined distance threshold value;
When second current distance is less than pre-determined distance threshold value, there are the mesh at least one described image feature information
Logo image characteristic information meets the front truck movement early-warning conditions.
5. multifunctional driver householder method according to claim 4, which is characterized in that described special according to the target image
Information architecture animation simulation video is levied, and in exporting the step of showing the animation simulation video on the vehicle-carrying display screen, is wrapped
It includes:
The corresponding second target obstacle type of the dynamic barrier is identified from the second default obstacle identity library, described second
Default obstacle identity library includes various disorders species type;
Obtain the second target animation type corresponding with the second target obstacle type, each obstacle identity corresponding one
A animation model;
According to the second target animation model construction dynamic barrier animated video, and it is aobvious in being exported on the vehicle-carrying display screen
Show the dynamic barrier animated video and second current distance.
6. multifunctional driver householder method according to claim 1, which is characterized in that the default early-warning conditions are lane
Deviate early-warning conditions, meets at least one image feature information described in the judgement with the presence or absence of target image characteristics information pre-
If the step of early-warning conditions, including:
It analyzes at least one described image feature information and obtains first lane line characteristic information and the first headstock location information;
According to the first headstock location information and the first lane line characteristic information determine left-hand lane line position information and
Right-hand lane line position information;
Sentenced according to the left-hand lane line position information, the right-hand lane line position information and the first headstock location information
The automobile that breaks whether crimping;
When the automobile crimping, if the automobile does not carry out default steering operation, at least one described image feature information
In there are the target image characteristics information to meet the lane departure warning condition.
7. multifunctional driver householder method according to claim 6, which is characterized in that described special according to the target image
Information architecture animation simulation video is levied, and in exporting the step of showing the animation simulation video on the vehicle-carrying display screen, is wrapped
It includes:
Deviation animated video is constructed according to the first lane line characteristic information and the first headstock location information;
Believed according to the left-hand lane line position information, the right-hand lane line position information and first automobile head position
Breath judges that the automobile presses the left-hand lane line or the right-hand lane line;
If the automobile presses the left-hand lane line, regarded in highlighting the deviation animation on the vehicle-carrying display screen
The left-hand lane line of frequency;
If the automobile presses the right-hand lane line, regarded in highlighting the deviation animation on the vehicle-carrying display screen
The right-hand lane line of frequency.
8. multifunctional driver householder method according to claim 1, which is characterized in that the default early-warning conditions are low photograph
Early-warning conditions are spent, are met at least one image feature information described in the judgement with the presence or absence of target image characteristics information default
The step of early-warning conditions, including:
It analyzes at least one described image feature information and obtains second lane line characteristic information and the second headstock location information;
The target carriage where the automobile is determined according to the second lane line characteristic information and the second headstock location information
Road;
The Pixel Information of target lane region is obtained, and the target lane place is obtained according to the Pixel Information
The intensity of illumination mean value in region;
Judge whether the intensity of illumination mean value is lower than default Intensity threshold;
When the intensity of illumination mean value is lower than default Intensity threshold, there are the mesh at least one described image feature information
Logo image characteristic information meets the low-light (level) early-warning conditions.
9. a kind of multifunctional driver auxiliary device, which is characterized in that it includes memory, processor, vehicle-carrying display screen, vehicle-mounted sound
Case, binocular camera and acceleration transducer, the processor couple the memory, vehicle-carrying display screen, described vehicle-mounted
Speaker, the binocular camera, the acceleration transducer, be stored on the memory to run on the processor
Computer program;
The processor executes the computer program, realizes any one of the claim 1-8 multifunctional driver auxiliary square
Step in method.
10. a kind of storage medium, is stored thereon with computer program, which is characterized in that the computer program is held by processor
When row, the step in any one of the claim 1-8 multifunctional driver householder method is realized.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201810686742.2A CN108859963A (en) | 2018-06-28 | 2018-06-28 | Multifunctional driving assistance method, multifunctional driving assistance device, and storage medium |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201810686742.2A CN108859963A (en) | 2018-06-28 | 2018-06-28 | Multifunctional driving assistance method, multifunctional driving assistance device, and storage medium |
Publications (1)
Publication Number | Publication Date |
---|---|
CN108859963A true CN108859963A (en) | 2018-11-23 |
Family
ID=64296268
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201810686742.2A Pending CN108859963A (en) | 2018-06-28 | 2018-06-28 | Multifunctional driving assistance method, multifunctional driving assistance device, and storage medium |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN108859963A (en) |
Cited By (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN110246352A (en) * | 2019-04-19 | 2019-09-17 | 深圳市天之眼高新科技有限公司 | Driving based reminding method, device, storage medium and system based on animation effect |
CN110673595A (en) * | 2018-12-29 | 2020-01-10 | 长城汽车股份有限公司 | Method and system for avoiding obstacle during automatic driving of vehicle and vehicle |
CN111736701A (en) * | 2020-06-24 | 2020-10-02 | 上海商汤临港智能科技有限公司 | Vehicle-mounted digital person-based driving assistance interaction method and device and storage medium |
CN111862533A (en) * | 2020-07-15 | 2020-10-30 | 北京敬一科技有限公司 | Vehicle joint navigation equipment and method based on big data |
CN112053590A (en) * | 2020-09-08 | 2020-12-08 | 中国第一汽车股份有限公司 | Vehicle early warning method, device, equipment and medium |
CN114179726A (en) * | 2021-12-23 | 2022-03-15 | 浙江吉利控股集团有限公司 | Driving assistance information display method, device, equipment, medium and program product |
CN114385005A (en) * | 2021-12-24 | 2022-04-22 | 领悦数字信息技术有限公司 | Personalized virtual test driving device, method and storage medium |
Citations (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN201380816Y (en) * | 2008-12-29 | 2010-01-13 | 广东铁将军防盗设备有限公司 | Automatic navigation automobile, and automobile obstacle-avoidance warning system and corresponding circuit thereof |
CN103057470A (en) * | 2012-12-06 | 2013-04-24 | 重庆交通大学 | Pre-prompt device and pre-prompt method for regulation violation line-rolling of vehicles |
CN103264660A (en) * | 2013-05-10 | 2013-08-28 | 浙江吉利汽车研究院有限公司杭州分公司 | Vehicle safety pre-warning system |
CN103407407A (en) * | 2013-08-28 | 2013-11-27 | 沈阳工业大学 | Automobile safety distance warning device and method based on binocular stereo vision |
CN104742845A (en) * | 2015-03-18 | 2015-07-01 | 佛山市智海星空科技有限公司 | Dynamic early warning system for automobile rear-end collision preventing |
US20150332102A1 (en) * | 2007-11-07 | 2015-11-19 | Magna Electronics Inc. | Object detection system |
CN105882515A (en) * | 2015-11-11 | 2016-08-24 | 乐卡汽车智能科技(北京)有限公司 | Information processing method and device applied to automobile data recorder and automobile data recorder |
-
2018
- 2018-06-28 CN CN201810686742.2A patent/CN108859963A/en active Pending
Patent Citations (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20150332102A1 (en) * | 2007-11-07 | 2015-11-19 | Magna Electronics Inc. | Object detection system |
CN201380816Y (en) * | 2008-12-29 | 2010-01-13 | 广东铁将军防盗设备有限公司 | Automatic navigation automobile, and automobile obstacle-avoidance warning system and corresponding circuit thereof |
CN103057470A (en) * | 2012-12-06 | 2013-04-24 | 重庆交通大学 | Pre-prompt device and pre-prompt method for regulation violation line-rolling of vehicles |
CN103264660A (en) * | 2013-05-10 | 2013-08-28 | 浙江吉利汽车研究院有限公司杭州分公司 | Vehicle safety pre-warning system |
CN103407407A (en) * | 2013-08-28 | 2013-11-27 | 沈阳工业大学 | Automobile safety distance warning device and method based on binocular stereo vision |
CN104742845A (en) * | 2015-03-18 | 2015-07-01 | 佛山市智海星空科技有限公司 | Dynamic early warning system for automobile rear-end collision preventing |
CN105882515A (en) * | 2015-11-11 | 2016-08-24 | 乐卡汽车智能科技(北京)有限公司 | Information processing method and device applied to automobile data recorder and automobile data recorder |
Cited By (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN110673595A (en) * | 2018-12-29 | 2020-01-10 | 长城汽车股份有限公司 | Method and system for avoiding obstacle during automatic driving of vehicle and vehicle |
CN110246352A (en) * | 2019-04-19 | 2019-09-17 | 深圳市天之眼高新科技有限公司 | Driving based reminding method, device, storage medium and system based on animation effect |
CN111736701A (en) * | 2020-06-24 | 2020-10-02 | 上海商汤临港智能科技有限公司 | Vehicle-mounted digital person-based driving assistance interaction method and device and storage medium |
CN111862533A (en) * | 2020-07-15 | 2020-10-30 | 北京敬一科技有限公司 | Vehicle joint navigation equipment and method based on big data |
CN112053590A (en) * | 2020-09-08 | 2020-12-08 | 中国第一汽车股份有限公司 | Vehicle early warning method, device, equipment and medium |
CN114179726A (en) * | 2021-12-23 | 2022-03-15 | 浙江吉利控股集团有限公司 | Driving assistance information display method, device, equipment, medium and program product |
CN114385005A (en) * | 2021-12-24 | 2022-04-22 | 领悦数字信息技术有限公司 | Personalized virtual test driving device, method and storage medium |
CN114385005B (en) * | 2021-12-24 | 2024-04-26 | 领悦数字信息技术有限公司 | Personalized virtual test driving device, method and storage medium |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN108859963A (en) | Multifunctional driving assistance method, multifunctional driving assistance device, and storage medium | |
CN108860045A (en) | Driving support method, driving support device, and storage medium | |
CN107967806B (en) | Vehicle fake-license detection method, device, readable storage medium storing program for executing and electronic equipment | |
CN105769120B (en) | Method for detecting fatigue driving and device | |
KR102391792B1 (en) | Biometric detection methods, devices and systems, electronic devices and storage media | |
EP1553516B1 (en) | Pedestrian extracting apparatus | |
CN110889351B (en) | Video detection method, device, terminal equipment and readable storage medium | |
CN110826370B (en) | Method and device for identifying identity of person in vehicle, vehicle and storage medium | |
CN113076851B (en) | Method and device for collecting vehicle violation data and computer equipment | |
CN106314424B (en) | Householder method of overtaking other vehicles, device and automobile based on automobile | |
KR101729486B1 (en) | Around view monitor system for detecting blind spot and method thereof | |
CN208789581U (en) | Multifunctional driving auxiliary device | |
CN208789584U (en) | Driving support device | |
US20210303885A1 (en) | Generative adversarial network models for small roadway object detection | |
CN114170585B (en) | Dangerous driving behavior recognition method and device, electronic equipment and storage medium | |
CN115119045B (en) | Video generation method and device based on vehicle-mounted multiple cameras and vehicle-mounted equipment | |
US10311310B2 (en) | Method and apparatus for providing increased obstacle visibility | |
CN114973215A (en) | Fatigue driving determination method and device and electronic equipment | |
US20120189161A1 (en) | Visual attention apparatus and control method based on mind awareness and display apparatus using the visual attention apparatus | |
CN114407928A (en) | Vehicle avoidance control method and vehicle avoidance control device | |
CN113246997A (en) | Safety monitoring method and device in intelligent driving, electronic equipment and storage medium | |
CN116872840A (en) | Vehicle anti-collision early warning method and device, vehicle and storage medium | |
CN111241918B (en) | Vehicle tracking prevention method and system based on face recognition | |
TWI807561B (en) | Embedded deep learning multi-scale object detection model using real-time distant region locating device and method thereof | |
US20220164978A1 (en) | Method for locating position of obstacles, and apparatus, and system applying method |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
RJ01 | Rejection of invention patent application after publication | ||
RJ01 | Rejection of invention patent application after publication |
Application publication date: 20181123 |