CN102778223A - License number cooperation target and monocular camera based automobile anti-collision early warning method - Google Patents
License number cooperation target and monocular camera based automobile anti-collision early warning method Download PDFInfo
- Publication number
- CN102778223A CN102778223A CN2012101851929A CN201210185192A CN102778223A CN 102778223 A CN102778223 A CN 102778223A CN 2012101851929 A CN2012101851929 A CN 2012101851929A CN 201210185192 A CN201210185192 A CN 201210185192A CN 102778223 A CN102778223 A CN 102778223A
- Authority
- CN
- China
- Prior art keywords
- automobile
- early warning
- camera
- vehicle
- car plate
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Landscapes
- Traffic Control Systems (AREA)
Abstract
The invention discloses a license number cooperation target and monocular camera based automobile anti-collision early warning method. The method comprises the following steps that: images are collected in real time by a fore sight camera installed on an automobile head and a rear sight camera installed at the tail part of an automobile, the fore sight camera installed on the automobile head and the rear sight camera installed at the tail part of the automobile are respectively used for positioning the relative position and speed between the running automobile in front and the automobile as well as the relative position and speed of the running automobile behind and the automobile; image collecting and vision positioning systems of the fore sight camera and the rear sight camera operate respectively; an intelligent analysis comprehensive system analyzes the safety state of the automobile according to the positioning information and vehicle running data of the automobiles front and behind, which are obtained by the fore sight camera and the rear sight camera; and alarming and suggestions are given to drivers according to estimate results, wherein the alarming mode is three-level alarming of sound, light and voice. According to the invention, through the early prevention, the safety of the drivers and pedestrians in the road environment is protected effectively, the automobile collision is reduced greatly, economic loss is reduced, accidents are prevented, and the positioning method is high in accuracy and has good timeliness.
Description
Technical field
The present invention relates to technical field of vehicle safety, the vehicle anti-collision early warning method more particularly to based on car plate cooperative target and monocular-camera.
Background technology
Vehicle anti-collision early warning system is that the vehicle intelligent system of spacing monitoring, early warning of knocking into the back, anti-collision warning, navigation feature is realized by sensor, computer image processing technology, is a key technology in the unmanned technology of intelligent automobile.The automotive license plate image that vehicle anti-collision early warning system can be shot according to video camera determines the relative distance and relative velocity between front vehicles and Current vehicle by monocular vision location technology.So as to carry out danger judgement, driver is reminded to make corresponding actions to avoid the collision of automobile in time.The research of the system location technology can aid in driver to judge, point out early warning, improve drive safety.Vehicle anti-collision early warning system passes through advance preventing; it is effectively protected the safety of pedestrian in driver and road environment; greatly reduce car crass; reduce the generation that economic loss avoids accident; therefore; it is the priority research areas of vehicle safety, is enhancing vehicle safety, reduces the necessary means of traffic accident.
The number of sensors that existing vehicle anti-collision early warning system is present is more, processing speed is slow, the problem of cost is high, the patent of invention proposes a kind of localization method based on car plate cooperative target and monocular-camera, and intends a kind of vehicle anti-collision early warning system based on monocular-camera of research and development on this basis.The mode processing speed of monocular vision is fast, low cost.Including two aspect problems, one is the car plate in identification and positioning image, and two are to determine the position of car plate and attitude.
For recognizing and positioning the car plate in image, first, front truck and license plate image are tentatively extracted from afterbody image using the method based on mathematical morphology, because car body angle is tilted, the interference of car light image, pseudo- car plate is removed using the method based on characters on license plate textural characteristics rim detection, current hull back image includes many billboards and notice board image, in order to remove the interference of the pseudo- image in this part, car plate type is recognized using the method based on color characteristic, last positioning licence plate region, extracts the frame and angle point of car plate.
Position and the attitude of car plate are determined using the monocular-camera localization method based on cooperative target for Second Problem.Car plate can provide four edges line as cooperative target, and just car plate can be positioned using rectangle cooperative target localization method.All car plates in the visual field are carried out with the profile of the classification each car plate of Simultaneous Extracting Image according to morphology, the length and width data according to known to every kind of car plate, position and attitude of the car plate under bodywork reference frame are calculated using the monocular-camera localization method based on linear feature.
The content of the invention
The technical problem to be solved in the present invention is, there is provided a kind of using the monocular visual positioning method based on car plate frame rectangular characteristic, the relative distance and relative velocity between Current vehicle and front vehicles can be accurately determined, processing speed is fast, the vehicle anti-collision early warning method of low cost.
The technical scheme of use is:
Vehicle anti-collision early warning method based on car plate cooperative target and monocular-camera, pass through the forward looking camera installed in automobile head, real IMAQ during the backsight camera of automobile tail, it is respectively used to position the relative position and speed and relative position and speed for positioning behind vehicle and this car of traveling ahead vehicle and this car, the IMAQ of two front-and rear-view video cameras works respectively with vision positioning system, the fore-aft vehicle location information and vehicle operation data obtained through intellectual analysis integrated system according to two video cameras of front-and rear-view is analyzed the safe condition of this car, alarm is provided to driver according to assessment result and advised, alarm form is sound, light, voice three-level is alarmed.
The above-mentioned vehicle anti-collision early warning method based on car plate cooperative target and monocular-camera, including position and the attitude for recognizing and positioning the car plate in image with determine car plate, by the use of the four edges line of car plate frame as cooperative target, monocular visual positioning method determines the relative distance and relative velocity between Current vehicle and forward and backward side's vehicle.
Above-mentioned forward looking camera method for early warning uses identical localization method with rear view camera method for early warning, the two autonomous working.
The present invention has the following advantages that compared with prior art:
1. positioning precision is high.Relative distance and relative velocity between Current vehicle and front vehicles can accurately be determined using the monocular visual positioning method based on car plate frame rectangular characteristic.
2. it is applied widely.The anti-collision prewarning apparatus for vehicle is used as beasurement base using car plate frame, car plate frame has unification of the motherland standard, all there is consistency under standard Structured environment or under non-standard structure environment, therefore the anti-collision prewarning apparatus for vehicle has wide range of applications, independent of track.
Brief description of the drawings
Fig. 1 is the structural representation of the present invention.
Fig. 2 is the monocular visual positioning method schematic diagram based on car plate frame.
Embodiment
Vehicle anti-collision early warning method based on car plate cooperative target and monocular-camera, the anti-collision early warning structure composition is as shown in Figure 1.Vehicle anti-collision early warning system is by the forward looking camera installed in automobile head, the backsight camera of automobile tail, image capturing system and Vehicle positioning system, intellectual analysis integrated system composition.Forward looking camera is used for the relative position and speed for positioning traveling ahead vehicle and this car;Rear view camera is used for the relative position and speed for positioning behind vehicle and this car.The image capturing system of two front-and rear-view video cameras, vision positioning system independently work.The vehicle anti-collision early warning, using the vehicle anti-collision early warning method based on car plate cooperative target and monocular vision.Including position and the attitude both sides problem for recognizing and positioning the car plate in image with determine car plate.Include being accurately positioned license plate image region based on architectural feature, textural characteristics, color characteristic, and extracting the frame of license plate image using comprehensive characteristics.Car plate frame has unified yardstick.And car plate frame is the rectangle of standard.Use based on the monocular visual positioning method of car plate frame rectangular characteristic to determine the relative distance and relative velocity between Current vehicle and front vehicles in the invention.This method positioning precision is high, and real-time is good.The fore-aft vehicle location information and vehicle operation data obtained again through intellectual analysis integrated system according to front and rear two video cameras, driver's manipulation behavioral data is analyzed the safe condition of this car, manipulation behavior to driver may be estimated to the influence that security is produced, alarm is provided to driver finally according to assessment result and is advised, alarm form is sound, light, the alarm of voice three-level.
The operation principle of the present invention
As shown in Figure 2:If camera model is known to perspective projection model and the intrinsic parameter of video camera.If the four edges of car plate frameDirection vector under world coordinate system is,.The coordinate that four edges intersect at four summits is .Direction vector of the four edges under camera coordinate system be .Four summits Coordinate under camera coordinate system is .The straight line that four edges are imaged under image coordinate system Equation is .Direction vector is, the coordinate put on graph line is .Four summits The picture point under image coordinate system Coordinate be .Car plate frame sideLength be.Orientation problem is to determine the rigid body translation between object coordinates system and camera coordinate system。
Perspective projection model is by space lineAnd graph lineAnd video camera photocentre is tied to a plane, this plane is called to explain plane.Assuming that perpendicular to explanation planeNormal vector be, then normal vectorWith graph lineAnd graph lineOn any pointWith the line of photocentreIt is all vertical, therefore normal vectorIt can be expressed asDirection vectorWith
Direction vector apposition.
Under world coordinate system, sideAnd sideIt is parallel, sideAnd sideParallel, by perspective projection consistency, under camera coordinate system, this property keeps constant.Normal vectorWith explanation planeOn any straight line it is all vertical, thereforePerpendicular to side.Known sideAnd sideIt is parallel, therefore can be derived from normal vectorPerpendicular to side.Because normal vectorAnd sideVertically, therefore sideDirection vector under camera coordinate system is equal to normal vectorAnd normal vectorApposition.I.e.:
Similarly, sideDirection vector under camera coordinate system is equal to normal vectorAnd normal vectorApposition.I.e.:
Assuming that there is one and side under object coordinates systemAnd sideAll vertical straight line, then straight lineDirection vectorEqual to sideAnd sideThe apposition of direction vector under object coordinates system.I.e.:
Under camera coordinate system, straight lineAnd sideAnd sidePosition relationship keep constant, its direction vectorEqual to sideAnd sideThe apposition of direction vector under camera coordinate system.I.e.:
Known three sides、、(They are not parallel to each other, also do not pass through the camera light heart)Direction vector under object coordinates system, and this direction vector of three straight lines under camera coordinate system is calculated, by Screw theory, it is easy to calculate the spin matrix between camera coordinate system and object coordinates system.
As Fig. 2 shows, point、With corresponding picture point、And video camera photocentre also constitutes a closing triangle.In, straight line、Direction vector, it is known that be respectively、.Assuming that straight lineWith straight lineBetween folder cosine of an angle be, therefore obtain:
By formula(2)Obtain sideDirection vector, it is assumed that straight lineWith sideBetween folder cosine of an angle be, obtain:
Under object coordinates system, 2 points、Distance be, according to perspective projection consistency, under camera coordinate system, distance between two points value keeps constant.As Fig. 2 shows, point、With corresponding picture point、And video camera photocentre also constitutes a closing triangle.In, straight line、Direction vector known to.Respectively、.SideDirection vector, it is known thatIn, obtained using sine:
By formula(8), obtain:
Postulated pointCoordinate is under camera coordinate system, hereIt is unknown number, therefore, obtains:
By(10), obtain:
Car plate is located at the front of video camera, thereforeTake on the occasion of reasonable, obtain:
Calculating more than, is obtained a littleCoordinate under camera coordinate system, therefore, it is possible to determine translation matrix of the car plate relative to camera coordinate system, you can determine coordinate of the car plate in camera coordinate system.Because car plate and automobile position relation are determined, the position pass degree relation of video camera and automobile.Therefore system, it is known that can obtain the distance between Ben Che and other vehicles and angular relationship.
Claims (3)
1. the vehicle anti-collision early warning method based on car plate cooperative target and monocular-camera, it is characterized in that passing through the forward looking camera installed in automobile head, real IMAQ during the backsight camera of automobile tail, it is respectively used to position the relative position and speed and relative position and speed for positioning behind vehicle and this car of traveling ahead vehicle and this car, the IMAQ of two front-and rear-view video cameras works respectively with vision positioning system, the fore-aft vehicle location information and vehicle operation data obtained through intellectual analysis integrated system according to two video cameras of front-and rear-view is analyzed the safe condition of this car, alarm is provided to driver according to assessment result and advised, alarm form is sound, light, voice three-level is alarmed.
2. the vehicle anti-collision early warning method according to claim 1 based on car plate cooperative target and monocular-camera, it is characterized in that described vehicle anti-collision early warning method, including position and the attitude for recognizing and positioning the car plate in image with determine car plate, by the use of the four edges line of car plate frame as cooperative target, monocular visual positioning method determines the relative distance and relative velocity between Current vehicle and forward and backward side's vehicle.
3. the vehicle anti-collision early warning method according to claim 1 based on car plate cooperative target and monocular-camera, it is characterised in that described forward looking camera method for early warning uses identical localization method with rear view camera method for early warning, the two autonomous working.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN2012101851929A CN102778223A (en) | 2012-06-07 | 2012-06-07 | License number cooperation target and monocular camera based automobile anti-collision early warning method |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN2012101851929A CN102778223A (en) | 2012-06-07 | 2012-06-07 | License number cooperation target and monocular camera based automobile anti-collision early warning method |
Publications (1)
Publication Number | Publication Date |
---|---|
CN102778223A true CN102778223A (en) | 2012-11-14 |
Family
ID=47123222
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN2012101851929A Pending CN102778223A (en) | 2012-06-07 | 2012-06-07 | License number cooperation target and monocular camera based automobile anti-collision early warning method |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN102778223A (en) |
Cited By (12)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN103837872A (en) * | 2012-11-22 | 2014-06-04 | 株式会社电装 | Object detection apparatus |
CN105956567A (en) * | 2016-05-06 | 2016-09-21 | 安凯 | Method for determining coordinates of four vertexes of vehicle license plate by using digital image |
CN106802144A (en) * | 2016-12-28 | 2017-06-06 | 深圳市美好幸福生活安全系统有限公司 | A kind of vehicle distance measurement method based on monocular vision and car plate |
CN107038875A (en) * | 2017-05-22 | 2017-08-11 | 南宁学院 | A kind of automobile dynamic speed testing device based on image recognition |
CN105279760B (en) * | 2015-10-26 | 2017-12-19 | 宁波裕兰信息科技有限公司 | Automobile and obstacle detection method based on single dual camera information fusion |
CN107622500A (en) * | 2017-09-29 | 2018-01-23 | 吉林大学 | A kind of the heavy goods vehicles rearward collision method for early warning and its device of view-based access control model sensing |
CN108064401A (en) * | 2016-12-29 | 2018-05-22 | 深圳市柔宇科技有限公司 | Vehicle early warning method, apparatus and system |
CN109141373A (en) * | 2017-06-28 | 2019-01-04 | 西克股份公司 | For protecting the sensor of machine |
CN109318893A (en) * | 2018-10-30 | 2019-02-12 | 南京邮电大学 | Safe driving householder method and system based on the variation of license plate pixels tall |
CN110209178A (en) * | 2019-07-08 | 2019-09-06 | 徐熊键 | Automatic driving vehicle control method based on big data |
CN110648427A (en) * | 2018-06-26 | 2020-01-03 | 上海蔚兰动力科技有限公司 | Driving assistance system and operation method thereof |
CN111391861A (en) * | 2018-12-29 | 2020-07-10 | 北京奇虎科技有限公司 | Vehicle driving assisting method and device |
Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20050195383A1 (en) * | 1994-05-23 | 2005-09-08 | Breed David S. | Method for obtaining information about objects in a vehicular blind spot |
CN101135558A (en) * | 2007-09-28 | 2008-03-05 | 深圳先进技术研究院 | Vehicle anti-collision early warning method and apparatus based on machine vision |
US20090147996A1 (en) * | 2007-12-10 | 2009-06-11 | Hon Hai Precision Industry Co., Ltd. | Safe following distance warning system and method for a vehicle |
US20090322480A1 (en) * | 2008-06-30 | 2009-12-31 | Robert Leon Benedict | Rfid tag and method of vehicle attachment thereof |
-
2012
- 2012-06-07 CN CN2012101851929A patent/CN102778223A/en active Pending
Patent Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20050195383A1 (en) * | 1994-05-23 | 2005-09-08 | Breed David S. | Method for obtaining information about objects in a vehicular blind spot |
CN101135558A (en) * | 2007-09-28 | 2008-03-05 | 深圳先进技术研究院 | Vehicle anti-collision early warning method and apparatus based on machine vision |
US20090147996A1 (en) * | 2007-12-10 | 2009-06-11 | Hon Hai Precision Industry Co., Ltd. | Safe following distance warning system and method for a vehicle |
US20090322480A1 (en) * | 2008-06-30 | 2009-12-31 | Robert Leon Benedict | Rfid tag and method of vehicle attachment thereof |
Cited By (15)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN103837872B (en) * | 2012-11-22 | 2017-05-24 | 株式会社电装 | Object detection apparatus |
CN103837872A (en) * | 2012-11-22 | 2014-06-04 | 株式会社电装 | Object detection apparatus |
CN105279760B (en) * | 2015-10-26 | 2017-12-19 | 宁波裕兰信息科技有限公司 | Automobile and obstacle detection method based on single dual camera information fusion |
CN105956567A (en) * | 2016-05-06 | 2016-09-21 | 安凯 | Method for determining coordinates of four vertexes of vehicle license plate by using digital image |
CN106802144A (en) * | 2016-12-28 | 2017-06-06 | 深圳市美好幸福生活安全系统有限公司 | A kind of vehicle distance measurement method based on monocular vision and car plate |
CN108064401A (en) * | 2016-12-29 | 2018-05-22 | 深圳市柔宇科技有限公司 | Vehicle early warning method, apparatus and system |
CN107038875A (en) * | 2017-05-22 | 2017-08-11 | 南宁学院 | A kind of automobile dynamic speed testing device based on image recognition |
CN109141373A (en) * | 2017-06-28 | 2019-01-04 | 西克股份公司 | For protecting the sensor of machine |
CN107622500A (en) * | 2017-09-29 | 2018-01-23 | 吉林大学 | A kind of the heavy goods vehicles rearward collision method for early warning and its device of view-based access control model sensing |
CN107622500B (en) * | 2017-09-29 | 2023-05-23 | 吉林大学 | Visual sensing-based rear collision early warning method and device for heavy vehicle |
CN110648427A (en) * | 2018-06-26 | 2020-01-03 | 上海蔚兰动力科技有限公司 | Driving assistance system and operation method thereof |
CN109318893A (en) * | 2018-10-30 | 2019-02-12 | 南京邮电大学 | Safe driving householder method and system based on the variation of license plate pixels tall |
CN111391861A (en) * | 2018-12-29 | 2020-07-10 | 北京奇虎科技有限公司 | Vehicle driving assisting method and device |
CN110209178A (en) * | 2019-07-08 | 2019-09-06 | 徐熊键 | Automatic driving vehicle control method based on big data |
CN110209178B (en) * | 2019-07-08 | 2020-09-15 | 陈坤燕 | Unmanned vehicle control method based on big data |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN102778223A (en) | License number cooperation target and monocular camera based automobile anti-collision early warning method | |
CN110077399B (en) | Vehicle anti-collision method based on road marking and wheel detection fusion | |
CN110065494B (en) | Vehicle anti-collision method based on wheel detection | |
CN112389466B (en) | Method, device and equipment for automatically avoiding vehicle and storage medium | |
US9978276B2 (en) | Vehicle exterior environment recognition device | |
CN105922990B (en) | A kind of vehicle environmental based on high in the clouds machine learning perceives and control method | |
JP4420011B2 (en) | Object detection device | |
CN114375467B (en) | System and method for detecting an emergency vehicle | |
CN112292286A (en) | Rider assistance system and method | |
CN106696960B (en) | A kind of vehicle collision prewarning method and device | |
CN106845332B (en) | Vision-based wet road condition detection using tire side splash | |
CN106537180A (en) | Method for mitigating radar sensor limitations with video camera input for active braking for pedestrians | |
CN106515582A (en) | Safe driving early warning method and device | |
CN102685516A (en) | Active safety type assistant driving method based on stereoscopic vision | |
CN107229906A (en) | A kind of automobile overtaking's method for early warning based on units of variance model algorithm | |
US9975551B2 (en) | Vehicle exterior environment recognition device | |
CN110126824A (en) | A kind of commercial vehicle AEBS system of integrated binocular camera and millimetre-wave radar | |
Fernández et al. | Real-time vision-based blind spot warning system: Experiments with motorcycles in daytime/nighttime conditions | |
CN108528337B (en) | Intelligent inner wheel difference early warning system and early warning method based on video projection | |
JP7507930B2 (en) | Accident Analysis Equipment | |
CN106570487A (en) | Method and device for predicting collision between objects | |
US11420633B2 (en) | Assisting the driving of an automotive vehicle when approaching a speed breaker | |
Lamprecht et al. | Extrinsic camera calibration for an on-board two-camera system without overlapping field of view | |
Mahajan et al. | Lane departure warning system | |
JP4661602B2 (en) | Rear vehicle analysis device and collision prediction device |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
C06 | Publication | ||
PB01 | Publication | ||
C10 | Entry into substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
C02 | Deemed withdrawal of patent application after publication (patent law 2001) | ||
WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20121114 |