CN103832380A - Dead zone automobile detection and warning system and method based on machine vision - Google Patents

Dead zone automobile detection and warning system and method based on machine vision Download PDF

Info

Publication number
CN103832380A
CN103832380A CN201210486564.1A CN201210486564A CN103832380A CN 103832380 A CN103832380 A CN 103832380A CN 201210486564 A CN201210486564 A CN 201210486564A CN 103832380 A CN103832380 A CN 103832380A
Authority
CN
China
Prior art keywords
automobile
processing unit
digital signal
vehicle
signal processing
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201210486564.1A
Other languages
Chinese (zh)
Inventor
余曦
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
SHENZHEN HUAYI AUTOMOBILE SCIENCE & TECHNOLOGY Co Ltd
Original Assignee
SHENZHEN HUAYI AUTOMOBILE SCIENCE & TECHNOLOGY Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by SHENZHEN HUAYI AUTOMOBILE SCIENCE & TECHNOLOGY Co Ltd filed Critical SHENZHEN HUAYI AUTOMOBILE SCIENCE & TECHNOLOGY Co Ltd
Priority to CN201210486564.1A priority Critical patent/CN103832380A/en
Publication of CN103832380A publication Critical patent/CN103832380A/en
Pending legal-status Critical Current

Links

Images

Landscapes

  • Image Analysis (AREA)
  • Image Processing (AREA)

Abstract

The invention discloses a dead zone automobile detection and warning system and method based on machine vision. The dead zone automobile detection and warning system comprises an interface processing unit, a left backward-looking camera, a right backward-looking camera, a left digital signal processing unit, a right digital signal processing unit and a power source module, wherein the left backward-looking camera is installed at a left rearview mirror of an automobile, collects the images within the range of 3 meters on the left side of the automobile and 3 meters on the rear of a rear bumper of the automobile, and transmits the images to the left digital signal processing unit; the right backward-looking camera is installed at a right rearview mirror of the automobile, collects the images within the range of 3 meters on the rear side of the automobile and 3 meters on the rear of the rear bumper of the automobile, and transmits the images to the right digital signal processing unit; image information processed by the left digital signal processing unit and the right digital signal processing unit is transmitted to the interface processing unit, the interface processing unit controls a warning device to work, and the power source module supplies power to other modules.

Description

A kind of blind area detecting test of vehicle and warning system and method based on machine vision
Technical field
The present invention discloses a kind of detecting test of vehicle and warning system, particularly a kind of blind area detecting test of vehicle and warning system and method based on machine vision.
Background technology
Along with the development gradually of automobile industry, automobile pollution increases day by day, and automobile is lived the convenience brought with fast self-evident to people, and the flourish of auto trade brings very large contribution to economy, but also produce a series of social concerns, wherein traffic accident is the most serious problem simultaneously.According to statistics, in 2011, Kuomintang-Communist occurs 210812, death toll: 62387 people.Wherein the cause of most accidents is that driver drives rashly, due to not observing traffic rules and regulations, in this, be that vehicle collision occurs driver in overtaking process greatly, although back mirror is all housed on automobile, driver can be in the time overtaking other vehicles or turn, watch vehicle condition below by back mirror, but, back mirror is subject to the restrictions such as its installation site on the one hand, there is certain backsight blind area, on the other hand due to the factor such as driving experience or idea of leaving things to chance, have vehicle even if it is seen, still lane change is overtaken other vehicles or is turned, and then traffic accident occurs.
Summary of the invention
For easily get into an accident in the time that lane change is overtaken other vehicles or the turned shortcoming of accident of the above-mentioned automobile of the prior art of mentioning, the invention provides a kind of blind area detecting test of vehicle and warning system and method based on machine vision, it detects respectively the vehicle condition in blind area, vehicle right and left both sides by two cameras, and according to circumstances send alarm message, notify driver, can effectively avoid vehicle that traffic accident occurs in the time that lane change is overtaken other vehicles or turned.
The technical scheme that the present invention solves its technical matters employing is: a kind of blind area detecting test of vehicle and warning system based on machine vision, system comprises interface processing unit, left rearview camera, right rearview camera, left digital signal processing unit, right digital signal processing unit and power module, described left rearview camera is arranged on automobile left-hand mirror place, gather the image within the scope of 3 meters, 3 meters of automobile left sides and automobile rear bumper rear, and give left digital signal processing unit by image transmitting, right rearview camera is arranged on Automobile Right back mirror place, gather the image within the scope of 3 meters, 3 meters of automotive backs and automobile rear bumper rear, and give right digital signal processing unit by image transmitting, through left digital signal processing unit and right digital signal processing unit image transmission after treatment to interface processing unit, interface is processed the work of unit controls warning device, power module is given other module for power supply.
Adopt above-mentioned system to realize blind area detecting test of vehicle and the method for warming based on machine vision, the method comprises the steps:
A, automotive ignition, system energising starts;
B, before automobile is not walked, system enters idle pulley, now can't move blind area detecting test of vehicle;
C, two cameras send vision signal with the speed of 25 frames per second or 30 frames to corresponding digital signal processing unit respectively;
D, digital signal processing unit are converted into vision signal the colour picture of rgb format;
E, YUV coding: the colour picture signal of obtaining through color separation, obtain RGB after amplification correction respectively, then is passed through to matrixer and obtains brightness signal Y and two colour difference signal R-Y, i.e. U, B-Y, i.e. V;
F, image is carried out to Hough conversion, the edge of objects in images is detected to analysis;
G, blind area vehicle identification: whether the object in analysis image is similar to vehicle body housing shape, if analysis result is for having vehicle in blind area, enters H flow process;
H, detection steering indicating light or steering wheel inclination angle;
If there is vehicle I blind area, automobile will sail again corresponding track into simultaneously, send warning signal.
The technical scheme that the present invention solves its technical matters employing further comprises:
Described interface processing unit is connected with steering wheel angle sensor or turn signal by I/O mouth or CAN bus bus, gathers steering wheel angle information or steering indicating light information.
Described power module is power interface, and power interface is connected with automobile power source, by automobile power source to system power supply.
Described automobile is less than 10KPH for automobile speed per hour before not walking.
Described warning signal sends predetermined warning message according to hazard level: if there is car blind area, but automobile does not turn to the direction of car, only sends visual alert; If blind area has car and automobile will sail corresponding car direction into, send vision and tactile vibrations warning simultaneously.
The invention has the beneficial effects as follows: the present invention adopts advanced computer vision algorithm for pattern recognition, in conjunction with high speed digital signal processor to being arranged on the camera driving road-condition real-time analysis on vehicle mirrors, can detect that there is vehicle in region, blind area, and driver will forward in the situation in corresponding track simultaneously and send vision to chaufeur, the warning of the sense of hearing or sense of touch aspect, take care and travel with prompting driver, effectively minimizing accident occurs.
Below in conjunction with the drawings and specific embodiments, the present invention will be further described.
Accompanying drawing explanation
Fig. 1 is circuit block diagram of the present invention.
Fig. 2 is structural representation of the present invention.
Fig. 3 is that the present invention uses view.
Fig. 4 is the system flowchart first half of the present invention.
Fig. 5 is system flowchart lower part of the present invention.
In figure, 1-car body, 2-left-hand mirror, the right back visor of 3-, the left rearview camera of 4-, the right rearview camera of 5-, 6-warns panel.
The specific embodiment
The present embodiment is the preferred embodiment for the present invention, and other all its principles are identical with the present embodiment or approximate with basic structure, all within protection domain of the present invention.
Please refer to accompanying drawing 1 and accompanying drawing 2, the blind area detecting test of vehicle based on machine vision and warning system in the present invention mainly comprise interface processing unit, left rearview camera 4, right rearview camera 5, left digital signal processing unit, right digital signal processing unit and power module, in the present embodiment, interface processing unit adopts micro controller system.Wherein left rearview camera 4 is arranged on left-hand mirror 2 places of car body 1, gather the image within the scope of 3 meters, 3 meters of automobile left sides and automobile rear bumper rear, and give left digital signal processing unit by image transmitting, right rearview camera 5 is arranged on right back visor 3 places of car body 1, gather the image within the scope of 3 meters, 3 meters of automotive backs and automobile rear bumper rear, and give right digital signal processing unit by image transmitting, through left digital signal processing unit and right digital signal processing unit image transmission after treatment to interface processing unit, interface is processed the work of unit controls warning device, power module is given other module for power supply, in the present embodiment, power module is power interface, power interface is connected with automobile power source, (be automobile batteries by automobile power source, 12V or 24V) to system power supply.In the present embodiment, interface microcontroller processing unit is connected with steering wheel angle sensor or turn signal by I/O mouth or CAN bus bus, gather steering wheel angle information or steering indicating light information, thereby obtain motor turning signal, and send digital signal processing unit to.In the present embodiment, digital signal processing unit adopts DSP high speed digital signal processor, DSP high speed digital signal processor obtains the road conditions image in driving by being arranged on the camera of back mirror, carry out complicated Machine Vision Recognition in conjunction with speed information, whether region, Intelligent Recognition blind area has vehicle.DSP high speed digital signal processor is processed the road map obtaining is looked like to process and pattern-recognition, and to the size of left and right back mirror object, it is vehicle or other objects that shape etc. are distinguished.DSP high speed digital signal processor can make interface microcontroller processing unit sends different brackets warning message by CAN bus bus to warning panel 6 according to the probability that will collide, and independently warns panel 6 receiving after warning message and will on panel, show different warning messages to chaufeur.
The present invention is connected to power supply and warning panel 6 by wire harness and adaptor union.User only need plug adaptor union, and plug and play is without carrying out complexity setting, convenient and swift.
Please refer to accompanying drawing 3, in the present invention, blind area is the self-defining concept of the present invention, and it refers to:
A line: from, 3 meters, sideline, vehicle body left side;
B line: sideline, vehicle body left side;
C line: sideline, vehicle body right side;
D line: cash 3 meters of from vehicle body right side;
E line: automobile front-row passenger visual threshold line;
F line: car rear bumper sideline;
G line: from 3 meters of of vehicle body rear bumper;
In Fig. 3, shadow region is blind area, and vehicle left side is the region that A line, B line, G line and E coil go out, and vehicle rear-side is the region that C line, D line, G line and E coil go out.
Please refer to accompanying drawing 4 and accompanying drawing 5, blind area detecting test of vehicle based on machine vision of the present invention and the method for warning comprise the steps:
A, automotive ignition, system energising starts;
B, do not walk (in the present embodiment at automobile, speed per hour is less than to 10KPH, be that speed per hour is less than 10 kilometer per hours and is defined as automobile and does not walk, now driver has the sufficient time to process accident) front system enters idle pulley, now can't move blind area detecting test of vehicle;
C, two cameras send vision signal with the speed of 25 frames per second (carrying out video acquisition under pal mode) or 30 frames (carrying out video acquisition under TSC-system formula) to corresponding DSP high speed digital signal processor respectively;
D, DSP high speed digital signal processor are converted into corresponding vision signal the colour picture of rgb format;
E, YUV coding: DSP high speed digital signal processor the colour picture signal obtained through color separation, obtain RGB after amplification correction respectively, obtain brightness signal Y and two colour difference signal R-Y (being U), B-Y (being V) through matrixer again, there is no U, V signal component if only have Y-signal component, the image representing so is like this exactly black and white gray level image;
F, image is carried out to Hough conversion, the edge of objects in images is detected to analysis;
G, blind area vehicle identification: in analysis image, whether object is similar to vehicle body housing shape, if analysis result is for having vehicle in blind area, enters H flow process;
H, detection steering indicating light or steering wheel inclination angle;
If I has vehicle in blind area, vehicle will sail corresponding track into simultaneously, and interface microcontroller processing unit sends warning signal by CAN bus to warning panel 6.Warning panel 6 is received after signal, sends predetermined warning message: if there is car blind area, but vehicle does not turn to this direction according to hazard level, only sends visual alert; If blind area has car and vehicle will sail corresponding car direction into, send vision and tactile vibrations warning.
The present invention adopts advanced computer vision algorithm for pattern recognition, in conjunction with high speed digital signal processor to being arranged on the camera driving road-condition real-time analysis on vehicle mirrors, can detect that there is vehicle in region, blind area, and driver will forward in the situation in corresponding track simultaneously and send vision to chaufeur, the warning of the sense of hearing or sense of touch aspect, take care and travel with prompting driver, effectively minimizing accident occurs.

Claims (6)

1. blind area detecting test of vehicle and the warning system based on machine vision, it is characterized in that: described system comprises interface processing unit, left rearview camera, right rearview camera, left digital signal processing unit, right digital signal processing unit and power module, described left rearview camera is arranged on automobile left-hand mirror place, gather the image within the scope of 3 meters, 3 meters of automobile left sides and automobile rear bumper rear, and give left digital signal processing unit by image transmitting, right rearview camera is arranged on Automobile Right back mirror place, gather the image within the scope of 3 meters, 3 meters of automotive backs and automobile rear bumper rear, and give right digital signal processing unit by image transmitting, through left digital signal processing unit and right digital signal processing unit image transmission after treatment to interface processing unit, interface is processed the work of unit controls warning device, power module is given other module for power supply.
2. blind area detecting test of vehicle and the warning system based on machine vision according to claim 1, it is characterized in that: described interface processing unit is connected with steering wheel angle sensor or turn signal by I/O mouth or CAN bus bus, gather steering wheel angle information or steering indicating light information.
3. blind area detecting test of vehicle and the warning system based on machine vision according to claim 1, is characterized in that: described power module is power interface, and power interface is connected with automobile power source, by automobile power source to system power supply.
4. the system of employing as described in claim 1 or 2 or 3 realizes blind area detecting test of vehicle and the method for warming based on machine vision, it is characterized in that: described method comprises the steps:
A, automotive ignition, system energising starts;
B, before automobile is not walked, system enters idle pulley, now can't move blind area detecting test of vehicle;
C, two cameras send vision signal with the speed of 25 frames per second or 30 frames to corresponding digital signal processing unit respectively;
D, digital signal processing unit are converted into vision signal the colour picture of rgb format;
E, YUV coding: the colour picture signal of obtaining through color separation, obtain RGB after amplification correction respectively, then is passed through to matrixer and obtains brightness signal Y and two colour difference signal R-Y, i.e. U, B-Y, i.e. V:
F, image is carried out to Hough conversion, the edge of objects in images is detected to analysis;
G, blind area vehicle identification: whether the object in analysis image is similar to vehicle body housing shape, if analysis result is for having vehicle in blind area, enters H flow process;
H, detection steering indicating light or steering wheel inclination angle;
If there is vehicle I blind area, automobile will sail again corresponding track into simultaneously, send warning signal.
5. method according to claim 4, is characterized in that: described automobile is less than 10KPH for automobile speed per hour before not walking.
6. method according to claim 4, is characterized in that: described warning signal sends predetermined warning message according to hazard level: if there is car blind area, but automobile does not turn to the direction of car, only sends visual alert; If blind area has car and automobile will sail corresponding car direction into, send vision and tactile vibrations warning simultaneously.
CN201210486564.1A 2012-11-23 2012-11-23 Dead zone automobile detection and warning system and method based on machine vision Pending CN103832380A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201210486564.1A CN103832380A (en) 2012-11-23 2012-11-23 Dead zone automobile detection and warning system and method based on machine vision

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201210486564.1A CN103832380A (en) 2012-11-23 2012-11-23 Dead zone automobile detection and warning system and method based on machine vision

Publications (1)

Publication Number Publication Date
CN103832380A true CN103832380A (en) 2014-06-04

Family

ID=50796377

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201210486564.1A Pending CN103832380A (en) 2012-11-23 2012-11-23 Dead zone automobile detection and warning system and method based on machine vision

Country Status (1)

Country Link
CN (1) CN103832380A (en)

Cited By (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105774654A (en) * 2016-03-02 2016-07-20 广州三晶智能电子技术有限公司 Car blind spot visible steering system and control method
CN107444268A (en) * 2017-07-28 2017-12-08 江苏川钿电气机械有限公司 A kind of vehicle blind zone monitoring system
CN107577988A (en) * 2017-08-03 2018-01-12 东软集团股份有限公司 Realize the method, apparatus and storage medium, program product of side vehicle location
CN108322636A (en) * 2017-12-29 2018-07-24 吉林大学 A kind of speed estimator, vehicle and method of estimation based on machine vision
CN108830260A (en) * 2018-07-05 2018-11-16 苏州天瞳威视电子科技有限公司 A kind of blind area detection system method of view-based access control model
CN108877261A (en) * 2017-05-10 2018-11-23 杜卡迪摩托控股有限公司 With the motorcycle for detecting the device from the close vehicle in rear
CN111469760A (en) * 2019-01-24 2020-07-31 杭州海康汽车技术有限公司 Vehicle blind area detection method, device and system
CN111976598A (en) * 2020-08-31 2020-11-24 北京经纬恒润科技有限公司 Vehicle blind area monitoring method and system

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20060167606A1 (en) * 2005-01-27 2006-07-27 Khaled Malhas Electronically controlled mirror system for vehicle blind spot exposure
CN101271518A (en) * 2007-03-20 2008-09-24 国际商业机器公司 System and method for managing the interaction of object detection and tracking systems in video surveillance
TWM353849U (en) * 2008-09-17 2009-04-01 Jyh-Chiang Liou Integrated driving assistance apparatus
CN102211547A (en) * 2010-04-01 2011-10-12 鸿富锦精密工业(深圳)有限公司 Driving visual blind area detection system and method
CN102632839A (en) * 2011-02-15 2012-08-15 汽车零部件研究及发展中心有限公司 Back sight image cognition based on-vehicle blind area early warning system and method

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20060167606A1 (en) * 2005-01-27 2006-07-27 Khaled Malhas Electronically controlled mirror system for vehicle blind spot exposure
CN101271518A (en) * 2007-03-20 2008-09-24 国际商业机器公司 System and method for managing the interaction of object detection and tracking systems in video surveillance
TWM353849U (en) * 2008-09-17 2009-04-01 Jyh-Chiang Liou Integrated driving assistance apparatus
CN102211547A (en) * 2010-04-01 2011-10-12 鸿富锦精密工业(深圳)有限公司 Driving visual blind area detection system and method
CN102632839A (en) * 2011-02-15 2012-08-15 汽车零部件研究及发展中心有限公司 Back sight image cognition based on-vehicle blind area early warning system and method

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
熊玉梅、郭坚、陈一民: "视觉目标的识别及跟踪技术的研究", 《计算机应用与软件》 *

Cited By (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105774654A (en) * 2016-03-02 2016-07-20 广州三晶智能电子技术有限公司 Car blind spot visible steering system and control method
CN108877261A (en) * 2017-05-10 2018-11-23 杜卡迪摩托控股有限公司 With the motorcycle for detecting the device from the close vehicle in rear
CN107444268A (en) * 2017-07-28 2017-12-08 江苏川钿电气机械有限公司 A kind of vehicle blind zone monitoring system
CN107577988A (en) * 2017-08-03 2018-01-12 东软集团股份有限公司 Realize the method, apparatus and storage medium, program product of side vehicle location
US10495754B2 (en) 2017-08-03 2019-12-03 Neusoft Corporation Method, apparatus, storage medium and program product for side vehicle positioning
CN107577988B (en) * 2017-08-03 2020-05-26 东软集团股份有限公司 Method, device, storage medium and program product for realizing side vehicle positioning
CN108322636A (en) * 2017-12-29 2018-07-24 吉林大学 A kind of speed estimator, vehicle and method of estimation based on machine vision
CN108830260A (en) * 2018-07-05 2018-11-16 苏州天瞳威视电子科技有限公司 A kind of blind area detection system method of view-based access control model
CN111469760A (en) * 2019-01-24 2020-07-31 杭州海康汽车技术有限公司 Vehicle blind area detection method, device and system
CN111976598A (en) * 2020-08-31 2020-11-24 北京经纬恒润科技有限公司 Vehicle blind area monitoring method and system

Similar Documents

Publication Publication Date Title
CN103832380A (en) Dead zone automobile detection and warning system and method based on machine vision
CN203753005U (en) Lane departure warning device
CN103723073B (en) A kind of danger of Fusion is overtaken other vehicles prior-warning device and method for early warning thereof
CN103043021A (en) Omni-directional automotive active safety system with integrated five-channel video detection function
CN109715467B (en) Vehicle control device, vehicle control method, and movable body
CN103832357B (en) A kind of lane-departure warning system and method based on machine vision
WO2019075903A1 (en) Blind spot smart assistance vehicle-mounted system for use in passenger vehicle
CN103213550A (en) Automobile brake safety prompt control system and safety prompt control method
CN111619449A (en) T-shaped intersection automobile blind area monitoring system and monitoring method
JP2012221303A (en) In-vehicle lighting device for driving support and in-vehicle driving support device and driving support system
CN207579859U (en) A kind of vehicle collision prevention system based on cognition technology
CN111319562A (en) Image system backs a car based on infrared detection
CN111038390A (en) Car blind area monitoring devices based on multisensor fuses
CN106114365A (en) Thermal imaging automobile safe driving auxiliary system
CN203293984U (en) Lane departure warning system based on machine vision
CN203318280U (en) Machine vision based blind-zone vehicle detection and warning system
CN204354915U (en) A kind of vehicle lane change ancillary system
CN113581194A (en) Automatic early warning interaction system and method based on vehicle-mounted vision detection
CN210526396U (en) Intelligent auxiliary driving system
CN207602038U (en) Traffic sign cresset converts system for prompting
US11152726B2 (en) Connector device and connector system
CN216596530U (en) Vehicle road cooperative active early warning system
CN214564955U (en) Overtaking at night reminding system and vehicle
CN210258207U (en) Active safety intelligent driving system
CN209748703U (en) 360 panorama image system of parking

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20140604

RJ01 Rejection of invention patent application after publication