CN110712591A - Back-up safety system based on analysis of back-pull camera image ADAS - Google Patents

Back-up safety system based on analysis of back-pull camera image ADAS Download PDF

Info

Publication number
CN110712591A
CN110712591A CN201910912757.0A CN201910912757A CN110712591A CN 110712591 A CN110712591 A CN 110712591A CN 201910912757 A CN201910912757 A CN 201910912757A CN 110712591 A CN110712591 A CN 110712591A
Authority
CN
China
Prior art keywords
module
processing module
early warning
model information
object model
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201910912757.0A
Other languages
Chinese (zh)
Inventor
黎逵
孙建伟
孙德生
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Visual Development Co Ltd Is Irrigated In Jiangxi
Original Assignee
Visual Development Co Ltd Is Irrigated In Jiangxi
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Visual Development Co Ltd Is Irrigated In Jiangxi filed Critical Visual Development Co Ltd Is Irrigated In Jiangxi
Priority to CN201910912757.0A priority Critical patent/CN110712591A/en
Publication of CN110712591A publication Critical patent/CN110712591A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60QARRANGEMENT OF SIGNALLING OR LIGHTING DEVICES, THE MOUNTING OR SUPPORTING THEREOF OR CIRCUITS THEREFOR, FOR VEHICLES IN GENERAL
    • B60Q9/00Arrangement or adaptation of signal devices not provided for in one of main groups B60Q1/00 - B60Q7/00, e.g. haptic signalling
    • B60Q9/008Arrangement or adaptation of signal devices not provided for in one of main groups B60Q1/00 - B60Q7/00, e.g. haptic signalling for anti-collision purposes
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/50Context or environment of the image
    • G06V20/56Context or environment of the image exterior to a vehicle by using sensors mounted on the vehicle
    • G06V20/58Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads

Landscapes

  • Engineering & Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Mechanical Engineering (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Theoretical Computer Science (AREA)
  • Closed-Circuit Television Systems (AREA)
  • Traffic Control Systems (AREA)

Abstract

The invention relates to a reversing safety system based on ADAS analysis of a rear-pull camera image, which comprises a rear-pull camera, a CPU data processing module, an early warning diagnosis module, an APP processing module, a display module, a human-computer interaction display module and a human-computer interaction voice module, wherein the CPU data processing module is used for processing a back-pull camera image; the rear pull camera is used for acquiring backing image data and inputting the data to the CPU data processing module; the CPU data processing module is used for sending the image data to the early warning diagnosis module in a form of each frame; the early warning diagnosis module is used for identifying the image data into corresponding object model information and returning the model information to the CPU data processing module; the CPU data processing module is used for sending corresponding object model information to the APP processing module; the man-machine interaction display module is used for displaying the object model information processed by the APP processing module, and the man-machine interaction voice module is used for converting the object model information processed by the APP processing module into dangerous level voice signals to be played.

Description

Back-up safety system based on analysis of back-pull camera image ADAS
Technical Field
The invention relates to a reversing safety system based on ADAS analysis of a rear-pull camera image.
Background
With the continuous and high-speed increase of economy in China, the automobile industry is also rapidly developed, automobiles have entered thousands of households, the number of motor vehicles in China currently exceeds 3.7 hundred million by 6 months in 2019, and the number of cars is two hundred million, which is huge. The automobiles bring great convenience to people and bring many safety problems, for example, accidents caused by automobile backing show a trend of increasing year by year. However, in order to avoid the above car backing accidents, radar car backing anti-collision instruments are adopted in the prior art, and the early radar car backing anti-collision instruments can detect obstacles in a certain distance range behind a car, so as to give an alarm, and then, the alarm is developed according to the distance in a segmented mode. Although the radar anti-collision instrument for backing a car can solve the car backing accident to a certain extent, some defects still exist, for example: the driver can not visually see the field of vision behind the vehicle, and a large number of accidents can be caused due to the dead angle problem and the coverage problem of the radar. The existing millimeter wave radar configured for some high-end vehicles can quickly identify obstacles behind the vehicles, but even if the obstacles exist, no image display is available, it is unclear what specific obstacles are, how far away from the vehicles is, the experience feeling is not good, the cost is very high, and the technology cannot be popularized and used by medium-low-end vehicles.
In the current market, the intelligent rearview mirrors popular with car owners are basically equipped with a reversing image function, and the reversing image display function supported after the system is started is only the display of images. When a vehicle owner backs a vehicle, the vehicle owner needs to look at the display screen all the time to observe the rear dynamic state, sometimes the vehicle owner needs to observe not only the rear of the vehicle but also the driver needs to observe the left side, the right side or the front state, so that the driver cannot always look at the screen to back the vehicle, and when the driver leaves the rear view, if pedestrians, children, electric vehicles or other vehicles enter the rear of the vehicle, the driver cannot observe the situation, traffic accidents easily occur. The experience is poor, and the backing safety is also greatly discounted.
Disclosure of Invention
The invention aims to solve the defects of the prior art, and provides a backing safety system based on ADAS analysis of a back-pull camera image.
The rear pull camera is used for acquiring backing image data and inputting the data to the CPU data processing module;
the CPU data processing module is used for sending the image data to the early warning diagnosis module in a form of each frame;
the early warning diagnosis module is used for identifying the image data into corresponding object model information and returning the model information to the CPU data processing module;
the CPU data processing module is used for sending corresponding object model information to the APP processing module;
the man-machine interaction display module is used for displaying the object model information processed by the APP processing module, and the man-machine interaction voice module is used for converting the object model information processed by the APP processing module into dangerous level voice signals to be played.
Further, the early warning diagnosis module is used for determining a region of interest (ROI) of the image through filtering analysis of image data of each frame, and then extracting body model information by adopting an adaboost iterative algorithm.
Further, the early warning diagnosis module firstly extracts picture features of the region of interest, and then compares the picture features with pre-stored object model information to identify and screen out corresponding object model information and coordinate positions of the object models on the image.
Furthermore, the man-machine interaction display module can display the reversing image data acquired by the rear-pull camera into an image plane, an alarm line is displayed on a vertical middle horizontal line of the image plane, the alarm line can move up and down on the image plane, the alarm line divides the image plane into an early warning monitoring area and an early warning area, and when an object model appears on the image plane and falls into the early warning monitoring area, the man-machine interaction voice module cannot give an alarm; when an object appears on the image plane and falls into the early warning alarm area, the man-machine interaction voice module gives an alarm, and the function of reminding a driver is enhanced through TTS voice broadcast
The invention has the beneficial effects that: the invention adds an ADAS intelligent recognition function on the basis of the automobile intelligent rearview mirror to realize that pedestrians, children, electric bicycles, other automobiles and the like suddenly rushing behind the automobile can be quickly recognized in the process of backing, and the automobile owner is reminded in time through prompt tones, voice characters and pictures and texts, thereby avoiding traffic accidents and improving the safety, reliability and effectiveness of backing. The driving safety is improved to the maximum extent.
Drawings
FIG. 1 is a block diagram of the system of the present invention;
FIG. 2 is a flow chart of the early warning diagnostic module of the system of the present invention;
FIG. 3 is a schematic diagram of a back-pull camera imaging system of the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
Referring to fig. 1, a car backing safety system based on analysis of a back-pull camera image ADAS comprises a back-pull camera, a CPU data processing module, an early warning diagnosis module, an APP processing module, a human-computer interaction display module and a human-computer interaction voice module.
The rear pull camera is used for acquiring backing image data and inputting the data to the CPU data processing module;
the CPU data processing module is used for sending the image data to the early warning diagnosis module in a form of each frame;
the early warning diagnosis module is used for identifying the image data into corresponding object model information and returning the model information to the CPU data processing module;
the CPU data processing module is used for sending corresponding object model information to the APP processing module;
the man-machine interaction display module is used for displaying the object model information processed by the APP processing module, and the man-machine interaction voice module is used for converting the object model information processed by the APP processing module into dangerous level voice signals to be played.
Further, referring to fig. 2, the forewarning diagnosis module is configured to determine a region of interest (ROI region) of the image through a filtering analysis of each frame of image data, and then extract the body model information using the adaboost iterative algorithm. Specifically, firstly, the picture characteristics of the region of interest are extracted, and then the picture characteristics are compared with the pre-stored object model information to identify and screen out the corresponding object model information and the coordinate position of the object model on the image.
In order to obtain good identification effect, target small areas with multiple sizes, such as 20X20, 36X36 and 48X48, need to be traversed and screened, and the identified effect is the best in several traversals.
In the invention, the reversing picture data is analyzed by complete ADAS to obtain corresponding object model information and the information is sent to the APP processing module by the CPU data processing module, the APP processing module outputs the information to the man-machine interaction display module for display after corresponding logic operation, and the danger degree prompt tone is played by the man-machine interaction voice module, so that a driver can perform corresponding operation according to the danger degree prompt tone and the content displayed by the display module, TTS voice broadcast can be added for determining the type of the corresponding object model, such as cautious pedestrians and please notice of reversing! The driver is reminded in time to pay attention to the rear safety, and corresponding object modules are drawn on the right side of the LCD display screen at the left rear part, the right rear part and the rear part of the vehicle or in three conditions, so that the driver can pay attention to the condition.
Because the intelligent rear-view mirror that supports the image function of backing a car at present does not basically install when the loading factory and accomplish, if will install such intelligent rear-view mirror on the automobile body of different grade type, for example car, SUV, small truck, van etc. this moment, in order to let the image of shooing have better visual angle scope, the position of back pull camera installation just need to correspond with corresponding automobile body, for example: the SUV is higher by a little, and the height of the camera above the ground is higher by a little; the car is a little short, and the height of the camera from the ground is a little short. In addition, the height of the camera from the ground also affects the imaging range and the distance feeling difference of the back-pull camera. Even if the same type of vehicle is used, the rear pull cameras are arranged at different positions of the vehicle, such as the middle position, the left position or the right position, and the imaging range and the distance feeling are different. Therefore, the factors are comprehensively considered in the invention, a reasonable early warning alarm range is determined in the imaging range, specifically, as shown in fig. 3, the back-pull camera sets the vertical middle horizontal line of the formed image plane as an alarm line, the alarm line divides the image plane into an early warning monitoring area and an early warning area, the early warning area is an area nearest to the tail of the vehicle, and the alarm line can move up and down on the image plane. The user can move up and down according to the condition of the vehicle body to adjust the position of the alarm line on the image plane, and can enlarge or reduce the early warning video range according to the driving level of the user.
The function of the alarm line in the invention is further explained, the back-pull camera displays the acquired image plane on the man-machine interaction display module, and the alarm line can be displayed in the image plane, the alarm line divides the image plane into an early warning monitoring area and an early warning area, when an object appears on the image plane and falls into the early warning monitoring area, the man-machine interaction voice module can not give an alarm; when an object appears on the image plane and falls into the early warning alarm area, the human-computer interaction voice module gives an alarm, and meanwhile, the function of reminding a driver through TTS voice broadcasting 'please notice to back a car' is enhanced.
Although embodiments of the present invention have been shown and described, it will be appreciated by those skilled in the art that changes, modifications, substitutions and alterations can be made in these embodiments without departing from the principles and spirit of the invention, the scope of which is defined in the appended claims and their equivalents.

Claims (4)

1. The utility model provides a safety coefficient that backs a car based on analysis of back pull camera image ADAS which characterized in that: the system comprises a back-pull camera, a CPU data processing module, an early warning diagnosis module, an APP processing module, a human-computer interaction display module and a human-computer interaction voice module;
the rear pull camera is used for acquiring backing image data and inputting the data to the CPU data processing module;
the CPU data processing module is used for sending the image data to the early warning diagnosis module in a form of each frame;
the early warning diagnosis module is used for identifying the image data into corresponding object model information and returning the model information to the CPU data processing module;
the CPU data processing module is used for sending corresponding object model information to the APP processing module;
the man-machine interaction display module is used for displaying the object model information processed by the APP processing module, and the man-machine interaction voice module is used for converting the object model information processed by the APP processing module into dangerous level voice signals to be played.
2. The reverse safety system of claim 1, wherein the early warning diagnosis module is configured to determine a region of interest of the image by filtering analysis of each frame of image data, and then extract the body model information using an adaboost iterative algorithm.
3. The reverse safety system of claim 2, wherein: the early warning diagnosis module firstly extracts the picture characteristics of each area in each frame of image data, then compares the characteristics with the pre-stored object model information, identifies and screens out the corresponding object model information and determines the coordinate position of the object model on the image.
4. The reverse safety system of claim 3, wherein: the man-machine interaction display module can display the reversing image data acquired by the rear-pull camera into an image plane, an alarm line is displayed on a vertical middle horizontal line of the image plane, the alarm line can move up and down on the image plane, the image plane is divided into an early warning monitoring area and an early warning area by the alarm line, and when an object model appears on the image plane and falls into the early warning monitoring area, the man-machine interaction voice module cannot give an alarm; when an object appears on the image plane and falls into the early warning alarm area, the man-machine interaction voice module gives an alarm, and the function of reminding a driver is enhanced through TTS voice broadcasting 'please notice to back a car'.
CN201910912757.0A 2019-09-25 2019-09-25 Back-up safety system based on analysis of back-pull camera image ADAS Pending CN110712591A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201910912757.0A CN110712591A (en) 2019-09-25 2019-09-25 Back-up safety system based on analysis of back-pull camera image ADAS

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201910912757.0A CN110712591A (en) 2019-09-25 2019-09-25 Back-up safety system based on analysis of back-pull camera image ADAS

Publications (1)

Publication Number Publication Date
CN110712591A true CN110712591A (en) 2020-01-21

Family

ID=69210896

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201910912757.0A Pending CN110712591A (en) 2019-09-25 2019-09-25 Back-up safety system based on analysis of back-pull camera image ADAS

Country Status (1)

Country Link
CN (1) CN110712591A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114463928A (en) * 2021-12-29 2022-05-10 上海瑞琨计算机系统集成有限公司 Intelligent alarm method and system

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20010056474A (en) * 1999-12-15 2001-07-04 박종섭 Device recognizing object on car backing and control method thereof
US6396397B1 (en) * 1993-02-26 2002-05-28 Donnelly Corporation Vehicle imaging system with stereo imaging
GB0910753D0 (en) * 2008-09-19 2009-08-05 Li Shih Hsiung Vehicle reversing detecting system
CN103253184A (en) * 2012-02-16 2013-08-21 环达电脑(上海)有限公司 Intelligent reversing system and method based on face recognition
CN105620366A (en) * 2016-03-15 2016-06-01 东华大学 Wireless backward moving image aid system
CN205498764U (en) * 2016-03-07 2016-08-24 郑州精益达汽车零部件有限公司 Integrated rear portion initiative safety precaution's ADAS system based on vision

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6396397B1 (en) * 1993-02-26 2002-05-28 Donnelly Corporation Vehicle imaging system with stereo imaging
KR20010056474A (en) * 1999-12-15 2001-07-04 박종섭 Device recognizing object on car backing and control method thereof
GB0910753D0 (en) * 2008-09-19 2009-08-05 Li Shih Hsiung Vehicle reversing detecting system
CN103253184A (en) * 2012-02-16 2013-08-21 环达电脑(上海)有限公司 Intelligent reversing system and method based on face recognition
CN205498764U (en) * 2016-03-07 2016-08-24 郑州精益达汽车零部件有限公司 Integrated rear portion initiative safety precaution's ADAS system based on vision
CN105620366A (en) * 2016-03-15 2016-06-01 东华大学 Wireless backward moving image aid system

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114463928A (en) * 2021-12-29 2022-05-10 上海瑞琨计算机系统集成有限公司 Intelligent alarm method and system
CN114463928B (en) * 2021-12-29 2022-11-25 上海瑞琨计算机系统集成有限公司 Intelligent alarm method and system

Similar Documents

Publication Publication Date Title
US10116873B1 (en) System and method to adjust the field of view displayed on an electronic mirror using real-time, physical cues from the driver in a vehicle
US9384401B2 (en) Method for fog detection
CN108583432B (en) Intelligent A-pillar dead zone early warning device and method based on image recognition technology
US6424272B1 (en) Vehicular blind spot vision system
CN103448653A (en) Vehicle collision warning system and method
CN103548069B (en) For the method and apparatus identifying possible colliding object
AU2013316125B2 (en) Backward movement indicator apparatus for a vehicle
US20220041105A1 (en) Rearview device simulation
US10999559B1 (en) Electronic side-mirror with multiple fields of view
CN111351474B (en) Vehicle moving target detection method, device and system
CN112896159A (en) Driving safety early warning method and system
Cualain et al. Multiple-camera lane departure warning system for the automotive environment
CN110712591A (en) Back-up safety system based on analysis of back-pull camera image ADAS
CN111038390A (en) Car blind area monitoring devices based on multisensor fuses
CN110929606A (en) Vehicle blind area pedestrian monitoring method and device
CN111845557B (en) Safety early warning method and system for vehicle driving and related device
CN113581194A (en) Automatic early warning interaction system and method based on vehicle-mounted vision detection
CN112455450A (en) Vehicle rear-end collision early warning method, device, storage medium and device
JP6867023B2 (en) Video display device for mobiles and its method
CN214796205U (en) 360-degree panoramic wireless safety auxiliary system for rear loading of motor vehicle
CN114049794B (en) Vehicle-mounted safety auxiliary driving system based on smart phone
CN113547984A (en) Vehicle A column blind area identification method and system based on HUD
CN111038389A (en) Large-scale vehicle blind area monitoring devices based on vision
CN216101883U (en) Passenger car imaging system and car
US20240025343A1 (en) Rearview displays for vehicles

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20200121

RJ01 Rejection of invention patent application after publication