CN110549975A - 3D Sensor-based automobile radar system and control method thereof - Google Patents
3D Sensor-based automobile radar system and control method thereof Download PDFInfo
- Publication number
- CN110549975A CN110549975A CN201810550819.3A CN201810550819A CN110549975A CN 110549975 A CN110549975 A CN 110549975A CN 201810550819 A CN201810550819 A CN 201810550819A CN 110549975 A CN110549975 A CN 110549975A
- Authority
- CN
- China
- Prior art keywords
- data
- information
- sensor
- distance
- module
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60Q—ARRANGEMENT OF SIGNALLING OR LIGHTING DEVICES, THE MOUNTING OR SUPPORTING THEREOF OR CIRCUITS THEREFOR, FOR VEHICLES IN GENERAL
- B60Q9/00—Arrangement or adaptation of signal devices not provided for in one of main groups B60Q1/00 - B60Q7/00, e.g. haptic signalling
- B60Q9/008—Arrangement or adaptation of signal devices not provided for in one of main groups B60Q1/00 - B60Q7/00, e.g. haptic signalling for anti-collision purposes
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60R21/00—Arrangements or fittings on vehicles for protecting or preventing injuries to occupants or pedestrians in case of accidents or other traffic risks
- B60R21/01—Electrical circuits for triggering passive safety arrangements, e.g. airbags, safety belt tighteners, in case of vehicle accidents or impending vehicle accidents
- B60R21/013—Electrical circuits for triggering passive safety arrangements, e.g. airbags, safety belt tighteners, in case of vehicle accidents or impending vehicle accidents including means for detecting collisions, impending collisions or roll-over
- B60R21/0134—Electrical circuits for triggering passive safety arrangements, e.g. airbags, safety belt tighteners, in case of vehicle accidents or impending vehicle accidents including means for detecting collisions, impending collisions or roll-over responsive to imminent contact with an obstacle, e.g. using radar systems
Landscapes
- Engineering & Computer Science (AREA)
- Mechanical Engineering (AREA)
- Human Computer Interaction (AREA)
- Radar, Positioning & Navigation (AREA)
- Remote Sensing (AREA)
- Traffic Control Systems (AREA)
Abstract
the invention discloses a 3D Sensor-based automobile radar system and a control method thereof, and the system comprises a 3D Sensor module, a data processing module, a 3D recognition module, an output module and a display and voice broadcast terminal, wherein 3D Sensor equipment is used for acquiring depth data in real time and acquiring color images at the same time, performing object ranging, performing object characteristic extraction in real time, recognizing objects including people and animals, performing action recognition, displaying the 3D data and image data on vehicle-mounted equipment, displaying early warning information in real time, and playing voice prompts in time if an early warning line is reached.
Description
Technical Field
The invention belongs to the field of 3D sensors, and particularly relates to an automobile radar system based on a 3D Sensor and a control method thereof.
Background
The automobile radar is used as a safety device and can bear certain work needing attention, judgment and technology, so that the driving strength is reduced, the burden of a driver is reduced, safety accidents are avoided to a certain extent, and unnecessary loss is reduced for individuals and countries.
currently, automotive radars have different types of radars based on different technologies (e.g. laser, ultrasound, microwave), have different functions (e.g. obstacle finding, collision prediction, adaptive cruise control) and use different operating principles (e.g. pulse radar, FMCW radar, microwave impact radar).
in view of the current development of 3D Sensor technology, we can use a new approach to build automotive radars: based on the 3D Sensor device, the display device and the audio device, the automobile radar system is intelligently constructed through the distance detection, object detection and feature recognition capabilities of the 3D Sensor.
Disclosure of Invention
the invention aims to solve the technical problem of providing a 3D Sensor-based automobile radar system and a control method thereof aiming at the defects of the background technology, and the 3D Sensor is used for replacing the radar system based on the prior art, so that the radar system has richer functions and is more intelligent.
The invention adopts the following technical scheme to solve the technical problems
an automobile radar system based on 3D Sensor comprises
The 3D Sensor module is used for acquiring depth data and color data in real time, processing the data and generating 3D data information;
the data processing module is used for carrying out distance monitoring according to the depth data and extracting 3D characteristic data from the 3D data information;
the 3D identification module is used for identifying objects, people or animals according to the extracted 3D characteristic data and carrying out action identification on people;
the output module is used for displaying real-time pictures, identifying objects, people or animals and displaying action and characteristic data;
And the voice broadcasting terminal is used for carrying out voice early warning.
As a further preferable scheme of the 3D Sensor-based automobile radar system, the 3D Sensor module specifically comprises
an infrared emitter for emitting infrared light;
an infrared receiver for receiving infrared light;
The 3D identification chip is used for generating depth data and generating 3D information according to the depth data;
And the RGB camera is used for acquiring color data so as to generate a real-time picture.
as a further preferable scheme of the 3D Sensor-based automotive radar system of the present invention, the 3D identification module specifically includes
the distance monitoring module is used for calculating the distance according to the depth data;
And the 3D feature extraction module is used for extracting 3D information according to the 3D information of the depth data so as to complete 3D feature recognition.
as a further preferable scheme of the 3D Sensor-based automotive radar system of the present invention, the 3D identification module specifically includes
The object, human and animal identification module is used for carrying out feature retrieval according to the data of the 3D feature extraction module and the 3D feature library so as to identify;
and the action recognition processing module is used for carrying out action recognition according to the 3D information.
as a further preferable scheme of the 3D Sensor-based automotive radar system of the present invention, the output module specifically includes
the 3D display component is used for displaying the real-time monitoring picture and the identified 3D characteristic information;
The early warning system is used for sending out early warning;
And the information recording system is used for identifying the information recording and the dangerous number recording.
the control method of the automobile radar system based on the 3D Sensor specifically comprises the following steps:
Step 1, acquiring depth data and RGB data in real time; the depth information data is obtained by projecting a known infrared mode into a scene based on optical coding and through the deformation of the mode captured by another infrared CMOS imager, and the distance information of all objects in the angle of view is output; the RGB data is captured by an RGB camera;
step 2, carrying out data analysis on the depth data and the RGB data acquired in the step 1, and carrying out distance monitoring and obstacle monitoring;
Step 3, extracting the characteristics of the detected obstacles; specifically, the method comprises the following steps: outputting 3D data information by a 3D identification chip, carrying out feature detection on the depth data blocks, iterating to an optimal value, summarizing features, and obtaining feature data;
Step 4, carrying out object identification on the extracted characteristic data, and measuring and calculating the distance in real time; the real-time distance measurement and calculation specifically refers to depth distance statistics of a characteristic region corresponding to a characteristic object, and the minimum distance value in the region is determined as the distance of the object;
step 5, for animals and people, living body detection, action recognition and obstacle behavior monitoring can be carried out;
step 6, 3D modeling is carried out, and real-time monitoring is carried out through an early warning system to obtain early warning information;
and 7, the barrier enters the early warning range, early warning information is displayed through the 3D display assembly, voice broadcasting is carried out, and real-time prompting is carried out.
compared with the prior art, the invention adopting the technical scheme has the following technical effects:
1. the invention has strong functionality, the traditional automobile radar has less functions and has a detection blind area, when the automobile radar encounters an excessively short obstacle, an uneven ground and an excessively thin obstacle, the radar does not respond, generally, the obstacle below the center of the probe by 10 ~ 15cm can be ignored by the probe, the height value can be reduced along with the distance between the obstacle and the parking space, the danger is increased along with the distance, the automobile radar based on the 3D Sensor has less blind area, and has great advantages in small object monitoring, and the surrounding objects can be monitored and identified under the condition of no light;
2. The invention has expansibility, the traditional automobile radar can only detect the obstacles and can not display the obstacles (the obstacles can be used by means of image cooperation), the automobile radar based on the 3D Sensor can not only detect the distance and the obstacles and display the obstacles (if the display effect is better by cooperating with a colorful image), but also identify objects (including people and animals), and more intelligently give real-time external environment information to a driver so as to drive better.
Drawings
Fig. 1 is a schematic diagram of the system architecture of the present invention.
Detailed Description
The technical scheme of the invention is further explained in detail by combining the attached drawings:
As shown in fig. 1, an automobile radar system based on 3D Sensor is characterized in that: comprises
the 3D Sensor module is used for acquiring depth data and color data in real time, processing the data and generating 3D data information;
The data processing module is used for carrying out distance monitoring according to the depth data and extracting 3D characteristic data from the 3D data information;
the 3D identification module is used for identifying objects, people or animals according to the extracted 3D characteristic data and carrying out action identification on people;
the output module is used for displaying real-time pictures, identifying objects, people or animals and displaying action and characteristic data;
And the voice broadcasting terminal is used for carrying out voice early warning.
the method comprises the steps of using a 3D Sensor device to obtain depth data (and simultaneously obtain a color image), measuring distance of an object, extracting characteristics of the object in real time, identifying the object (including people and animals), identifying actions, displaying the 3D data and image data on a vehicle-mounted device, displaying early warning information in real time, and playing a voice prompt in time if an early warning line is reached.
The 3D Sensor module specifically comprises
an infrared emitter for emitting infrared light;
An infrared receiver for receiving infrared light;
the 3D identification chip is used for generating depth data and generating 3D information according to the depth data;
And the RGB camera is used for acquiring color data so as to generate a real-time picture.
as a further preferable scheme of the 3D Sensor-based automotive radar system of the present invention, the 3D identification module specifically includes
the distance monitoring module is used for calculating the distance according to the depth data;
And the 3D feature extraction module is used for extracting 3D information according to the 3D information of the depth data so as to complete 3D feature recognition.
The 3D identification module specifically comprises
The object, human and animal identification module is used for carrying out feature retrieval according to the data of the 3D feature extraction module and the 3D feature library so as to identify;
and the action recognition processing module is used for carrying out action recognition according to the 3D information.
the output module specifically comprises
The 3D display component is used for displaying the real-time monitoring picture and the identified 3D characteristic information;
the early warning system is used for sending out early warning;
and the information recording system is used for identifying the information recording and the dangerous number recording.
the control method of the automobile radar system based on the 3D Sensor specifically comprises the following steps:
step 1, acquiring depth data and RGB data in real time; the depth information data is obtained by projecting a known infrared mode into a scene based on optical coding and through the deformation of the mode captured by another infrared CMOS imager, and the distance information of all objects in the angle of view is output; the RGB data is captured by an RGB camera;
step 2, carrying out data analysis on the depth data and the RGB data acquired in the step 1, and carrying out distance monitoring and obstacle monitoring;
Step 3, extracting the characteristics of the detected obstacles; specifically, the method comprises the following steps: outputting 3D data information by a 3D identification chip, carrying out feature detection on the depth data blocks, iterating to an optimal value, summarizing features, and obtaining feature data;
Step 4, carrying out object identification on the extracted characteristic data, and measuring and calculating the distance in real time; the real-time distance measurement and calculation specifically refers to depth distance statistics of a characteristic region corresponding to a characteristic object, and the minimum distance value in the region is determined as the distance of the object;
Step 5, for animals and people, living body detection, action recognition and obstacle behavior monitoring can be carried out;
step 6, 3D modeling is carried out, and real-time monitoring is carried out through an early warning system to obtain early warning information;
And 7, the barrier enters the early warning range, early warning information is displayed through the 3D display assembly, voice broadcasting is carried out, and real-time prompting is carried out.
In conclusion, the invention has strong functionality, the traditional automobile radar has fewer functions and has a detection blind area, when the automobile radar encounters an excessively short obstacle, an uneven ground and an excessively thin obstacle, the radar does not respond, generally, the obstacle below the center of the probe by 10 ~ 15cm is possibly ignored by the probe, the height value is reduced along with the decrease of the distance between the obstacle and the parking space, the danger is increased along with the decrease of the distance, the automobile radar based on the 3D Sensor has fewer blind areas, the automobile radar has great advantages in small object monitoring, and the surrounding objects can be monitored and identified without light;
the invention has expansibility, the traditional automobile radar can only detect the obstacles and can not display the obstacles (the obstacles can be used by means of image cooperation), the automobile radar based on the 3D Sensor can not only detect the distance and the obstacles and display the obstacles (if the display effect is better by cooperating with a colorful image), but also identify objects (including people and animals), and more intelligently give real-time external environment information to a driver so as to drive better.
Claims (6)
1. The utility model provides an automobile radar system based on 3D Sensor which characterized in that: comprises
the 3D Sensor module is used for acquiring depth data and color data in real time, processing the data and generating 3D data information;
The data processing module is used for carrying out distance monitoring according to the depth data and extracting 3D characteristic data from the 3D data information;
the 3D identification module is used for identifying objects, people or animals according to the extracted 3D characteristic data and carrying out action identification on people;
the output module is used for displaying real-time pictures, identifying objects, people or animals and displaying action and characteristic data;
and the voice broadcasting terminal is used for carrying out voice early warning.
2. the 3D Sensor-based automotive radar system of claim 1, wherein: the 3D Sensor module specifically comprises
An infrared emitter for emitting infrared light;
An infrared receiver for receiving infrared light;
the 3D identification chip is used for generating depth data and generating 3D information according to the depth data;
And the RGB camera is used for acquiring color data so as to generate a real-time picture.
3. the 3D Sensor-based automotive radar system of claim 1, wherein: the 3D identification module specifically comprises
The distance monitoring module is used for calculating the distance according to the depth data;
and the 3D feature extraction module is used for extracting 3D information according to the 3D information of the depth data so as to complete 3D feature recognition.
4. The 3D Sensor-based automotive radar system of claim 1, wherein: the 3D identification module specifically comprises
The object, human and animal identification module is used for carrying out feature retrieval according to the data of the 3D feature extraction module and the 3D feature library so as to identify;
And the action recognition processing module is used for carrying out action recognition according to the 3D information.
5. the 3D Sensor-based automotive radar system of claim 1, wherein: the output module specifically comprises
The 3D display component is used for displaying the real-time monitoring picture and the identified 3D characteristic information;
The early warning system is used for sending out early warning;
And the information recording system is used for identifying the information recording and the dangerous number recording.
6. The control method of the 3D Sensor-based automotive radar system according to claims 1 to 5, characterized in that: the method specifically comprises the following steps:
Step 1, acquiring depth data and RGB data in real time; the depth information data is obtained by projecting a known infrared mode into a scene based on optical coding and through the deformation of the mode captured by another infrared CMOS imager, and the distance information of all objects in the angle of view is output; the RGB data is captured by an RGB camera;
Step 2, carrying out data analysis on the depth data and the RGB data acquired in the step 1, and carrying out distance monitoring and obstacle monitoring;
step 3, extracting the characteristics of the detected obstacles; specifically, the method comprises the following steps: outputting 3D data information by a 3D identification chip, carrying out feature detection on the depth data blocks, iterating to an optimal value, summarizing features, and obtaining feature data;
Step 4, carrying out object identification on the extracted characteristic data, and measuring and calculating the distance in real time; the real-time distance measurement and calculation specifically refers to depth distance statistics of a characteristic region corresponding to a characteristic object, and the minimum distance value in the region is determined as the distance of the object;
Step 5, for animals and people, living body detection, action recognition and obstacle behavior monitoring can be carried out;
Step 6, 3D modeling is carried out, and real-time monitoring is carried out through an early warning system to obtain early warning information;
and 7, the barrier enters the early warning range, early warning information is displayed through the 3D display assembly, voice broadcasting is carried out, and real-time prompting is carried out.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810550819.3A CN110549975A (en) | 2018-05-31 | 2018-05-31 | 3D Sensor-based automobile radar system and control method thereof |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810550819.3A CN110549975A (en) | 2018-05-31 | 2018-05-31 | 3D Sensor-based automobile radar system and control method thereof |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN110549975A true CN110549975A (en) | 2019-12-10 |
Family
ID=68733801
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810550819.3A Pending CN110549975A (en) | 2018-05-31 | 2018-05-31 | 3D Sensor-based automobile radar system and control method thereof |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110549975A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111240486A (en) * | 2020-02-17 | 2020-06-05 | 河北冀联人力资源服务集团有限公司 | Data processing method and system based on edge calculation |
Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| AU2005201620A1 (en) * | 2005-04-26 | 2006-11-16 | Assadi, James | Surround Sensor for Vehicles and Vessels |
| CN105138111A (en) * | 2015-07-09 | 2015-12-09 | 中山大学 | Single camera based somatosensory interaction method and system |
| CN105981077A (en) * | 2014-01-03 | 2016-09-28 | 谷歌技术控股有限责任公司 | Methods and Systems for Generating a Map including Sparse and Dense Mapping Information |
| CN105991990A (en) * | 2015-01-23 | 2016-10-05 | 江苏南大五维电子科技有限公司 | 3D information obtaining device, 3D information obtaining method, imaging device and electronic device |
| WO2017003053A1 (en) * | 2015-06-30 | 2017-01-05 | 엘지전자 주식회사 | Vehicle display device and vehicle |
| CN106573381A (en) * | 2014-06-04 | 2017-04-19 | 因特利格兰特总部有限责任公司 | Truck unloader visualization |
| CN107533749A (en) * | 2015-06-30 | 2018-01-02 | 日立汽车系统株式会社 | Article detection device |
| CN107665326A (en) * | 2016-07-29 | 2018-02-06 | 奥的斯电梯公司 | Monitoring system, passenger transporter and its monitoring method of passenger transporter |
| CN107804227A (en) * | 2017-09-28 | 2018-03-16 | 上海视智电子科技有限公司 | A kind of automobile safety system based on 3D depth surveys |
-
2018
- 2018-05-31 CN CN201810550819.3A patent/CN110549975A/en active Pending
Patent Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| AU2005201620A1 (en) * | 2005-04-26 | 2006-11-16 | Assadi, James | Surround Sensor for Vehicles and Vessels |
| CN105981077A (en) * | 2014-01-03 | 2016-09-28 | 谷歌技术控股有限责任公司 | Methods and Systems for Generating a Map including Sparse and Dense Mapping Information |
| CN106573381A (en) * | 2014-06-04 | 2017-04-19 | 因特利格兰特总部有限责任公司 | Truck unloader visualization |
| CN105991990A (en) * | 2015-01-23 | 2016-10-05 | 江苏南大五维电子科技有限公司 | 3D information obtaining device, 3D information obtaining method, imaging device and electronic device |
| WO2017003053A1 (en) * | 2015-06-30 | 2017-01-05 | 엘지전자 주식회사 | Vehicle display device and vehicle |
| CN107533749A (en) * | 2015-06-30 | 2018-01-02 | 日立汽车系统株式会社 | Article detection device |
| CN105138111A (en) * | 2015-07-09 | 2015-12-09 | 中山大学 | Single camera based somatosensory interaction method and system |
| CN107665326A (en) * | 2016-07-29 | 2018-02-06 | 奥的斯电梯公司 | Monitoring system, passenger transporter and its monitoring method of passenger transporter |
| CN107804227A (en) * | 2017-09-28 | 2018-03-16 | 上海视智电子科技有限公司 | A kind of automobile safety system based on 3D depth surveys |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111240486A (en) * | 2020-02-17 | 2020-06-05 | 河北冀联人力资源服务集团有限公司 | Data processing method and system based on edge calculation |
| CN111240486B (en) * | 2020-02-17 | 2021-07-02 | 河北冀联人力资源服务集团有限公司 | Data processing method and system based on edge calculation |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11620835B2 (en) | Obstacle recognition method and apparatus, storage medium, and electronic device | |
| WO2021023106A1 (en) | Target recognition method and apparatus, and camera | |
| EP2559016B1 (en) | Video based intelligent vehicle control system | |
| KR101030763B1 (en) | Image acquisition unit, acquisition method and associated control unit | |
| CN107856671B (en) | Method and system for road condition identification through automobile data recorder | |
| US20160010983A1 (en) | Integrated Vehicular System for Low Speed Collision Avoidance | |
| KR20150051735A (en) | Parking Guide System and the Method | |
| KR101103526B1 (en) | Collision Avoidance Method Using Stereo Camera | |
| CN102303563B (en) | System and method for prewarning front vehicle collision | |
| CN109977908B (en) | Vehicle driving lane detection method based on deep learning | |
| CN112606804B (en) | Control method and control system for active braking of vehicle | |
| CN104076363A (en) | Rapid automatic guided vehicle obstacle detection method based on multiple sensors | |
| TWM593949U (en) | Image integration warning system for motor vehicles | |
| CN110549975A (en) | 3D Sensor-based automobile radar system and control method thereof | |
| CN111086451B (en) | Head-up display system, display method and automobile | |
| US20230343228A1 (en) | Information processing apparatus, information processing system, and information processing method, and program | |
| CN111332306A (en) | Traffic road perception auxiliary driving early warning device based on machine vision | |
| KR102290353B1 (en) | Unauthorized alerting system and method using object recognition | |
| US20160217581A1 (en) | Driving condition identification system | |
| CN115331386B (en) | Prevent fishing detection alarm system based on computer vision | |
| CN111832418A (en) | Vehicle control method, device, vehicle and storage medium | |
| CN116612638A (en) | Traffic collision accident detection method, device and readable medium | |
| CN111332305A (en) | Active early warning type traffic road perception auxiliary driving early warning system | |
| CN115100251A (en) | Thermal imager and laser radar-based vehicle front pedestrian detection method and terminal | |
| CN113232586A (en) | Infrared pedestrian projection display method and system for driving at night |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20191210 |