CN112735121A - Holographic sensing system based on image-level laser radar - Google Patents
Holographic sensing system based on image-level laser radar Download PDFInfo
- Publication number
- CN112735121A CN112735121A CN201910974895.1A CN201910974895A CN112735121A CN 112735121 A CN112735121 A CN 112735121A CN 201910974895 A CN201910974895 A CN 201910974895A CN 112735121 A CN112735121 A CN 112735121A
- Authority
- CN
- China
- Prior art keywords
- image
- information
- control center
- sensing system
- traffic
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000001514 detection method Methods 0.000 claims abstract description 30
- 238000012360 testing method Methods 0.000 claims abstract description 10
- 238000004364 calculation method Methods 0.000 claims description 14
- 230000004044 response Effects 0.000 claims description 4
- 238000009434 installation Methods 0.000 abstract description 5
- 238000000034 method Methods 0.000 description 8
- 238000012545 processing Methods 0.000 description 5
- 238000005286 illumination Methods 0.000 description 4
- 230000005540 biological transmission Effects 0.000 description 3
- 238000010586 diagram Methods 0.000 description 3
- 239000013307 optical fiber Substances 0.000 description 3
- 238000011161 development Methods 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 238000012423 maintenance Methods 0.000 description 2
- 230000002159 abnormal effect Effects 0.000 description 1
- 238000013528 artificial neural network Methods 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 238000013135 deep learning Methods 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 238000002592 echocardiography Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 230000004927 fusion Effects 0.000 description 1
- 230000010365 information processing Effects 0.000 description 1
- 230000002452 interceptive effect Effects 0.000 description 1
- 238000005259 measurement Methods 0.000 description 1
- 230000005055 memory storage Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012544 monitoring process Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000008447 perception Effects 0.000 description 1
- 230000008569 process Effects 0.000 description 1
- 239000000047 product Substances 0.000 description 1
- 230000000750 progressive effect Effects 0.000 description 1
- 238000012163 sequencing technique Methods 0.000 description 1
- 239000013589 supplement Substances 0.000 description 1
- 238000012549 training Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G08—SIGNALLING
- G08G—TRAFFIC CONTROL SYSTEMS
- G08G1/00—Traffic control systems for road vehicles
- G08G1/01—Detecting movement of traffic to be counted or controlled
- G08G1/0104—Measuring and analyzing of parameters relative to traffic conditions
- G08G1/0108—Measuring and analyzing of parameters relative to traffic conditions based on the source of data
-
- G—PHYSICS
- G08—SIGNALLING
- G08G—TRAFFIC CONTROL SYSTEMS
- G08G1/00—Traffic control systems for road vehicles
- G08G1/01—Detecting movement of traffic to be counted or controlled
- G08G1/04—Detecting movement of traffic to be counted or controlled using optical or ultrasonic detectors
-
- G—PHYSICS
- G08—SIGNALLING
- G08G—TRAFFIC CONTROL SYSTEMS
- G08G1/00—Traffic control systems for road vehicles
- G08G1/07—Controlling traffic signals
Landscapes
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Chemical & Material Sciences (AREA)
- Analytical Chemistry (AREA)
- Traffic Control Systems (AREA)
Abstract
The invention provides an image-level laser radar-based holographic sensing system, which comprises: road information acquisition equipment, drive test terminal system, traffic management and control center, road information acquisition is electric connection to drive test terminal system and traffic management and control center respectively, and drive test terminal system includes camera, image level laser radar. The long-distance and high-precision detection of a single laser radar is realized, so that the installation cost per kilometer is reduced. Meanwhile, the problem of low resolution in the current road holographic sensing system is solved, and the system is matched with a camera for use, so that high-resolution and low-cost emergency early warning is realized at an intersection of cities and towns.
Description
Technical Field
The invention relates to the field of sensors, in particular to a holographic sensing system based on an image-level laser radar.
Background
The rapid development of economy and the increasing traffic pressure provide new requirements for urban road traffic, how to fully utilize the existing technical means to improve urban traffic capacity and establish a perfect road holographic sensing system, particularly the emergency early warning of intersection, which is the key development direction of intelligent traffic. At the present stage, the road holographic sensing system adopts a detection mode of integrating video detection and radar detection to jointly complete information acquisition. A holographic sensing system (video + millimeter wave radar detection type) for emergency early warning at an intersection is shown in fig. 1.
The road holographic sensing system comprises a road information acquisition device, a road test terminal system and a traffic control center, wherein the road information acquisition device comprises a camera and a millimeter wave radar.
Video detection is the mainstream road detection method at present, has the characteristics of abundant information content, flexible information processing mode and the like, can obtain comprehensive vehicle information, but is greatly influenced by illumination and weather, and cannot work normally during night.
The millimeter wave radar is a radar with a working frequency range in a millimeter wave frequency range, and the distance measurement principle is to send out radio waves (radar waves), then receive echoes and measure the position data of a target according to the time difference between the sending and receiving. The millimeter wave radar works by utilizing the radar waves emitted by the millimeter wave radar, is not influenced by illumination, and can well make up the defect that a camera cannot normally collect road information during night. But its detection range is short; the detection resolution is low, and small objects on a detection road are easy to omit; the full coverage effect of the intersection is expected to be achieved under the influence of the detection distance and the detection precision, and the installation cost per kilometer is high.
The video + millimeter wave radar detection type holographic sensing system combines data obtained from a plurality of sources, and can obtain more and more comprehensive information than a single sensor. From data collected by the video and millimeter wave radar, the length, width, speed and other information of the vehicle can be obtained, so that the characteristic identification of the target vehicle is carried out; the traffic flow of the current intersection can be obtained by calculating the number of detected vehicles per minute, the road condition is identified and guided, and the traffic pressure is relieved; and (4) continuing the vehicles at the intersection, recording the lane change, line pressing, overspeed, abnormal parking and the like of the vehicles, and providing data for a traffic sequencing system. The detection technologies of the video and the millimeter wave radar are fused, so that the advantages can be complemented, more comprehensive information of the vehicle road can be obtained, the recognition rate of the vehicle and the judgment of the road condition can be improved, the detection rate of whether the vehicle runs normally can be improved, and a comprehensive information source is provided for the intersection emergency early warning system. The system cost is high.
Maintenance, a new perception system is needed.
Disclosure of Invention
In view of the above existing problems, the present invention provides a new sensing system, which is based on an image-level laser radar, and implements long-distance and high-precision detection of a single radar, thereby reducing the installation cost per kilometer.
In order to achieve the purpose, the invention adopts the following technical scheme:
an image-level lidar based holographic sensing system, comprising: the road information acquisition system comprises road information acquisition equipment, a road test terminal system and a traffic control center, wherein the road information acquisition equipment is electrically connected to the road test terminal system and the traffic control center respectively, and the road test terminal system comprises a camera and an image-level laser radar.
Preferably, the image-level lidar is operable to emit a wavelength of 1550 nm.
Preferably, the system is operated to emit a plurality of light pulses within a predetermined time, each light pulse being emitted in a plurality of different directions with a field of view of 40 × 100 °, and a reflected signal of each light pulse is used to construct a three-dimensional scene around the system.
Preferably, the information detected by the camera and the image-level lidar is transmitted to a switch and transmitted to a traffic light or an edge calculation module through the switch, the switch feeds back the information of the detection module to a control center, and the control center transmits the received information to the participating vehicles and/or connected intelligent equipment through the RSU.
Preferably, the participating vehicle transmits the detected ambient environment information to the control center through the onboard vehicle-mounted device, the control center receives and correspondingly feeds back the information and transmits the response information to the switch, the switch transmits the received response signal to the traffic light device, and the traffic light device receives and displays the traffic signal. On the other hand, the edge calculation will take part in the control center calculation. The edge calculation may also transmit the results of its calculations to the participating vehicles and/or connected smart devices. The detection module comprises a laser radar, a camera and other sensors (and weather and illumination sensors), and transmits the information detected by the detection module to the switch.
Compared with the scheme in the prior art, the invention has the advantages that:
the method is based on the image-level laser radar, realizes long-distance and high-precision detection of a single radar, and accordingly reduces the installation cost per kilometer. Meanwhile, the problem of low resolution in the current road holographic sensing system is solved, and the system is matched with a camera for use, so that high-resolution and low-cost emergency early warning is realized at an intersection of cities and towns.
Drawings
The invention is further described with reference to the following figures and examples:
fig. 1 is a schematic diagram of a holographic sensing system for emergency early warning at an intersection in the prior art.
Fig. 2 is a schematic diagram illustrating an architecture of a roadside holographic sensing system device according to an embodiment of the application.
Fig. 3 is a flow chart of the vehicle-road cooperative data transmission according to the embodiment of the present application.
Detailed Description
The above-described scheme is further illustrated below with reference to specific examples. It should be understood that these examples are for illustrative purposes and are not intended to limit the scope of the present invention. The conditions employed in the examples may be further adjusted as determined by the particular manufacturer, and the conditions not specified are typically those used in routine experimentation.
The embodiment adopts the holographic sensing system of the image-level laser radar under the existing framework. The image-level laser radar works to emit 1550nm wavelength, so that the image-level laser radar is safe to human eyes. Lidar operates on the time-of-flight principle. The system emits a large number of light pulses within 0.1 second, each light pulse is emitted to a plurality of different directions with a field of view of 40x100 degrees, and the reflected signals of each light pulse are utilized to construct a three-dimensional scene around the system.
The holographic sensing system of the image-level lidar according to the embodiment of the present application will be described in detail with reference to fig. 2 and 3.
Fig. 3 is a flow chart of the vehicle-road cooperative data transmission according to the embodiment of the present application, information detected by the detection module is transmitted to the switch through an optical fiber, the switch transmits the information to the traffic light device (based on the received information display signal) or the auxiliary processing module (edge calculation), the switch processes the information of the detection module and feeds the processed information back to the (traffic) control center (remote server) through the optical fiber, and the control center transmits the processed information to the participating vehicle and/or the connected intelligent device (such as the mobile phone APP) through the RSU. The participatory vehicle transmits the surrounding environment information (such as 5G transmission) detected by the participatory vehicle through the onboard vehicle equipment (such as laser radar, camera, millimeter wave and other equipment) to the control center, the control center transmits the received information to the switch after processing, and the switch is novel interactive with the traffic light device, so as to adjust traffic signals. On the other hand, the auxiliary processing module (edge calculation). The auxiliary processing module (edge calculation) can also transmit the results of its calculations to the participating vehicles and/or connected smart devices. The detection module comprises a laser radar, a camera and other sensors (and weather and illumination sensors), and transmits the information detected by the detection module to the switch.
Fig. 2 is a schematic diagram of a roadside holographic sensing system device architecture according to an embodiment of the present application, which obtains road and vehicle information at a junction by using a mutual fusion effect of a radar and a camera, and has the advantages of higher precision and long detection distance. The resolution precision of the image-level laser radar is far higher than that of the millimeter-wave radar, so that small-volume objects missed to be detected by the millimeter-wave radar can be identified, and richer and more precise road information is provided for a holographic sensing system. The image-level laser radar utilizes the collected high-density target point cloud patterns, the target attributes are accurately identified through deep learning by a neural network algorithm, and information such as types, directions, distances, speeds, moving directions and flow rates of motor vehicles, non-motor vehicles, pedestrians and the like can be output through training. The output rate and accuracy of target identification can be greatly improved. Road surface information can be transmitted to a roadside terminal system through optical fibers or a gigabit network after being identified and by matching with other multi-sensors, and then is broadcasted to surrounding or more distant vehicles through a traffic control center server, intersection traffic information and traffic safety information prompts are provided for surrounding current vehicles, meanwhile, effective information supplement is provided for vehicle vision blind areas, and driving safety is improved. The traffic information collection and playing can greatly improve and promote the emergency early warning information of the intersection and improve the emergency early warning capability. Meanwhile, vehicles with radar monitoring can transmit traffic information of surrounding areas to a traffic control center through a network, so that road holographic sensing system information is enriched, and a feasible implementation mode is provided for intelligent vehicle-road cooperation.
In the above embodiment, the image-level laser radar has the detection capability of 300m, the detection capability is far greater than that of the millimeter-wave radar, the target object can be tracked for a longer distance, and meanwhile, the number of the radars to be installed is far smaller than that of the millimeter-wave radar on the traffic road with the same distance, so that the installation and maintenance cost is reduced.
In the above embodiments, the traffic control center is also referred to as a traffic control center.
In one embodiment, the traffic scheduling method based on the holographic sensing system of the image-level laser radar is applied to intersection emergency early warning, compared with the method introduced in the background, the traffic scheduling method adopts a single laser, and is matched with a camera (video camera) for use through long-distance and high-precision detection, so that the traffic condition of an intersection is constructed at high resolution, the detected information is interacted with the information of a control center, and the traffic flow of the intersection is scheduled reasonably and orderly. Such embodiment has improved the emergent early warning ability of intersection.
It should be noted that, in the present specification, each embodiment is described in a progressive manner, and the same or similar parts in each embodiment may be referred to each other, and each embodiment focuses on differences from other embodiments. Especially, as for the device embodiment, the user terminal embodiment and the management platform embodiment, since they are basically similar to the method embodiment, the description is relatively simple, and the relevant points can be referred to the partial description of the method embodiment.
The systems, modules or units illustrated in the above embodiments may be implemented by a computer chip or an entity, or by a product with certain functions.
From the above description of the embodiments, it is clear to those skilled in the art that the present specification can be implemented by software plus a necessary general hardware platform. Based on such understanding, the technical solutions of the present specification may be essentially or partially implemented in the form of software products, which may be stored in a storage medium, such as ROM/RAM, optical disc, etc., and include several instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) to execute the methods described in the embodiments or some parts of the embodiments of the present specification.
The description is operational with numerous general purpose or special purpose computing system environments or configurations. For example: personal computers, server computers, multiprocessor systems, programmable consumer electronics, minicomputers, distributed computing environments that include any of the above systems or devices, and the like.
This description may be described in the general context of computer-executable instructions, such as program modules, being executed by a computer. Generally, program modules include programs, components, data structures, etc. that perform particular tasks or implement particular abstract data types. The specification may also be practiced in distributed computing environments where tasks are performed by remote processing devices that are linked through a communications network. In a distributed computing environment, program modules may be located in both local and remote computer storage media including memory storage devices.
The above embodiments are merely illustrative of the technical ideas and features of the present invention, and the purpose thereof is to enable those skilled in the art to understand the contents of the present invention and implement the present invention, and not to limit the protection scope of the present invention. All equivalent changes and modifications made according to the spirit of the present invention should be covered within the protection scope of the present invention.
Claims (5)
1. An image-level lidar based holographic sensing system, comprising:
road information acquisition equipment, a road test terminal system and a traffic control center, wherein the road information acquisition equipment is respectively and electrically connected to the road test terminal system and the traffic control center,
the drive test terminal system comprises a camera and an image-level laser radar.
2. The image-based lidar holographic sensing system of claim 1, wherein the image-based lidar is operable to emit a wavelength of 1550 nm.
3. The image-based lidar holographic sensing system of claim 1, wherein the system is operable to emit a plurality of light pulses during a predetermined time, each light pulse being emitted in a plurality of different directions with a field of view of 40x100 °, and wherein a reflected signal of each light pulse is utilized to construct a three-dimensional scene surrounding the system.
4. The holographic sensing system of claim 1, wherein information based on camera, image level lidar detection is transmitted to a switch and through the switch to a traffic light or edge calculation module, and the switch feeds back the information of the detection module to a control center, which transmits the received information to participating vehicles and/or connected smart devices through the RSU.
5. The holographic sensing system of claim 4, wherein the participating vehicles transmit their detected ambient environment information to the control center through their onboard vehicle-mounted devices, the control center receives and accordingly feeds back the information and transmits the information in response to the switch, the switch transmits the received response signal to the traffic light device, and the traffic light device receives and displays the traffic signal. On the other hand, the edge calculation will take part in the control center calculation. The edge calculation may also transmit the results of its calculations to the participating vehicles and/or connected smart devices.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910974895.1A CN112735121A (en) | 2019-10-14 | 2019-10-14 | Holographic sensing system based on image-level laser radar |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910974895.1A CN112735121A (en) | 2019-10-14 | 2019-10-14 | Holographic sensing system based on image-level laser radar |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN112735121A true CN112735121A (en) | 2021-04-30 |
Family
ID=75588521
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910974895.1A Pending CN112735121A (en) | 2019-10-14 | 2019-10-14 | Holographic sensing system based on image-level laser radar |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112735121A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113470354A (en) * | 2021-06-24 | 2021-10-01 | 上海智能网联汽车技术中心有限公司 | All-weather road test sensing system |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104269053A (en) * | 2014-08-29 | 2015-01-07 | 陈业军 | Intelligent traffic system and method and intelligent automobile |
| CN105761521A (en) * | 2015-12-31 | 2016-07-13 | 重庆邮电大学 | Real-time traffic guidance roadside system and real-time traffic guidance method based on Internet of Vehicles |
| CN107067762A (en) * | 2017-03-07 | 2017-08-18 | 贤石金 | Intelligent traffic light |
| CN108986510A (en) * | 2018-07-31 | 2018-12-11 | 同济大学 | A kind of local dynamic map of intelligence towards crossing realizes system and implementation method |
| CN109472977A (en) * | 2018-12-06 | 2019-03-15 | 上海淞泓智能汽车科技有限公司 | A kind of multi information acquisition publication integral intelligent road side system |
| CN109993968A (en) * | 2019-02-26 | 2019-07-09 | 北京工业大学 | Traffic control system based on car networking |
-
2019
- 2019-10-14 CN CN201910974895.1A patent/CN112735121A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104269053A (en) * | 2014-08-29 | 2015-01-07 | 陈业军 | Intelligent traffic system and method and intelligent automobile |
| CN105761521A (en) * | 2015-12-31 | 2016-07-13 | 重庆邮电大学 | Real-time traffic guidance roadside system and real-time traffic guidance method based on Internet of Vehicles |
| CN107067762A (en) * | 2017-03-07 | 2017-08-18 | 贤石金 | Intelligent traffic light |
| CN108986510A (en) * | 2018-07-31 | 2018-12-11 | 同济大学 | A kind of local dynamic map of intelligence towards crossing realizes system and implementation method |
| CN109472977A (en) * | 2018-12-06 | 2019-03-15 | 上海淞泓智能汽车科技有限公司 | A kind of multi information acquisition publication integral intelligent road side system |
| CN109993968A (en) * | 2019-02-26 | 2019-07-09 | 北京工业大学 | Traffic control system based on car networking |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113470354A (en) * | 2021-06-24 | 2021-10-01 | 上海智能网联汽车技术中心有限公司 | All-weather road test sensing system |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11479262B2 (en) | Geographically disparate sensor fusion for enhanced target detection and identification in autonomous vehicles | |
| CN107650908B (en) | Unmanned vehicle environment sensing system | |
| CN110471085B (en) | Track detecting system | |
| CN110542898A (en) | Radar group-based vehicle behavior continuous tracking detection system and method | |
| CN201484287U (en) | Automobile rear-end collision safety warning device | |
| CN111477010A (en) | Device for intersection holographic sensing and control method thereof | |
| CN114442101B (en) | Vehicle navigation method, device, equipment and medium based on imaging millimeter wave radar | |
| CN109910955B (en) | Rail transit tunnel barrier detection system and method based on transponder information transmission | |
| CN112379674B (en) | Automatic driving equipment and system | |
| CN213303095U (en) | Road test device based on artificial intelligence | |
| CN111907518B (en) | Method for dynamically optimizing AEB braking strategy based on cloud big data analysis | |
| US20220215508A9 (en) | Super-resolution radar for autonomous vehicles | |
| CN111477011A (en) | Detection device and detection method for road intersection early warning | |
| CN103692993A (en) | Binocular far infrared intelligent assistant safety driving system | |
| Gazis et al. | Examining the sensors that enable self-driving vehicles | |
| EP3749977A1 (en) | Method and apparatus for object detection using a beam steering radar and convolutional neural network system | |
| CN114397672A (en) | Train active obstacle detection method and device based on positioning technology | |
| CN112669614A (en) | Device and method for acquiring and publishing real-time road condition information | |
| CN210518410U (en) | Automobile sensor system based on time synchronization and automatic driving vehicle | |
| CN114492679A (en) | Vehicle data processing method and device, electronic equipment and medium | |
| CN104199043B (en) | Traffic sign detection method | |
| CN117372979A (en) | Road inspection method, device, electronic equipment and storage medium | |
| CN112735121A (en) | Holographic sensing system based on image-level laser radar | |
| CN111402630B (en) | Road early warning method, device and storage medium | |
| CN109584568B (en) | Intelligent traffic radar monitoring system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20210430 |