CN115184917B - 一种融合毫米波雷达与相机的区域目标跟踪方法 - Google Patents
一种融合毫米波雷达与相机的区域目标跟踪方法 Download PDFInfo
- Publication number
- CN115184917B CN115184917B CN202211106749.5A CN202211106749A CN115184917B CN 115184917 B CN115184917 B CN 115184917B CN 202211106749 A CN202211106749 A CN 202211106749A CN 115184917 B CN115184917 B CN 115184917B
- Authority
- CN
- China
- Prior art keywords
- target
- camera
- radar
- video
- frame
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 38
- 238000013528 artificial neural network Methods 0.000 claims abstract description 8
- 238000013135 deep learning Methods 0.000 claims abstract description 5
- 238000001514 detection method Methods 0.000 claims description 21
- 239000011159 matrix material Substances 0.000 claims description 17
- 230000004927 fusion Effects 0.000 claims description 10
- 230000003068 static effect Effects 0.000 claims description 10
- 238000001914 filtration Methods 0.000 claims description 9
- 238000003384 imaging method Methods 0.000 claims description 8
- 238000004364 calculation method Methods 0.000 claims description 7
- 238000005259 measurement Methods 0.000 claims description 7
- 238000006243 chemical reaction Methods 0.000 claims description 6
- 230000003287 optical effect Effects 0.000 claims description 5
- 230000007704 transition Effects 0.000 claims description 5
- 238000005070 sampling Methods 0.000 claims description 3
- 230000008569 process Effects 0.000 description 10
- 230000006872 improvement Effects 0.000 description 9
- 230000000694 effects Effects 0.000 description 7
- 238000012545 processing Methods 0.000 description 4
- 230000007547 defect Effects 0.000 description 3
- 238000010586 diagram Methods 0.000 description 3
- 238000007781 pre-processing Methods 0.000 description 2
- 230000000007 visual effect Effects 0.000 description 2
- 241001465754 Metazoa Species 0.000 description 1
- 230000006978 adaptation Effects 0.000 description 1
- 238000007796 conventional method Methods 0.000 description 1
- 230000007812 deficiency Effects 0.000 description 1
- 238000000605 extraction Methods 0.000 description 1
- 239000000463 material Substances 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000010606 normalization Methods 0.000 description 1
- 230000009466 transformation Effects 0.000 description 1
- 238000012800 visualization Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S13/00—Systems using the reflection or reradiation of radio waves, e.g. radar systems; Analogous systems using reflection or reradiation of waves whose nature or wavelength is irrelevant or unspecified
- G01S13/86—Combinations of radar systems with non-radar systems, e.g. sonar, direction finder
- G01S13/867—Combination of radar systems with cameras
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S13/00—Systems using the reflection or reradiation of radio waves, e.g. radar systems; Analogous systems using reflection or reradiation of waves whose nature or wavelength is irrelevant or unspecified
- G01S13/66—Radar-tracking systems; Analogous systems
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/20—Analysis of motion
- G06T7/277—Analysis of motion involving stochastic approaches, e.g. using Kalman filters
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/70—Determining position or orientation of objects or cameras
- G06T7/73—Determining position or orientation of objects or cameras using feature-based methods
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/20—Image preprocessing
- G06V10/25—Determination of region of interest [ROI] or a volume of interest [VOI]
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
- G06V10/82—Arrangements for image or video recognition or understanding using pattern recognition or machine learning using neural networks
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/40—Scenes; Scene-specific elements in video content
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/20—Special algorithmic details
- G06T2207/20084—Artificial neural networks [ANN]
Landscapes
- Engineering & Computer Science (AREA)
- Remote Sensing (AREA)
- Radar, Positioning & Navigation (AREA)
- General Physics & Mathematics (AREA)
- Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Multimedia (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Evolutionary Computation (AREA)
- Computer Networks & Wireless Communication (AREA)
- Medical Informatics (AREA)
- Software Systems (AREA)
- General Health & Medical Sciences (AREA)
- Databases & Information Systems (AREA)
- Computing Systems (AREA)
- Artificial Intelligence (AREA)
- Health & Medical Sciences (AREA)
- Radar Systems Or Details Thereof (AREA)
Abstract
Description
Claims (6)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202211106749.5A CN115184917B (zh) | 2022-09-13 | 2022-09-13 | 一种融合毫米波雷达与相机的区域目标跟踪方法 |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202211106749.5A CN115184917B (zh) | 2022-09-13 | 2022-09-13 | 一种融合毫米波雷达与相机的区域目标跟踪方法 |
Publications (2)
Publication Number | Publication Date |
---|---|
CN115184917A CN115184917A (zh) | 2022-10-14 |
CN115184917B true CN115184917B (zh) | 2023-03-10 |
Family
ID=83524325
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN202211106749.5A Active CN115184917B (zh) | 2022-09-13 | 2022-09-13 | 一种融合毫米波雷达与相机的区域目标跟踪方法 |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN115184917B (zh) |
Families Citing this family (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN116027317B (zh) * | 2023-01-06 | 2024-01-26 | 中国人民解放军空军预警学院 | 一种基于星载宽带雷达的海面舰船目标二维速度估计方法 |
CN116030099B (zh) * | 2023-03-31 | 2023-08-08 | 北京尚优力达科技有限公司 | 一种基于ptz相机的多目标跟踪方法及装置 |
CN116630764B (zh) * | 2023-07-21 | 2023-09-26 | 武汉理工大学三亚科教创新园 | 水面目标融合辨识方法、系统、存储介质、计算机设备及终端 |
Citations (10)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2007233166A (ja) * | 2006-03-02 | 2007-09-13 | Olympus Imaging Corp | ぶれ補正機能付きカメラ |
WO2012151777A1 (zh) * | 2011-05-09 | 2012-11-15 | 上海芯启电子科技有限公司 | 多目标跟踪特写拍摄视频监控系统 |
CN106953762A (zh) * | 2017-03-29 | 2017-07-14 | 千寻位置网络有限公司 | 基于热备数据中心的差分服务系统及实现方法 |
CN109459750A (zh) * | 2018-10-19 | 2019-03-12 | 吉林大学 | 一种毫米波雷达与深度学习视觉融合的前方多车辆跟踪方法 |
CN110415278A (zh) * | 2019-07-30 | 2019-11-05 | 中国人民解放军火箭军工程大学 | 直线移动ptz相机辅助双目ptz视觉系统的主从跟踪方法 |
CN113573022A (zh) * | 2021-07-27 | 2021-10-29 | 安徽云森物联网科技有限公司 | 一种基于毫米波雷达和ptz云台的目标自动跟踪方法 |
CN114236528A (zh) * | 2022-02-23 | 2022-03-25 | 浙江高信技术股份有限公司 | 一种基于毫米波雷达和视频融合的目标检测方法及系统 |
CN114545435A (zh) * | 2021-12-21 | 2022-05-27 | 武汉市众向科技有限公司 | 一种融合相机与激光雷达的动态目标感知系统及方法 |
CN114820725A (zh) * | 2022-03-15 | 2022-07-29 | 中国科学院自动化研究所 | 目标显示方法、装置、电子设备及存储介质 |
CN115032651A (zh) * | 2022-06-06 | 2022-09-09 | 合肥工业大学 | 一种基于激光雷达与机器视觉融合的目标检测方法 |
Family Cites Families (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US9599706B2 (en) * | 2015-04-06 | 2017-03-21 | GM Global Technology Operations LLC | Fusion method for cross traffic application using radars and camera |
CN109410243A (zh) * | 2018-10-16 | 2019-03-01 | 中电科新型智慧城市研究院有限公司 | 基于区域交叠与模板匹配的多目标跟踪方法 |
US11774582B2 (en) * | 2020-01-28 | 2023-10-03 | Aptiv Technologies Limited | Imaging and radar fusion for multiple-object tracking |
CN114063098A (zh) * | 2020-08-05 | 2022-02-18 | 北京万集科技股份有限公司 | 多目标跟踪方法、装置、计算机设备和存储介质 |
CN113156421A (zh) * | 2021-04-07 | 2021-07-23 | 南京邮电大学 | 基于毫米波雷达和摄像头信息融合的障碍物检测方法 |
-
2022
- 2022-09-13 CN CN202211106749.5A patent/CN115184917B/zh active Active
Patent Citations (10)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2007233166A (ja) * | 2006-03-02 | 2007-09-13 | Olympus Imaging Corp | ぶれ補正機能付きカメラ |
WO2012151777A1 (zh) * | 2011-05-09 | 2012-11-15 | 上海芯启电子科技有限公司 | 多目标跟踪特写拍摄视频监控系统 |
CN106953762A (zh) * | 2017-03-29 | 2017-07-14 | 千寻位置网络有限公司 | 基于热备数据中心的差分服务系统及实现方法 |
CN109459750A (zh) * | 2018-10-19 | 2019-03-12 | 吉林大学 | 一种毫米波雷达与深度学习视觉融合的前方多车辆跟踪方法 |
CN110415278A (zh) * | 2019-07-30 | 2019-11-05 | 中国人民解放军火箭军工程大学 | 直线移动ptz相机辅助双目ptz视觉系统的主从跟踪方法 |
CN113573022A (zh) * | 2021-07-27 | 2021-10-29 | 安徽云森物联网科技有限公司 | 一种基于毫米波雷达和ptz云台的目标自动跟踪方法 |
CN114545435A (zh) * | 2021-12-21 | 2022-05-27 | 武汉市众向科技有限公司 | 一种融合相机与激光雷达的动态目标感知系统及方法 |
CN114236528A (zh) * | 2022-02-23 | 2022-03-25 | 浙江高信技术股份有限公司 | 一种基于毫米波雷达和视频融合的目标检测方法及系统 |
CN114820725A (zh) * | 2022-03-15 | 2022-07-29 | 中国科学院自动化研究所 | 目标显示方法、装置、电子设备及存储介质 |
CN115032651A (zh) * | 2022-06-06 | 2022-09-09 | 合肥工业大学 | 一种基于激光雷达与机器视觉融合的目标检测方法 |
Non-Patent Citations (3)
Title |
---|
"Extending Reliability of mmWave Radar Tracking and Detection via Fusion With Camera";Renyuan Zhang等;《IEEE Access》;20190919;137065-137079 * |
"Multisensor data fusion: Target tracking with a doppler radar and an Electro-Optic camera";Shuaib Omar等;《2011 IEEE International Conference on Control System, Computing and Engineering》;20120426;210-215 * |
"基于多传感器信息融合的移动机器人定位方法研究";吴显;《中国优秀硕士学位论文全文数据库信息科技辑》;20160715;正文第21-23页 * |
Also Published As
Publication number | Publication date |
---|---|
CN115184917A (zh) | 2022-10-14 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN115184917B (zh) | 一种融合毫米波雷达与相机的区域目标跟踪方法 | |
EP3573024B1 (en) | Building radar-camera surveillance system | |
CN109460740B (zh) | 基于ais与视频数据融合的船舶身份识别方法 | |
CN107016367B (zh) | 一种跟踪控制方法及跟踪控制系统 | |
CN110794405B (zh) | 一种基于相机和雷达融合的目标检测方法及系统 | |
TWI393074B (zh) | 移動物體偵測裝置與方法 | |
CN113671480A (zh) | 雷达与视频融合交通目标跟踪方法、系统、设备、终端 | |
CN109459750A (zh) | 一种毫米波雷达与深度学习视觉融合的前方多车辆跟踪方法 | |
US20030053658A1 (en) | Surveillance system and methods regarding same | |
US20030053659A1 (en) | Moving object assessment system and method | |
US20030123703A1 (en) | Method for monitoring a moving object and system regarding same | |
EP0878965A2 (en) | Method for tracking entering object and apparatus for tracking and monitoring entering object | |
CN111045000A (zh) | 监测系统和方法 | |
US20060274917A1 (en) | Image processing techniques for a video based traffic monitoring system and methods therefor | |
KR20010000107A (ko) | 다중 이동물체 추적/감시 시스템 | |
WO2003001473A1 (en) | Vision-based collision threat detection system_ | |
JP2000329852A (ja) | 障害物認識装置 | |
CN106504274A (zh) | 一种基于红外摄像头下的视觉跟踪方法及系统 | |
Zhou et al. | Detecting and tracking small moving objects in wide area motion imagery (wami) using convolutional neural networks (cnns) | |
Xiao et al. | Simultaneous detection and tracking of pedestrian from velodyne laser scanning data | |
CN116310679A (zh) | 多传感器融合目标检测方法、系统、介质、设备及终端 | |
CN111913177A (zh) | 对目标物探测方法、装置以及存储介质 | |
CN106558069A (zh) | 一种基于视频监控下的目标跟踪方法及系统 | |
JP2006012178A (ja) | 駐車車両検知方法及び駐車車両検知システム | |
JP2002074370A (ja) | 動画像による監視システム、方法及びコンピュータ読み取り可能な記録媒体 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant | ||
CP01 | Change in the name or title of a patent holder | ||
CP01 | Change in the name or title of a patent holder |
Address after: Building B7, Lugu enterprise Plaza, 27 Wenxuan Road, high tech Zone, Changsha City, Hunan Province, 410205 Patentee after: Huanuo Xingkong Technology Co.,Ltd. Address before: Building B7, Lugu enterprise Plaza, 27 Wenxuan Road, high tech Zone, Changsha City, Hunan Province, 410205 Patentee before: Hunan Huanuo Xingkong Electronic Technology Co.,Ltd. Address after: Building B7, Lugu enterprise Plaza, 27 Wenxuan Road, high tech Zone, Changsha City, Hunan Province, 410205 Patentee after: Hunan Huanuo Xingkong Electronic Technology Co.,Ltd. Address before: Building B7, Lugu enterprise Plaza, 27 Wenxuan Road, high tech Zone, Changsha City, Hunan Province, 410205 Patentee before: HUNAN NOVASKY ELECTRONIC TECHNOLOGY Co.,Ltd. |