TW202244529A - 基於相機地圖及／或雷達資訊的物件尺寸估計 - Google Patents

基於相機地圖及／或雷達資訊的物件尺寸估計 Download PDF

Info

Publication number
TW202244529A
TW202244529A TW110101276A TW110101276A TW202244529A TW 202244529 A TW202244529 A TW 202244529A TW 110101276 A TW110101276 A TW 110101276A TW 110101276 A TW110101276 A TW 110101276A TW 202244529 A TW202244529 A TW 202244529A
Authority
TW
Taiwan
Prior art keywords
map
image
point
points
size
Prior art date
Application number
TW110101276A
Other languages
English (en)
Chinese (zh)
Inventor
加雅克里許南 烏尼克里許南
阿福達 喬西
席瓦母 艾卡瓦
尤加 Ｙ娜達拉簡
阿米爾 薩利米
由爾斯 尼艾森
斯里席沙阿拉溫德 瓦德瑞
高譚 薩德瓦
Original Assignee
美商高通公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 美商高通公司 filed Critical 美商高通公司
Publication of TW202244529A publication Critical patent/TW202244529A/zh

Links

Images

Classifications

    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S7/00—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00
    • G01S7/02—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S13/00
    • G01S7/41—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S13/00 using analysis of echo signal for target characterisation; Target signature; Target cross-section
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S13/00—Systems using the reflection or reradiation of radio waves, e.g. radar systems; Analogous systems using reflection or reradiation of waves whose nature or wavelength is irrelevant or unspecified
    • G01S13/02—Systems using reflection of radio waves, e.g. primary radar systems; Analogous systems
    • G01S13/06—Systems determining position data of a target
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S13/00—Systems using the reflection or reradiation of radio waves, e.g. radar systems; Analogous systems using reflection or reradiation of waves whose nature or wavelength is irrelevant or unspecified
    • G01S13/86—Combinations of radar systems with non-radar systems, e.g. sonar, direction finder
    • G01S13/867—Combination of radar systems with cameras
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S13/00—Systems using the reflection or reradiation of radio waves, e.g. radar systems; Analogous systems using reflection or reradiation of waves whose nature or wavelength is irrelevant or unspecified
    • G01S13/88—Radar or analogous systems specially adapted for specific applications
    • G01S13/89—Radar or analogous systems specially adapted for specific applications for mapping or imaging
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S13/00—Systems using the reflection or reradiation of radio waves, e.g. radar systems; Analogous systems using reflection or reradiation of waves whose nature or wavelength is irrelevant or unspecified
    • G01S13/88—Radar or analogous systems specially adapted for specific applications
    • G01S13/93—Radar or analogous systems specially adapted for specific applications for anti-collision purposes
    • G01S13/931—Radar or analogous systems specially adapted for specific applications for anti-collision purposes of land vehicles
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/60—Analysis of geometric attributes
    • G06T7/62—Analysis of geometric attributes of area, perimeter, diameter or volume
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/70—Determining position or orientation of objects or cameras
    • G06T7/73—Determining position or orientation of objects or cameras using feature-based methods
    • G06T7/75—Determining position or orientation of objects or cameras using feature-based methods involving models
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/764—Arrangements for image or video recognition or understanding using pattern recognition or machine learning using classification, e.g. of video objects
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/82—Arrangements for image or video recognition or understanding using pattern recognition or machine learning using neural networks
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/50—Context or environment of the image
    • G06V20/56—Context or environment of the image exterior to a vehicle by using sensors mounted on the vehicle
    • G06V20/58—Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/60—Type of objects
    • G06V20/64—Three-dimensional [3D] objects
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10016—Video; Image sequence
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10028—Range image; Depth image; 3D point clouds
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20081—Training; Learning
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20084—Artificial neural networks [ANN]
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30248—Vehicle exterior or interior
    • G06T2207/30252—Vehicle exterior; Vicinity of vehicle
    • G06T2207/30256—Lane; Road marking
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30248—Vehicle exterior or interior
    • G06T2207/30252—Vehicle exterior; Vicinity of vehicle
    • G06T2207/30261—Obstacle

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Remote Sensing (AREA)
  • Radar, Positioning & Navigation (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Multimedia (AREA)
  • Evolutionary Computation (AREA)
  • Databases & Information Systems (AREA)
  • General Health & Medical Sciences (AREA)
  • Medical Informatics (AREA)
  • Software Systems (AREA)
  • Computing Systems (AREA)
  • Artificial Intelligence (AREA)
  • Health & Medical Sciences (AREA)
  • Electromagnetism (AREA)
  • Geometry (AREA)
  • Image Analysis (AREA)
  • Traffic Control Systems (AREA)
  • Radar Systems Or Details Thereof (AREA)
TW110101276A 2020-01-06 2021-01-13 基於相機地圖及／或雷達資訊的物件尺寸估計 TW202244529A (zh)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US202062957638P 2020-01-06 2020-01-06
US17/142,199 US11461915B2 (en) 2020-01-06 2021-01-05 Object size estimation using camera map and/or radar information
US17/142,199 2021-01-05

Publications (1)

Publication Number Publication Date
TW202244529A true TW202244529A (zh) 2022-11-16

Family

ID=76655496

Family Applications (1)

Application Number Title Priority Date Filing Date
TW110101276A TW202244529A (zh) 2020-01-06 2021-01-13 基於相機地圖及／或雷達資訊的物件尺寸估計

Country Status (8)

Country Link
US (1) US11461915B2 (https=)
EP (1) EP4088134A1 (https=)
JP (1) JP7677980B2 (https=)
KR (1) KR20220119396A (https=)
BR (1) BR112022012980A2 (https=)
PH (1) PH12022551387A1 (https=)
TW (1) TW202244529A (https=)
WO (1) WO2021142451A1 (https=)

Families Citing this family (50)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2019094863A1 (en) 2017-11-13 2019-05-16 Smart Ag, Inc. Safety system for autonomous operation of off-road and agricultural vehicles using machine learning for detection and identification of obstacles
EP3663978B1 (en) * 2018-12-07 2025-03-12 Thinkware Corporation Method and device for detecting a vehicle
WO2020134750A1 (zh) * 2018-12-28 2020-07-02 杭州大拿科技股份有限公司 一种答案批改方法及装置
JP7164049B2 (ja) * 2019-07-11 2022-11-01 日本電気株式会社 物体検知装置、学習方法、及び、プログラム
KR20210017525A (ko) * 2019-08-08 2021-02-17 삼성전자주식회사 거리 추정 장치 및 이의 동작 방법
US12001958B2 (en) * 2020-03-19 2024-06-04 Nvidia Corporation Future trajectory predictions in multi-actor environments for autonomous machine
CA3177161A1 (en) * 2020-04-28 2021-11-04 Rahul RAMAKRISHNAN Object detection and tracking for automated operation of vehicles and machinery
CN113591872B (zh) * 2020-04-30 2025-01-14 华为技术有限公司 一种数据处理系统、物体检测方法及其装置
DE102020121061A1 (de) * 2020-08-11 2022-02-17 Valeo Schalter Und Sensoren Gmbh Verfahren zum Betreiben eines Assistenzsystems zur Bestimmung einer Länge eines Objekts, Computerprogrammprodukt, computerlesbares Speichermedium sowie Assistenzsystem
US11987236B2 (en) * 2020-08-31 2024-05-21 Nec Corporation Monocular 3D object localization from temporal aggregation
US11731662B2 (en) 2020-10-08 2023-08-22 Ford Global Technologies, Llc Autonomous vehicle system for detecting pedestrian presence
US11361201B2 (en) * 2020-10-08 2022-06-14 Argo AI, LLC Systems and methods for determining an object type and an attribute for an observation based on fused sensor data
WO2022093252A1 (en) * 2020-10-30 2022-05-05 Google Llc Non-occluding video overlays
DE102021104015A1 (de) * 2021-02-19 2022-08-25 Bayerische Motoren Werke Aktiengesellschaft Verfahren zum Erfassen von Objekten in einer Umgebung eines Fahrzeugs mit Bestimmung einer Verdeckung der Objekte, Recheneinrichtung sowie Sensorsystem
JP7572920B2 (ja) * 2021-07-21 2024-10-24 京セラ株式会社 電子機器、電子機器の制御方法、及びプログラム
CN113591668B (zh) * 2021-07-26 2023-11-21 南京大学 一种使用深度学习和空间分析的广域未知大坝自动探测方法
US11948381B2 (en) * 2021-08-20 2024-04-02 Motional Ad Llc Determining object mobility parameters using an object sequence
KR20230044113A (ko) * 2021-09-22 2023-04-03 센스타임 인터내셔널 피티이. 리미티드. 물품 식별 방법, 장치, 기기 및 컴퓨터 판독 가능 저장 매체
CN113778130B (zh) * 2021-09-24 2022-04-15 南京航空航天大学 一种基于三维模型的无人机覆盖路径规划方法
US12260562B2 (en) 2021-10-19 2025-03-25 Stoneridge, Inc. Trailer end tracking in a camera monitoring system
US12197208B2 (en) * 2021-11-01 2025-01-14 Ford Global Technologies, Llc Camera calibration
CN118284906A (zh) * 2021-12-16 2024-07-02 古野电气株式会社 目标监测装置、目标监测方法以及程序
US12033346B2 (en) * 2022-02-01 2024-07-09 Zoox, Inc. Distance representation and encoding
US12374096B2 (en) * 2022-03-04 2025-07-29 Sony Group Corporation Teaching student network for end-to-end semi-supervised object detection
WO2023171672A1 (ja) * 2022-03-08 2023-09-14 パイオニア株式会社 情報処理装置、制御方法、プログラム及び記憶媒体
US12309341B2 (en) 2022-03-18 2025-05-20 Htc Corporation Wearable device and control method thereof
US12423836B2 (en) * 2022-03-31 2025-09-23 Sony Group Corporation Camera-radar fusion using correspondences
US12271974B2 (en) * 2022-05-09 2025-04-08 Volvo Car Corporation Generation of bird's-eye-view images and segmentation maps
SE547500C2 (en) * 2022-06-03 2025-10-07 Tobii Ab Method of estimating a three-dimensional position of an object
KR102744214B1 (ko) * 2022-08-26 2024-12-20 포티투닷 주식회사 정지된 타겟의 위치를 획득하는 방법 및 장치
US12461228B1 (en) * 2022-08-29 2025-11-04 Amazon Technologies, Inc. Radar-inertial odometry for autonomous ground vehicles
CN115616516B (zh) * 2022-10-21 2023-11-10 中船鹏力(南京)大气海洋信息系统有限公司 一种基于雷达信息的船舶尺寸估计方法
CN116052091B (zh) * 2023-02-09 2026-01-02 曜科智能科技（上海）有限公司 车辆位姿估计方法、芯片、电子设备和计算机可读介质
US11989949B1 (en) 2023-03-31 2024-05-21 Geotab Inc. Systems for detecting vehicle following distance
US12162509B2 (en) 2023-03-31 2024-12-10 Geotab Inc. Systems for detecting vehicle following distance
US12456305B2 (en) 2023-03-31 2025-10-28 Geotab Inc. Systems and methods for identifying tailgating
US12423864B2 (en) 2023-03-31 2025-09-23 Geotab Inc. Systems for detecting vehicle following distance
EP4447001A1 (en) * 2023-03-31 2024-10-16 GEOTAB Inc. Systems and methods for detecting vehicle following distance
US12586230B2 (en) 2023-03-31 2026-03-24 Geotab Inc. Systems and methods for training a model for determining vehicle following distance
EP4451012A1 (en) * 2023-04-19 2024-10-23 Aptiv Technologies AG Method and system for estimating an object size using range sensor detections
US12591994B2 (en) * 2023-06-02 2026-03-31 Qualcomm Incorporated Using light and shadow in vision-aided precise positioning
US20240412534A1 (en) * 2023-06-06 2024-12-12 Qualcomm Incorporated Determining a road profile based on image data and point-cloud data
KR102728715B1 (ko) * 2023-07-24 2024-11-13 한국과학기술원 카메라와 레이다를 이용한 3차원 환경 인지 시스템 및 그 방법
US20250054284A1 (en) * 2023-08-08 2025-02-13 Qualcomm Incorporated Heatmap reduction for object detection
WO2025147248A1 (en) * 2024-01-04 2025-07-10 Canon Kabushiki Kaisha System and method for automatically estimating height of a user
EP4585969A1 (en) * 2024-01-11 2025-07-16 Aptiv Technologies AG Method for determining a contour of an object
US20250378569A1 (en) * 2024-06-10 2025-12-11 Qualcomm Incorporated Determining positions of objects based on images and ground-plane models
US20250384667A1 (en) * 2024-06-18 2025-12-18 Ford Global Technologies, Llc Machine learning system and method
US20260017816A1 (en) * 2024-07-10 2026-01-15 Here Global B.V. Method and system for detection of road objects using 2d image sign sightings
EP4707860A1 (en) 2024-09-10 2026-03-11 Novelic Doo Beograd - Zvezdara Inside cabin sensor system

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7103213B2 (en) * 2004-03-02 2006-09-05 Sarnoff Corporation Method and apparatus for classifying an object
JP2011113410A (ja) * 2009-11-27 2011-06-09 Toshiba Corp 幹線路合流情報提供システム
US9495602B2 (en) * 2013-10-23 2016-11-15 Toyota Motor Engineering & Manufacturing North America, Inc. Image and map-based detection of vehicles at intersections
CN110163904B (zh) * 2018-09-11 2022-04-22 腾讯大地通途（北京）科技有限公司 对象标注方法、移动控制方法、装置、设备及存储介质
US11630197B2 (en) * 2019-01-04 2023-04-18 Qualcomm Incorporated Determining a motion state of a target object
US11462112B2 (en) * 2019-03-07 2022-10-04 Nec Corporation Multi-task perception network with applications to scene understanding and advanced driver-assistance system

Also Published As

Publication number Publication date
EP4088134A1 (en) 2022-11-16
US11461915B2 (en) 2022-10-04
US20210209785A1 (en) 2021-07-08
WO2021142451A1 (en) 2021-07-15
BR112022012980A2 (pt) 2022-09-13
CN115244421A (zh) 2022-10-25
JP7677980B2 (ja) 2025-05-15
KR20220119396A (ko) 2022-08-29
PH12022551387A1 (en) 2023-05-03
JP2023529766A (ja) 2023-07-12

Similar Documents

Publication Publication Date Title
US11461915B2 (en) Object size estimation using camera map and/or radar information
KR102933653B1 (ko) 레이더 딥 러닝
US11482014B2 (en) 3D auto-labeling with structural and physical constraints
US11195028B2 (en) Real-time simultaneous detection of lane marker and raised pavement marker for optimal estimation of multiple lane boundaries
US12148169B2 (en) Three-dimensional target estimation using keypoints
CN116958934B (zh) 一种基于雷达和视觉融合的自动驾驶车辆的目标检测方法
Gwak et al. A review of intelligent self-driving vehicle software research
US12026954B2 (en) Static occupancy tracking
EP4120204A1 (en) Sensor fusion architecture for low-latency accurate road user detection
Mekala et al. Deep learning inspired object consolidation approaches using lidar data for autonomous driving: a review
US20250035448A1 (en) Localization of vectorized high definition (hd) map using predicted map information
Rossi et al. On the role of sensor fusion for object detection in future vehicular networks
Guptha M et al. [Retracted] Generative Adversarial Networks for Unmanned Aerial Vehicle Object Detection with Fusion Technology
US20250111639A1 (en) Method for detecting object and method for estimating distances of object in image and host and system thereof
US20240221386A1 (en) Occupancy tracking based on depth information
Swain et al. Machine Learning Algorithms for Autonomous Vehicles
CN115244421B (zh) 使用相机地图和/或雷达信息的对象尺寸估计
Ding Radar and camera fusion in intelligent transportation system
CN115131756A (zh) 一种目标检测方法及装置
WO2024197460A9 (en) Point map registration using semantic information
US20250095329A1 (en) Dynamic neural networks for temporal feature alignment in asynchronous multi-sensor fusion systems
US12354334B2 (en) Adaptive region-based object sampling for object detection
WO2022159331A1 (en) Static occupancy tracking
유인섭 Vision-based Distance Measurement and Localization for Automated Driving