PH12022551387A1 - Object size estimation using camera map and/or radar information - Google Patents

Object size estimation using camera map and/or radar information

Info

Publication number
PH12022551387A1
PH12022551387A1 PH1/2022/551387A PH12022551387A PH12022551387A1 PH 12022551387 A1 PH12022551387 A1 PH 12022551387A1 PH 12022551387 A PH12022551387 A PH 12022551387A PH 12022551387 A1 PH12022551387 A1 PH 12022551387A1
Authority
PH
Philippines
Prior art keywords
map
radar information
object size
estimated
information
Prior art date
Application number
PH1/2022/551387A
Other languages
English (en)
Inventor
Shivam Agarwal
Avdhut Joshi
Urs Niesen
Gautam Sachdeva
Amir Salimi
Jayakrishnan Unnikrishnan
Sree Sesha Aravind Vadrevu
Nadaraajan Yoga Y
Original Assignee
Qualcomm Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Qualcomm Inc filed Critical Qualcomm Inc
Publication of PH12022551387A1 publication Critical patent/PH12022551387A1/en

Links

Classifications

    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S7/00—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00
    • G01S7/02—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S13/00
    • G01S7/41—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S13/00 using analysis of echo signal for target characterisation; Target signature; Target cross-section
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S13/00—Systems using the reflection or reradiation of radio waves, e.g. radar systems; Analogous systems using reflection or reradiation of waves whose nature or wavelength is irrelevant or unspecified
    • G01S13/02—Systems using reflection of radio waves, e.g. primary radar systems; Analogous systems
    • G01S13/06—Systems determining position data of a target
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S13/00—Systems using the reflection or reradiation of radio waves, e.g. radar systems; Analogous systems using reflection or reradiation of waves whose nature or wavelength is irrelevant or unspecified
    • G01S13/86—Combinations of radar systems with non-radar systems, e.g. sonar, direction finder
    • G01S13/867—Combination of radar systems with cameras
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S13/00—Systems using the reflection or reradiation of radio waves, e.g. radar systems; Analogous systems using reflection or reradiation of waves whose nature or wavelength is irrelevant or unspecified
    • G01S13/88—Radar or analogous systems specially adapted for specific applications
    • G01S13/89—Radar or analogous systems specially adapted for specific applications for mapping or imaging
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S13/00—Systems using the reflection or reradiation of radio waves, e.g. radar systems; Analogous systems using reflection or reradiation of waves whose nature or wavelength is irrelevant or unspecified
    • G01S13/88—Radar or analogous systems specially adapted for specific applications
    • G01S13/93—Radar or analogous systems specially adapted for specific applications for anti-collision purposes
    • G01S13/931—Radar or analogous systems specially adapted for specific applications for anti-collision purposes of land vehicles
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/60—Analysis of geometric attributes
    • G06T7/62—Analysis of geometric attributes of area, perimeter, diameter or volume
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/70—Determining position or orientation of objects or cameras
    • G06T7/73—Determining position or orientation of objects or cameras using feature-based methods
    • G06T7/75—Determining position or orientation of objects or cameras using feature-based methods involving models
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/764—Arrangements for image or video recognition or understanding using pattern recognition or machine learning using classification, e.g. of video objects
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/82—Arrangements for image or video recognition or understanding using pattern recognition or machine learning using neural networks
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/50—Context or environment of the image
    • G06V20/56—Context or environment of the image exterior to a vehicle by using sensors mounted on the vehicle
    • G06V20/58—Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10016—Video; Image sequence
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10028—Range image; Depth image; 3D point clouds
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20081—Training; Learning
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20084—Artificial neural networks [ANN]
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30248—Vehicle exterior or interior
    • G06T2207/30252—Vehicle exterior; Vicinity of vehicle
    • G06T2207/30256—Lane; Road marking
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30248—Vehicle exterior or interior
    • G06T2207/30252—Vehicle exterior; Vicinity of vehicle
    • G06T2207/30261—Obstacle
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/60—Type of objects
    • G06V20/64—Three-dimensional [3D] objects

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Remote Sensing (AREA)
  • Radar, Positioning & Navigation (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Multimedia (AREA)
  • Evolutionary Computation (AREA)
  • Databases & Information Systems (AREA)
  • General Health & Medical Sciences (AREA)
  • Medical Informatics (AREA)
  • Software Systems (AREA)
  • Computing Systems (AREA)
  • Artificial Intelligence (AREA)
  • Health & Medical Sciences (AREA)
  • Electromagnetism (AREA)
  • Geometry (AREA)
  • Image Analysis (AREA)
  • Traffic Control Systems (AREA)
  • Radar Systems Or Details Thereof (AREA)
PH1/2022/551387A 2020-01-06 2021-01-11 Object size estimation using camera map and/or radar information PH12022551387A1 (en)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US202062957638P 2020-01-06 2020-01-06
US17/142,199 US11461915B2 (en) 2020-01-06 2021-01-05 Object size estimation using camera map and/or radar information
PCT/US2021/012984 WO2021142451A1 (en) 2020-01-06 2021-01-11 Object size estimation using camera map and/or radar information

Publications (1)

Publication Number Publication Date
PH12022551387A1 true PH12022551387A1 (en) 2023-05-03

Family

ID=76655496

Family Applications (1)

Application Number Title Priority Date Filing Date
PH1/2022/551387A PH12022551387A1 (en) 2020-01-06 2021-01-11 Object size estimation using camera map and/or radar information

Country Status (8)

Country Link
US (1) US11461915B2 (https=)
EP (1) EP4088134A1 (https=)
JP (1) JP7677980B2 (https=)
KR (1) KR20220119396A (https=)
BR (1) BR112022012980A2 (https=)
PH (1) PH12022551387A1 (https=)
TW (1) TW202244529A (https=)
WO (1) WO2021142451A1 (https=)

Families Citing this family (50)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2019094863A1 (en) 2017-11-13 2019-05-16 Smart Ag, Inc. Safety system for autonomous operation of off-road and agricultural vehicles using machine learning for detection and identification of obstacles
EP3663978B1 (en) * 2018-12-07 2025-03-12 Thinkware Corporation Method and device for detecting a vehicle
WO2020134750A1 (zh) * 2018-12-28 2020-07-02 杭州大拿科技股份有限公司 一种答案批改方法及装置
JP7164049B2 (ja) * 2019-07-11 2022-11-01 日本電気株式会社 物体検知装置、学習方法、及び、プログラム
KR20210017525A (ko) * 2019-08-08 2021-02-17 삼성전자주식회사 거리 추정 장치 및 이의 동작 방법
US12001958B2 (en) * 2020-03-19 2024-06-04 Nvidia Corporation Future trajectory predictions in multi-actor environments for autonomous machine
CA3177161A1 (en) * 2020-04-28 2021-11-04 Rahul RAMAKRISHNAN Object detection and tracking for automated operation of vehicles and machinery
CN113591872B (zh) * 2020-04-30 2025-01-14 华为技术有限公司 一种数据处理系统、物体检测方法及其装置
DE102020121061A1 (de) * 2020-08-11 2022-02-17 Valeo Schalter Und Sensoren Gmbh Verfahren zum Betreiben eines Assistenzsystems zur Bestimmung einer Länge eines Objekts, Computerprogrammprodukt, computerlesbares Speichermedium sowie Assistenzsystem
US11987236B2 (en) * 2020-08-31 2024-05-21 Nec Corporation Monocular 3D object localization from temporal aggregation
US11731662B2 (en) 2020-10-08 2023-08-22 Ford Global Technologies, Llc Autonomous vehicle system for detecting pedestrian presence
US11361201B2 (en) * 2020-10-08 2022-06-14 Argo AI, LLC Systems and methods for determining an object type and an attribute for an observation based on fused sensor data
WO2022093252A1 (en) * 2020-10-30 2022-05-05 Google Llc Non-occluding video overlays
DE102021104015A1 (de) * 2021-02-19 2022-08-25 Bayerische Motoren Werke Aktiengesellschaft Verfahren zum Erfassen von Objekten in einer Umgebung eines Fahrzeugs mit Bestimmung einer Verdeckung der Objekte, Recheneinrichtung sowie Sensorsystem
JP7572920B2 (ja) * 2021-07-21 2024-10-24 京セラ株式会社 電子機器、電子機器の制御方法、及びプログラム
CN113591668B (zh) * 2021-07-26 2023-11-21 南京大学 一种使用深度学习和空间分析的广域未知大坝自动探测方法
US11948381B2 (en) * 2021-08-20 2024-04-02 Motional Ad Llc Determining object mobility parameters using an object sequence
KR20230044113A (ko) * 2021-09-22 2023-04-03 센스타임 인터내셔널 피티이. 리미티드. 물품 식별 방법, 장치, 기기 및 컴퓨터 판독 가능 저장 매체
CN113778130B (zh) * 2021-09-24 2022-04-15 南京航空航天大学 一种基于三维模型的无人机覆盖路径规划方法
US12260562B2 (en) 2021-10-19 2025-03-25 Stoneridge, Inc. Trailer end tracking in a camera monitoring system
US12197208B2 (en) * 2021-11-01 2025-01-14 Ford Global Technologies, Llc Camera calibration
CN118284906A (zh) * 2021-12-16 2024-07-02 古野电气株式会社 目标监测装置、目标监测方法以及程序
US12033346B2 (en) * 2022-02-01 2024-07-09 Zoox, Inc. Distance representation and encoding
US12374096B2 (en) * 2022-03-04 2025-07-29 Sony Group Corporation Teaching student network for end-to-end semi-supervised object detection
WO2023171672A1 (ja) * 2022-03-08 2023-09-14 パイオニア株式会社 情報処理装置、制御方法、プログラム及び記憶媒体
US12309341B2 (en) 2022-03-18 2025-05-20 Htc Corporation Wearable device and control method thereof
US12423836B2 (en) * 2022-03-31 2025-09-23 Sony Group Corporation Camera-radar fusion using correspondences
US12271974B2 (en) * 2022-05-09 2025-04-08 Volvo Car Corporation Generation of bird's-eye-view images and segmentation maps
SE547500C2 (en) * 2022-06-03 2025-10-07 Tobii Ab Method of estimating a three-dimensional position of an object
KR102744214B1 (ko) * 2022-08-26 2024-12-20 포티투닷 주식회사 정지된 타겟의 위치를 획득하는 방법 및 장치
US12461228B1 (en) * 2022-08-29 2025-11-04 Amazon Technologies, Inc. Radar-inertial odometry for autonomous ground vehicles
CN115616516B (zh) * 2022-10-21 2023-11-10 中船鹏力(南京)大气海洋信息系统有限公司 一种基于雷达信息的船舶尺寸估计方法
CN116052091B (zh) * 2023-02-09 2026-01-02 曜科智能科技（上海）有限公司 车辆位姿估计方法、芯片、电子设备和计算机可读介质
US11989949B1 (en) 2023-03-31 2024-05-21 Geotab Inc. Systems for detecting vehicle following distance
US12162509B2 (en) 2023-03-31 2024-12-10 Geotab Inc. Systems for detecting vehicle following distance
US12456305B2 (en) 2023-03-31 2025-10-28 Geotab Inc. Systems and methods for identifying tailgating
US12423864B2 (en) 2023-03-31 2025-09-23 Geotab Inc. Systems for detecting vehicle following distance
EP4447001A1 (en) * 2023-03-31 2024-10-16 GEOTAB Inc. Systems and methods for detecting vehicle following distance
US12586230B2 (en) 2023-03-31 2026-03-24 Geotab Inc. Systems and methods for training a model for determining vehicle following distance
EP4451012A1 (en) * 2023-04-19 2024-10-23 Aptiv Technologies AG Method and system for estimating an object size using range sensor detections
US12591994B2 (en) * 2023-06-02 2026-03-31 Qualcomm Incorporated Using light and shadow in vision-aided precise positioning
US20240412534A1 (en) * 2023-06-06 2024-12-12 Qualcomm Incorporated Determining a road profile based on image data and point-cloud data
KR102728715B1 (ko) * 2023-07-24 2024-11-13 한국과학기술원 카메라와 레이다를 이용한 3차원 환경 인지 시스템 및 그 방법
US20250054284A1 (en) * 2023-08-08 2025-02-13 Qualcomm Incorporated Heatmap reduction for object detection
WO2025147248A1 (en) * 2024-01-04 2025-07-10 Canon Kabushiki Kaisha System and method for automatically estimating height of a user
EP4585969A1 (en) * 2024-01-11 2025-07-16 Aptiv Technologies AG Method for determining a contour of an object
US20250378569A1 (en) * 2024-06-10 2025-12-11 Qualcomm Incorporated Determining positions of objects based on images and ground-plane models
US20250384667A1 (en) * 2024-06-18 2025-12-18 Ford Global Technologies, Llc Machine learning system and method
US20260017816A1 (en) * 2024-07-10 2026-01-15 Here Global B.V. Method and system for detection of road objects using 2d image sign sightings
EP4707860A1 (en) 2024-09-10 2026-03-11 Novelic Doo Beograd - Zvezdara Inside cabin sensor system

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7103213B2 (en) * 2004-03-02 2006-09-05 Sarnoff Corporation Method and apparatus for classifying an object
JP2011113410A (ja) * 2009-11-27 2011-06-09 Toshiba Corp 幹線路合流情報提供システム
US9495602B2 (en) * 2013-10-23 2016-11-15 Toyota Motor Engineering & Manufacturing North America, Inc. Image and map-based detection of vehicles at intersections
CN110163904B (zh) * 2018-09-11 2022-04-22 腾讯大地通途（北京）科技有限公司 对象标注方法、移动控制方法、装置、设备及存储介质
US11630197B2 (en) * 2019-01-04 2023-04-18 Qualcomm Incorporated Determining a motion state of a target object
US11462112B2 (en) * 2019-03-07 2022-10-04 Nec Corporation Multi-task perception network with applications to scene understanding and advanced driver-assistance system

Also Published As

Publication number Publication date
EP4088134A1 (en) 2022-11-16
US11461915B2 (en) 2022-10-04
US20210209785A1 (en) 2021-07-08
TW202244529A (zh) 2022-11-16
WO2021142451A1 (en) 2021-07-15
BR112022012980A2 (pt) 2022-09-13
CN115244421A (zh) 2022-10-25
JP7677980B2 (ja) 2025-05-15
KR20220119396A (ko) 2022-08-29
JP2023529766A (ja) 2023-07-12

Similar Documents

Publication Publication Date Title
PH12022551387A1 (en) Object size estimation using camera map and/or radar information
WO2019108579A3 (en) Radar aided visual inertial odometry initialization
EP2937815A3 (en) Methods and systems for object detection using laser point clouds
MX2021009911A (es) Procesamiento de imagenes multicamara.
WO2020056431A8 (en) System and method for three-dimensional (3d) object detection
EP2874395A3 (en) Method, apparatus and computer program product for disparity estimation
US20140343842A1 (en) Localization using road markings
US20100284572A1 (en) Systems and methods for extracting planar features, matching the planar features, and estimating motion from the planar features
MX373029B (es) Metodo para la reconstruccion en 3d de un ambiente de un dispositivo movil, que corresponde a un producto de programa de computadora y dispositivo.
GB2598244A (en) Systems and methods for automated detection of changes in extent of structures using imagery
US9898669B2 (en) Traveling road surface detection device and traveling road surface detection method
JP2016507793A5 (https=)
BR112018069528A2 (pt) método e sistema para analisar uma imagem.
WO2018045241A3 (en) DETECTION OF ANOMALIES IN MULTIVARIATED DATA
WO2014200589A3 (en) Determining positional information for an object in space
TR201910988T4 (tr) Bir video görüntüsü ile ilişkili bir audio sinyalini işlemden geçirmek için yöntem ve cihaz
MX2020006848A (es) Etiquetado de entorno urbano.
EP2372641A3 (en) Surface detection in images based on spatial data
CN104574366A (zh) 一种基于单目深度图的视觉显著性区域的提取方法
EP3166084A3 (en) Method and system for determining a configuration of a virtual robot in a virtual environment
EP2669846A3 (en) Target recognition system and target recognition method executed by the target recognition system, target recognition program executed on the target recognition system, and recording medium storing the target recognition program
EP2393076A3 (en) Navigable topological maps
MX2017014704A (es) Vision del vehiculo.
PH12021551561A1 (en) Methods, apparatuses, devices and storage medium for predicting correlation between objects
MX371231B (es) Identificación y rastreo de vehículos en movimiento.