JP2025519690A - さまざまなセンサ・モダリティ、たとえば、カメラ、レーダー、およびライダー・センサの自動的な外部較正および較正検証 - Google Patents

さまざまなセンサ・モダリティ、たとえば、カメラ、レーダー、およびライダー・センサの自動的な外部較正および較正検証 Download PDF

Info

Publication number
JP2025519690A
JP2025519690A JP2024573556A JP2024573556A JP2025519690A JP 2025519690 A JP2025519690 A JP 2025519690A JP 2024573556 A JP2024573556 A JP 2024573556A JP 2024573556 A JP2024573556 A JP 2024573556A JP 2025519690 A JP2025519690 A JP 2025519690A
Authority
JP
Japan
Prior art keywords
sensor
calibration
data
sensors
parameters
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
JP2024573556A
Other languages
English (en)
Japanese (ja)
Other versions
JP2025519690A5 (cg-RX-API-DMAC7.html
Inventor
タマース、ジロス
マーチャーシュ、レーラーント－ニェシュテ
ペーテル、ダーニエル、コズマ
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
aiMotive Kft
Original Assignee
aiMotive Kft
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by aiMotive Kft filed Critical aiMotive Kft
Publication of JP2025519690A publication Critical patent/JP2025519690A/ja
Publication of JP2025519690A5 publication Critical patent/JP2025519690A5/ja
Pending legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S7/00—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00
    • G01S7/02—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S13/00
    • G01S7/40—Means for monitoring or calibrating
    • G01S7/4004—Means for monitoring or calibrating of parts of a radar system
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/80—Analysis of captured images to determine intrinsic or extrinsic camera parameters, i.e. camera calibration
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S13/00—Systems using the reflection or reradiation of radio waves, e.g. radar systems; Analogous systems using reflection or reradiation of waves whose nature or wavelength is irrelevant or unspecified
    • G01S13/86—Combinations of radar systems with non-radar systems, e.g. sonar, direction finder
    • G01S13/865—Combination of radar systems with lidar systems
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S13/00—Systems using the reflection or reradiation of radio waves, e.g. radar systems; Analogous systems using reflection or reradiation of waves whose nature or wavelength is irrelevant or unspecified
    • G01S13/86—Combinations of radar systems with non-radar systems, e.g. sonar, direction finder
    • G01S13/867—Combination of radar systems with cameras
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S13/00—Systems using the reflection or reradiation of radio waves, e.g. radar systems; Analogous systems using reflection or reradiation of waves whose nature or wavelength is irrelevant or unspecified
    • G01S13/88—Radar or analogous systems specially adapted for specific applications
    • G01S13/93—Radar or analogous systems specially adapted for specific applications for anti-collision purposes
    • G01S13/931—Radar or analogous systems specially adapted for specific applications for anti-collision purposes of land vehicles
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S17/00—Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
    • G01S17/87—Combinations of systems using electromagnetic waves other than radio waves
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S19/00—Satellite radio beacon positioning systems; Determining position, velocity or attitude using signals transmitted by such systems
    • G01S19/01—Satellite radio beacon positioning systems transmitting time-stamped messages, e.g. GPS [Global Positioning System], GLONASS [Global Orbiting Navigation Satellite System] or GALILEO
    • G01S19/13—Receivers
    • G01S19/23—Testing, monitoring, correcting or calibrating of receiver elements
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S7/00—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00
    • G01S7/48—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S17/00
    • G01S7/497—Means for monitoring or calibrating
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/70—Determining position or orientation of objects or cameras
    • G06T7/73—Determining position or orientation of objects or cameras using feature-based methods
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/80—Analysis of captured images to determine intrinsic or extrinsic camera parameters, i.e. camera calibration
    • G06T7/85—Stereo camera calibration
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W2420/00—Indexing codes relating to the type of sensors based on the principle of their operation
    • B60W2420/40—Photo, light or radio wave sensitive means, e.g. infrared sensors
    • B60W2420/403—Image sensing, e.g. optical camera
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W2420/00—Indexing codes relating to the type of sensors based on the principle of their operation
    • B60W2420/40—Photo, light or radio wave sensitive means, e.g. infrared sensors
    • B60W2420/408—Radar; Laser, e.g. lidar
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10004—Still image; Photographic image
    • G06T2207/10012—Stereo images
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10028—Range image; Depth image; 3D point clouds
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30248—Vehicle exterior or interior
    • G06T2207/30252—Vehicle exterior; Vicinity of vehicle
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30248—Vehicle exterior or interior
    • G06T2207/30252—Vehicle exterior; Vicinity of vehicle
    • G06T2207/30261—Obstacle

Landscapes

  • Engineering & Computer Science (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Remote Sensing (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Theoretical Computer Science (AREA)
  • Electromagnetism (AREA)
  • Length Measuring Devices By Optical Means (AREA)
  • Image Analysis (AREA)
JP2024573556A 2022-06-22 2023-05-11 さまざまなセンサ・モダリティ、たとえば、カメラ、レーダー、およびライダー・センサの自動的な外部較正および較正検証 Pending JP2025519690A (ja)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
EP22180544.3A EP4296711A1 (en) 2022-06-22 2022-06-22 Automatic extrinsic calibration and calibration validation of different sensor modalities, e.g camera, radar and lidar sensors
EP22180544.3 2022-06-22
PCT/EP2023/062655 WO2023247109A1 (en) 2022-06-22 2023-05-11 Automatic extrinsic calibration and calibration validation of different sensor modalities, e.g camera, radar and lidar sensors

Publications (2)

Publication Number Publication Date
JP2025519690A true JP2025519690A (ja) 2025-06-26
JP2025519690A5 JP2025519690A5 (cg-RX-API-DMAC7.html) 2026-04-28

Family

ID=82214435

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2024573556A Pending JP2025519690A (ja) 2022-06-22 2023-05-11 さまざまなセンサ・モダリティ、たとえば、カメラ、レーダー、およびライダー・センサの自動的な外部較正および較正検証

Country Status (6)

Country Link
US (1) US20250363666A1 (cg-RX-API-DMAC7.html)
EP (1) EP4296711A1 (cg-RX-API-DMAC7.html)
JP (1) JP2025519690A (cg-RX-API-DMAC7.html)
KR (1) KR20250028355A (cg-RX-API-DMAC7.html)
CN (1) CN119365790A (cg-RX-API-DMAC7.html)
WO (1) WO2023247109A1 (cg-RX-API-DMAC7.html)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20250117029A1 (en) * 2023-10-04 2025-04-10 Nec Laboratories America, Inc. Automatic multi-modality sensor calibration with near-infrared images
CN121686377A (zh) * 2025-11-28 2026-03-17 中移(上海)信息通信科技有限公司 感知目标融合方法、装置及设备

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11208117B2 (en) * 2019-07-09 2021-12-28 Refraction Ai, Inc. Method and system for autonomous vehicle control

Also Published As

Publication number Publication date
KR20250028355A (ko) 2025-02-28
CN119365790A (zh) 2025-01-24
US20250363666A1 (en) 2025-11-27
WO2023247109A1 (en) 2023-12-28
EP4296711A1 (en) 2023-12-27

Similar Documents

Publication Publication Date Title
US11731649B2 (en) High precision position estimation method through road shape classification-based map matching and autonomous vehicle thereof
CN115797454B (zh) 一种鸟瞰图视角下多摄像机融合感知方法及装置
JP7077910B2 (ja) 区画線検出装置及び区画線検出方法
LU502288B1 (en) Method and system for detecting position relation between vehicle and lane line, and storage medium
CN118244281B (zh) 一种视觉与雷达融合的目标定位方法及装置
WO2019175286A1 (en) Image annotation
JP6779365B2 (ja) 物体検出装置及び車両
RU2764708C1 (ru) Способы и системы для обработки данных лидарных датчиков
CN107577996A (zh) 一种车辆驾驶路径偏移的识别方法及系统
US11132530B2 (en) Method for three-dimensional graphic reconstruction of a vehicle
CN114549632B (zh) 车辆定位方法及装置
CN113393524B (zh) 一种结合深度学习和轮廓点云重建的目标位姿估计方法
JP6552448B2 (ja) 車両位置検出装置、車両位置検出方法及び車両位置検出用コンピュータプログラム
US20210326613A1 (en) Vehicle detection method and device
CN114972494B (zh) 一种记忆泊车场景的地图构建方法及装置
KR102003387B1 (ko) 조감도 이미지를 이용한 교통 장애물의 검출 및 거리 측정 방법, 교통 장애물을 검출하고 거리를 측정하는 프로그램을 저장한 컴퓨터 판독가능 기록매체
US20250363666A1 (en) Automatic extrinsic calibration and calibration validation of different sensor modalities, e.g camera, radar and lidar sensors
JP6396499B2 (ja) 三次元情報の規模測定
CN121099183B (zh) 摄像头参数的调整方法及装置、车辆、介质和程序产品
WO2022133986A1 (en) Accuracy estimation method and system
GB2624483A (en) Image processing method and method for predicting collisions
JP6186072B2 (ja) 単一カメラを用いた３ｄでの移動物体の位置測定
CN113345035B (zh) 一种基于双目相机的坡度即时预测方法、系统及计算机可读存储介质
KR20240030098A (ko) 차량 및 차량의 제어 방법
CN115690711B (zh) 一种目标检测方法、装置及智能车辆

Legal Events

Date Code Title Description
A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20260420

A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20260420