JP6769010B2 - ステレオカメラの自己調整 - Google Patents

ステレオカメラの自己調整 Download PDF

Info

Publication number
JP6769010B2
JP6769010B2 JP2017534356A JP2017534356A JP6769010B2 JP 6769010 B2 JP6769010 B2 JP 6769010B2 JP 2017534356 A JP2017534356 A JP 2017534356A JP 2017534356 A JP2017534356 A JP 2017534356A JP 6769010 B2 JP6769010 B2 JP 6769010B2
Authority
JP
Japan
Prior art keywords
pan
parallax
image
value
values
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
JP2017534356A
Other languages
English (en)
Japanese (ja)
Other versions
JP2018508853A5 (enExample
JP2018508853A (ja
Inventor
ブーニュー，シルヴァン
Original Assignee
イムラ ウーロプ ソシエテ・パ・アクシオンス・シンプリフィエ
イムラ ウーロプ ソシエテ・パ・アクシオンス・シンプリフィエ
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by イムラ ウーロプ ソシエテ・パ・アクシオンス・シンプリフィエ, イムラ ウーロプ ソシエテ・パ・アクシオンス・シンプリフィエ filed Critical イムラ ウーロプ ソシエテ・パ・アクシオンス・シンプリフィエ
Publication of JP2018508853A publication Critical patent/JP2018508853A/ja
Publication of JP2018508853A5 publication Critical patent/JP2018508853A5/ja
Application granted granted Critical
Publication of JP6769010B2 publication Critical patent/JP6769010B2/ja
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20—Image signal generators
    • H04N13/204—Image signal generators using stereoscopic image cameras
    • H04N13/246—Calibration of cameras
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/60—Analysis of geometric attributes
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/70—Determining position or orientation of objects or cameras
    • G06T7/73—Determining position or orientation of objects or cameras using feature-based methods
    • G06T7/74—Determining position or orientation of objects or cameras using feature-based methods involving reference images or patches
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/80—Analysis of captured images to determine intrinsic or extrinsic camera parameters, i.e. camera calibration
    • G06T7/85—Stereo camera calibration
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20—Image signal generators
    • H04N13/204—Image signal generators using stereoscopic image cameras
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20—Image signal generators
    • H04N13/204—Image signal generators using stereoscopic image cameras
    • H04N13/239—Image signal generators using stereoscopic image cameras using two two-dimensional [2D] image sensors having a relative position equal to or related to the interocular distance
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20—Image signal generators
    • H04N13/296—Synchronisation thereof; Control thereof
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R2300/00—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
    • B60R2300/10—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of camera system used
    • B60R2300/107—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of camera system used using stereoscopic cameras
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R2300/00—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
    • B60R2300/30—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of image processing
    • B60R2300/303—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of image processing using joined images, e.g. multiple camera images
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10004—Still image; Photographic image
    • G06T2207/10012—Stereo images
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20021—Dividing image into blocks, subimages or windows
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20072—Graph-based image processing
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30248—Vehicle exterior or interior
    • G06T2207/30252—Vehicle exterior; Vicinity of vehicle
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N2013/0074—Stereoscopic image analysis
    • H04N2013/0081—Depth or disparity estimation from stereoscopic image signals

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Geometry (AREA)
  • Image Analysis (AREA)
  • Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)
  • Studio Devices (AREA)
  • Image Processing (AREA)
  • Length Measuring Devices By Optical Means (AREA)
  • Measurement Of Optical Distance (AREA)
JP2017534356A 2015-01-16 2016-01-18 ステレオカメラの自己調整 Expired - Fee Related JP6769010B2 (ja)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
DE102015000250.3 2015-01-16
DE102015000250 2015-01-16
PCT/EP2016/050916 WO2016113429A2 (en) 2015-01-16 2016-01-18 Self-rectification of stereo camera

Publications (3)

Publication Number Publication Date
JP2018508853A JP2018508853A (ja) 2018-03-29
JP2018508853A5 JP2018508853A5 (enExample) 2019-01-31
JP6769010B2 true JP6769010B2 (ja) 2020-10-14

Family

ID=55177942

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2017534356A Expired - Fee Related JP6769010B2 (ja) 2015-01-16 2016-01-18 ステレオカメラの自己調整

Country Status (4)

Country Link
US (1) US20180007345A1 (enExample)
JP (1) JP6769010B2 (enExample)
DE (1) DE112016000356T5 (enExample)
WO (1) WO2016113429A2 (enExample)

Families Citing this family (18)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR101803164B1 (ko) 2013-03-15 2017-12-28 우버 테크놀로지스, 인크. 로봇 공학용 다중 감지 스테레오 비전 방법, 시스템 및 장치
US10077007B2 (en) * 2016-03-14 2018-09-18 Uber Technologies, Inc. Sidepod stereo camera system for an autonomous vehicle
US20170359561A1 (en) * 2016-06-08 2017-12-14 Uber Technologies, Inc. Disparity mapping for an autonomous vehicle
DE112018002048T5 (de) * 2017-04-17 2020-02-20 Cognex Corp. Hochgenaues kalibriersystem und kalibrierverfahren
US11568568B1 (en) * 2017-10-31 2023-01-31 Edge 3 Technologies Calibration for multi-camera and multisensory systems
US10967862B2 (en) 2017-11-07 2021-04-06 Uatc, Llc Road anomaly detection for autonomous vehicle
CN111343360B (zh) * 2018-12-17 2022-05-17 杭州海康威视数字技术股份有限公司 一种校正参数获得方法
CN109520480B (zh) * 2019-01-22 2021-04-30 合刃科技（深圳）有限公司 基于双目立体视觉的测距方法及测距系统
US11427193B2 (en) 2020-01-22 2022-08-30 Nodar Inc. Methods and systems for providing depth maps with confidence estimates
EP4094433B1 (en) * 2020-01-22 2026-04-29 Nodar Inc. Non-rigid stereo vision camera system
CN111743510B (zh) * 2020-06-24 2023-09-19 中国科学院光电技术研究所 一种基于聚类的人眼哈特曼光斑图像去噪方法
WO2022163216A1 (ja) * 2021-01-27 2022-08-04 ソニーグループ株式会社 移動体、情報処理方法およびプログラム
CN112991464B (zh) * 2021-03-19 2023-04-07 山东大学 基于立体视觉的三维重建的点云误差补偿方法及系统
WO2022219862A1 (ja) * 2021-04-15 2022-10-20 ソニーグループ株式会社 情報処理装置、情報処理方法およびプログラム
WO2023059365A1 (en) 2021-10-08 2023-04-13 Nodar Inc. Real-time perception system for small objects at long range for autonomous vehicles
CN114897997B (zh) * 2022-07-13 2022-10-25 星猿哲科技(深圳)有限公司 相机标定方法、装置、设备及存储介质
US12277732B2 (en) * 2022-12-28 2025-04-15 Apollo Autonomous Driving USA LLC Video camera calibration refinement for autonomous driving vehicles
US20260179258A1 (en) * 2024-12-20 2026-06-25 Eaigle Inc. System and Method for Automated Camera Parameters

Family Cites Families (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP3617709B2 (ja) * 1995-11-10 2005-02-09 株式会社日本自動車部品総合研究所 距離計測装置
DE602007012688D1 (de) 2007-08-10 2011-04-07 Honda Res Inst Europe Gmbh Online-Kalibrierung von Stereokamerasystemen mit Feinvergenzbewegungen
JP2009048516A (ja) * 2007-08-22 2009-03-05 Sony Corp 情報処理装置、および情報処理方法、並びにコンピュータ・プログラム
DE102008008619A1 (de) 2008-02-12 2008-07-31 Daimler Ag Verfahren zur Kalibrierung eines Stereokamerasystems
US8120644B2 (en) * 2009-02-17 2012-02-21 Autoliv Asp, Inc. Method and system for the dynamic calibration of stereovision cameras
JP5440461B2 (ja) * 2010-09-13 2014-03-12 株式会社リコー 校正装置、距離計測システム、校正方法および校正プログラム
US20120242806A1 (en) 2011-03-23 2012-09-27 Tk Holdings Inc. Dynamic stereo camera calibration system and method
US9191649B2 (en) * 2011-08-12 2015-11-17 Qualcomm Incorporated Systems and methods to capture a stereoscopic image pair
EP3869797B1 (en) * 2012-08-21 2023-07-19 Adeia Imaging LLC Method for depth detection in images captured using array cameras
US9519968B2 (en) * 2012-12-13 2016-12-13 Hewlett-Packard Development Company, L.P. Calibrating visual sensors using homography operators
EP3175200A4 (en) * 2014-07-31 2018-04-04 Hewlett-Packard Development Company, L.P. Three dimensional scanning system and framework
WO2016154123A2 (en) * 2015-03-21 2016-09-29 Mine One Gmbh Virtual 3d methods, systems and software
US10554956B2 (en) * 2015-10-29 2020-02-04 Dell Products, Lp Depth masks for image segmentation for depth-based computational photography
DE102016201741A1 (de) * 2016-02-04 2017-08-10 Hella Kgaa Hueck & Co. Verfahren zur Höhenerkennung

Also Published As

Publication number Publication date
US20180007345A1 (en) 2018-01-04
WO2016113429A3 (en) 2016-09-09
WO2016113429A2 (en) 2016-07-21
DE112016000356T5 (de) 2018-01-11
WO2016113429A4 (en) 2017-04-20
JP2018508853A (ja) 2018-03-29

Similar Documents

Publication Publication Date Title
US20180007345A1 (en) Self-rectification of stereo camera
US12106522B2 (en) System and method for camera calibration using an epipolar constraint
US10097812B2 (en) Stereo auto-calibration from structure-from-motion
CA3206206A1 (en) Device and method for correspondence analysis in images
CN111971956B (zh) 用于动态立体校准的方法及系统
KR20230003803A (ko) 라이다 좌표계와 카메라 좌표계의 벡터 정합을 통한 자동 캘리브레이션 방법
Ricolfe-Viala et al. Correcting non-linear lens distortion in cameras without using a model
CN119048600A (zh) 深度相机融合激光雷达的三维稠密点云建图方法及系统
CN112262411A (zh) 图像关联方法、系统和装置
EP3633606A1 (en) Information processing device, information processing method, and program
JP2019139420A (ja) 立体物認識装置、撮像装置および車両
CN112712566A (zh) 基于结构参数在线校正的双目立体视觉传感器测量方法
JPWO2020095549A1 (ja) 撮像装置
Xu et al. Selective Kalman filter: When and how to fuse multi-sensor information to overcome degeneracy in SLAM
CN119850682A (zh) 基于激光雷达和摄像头融合感知的轨迹追踪方法及系统
CN122062594A (zh) 基于激光三角测距的实时高速三维点云生成方法及系统
Blaschitz et al. Geometric calibration and image rectification of a multi-line scan camera for accurate 3D reconstruction
Miksch et al. Automatic extrinsic camera self-calibration based on homography and epipolar geometry
WO2022128463A1 (en) Method for rectification of images and/or image points, camera-based system and vehicle
Li et al. An adaptive plug-and-play online extrinsic calibration approach for LiDAR-camera fusion
CN114462622B (zh) 一种用于众包数据的深度学习模型部署与训练方法
KR101047150B1 (ko) 레이저스캐너와 비디오카메라간 물리적 편의 보정장치 및 방법과, 물리적편의보정치 측정장치 및 방법
Knorr et al. Robust ground plane induced homography estimation for wide angle fisheye cameras
Zhang et al. Spatiotemporal alignment in hybrid vision systems: unifying event cameras and frame-based cameras
Ahouandjinou et al. An approach to correcting image distortion by self calibration stereoscopic scene from multiple views

Legal Events

Date Code Title Description
A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20181214

A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20181214

A977 Report on retrieval

Free format text: JAPANESE INTERMEDIATE CODE: A971007

Effective date: 20191211

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20200107

A601 Written request for extension of time

Free format text: JAPANESE INTERMEDIATE CODE: A601

Effective date: 20200402

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20200603

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20200623

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20200806

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20200825

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20200903

R150 Certificate of patent or registration of utility model

Ref document number: 6769010

Country of ref document: JP

Free format text: JAPANESE INTERMEDIATE CODE: R150

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

LAPS Cancellation because of no payment of annual fees