JP6995188B2 - 車載カメラの姿勢推定方法、装置およびシステムならびに電子機器 - Google Patents

車載カメラの姿勢推定方法、装置およびシステムならびに電子機器 Download PDF

Info

Publication number
JP6995188B2
JP6995188B2 JP2020510614A JP2020510614A JP6995188B2 JP 6995188 B2 JP6995188 B2 JP 6995188B2 JP 2020510614 A JP2020510614 A JP 2020510614A JP 2020510614 A JP2020510614 A JP 2020510614A JP 6995188 B2 JP6995188 B2 JP 6995188B2
Authority
JP
Japan
Prior art keywords
vehicle
information
camera
horizon
mounted camera
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
JP2020510614A
Other languages
English (en)
Japanese (ja)
Other versions
JP2020533667A5 (enExample
JP2020533667A (ja
Inventor
戴▲興▼
王哲
石建萍
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Sensetime Technology Development Co Ltd
Original Assignee
Beijing Sensetime Technology Development Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Sensetime Technology Development Co Ltd filed Critical Beijing Sensetime Technology Development Co Ltd
Publication of JP2020533667A publication Critical patent/JP2020533667A/ja
Publication of JP2020533667A5 publication Critical patent/JP2020533667A5/ja
Application granted granted Critical
Publication of JP6995188B2 publication Critical patent/JP6995188B2/ja
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/70—Determining position or orientation of objects or cameras
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N17/00—Diagnosis, testing or measuring for television systems or their details
    • H04N17/002—Diagnosis, testing or measuring for television systems or their details for television cameras
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R11/00—Arrangements for holding or mounting articles, not otherwise provided for
    • B60R11/04—Mounting of cameras operative during drive; Arrangement of controls thereof relative to the vehicle
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/70—Determining position or orientation of objects or cameras
    • G06T7/73—Determining position or orientation of objects or cameras using feature-based methods
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/80—Analysis of captured images to determine intrinsic or extrinsic camera parameters, i.e. camera calibration
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/40—Extraction of image or video features
    • G06V10/42—Global feature extraction by analysis of the whole pattern, e.g. using frequency domain transformations or autocorrelation
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/50—Context or environment of the image
    • G06V20/56—Context or environment of the image exterior to a vehicle by using sensors mounted on the vehicle
    • G06V20/588—Recognition of the road, e.g. of lane markings; Recognition of the vehicle driving pattern in relation to the road
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
    • H04N7/183—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast for receiving images from a single remote source
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R2300/00—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
    • B60R2300/40—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the details of the power supply or the coupling to vehicle components
    • B60R2300/402—Image calibration
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R2300/00—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
    • B60R2300/80—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the intended use of the viewing arrangement
    • B60R2300/804—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the intended use of the viewing arrangement for lane monitoring
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30244—Camera pose
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30248—Vehicle exterior or interior
    • G06T2207/30252—Vehicle exterior; Vicinity of vehicle
    • G06T2207/30256—Lane; Road marking

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Signal Processing (AREA)
  • General Health & Medical Sciences (AREA)
  • Biomedical Technology (AREA)
  • Health & Medical Sciences (AREA)
  • Mechanical Engineering (AREA)
  • Image Analysis (AREA)
  • Traffic Control Systems (AREA)
  • Studio Devices (AREA)
JP2020510614A 2018-08-24 2019-06-28 車載カメラの姿勢推定方法、装置およびシステムならびに電子機器 Active JP6995188B2 (ja)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
CN201810973920.X 2018-08-24
CN201810973920.XA CN110858405A (zh) 2018-08-24 2018-08-24 车载摄像头的姿态估计方法、装置和系统及电子设备
PCT/CN2019/093911 WO2020038118A1 (zh) 2018-08-24 2019-06-28 车载摄像头的姿态估计方法、装置和系统及电子设备

Publications (3)

Publication Number Publication Date
JP2020533667A JP2020533667A (ja) 2020-11-19
JP2020533667A5 JP2020533667A5 (enExample) 2021-08-12
JP6995188B2 true JP6995188B2 (ja) 2022-01-14

Family

ID=69592397

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2020510614A Active JP6995188B2 (ja) 2018-08-24 2019-06-28 車載カメラの姿勢推定方法、装置およびシステムならびに電子機器

Country Status (5)

Country Link
US (1) US11205284B2 (enExample)
JP (1) JP6995188B2 (enExample)
CN (1) CN110858405A (enExample)
SG (1) SG11202000641UA (enExample)
WO (1) WO2020038118A1 (enExample)

Families Citing this family (19)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10816354B2 (en) 2017-08-22 2020-10-27 Tusimple, Inc. Verification module system and method for motion-based lane detection with multiple sensors
US12270661B2 (en) 2018-02-14 2025-04-08 Tusimple, Inc. Lane marking localization and fusion
US11009356B2 (en) 2018-02-14 2021-05-18 Tusimple, Inc. Lane marking localization and fusion
US11009365B2 (en) 2018-02-14 2021-05-18 Tusimple, Inc. Lane marking localization
EP3893150A1 (en) * 2020-04-09 2021-10-13 Tusimple, Inc. Camera pose estimation techniques
US20230306633A1 (en) * 2020-08-18 2023-09-28 Foresight Automotive Ltd. System and method for pose estimation of sensors using motion and angular shift
CN113490967A (zh) * 2020-09-22 2021-10-08 深圳市锐明技术股份有限公司 一种相机的标定方法、标定装置及电子设备
CN112384952A (zh) * 2020-09-22 2021-02-19 深圳市锐明技术股份有限公司 一种相机的标定方法、标定装置及电子设备
CN112597965B (zh) * 2021-01-05 2024-10-18 株洲中车时代电气股份有限公司 一种驾驶行为识别方法、装置和计算机可读存储介质
CN112907678B (zh) * 2021-01-25 2022-05-13 深圳佑驾创新科技有限公司 车载相机外参姿态动态估计方法、装置、计算机设备
JP7776100B2 (ja) 2021-04-16 2025-11-26 株式会社コムテック 再生制御システム及びコンピュータプログラム
CN115564793B (zh) * 2021-06-30 2024-12-27 惠州市德赛西威智能交通技术研究院有限公司 一种车载前向摄像头的位姿实时计算方法
CN113744330B (zh) * 2021-08-16 2025-04-29 苏州挚途科技有限公司 车载摄像头的俯仰角确定方法、装置及电子设备
US11875580B2 (en) * 2021-10-04 2024-01-16 Motive Technologies, Inc. Camera initialization for lane detection and distance estimation using single-view geometry
CN114494439B (zh) * 2022-01-25 2023-08-15 襄阳达安汽车检测中心有限公司 Hil仿真测试中摄像头位姿校准方法、装置、设备及介质
KR20240103749A (ko) * 2022-12-27 2024-07-04 현대자동차주식회사 차량 및 그 제어방법
US12405116B2 (en) * 2023-03-03 2025-09-02 Telenav, Inc. Navigation system with automatic optical calibration mechanism and method of operation thereof
CN117252880B (zh) * 2023-11-17 2024-01-16 宝德华南(深圳)热能系统有限公司 一种新能源汽车的adas综合评测系统
KR20250110561A (ko) * 2024-01-12 2025-07-21 현대자동차주식회사 멀티 카메라 자세 추정 방법 및 그 장치

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2007034989A (ja) 2005-07-29 2007-02-08 Nissan Motor Co Ltd 撮像装置のずれ検出方法、撮像装置のずれ補正方法及び撮像装置
JP2010537331A (ja) 2007-08-31 2010-12-02 ヴァレオ・シャルター・ウント・ゼンゾーレン・ゲーエムベーハー ビデオ画像のオンライン較正方法およびシステム
JP2011022995A (ja) 2009-06-16 2011-02-03 Nippon Soken Inc 消失点推定装置およびプログラム

Family Cites Families (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8487991B2 (en) * 2008-04-24 2013-07-16 GM Global Technology Operations LLC Clear path detection using a vanishing point
US9129161B2 (en) * 2013-05-31 2015-09-08 Toyota Jidosha Kabushiki Kaisha Computationally efficient scene classification
JP5906272B2 (ja) * 2014-03-28 2016-04-20 富士重工業株式会社 車両用ステレオ画像処理装置
GB201410612D0 (en) * 2014-06-13 2014-07-30 Tomtom Int Bv Methods and systems for generating route data
DE112016006081T5 (de) * 2015-12-28 2018-09-06 Intel Corporation Automatische Echtzeit-Fahrzeugkamerakalibrierung
JP6614042B2 (ja) * 2016-06-15 2019-12-04 株式会社Ｊｖｃケンウッド 姿勢変化判定装置、俯瞰映像生成装置、俯瞰映像生成システム、姿勢変化判定方法およびプログラム
CN106204574B (zh) 2016-07-07 2018-12-21 兰州理工大学 基于目标平面运动特征的相机位姿自标定方法
KR102538592B1 (ko) * 2016-08-31 2023-05-31 현대모비스 주식회사 탑-뷰 영상 생성 장치 및 그 방법
CN106679633B (zh) * 2016-12-07 2019-06-04 东华大学 一种车载测距系统及方法
CN107330940A (zh) * 2017-01-25 2017-11-07 问众智能信息科技（北京）有限公司 车载相机姿态自动估计的方法和装置
CN106875448B (zh) * 2017-02-16 2019-07-23 武汉极目智能技术有限公司 一种车载单目摄像头外部参数自标定方法
CN107145825A (zh) * 2017-03-31 2017-09-08 纵目科技（上海）股份有限公司 地平面拟合、摄像头标定方法及系统、车载终端
CN107133985B (zh) * 2017-04-20 2020-05-12 常州智行科技有限公司 一种基于车道线消逝点的车载摄像机自动标定方法
CN108229386B (zh) * 2017-12-29 2021-12-14 百度在线网络技术（北京）有限公司 用于检测车道线的方法、装置和介质
CN108875603B (zh) * 2018-05-31 2021-06-04 上海商汤智能科技有限公司 基于车道线的智能驾驶控制方法和装置、电子设备
CN108898638A (zh) * 2018-06-27 2018-11-27 江苏大学 一种车载摄像头在线自动标定方法

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2007034989A (ja) 2005-07-29 2007-02-08 Nissan Motor Co Ltd 撮像装置のずれ検出方法、撮像装置のずれ補正方法及び撮像装置
JP2010537331A (ja) 2007-08-31 2010-12-02 ヴァレオ・シャルター・ウント・ゼンゾーレン・ゲーエムベーハー ビデオ画像のオンライン較正方法およびシステム
JP2011022995A (ja) 2009-06-16 2011-02-03 Nippon Soken Inc 消失点推定装置およびプログラム

Also Published As

Publication number Publication date
JP2020533667A (ja) 2020-11-19
WO2020038118A1 (zh) 2020-02-27
US11205284B2 (en) 2021-12-21
CN110858405A (zh) 2020-03-03
SG11202000641UA (en) 2020-03-30
US20200160561A1 (en) 2020-05-21

Similar Documents

Publication Publication Date Title
JP6995188B2 (ja) 車載カメラの姿勢推定方法、装置およびシステムならびに電子機器
US11763571B2 (en) Monocular cued detection of three-dimensional structures from depth images
JP6844043B2 (ja) 視覚測位方法、装置、電子機器およびシステム
JP5375958B2 (ja) 画像処理装置および画像処理方法
JP4801821B2 (ja) 道路形状推定装置
CN104854637B (zh) 移动物体位置姿态角推定装置及移动物体位置姿态角推定方法
JP5714940B2 (ja) 移動体位置測定装置
CN108629292B (zh) 弯曲车道线检测方法、装置及终端
JP2020533667A5 (enExample)
CN107636679A (zh) 一种障碍物检测方法及装置
CN111213153A (zh) 目标物体运动状态检测方法、设备及存储介质
CN114898325B (zh) 一种车辆危险变道检测方法、装置及电子设备
CN112352260A (zh) 车道估计装置、方法以及程序
CN111738033B (zh) 基于平面分割的车辆行驶信息确定方法及装置、车载终端
JP7259309B2 (ja) 画像処理装置および画像処理方法
CN113345087B (zh) 基于单目视觉的地表模型拟合方法和装置
JP2012215442A (ja) 自位置特定システム、自位置特定プログラム及び自位置特定方法
CN113903103B (zh) 局部图像生成装置、局部图像生成方法以及存储介质
CN115943287A (zh) 车辆姿态推断系统及车辆姿态推断方法
CN113147746A (zh) 坡道车位的探测方法及装置
JP7252750B2 (ja) 画像処理装置および画像処理方法
CN114120701B (zh) 一种泊车定位方法及装置
CN113688653B (zh) 道路中心线的识别装置及方法、电子设备
WO2022133986A1 (en) Accuracy estimation method and system
CN114037977A (zh) 道路灭点的检测方法、装置、设备及存储介质

Legal Events

Date Code Title Description
A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20200220

A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20200220

A977 Report on retrieval

Free format text: JAPANESE INTERMEDIATE CODE: A971007

Effective date: 20210330

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20210401

A524 Written submission of copy of amendment under article 19 pct

Free format text: JAPANESE INTERMEDIATE CODE: A524

Effective date: 20210701

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20211125

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20211214

R150 Certificate of patent or registration of utility model

Ref document number: 6995188

Country of ref document: JP

Free format text: JAPANESE INTERMEDIATE CODE: R150

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250