JP6946298B2 - 画像ベースの車両位置特定のためのシステム及び方法 - Google Patents

画像ベースの車両位置特定のためのシステム及び方法 Download PDF

Info

Publication number
JP6946298B2
JP6946298B2 JP2018531062A JP2018531062A JP6946298B2 JP 6946298 B2 JP6946298 B2 JP 6946298B2 JP 2018531062 A JP2018531062 A JP 2018531062A JP 2018531062 A JP2018531062 A JP 2018531062A JP 6946298 B2 JP6946298 B2 JP 6946298B2
Authority
JP
Japan
Prior art keywords
map data
vehicle
camera image
camera
edge
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
JP2018531062A
Other languages
English (en)
Japanese (ja)
Other versions
JP2019500602A5 (enExample
JP2019500602A (ja
Inventor
ハイゼル ベルンド
ハイゼル ベルンド
タアリミ アリ
タアリミ アリ
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Honda Motor Co Ltd
Original Assignee
Honda Motor Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Honda Motor Co Ltd filed Critical Honda Motor Co Ltd
Publication of JP2019500602A publication Critical patent/JP2019500602A/ja
Publication of JP2019500602A5 publication Critical patent/JP2019500602A5/ja
Application granted granted Critical
Publication of JP6946298B2 publication Critical patent/JP6946298B2/ja
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/70—Determining position or orientation of objects or cameras
    • G06T7/73—Determining position or orientation of objects or cameras using feature-based methods
    • G06T7/74—Determining position or orientation of objects or cameras using feature-based methods involving reference images or patches
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01C—MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
    • G01C21/00—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00
    • G01C21/26—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 specially adapted for navigation in a road network
    • G01C21/28—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 specially adapted for navigation in a road network with correlation of data from several navigational instruments
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T17/00—Three dimensional [3D] modelling, e.g. data description of 3D objects
    • G06T17/05—Geographic models
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/40—Extraction of image or video features
    • G06V10/44—Local feature extraction by analysis of parts of the pattern, e.g. by detecting edges, contours, loops, corners, strokes or intersections; Connectivity analysis, e.g. of connected components
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/50—Context or environment of the image
    • G06V20/56—Context or environment of the image exterior to a vehicle by using sensors mounted on the vehicle
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/60—Type of objects
    • G06V20/64—Three-dimensional objects
    • G06V20/647—Three-dimensional objects by matching two-dimensional images to three-dimensional objects
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10016—Video; Image sequence
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30244—Camera pose
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30248—Vehicle exterior or interior
    • G06T2207/30252—Vehicle exterior; Vicinity of vehicle

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Multimedia (AREA)
  • Remote Sensing (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Geometry (AREA)
  • Software Systems (AREA)
  • Computer Graphics (AREA)
  • Automation & Control Theory (AREA)
  • Navigation (AREA)
  • Instructional Devices (AREA)
JP2018531062A 2015-12-15 2016-12-14 画像ベースの車両位置特定のためのシステム及び方法 Active JP6946298B2 (ja)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US14/970,251 2015-12-15
US14/970,251 US9727793B2 (en) 2015-12-15 2015-12-15 System and method for image based vehicle localization
PCT/US2016/066632 WO2017106327A1 (en) 2015-12-15 2016-12-14 System and method for image based vehicle localization

Publications (3)

Publication Number Publication Date
JP2019500602A JP2019500602A (ja) 2019-01-10
JP2019500602A5 JP2019500602A5 (enExample) 2019-12-05
JP6946298B2 true JP6946298B2 (ja) 2021-10-06

Family

ID=59018803

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2018531062A Active JP6946298B2 (ja) 2015-12-15 2016-12-14 画像ベースの車両位置特定のためのシステム及び方法

Country Status (5)

Country Link
US (1) US9727793B2 (enExample)
JP (1) JP6946298B2 (enExample)
CN (1) CN108450034B (enExample)
DE (1) DE112016005735T5 (enExample)
WO (1) WO2017106327A1 (enExample)

Families Citing this family (47)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP3358294A4 (en) * 2015-09-30 2019-04-10 Sony Corporation INFORMATION PROCESSING DEVICE, INFORMATION PROCESSING PROCESS AND PROGRAM
EP3422289A4 (en) * 2016-02-23 2019-02-27 Ricoh Company, Ltd. IMAGE PROCESSING DEVICE, IMAGING APPARATUS, CONTROL SYSTEM OF A MOBILITY DEVICE, PICTURE PROCESSING METHOD AND PROGRAM
JP6552448B2 (ja) * 2016-03-31 2019-07-31 株式会社デンソーアイティーラボラトリ 車両位置検出装置、車両位置検出方法及び車両位置検出用コンピュータプログラム
EP3497405B1 (en) * 2016-08-09 2022-06-15 Nauto, Inc. System and method for precision localization and mapping
US10282860B2 (en) * 2017-05-22 2019-05-07 Honda Motor Co., Ltd. Monocular localization in urban environments using road markings
US10529089B2 (en) * 2018-02-23 2020-01-07 GM Global Technology Operations LLC Crowd-sensed point cloud map
CN108535753A (zh) * 2018-03-30 2018-09-14 北京百度网讯科技有限公司 车辆定位方法、装置及设备
DE102018207857A1 (de) * 2018-05-18 2019-11-21 Zf Friedrichshafen Ag Verfahren und Positionierungssystem zum Transformieren einer Position eines Fahrzeugs
US20200027241A1 (en) * 2018-07-19 2020-01-23 GM Global Technology Operations LLC Auto-calibration for vehicle cameras
KR102682524B1 (ko) 2018-09-11 2024-07-08 삼성전자주식회사 증강 현실에서 가상 객체를 표시하기 위한 측위 방법 및 장치
CN109345589A (zh) * 2018-09-11 2019-02-15 百度在线网络技术（北京）有限公司 基于自动驾驶车辆的位置检测方法、装置、设备及介质
CN109389650B (zh) * 2018-09-30 2021-01-12 京东方科技集团股份有限公司 一种车载相机的标定方法、装置、车辆和存储介质
DE102018217194A1 (de) * 2018-10-09 2020-04-09 Robert Bosch Gmbh Verfahren zum Lokalisieren eines Fahrzeugs
KR102793522B1 (ko) * 2018-10-24 2025-04-09 삼성전자주식회사 영상 및 맵 데이터 기반 측위 방법 및 장치
DE102018220159B4 (de) * 2018-11-23 2021-03-11 Zf Friedrichshafen Ag Verfahren und System zum Bereitstellen von Transformationsparametern
KR102522923B1 (ko) * 2018-12-24 2023-04-20 한국전자통신연구원 차량의 자기위치 추정 장치 및 그 방법
US11227168B2 (en) * 2019-01-08 2022-01-18 Qualcomm Incorporated Robust lane association by projecting 2-D image into 3-D world using map information
US20200217667A1 (en) * 2019-01-08 2020-07-09 Qualcomm Incorporated Robust association of traffic signs with a map
US10650548B1 (en) * 2019-01-30 2020-05-12 StradVision, Inc. Method and device for localization of autonomous vehicle for route planning by using attention-driven landmark detection
CN109961522B (zh) * 2019-04-02 2023-05-05 阿波罗智联(北京)科技有限公司 图像投射方法、装置、设备和存储介质
CN111829532B (zh) * 2019-04-18 2022-05-17 丰翼科技(深圳)有限公司 一种飞行器重定位系统和重定位方法
CN111753605B (zh) * 2019-06-11 2024-08-20 北京京东乾石科技有限公司 车道线定位方法、装置、电子设备及可读介质
CN110264517A (zh) * 2019-06-13 2019-09-20 上海理工大学 一种基于三维场景图像确定车辆当前位置信息的方法与系统
CN112097742B (zh) * 2019-06-17 2022-08-30 北京地平线机器人技术研发有限公司 一种位姿确定方法及装置
CN112150538B (zh) * 2019-06-27 2024-04-12 北京初速度科技有限公司 一种在三维地图构建过程中车辆位姿的确定方法和装置
US11629835B2 (en) * 2019-07-31 2023-04-18 Toyota Jidosha Kabushiki Kaisha Auto-calibration of vehicle sensors
US11500104B2 (en) 2019-08-16 2022-11-15 Ford Global Technologies, Llc Localizing a moving object
CN112400122B (zh) * 2019-08-26 2024-07-16 北京航迹科技有限公司 定位目标对象的系统和方法
KR102782302B1 (ko) * 2019-09-20 2025-03-17 삼성전자주식회사 위치 추정 장치 및 방법
US11620831B2 (en) * 2020-04-29 2023-04-04 Toyota Research Institute, Inc. Register sets of low-level features without data association
US11887323B2 (en) * 2020-06-08 2024-01-30 Ford Global Technologies, Llc Self-supervised estimation of observed vehicle pose
CN111968071B (zh) * 2020-06-29 2024-07-05 北京中软政通信息技术有限公司 车辆的空间位置生成方法、装置、设备及存储介质
JP7474137B2 (ja) * 2020-06-30 2024-04-24 キヤノン株式会社 情報処理装置およびその制御方法
CN111833717B (zh) 2020-07-20 2022-04-15 阿波罗智联(北京)科技有限公司 用于定位交通工具的方法、装置、设备和存储介质
CN114248778B (zh) * 2020-09-22 2024-04-12 华为技术有限公司 移动设备的定位方法和定位装置
CN112001456B (zh) * 2020-10-28 2021-07-30 北京三快在线科技有限公司 一种车辆定位方法、装置、存储介质及电子设备
CN112560680B (zh) * 2020-12-16 2024-09-03 阿波罗智联(北京)科技有限公司 车道线处理方法、装置、电子设备及存储介质
EP4020111B1 (en) * 2020-12-28 2023-11-15 Zenseact AB Vehicle localisation
US11482007B2 (en) 2021-02-10 2022-10-25 Ford Global Technologies, Llc Event-based vehicle pose estimation using monochromatic imaging
CN112966059B (zh) * 2021-03-02 2023-11-24 北京百度网讯科技有限公司 针对定位数据的数据处理方法、装置、电子设备和介质
US12078738B2 (en) 2021-11-09 2024-09-03 Msrs Llc Method, apparatus, and computer readable medium for a multi-source reckoning system
CN114547551B (zh) * 2022-02-23 2023-08-29 阿波罗智能技术(北京)有限公司 基于车辆上报数据的路面数据获取方法及云端服务器
EP4257927B1 (en) * 2022-04-06 2025-10-15 Zenseact AB Vehicle pose assessment
WO2025134278A1 (ja) * 2023-12-20 2025-06-26 日産自動車株式会社 画像生成方法及び画像生成装置
WO2025134318A1 (ja) * 2023-12-21 2025-06-26 日産自動車株式会社 画像生成方法及び画像生成装置
US12259246B1 (en) 2024-05-13 2025-03-25 Msrs Llc Method, apparatus, and computer readable medium for calculating a handrail influence intensity factor
CN119741373B (zh) * 2024-12-11 2025-08-26 湖北文理学院 多层空间过渡区域的车辆定位方法、装置、设备及介质

Family Cites Families (20)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6768944B2 (en) 2002-04-09 2004-07-27 Intelligent Technologies International, Inc. Method and system for controlling a vehicle
US6094508A (en) 1997-12-08 2000-07-25 Intel Corporation Perceptual thresholding for gradient-based local edge detection
US9126533B2 (en) * 2007-02-23 2015-09-08 Aisin Aw Co., Ltd. Driving support method and driving support device
JP4412380B2 (ja) * 2007-10-02 2010-02-10 アイシン・エィ・ダブリュ株式会社 運転支援装置、運転支援方法及びコンピュータプログラム
US8284995B2 (en) 2008-07-16 2012-10-09 Volkswagen Of America, Inc. Method for updating a geographic database for an in-vehicle navigation system
US8503762B2 (en) * 2009-08-26 2013-08-06 Jacob Ben Tzvi Projecting location based elements over a heads up display
US9077958B2 (en) * 2010-08-30 2015-07-07 Honda Motor Co., Ltd. Road departure warning system
US8452535B2 (en) * 2010-12-13 2013-05-28 GM Global Technology Operations LLC Systems and methods for precise sub-lane vehicle positioning
CN102252859B (zh) * 2011-05-31 2013-06-05 南京信息工程大学 汽车列车直线行驶横向稳定性自动辨识系统
US9111349B2 (en) 2011-12-16 2015-08-18 Microsoft Technology Licensing, Llc Object identification using 3-D curve matching
JP5910180B2 (ja) * 2012-03-06 2016-04-27 日産自動車株式会社 移動物体位置姿勢推定装置及び方法
JP5867176B2 (ja) * 2012-03-06 2016-02-24 日産自動車株式会社 移動物体位置姿勢推定装置及び方法
JP6044084B2 (ja) * 2012-03-08 2016-12-14 日産自動車株式会社 移動物体位置姿勢推定装置及び方法
JP5962771B2 (ja) * 2012-12-12 2016-08-03 日産自動車株式会社 移動物体位置姿勢角推定装置及び移動物体位置姿勢角推定方法
US9145139B2 (en) * 2013-06-24 2015-09-29 Google Inc. Use of environmental information to aid image processing for autonomous vehicles
US9201424B1 (en) 2013-08-27 2015-12-01 Google Inc. Camera calibration using structure from motion techniques
WO2015072217A1 (ja) * 2013-11-13 2015-05-21 日産自動車株式会社 移動体位置推定装置および移動体位置推定方法
KR20150058679A (ko) * 2013-11-20 2015-05-29 한국전자통신연구원 단지내 도로에서 자율주행차량의 위치 및 해딩 정보 제공 장치 및 방법
CN104007760B (zh) * 2014-04-22 2016-05-18 济南大学 一种自主机器人视觉导航中的自定位方法
CN104374376B (zh) * 2014-11-05 2016-06-15 北京大学 一种车载三维测量系统装置及其应用

Also Published As

Publication number Publication date
CN108450034A (zh) 2018-08-24
WO2017106327A1 (en) 2017-06-22
US20170169300A1 (en) 2017-06-15
US9727793B2 (en) 2017-08-08
DE112016005735T5 (de) 2018-10-04
JP2019500602A (ja) 2019-01-10
CN108450034B (zh) 2022-02-11

Similar Documents

Publication Publication Date Title
JP6946298B2 (ja) 画像ベースの車両位置特定のためのシステム及び方法
US10282860B2 (en) Monocular localization in urban environments using road markings
CN104833370B (zh) 用于映射、定位和位姿校正的系统和方法
CN111178122B (zh) 道路场景中三维车道的检测及平面表示
US11035933B2 (en) Transition map between lidar and high-definition map
JP6910664B2 (ja) 自動駐車システム内のセマンティックセグメンテーションを利用した駐車領域を検出するための方法及び装置
US20220180483A1 (en) Image processing device, image processing method, and program
WO2018170472A1 (en) Joint 3d object detection and orientation estimation via multimodal fusion
TW202018330A (zh) 使用光達的運輸工具定位系統
JP2019509552A (ja) コンテキスト及び深さ順序を用いる、部分的に遮られた物体の検出
CN110859044A (zh) 自然场景中的集成传感器校准
KR20200043391A (ko) 화상 블러 보정을 위한 화상 처리, 화상 처리 방법 및 프로그램
JP2020057387A (ja) 車両位置決め方法、車両位置決め装置、電子機器及びコンピュータ読み取り可能な記憶媒体
US20200324781A1 (en) Systems and methods for estimating velocity of an autonomous vehicle and state information of a surrounding vehicle
CN104732196A (zh) 车辆检测方法及系统
JP2020087191A (ja) 車線境界設定装置、車線境界設定方法
CN113454692B (zh) 驾驶信息提供方法以及车辆地图提供服务器和方法
CN111824163A (zh) 用于确定道路的曲线的方法和设备
JP7783339B2 (ja) 路面情報取得方法、路面情報取得装置、及び路面情報取得プログラム
WO2019220765A1 (ja) 自己位置推定装置
CN110995981B (zh) 图像处理装置及其控制方法、非暂时性可读记录介质、信息处理系统
CN114693803B (zh) 参数标定方法、装置、车辆及存储介质
CN114830185A (zh) 借助于神经网络的位置确定
CN115346191A (zh) 用于校准的方法和设备
CN117836818A (zh) 信息处理装置、信息处理系统、模型以及模型的生成方法

Legal Events

Date Code Title Description
A529 Written submission of copy of amendment under article 34 pct

Free format text: JAPANESE INTERMEDIATE CODE: A529

Effective date: 20180814

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20191021

A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20191021

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20210105

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20210305

A02 Decision of refusal

Free format text: JAPANESE INTERMEDIATE CODE: A02

Effective date: 20210406

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20210705

C60 Trial request (containing other claim documents, opposition documents)

Free format text: JAPANESE INTERMEDIATE CODE: C60

Effective date: 20210705

A911 Transfer to examiner for re-examination before appeal (zenchi)

Free format text: JAPANESE INTERMEDIATE CODE: A911

Effective date: 20210712

C21 Notice of transfer of a case for reconsideration by examiners before appeal proceedings

Free format text: JAPANESE INTERMEDIATE CODE: C21

Effective date: 20210713

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20210907

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20210915

R150 Certificate of patent or registration of utility model

Ref document number: 6946298

Country of ref document: JP

Free format text: JAPANESE INTERMEDIATE CODE: R150