DE112016005735T5 - System und Verfahren für eine bildbasierte Fahrzeugort-Bestimmung - Google Patents

System und Verfahren für eine bildbasierte Fahrzeugort-Bestimmung Download PDF

Info

Publication number
DE112016005735T5
DE112016005735T5 DE112016005735.0T DE112016005735T DE112016005735T5 DE 112016005735 T5 DE112016005735 T5 DE 112016005735T5 DE 112016005735 T DE112016005735 T DE 112016005735T DE 112016005735 T5 DE112016005735 T5 DE 112016005735T5
Authority
DE
Germany
Prior art keywords
map data
vehicle
camera image
location
dimensional map
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Withdrawn
Application number
DE112016005735.0T
Other languages
German (de)
English (en)
Inventor
Bernd Heisele
Ali TAALIMI
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Honda Motor Co Ltd
Original Assignee
Honda Motor Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Honda Motor Co Ltd filed Critical Honda Motor Co Ltd
Publication of DE112016005735T5 publication Critical patent/DE112016005735T5/de
Withdrawn legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/70—Determining position or orientation of objects or cameras
    • G06T7/73—Determining position or orientation of objects or cameras using feature-based methods
    • G06T7/74—Determining position or orientation of objects or cameras using feature-based methods involving reference images or patches
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01C—MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
    • G01C21/00—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00
    • G01C21/26—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 specially adapted for navigation in a road network
    • G01C21/28—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 specially adapted for navigation in a road network with correlation of data from several navigational instruments
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T17/00—Three dimensional [3D] modelling, e.g. data description of 3D objects
    • G06T17/05—Geographic models
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/40—Extraction of image or video features
    • G06V10/44—Local feature extraction by analysis of parts of the pattern, e.g. by detecting edges, contours, loops, corners, strokes or intersections; Connectivity analysis, e.g. of connected components
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/50—Context or environment of the image
    • G06V20/56—Context or environment of the image exterior to a vehicle by using sensors mounted on the vehicle
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/60—Type of objects
    • G06V20/64—Three-dimensional objects
    • G06V20/647—Three-dimensional objects by matching two-dimensional images to three-dimensional objects
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10016—Video; Image sequence
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30244—Camera pose
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30248—Vehicle exterior or interior
    • G06T2207/30252—Vehicle exterior; Vicinity of vehicle

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Multimedia (AREA)
  • Remote Sensing (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Geometry (AREA)
  • Software Systems (AREA)
  • Computer Graphics (AREA)
  • Automation & Control Theory (AREA)
  • Navigation (AREA)
  • Instructional Devices (AREA)
DE112016005735.0T 2015-12-15 2016-12-14 System und Verfahren für eine bildbasierte Fahrzeugort-Bestimmung Withdrawn DE112016005735T5 (de)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US14/970,251 2015-12-15
US14/970,251 US9727793B2 (en) 2015-12-15 2015-12-15 System and method for image based vehicle localization
PCT/US2016/066632 WO2017106327A1 (en) 2015-12-15 2016-12-14 System and method for image based vehicle localization

Publications (1)

Publication Number Publication Date
DE112016005735T5 true DE112016005735T5 (de) 2018-10-04

Family

ID=59018803

Family Applications (1)

Application Number Title Priority Date Filing Date
DE112016005735.0T Withdrawn DE112016005735T5 (de) 2015-12-15 2016-12-14 System und Verfahren für eine bildbasierte Fahrzeugort-Bestimmung

Country Status (5)

Country Link
US (1) US9727793B2 (enExample)
JP (1) JP6946298B2 (enExample)
CN (1) CN108450034B (enExample)
DE (1) DE112016005735T5 (enExample)
WO (1) WO2017106327A1 (enExample)

Families Citing this family (47)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP3358294A4 (en) * 2015-09-30 2019-04-10 Sony Corporation INFORMATION PROCESSING DEVICE, INFORMATION PROCESSING PROCESS AND PROGRAM
EP3422289A4 (en) * 2016-02-23 2019-02-27 Ricoh Company, Ltd. IMAGE PROCESSING DEVICE, IMAGING APPARATUS, CONTROL SYSTEM OF A MOBILITY DEVICE, PICTURE PROCESSING METHOD AND PROGRAM
JP6552448B2 (ja) * 2016-03-31 2019-07-31 株式会社デンソーアイティーラボラトリ 車両位置検出装置、車両位置検出方法及び車両位置検出用コンピュータプログラム
EP3497405B1 (en) * 2016-08-09 2022-06-15 Nauto, Inc. System and method for precision localization and mapping
US10282860B2 (en) * 2017-05-22 2019-05-07 Honda Motor Co., Ltd. Monocular localization in urban environments using road markings
US10529089B2 (en) * 2018-02-23 2020-01-07 GM Global Technology Operations LLC Crowd-sensed point cloud map
CN108535753A (zh) * 2018-03-30 2018-09-14 北京百度网讯科技有限公司 车辆定位方法、装置及设备
DE102018207857A1 (de) * 2018-05-18 2019-11-21 Zf Friedrichshafen Ag Verfahren und Positionierungssystem zum Transformieren einer Position eines Fahrzeugs
US20200027241A1 (en) * 2018-07-19 2020-01-23 GM Global Technology Operations LLC Auto-calibration for vehicle cameras
KR102682524B1 (ko) 2018-09-11 2024-07-08 삼성전자주식회사 증강 현실에서 가상 객체를 표시하기 위한 측위 방법 및 장치
CN109345589A (zh) * 2018-09-11 2019-02-15 百度在线网络技术（北京）有限公司 基于自动驾驶车辆的位置检测方法、装置、设备及介质
CN109389650B (zh) * 2018-09-30 2021-01-12 京东方科技集团股份有限公司 一种车载相机的标定方法、装置、车辆和存储介质
DE102018217194A1 (de) * 2018-10-09 2020-04-09 Robert Bosch Gmbh Verfahren zum Lokalisieren eines Fahrzeugs
KR102793522B1 (ko) * 2018-10-24 2025-04-09 삼성전자주식회사 영상 및 맵 데이터 기반 측위 방법 및 장치
DE102018220159B4 (de) * 2018-11-23 2021-03-11 Zf Friedrichshafen Ag Verfahren und System zum Bereitstellen von Transformationsparametern
KR102522923B1 (ko) * 2018-12-24 2023-04-20 한국전자통신연구원 차량의 자기위치 추정 장치 및 그 방법
US11227168B2 (en) * 2019-01-08 2022-01-18 Qualcomm Incorporated Robust lane association by projecting 2-D image into 3-D world using map information
US20200217667A1 (en) * 2019-01-08 2020-07-09 Qualcomm Incorporated Robust association of traffic signs with a map
US10650548B1 (en) * 2019-01-30 2020-05-12 StradVision, Inc. Method and device for localization of autonomous vehicle for route planning by using attention-driven landmark detection
CN109961522B (zh) * 2019-04-02 2023-05-05 阿波罗智联(北京)科技有限公司 图像投射方法、装置、设备和存储介质
CN111829532B (zh) * 2019-04-18 2022-05-17 丰翼科技(深圳)有限公司 一种飞行器重定位系统和重定位方法
CN111753605B (zh) * 2019-06-11 2024-08-20 北京京东乾石科技有限公司 车道线定位方法、装置、电子设备及可读介质
CN110264517A (zh) * 2019-06-13 2019-09-20 上海理工大学 一种基于三维场景图像确定车辆当前位置信息的方法与系统
CN112097742B (zh) * 2019-06-17 2022-08-30 北京地平线机器人技术研发有限公司 一种位姿确定方法及装置
CN112150538B (zh) * 2019-06-27 2024-04-12 北京初速度科技有限公司 一种在三维地图构建过程中车辆位姿的确定方法和装置
US11629835B2 (en) * 2019-07-31 2023-04-18 Toyota Jidosha Kabushiki Kaisha Auto-calibration of vehicle sensors
US11500104B2 (en) 2019-08-16 2022-11-15 Ford Global Technologies, Llc Localizing a moving object
CN112400122B (zh) * 2019-08-26 2024-07-16 北京航迹科技有限公司 定位目标对象的系统和方法
KR102782302B1 (ko) * 2019-09-20 2025-03-17 삼성전자주식회사 위치 추정 장치 및 방법
US11620831B2 (en) * 2020-04-29 2023-04-04 Toyota Research Institute, Inc. Register sets of low-level features without data association
US11887323B2 (en) * 2020-06-08 2024-01-30 Ford Global Technologies, Llc Self-supervised estimation of observed vehicle pose
CN111968071B (zh) * 2020-06-29 2024-07-05 北京中软政通信息技术有限公司 车辆的空间位置生成方法、装置、设备及存储介质
JP7474137B2 (ja) * 2020-06-30 2024-04-24 キヤノン株式会社 情報処理装置およびその制御方法
CN111833717B (zh) 2020-07-20 2022-04-15 阿波罗智联(北京)科技有限公司 用于定位交通工具的方法、装置、设备和存储介质
CN114248778B (zh) * 2020-09-22 2024-04-12 华为技术有限公司 移动设备的定位方法和定位装置
CN112001456B (zh) * 2020-10-28 2021-07-30 北京三快在线科技有限公司 一种车辆定位方法、装置、存储介质及电子设备
CN112560680B (zh) * 2020-12-16 2024-09-03 阿波罗智联(北京)科技有限公司 车道线处理方法、装置、电子设备及存储介质
EP4020111B1 (en) * 2020-12-28 2023-11-15 Zenseact AB Vehicle localisation
US11482007B2 (en) 2021-02-10 2022-10-25 Ford Global Technologies, Llc Event-based vehicle pose estimation using monochromatic imaging
CN112966059B (zh) * 2021-03-02 2023-11-24 北京百度网讯科技有限公司 针对定位数据的数据处理方法、装置、电子设备和介质
US12078738B2 (en) 2021-11-09 2024-09-03 Msrs Llc Method, apparatus, and computer readable medium for a multi-source reckoning system
CN114547551B (zh) * 2022-02-23 2023-08-29 阿波罗智能技术(北京)有限公司 基于车辆上报数据的路面数据获取方法及云端服务器
EP4257927B1 (en) * 2022-04-06 2025-10-15 Zenseact AB Vehicle pose assessment
WO2025134278A1 (ja) * 2023-12-20 2025-06-26 日産自動車株式会社 画像生成方法及び画像生成装置
WO2025134318A1 (ja) * 2023-12-21 2025-06-26 日産自動車株式会社 画像生成方法及び画像生成装置
US12259246B1 (en) 2024-05-13 2025-03-25 Msrs Llc Method, apparatus, and computer readable medium for calculating a handrail influence intensity factor
CN119741373B (zh) * 2024-12-11 2025-08-26 湖北文理学院 多层空间过渡区域的车辆定位方法、装置、设备及介质

Family Cites Families (20)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6768944B2 (en) 2002-04-09 2004-07-27 Intelligent Technologies International, Inc. Method and system for controlling a vehicle
US6094508A (en) 1997-12-08 2000-07-25 Intel Corporation Perceptual thresholding for gradient-based local edge detection
US9126533B2 (en) * 2007-02-23 2015-09-08 Aisin Aw Co., Ltd. Driving support method and driving support device
JP4412380B2 (ja) * 2007-10-02 2010-02-10 アイシン・エィ・ダブリュ株式会社 運転支援装置、運転支援方法及びコンピュータプログラム
US8284995B2 (en) 2008-07-16 2012-10-09 Volkswagen Of America, Inc. Method for updating a geographic database for an in-vehicle navigation system
US8503762B2 (en) * 2009-08-26 2013-08-06 Jacob Ben Tzvi Projecting location based elements over a heads up display
US9077958B2 (en) * 2010-08-30 2015-07-07 Honda Motor Co., Ltd. Road departure warning system
US8452535B2 (en) * 2010-12-13 2013-05-28 GM Global Technology Operations LLC Systems and methods for precise sub-lane vehicle positioning
CN102252859B (zh) * 2011-05-31 2013-06-05 南京信息工程大学 汽车列车直线行驶横向稳定性自动辨识系统
US9111349B2 (en) 2011-12-16 2015-08-18 Microsoft Technology Licensing, Llc Object identification using 3-D curve matching
JP5910180B2 (ja) * 2012-03-06 2016-04-27 日産自動車株式会社 移動物体位置姿勢推定装置及び方法
JP5867176B2 (ja) * 2012-03-06 2016-02-24 日産自動車株式会社 移動物体位置姿勢推定装置及び方法
JP6044084B2 (ja) * 2012-03-08 2016-12-14 日産自動車株式会社 移動物体位置姿勢推定装置及び方法
JP5962771B2 (ja) * 2012-12-12 2016-08-03 日産自動車株式会社 移動物体位置姿勢角推定装置及び移動物体位置姿勢角推定方法
US9145139B2 (en) * 2013-06-24 2015-09-29 Google Inc. Use of environmental information to aid image processing for autonomous vehicles
US9201424B1 (en) 2013-08-27 2015-12-01 Google Inc. Camera calibration using structure from motion techniques
WO2015072217A1 (ja) * 2013-11-13 2015-05-21 日産自動車株式会社 移動体位置推定装置および移動体位置推定方法
KR20150058679A (ko) * 2013-11-20 2015-05-29 한국전자통신연구원 단지내 도로에서 자율주행차량의 위치 및 해딩 정보 제공 장치 및 방법
CN104007760B (zh) * 2014-04-22 2016-05-18 济南大学 一种自主机器人视觉导航中的自定位方法
CN104374376B (zh) * 2014-11-05 2016-06-15 北京大学 一种车载三维测量系统装置及其应用

Also Published As

Publication number Publication date
CN108450034A (zh) 2018-08-24
WO2017106327A1 (en) 2017-06-22
US20170169300A1 (en) 2017-06-15
US9727793B2 (en) 2017-08-08
JP6946298B2 (ja) 2021-10-06
JP2019500602A (ja) 2019-01-10
CN108450034B (zh) 2022-02-11

Similar Documents

Publication Publication Date Title
DE112016005735T5 (de) System und Verfahren für eine bildbasierte Fahrzeugort-Bestimmung
DE102019104482B4 (de) Verfahren und computerimplementiertes System zum Steuern eines autonomen Fahrzeugs
DE102018205915A1 (de) Monokulare Lokalisierung in städtischen Umgebungen unter Verwendung von Straßenmarkierungen
DE102015107677B4 (de) Rundum-Sicht-Kamerasystem- (VPM-) Online-Kalibrierung
DE112017001322T5 (de) Signalverarbeitungsvorrichtung und Signalverarbeitungsverfahren
DE112018000899T5 (de) Gemeinsame 3D-Objekterfassung und Ausrichtungsabschätzung über multimodale Fusion
DE102019133536A1 (de) Verfahren und Vorrichtung zum Ermöglichen der sequentiellen Bodenansichts-Bildprojektionssynthese und der komplizierten Szenenrekonstruktion an Kartenanomalie-Hotspots
DE112017000643T5 (de) Detektion eines teilweise verdeckten Objekts unter Verwendung von Kontext und Tiefenordnung
DE102014222617B4 (de) Fahrzeugerfassungsverfahren und Fahrzeugerfassungssytem
DE102019101511A1 (de) Fahrzeugübergreifende zusammenarbeit zur selbsthöhenschätzung von fahrzeugen
DE102019101463A1 (de) Sichtbasierte verfahren und systeme zur bestimmung des vorhandenseins eines anhängers
CN111539484B (zh) 训练神经网络的方法及装置
DE102015107675A1 (de) System und Verfahren zur Schätzung einer Fahrzeugdynamik unter Verwendung von Merkmalpunkten in Bildern von mehreren Kameras
DE112020005735T5 (de) Positionsabschätzungsvorrichtung, Fahrzeug, Positionsabschätzungsverfahren und Positionsabschätzungsprogramm
DE112018007048T5 (de) Kalibrationsvorrichtung, kalibrationsverfahren und programm
DE102020207490A1 (de) Objektabstandsmessvorrichtung und Verfahren
DE112017005385T5 (de) Bildverarbeitungseinrichtung und Bildverarbeitungsverfahren
DE102019113706A1 (de) Systeme und verfahren für das im fahrzeug erweiterte virtual-reality-system
DE102021106694A1 (de) Dynamische lidar-zu-kamera-ausrichtung
DE102020105619A1 (de) System und verfahren zur bestimmung der fahrzeugposition
DE102018215753A1 (de) Vorrichtung und Verfahren zum Ermitteln einer Trajektorie eines Fahrzeugs
DE102022126158A1 (de) Systeme und verfahren zum bereitstellen von parametern eines interessierenden bereichs der lichtsignale für ein autonomes fahrzeug
DE112017005228T5 (de) Bildverarbeitungsvorrichtung und Bildverarbeitungsverfahren
DE102022114048A1 (de) Bildentzerrung
DE102018109436A1 (de) Erkennung eines sattelaufliegerüberstands mit aktiver parkassistenz

Legal Events

Date Code Title Description
R005 Application deemed withdrawn due to failure to request examination