CN113678079A - 从车辆传感器和相机阵列生成结构化地图数据 - Google Patents

从车辆传感器和相机阵列生成结构化地图数据 Download PDF

Info

Publication number
CN113678079A
CN113678079A CN202080023022.3A CN202080023022A CN113678079A CN 113678079 A CN113678079 A CN 113678079A CN 202080023022 A CN202080023022 A CN 202080023022A CN 113678079 A CN113678079 A CN 113678079A
Authority
CN
China
Prior art keywords
image
feature
time
location
data
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202080023022.3A
Other languages
English (en)
Chinese (zh)
Inventor
N·奈卡尔
A·帕特伦-佩雷斯
A·马克斯
J·库亚
A·M·贝斯蒂克
C·D·汤普森
A·C·科斯马
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Wieden Lidar Usa Ltd
Original Assignee
Wieden Lidar Usa Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Wieden Lidar Usa Ltd filed Critical Wieden Lidar Usa Ltd
Publication of CN113678079A publication Critical patent/CN113678079A/zh
Pending legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/50—Depth or shape recovery
    • G06T7/55—Depth or shape recovery from multiple images
    • G06T7/579—Depth or shape recovery from multiple images from motion
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01C—MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
    • G01C21/00—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00
    • G01C21/38—Electronic maps specially adapted for navigation; Updating thereof
    • G01C21/3804—Creation or updating of map data
    • G01C21/3833—Creation or updating of map data characterised by the source of data
    • G01C21/3841—Data obtained from two or more sources, e.g. probe vehicles
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01C—MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
    • G01C21/00—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00
    • G01C21/38—Electronic maps specially adapted for navigation; Updating thereof
    • G01C21/3804—Creation or updating of map data
    • G01C21/3833—Creation or updating of map data characterised by the source of data
    • G01C21/3848—Data obtained from both position sensors and additional sensors
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01C—MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
    • G01C21/00—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00
    • G01C21/38—Electronic maps specially adapted for navigation; Updating thereof
    • G01C21/3863—Structures of map data
    • G01C21/3867—Geometry of map features, e.g. shape points, polygons or for simplified maps
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/70—Determining position or orientation of objects or cameras
    • G06T7/73—Determining position or orientation of objects or cameras using feature-based methods
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/70—Determining position or orientation of objects or cameras
    • G06T7/73—Determining position or orientation of objects or cameras using feature-based methods
    • G06T7/74—Determining position or orientation of objects or cameras using feature-based methods involving reference images or patches
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10016—Video; Image sequence
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30248—Vehicle exterior or interior
    • G06T2207/30252—Vehicle exterior; Vicinity of vehicle

Landscapes

  • Engineering & Computer Science (AREA)
  • Remote Sensing (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Automation & Control Theory (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Theoretical Computer Science (AREA)
  • Geometry (AREA)
  • Navigation (AREA)
  • Traffic Control Systems (AREA)
  • Instructional Devices (AREA)
CN202080023022.3A 2019-01-22 2020-01-22 从车辆传感器和相机阵列生成结构化地图数据 Pending CN113678079A (zh)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US16/254,508 US11004224B2 (en) 2019-01-22 2019-01-22 Generation of structured map data from vehicle sensors and camera arrays
US16/254508 2019-01-22
PCT/US2020/014558 WO2020154366A1 (en) 2019-01-22 2020-01-22 Generation of structured map data from vehicle sensors and camera arrays

Publications (1)

Publication Number Publication Date
CN113678079A true CN113678079A (zh) 2021-11-19

Family

ID=71608397

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202080023022.3A Pending CN113678079A (zh) 2019-01-22 2020-01-22 从车辆传感器和相机阵列生成结构化地图数据

Country Status (9)

Country Link
US (2) US11004224B2 (https=)
EP (1) EP3899684A4 (https=)
JP (1) JP2022518911A (https=)
KR (1) KR20210118119A (https=)
CN (1) CN113678079A (https=)
CA (1) CA3127451A1 (https=)
IL (1) IL285029A (https=)
MX (1) MX2021008782A (https=)
WO (1) WO2020154366A1 (https=)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114172610A (zh) * 2021-12-08 2022-03-11 北京经纬恒润科技股份有限公司 一种多源数据同步处理方法、装置及系统

Families Citing this family (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20200132500A1 (en) * 2017-07-20 2020-04-30 Toyota Mapmaster Incorporated New road deducation assistance device, new road deducation assistance method, and computer program product
EP3779929A4 (en) * 2018-03-29 2021-05-05 Panasonic Intellectual Property Management Co., Ltd. CONTROL DEVICE AND CARD GENERATION PROCESS
US11004224B2 (en) 2019-01-22 2021-05-11 Velodyne Lidar Usa, Inc. Generation of structured map data from vehicle sensors and camera arrays
WO2020237288A1 (en) * 2019-05-24 2020-12-03 Aerometrex Pty Ltd An aerial imaging system and method
US11709061B2 (en) * 2020-10-16 2023-07-25 Argo AI, LLC Systems and methods for multi-modal transfer capabilities for smart infrastructure
DE102021103134A1 (de) 2021-02-10 2022-08-11 Cariad Se Verfahren zum Betreiben einer Sensorschaltung in einem Kraftfahrzeug, entsprechend betreibbare Sensorschaltung und Kraftfahrzeug mit der Sensorschaltung
WO2022231523A1 (en) * 2021-04-29 2022-11-03 National University Of Singapore Multi-camera system
CN113724323B (zh) * 2021-08-24 2024-07-23 杭州海康威视数字技术股份有限公司 一种地图构建方法、装置及设备
US12050589B2 (en) * 2021-12-29 2024-07-30 Lyft, Inc. Systems and methods for updating maps and evaluating map accuracy based on collected image data
US20260009654A1 (en) * 2022-03-31 2026-01-08 Honda Motor Co., Ltd. Map generation apparatus
WO2024031141A1 (en) * 2022-08-09 2024-02-15 Visionary Machines Pty Ltd Systems and methods for generating and/or using 3-dimensional information with one or more moving cameras
KR102589483B1 (ko) * 2022-09-26 2023-10-16 한국건설기술연구원 건설 인프라 스캔 작업 지원용 로버 기반 3차원 스캔 모바일 맵핑 시스템 및 방법
CN115973178B (zh) * 2023-03-17 2023-05-23 禾多科技（北京）有限公司 车辆移动控制方法、装置、电子设备和计算机可读介质
CN119478327B (zh) * 2024-10-24 2025-09-26 广州骊珠科技有限责任公司 环境帧的回环检测方法

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20150094089A1 (en) * 2013-09-27 2015-04-02 Qualcomm Incorporated Hybrid photo navigation and mapping
US20170118539A1 (en) * 2015-10-26 2017-04-27 Alpinereplay, Inc. System and method for enhanced video image recognition using motion sensors
US20170123425A1 (en) * 2015-10-09 2017-05-04 SZ DJI Technology Co., Ltd Salient feature based vehicle positioning
US20170357858A1 (en) * 2016-06-09 2017-12-14 Qualcomm Incorporated Geometric matching in visual navigation systems
US20180188032A1 (en) * 2017-01-04 2018-07-05 Qualcomm Incorporated Systems and methods for using a global positioning system velocity in visual-inertial odometry
CN109211249A (zh) * 2017-06-30 2019-01-15 通用汽车环球科技运作有限责任公司 用于车辆定位的方法和系统

Family Cites Families (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5633872A (en) * 1994-06-08 1997-05-27 Eon Corporation Interactive radio
US6789005B2 (en) * 2002-11-22 2004-09-07 New York Air Brake Corporation Method and apparatus of monitoring a railroad hump yard
US20070070069A1 (en) * 2005-09-26 2007-03-29 Supun Samarasekera System and method for enhanced situation awareness and visualization of environments
US7958536B2 (en) * 2008-03-31 2011-06-07 Broadcom Corporation Video transmission system with timing based on a global clock and methods for use therewith
US20100204974A1 (en) * 2009-02-09 2010-08-12 Utah State University Lidar-Assisted Stero Imager
US9560312B2 (en) * 2013-12-11 2017-01-31 Cellco Partnership Time synchronization of video and data inside a mobile device
US10242455B2 (en) * 2015-12-18 2019-03-26 Iris Automation, Inc. Systems and methods for generating a 3D world model using velocity data of a vehicle
US10437342B2 (en) * 2016-12-05 2019-10-08 Youspace, Inc. Calibration systems and methods for depth-based interfaces with disparate fields of view
US10437252B1 (en) * 2017-09-08 2019-10-08 Perceptln Shenzhen Limited High-precision multi-layer visual and semantic map for autonomous driving
JP6920159B2 (ja) * 2017-09-29 2021-08-18 株式会社デンソー 車両の周辺監視装置と周辺監視方法
US11004224B2 (en) 2019-01-22 2021-05-11 Velodyne Lidar Usa, Inc. Generation of structured map data from vehicle sensors and camera arrays

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20150094089A1 (en) * 2013-09-27 2015-04-02 Qualcomm Incorporated Hybrid photo navigation and mapping
US20170123425A1 (en) * 2015-10-09 2017-05-04 SZ DJI Technology Co., Ltd Salient feature based vehicle positioning
US20170118539A1 (en) * 2015-10-26 2017-04-27 Alpinereplay, Inc. System and method for enhanced video image recognition using motion sensors
US20170357858A1 (en) * 2016-06-09 2017-12-14 Qualcomm Incorporated Geometric matching in visual navigation systems
US20180188032A1 (en) * 2017-01-04 2018-07-05 Qualcomm Incorporated Systems and methods for using a global positioning system velocity in visual-inertial odometry
CN109211249A (zh) * 2017-06-30 2019-01-15 通用汽车环球科技运作有限责任公司 用于车辆定位的方法和系统

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114172610A (zh) * 2021-12-08 2022-03-11 北京经纬恒润科技股份有限公司 一种多源数据同步处理方法、装置及系统
CN114172610B (zh) * 2021-12-08 2024-05-07 北京经纬恒润科技股份有限公司 一种多源数据同步处理方法、装置及系统

Also Published As

Publication number Publication date
US20210248768A1 (en) 2021-08-12
JP2022518911A (ja) 2022-03-17
EP3899684A4 (en) 2023-03-08
KR20210118119A (ko) 2021-09-29
CA3127451A1 (en) 2020-07-30
IL285029A (en) 2021-09-30
WO2020154366A1 (en) 2020-07-30
US11915440B2 (en) 2024-02-27
MX2021008782A (es) 2021-11-12
US20200234459A1 (en) 2020-07-23
EP3899684A1 (en) 2021-10-27
US11004224B2 (en) 2021-05-11

Similar Documents

Publication Publication Date Title
US11915440B2 (en) Generation of structured map data from vehicle sensors and camera arrays
JP7808285B2 (ja) レーンマッピング及びナビゲーション
JP7077520B2 (ja) 自律車両の車線割り当てを決定するシステム、自律車両の車線割り当てを決定するためにコンピュータで実装された方法、およびコンピュータプログラム
US12147242B2 (en) Crowdsourcing a sparse map for autonomous vehicle navigation
EP3612854B1 (en) Vehicle navigation system using pose estimation based on point cloud
CN107145578B (zh) 地图构建方法、装置、设备和系统
EP3137850B1 (en) Method and system for determining a position relative to a digital map
EP3647734A1 (en) Automatic generation of dimensionally reduced maps and spatiotemporal localization for navigation of a vehicle
JP2021088357A (ja) 自律車両ナビゲーションのための疎な地図並びにレーン測定値のクラウドソーシング及び配信
KR102219843B1 (ko) 자율주행을 위한 위치 추정 장치 및 방법
JP6950832B2 (ja) 位置座標推定装置、位置座標推定方法およびプログラム
CN109374008A (zh) 一种基于三目摄像头的图像采集系统及方法
US20250191228A1 (en) Camera to camera calibration
CN114694111A (zh) 车辆定位
CN113508277A (zh) 车道标记定位和融合
CN113048995A (zh) 支持自主运载工具导航的长期对象跟踪
KR102358547B1 (ko) 유동성을 지닌 mms의 실측치 실시간 보정을 통한 수집데이터 출력시스템
KR20230075898A (ko) 다중플랫폼 및 다중센서 융합에 의한 데이터 수집 방법
CN115540889A (zh) 使用相机、gps和imu定位自动驾驶车辆
RU2772620C1 (ru) Создание структурированных картографических данных с помощью датчиков транспортного средства и массивов камер
JP2024546752A (ja) モバイルデバイスによるリアルタイムマッピングのための信頼性の高いアンカーポイント

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
WD01 Invention patent application deemed withdrawn after publication
WD01 Invention patent application deemed withdrawn after publication

Application publication date: 20211119