CN104781849B - 单眼视觉同时定位与建图(slam)的快速初始化 - Google Patents

单眼视觉同时定位与建图(slam)的快速初始化 Download PDF

Info

Publication number
CN104781849B
CN104781849B CN201380056667.7A CN201380056667A CN104781849B CN 104781849 B CN104781849 B CN 104781849B CN 201380056667 A CN201380056667 A CN 201380056667A CN 104781849 B CN104781849 B CN 104781849B
Authority
CN
China
Prior art keywords
points
target
subsequent
interest
image
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201380056667.7A
Other languages
English (en)
Chinese (zh)
Other versions
CN104781849A (zh
Inventor
格哈德·赖特迈尔
亚历山德罗·穆洛尼
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Qualcomm Inc
Original Assignee
Qualcomm Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Qualcomm Inc filed Critical Qualcomm Inc
Publication of CN104781849A publication Critical patent/CN104781849A/zh
Application granted granted Critical
Publication of CN104781849B publication Critical patent/CN104781849B/zh
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/60—Type of objects
    • G06V20/64—Three-dimensional [3D] objects
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/70—Determining position or orientation of objects or cameras
    • G06T7/73—Determining position or orientation of objects or cameras using feature-based methods
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/10—Segmentation; Edge detection
    • G06T7/12—Edge-based segmentation
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10016—Video; Image sequence

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Multimedia (AREA)
  • Processing Or Creating Images (AREA)
  • Image Analysis (AREA)
  • User Interface Of Digital Computer (AREA)
  • Studio Devices (AREA)
  • Image Processing (AREA)
  • Image Generation (AREA)
CN201380056667.7A 2012-11-02 2013-10-18 单眼视觉同时定位与建图(slam)的快速初始化 Active CN104781849B (zh)

Applications Claiming Priority (5)

Application Number Priority Date Filing Date Title
US201261722091P 2012-11-02 2012-11-02
US61/722,091 2012-11-02
US13/831,405 US9576183B2 (en) 2012-11-02 2013-03-14 Fast initialization for monocular visual SLAM
US13/831,405 2013-03-14
PCT/US2013/065654 WO2014070483A1 (en) 2012-11-02 2013-10-18 Fast initialization for monocular visual slam

Publications (2)

Publication Number Publication Date
CN104781849A CN104781849A (zh) 2015-07-15
CN104781849B true CN104781849B (zh) 2018-05-25

Family

ID=50622422

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201380056667.7A Active CN104781849B (zh) 2012-11-02 2013-10-18 单眼视觉同时定位与建图(slam)的快速初始化

Country Status (8)

Country Link
US (1) US9576183B2 (https=)
EP (1) EP2915140B1 (https=)
JP (1) JP6258953B2 (https=)
KR (1) KR20150082379A (https=)
CN (1) CN104781849B (https=)
BR (1) BR112015009521A2 (https=)
TW (1) TWI509221B (https=)
WO (1) WO2014070483A1 (https=)

Families Citing this family (80)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9135705B2 (en) 2012-10-16 2015-09-15 Qualcomm Incorporated Sensor calibration and position estimation based on vanishing point determination
US20140270477A1 (en) * 2013-03-14 2014-09-18 Jonathan Coon Systems and methods for displaying a three-dimensional model from a photogrammetric scan
US20140369557A1 (en) * 2013-06-14 2014-12-18 Qualcomm Incorporated Systems and Methods for Feature-Based Tracking
US9400930B2 (en) 2013-09-27 2016-07-26 Qualcomm Incorporated Hybrid photo navigation and mapping
CN105825520A (zh) * 2015-01-08 2016-08-03 北京雷动云合智能技术有限公司 一种可创建大规模地图的单眼slam方法
EP3062142B1 (en) 2015-02-26 2018-10-03 Nokia Technologies OY Apparatus for a near-eye display
CN104867158B (zh) * 2015-06-03 2017-09-29 武汉理工大学 基于单目视觉的室内水面船舶精确定位系统和方法
GB2541884A (en) 2015-08-28 2017-03-08 Imp College Of Science Tech And Medicine Mapping a space using a multi-directional camera
CN107025661B (zh) * 2016-01-29 2020-08-04 成都理想境界科技有限公司 一种实现增强现实的方法、服务器、终端及系统
CN107665508B (zh) * 2016-07-29 2021-06-01 成都理想境界科技有限公司 实现增强现实的方法及系统
WO2018037079A1 (en) * 2016-08-24 2018-03-01 Universität Zürich Simultaneous localization and mapping with an event camera
CN106197432B (zh) * 2016-08-30 2018-12-21 北京航空航天大学 一种基于FastSLAM算法的无人机着陆方法
EP3306572B1 (en) * 2016-10-07 2025-03-05 Schneider Electric Industries SAS Method for 3d mapping of 2d point of interest
CN106570913B (zh) * 2016-11-04 2019-12-13 上海玄彩美科网络科技有限公司 基于特征的单目slam快速初始化方法
US10430685B2 (en) * 2016-11-16 2019-10-01 Facebook, Inc. Deep multi-scale video prediction
US10650552B2 (en) 2016-12-29 2020-05-12 Magic Leap, Inc. Systems and methods for augmented reality
EP4300160A3 (en) 2016-12-30 2024-05-29 Magic Leap, Inc. Polychromatic light out-coupling apparatus, near-eye displays comprising the same, and method of out-coupling polychromatic light
WO2018134686A2 (en) * 2017-01-19 2018-07-26 Mindmaze Holding Sa Systems, methods, device and apparatuses for performing simultaneous localization and mapping
US20200158517A1 (en) * 2017-01-19 2020-05-21 Mindmaze Holding Sa System, methods, device and apparatuses for preforming simultaneous localization and mapping
US11436749B2 (en) 2017-01-23 2022-09-06 Oxford University Innovation Limited Determining the location of a mobile device
WO2018134587A1 (en) 2017-01-23 2018-07-26 Oxford University Innovation Limited Determining the location of a mobile device
US10659768B2 (en) * 2017-02-28 2020-05-19 Mitsubishi Electric Research Laboratories, Inc. System and method for virtually-augmented visual simultaneous localization and mapping
US10489965B1 (en) * 2017-03-24 2019-11-26 Mappedin Inc. Systems and methods for positioning a virtual camera
US10848741B2 (en) * 2017-06-12 2020-11-24 Adobe Inc. Re-cinematography for spherical video
US10578870B2 (en) 2017-07-26 2020-03-03 Magic Leap, Inc. Exit pupil expander
WO2019019157A1 (en) 2017-07-28 2019-01-31 Qualcomm Incorporated INITIALIZING IMAGE SENSOR IN A ROBOTIC VEHICLE
EP3676801B1 (en) * 2017-08-31 2023-08-02 Sony Group Corporation Electronic devices, methods, and computer program products for controlling 3d modeling operations based on pose metrics
US10497145B2 (en) * 2017-11-16 2019-12-03 Nec Corporation System and method for real-time large image homography processing
KR20250138816A (ko) 2017-12-10 2025-09-22 매직 립, 인코포레이티드 광학 도파관들 상의 반사―방지 코팅들
CA3086206A1 (en) 2017-12-20 2019-06-27 Magic Leap, Inc. Insert for augmented reality viewing device
US10402986B2 (en) * 2017-12-20 2019-09-03 Facebook, Inc. Unsupervised video segmentation
US10311646B1 (en) 2018-02-26 2019-06-04 Capital One Services, Llc Dynamic configuration of an augmented reality overlay
WO2019169085A1 (en) * 2018-03-01 2019-09-06 Michael Melcher Virtual asset tagging and augmented camera display system and method of use
EP3766039B1 (en) 2018-03-15 2024-08-14 Magic Leap, Inc. Image correction due to deformation of components of a viewing device
CN110264509B (zh) 2018-04-27 2022-10-14 腾讯科技（深圳）有限公司 确定图像捕捉设备的位姿的方法、装置及其存储介质
WO2019232282A1 (en) 2018-05-30 2019-12-05 Magic Leap, Inc. Compact variable focus configurations
JP7319303B2 (ja) 2018-05-31 2023-08-01 マジック リープ， インコーポレイテッド レーダ頭部姿勢位置特定
EP3804306B1 (en) 2018-06-05 2023-12-27 Magic Leap, Inc. Homography transformation matrices based temperature calibration of a viewing system
JP7421505B2 (ja) 2018-06-08 2024-01-24 マジック リープ， インコーポレイテッド 自動化された表面選択設置およびコンテンツ配向設置を用いた拡張現実ビューア
WO2020010097A1 (en) 2018-07-02 2020-01-09 Magic Leap, Inc. Pixel intensity modulation using modifying gain values
US11856479B2 (en) 2018-07-03 2023-12-26 Magic Leap, Inc. Systems and methods for virtual and augmented reality along a route with markers
US11510027B2 (en) 2018-07-03 2022-11-22 Magic Leap, Inc. Systems and methods for virtual and augmented reality
JP7374981B2 (ja) 2018-07-10 2023-11-07 マジック リープ， インコーポレイテッド クロス命令セットアーキテクチャプロシージャ呼出のためのスレッドウィービング
WO2020023543A1 (en) 2018-07-24 2020-01-30 Magic Leap, Inc. Viewing device with dust seal integration
WO2020023545A1 (en) 2018-07-24 2020-01-30 Magic Leap, Inc. Temperature dependent calibration of movement detection devices
EP3831058B1 (en) 2018-08-02 2025-10-08 Magic Leap, Inc. A viewing system with interpupillary distance compensation based on head motion
EP3830631A4 (en) 2018-08-03 2021-10-27 Magic Leap, Inc. DRIFT CORRECTION BASED ON UNMERGED LAYING OF MELTED LAYING OF A TOTEM IN A USER INTERACTION SYSTEM
US12016719B2 (en) 2018-08-22 2024-06-25 Magic Leap, Inc. Patient viewing system
CN113196138B (zh) 2018-11-16 2023-08-25 奇跃公司 用于保持图像清晰度的图像尺寸触发的澄清
WO2020132484A1 (en) 2018-12-21 2020-06-25 Magic Leap, Inc. Air pocket structures for promoting total internal reflection in a waveguide
CN109917644B (zh) * 2018-12-26 2022-06-14 达闼科技（北京）有限公司 一种提高视觉惯导系统鲁棒性的方法、装置和机器人设备
CN109493685B (zh) * 2018-12-29 2021-03-30 深圳市掌网科技股份有限公司 一种基于增强现实的虚拟打击乐器训练系统
EP3921720B1 (en) 2019-02-06 2024-05-22 Magic Leap, Inc. Target intent-based clock speed determination and adjustment to limit total heat generated by multiple processors
CN113544766B (zh) 2019-03-12 2024-12-03 奇跃公司 在第一和第二增强现实观看器之间配准本地内容
US12597141B2 (en) * 2019-03-22 2026-04-07 Vergence Automation, Inc. System for optical determination of coefficient of friction for a surface
US10955245B2 (en) * 2019-04-30 2021-03-23 Samsung Electronics Co., Ltd. System and method for low latency, high performance pose fusion
JP2022530900A (ja) 2019-05-01 2022-07-04 マジック リープ， インコーポレイテッド コンテンツプロビジョニングシステムおよび方法
CN110321902B (zh) * 2019-05-09 2021-07-13 哈尔滨工业大学 一种基于socp的室内自动视觉指纹采集方法
CN110298884B (zh) * 2019-05-27 2023-05-30 重庆高开清芯科技产业发展有限公司 一种适于动态环境中单目视觉相机的位姿估计方法
CN112215880B (zh) * 2019-07-10 2022-05-06 浙江商汤科技开发有限公司 一种图像深度估计方法及装置、电子设备、存储介质
CN112243082B (zh) * 2019-07-17 2022-09-06 百度时代网络技术（北京）有限公司 一种跟踪拍摄方法、装置、电子设备及存储介质
CN114174895B (zh) 2019-07-26 2025-07-08 奇跃公司 用于增强现实的系统和方法
US11514594B2 (en) 2019-10-30 2022-11-29 Vergence Automation, Inc. Composite imaging systems using a focal plane array with in-pixel analog storage elements
JP7635230B2 (ja) 2019-11-14 2025-02-25 マジック リープ， インコーポレイテッド 仮想および拡張現実のためのシステムおよび方法
WO2021097323A1 (en) 2019-11-15 2021-05-20 Magic Leap, Inc. A viewing system for use in a surgical environment
US11340696B2 (en) * 2020-01-13 2022-05-24 Sony Interactive Entertainment Inc. Event driven sensor (EDS) tracking of light emitting diode (LED) array
US11315346B2 (en) * 2020-01-16 2022-04-26 Square Enix Co., Ltd. Method for producing augmented reality image
US12230649B2 (en) 2020-05-19 2025-02-18 Vergence Automation, Inc. AI system on chip (SOC) for robotics vision applications
US11687086B2 (en) * 2020-07-09 2023-06-27 Brookhurst Garage, Inc. Autonomous robotic navigation in storage site
US11113894B1 (en) * 2020-09-11 2021-09-07 Microsoft Technology Licensing, Llc Systems and methods for GPS-based and sensor-based relocalization
TWI772177B (zh) * 2021-09-10 2022-07-21 迪伸電子股份有限公司 自走裝置的移動控制方法及自走裝置
US12567158B2 (en) * 2021-12-10 2026-03-03 Samsung Electronics Co., Ltd. Apparatus and method with image processing and target tracking
WO2023132269A1 (ja) 2022-01-06 2023-07-13 ソニーグループ株式会社 情報処理装置、および情報処理方法、並びにプログラム
US12437367B2 (en) 2022-11-16 2025-10-07 Snap Inc. Real-time try-on using body landmarks
KR20240079660A (ko) * 2022-11-29 2024-06-05 한국전자기술연구원 단안 컬러 이미지 기반의 실시간 3d 휴먼 객체 복원 장치 및 방법
IT202300000291A1 (it) * 2023-01-12 2024-07-12 Lab S R L Processo di individuazione post-trattamento simultaneo di una pluralità di oggetti trattati e posizionati su una base di trattamento
US12406444B2 (en) * 2023-02-23 2025-09-02 Snap Inc. Real-time fashion item transfer system
CN117641085B (zh) * 2023-11-29 2025-04-04 广州安特激光技术有限公司 基于液态镜头的动态跟踪监控系统及方法
US12501860B2 (en) 2024-03-21 2025-12-23 Bonsai Robotics Inc. Autonomous navigation in an orchard for harvesting
WO2025198902A1 (en) * 2024-03-21 2025-09-25 Bonsai Robotics Inc. Architecture for identifying the position of an autonomous machine

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20100208057A1 (en) * 2009-02-13 2010-08-19 Peter Meier Methods and systems for determining the pose of a camera with respect to at least one object of a real environment
WO2010142929A1 (en) * 2009-06-11 2010-12-16 Toshiba Research Europe Limited 3d image generation

Family Cites Families (19)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5889505A (en) 1996-04-04 1999-03-30 Yale University Vision-based six-degree-of-freedom computer input device
US6288704B1 (en) 1999-06-08 2001-09-11 Vega, Vista, Inc. Motion detection and tracking system to control navigation and display of object viewers
US7015831B2 (en) 2002-12-17 2006-03-21 Evolution Robotics, Inc. Systems and methods for incrementally updating a pose of a mobile device calculated by visual simultaneous localization and mapping techniques
US20080310757A1 (en) * 2007-06-15 2008-12-18 George Wolberg System and related methods for automatically aligning 2D images of a scene to a 3D model of the scene
JP5012615B2 (ja) * 2008-03-27 2012-08-29 ソニー株式会社 情報処理装置、および画像処理方法、並びにコンピュータ・プログラム
JP5683851B2 (ja) 2009-08-20 2015-03-11 株式会社ザクティ 撮像装置及び画像処理装置
IL202460A (en) * 2009-12-01 2013-08-29 Rafael Advanced Defense Sys Method and system for creating a 3D view of real arena for military planning and operations
KR101633620B1 (ko) * 2010-01-04 2016-06-27 삼성전자 주식회사 영상 기반의 위치 인식을 위한 특징점 등록 장치 및 그 방법
JP2011159163A (ja) * 2010-02-02 2011-08-18 Sony Corp 画像処理装置、画像処理方法及びプログラム
FR2960082B1 (fr) * 2010-05-17 2012-08-10 Commissariat Energie Atomique Procede et systeme pour fusionner des donnees issues de capteurs d'images et de capteurs de mouvement ou de position
JP5612916B2 (ja) * 2010-06-18 2014-10-22 キヤノン株式会社 位置姿勢計測装置、その処理方法、プログラム、ロボットシステム
US8913056B2 (en) 2010-08-04 2014-12-16 Apple Inc. Three dimensional user interface effects on a display by using properties of motion
US8532367B2 (en) * 2010-08-17 2013-09-10 Raytheon Company System and method for 3D wireframe reconstruction from video
JP5743501B2 (ja) 2010-11-25 2015-07-01 キヤノン株式会社 物体追尾装置、物体追尾方法、及び物体追尾プログラム
US8570320B2 (en) * 2011-01-31 2013-10-29 Microsoft Corporation Using a three-dimensional environment model in gameplay
JP2012181688A (ja) 2011-03-01 2012-09-20 Sony Corp 情報処理装置、情報処理方法、情報処理システムおよびプログラム
WO2013126784A2 (en) * 2012-02-23 2013-08-29 Huston Charles D System and method for creating an environment and for sharing a location based experience in an environment
US9183631B2 (en) * 2012-06-29 2015-11-10 Mitsubishi Electric Research Laboratories, Inc. Method for registering points and planes of 3D data in multiple coordinate systems
US8831290B2 (en) * 2012-08-01 2014-09-09 Mitsubishi Electric Research Laboratories, Inc. Method and system for determining poses of vehicle-mounted cameras for in-road obstacle detection

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20100208057A1 (en) * 2009-02-13 2010-08-19 Peter Meier Methods and systems for determining the pose of a camera with respect to at least one object of a real environment
WO2010142929A1 (en) * 2009-06-11 2010-12-16 Toshiba Research Europe Limited 3d image generation

Non-Patent Citations (3)

* Cited by examiner, † Cited by third party
Title
Inverse Depth Parametrization for Monocular SLAM;Javier Civera et al;《IEEE TRANSACTIONS ON ROBOTICS》;20081031;第24卷(第5期);全文 *
Parallel Tracking and Mapping for Small AR Workspaces;Georg Klein et al;《Proceedings of the 2007 6th IEEE and ACM International Symposium on Mixed and Augmented Reality》;20071116;第5.6节 *
Parallel Tracking and Mapping on a camera phone;Georg Klein et al;《Proceedings of the 2009 8th IEEE International Symposium on Mixed and Augmented Reality》;20091022;第3.1节、第4节、第5.1节、第5.2节、第7节，图1 *

Also Published As

Publication number Publication date
TW201430315A (zh) 2014-08-01
WO2014070483A1 (en) 2014-05-08
TWI509221B (zh) 2015-11-21
CN104781849A (zh) 2015-07-15
BR112015009521A2 (pt) 2017-07-04
US9576183B2 (en) 2017-02-21
JP6258953B2 (ja) 2018-01-10
JP2016502712A (ja) 2016-01-28
EP2915140B1 (en) 2018-10-17
EP2915140A1 (en) 2015-09-09
US20140126769A1 (en) 2014-05-08
KR20150082379A (ko) 2015-07-15

Similar Documents

Publication Publication Date Title
CN104781849B (zh) 单眼视觉同时定位与建图(slam)的快速初始化
US11481982B2 (en) In situ creation of planar natural feature targets
CN105210113B (zh) 具有一般和全景相机移动的单眼视觉slam
CN107111880B (zh) 针对计算机视觉的遮挡处置
US9667873B2 (en) Methods for facilitating computer vision application initialization
CN110352446A (zh) 用于获得图像的方法和装置及其记录介质
CN107683496B (zh) 用于3d地图的假设线地图绘制和验证

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant