TWI509221B - 用於視覺同時區域化及映射（ｓｌａｍ）之處理器實施方法、電腦可讀穩定式儲存媒體、資料處理器件及裝置 - Google Patents

用於視覺同時區域化及映射（ｓｌａｍ）之處理器實施方法、電腦可讀穩定式儲存媒體、資料處理器件及裝置 Download PDF

Info

Publication number
TWI509221B
TWI509221B TW102139873A TW102139873A TWI509221B TW I509221 B TWI509221 B TW I509221B TW 102139873 A TW102139873 A TW 102139873A TW 102139873 A TW102139873 A TW 102139873A TW I509221 B TWI509221 B TW I509221B
Authority
TW
Taiwan
Prior art keywords
target
points
subsequent
interest
image
Prior art date
Application number
TW102139873A
Other languages
English (en)
Chinese (zh)
Other versions
TW201430315A (zh
Inventor
Gerhard Reitmayr
Alessandro Mulloni
Original Assignee
Qualcomm Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Qualcomm Inc filed Critical Qualcomm Inc
Publication of TW201430315A publication Critical patent/TW201430315A/zh
Application granted granted Critical
Publication of TWI509221B publication Critical patent/TWI509221B/zh

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/60—Type of objects
    • G06V20/64—Three-dimensional [3D] objects
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/70—Determining position or orientation of objects or cameras
    • G06T7/73—Determining position or orientation of objects or cameras using feature-based methods
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/10—Segmentation; Edge detection
    • G06T7/12—Edge-based segmentation
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10016—Video; Image sequence

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Multimedia (AREA)
  • Processing Or Creating Images (AREA)
  • Image Analysis (AREA)
  • User Interface Of Digital Computer (AREA)
  • Image Processing (AREA)
  • Studio Devices (AREA)
  • Image Generation (AREA)
TW102139873A 2012-11-02 2013-11-01 用於視覺同時區域化及映射（ｓｌａｍ）之處理器實施方法、電腦可讀穩定式儲存媒體、資料處理器件及裝置 TWI509221B (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US201261722091P 2012-11-02 2012-11-02
US13/831,405 US9576183B2 (en) 2012-11-02 2013-03-14 Fast initialization for monocular visual SLAM

Publications (2)

Publication Number Publication Date
TW201430315A TW201430315A (zh) 2014-08-01
TWI509221B true TWI509221B (zh) 2015-11-21

Family

ID=50622422

Family Applications (1)

Application Number Title Priority Date Filing Date
TW102139873A TWI509221B (zh) 2012-11-02 2013-11-01 用於視覺同時區域化及映射（ｓｌａｍ）之處理器實施方法、電腦可讀穩定式儲存媒體、資料處理器件及裝置

Country Status (8)

Country Link
US (1) US9576183B2 (enExample)
EP (1) EP2915140B1 (enExample)
JP (1) JP6258953B2 (enExample)
KR (1) KR20150082379A (enExample)
CN (1) CN104781849B (enExample)
BR (1) BR112015009521A2 (enExample)
TW (1) TWI509221B (enExample)
WO (1) WO2014070483A1 (enExample)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TWI772177B (zh) * 2021-09-10 2022-07-21 迪伸電子股份有限公司 自走裝置的移動控制方法及自走裝置

Families Citing this family (80)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9135705B2 (en) * 2012-10-16 2015-09-15 Qualcomm Incorporated Sensor calibration and position estimation based on vanishing point determination
US20140270477A1 (en) * 2013-03-14 2014-09-18 Jonathan Coon Systems and methods for displaying a three-dimensional model from a photogrammetric scan
US20140369557A1 (en) * 2013-06-14 2014-12-18 Qualcomm Incorporated Systems and Methods for Feature-Based Tracking
US9405972B2 (en) 2013-09-27 2016-08-02 Qualcomm Incorporated Exterior hybrid photo mapping
CN105825520A (zh) * 2015-01-08 2016-08-03 北京雷动云合智能技术有限公司 一种可创建大规模地图的单眼slam方法
EP3062142B1 (en) 2015-02-26 2018-10-03 Nokia Technologies OY Apparatus for a near-eye display
CN104867158B (zh) * 2015-06-03 2017-09-29 武汉理工大学 基于单目视觉的室内水面船舶精确定位系统和方法
GB2541884A (en) 2015-08-28 2017-03-08 Imp College Of Science Tech And Medicine Mapping a space using a multi-directional camera
CN107025661B (zh) * 2016-01-29 2020-08-04 成都理想境界科技有限公司 一种实现增强现实的方法、服务器、终端及系统
CN107665508B (zh) * 2016-07-29 2021-06-01 成都理想境界科技有限公司 实现增强现实的方法及系统
CN109791696B (zh) * 2016-08-24 2024-04-30 苏黎世大学 用于场景的3d重建的方法、设备和定位事件摄像机的方法
CN106197432B (zh) * 2016-08-30 2018-12-21 北京航空航天大学 一种基于FastSLAM算法的无人机着陆方法
ES3019009T3 (en) * 2016-10-07 2025-05-20 Schneider Electric Ind Sas Method for 3d mapping of 2d point of interest
CN106570913B (zh) * 2016-11-04 2019-12-13 上海玄彩美科网络科技有限公司 基于特征的单目slam快速初始化方法
US10430685B2 (en) * 2016-11-16 2019-10-01 Facebook, Inc. Deep multi-scale video prediction
US10650552B2 (en) 2016-12-29 2020-05-12 Magic Leap, Inc. Systems and methods for augmented reality
EP3343267B1 (en) 2016-12-30 2024-01-24 Magic Leap, Inc. Polychromatic light out-coupling apparatus, near-eye displays comprising the same, and method of out-coupling polychromatic light
US20200158517A1 (en) * 2017-01-19 2020-05-21 Mindmaze Holding Sa System, methods, device and apparatuses for preforming simultaneous localization and mapping
WO2018134686A2 (en) * 2017-01-19 2018-07-26 Mindmaze Holding Sa Systems, methods, device and apparatuses for performing simultaneous localization and mapping
WO2018134587A1 (en) 2017-01-23 2018-07-26 Oxford University Innovation Limited Determining the location of a mobile device
JP7221203B2 (ja) 2017-01-23 2023-02-13 オックスフォード ユニヴァーシティ イノヴェーション リミテッド モバイル装置の位置特定方法
US10659768B2 (en) * 2017-02-28 2020-05-19 Mitsubishi Electric Research Laboratories, Inc. System and method for virtually-augmented visual simultaneous localization and mapping
US10489965B1 (en) * 2017-03-24 2019-11-26 Mappedin Inc. Systems and methods for positioning a virtual camera
US10848741B2 (en) * 2017-06-12 2020-11-24 Adobe Inc. Re-cinematography for spherical video
US10578870B2 (en) 2017-07-26 2020-03-03 Magic Leap, Inc. Exit pupil expander
CN111094893A (zh) 2017-07-28 2020-05-01 高通股份有限公司 机器人式运载工具的图像传感器初始化
US11551368B2 (en) * 2017-08-31 2023-01-10 Sony Group Corporation Electronic devices, methods, and computer program products for controlling 3D modeling operations based on pose metrics
US10497145B2 (en) * 2017-11-16 2019-12-03 Nec Corporation System and method for real-time large image homography processing
KR102596429B1 (ko) 2017-12-10 2023-10-30 매직 립, 인코포레이티드 광학 도파관들 상의 반사―방지 코팅들
US10402986B2 (en) * 2017-12-20 2019-09-03 Facebook, Inc. Unsupervised video segmentation
KR102761610B1 (ko) 2017-12-20 2025-01-31 매직 립, 인코포레이티드 증강 현실 뷰잉 디바이스용 인서트
US10311646B1 (en) * 2018-02-26 2019-06-04 Capital One Services, Llc Dynamic configuration of an augmented reality overlay
AU2019227833A1 (en) * 2018-03-01 2020-10-22 Lappidus, Inc Virtual asset tagging and augmented camera display system and method of use
CN112136152B (zh) 2018-03-15 2025-02-07 奇跃公司 由观看设备的部件变形导致的图像校正
CN110264509B (zh) * 2018-04-27 2022-10-14 腾讯科技（深圳）有限公司 确定图像捕捉设备的位姿的方法、装置及其存储介质
CN112236713B (zh) 2018-05-30 2023-01-24 奇跃公司 紧凑的可变聚焦配置
JP7319303B2 (ja) * 2018-05-31 2023-08-01 マジック リープ， インコーポレイテッド レーダ頭部姿勢位置特定
CN112400157B (zh) 2018-06-05 2024-07-09 奇跃公司 观看系统的基于单应性变换矩阵的温度校准
CN112513785B (zh) 2018-06-08 2024-11-05 奇跃公司 具有自动表面选择放置和内容取向放置的增强现实观看器
WO2020010097A1 (en) 2018-07-02 2020-01-09 Magic Leap, Inc. Pixel intensity modulation using modifying gain values
US11510027B2 (en) 2018-07-03 2022-11-22 Magic Leap, Inc. Systems and methods for virtual and augmented reality
US11856479B2 (en) 2018-07-03 2023-12-26 Magic Leap, Inc. Systems and methods for virtual and augmented reality along a route with markers
JP7374981B2 (ja) 2018-07-10 2023-11-07 マジック リープ， インコーポレイテッド クロス命令セットアーキテクチャプロシージャ呼出のためのスレッドウィービング
US11624929B2 (en) 2018-07-24 2023-04-11 Magic Leap, Inc. Viewing device with dust seal integration
CN119197613A (zh) 2018-07-24 2024-12-27 奇跃公司 移动检测设备的依赖于温度的校准
WO2020028834A1 (en) 2018-08-02 2020-02-06 Magic Leap, Inc. A viewing system with interpupillary distance compensation based on head motion
JP7438188B2 (ja) 2018-08-03 2024-02-26 マジック リープ， インコーポレイテッド ユーザ相互作用システムにおけるトーテムの融合姿勢の非融合姿勢ベースのドリフト補正
JP7487176B2 (ja) 2018-08-22 2024-05-20 マジック リープ， インコーポレイテッド 患者視認システム
JP7434303B2 (ja) 2018-10-12 2024-02-20 マジック リープ， インコーポレイテッド 運動追跡システムの正確度を検証するためのステージングシステム
EP3881279A4 (en) 2018-11-16 2022-08-17 Magic Leap, Inc. IMAGE SIZE TRIGGERED CLEARANCE TO MAINTAIN IMAGE SHARPNESS
JP7543274B2 (ja) 2018-12-21 2024-09-02 マジック リープ， インコーポレイテッド 導波管内の全内部反射を助長するための空気ポケット構造
CN109917644B (zh) * 2018-12-26 2022-06-14 达闼科技（北京）有限公司 一种提高视觉惯导系统鲁棒性的方法、装置和机器人设备
CN109493685B (zh) * 2018-12-29 2021-03-30 深圳市掌网科技股份有限公司 一种基于增强现实的虚拟打击乐器训练系统
WO2020163603A1 (en) 2019-02-06 2020-08-13 Magic Leap, Inc. Target intent-based clock speed determination and adjustment to limit total heat generated by multiple processors
WO2020185405A1 (en) 2019-03-12 2020-09-17 Magic Leap, Inc. Registration of local content between first and second augmented reality viewers
US12597141B2 (en) * 2019-03-22 2026-04-07 Vergence Automation, Inc. System for optical determination of coefficient of friction for a surface
US10955245B2 (en) * 2019-04-30 2021-03-23 Samsung Electronics Co., Ltd. System and method for low latency, high performance pose fusion
EP3963565A4 (en) 2019-05-01 2022-10-12 Magic Leap, Inc. CONTENT DELIVERY SYSTEM AND PROCEDURES
CN110321902B (zh) * 2019-05-09 2021-07-13 哈尔滨工业大学 一种基于socp的室内自动视觉指纹采集方法
CN110298884B (zh) * 2019-05-27 2023-05-30 重庆高开清芯科技产业发展有限公司 一种适于动态环境中单目视觉相机的位姿估计方法
CN112215880B (zh) * 2019-07-10 2022-05-06 浙江商汤科技开发有限公司 一种图像深度估计方法及装置、电子设备、存储介质
CN112243082B (zh) * 2019-07-17 2022-09-06 百度时代网络技术（北京）有限公司 一种跟踪拍摄方法、装置、电子设备及存储介质
JP7609844B2 (ja) 2019-07-26 2025-01-07 マジック リープ， インコーポレイテッド 拡張現実のためのシステムおよび方法
US11514594B2 (en) 2019-10-30 2022-11-29 Vergence Automation, Inc. Composite imaging systems using a focal plane array with in-pixel analog storage elements
CN114730490A (zh) 2019-11-14 2022-07-08 奇跃公司 用于虚拟现实和增强现实的系统和方法
EP4058979A4 (en) 2019-11-15 2023-01-11 Magic Leap, Inc. VISUALIZATION SYSTEM FOR USE IN A SURGICAL ENVIRONMENT
US11340696B2 (en) * 2020-01-13 2022-05-24 Sony Interactive Entertainment Inc. Event driven sensor (EDS) tracking of light emitting diode (LED) array
US11315346B2 (en) * 2020-01-16 2022-04-26 Square Enix Co., Ltd. Method for producing augmented reality image
US12230649B2 (en) 2020-05-19 2025-02-18 Vergence Automation, Inc. AI system on chip (SOC) for robotics vision applications
US11687086B2 (en) * 2020-07-09 2023-06-27 Brookhurst Garage, Inc. Autonomous robotic navigation in storage site
US11113894B1 (en) * 2020-09-11 2021-09-07 Microsoft Technology Licensing, Llc Systems and methods for GPS-based and sensor-based relocalization
US12567158B2 (en) * 2021-12-10 2026-03-03 Samsung Electronics Co., Ltd. Apparatus and method with image processing and target tracking
US20250069301A1 (en) 2022-01-06 2025-02-27 Sony Group Corporation Information processing device, information processing method, and program
US12437367B2 (en) 2022-11-16 2025-10-07 Snap Inc. Real-time try-on using body landmarks
KR20240079660A (ko) * 2022-11-29 2024-06-05 한국전자기술연구원 단안 컬러 이미지 기반의 실시간 3d 휴먼 객체 복원 장치 및 방법
IT202300000291A1 (it) * 2023-01-12 2024-07-12 Lab S R L Processo di individuazione post-trattamento simultaneo di una pluralità di oggetti trattati e posizionati su una base di trattamento
US12406444B2 (en) * 2023-02-23 2025-09-02 Snap Inc. Real-time fashion item transfer system
CN117641085B (zh) * 2023-11-29 2025-04-04 广州安特激光技术有限公司 基于液态镜头的动态跟踪监控系统及方法
WO2025198902A1 (en) * 2024-03-21 2025-09-25 Bonsai Robotics Inc. Architecture for identifying the position of an autonomous machine
US12501860B2 (en) 2024-03-21 2025-12-23 Bonsai Robotics Inc. Autonomous navigation in an orchard for harvesting

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5889505A (en) * 1996-04-04 1999-03-30 Yale University Vision-based six-degree-of-freedom computer input device
TW201214266A (en) * 2010-08-04 2012-04-01 Apple Inc Three dimensional user interface effects on a display by using properties of motion

Family Cites Families (19)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6288704B1 (en) 1999-06-08 2001-09-11 Vega, Vista, Inc. Motion detection and tracking system to control navigation and display of object viewers
WO2004059900A2 (en) 2002-12-17 2004-07-15 Evolution Robotics, Inc. Systems and methods for visual simultaneous localization and mapping
US20080310757A1 (en) * 2007-06-15 2008-12-18 George Wolberg System and related methods for automatically aligning 2D images of a scene to a 3D model of the scene
JP5012615B2 (ja) * 2008-03-27 2012-08-29 ソニー株式会社 情報処理装置、および画像処理方法、並びにコンピュータ・プログラム
US8970690B2 (en) 2009-02-13 2015-03-03 Metaio Gmbh Methods and systems for determining the pose of a camera with respect to at least one object of a real environment
JP5487298B2 (ja) * 2009-06-11 2014-05-07 株式会社東芝 ３次元画像生成
JP5683851B2 (ja) 2009-08-20 2015-03-11 株式会社ザクティ 撮像装置及び画像処理装置
IL202460A (en) * 2009-12-01 2013-08-29 Rafael Advanced Defense Sys Method and system for creating a 3D view of real arena for military planning and operations
KR101633620B1 (ko) * 2010-01-04 2016-06-27 삼성전자 주식회사 영상 기반의 위치 인식을 위한 특징점 등록 장치 및 그 방법
JP2011159163A (ja) * 2010-02-02 2011-08-18 Sony Corp 画像処理装置、画像処理方法及びプログラム
FR2960082B1 (fr) * 2010-05-17 2012-08-10 Commissariat Energie Atomique Procede et systeme pour fusionner des donnees issues de capteurs d'images et de capteurs de mouvement ou de position
JP5612916B2 (ja) * 2010-06-18 2014-10-22 キヤノン株式会社 位置姿勢計測装置、その処理方法、プログラム、ロボットシステム
US8532367B2 (en) * 2010-08-17 2013-09-10 Raytheon Company System and method for 3D wireframe reconstruction from video
JP5743501B2 (ja) 2010-11-25 2015-07-01 キヤノン株式会社 物体追尾装置、物体追尾方法、及び物体追尾プログラム
US8570320B2 (en) * 2011-01-31 2013-10-29 Microsoft Corporation Using a three-dimensional environment model in gameplay
JP2012181688A (ja) 2011-03-01 2012-09-20 Sony Corp 情報処理装置、情報処理方法、情報処理システムおよびプログラム
WO2013126784A2 (en) * 2012-02-23 2013-08-29 Huston Charles D System and method for creating an environment and for sharing a location based experience in an environment
US9183631B2 (en) * 2012-06-29 2015-11-10 Mitsubishi Electric Research Laboratories, Inc. Method for registering points and planes of 3D data in multiple coordinate systems
US8831290B2 (en) * 2012-08-01 2014-09-09 Mitsubishi Electric Research Laboratories, Inc. Method and system for determining poses of vehicle-mounted cameras for in-road obstacle detection

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5889505A (en) * 1996-04-04 1999-03-30 Yale University Vision-based six-degree-of-freedom computer input device
TW201214266A (en) * 2010-08-04 2012-04-01 Apple Inc Three dimensional user interface effects on a display by using properties of motion

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TWI772177B (zh) * 2021-09-10 2022-07-21 迪伸電子股份有限公司 自走裝置的移動控制方法及自走裝置

Also Published As

Publication number Publication date
CN104781849B (zh) 2018-05-25
TW201430315A (zh) 2014-08-01
BR112015009521A2 (pt) 2017-07-04
KR20150082379A (ko) 2015-07-15
JP6258953B2 (ja) 2018-01-10
CN104781849A (zh) 2015-07-15
US20140126769A1 (en) 2014-05-08
JP2016502712A (ja) 2016-01-28
EP2915140B1 (en) 2018-10-17
EP2915140A1 (en) 2015-09-09
WO2014070483A1 (en) 2014-05-08
US9576183B2 (en) 2017-02-21

Similar Documents

Publication Publication Date Title
CN104781849B (zh) 单眼视觉同时定位与建图(slam)的快速初始化
US11481982B2 (en) In situ creation of planar natural feature targets
CN105210113B (zh) 具有一般和全景相机移动的单眼视觉slam
EP2992507B1 (en) Methods for facilitating computer vision application initialization
CN110352446A (zh) 用于获得图像的方法和装置及其记录介质
JP2016522485A (ja) 再構成からの隠消現実感効果および媒介現実感効果
WO2017041740A1 (en) Methods and systems for light field augmented reality/virtual reality on mobile devices
US20200211275A1 (en) Information processing device, information processing method, and recording medium
EP4392940B1 (en) Re-classification of static pixels and dynamic pixels in stereoscopic images
CN120765815A (zh) 渲染处理方法及电子设备

Legal Events

Date Code Title Description
MM4A Annulment or lapse of patent due to non-payment of fees