JP6125100B2 - 点特徴と線特徴とを使用する堅牢な追跡 - Google Patents

点特徴と線特徴とを使用する堅牢な追跡 Download PDF

Info

Publication number
JP6125100B2
JP6125100B2 JP2016519514A JP2016519514A JP6125100B2 JP 6125100 B2 JP6125100 B2 JP 6125100B2 JP 2016519514 A JP2016519514 A JP 2016519514A JP 2016519514 A JP2016519514 A JP 2016519514A JP 6125100 B2 JP6125100 B2 JP 6125100B2
Authority
JP
Japan
Prior art keywords
image
feature
point
current image
model
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
JP2016519514A
Other languages
English (en)
Japanese (ja)
Other versions
JP2016521885A5 (enExample
JP2016521885A (ja
Inventor
ディーラジュ・アフジャー
キヨン・キム
ヤンハイ・ツィン
セイエド・ヘサメディン・ナジャフィ・ショウシュタリ
Original Assignee
クアルコム，インコーポレイテッド
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by クアルコム，インコーポレイテッド filed Critical クアルコム，インコーポレイテッド
Publication of JP2016521885A publication Critical patent/JP2016521885A/ja
Publication of JP2016521885A5 publication Critical patent/JP2016521885A5/ja
Application granted granted Critical
Publication of JP6125100B2 publication Critical patent/JP6125100B2/ja
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
    • H04N7/183—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast for receiving images from a single remote source
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/20—Analysis of motion
    • G06T7/246—Analysis of motion using feature-based methods, e.g. the tracking of corners or segments
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/70—Determining position or orientation of objects or cameras
    • G06T7/73—Determining position or orientation of objects or cameras using feature-based methods
    • G06T7/75—Determining position or orientation of objects or cameras using feature-based methods involving models
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20021—Dividing image into blocks, subimages or windows
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30244—Camera pose

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Image Analysis (AREA)
JP2016519514A 2013-06-14 2014-05-16 点特徴と線特徴とを使用する堅牢な追跡 Expired - Fee Related JP6125100B2 (ja)

Applications Claiming Priority (5)

Application Number Priority Date Filing Date Title
US201361835402P 2013-06-14 2013-06-14
US61/835,402 2013-06-14
US14/278,928 US9406137B2 (en) 2013-06-14 2014-05-15 Robust tracking using point and line features
US14/278,928 2014-05-15
PCT/US2014/038461 WO2014200665A1 (en) 2013-06-14 2014-05-16 Robust tracking using point and line features

Publications (3)

Publication Number Publication Date
JP2016521885A JP2016521885A (ja) 2016-07-25
JP2016521885A5 JP2016521885A5 (enExample) 2016-12-15
JP6125100B2 true JP6125100B2 (ja) 2017-05-10

Family

ID=52018894

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2016519514A Expired - Fee Related JP6125100B2 (ja) 2013-06-14 2014-05-16 点特徴と線特徴とを使用する堅牢な追跡

Country Status (6)

Country Link
US (1) US9406137B2 (enExample)
EP (1) EP3008695B1 (enExample)
JP (1) JP6125100B2 (enExample)
KR (1) KR101722654B1 (enExample)
CN (1) CN105283905B (enExample)
WO (1) WO2014200665A1 (enExample)

Families Citing this family (39)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9135646B2 (en) * 2013-10-09 2015-09-15 Ricoh Company, Ltd. Associating advertising content with a channel
EP3164991A1 (en) * 2014-07-03 2017-05-10 Amiad Gurman A method of perceiving 3d structure from a pair of images
JP6723798B2 (ja) * 2015-05-20 2020-07-15 キヤノン株式会社 情報処理装置、方法、プログラム
US10282591B2 (en) 2015-08-24 2019-05-07 Qualcomm Incorporated Systems and methods for depth map sampling
US9849591B2 (en) * 2015-10-02 2017-12-26 X Development Llc Localization of a robot in an environment using detected edges of a camera image from a camera of the robot and detected edges derived from a three-dimensional model of the environment
US10260862B2 (en) * 2015-11-02 2019-04-16 Mitsubishi Electric Research Laboratories, Inc. Pose estimation using sensors
US10217231B2 (en) * 2016-05-31 2019-02-26 Microsoft Technology Licensing, Llc Systems and methods for utilizing anchor graphs in mixed reality environments
US10290111B2 (en) * 2016-07-26 2019-05-14 Qualcomm Incorporated Systems and methods for compositing images
JP2018036901A (ja) * 2016-08-31 2018-03-08 富士通株式会社 画像処理装置、画像処理方法および画像処理プログラム
WO2018144929A1 (en) * 2017-02-02 2018-08-09 Infatics, Inc. (DBA DroneDeploy) System and methods for improved aerial mapping with aerial vehicles
US11048325B2 (en) 2017-07-10 2021-06-29 Samsung Electronics Co., Ltd. Wearable augmented reality head mounted display device for phone content display and health monitoring
CN108021921A (zh) * 2017-11-23 2018-05-11 塔普翊海（上海）智能科技有限公司 图像特征点提取系统及其应用
CA3084057A1 (en) 2017-12-15 2019-06-20 Magic Leap, Inc. Enhanced pose determination for display device
WO2019194561A1 (ko) * 2018-04-03 2019-10-10 한국과학기술원 이동형 단말기에서의 증강 현실을 제공하기 위한 위치 인식 방법 및 시스템
US10964053B2 (en) * 2018-07-02 2021-03-30 Microsoft Technology Licensing, Llc Device pose estimation using 3D line clouds
CN109059941B (zh) * 2018-07-06 2019-11-29 禾多科技（北京）有限公司 特征地图构建方法、视觉定位方法及对应装置
US10848664B2 (en) * 2018-07-26 2020-11-24 Sony Corporation Image capture device and method for image score-based video quality enhancement
US11227435B2 (en) 2018-08-13 2022-01-18 Magic Leap, Inc. Cross reality system
CN119205860A (zh) 2018-08-13 2024-12-27 奇跃公司 跨现实系统
CN108709560A (zh) * 2018-08-15 2018-10-26 苏州中研讯科智能科技有限公司 基于直线段特征的载运机器人高精度定位导航方法
JP7503542B2 (ja) 2018-10-05 2024-06-20 マジック リープ， インコーポレイテッド 任意の場所における場所特有の仮想コンテンツのレンダリング
US10839556B2 (en) 2018-10-23 2020-11-17 Microsoft Technology Licensing, Llc Camera pose estimation using obfuscated features
CN113474816B (zh) * 2018-12-26 2025-10-28 耐克创新有限合伙公司 弹性动态投影映射系统和方法
CN109712170B (zh) * 2018-12-27 2021-09-07 广东省智能制造研究所 基于视觉惯性里程计的环境对象追踪方法和装置
EP4046070A4 (en) 2019-10-15 2023-10-18 Magic Leap, Inc. CROSS-REALLY SYSTEM THAT SUPPORTS MULTIPLE DEVICE TYPES
US11632679B2 (en) 2019-10-15 2023-04-18 Magic Leap, Inc. Cross reality system with wireless fingerprints
EP4046139A4 (en) 2019-10-15 2023-11-22 Magic Leap, Inc. EXTENDED REALITY SYSTEM WITH LOCATION SERVICE
CN114616509B (zh) 2019-10-31 2024-12-27 奇跃公司 具有关于持久坐标框架的质量信息的交叉现实系统
EP4059007A4 (en) 2019-11-12 2023-11-01 Magic Leap, Inc. CROSS-REALLY SYSTEM WITH LOCATION SERVICE AND SHARED LOCATION-BASED CONTENT
EP4073763A4 (en) 2019-12-09 2023-12-27 Magic Leap, Inc. EXTENDED REALITY SYSTEM WITH SIMPLIFIED VIRTUAL CONTENT PROGRAMMING
WO2021124286A1 (en) * 2019-12-20 2021-06-24 Niantic, Inc. Location determination and mapping with 3d line junctions
EP4104001A4 (en) 2020-02-13 2024-03-13 Magic Leap, Inc. Cross reality system with map processing using multi-resolution frame descriptors
CN115427758B (zh) 2020-02-13 2025-01-17 奇跃公司 具有精确共享地图的交叉现实系统
US11830149B2 (en) * 2020-02-13 2023-11-28 Magic Leap, Inc. Cross reality system with prioritization of geolocation information for localization
WO2021173779A1 (en) 2020-02-26 2021-09-02 Magic Leap, Inc. Cross reality system with fast localization
EP4143794A4 (en) 2020-04-29 2024-04-17 Magic Leap, Inc. CROSS-REALITY SYSTEM FOR LARGE-SCALE ENVIRONMENTS
KR102872409B1 (ko) * 2021-12-27 2025-10-22 주식회사 버넥트 모바일 환경에서 실시간 트래킹을 위한 키포인트 선택 방법
CN115690205B (zh) * 2022-10-09 2023-12-05 北京自动化控制设备研究所 基于点线综合特征的视觉相对位姿测量误差估计方法
CN116436543B (zh) * 2023-06-14 2023-08-25 四川恒湾科技有限公司 一种基于fdd系统中多失真源的无源交调校正方法

Family Cites Families (17)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP3800905B2 (ja) * 1999-07-27 2006-07-26 松下電工株式会社 画像特徴追跡処理方法、画像特徴追跡処理装置、３次元データ作成方法
JP2001076151A (ja) * 1999-09-08 2001-03-23 Denso Corp 画像情報に含まれる認識対象物の認識方法
EP1297691A2 (en) 2000-03-07 2003-04-02 Sarnoff Corporation Camera pose estimation
US20030012410A1 (en) * 2001-07-10 2003-01-16 Nassir Navab Tracking and pose estimation for augmented reality using real features
AU2003277240A1 (en) 2002-10-15 2004-06-07 University Of Southern California Augmented virtual environments
US7764808B2 (en) * 2003-03-24 2010-07-27 Siemens Corporation System and method for vehicle detection and tracking
US7616807B2 (en) 2005-02-24 2009-11-10 Siemens Corporate Research, Inc. System and method for using texture landmarks for improved markerless tracking in augmented reality applications
DE602006010747D1 (de) * 2006-03-23 2010-01-07 Nds Ltd System zur analyse von bewegung
NO327279B1 (no) 2007-05-22 2009-06-02 Metaio Gmbh Kamerapositurestimeringsanordning og- fremgangsmate for foroket virkelighetsavbildning
JP4956375B2 (ja) * 2007-10-30 2012-06-20 キヤノン株式会社 画像処理装置、画像処理方法
JP2011043863A (ja) * 2007-11-16 2011-03-03 Nec Corp 対象領域判定・追跡装置、方法、プログラム及び対象領域判定装置
JP5253066B2 (ja) * 2008-09-24 2013-07-31 キヤノン株式会社 位置姿勢計測装置及び方法
US8442305B2 (en) * 2009-06-30 2013-05-14 Mitsubishi Electric Research Laboratories, Inc. Method for determining 3D poses using points and lines
FR2951565B1 (fr) 2009-10-20 2016-01-01 Total Immersion Procede, programme d'ordinateur et dispositif de suivi hybride de representations d'objets, en temps reel, dans une sequence d'images
US9317133B2 (en) 2010-10-08 2016-04-19 Nokia Technologies Oy Method and apparatus for generating augmented reality content
US20120092329A1 (en) 2010-10-13 2012-04-19 Qualcomm Incorporated Text-based 3d augmented reality
CN102184550B (zh) * 2011-05-04 2013-02-13 华中科技大学 一种动平台地面运动目标检测方法

Also Published As

Publication number Publication date
KR101722654B1 (ko) 2017-04-03
KR20160019512A (ko) 2016-02-19
EP3008695A1 (en) 2016-04-20
US9406137B2 (en) 2016-08-02
JP2016521885A (ja) 2016-07-25
US20140368645A1 (en) 2014-12-18
CN105283905B (zh) 2018-03-09
WO2014200665A1 (en) 2014-12-18
EP3008695B1 (en) 2018-05-09
CN105283905A (zh) 2016-01-27

Similar Documents

Publication Publication Date Title
JP6125100B2 (ja) 点特徴と線特徴とを使用する堅牢な追跡
JP6348574B2 (ja) 総体的カメラ移動およびパノラマカメラ移動を使用した単眼視覚ｓｌａｍ
US11481982B2 (en) In situ creation of planar natural feature targets
JP6258953B2 (ja) 単眼視覚ｓｌａｍのための高速初期化
TWI583176B (zh) 具有功率有效深度感測器運用之即時三維重建
US9667873B2 (en) Methods for facilitating computer vision application initialization
EP2992508B1 (en) Diminished and mediated reality effects from reconstruction
US20140369557A1 (en) Systems and Methods for Feature-Based Tracking
US9747516B2 (en) Keypoint detection with trackability measurements
US12482198B2 (en) Real-time photorealistic view rendering on augmented reality (AR) device
KR102450236B1 (ko) 전자 장치, 그 제어 방법 및 컴퓨터 판독가능 기록 매체

Legal Events

Date Code Title Description
A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20161024

A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20161024

A871 Explanation of circumstances concerning accelerated examination

Free format text: JAPANESE INTERMEDIATE CODE: A871

Effective date: 20161024

A975 Report on accelerated examination

Free format text: JAPANESE INTERMEDIATE CODE: A971005

Effective date: 20170221

A977 Report on retrieval

Free format text: JAPANESE INTERMEDIATE CODE: A971007

Effective date: 20170221

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20170306

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20170404

R150 Certificate of patent or registration of utility model

Ref document number: 6125100

Country of ref document: JP

Free format text: JAPANESE INTERMEDIATE CODE: R150

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

LAPS Cancellation because of no payment of annual fees