KR101722654B1 - 점 특징 및 선 특징을 사용한 강력한 추적 - Google Patents

점 특징 및 선 특징을 사용한 강력한 추적 Download PDF

Info

Publication number
KR101722654B1
KR101722654B1 KR1020167000670A KR20167000670A KR101722654B1 KR 101722654 B1 KR101722654 B1 KR 101722654B1 KR 1020167000670 A KR1020167000670 A KR 1020167000670A KR 20167000670 A KR20167000670 A KR 20167000670A KR 101722654 B1 KR101722654 B1 KR 101722654B1
Authority
KR
South Korea
Prior art keywords
image
point
feature
current image
model
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
KR1020167000670A
Other languages
English (en)
Korean (ko)
Other versions
KR20160019512A (ko
Inventor
디라즈 아후자
기영 김
양하이 트신
셰예드 헤사메딘 나자피 쇼우쉬타리
Original Assignee
퀄컴 인코포레이티드
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 퀄컴 인코포레이티드 filed Critical 퀄컴 인코포레이티드
Publication of KR20160019512A publication Critical patent/KR20160019512A/ko
Application granted granted Critical
Publication of KR101722654B1 publication Critical patent/KR101722654B1/ko
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/20—Analysis of motion
    • G06T7/246—Analysis of motion using feature-based methods, e.g. the tracking of corners or segments
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/70—Determining position or orientation of objects or cameras
    • G06T7/73—Determining position or orientation of objects or cameras using feature-based methods
    • G06T7/74—Determining position or orientation of objects or cameras using feature-based methods involving reference images or patches
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/70—Determining position or orientation of objects or cameras
    • G06T7/73—Determining position or orientation of objects or cameras using feature-based methods
    • G06T7/75—Determining position or orientation of objects or cameras using feature-based methods involving models
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
    • H04N7/183—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast for receiving images from a single remote source
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20021—Dividing image into blocks, subimages or windows
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30244—Camera pose

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Image Analysis (AREA)
KR1020167000670A 2013-06-14 2014-05-16 점 특징 및 선 특징을 사용한 강력한 추적 Expired - Fee Related KR101722654B1 (ko)

Applications Claiming Priority (5)

Application Number Priority Date Filing Date Title
US201361835402P 2013-06-14 2013-06-14
US61/835,402 2013-06-14
US14/278,928 2014-05-15
US14/278,928 US9406137B2 (en) 2013-06-14 2014-05-15 Robust tracking using point and line features
PCT/US2014/038461 WO2014200665A1 (en) 2013-06-14 2014-05-16 Robust tracking using point and line features

Publications (2)

Publication Number Publication Date
KR20160019512A KR20160019512A (ko) 2016-02-19
KR101722654B1 true KR101722654B1 (ko) 2017-04-03

Family

ID=52018894

Family Applications (1)

Application Number Title Priority Date Filing Date
KR1020167000670A Expired - Fee Related KR101722654B1 (ko) 2013-06-14 2014-05-16 점 특징 및 선 특징을 사용한 강력한 추적

Country Status (6)

Country Link
US (1) US9406137B2 (enExample)
EP (1) EP3008695B1 (enExample)
JP (1) JP6125100B2 (enExample)
KR (1) KR101722654B1 (enExample)
CN (1) CN105283905B (enExample)
WO (1) WO2014200665A1 (enExample)

Families Citing this family (40)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9135646B2 (en) * 2013-10-09 2015-09-15 Ricoh Company, Ltd. Associating advertising content with a channel
CN107004276A (zh) * 2014-07-03 2017-08-01 A·古曼 从一对图像中觉察3d结构的方法
JP6723798B2 (ja) * 2015-05-20 2020-07-15 キヤノン株式会社 情報処理装置、方法、プログラム
US10282591B2 (en) 2015-08-24 2019-05-07 Qualcomm Incorporated Systems and methods for depth map sampling
US9849591B2 (en) * 2015-10-02 2017-12-26 X Development Llc Localization of a robot in an environment using detected edges of a camera image from a camera of the robot and detected edges derived from a three-dimensional model of the environment
US10260862B2 (en) * 2015-11-02 2019-04-16 Mitsubishi Electric Research Laboratories, Inc. Pose estimation using sensors
US10217231B2 (en) * 2016-05-31 2019-02-26 Microsoft Technology Licensing, Llc Systems and methods for utilizing anchor graphs in mixed reality environments
US10290111B2 (en) * 2016-07-26 2019-05-14 Qualcomm Incorporated Systems and methods for compositing images
JP2018036901A (ja) * 2016-08-31 2018-03-08 富士通株式会社 画像処理装置、画像処理方法および画像処理プログラム
WO2018144929A1 (en) * 2017-02-02 2018-08-09 Infatics, Inc. (DBA DroneDeploy) System and methods for improved aerial mapping with aerial vehicles
US11048325B2 (en) 2017-07-10 2021-06-29 Samsung Electronics Co., Ltd. Wearable augmented reality head mounted display device for phone content display and health monitoring
CN108021921A (zh) * 2017-11-23 2018-05-11 塔普翊海（上海）智能科技有限公司 图像特征点提取系统及其应用
KR102708487B1 (ko) 2017-12-15 2024-09-20 매직 립, 인코포레이티드 향상된 포즈 결정을 위한 시스템들 및 방법들
WO2019194561A1 (ko) * 2018-04-03 2019-10-10 한국과학기술원 이동형 단말기에서의 증강 현실을 제공하기 위한 위치 인식 방법 및 시스템
US10964053B2 (en) * 2018-07-02 2021-03-30 Microsoft Technology Licensing, Llc Device pose estimation using 3D line clouds
CN109059941B (zh) * 2018-07-06 2019-11-29 禾多科技（北京）有限公司 特征地图构建方法、视觉定位方法及对应装置
US10848664B2 (en) * 2018-07-26 2020-11-24 Sony Corporation Image capture device and method for image score-based video quality enhancement
WO2020036898A1 (en) 2018-08-13 2020-02-20 Magic Leap, Inc. A cross reality system
US11227435B2 (en) 2018-08-13 2022-01-18 Magic Leap, Inc. Cross reality system
CN108709560A (zh) * 2018-08-15 2018-10-26 苏州中研讯科智能科技有限公司 基于直线段特征的载运机器人高精度定位导航方法
US11232635B2 (en) 2018-10-05 2022-01-25 Magic Leap, Inc. Rendering location specific virtual content in any location
US10839556B2 (en) 2018-10-23 2020-11-17 Microsoft Technology Licensing, Llc Camera pose estimation using obfuscated features
CN113474816B (zh) * 2018-12-26 2025-10-28 耐克创新有限合伙公司 弹性动态投影映射系统和方法
CN109712170B (zh) * 2018-12-27 2021-09-07 广东省智能制造研究所 基于视觉惯性里程计的环境对象追踪方法和装置
CN114616534B (zh) 2019-10-15 2025-08-26 奇跃公司 具有无线指纹的交叉现实系统
US11257294B2 (en) 2019-10-15 2022-02-22 Magic Leap, Inc. Cross reality system supporting multiple device types
US11568605B2 (en) 2019-10-15 2023-01-31 Magic Leap, Inc. Cross reality system with localization service
JP7604478B2 (ja) 2019-10-31 2024-12-23 マジック リープ， インコーポレイテッド 持続座標フレームについての品質情報を伴うクロスリアリティシステム
JP7525603B2 (ja) 2019-11-12 2024-07-30 マジック リープ， インコーポレイテッド 位置特定サービスおよび共有場所ベースのコンテンツを伴うクロスリアリティシステム
JP7748945B2 (ja) 2019-12-09 2025-10-03 マジック リープ， インコーポレイテッド 仮想コンテンツの簡略化されたプログラミングを伴うクロスリアリティシステム
KR20220119664A (ko) * 2019-12-20 2022-08-30 나이앤틱, 인크. 3d 라인 정션을 통한 위치 판정 및 매핑
WO2021163306A1 (en) 2020-02-13 2021-08-19 Magic Leap, Inc. Cross reality system with accurate shared maps
JP7768888B2 (ja) 2020-02-13 2025-11-12 マジック リープ， インコーポレイテッド マルチ分解能フレーム記述子を使用したマップ処理を伴うクロスリアリティシステム
US11830149B2 (en) * 2020-02-13 2023-11-28 Magic Leap, Inc. Cross reality system with prioritization of geolocation information for localization
US11551430B2 (en) 2020-02-26 2023-01-10 Magic Leap, Inc. Cross reality system with fast localization
US11900547B2 (en) 2020-04-29 2024-02-13 Magic Leap, Inc. Cross reality system for large scale environments
KR102864852B1 (ko) * 2021-11-23 2025-09-25 주식회사 버넥트 연속 프레임 간의 실시간 이미지 타겟의 모션 추정 방법 및 그 시스템
KR102872409B1 (ko) * 2021-12-27 2025-10-22 주식회사 버넥트 모바일 환경에서 실시간 트래킹을 위한 키포인트 선택 방법
CN115690205B (zh) * 2022-10-09 2023-12-05 北京自动化控制设备研究所 基于点线综合特征的视觉相对位姿测量误差估计方法
CN116436543B (zh) * 2023-06-14 2023-08-25 四川恒湾科技有限公司 一种基于fdd系统中多失真源的无源交调校正方法

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2001076151A (ja) 1999-09-08 2001-03-23 Denso Corp 画像情報に含まれる認識対象物の認識方法
JP2001101419A (ja) 1999-07-27 2001-04-13 Matsushita Electric Works Ltd 画像特徴追跡処理方法、画像特徴追跡処理装置、３次元データ作成方法
US20030012410A1 (en) 2001-07-10 2003-01-16 Nassir Navab Tracking and pose estimation for augmented reality using real features
JP2009110304A (ja) 2007-10-30 2009-05-21 Canon Inc 画像処理装置、画像処理方法
JP2010079452A (ja) 2008-09-24 2010-04-08 Canon Inc 位置姿勢計測装置及び方法

Family Cites Families (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1297691A2 (en) 2000-03-07 2003-04-02 Sarnoff Corporation Camera pose estimation
JP4185052B2 (ja) 2002-10-15 2008-11-19 ユニバーシティ オブ サザン カリフォルニア 拡張仮想環境
US7764808B2 (en) * 2003-03-24 2010-07-27 Siemens Corporation System and method for vehicle detection and tracking
US7616807B2 (en) 2005-02-24 2009-11-10 Siemens Corporate Research, Inc. System and method for using texture landmarks for improved markerless tracking in augmented reality applications
WO2007107685A1 (en) * 2006-03-23 2007-09-27 Nds Limited System for analysis of motion
NO327279B1 (no) 2007-05-22 2009-06-02 Metaio Gmbh Kamerapositurestimeringsanordning og- fremgangsmate for foroket virkelighetsavbildning
JP2011043863A (ja) * 2007-11-16 2011-03-03 Nec Corp 対象領域判定・追跡装置、方法、プログラム及び対象領域判定装置
US8442305B2 (en) * 2009-06-30 2013-05-14 Mitsubishi Electric Research Laboratories, Inc. Method for determining 3D poses using points and lines
FR2951565B1 (fr) 2009-10-20 2016-01-01 Total Immersion Procede, programme d'ordinateur et dispositif de suivi hybride de representations d'objets, en temps reel, dans une sequence d'images
US9317133B2 (en) 2010-10-08 2016-04-19 Nokia Technologies Oy Method and apparatus for generating augmented reality content
US20120092329A1 (en) 2010-10-13 2012-04-19 Qualcomm Incorporated Text-based 3d augmented reality
CN102184550B (zh) * 2011-05-04 2013-02-13 华中科技大学 一种动平台地面运动目标检测方法

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2001101419A (ja) 1999-07-27 2001-04-13 Matsushita Electric Works Ltd 画像特徴追跡処理方法、画像特徴追跡処理装置、３次元データ作成方法
JP2001076151A (ja) 1999-09-08 2001-03-23 Denso Corp 画像情報に含まれる認識対象物の認識方法
US20030012410A1 (en) 2001-07-10 2003-01-16 Nassir Navab Tracking and pose estimation for augmented reality using real features
JP2009110304A (ja) 2007-10-30 2009-05-21 Canon Inc 画像処理装置、画像処理方法
JP2010079452A (ja) 2008-09-24 2010-04-08 Canon Inc 位置姿勢計測装置及び方法

Also Published As

Publication number Publication date
US9406137B2 (en) 2016-08-02
CN105283905B (zh) 2018-03-09
CN105283905A (zh) 2016-01-27
WO2014200665A1 (en) 2014-12-18
EP3008695A1 (en) 2016-04-20
EP3008695B1 (en) 2018-05-09
JP6125100B2 (ja) 2017-05-10
KR20160019512A (ko) 2016-02-19
US20140368645A1 (en) 2014-12-18
JP2016521885A (ja) 2016-07-25

Similar Documents

Publication Publication Date Title
KR101722654B1 (ko) 점 특징 및 선 특징을 사용한 강력한 추적
US9674507B2 (en) Monocular visual SLAM with general and panorama camera movements
US9747516B2 (en) Keypoint detection with trackability measurements
JP6258953B2 (ja) 単眼視覚ｓｌａｍのための高速初期化
EP2941736B1 (en) Mobile device based text detection and tracking
US10154190B2 (en) Balancing exposure and gain at an electronic device based on device motion and scene distance
US10313657B2 (en) Depth map generation apparatus, method and non-transitory computer-readable medium therefor
WO2014200625A1 (en) Systems and methods for feature-based tracking
KR102398478B1 (ko) 전자 디바이스 상에서의 환경 맵핑을 위한 피쳐 데이터 관리
KR20160003233A (ko) 컴퓨터 비전 애플리케이션 초기화를 용이하게 하는 방법들
JP2018028899A (ja) 画像レジストレーションの方法及びシステム
EP3414741A1 (en) Systems and methods for determining a region in an image
EP2951788A1 (en) Real-time 3d reconstruction with power efficient depth sensor usage
WO2021118560A1 (en) Scene lock mode for capturing camera images
KR101738572B1 (ko) 뎁스 이미지를 이용한 마커리스 증강현실 데이터처리 디바이스 및 뎁스 이미지를 이용한 증강현실 데이터처리방법
KR102450236B1 (ko) 전자 장치, 그 제어 방법 및 컴퓨터 판독가능 기록 매체
US9269146B2 (en) Target object angle determination using multiple cameras

Legal Events

Date Code Title Description
PA0105 International application

St.27 status event code: A-0-1-A10-A15-nap-PA0105

PG1501 Laying open of application

St.27 status event code: A-1-1-Q10-Q12-nap-PG1501

A201 Request for examination
A302 Request for accelerated examination
P11-X000 Amendment of application requested

St.27 status event code: A-2-2-P10-P11-nap-X000

P13-X000 Application amended

St.27 status event code: A-2-2-P10-P13-nap-X000

PA0201 Request for examination

St.27 status event code: A-1-2-D10-D11-exm-PA0201

PA0302 Request for accelerated examination

St.27 status event code: A-1-2-D10-D17-exm-PA0302

St.27 status event code: A-1-2-D10-D16-exm-PA0302

E902 Notification of reason for refusal
PE0902 Notice of grounds for rejection

St.27 status event code: A-1-2-D10-D21-exm-PE0902

T11-X000 Administrative time limit extension requested

St.27 status event code: U-3-3-T10-T11-oth-X000

P22-X000 Classification modified

St.27 status event code: A-2-2-P10-P22-nap-X000

P11-X000 Amendment of application requested

St.27 status event code: A-2-2-P10-P11-nap-X000

P13-X000 Application amended

St.27 status event code: A-2-2-P10-P13-nap-X000

E701 Decision to grant or registration of patent right
PE0701 Decision of registration

St.27 status event code: A-1-2-D10-D22-exm-PE0701

GRNT Written decision to grant
PR0701 Registration of establishment

St.27 status event code: A-2-4-F10-F11-exm-PR0701

PR1002 Payment of registration fee

St.27 status event code: A-2-2-U10-U12-oth-PR1002

Fee payment year number: 1

PG1601 Publication of registration

St.27 status event code: A-4-4-Q10-Q13-nap-PG1601

PR1001 Payment of annual fee

St.27 status event code: A-4-4-U10-U11-oth-PR1001

Fee payment year number: 4

PR1001 Payment of annual fee

St.27 status event code: A-4-4-U10-U11-oth-PR1001

Fee payment year number: 5

PC1903 Unpaid annual fee

St.27 status event code: A-4-4-U10-U13-oth-PC1903

Not in force date: 20220329

Payment event data comment text: Termination Category : DEFAULT_OF_REGISTRATION_FEE

PC1903 Unpaid annual fee

St.27 status event code: N-4-6-H10-H13-oth-PC1903

Ip right cessation event data comment text: Termination Category : DEFAULT_OF_REGISTRATION_FEE

Not in force date: 20220329