JP6273400B2 - 周辺情報を使用した高速テンプレートマッチング - Google Patents

周辺情報を使用した高速テンプレートマッチング Download PDF

Info

Publication number
JP6273400B2
JP6273400B2 JP2017500014A JP2017500014A JP6273400B2 JP 6273400 B2 JP6273400 B2 JP 6273400B2 JP 2017500014 A JP2017500014 A JP 2017500014A JP 2017500014 A JP2017500014 A JP 2017500014A JP 6273400 B2 JP6273400 B2 JP 6273400B2
Authority
JP
Japan
Prior art keywords
camera
template
templates
pose
target object
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
JP2017500014A
Other languages
English (en)
Japanese (ja)
Other versions
JP2017520063A5 (enExample
JP2017520063A (ja
Inventor
フイ・チャオ
ラグラマン・クリシュナムーティ
ファラツ・モハマド・ミルザエイ
Original Assignee
クアルコム，インコーポレイテッド
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by クアルコム，インコーポレイテッド filed Critical クアルコム，インコーポレイテッド
Publication of JP2017520063A publication Critical patent/JP2017520063A/ja
Publication of JP2017520063A5 publication Critical patent/JP2017520063A5/ja
Application granted granted Critical
Publication of JP6273400B2 publication Critical patent/JP6273400B2/ja
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/70—Determining position or orientation of objects or cameras
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/30—Determination of transform parameters for the alignment of images, i.e. image registration
    • G06T7/33—Determination of transform parameters for the alignment of images, i.e. image registration using feature-based methods
    • G06T7/337—Determination of transform parameters for the alignment of images, i.e. image registration using feature-based methods involving reference images or patches
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/70—Determining position or orientation of objects or cameras
    • G06T7/73—Determining position or orientation of objects or cameras using feature-based methods
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/70—Determining position or orientation of objects or cameras
    • G06T7/73—Determining position or orientation of objects or cameras using feature-based methods
    • G06T7/74—Determining position or orientation of objects or cameras using feature-based methods involving reference images or patches
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/40—Extraction of image or video features
    • G06V10/44—Local feature extraction by analysis of parts of the pattern, e.g. by detecting edges, contours, loops, corners, strokes or intersections; Connectivity analysis, e.g. of connected components
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/74—Image or video pattern matching; Proximity measures in feature spaces
    • G06V10/75—Organisation of the matching processes, e.g. simultaneous or sequential comparisons of image or video features; Coarse-fine approaches, e.g. multi-scale approaches; using context analysis; Selection of dictionaries
    • G06V10/751—Comparing pixel values or logical combinations thereof, or feature values having positional relevance, e.g. template matching
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10004—Still image; Photographic image
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30244—Camera pose
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V2201/00—Indexing scheme relating to image or video recognition or understanding
    • G06V2201/09—Recognition of logos
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V2201/00—Indexing scheme relating to image or video recognition or understanding
    • G06V2201/10—Recognition assisted with metadata

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Artificial Intelligence (AREA)
  • Computing Systems (AREA)
  • Databases & Information Systems (AREA)
  • Evolutionary Computation (AREA)
  • General Health & Medical Sciences (AREA)
  • Medical Informatics (AREA)
  • Software Systems (AREA)
  • Health & Medical Sciences (AREA)
  • Image Analysis (AREA)
JP2017500014A 2014-07-10 2015-06-03 周辺情報を使用した高速テンプレートマッチング Expired - Fee Related JP6273400B2 (ja)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US14/328,308 2014-07-10
US14/328,308 US9317921B2 (en) 2014-07-10 2014-07-10 Speed-up template matching using peripheral information
PCT/US2015/034049 WO2016007243A1 (en) 2014-07-10 2015-06-03 Speed-up template matching using peripheral information

Publications (3)

Publication Number Publication Date
JP2017520063A JP2017520063A (ja) 2017-07-20
JP2017520063A5 JP2017520063A5 (enExample) 2017-12-28
JP6273400B2 true JP6273400B2 (ja) 2018-01-31

Family

ID=53404939

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2017500014A Expired - Fee Related JP6273400B2 (ja) 2014-07-10 2015-06-03 周辺情報を使用した高速テンプレートマッチング

Country Status (6)

Country Link
US (1) US9317921B2 (enExample)
EP (1) EP3138078B1 (enExample)
JP (1) JP6273400B2 (enExample)
KR (1) KR101749017B1 (enExample)
CN (1) CN106471548B (enExample)
WO (1) WO2016007243A1 (enExample)

Families Citing this family (32)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9878447B2 (en) * 2015-04-10 2018-01-30 Microsoft Technology Licensing, Llc Automated collection and labeling of object data
US9652896B1 (en) * 2015-10-30 2017-05-16 Snap Inc. Image based tracking in augmented reality systems
US9984499B1 (en) 2015-11-30 2018-05-29 Snap Inc. Image and point cloud based tracking and in augmented reality systems
WO2017131735A1 (en) * 2016-01-29 2017-08-03 Hewlett Packard Enterprise Development Lp Image skew identification
US11385105B2 (en) * 2016-04-04 2022-07-12 Teledyne Flir, Llc Techniques for determining emitted radiation intensity
US10891502B1 (en) * 2017-01-19 2021-01-12 State Farm Mutual Automobile Insurance Company Apparatuses, systems and methods for alleviating driver distractions
US10319149B1 (en) 2017-02-17 2019-06-11 Snap Inc. Augmented reality anamorphosis system
US10074381B1 (en) 2017-02-20 2018-09-11 Snap Inc. Augmented reality speech balloon system
CN108734738B (zh) * 2017-04-18 2021-10-29 杭州海康威视数字技术股份有限公司 相机标定方法及装置
US10387730B1 (en) 2017-04-20 2019-08-20 Snap Inc. Augmented reality typography personalization system
US10169874B2 (en) * 2017-05-30 2019-01-01 International Business Machines Corporation Surface-based object identification
CN107330917B (zh) * 2017-06-23 2019-06-25 歌尔股份有限公司 移动目标的跟踪拍摄方法和跟踪设备
CN107516105B (zh) * 2017-07-20 2020-06-16 阿里巴巴集团控股有限公司 图像处理方法及装置
CN107369179B (zh) * 2017-07-31 2020-01-07 征图新视(江苏)科技股份有限公司 一种高精度图像定位方法
US10740974B1 (en) 2017-09-15 2020-08-11 Snap Inc. Augmented reality system
US10636137B1 (en) * 2017-10-23 2020-04-28 Amazon Technologies, Inc. System for determining object orientations in an image
US10970425B2 (en) * 2017-12-26 2021-04-06 Seiko Epson Corporation Object detection and tracking
WO2019164514A1 (en) * 2018-02-23 2019-08-29 Google Llc Transitioning between map view and augmented reality view
JP2021122079A (ja) * 2018-05-08 2021-08-26 ソニーグループ株式会社 情報処理装置、情報処理方法、及びプログラム
CN109582147B (zh) * 2018-08-08 2022-04-26 亮风台（上海）信息科技有限公司 一种用于呈现增强交互内容的方法以及用户设备
US10997760B2 (en) 2018-08-31 2021-05-04 Snap Inc. Augmented reality anthropomorphization system
US11972529B2 (en) 2019-02-01 2024-04-30 Snap Inc. Augmented reality system
US10547974B1 (en) * 2019-03-19 2020-01-28 Microsoft Technology Licensing, Llc Relative spatial localization of mobile devices
US10811055B1 (en) * 2019-06-27 2020-10-20 Fuji Xerox Co., Ltd. Method and system for real time synchronization of video playback with user motion
CN110414458B (zh) * 2019-08-01 2022-03-08 北京主线科技有限公司 基于平面标签和模板匹配的定位方法及装置
KR102782302B1 (ko) 2019-09-20 2025-03-17 삼성전자주식회사 위치 추정 장치 및 방법
US20210088770A1 (en) * 2019-09-24 2021-03-25 Fei Company Pose estimation using sematic segmentation
EP4220439A1 (en) * 2019-11-06 2023-08-02 Google LLC Use of image sensors to query real world for geo-reference information
CN111915608B (zh) * 2020-09-11 2023-08-15 北京百度网讯科技有限公司 建筑物提取方法、装置、设备和存储介质
CN112733773B (zh) * 2021-01-18 2024-07-16 上海商汤智能科技有限公司 一种对象检测方法、装置、计算机设备和存储介质
CN114536399B (zh) * 2022-01-07 2023-04-25 中国人民解放军海军军医大学第一附属医院 基于多个位姿标识的误差检测方法及机器人系统
CN116309815A (zh) * 2022-12-14 2023-06-23 哈尔滨工业大学 一种基于旋转参数的特征点加权不确定相机位姿估计方法

Family Cites Families (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20030012410A1 (en) * 2001-07-10 2003-01-16 Nassir Navab Tracking and pose estimation for augmented reality using real features
DE10323915A1 (de) 2003-05-23 2005-02-03 Daimlerchrysler Ag Kamerabasierte Positionserkennung für ein Straßenfahrzeug
JP2005135014A (ja) * 2003-10-28 2005-05-26 Hitachi Kokusai Electric Inc 物体検出装置
JP4418225B2 (ja) * 2003-12-18 2010-02-17 オリンパス株式会社 情報呈示システム
JP2007011607A (ja) * 2005-06-29 2007-01-18 Mitsubishi Electric Corp 地図検索装置および携帯端末
JP2008035328A (ja) 2006-07-31 2008-02-14 Fujifilm Corp テンプレート生成装置、画像配置装置、変更テンプレート生成装置およびそのプログラム
JP5013961B2 (ja) 2007-05-21 2012-08-29 キヤノン株式会社 位置姿勢計測装置及びその制御方法
US20090110267A1 (en) * 2007-09-21 2009-04-30 The Regents Of The University Of California Automated texture mapping system for 3D models
US8401276B1 (en) 2008-05-20 2013-03-19 University Of Southern California 3-D reconstruction and registration
US20100262931A1 (en) 2009-04-10 2010-10-14 Rovi Technologies Corporation Systems and methods for searching a media guidance application with multiple perspective views
WO2011048497A2 (en) 2009-10-19 2011-04-28 National University Of Singapore Computer vision based hybrid tracking for augmented reality in outdoor urban environments
JP5455124B2 (ja) 2010-04-01 2014-03-26 国立大学法人鳥取大学 カメラ姿勢パラメータ推定装置
US8938257B2 (en) * 2011-08-19 2015-01-20 Qualcomm, Incorporated Logo detection for indoor positioning
WO2013086475A1 (en) 2011-12-08 2013-06-13 Cornell University System and methods for world-scale camera pose estimation
US9147122B2 (en) 2012-05-31 2015-09-29 Qualcomm Incorporated Pose estimation based on peripheral information

Also Published As

Publication number Publication date
KR101749017B1 (ko) 2017-06-19
EP3138078B1 (en) 2017-09-27
CN106471548A (zh) 2017-03-01
CN106471548B (zh) 2018-07-13
US9317921B2 (en) 2016-04-19
EP3138078A1 (en) 2017-03-08
US20160012593A1 (en) 2016-01-14
WO2016007243A1 (en) 2016-01-14
KR20170008321A (ko) 2017-01-23
JP2017520063A (ja) 2017-07-20

Similar Documents

Publication Publication Date Title
JP6273400B2 (ja) 周辺情報を使用した高速テンプレートマッチング
US11165959B2 (en) Connecting and using building data acquired from mobile devices
JP6100380B2 (ja) 特に装置に係る視覚ベースの位置決めに使用される画像処理方法
US11062475B2 (en) Location estimating apparatus and method, learning apparatus and method, and computer program products
US9121724B2 (en) 3D position tracking for panoramic imagery navigation
CN113196208A (zh) 通过使用采集装置传感器对图像采集的自动化控制
EP3168571B1 (en) Utilizing camera to assist with indoor pedestrian navigation
US20140247280A1 (en) Federated mobile device positioning
CN105637530A (zh) 使用众包视频的3d模型更新
JP2017520063A5 (enExample)
WO2014162044A1 (en) Method and apparatus for determining camera location information and/or camera pose information according to a global coordinate system
CN107885763B (zh) 室内图中兴趣点信息的更新方法、装置及计算机可读介质
US20150161819A1 (en) Method and apparatus for optimized presentation of complex maps
CA3069813C (en) Capturing, connecting and using building interior data from mobile devices
CN111127584A (zh) 建立视觉地图的方法和装置、电子设备和存储介质
KR101413605B1 (ko) 네비게이션 시스템 및 방법
Shangguan et al. Towards accurate object localization with smartphones
CN107683496B (zh) 用于3d地图的假设线地图绘制和验证
JP6959305B2 (ja) 生成装置、生成方法、および生成プログラム
Ruiz-Ruiz et al. A vision-enhanced multisensor LBS suitable for augmented reality applications
CN116848493A (zh) 使用极线约束的光束平差
JP2021038958A (ja) 生成装置、生成方法、および生成プログラム

Legal Events

Date Code Title Description
A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20170104

A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20170104

A871 Explanation of circumstances concerning accelerated examination

Free format text: JAPANESE INTERMEDIATE CODE: A871

Effective date: 20170104

A975 Report on accelerated examination

Free format text: JAPANESE INTERMEDIATE CODE: A971005

Effective date: 20170530

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20170814

A524 Written submission of copy of amendment under article 19 pct

Free format text: JAPANESE INTERMEDIATE CODE: A524

Effective date: 20171114

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20171211

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20180105

R150 Certificate of patent or registration of utility model

Ref document number: 6273400

Country of ref document: JP

Free format text: JAPANESE INTERMEDIATE CODE: R150

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

LAPS Cancellation because of no payment of annual fees