JP6348574B2 - 総体的カメラ移動およびパノラマカメラ移動を使用した単眼視覚ｓｌａｍ - Google Patents

総体的カメラ移動およびパノラマカメラ移動を使用した単眼視覚ｓｌａｍ Download PDF

Info

Publication number
JP6348574B2
JP6348574B2 JP2016511811A JP2016511811A JP6348574B2 JP 6348574 B2 JP6348574 B2 JP 6348574B2 JP 2016511811 A JP2016511811 A JP 2016511811A JP 2016511811 A JP2016511811 A JP 2016511811A JP 6348574 B2 JP6348574 B2 JP 6348574B2
Authority
JP
Japan
Prior art keywords
map
panoramic
camera
keyframe
feature
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
JP2016511811A
Other languages
English (en)
Japanese (ja)
Other versions
JP2016526313A5 (enExample
JP2016526313A (ja
Inventor
クリスチャン・ピルチハイム
ディーター・シュマルシュティーグ
ゲルハルト・ライトメイヤー
Original Assignee
クアルコム，インコーポレイテッド
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by クアルコム，インコーポレイテッド filed Critical クアルコム，インコーポレイテッド
Publication of JP2016526313A publication Critical patent/JP2016526313A/ja
Publication of JP2016526313A5 publication Critical patent/JP2016526313A5/ja
Application granted granted Critical
Publication of JP6348574B2 publication Critical patent/JP6348574B2/ja
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20—Image signal generators
    • H04N13/286—Image signal generators having separate monoscopic and stereoscopic modes
    • H04N13/289—Switching between monoscopic and stereoscopic modes
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/50—Depth or shape recovery
    • G06T7/55—Depth or shape recovery from multiple images
    • G06T7/579—Depth or shape recovery from multiple images from motion
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/698—Control of cameras or camera modules for achieving an enlarged field of view, e.g. panoramic image capture

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Studio Devices (AREA)
  • Length Measuring Devices By Optical Means (AREA)
  • Processing Or Creating Images (AREA)
  • Image Processing (AREA)
  • Measurement Of Optical Distance (AREA)
JP2016511811A 2013-04-30 2014-04-29 総体的カメラ移動およびパノラマカメラ移動を使用した単眼視覚ｓｌａｍ Active JP6348574B2 (ja)

Applications Claiming Priority (5)

Application Number Priority Date Filing Date Title
US201361817808P 2013-04-30 2013-04-30
US61/817,808 2013-04-30
US14/151,776 2014-01-09
US14/151,776 US9674507B2 (en) 2013-04-30 2014-01-09 Monocular visual SLAM with general and panorama camera movements
PCT/US2014/035935 WO2014179349A1 (en) 2013-04-30 2014-04-29 Monocular visual slam with general and panorama camera movements

Publications (3)

Publication Number Publication Date
JP2016526313A JP2016526313A (ja) 2016-09-01
JP2016526313A5 JP2016526313A5 (enExample) 2017-06-15
JP6348574B2 true JP6348574B2 (ja) 2018-06-27

Family

ID=51788915

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2016511811A Active JP6348574B2 (ja) 2013-04-30 2014-04-29 総体的カメラ移動およびパノラマカメラ移動を使用した単眼視覚ｓｌａｍ

Country Status (6)

Country Link
US (1) US9674507B2 (enExample)
EP (1) EP2992505A1 (enExample)
JP (1) JP6348574B2 (enExample)
KR (1) KR20160003066A (enExample)
CN (1) CN105210113B (enExample)
WO (1) WO2014179349A1 (enExample)

Families Citing this family (60)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9495760B2 (en) * 2010-09-20 2016-11-15 Qualcomm Incorporated Adaptable framework for cloud assisted augmented reality
AU2013237718A1 (en) * 2013-10-04 2015-04-23 Canon Kabushiki Kaisha Method, apparatus and system for selecting a frame
US9479709B2 (en) 2013-10-10 2016-10-25 Nvidia Corporation Method and apparatus for long term image exposure with image stabilization on a mobile device
US9390344B2 (en) 2014-01-09 2016-07-12 Qualcomm Incorporated Sensor-based camera motion detection for unconstrained slam
US9723109B2 (en) 2014-05-28 2017-08-01 Alexander Hertel Platform for constructing and consuming realm and object feature clouds
US20150365634A1 (en) * 2014-06-16 2015-12-17 Chin-Teng Lin Image recognition system
US11051000B2 (en) * 2014-07-14 2021-06-29 Mitsubishi Electric Research Laboratories, Inc. Method for calibrating cameras with non-overlapping views
US10185775B2 (en) 2014-12-19 2019-01-22 Qualcomm Technologies, Inc. Scalable 3D mapping system
CN105989586A (zh) * 2015-03-04 2016-10-05 北京雷动云合智能技术有限公司 一种基于语义光束平差法的slam方法
GB2541884A (en) 2015-08-28 2017-03-08 Imp College Of Science Tech And Medicine Mapping a space using a multi-directional camera
US9807365B2 (en) 2015-12-08 2017-10-31 Mitsubishi Electric Research Laboratories, Inc. System and method for hybrid simultaneous localization and mapping of 2D and 3D data acquired by sensors from a 3D scene
US10705528B2 (en) 2015-12-15 2020-07-07 Qualcomm Incorporated Autonomous visual navigation
JP6775969B2 (ja) * 2016-02-29 2020-10-28 キヤノン株式会社 情報処理装置、情報処理方法、及びプログラム
JP6716996B2 (ja) 2016-03-29 2020-07-01 富士通株式会社 画像処理プログラム、画像処理装置、及び画像処理方法
CN106052647A (zh) * 2016-05-09 2016-10-26 华广发 高空俯视360度全景二十四山罗盘定位技术
CN106127739B (zh) * 2016-06-16 2021-04-27 华东交通大学 一种结合单目视觉的rgb-d slam方法
CN106020201B (zh) * 2016-07-13 2019-02-01 广东奥讯智能设备技术有限公司 移动机器人3d导航定位系统及导航定位方法
CN107798704B (zh) * 2016-08-30 2021-04-30 成都理想境界科技有限公司 一种用于增强现实的实时图像叠加方法及装置
CN106446815B (zh) * 2016-09-14 2019-08-09 浙江大学 一种同时定位与地图构建方法
US11436749B2 (en) 2017-01-23 2022-09-06 Oxford University Innovation Limited Determining the location of a mobile device
CN110770758B (zh) 2017-01-23 2024-06-04 牛津大学创新有限公司 确定可移动的设备的位置
KR102647351B1 (ko) 2017-01-26 2024-03-13 삼성전자주식회사 3차원의 포인트 클라우드를 이용한 모델링 방법 및 모델링 장치
US11747144B2 (en) * 2017-03-29 2023-09-05 Agency For Science, Technology And Research Real time robust localization via visual inertial odometry
JP6762913B2 (ja) * 2017-07-11 2020-09-30 キヤノン株式会社 情報処理装置、情報処理方法
CN107945265B (zh) * 2017-11-29 2019-09-20 华中科技大学 基于在线学习深度预测网络的实时稠密单目slam方法与系统
CN107909150B (zh) * 2017-11-29 2020-08-18 华中科技大学 基于逐块随机梯度下降法在线训练cnn的方法与系统
CN108107897B (zh) * 2018-01-11 2021-04-16 驭势科技（北京）有限公司 实时传感器控制方法及装置
CN110097045A (zh) * 2018-01-31 2019-08-06 株式会社理光 一种定位方法、定位装置及可读存储介质
CN110152293B (zh) * 2018-02-13 2022-07-22 腾讯科技（深圳）有限公司 操控对象的定位方法及装置、游戏对象的定位方法及装置
US10311646B1 (en) 2018-02-26 2019-06-04 Capital One Services, Llc Dynamic configuration of an augmented reality overlay
KR102557049B1 (ko) * 2018-03-30 2023-07-19 한국전자통신연구원 Slam 기반 카메라 추적에서 라벨된 키프레임을 이용한 이미지 특징 매칭 방법 및 장치
EP3547704A1 (en) 2018-03-30 2019-10-02 Thomson Licensing Method, apparatus and stream for volumetric video format
US10810754B2 (en) 2018-04-24 2020-10-20 Ford Global Technologies, Llc Simultaneous localization and mapping constraints in generative adversarial networks for monocular depth estimation
CN108933902B (zh) * 2018-07-27 2025-02-07 顺丰科技有限公司 全景图像采集装置、建图方法及移动机器人
CN109345587B (zh) * 2018-09-01 2022-02-22 哈尔滨工程大学 一种基于全景与单目视觉的混合视觉定位方法
EP3698323B1 (en) * 2018-10-04 2021-09-08 Google LLC Depth from motion for augmented reality for handheld user devices
GB2583793B (en) * 2018-10-08 2021-11-03 Ulc Robotics Inc System and method for data acquisition
CN109579745A (zh) * 2018-11-26 2019-04-05 江苏科技大学 基于增强现实和手机软件的新型房屋面积测算方法
CN109584302B (zh) * 2018-11-27 2023-12-01 北京旷视科技有限公司 相机位姿优化方法、装置、电子设备和计算机可读介质
CN109859266B (zh) * 2019-01-28 2022-11-25 西安理工大学 一种基于预变换的大视角变化下视觉同时定位与绘图方法
US10768695B2 (en) * 2019-02-01 2020-09-08 Facebook Technologies, Llc Artificial reality system having adaptive degrees of freedom (DOF) selection
CN109727269B (zh) * 2019-03-29 2019-07-09 中国人民解放军国防科技大学 一种基于单目视觉和道路地图的匹配定位方法
US11064096B2 (en) * 2019-12-13 2021-07-13 Sony Corporation Filtering and smoothing sources in camera tracking
US11340696B2 (en) * 2020-01-13 2022-05-24 Sony Interactive Entertainment Inc. Event driven sensor (EDS) tracking of light emitting diode (LED) array
CN111292420B (zh) * 2020-02-28 2023-04-28 北京百度网讯科技有限公司 用于构建地图的方法和装置
CN112198878B (zh) * 2020-09-30 2021-09-28 深圳市银星智能科技股份有限公司 一种即时地图构建方法、装置、机器人及存储介质
KR20220049304A (ko) * 2020-10-14 2022-04-21 삼성전자주식회사 이미지를 이용한 3차원 지도의 업데이트 방법 및 이를 지원하는 전자 장치
US12141993B2 (en) * 2020-11-27 2024-11-12 Samsung Electronics Co., Ltd. Method and device for simultaneous localization and mapping (SLAM)
CN114723921B (zh) * 2021-01-05 2025-03-21 中国移动通信有限公司研究院 运动控制方法、装置、相关设备及计算机可读存储介质
CN112819943B (zh) * 2021-01-15 2022-08-30 北京航空航天大学 一种基于全景相机的主动视觉slam系统
CN113392370B (zh) * 2021-06-15 2022-01-04 元橡科技(苏州)有限公司 一种slam系统
CN113781574B (zh) * 2021-07-19 2024-04-12 长春理工大学 一种双目折反射全景系统动态点去除方法
CN113628279B (zh) * 2021-07-29 2023-10-31 成都易瞳科技有限公司 一种全景视觉slam建图方法
CN114119999B (zh) * 2021-12-02 2024-05-14 河北工业大学 基于深度学习的迭代6d位姿估计方法及装置
KR102431122B1 (ko) * 2021-12-30 2022-08-10 주식회사 버넥트 맵 타겟 추적 방법 및 그 시스템
US12380588B2 (en) * 2022-01-11 2025-08-05 Htc Corporation Map optimizing method, related electronic device and non-transitory computer readable storage medium
JP7753164B2 (ja) 2022-07-28 2025-10-14 株式会社東芝 推定装置、推定方法及びプログラム
US20240160210A1 (en) * 2022-11-15 2024-05-16 Robust AI, Inc. Place enrollment in a robotic cart coordination system
EP4421447A1 (en) * 2023-02-23 2024-08-28 Floorfy S.L. Method for positioning images within an arbitrary 3d coordinate system
CN117115254A (zh) * 2023-08-23 2023-11-24 上海大学 一种用于执行slam任务时的仿生眼双目视觉的主动定位方法

Family Cites Families (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP5380789B2 (ja) * 2007-06-06 2014-01-08 ソニー株式会社 情報処理装置、および情報処理方法、並びにコンピュータ・プログラム
EP2237227A1 (en) 2009-04-01 2010-10-06 Nederlandse Organisatie voor toegepast -natuurwetenschappelijk onderzoek TNO Video sequence processing method and system
JP2011043419A (ja) * 2009-08-21 2011-03-03 Sony Corp 情報処理装置、および情報処理方法、並びにプログラム
US9204040B2 (en) 2010-05-21 2015-12-01 Qualcomm Incorporated Online creation of panoramic augmented reality annotations on mobile platforms
JP5577931B2 (ja) 2010-08-06 2014-08-27 ソニー株式会社 画像処理装置、画像処理方法およびプログラム
AU2011305154B2 (en) 2010-09-24 2015-02-05 Irobot Corporation Systems and methods for VSLAM optimization
US8711206B2 (en) * 2011-01-31 2014-04-29 Microsoft Corporation Mobile camera localization using depth maps
US8587583B2 (en) * 2011-01-31 2013-11-19 Microsoft Corporation Three-dimensional environment reconstruction
US20120300020A1 (en) * 2011-05-27 2012-11-29 Qualcomm Incorporated Real-time self-localization from panoramic images
US9390344B2 (en) 2014-01-09 2016-07-12 Qualcomm Incorporated Sensor-based camera motion detection for unconstrained slam

Also Published As

Publication number Publication date
US9674507B2 (en) 2017-06-06
CN105210113A (zh) 2015-12-30
WO2014179349A1 (en) 2014-11-06
EP2992505A1 (en) 2016-03-09
KR20160003066A (ko) 2016-01-08
CN105210113B (zh) 2018-11-13
JP2016526313A (ja) 2016-09-01
US20140320593A1 (en) 2014-10-30

Similar Documents

Publication Publication Date Title
JP6348574B2 (ja) 総体的カメラ移動およびパノラマカメラ移動を使用した単眼視覚ｓｌａｍ
US11481982B2 (en) In situ creation of planar natural feature targets
JP6258953B2 (ja) 単眼視覚ｓｌａｍのための高速初期化
JP6125100B2 (ja) 点特徴と線特徴とを使用する堅牢な追跡
JP6228320B2 (ja) 制約なしｓｌａｍ用のセンサベースのカメラ運動検出
JP2018507476A (ja) コンピュータビジョンに関する遮蔽処理
JP2016528476A (ja) Ｓｌａｍマップからのワイドエリア位置推定
JP2014515530A (ja) モバイルデバイスのための平面マッピングおよびトラッキング
JP6240706B2 (ja) グラフマッチングおよびサイクル検出による自動モデル初期化を用いた線トラッキング

Legal Events

Date Code Title Description
A529 Written submission of copy of amendment under article 34 pct

Free format text: JAPANESE INTERMEDIATE CODE: A529

Effective date: 20151028

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20170414

A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20170414

A977 Report on retrieval

Free format text: JAPANESE INTERMEDIATE CODE: A971007

Effective date: 20180425

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20180507

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20180531

R150 Certificate of patent or registration of utility model

Ref document number: 6348574

Country of ref document: JP

Free format text: JAPANESE INTERMEDIATE CODE: R150

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250