JP7586918B2 - 位置特定正確度のためのバッファを伴うクロスリアリティシステム - Google Patents

位置特定正確度のためのバッファを伴うクロスリアリティシステム Download PDF

Info

Publication number
JP7586918B2
JP7586918B2 JP2022550929A JP2022550929A JP7586918B2 JP 7586918 B2 JP7586918 B2 JP 7586918B2 JP 2022550929 A JP2022550929 A JP 2022550929A JP 2022550929 A JP2022550929 A JP 2022550929A JP 7586918 B2 JP7586918 B2 JP 7586918B2
Authority
JP
Japan
Prior art keywords
map
features
image
tracking
buffer
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
JP2022550929A
Other languages
English (en)
Japanese (ja)
Other versions
JP2023515523A (ja
JP2023515523A5 (https=
JPWO2021173862A5 (https=
Inventor
アリ シャーロクニー，
ケン－シェン リン，
シュアン ジャオ，
クリスチャン イヴァン ロバート ムーア，
アシュウィン スワミナサン，
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Magic Leap Inc
Original Assignee
Magic Leap Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Magic Leap Inc filed Critical Magic Leap Inc
Publication of JP2023515523A publication Critical patent/JP2023515523A/ja
Publication of JP2023515523A5 publication Critical patent/JP2023515523A5/ja
Publication of JPWO2021173862A5 publication Critical patent/JPWO2021173862A5/ja
Application granted granted Critical
Publication of JP7586918B2 publication Critical patent/JP7586918B2/ja
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating three-dimensional [3D] models or images for computer graphics
    • G06T19/006—Mixed reality
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/012—Head tracking input arrangements
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/013—Eye tracking input arrangements
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T1/00—General purpose image data processing
    • G06T1/20—Processor architectures; Processor configuration, e.g. pipelining
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/70—Determining position or orientation of objects or cameras
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/70—Determining position or orientation of objects or cameras
    • G06T7/73—Determining position or orientation of objects or cameras using feature-based methods
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00—Network arrangements or protocols for supporting network services or applications
    • H04L67/01—Protocols
    • H04L67/131—Protocols for games, networked simulations or virtual reality
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00—Network arrangements or protocols for supporting network services or applications
    • H04L67/50—Network services
    • H04L67/52—Network services specially adapted for the location of the user terminal
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10028—Range image; Depth image; 3D point clouds
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30244—Camera pose
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2210/00—Indexing scheme for image generation or computer graphics
    • G06T2210/61—Scene description

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Computer Graphics (AREA)
  • Computer Hardware Design (AREA)
  • Software Systems (AREA)
  • Signal Processing (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Human Computer Interaction (AREA)
  • Processing Or Creating Images (AREA)
  • User Interface Of Digital Computer (AREA)
  • Digital Computer Display Output (AREA)
JP2022550929A 2020-02-26 2021-02-25 位置特定正確度のためのバッファを伴うクロスリアリティシステム Active JP7586918B2 (ja)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US202062981961P 2020-02-26 2020-02-26
US62/981,961 2020-02-26
PCT/US2021/019716 WO2021173862A1 (en) 2020-02-26 2021-02-25 Cross reality system with buffering for localization accuracy

Publications (4)

Publication Number Publication Date
JP2023515523A JP2023515523A (ja) 2023-04-13
JP2023515523A5 JP2023515523A5 (https=) 2024-02-21
JPWO2021173862A5 JPWO2021173862A5 (https=) 2024-02-21
JP7586918B2 true JP7586918B2 (ja) 2024-11-19

Family

ID=77366367

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2022550929A Active JP7586918B2 (ja) 2020-02-26 2021-02-25 位置特定正確度のためのバッファを伴うクロスリアリティシステム

Country Status (5)

Country Link
US (2) US11557099B2 (https=)
EP (1) EP4111368A4 (https=)
JP (1) JP7586918B2 (https=)
CN (2) CN116721235A (https=)
WO (1) WO2021173862A1 (https=)

Families Citing this family (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2021252940A1 (en) * 2020-06-12 2021-12-16 University Of Washington Eye tracking in near-eye displays
US12456264B2 (en) * 2020-08-27 2025-10-28 Samsung Electronics Co., Ltd. Method and apparatus for performing anchor based rendering for augmented reality media objects
US11823339B2 (en) * 2021-04-06 2023-11-21 Apple Inc. Localization accuracy response
CN113870379B (zh) * 2021-09-15 2025-07-11 北京易航远智科技有限公司 地图生成方法、装置、电子设备及计算机可读存储介质
US12367603B2 (en) * 2021-09-24 2025-07-22 Apple Inc. Localization based on detected spatial features
US20230222679A1 (en) * 2022-01-07 2023-07-13 Htc Corporation Indoor space positioning method and indoor space positioning system
US20230386093A1 (en) * 2022-05-26 2023-11-30 Apple Inc. Changing Locked Modes Associated with Display of Computer-Generated Content
US12112431B2 (en) * 2022-05-27 2024-10-08 Quantarium Group, LLC Three dimensional mapping
CN115082959B (zh) * 2022-06-16 2025-07-25 海信视像科技股份有限公司 一种显示设备及图像处理方法
US12190545B2 (en) 2022-10-26 2025-01-07 Chengdu Qinchuan Iot Technology Co., Ltd. Intelligent manufacturing industrial internet of things with front split service platform, control method and medium thereof
US12423474B2 (en) * 2023-10-03 2025-09-23 Htc Corporation Data processing method, electronic device and non-transitory computer readable storage medium
US20250200794A1 (en) * 2023-12-14 2025-06-19 Htc Corporation Spatial map information generating apparatus, method, and coordinate system integrating apparatus

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20100208057A1 (en) 2009-02-13 2010-08-19 Peter Meier Methods and systems for determining the pose of a camera with respect to at least one object of a real environment
WO2015186341A1 (ja) 2014-06-03 2015-12-10 日本電気株式会社 画像処理システム、画像処理方法及びプログラム記憶媒体
WO2017183346A1 (ja) 2016-04-18 2017-10-26 ソニー株式会社 情報処理装置、情報処理方法、及びプログラム

Family Cites Families (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0907145A3 (en) * 1997-10-03 2003-03-26 Nippon Telegraph and Telephone Corporation Method and equipment for extracting image features from image sequence
US20020180793A1 (en) * 2001-05-31 2002-12-05 International Business Machines Corporation Dynamic buffering of graphic images by a platform independent application program interface
WO2004093013A1 (ja) 2003-04-15 2004-10-28 Fujitsu Limited 画像照合装置、画像照合方法、及び画像照合プログラム
US9292973B2 (en) * 2010-11-08 2016-03-22 Microsoft Technology Licensing, Llc Automatic variable virtual focus for augmented reality displays
US9501725B2 (en) * 2013-06-11 2016-11-22 Qualcomm Incorporated Interactive and automatic 3-D object scanning method for the purpose of database creation
JP6759550B2 (ja) * 2015-03-04 2020-09-23 ソニー株式会社 情報処理装置、プログラム、情報処理方法及び観察システム
WO2017011793A1 (en) * 2015-07-16 2017-01-19 Google Inc. Camera pose estimation for mobile devices
US10909711B2 (en) 2015-12-04 2021-02-02 Magic Leap, Inc. Relocalization systems and methods
US20170169617A1 (en) * 2015-12-14 2017-06-15 II Jonathan M. Rodriguez Systems and Methods for Creating and Sharing a 3-Dimensional Augmented Reality Space
CN109923867A (zh) * 2016-09-14 2019-06-21 皇家Kpn公司 流式传输虚拟现实视频
US10242654B2 (en) * 2017-01-25 2019-03-26 Microsoft Technology Licensing, Llc No miss cache structure for real-time image transformations
US11227435B2 (en) * 2018-08-13 2022-01-18 Magic Leap, Inc. Cross reality system
CN110378965B (zh) * 2019-05-21 2022-04-15 北京百度网讯科技有限公司 确定路侧成像设备坐标系转换参数的方法、装置、设备

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20100208057A1 (en) 2009-02-13 2010-08-19 Peter Meier Methods and systems for determining the pose of a camera with respect to at least one object of a real environment
WO2015186341A1 (ja) 2014-06-03 2015-12-10 日本電気株式会社 画像処理システム、画像処理方法及びプログラム記憶媒体
WO2017183346A1 (ja) 2016-04-18 2017-10-26 ソニー株式会社 情報処理装置、情報処理方法、及びプログラム

Also Published As

Publication number Publication date
CN115176285A (zh) 2022-10-11
US20210264674A1 (en) 2021-08-26
US11557099B2 (en) 2023-01-17
WO2021173862A1 (en) 2021-09-02
EP4111368A1 (en) 2023-01-04
CN116721235A (zh) 2023-09-08
CN115176285B (zh) 2023-07-25
JP2023515523A (ja) 2023-04-13
US12002170B2 (en) 2024-06-04
US20220406024A1 (en) 2022-12-22
EP4111368A4 (en) 2023-08-16

Similar Documents

Publication Publication Date Title
JP7665839B2 (ja) Ｗｉｆｉ／ｇｐｓベースのマップマージを伴うクロスリアリティシステム
JP7825024B2 (ja) 位置特定サービスを伴うクロスリアリティシステム
JP7653982B2 (ja) 無線フィンガプリントを用いたクロスリアリティシステム
JP7684321B2 (ja) 位置特定に関するジオロケーション情報の優先順位化を伴うクロスリアリティシステム
JP7677985B2 (ja) 正確な共有マップを伴うクロスリアリティシステム
JP7671769B2 (ja) 高速位置特定を伴うクロスリアリティシステム
JP7604475B2 (ja) 複数のデバイスタイプをサポートするクロスリアリティシステム
JP7784489B2 (ja) 位置特定サービスおよび共有場所ベースのコンテンツを伴うクロスリアリティシステム
JP7772975B2 (ja) 大規模環境再構築のためのクロスリアリティシステム
JP7777536B2 (ja) 大規模環境のためのクロスリアリティシステム
JP7768888B2 (ja) マルチ分解能フレーム記述子を使用したマップ処理を伴うクロスリアリティシステム
US11900547B2 (en) Cross reality system for large scale environments
JP7586918B2 (ja) 位置特定正確度のためのバッファを伴うクロスリアリティシステム
JP7711263B2 (ja) クロスリアリティシステム

Legal Events

Date Code Title Description
A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20240213

A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20240213

A871 Explanation of circumstances concerning accelerated examination

Free format text: JAPANESE INTERMEDIATE CODE: A871

Effective date: 20240213

A977 Report on retrieval

Free format text: JAPANESE INTERMEDIATE CODE: A971007

Effective date: 20240613

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20240620

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20240912

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20241009

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20241107

R150 Certificate of patent or registration of utility model

Ref document number: 7586918

Country of ref document: JP

Free format text: JAPANESE INTERMEDIATE CODE: R150