JP7504212B2 - Ｗｉｆｉ／ｇｐｓベースのマップマージを伴うクロスリアリティシステム - Google Patents

Ｗｉｆｉ／ｇｐｓベースのマップマージを伴うクロスリアリティシステム Download PDF

Info

Publication number
JP7504212B2
JP7504212B2 JP2022549630A JP2022549630A JP7504212B2 JP 7504212 B2 JP7504212 B2 JP 7504212B2 JP 2022549630 A JP2022549630 A JP 2022549630A JP 2022549630 A JP2022549630 A JP 2022549630A JP 7504212 B2 JP7504212 B2 JP 7504212B2
Authority
JP
Japan
Prior art keywords
map
tiles
tracking
user
location
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
JP2022549630A
Other languages
English (en)
Japanese (ja)
Other versions
JP2023515796A5 (https=
JPWO2021168338A5 (https=
JP2023515796A (ja
Inventor
モーシェ ブニク，
ベン ワイスビー，
ベラスケス， ミゲル アンドレス グラナドス
アリ シャーロクニー，
アシュウィン スワミナサン，
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Magic Leap Inc
Original Assignee
Magic Leap Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Magic Leap Inc filed Critical Magic Leap Inc
Publication of JP2023515796A publication Critical patent/JP2023515796A/ja
Publication of JP2023515796A5 publication Critical patent/JP2023515796A5/ja
Publication of JPWO2021168338A5 publication Critical patent/JPWO2021168338A5/ja
Priority to JP2024094286A priority Critical patent/JP7665839B2/ja
Application granted granted Critical
Publication of JP7504212B2 publication Critical patent/JP7504212B2/ja
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating three-dimensional [3D] models or images for computer graphics
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T17/00—Three-dimensional [3D] modelling for computer graphics
    • G06T17/05—Geographic models
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/00—Three-dimensional [3D] image rendering
    • G06T15/10—Geometric effects
    • G06T15/20—Perspective computation
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/00—Three-dimensional [3D] image rendering
    • G06T15/005—General purpose rendering architectures
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/00—Three-dimensional [3D] image rendering
    • G06T15/10—Geometric effects
    • G06T15/20—Perspective computation
    • G06T15/205—Image-based rendering
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T17/00—Three-dimensional [3D] modelling for computer graphics
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating three-dimensional [3D] models or images for computer graphics
    • G06T19/006—Mixed reality
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00—Image enhancement or restoration
    • G06T5/50—Image enhancement or restoration using two or more images, e.g. averaging or subtraction
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/30—Determination of transform parameters for the alignment of images, i.e. image registration
    • G06T7/33—Determination of transform parameters for the alignment of images, i.e. image registration using feature-based methods
    • G06T7/337—Determination of transform parameters for the alignment of images, i.e. image registration using feature-based methods involving reference images or patches
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/50—Depth or shape recovery
    • G06T7/55—Depth or shape recovery from multiple images

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Graphics (AREA)
  • Software Systems (AREA)
  • Geometry (AREA)
  • Computer Hardware Design (AREA)
  • General Engineering & Computer Science (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Computing Systems (AREA)
  • Remote Sensing (AREA)
  • User Interface Of Digital Computer (AREA)
  • Processing Or Creating Images (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
  • Instructional Devices (AREA)
JP2022549630A 2020-02-20 2021-02-19 Ｗｉｆｉ／ｇｐｓベースのマップマージを伴うクロスリアリティシステム Active JP7504212B2 (ja)

Priority Applications (1)

Application Number Priority Date Filing Date Title
JP2024094286A JP7665839B2 (ja) 2020-02-20 2024-06-11 Ｗｉｆｉ／ｇｐｓベースのマップマージを伴うクロスリアリティシステム

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US202062979362P 2020-02-20 2020-02-20
US62/979,362 2020-02-20
PCT/US2021/018893 WO2021168338A1 (en) 2020-02-20 2021-02-19 Cross reality system with wifi/gps based map merge

Related Child Applications (1)

Application Number Title Priority Date Filing Date
JP2024094286A Division JP7665839B2 (ja) 2020-02-20 2024-06-11 Ｗｉｆｉ／ｇｐｓベースのマップマージを伴うクロスリアリティシステム

Publications (4)

Publication Number Publication Date
JP2023515796A JP2023515796A (ja) 2023-04-14
JP2023515796A5 JP2023515796A5 (https=) 2024-02-16
JPWO2021168338A5 JPWO2021168338A5 (https=) 2024-02-16
JP7504212B2 true JP7504212B2 (ja) 2024-06-21

Family

ID=77391267

Family Applications (2)

Application Number Title Priority Date Filing Date
JP2022549630A Active JP7504212B2 (ja) 2020-02-20 2021-02-19 Ｗｉｆｉ／ｇｐｓベースのマップマージを伴うクロスリアリティシステム
JP2024094286A Active JP7665839B2 (ja) 2020-02-20 2024-06-11 Ｗｉｆｉ／ｇｐｓベースのマップマージを伴うクロスリアリティシステム

Family Applications After (1)

Application Number Title Priority Date Filing Date
JP2024094286A Active JP7665839B2 (ja) 2020-02-20 2024-06-11 Ｗｉｆｉ／ｇｐｓベースのマップマージを伴うクロスリアリティシステム

Country Status (5)

Country Link
US (3) US11532124B2 (https=)
EP (1) EP4107702A4 (https=)
JP (2) JP7504212B2 (https=)
CN (2) CN115151947B (https=)
WO (1) WO2021168338A1 (https=)

Families Citing this family (28)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN120372106A (zh) * 2018-02-08 2025-07-25 连普乐士株式会社 聊天室显示方法、聊天室显示系统及计算机可读记录介质
US11448512B2 (en) * 2020-04-06 2022-09-20 Here Global B.V. Systems and methods for verifying mapping information
KR20220030641A (ko) * 2020-09-03 2022-03-11 삼성전자주식회사 전자 장치 및 전자 장치의 동작 방법
US11522945B2 (en) * 2020-10-20 2022-12-06 Iris Tech Inc. System for providing synchronized sharing of augmented reality content in real time across multiple devices
US12596169B2 (en) 2020-10-29 2026-04-07 Cognosos, Inc. Method and system for locating objects within a master space using machine learning on RF radiolocation
US12209882B2 (en) * 2020-12-18 2025-01-28 Intel Corporation Map representation system and method for operating an autonomous agent
US11995776B2 (en) * 2021-01-19 2024-05-28 Samsung Electronics Co., Ltd. Extended reality interaction in synchronous virtual spaces using heterogeneous devices
US12159359B2 (en) 2021-03-11 2024-12-03 Quintar, Inc. Use of multiple registrations for augmented reality system for viewing an event
US20230260240A1 (en) * 2021-03-11 2023-08-17 Quintar, Inc. Alignment of 3d graphics extending beyond frame in augmented reality system with remote presentation
US12586305B2 (en) 2021-03-11 2026-03-24 Quintar, Inc. 3D reference point detection for survey for venue model construction
US11527047B2 (en) 2021-03-11 2022-12-13 Quintar, Inc. Augmented reality system for viewing an event with distributed computing
US12542946B2 (en) 2021-03-11 2026-02-03 Quintar, Inc. Remote presentation with augmented reality content synchronized with separately displayed video content
US11645819B2 (en) * 2021-03-11 2023-05-09 Quintar, Inc. Augmented reality system for viewing an event with mode based on crowd sourced images
US12244782B2 (en) 2021-03-11 2025-03-04 Quintar, Inc. Augmented reality system for remote presentation for viewing an event
US12028507B2 (en) * 2021-03-11 2024-07-02 Quintar, Inc. Augmented reality system with remote presentation including 3D graphics extending beyond frame
US12003806B2 (en) * 2021-03-11 2024-06-04 Quintar, Inc. Augmented reality system for viewing an event with multiple coordinate systems and automatically generated model
US11657578B2 (en) * 2021-03-11 2023-05-23 Quintar, Inc. Registration for augmented reality system for viewing an event
US11720165B2 (en) * 2021-03-25 2023-08-08 Comcast Cable Communications, Llc Multi-party location-based VR shared space usage optimization
US12101197B1 (en) * 2021-07-06 2024-09-24 Apple Inc. Temporarily suspending spatial constraints
US12569755B2 (en) * 2021-09-29 2026-03-10 Magnopus, LLC Platform agnostic autoscaling multiplayer inter and intra server communication manager system and method for AR, VR, mixed reality, and XR connected spaces
US12130998B1 (en) * 2022-01-20 2024-10-29 Apple Inc. Application content management in 3D environments
US12231409B2 (en) * 2022-02-15 2025-02-18 Capital One Services, Llc Methods and systems for linking mobile applications to multi-access point providers using an intermediary database
CN117152385A (zh) * 2022-03-25 2023-12-01 脸萌有限公司 图像处理方法、装置、电子设备及存储介质
CN114742962B (zh) * 2022-04-11 2025-05-27 亿咖通(湖北)技术有限公司 地图构建方法、装置、存储介质及处理器
US20240241893A1 (en) * 2023-01-13 2024-07-18 Argo AI, LLC Systems and methods for providing electronic maps
US12025454B1 (en) * 2023-07-28 2024-07-02 Goodmaps Inc. Localization of user(s) in environment(s)
US20250200794A1 (en) * 2023-12-14 2025-06-19 Htc Corporation Spatial map information generating apparatus, method, and coordinate system integrating apparatus
WO2026009914A1 (ja) * 2024-07-02 2026-01-08 無存楽株式会社 方法、プログラム、記憶媒体及び情報処理システム

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2019502214A (ja) 2015-11-04 2019-01-24 ズークス インコーポレイテッド 物理的環境の変化に応答して自律車両をナビゲートするための適応マッピング
WO2019126671A1 (en) 2017-12-22 2019-06-27 Magic Leap, Inc. Caching and updating of dense 3d reconstruction data
WO2020023582A1 (en) 2018-07-24 2020-01-30 Magic Leap, Inc. Methods and apparatuses for determining and/or evaluating localizing maps of image display devices

Family Cites Families (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20120306850A1 (en) * 2011-06-02 2012-12-06 Microsoft Corporation Distributed asynchronous localization and mapping for augmented reality
US20140267234A1 (en) * 2013-03-15 2014-09-18 Anselm Hook Generation and Sharing Coordinate System Between Users on Mobile
US20150193982A1 (en) * 2014-01-03 2015-07-09 Google Inc. Augmented reality overlays using position and orientation to facilitate interactions between electronic devices
US20150206343A1 (en) * 2014-01-17 2015-07-23 Nokia Corporation Method and apparatus for evaluating environmental structures for in-situ content augmentation
US10134182B1 (en) * 2016-06-23 2018-11-20 Zoox, Inc. Large scale dense mapping
US10365658B2 (en) * 2016-07-21 2019-07-30 Mobileye Vision Technologies Ltd. Systems and methods for aligning crowdsourced sparse map data
CN107590260B (zh) * 2017-09-21 2020-02-18 北京星闪世图科技有限公司 点云数据实时检索方法及其系统
US11127203B2 (en) * 2018-05-16 2021-09-21 Samsung Electronics Co., Ltd. Leveraging crowdsourced data for localization and mapping within an environment
US10290049B1 (en) * 2018-06-27 2019-05-14 Beijing Jingdong Shangke Information Technology Co., Ltd. System and method for multi-user augmented reality shopping
US11422259B2 (en) * 2018-06-28 2022-08-23 Zoox, Inc. Multi-resolution maps for localization
JP7459051B2 (ja) * 2018-07-24 2024-04-01 マジック リープ， インコーポレイテッド 角検出のための方法および装置
US11227435B2 (en) * 2018-08-13 2022-01-18 Magic Leap, Inc. Cross reality system
WO2020069525A1 (en) * 2018-09-28 2020-04-02 Jido, Inc. Method for detecting objects and localizing a mobile computing device within an augmented reality experience
US11087553B2 (en) * 2019-01-04 2021-08-10 University Of Maryland, College Park Interactive mixed reality platform utilizing geotagged social media
US11465642B2 (en) * 2019-01-30 2022-10-11 Baidu Usa Llc Real-time map generation system for autonomous vehicles
US20210110646A1 (en) * 2019-10-11 2021-04-15 Citrix Systems, Inc. Systems and methods of geolocating augmented reality consoles

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2019502214A (ja) 2015-11-04 2019-01-24 ズークス インコーポレイテッド 物理的環境の変化に応答して自律車両をナビゲートするための適応マッピング
WO2019126671A1 (en) 2017-12-22 2019-06-27 Magic Leap, Inc. Caching and updating of dense 3d reconstruction data
JP2021507403A (ja) 2017-12-22 2021-02-22 マジック リープ， インコーポレイテッドＭａｇｉｃ Ｌｅａｐ，Ｉｎｃ． 稠密３ｄ再構成データのキャッシュおよび更新
WO2020023582A1 (en) 2018-07-24 2020-01-30 Magic Leap, Inc. Methods and apparatuses for determining and/or evaluating localizing maps of image display devices
US20200034624A1 (en) 2018-07-24 2020-01-30 Magic Leap, Inc. Methods and apparatuses for determining and/or evaluating localizing maps of image display devices
JP2021530817A (ja) 2018-07-24 2021-11-11 マジック リープ, インコーポレイテッドMagic Leap, Inc. 画像ディスプレイデバイスの位置特定マップを決定および／または評価するための方法および装置

Also Published As

Publication number Publication date
CN115151947B (zh) 2024-03-19
US20230108794A1 (en) 2023-04-06
JP7665839B2 (ja) 2025-04-21
EP4107702A1 (en) 2022-12-28
US12322041B2 (en) 2025-06-03
WO2021168338A1 (en) 2021-08-26
EP4107702A4 (en) 2023-08-30
CN118135082A (zh) 2024-06-04
US11532124B2 (en) 2022-12-20
JP2023515796A (ja) 2023-04-14
US20250265779A1 (en) 2025-08-21
JP2024116297A (ja) 2024-08-27
US20210279953A1 (en) 2021-09-09
CN115151947A (zh) 2022-10-04

Similar Documents

Publication Publication Date Title
JP7665839B2 (ja) Ｗｉｆｉ／ｇｐｓベースのマップマージを伴うクロスリアリティシステム
JP7684321B2 (ja) 位置特定に関するジオロケーション情報の優先順位化を伴うクロスリアリティシステム
JP7604475B2 (ja) 複数のデバイスタイプをサポートするクロスリアリティシステム
JP7825024B2 (ja) 位置特定サービスを伴うクロスリアリティシステム
JP7677985B2 (ja) 正確な共有マップを伴うクロスリアリティシステム
US11900547B2 (en) Cross reality system for large scale environments
JP7772975B2 (ja) 大規模環境再構築のためのクロスリアリティシステム
JP7653982B2 (ja) 無線フィンガプリントを用いたクロスリアリティシステム
JP7777536B2 (ja) 大規模環境のためのクロスリアリティシステム
JP7671769B2 (ja) 高速位置特定を伴うクロスリアリティシステム
JP7525603B2 (ja) 位置特定サービスおよび共有場所ベースのコンテンツを伴うクロスリアリティシステム
JP7768888B2 (ja) マルチ分解能フレーム記述子を使用したマップ処理を伴うクロスリアリティシステム
JP7586918B2 (ja) 位置特定正確度のためのバッファを伴うクロスリアリティシステム

Legal Events

Date Code Title Description
A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20240207

A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20240207

A871 Explanation of circumstances concerning accelerated examination

Free format text: JAPANESE INTERMEDIATE CODE: A871

Effective date: 20240207

A977 Report on retrieval

Free format text: JAPANESE INTERMEDIATE CODE: A971007

Effective date: 20240405

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20240513

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20240611

R150 Certificate of patent or registration of utility model

Ref document number: 7504212

Country of ref document: JP

Free format text: JAPANESE INTERMEDIATE CODE: R150