JP7526169B2 - クロスリアリティシステム - Google Patents

クロスリアリティシステム Download PDF

Info

Publication number
JP7526169B2
JP7526169B2 JP2021518528A JP2021518528A JP7526169B2 JP 7526169 B2 JP7526169 B2 JP 7526169B2 JP 2021518528 A JP2021518528 A JP 2021518528A JP 2021518528 A JP2021518528 A JP 2021518528A JP 7526169 B2 JP7526169 B2 JP 7526169B2
Authority
JP
Japan
Prior art keywords
map
persistent
coordinate
user
frame
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
JP2021518528A
Other languages
English (en)
Japanese (ja)
Other versions
JPWO2020072972A5 (https=
JP2022509731A5 (https=
JP2022509731A (ja
Inventor
アヌシュ モハン，
ロバート ブレイク テイラー，
ジェレミー ドウェイン ミランダ，
ラファエル ドミンゴス トーレス，
ダニエル オルシャンスキー，
アリ シャーロクニー，
エラン ゲンデルマン，
ニック クラマー，
ケン トッセル，
サミュエル エー． ミラー，
ジェハンギール タジク，
アシュウィン スワミナサン，
ロメシュ アガルワル，
プラティーク シンガル，
ジョエル デイビッド ホルダー，
シュアン ジャオ，
シッダルタ チョーダリー，
ヘルダー トシロウ スズキ，
ヒラル ホナル バロット，
クリスチャン イヴァン ロバート ムーア，
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Magic Leap Inc
Original Assignee
Magic Leap Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Magic Leap Inc filed Critical Magic Leap Inc
Publication of JP2022509731A publication Critical patent/JP2022509731A/ja
Publication of JPWO2020072972A5 publication Critical patent/JPWO2020072972A5/ja
Publication of JP2022509731A5 publication Critical patent/JP2022509731A5/ja
Priority to JP2024087120A priority Critical patent/JP7711263B2/ja
Application granted granted Critical
Publication of JP7526169B2 publication Critical patent/JP7526169B2/ja
Priority to JP2025087496A priority patent/JP2025122153A/ja
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G06F3/04815—Interaction with a metaphor-based environment or interaction object displayed as three-dimensional [3D], e.g. changing the user viewpoint with respect to the environment or object
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00—Pattern recognition
    • G06F18/20—Analysing
    • G06F18/25—Fusion techniques
    • G06F18/253—Fusion techniques of extracted features
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating three-dimensional [3D] models or images for computer graphics
    • G06T19/006—Mixed reality
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/40—Extraction of image or video features
    • G06V10/46—Descriptors for shape, contour or point-related descriptors, e.g. scale invariant feature transform [SIFT] or bags of words [BoW]; Salient regional features
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/40—Extraction of image or video features
    • G06V10/46—Descriptors for shape, contour or point-related descriptors, e.g. scale invariant feature transform [SIFT] or bags of words [BoW]; Salient regional features
    • G06V10/462—Salient features, e.g. scale invariant feature transforms [SIFT]
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/82—Arrangements for image or video recognition or understanding using pattern recognition or machine learning using neural networks
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/20—Scenes; Scene-specific elements in augmented reality scenes
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/40—Scenes; Scene-specific elements in video content
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/40—Scenes; Scene-specific elements in video content
    • G06V20/49—Segmenting video sequences, i.e. computational techniques such as parsing or cutting the sequence, low-level clustering or determining units such as shots or scenes

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • General Engineering & Computer Science (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Evolutionary Computation (AREA)
  • Software Systems (AREA)
  • Computing Systems (AREA)
  • Artificial Intelligence (AREA)
  • Computer Graphics (AREA)
  • Computer Hardware Design (AREA)
  • Databases & Information Systems (AREA)
  • General Health & Medical Sciences (AREA)
  • Medical Informatics (AREA)
  • Health & Medical Sciences (AREA)
  • Data Mining & Analysis (AREA)
  • Human Computer Interaction (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Bioinformatics & Cheminformatics (AREA)
  • Bioinformatics & Computational Biology (AREA)
  • Evolutionary Biology (AREA)
  • Processing Or Creating Images (AREA)
  • User Interface Of Digital Computer (AREA)
JP2021518528A 2018-10-05 2019-10-04 クロスリアリティシステム Active JP7526169B2 (ja)

Priority Applications (2)

Application Number Priority Date Filing Date Title
JP2024087120A JP7711263B2 (ja) 2018-10-05 2024-05-29 クロスリアリティシステム
JP2025087496A JP2025122153A (ja) 2018-10-05 2025-05-26 クロスリアリティシステム

Applications Claiming Priority (13)

Application Number Priority Date Filing Date Title
US201862742237P 2018-10-05 2018-10-05
US62/742,237 2018-10-05
US201962812935P 2019-03-01 2019-03-01
US62/812,935 2019-03-01
US201962815955P 2019-03-08 2019-03-08
US62/815,955 2019-03-08
US201962868786P 2019-06-28 2019-06-28
US62/868,786 2019-06-28
US201962870954P 2019-07-05 2019-07-05
US62/870,954 2019-07-05
US201962884109P 2019-08-07 2019-08-07
US62/884,109 2019-08-07
PCT/US2019/054819 WO2020072972A1 (en) 2018-10-05 2019-10-04 A cross reality system

Related Child Applications (1)

Application Number Title Priority Date Filing Date
JP2024087120A Division JP7711263B2 (ja) 2018-10-05 2024-05-29 クロスリアリティシステム

Publications (4)

Publication Number Publication Date
JP2022509731A JP2022509731A (ja) 2022-01-24
JPWO2020072972A5 JPWO2020072972A5 (https=) 2022-10-11
JP2022509731A5 JP2022509731A5 (https=) 2022-10-11
JP7526169B2 true JP7526169B2 (ja) 2024-07-31

Family

ID=70055505

Family Applications (3)

Application Number Title Priority Date Filing Date
JP2021518528A Active JP7526169B2 (ja) 2018-10-05 2019-10-04 クロスリアリティシステム
JP2024087120A Active JP7711263B2 (ja) 2018-10-05 2024-05-29 クロスリアリティシステム
JP2025087496A Pending JP2025122153A (ja) 2018-10-05 2025-05-26 クロスリアリティシステム

Family Applications After (2)

Application Number Title Priority Date Filing Date
JP2024087120A Active JP7711263B2 (ja) 2018-10-05 2024-05-29 クロスリアリティシステム
JP2025087496A Pending JP2025122153A (ja) 2018-10-05 2025-05-26 クロスリアリティシステム

Country Status (4)

Country Link
EP (1) EP3861533A4 (https=)
JP (3) JP7526169B2 (https=)
CN (2) CN113544748B (https=)
WO (1) WO2020072972A1 (https=)

Families Citing this family (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2021238145A1 (zh) * 2020-05-26 2021-12-02 北京市商汤科技开发有限公司 Ar场景内容的生成方法、展示方法、装置及存储介质
US11556961B2 (en) * 2020-07-23 2023-01-17 At&T Intellectual Property I, L.P. Techniques for real-time object creation in extended reality environments
CN112465890B (zh) * 2020-11-24 2024-11-08 深圳市商汤科技有限公司 深度检测方法、装置、电子设备和计算机可读存储介质
US11200754B1 (en) * 2020-12-22 2021-12-14 Accenture Global Solutions Limited Extended reality environment generation
CN113313809B (zh) * 2021-06-03 2024-12-27 中国建设银行股份有限公司 一种渲染方法和装置
WO2023043607A1 (en) * 2021-09-16 2023-03-23 Chinook Labs Llc Aligning scanned environments for multi-user communication sessions
CN119847337A (zh) * 2021-11-19 2025-04-18 苹果公司 用于电子设备应用程序的场景信息访问
CN114332419B (zh) * 2021-12-28 2025-11-18 深圳市慧鲤科技有限公司 一种虚拟显示的处理方法、装置、设备和介质

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20160179830A1 (en) 2014-12-19 2016-06-23 Qualcomm Incorporated Scalable 3d mapping system
JP2017107604A (ja) 2013-03-11 2017-06-15 マジック リープ， インコーポレイテッド 拡張現実および仮想現実のためのシステムおよび方法
JP2017529635A (ja) 2014-06-14 2017-10-05 マジック リープ， インコーポレイテッドＭａｇｉｃ Ｌｅａｐ，Ｉｎｃ． 仮想および拡張現実を作成する方法およびシステム
US20180053315A1 (en) 2016-05-31 2018-02-22 Microsoft Technology Licensing, Llc Systems and methods for utilizing anchor graphs in mixed reality environments

Family Cites Families (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7542034B2 (en) * 2004-09-23 2009-06-02 Conversion Works, Inc. System and method for processing video images
US20080090659A1 (en) * 2006-10-12 2008-04-17 Maximino Aguilar Virtual world event notification from a persistent world game server in a logically partitioned game console
JP4292426B2 (ja) * 2007-05-15 2009-07-08 ソニー株式会社 撮像装置および撮像データ補正方法
JP2011154500A (ja) * 2010-01-27 2011-08-11 Sony Corp 学習装置、学習方法、識別装置、識別方法、及びプログラム
GB2506338A (en) * 2012-07-30 2014-04-02 Sony Comp Entertainment Europe A method of localisation and mapping
US10025486B2 (en) * 2013-03-15 2018-07-17 Elwha Llc Cross-reality select, drag, and drop for augmented reality systems
US10262462B2 (en) * 2014-04-18 2019-04-16 Magic Leap, Inc. Systems and methods for augmented and virtual reality
US9196022B2 (en) * 2014-03-10 2015-11-24 Omnivision Technologies, Inc. Image transformation and multi-view output systems and methods
JP2018014579A (ja) * 2016-07-20 2018-01-25 株式会社日立製作所 カメラトラッキング装置および方法
US10007868B2 (en) * 2016-09-19 2018-06-26 Adobe Systems Incorporated Font replacement based on visual similarity

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2017107604A (ja) 2013-03-11 2017-06-15 マジック リープ， インコーポレイテッド 拡張現実および仮想現実のためのシステムおよび方法
JP2017529635A (ja) 2014-06-14 2017-10-05 マジック リープ， インコーポレイテッドＭａｇｉｃ Ｌｅａｐ，Ｉｎｃ． 仮想および拡張現実を作成する方法およびシステム
US20160179830A1 (en) 2014-12-19 2016-06-23 Qualcomm Incorporated Scalable 3d mapping system
US20180053315A1 (en) 2016-05-31 2018-02-22 Microsoft Technology Licensing, Llc Systems and methods for utilizing anchor graphs in mixed reality environments

Also Published As

Publication number Publication date
WO2020072972A1 (en) 2020-04-09
CN120780192A (zh) 2025-10-14
EP3861533A4 (en) 2022-12-21
EP3861533A1 (en) 2021-08-11
CN113544748A (zh) 2021-10-22
WO2020072972A8 (en) 2021-09-23
JP2024103610A (ja) 2024-08-01
JP2025122153A (ja) 2025-08-20
JP7711263B2 (ja) 2025-07-22
CN113544748B (zh) 2025-06-03
JP2022509731A (ja) 2022-01-24

Similar Documents

Publication Publication Date Title
JP7825024B2 (ja) 位置特定サービスを伴うクロスリアリティシステム
JP7646788B2 (ja) クロスリアリティシステム
JP7604475B2 (ja) 複数のデバイスタイプをサポートするクロスリアリティシステム
JP7784489B2 (ja) 位置特定サービスおよび共有場所ベースのコンテンツを伴うクロスリアリティシステム
JP7671769B2 (ja) 高速位置特定を伴うクロスリアリティシステム
JP7677985B2 (ja) 正確な共有マップを伴うクロスリアリティシステム
JP7653982B2 (ja) 無線フィンガプリントを用いたクロスリアリティシステム
JP7777536B2 (ja) 大規模環境のためのクロスリアリティシステム
US11978159B2 (en) Cross reality system
JP7684321B2 (ja) 位置特定に関するジオロケーション情報の優先順位化を伴うクロスリアリティシステム
JP7768888B2 (ja) マルチ分解能フレーム記述子を使用したマップ処理を伴うクロスリアリティシステム
JP7604478B2 (ja) 持続座標フレームについての品質情報を伴うクロスリアリティシステム
JP7627281B2 (ja) 大規模環境再構築のためのクロスリアリティシステム
JP7711263B2 (ja) クロスリアリティシステム

Legal Events

Date Code Title Description
A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20220929

A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20220929

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20231106

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20240206

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20240229

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20240529

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20240705

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20240719

R150 Certificate of patent or registration of utility model

Ref document number: 7526169

Country of ref document: JP

Free format text: JAPANESE INTERMEDIATE CODE: R150