CN113544748B - 交叉现实系统 - Google Patents

交叉现实系统 Download PDF

Info

Publication number
CN113544748B
CN113544748B CN201980080054.4A CN201980080054A CN113544748B CN 113544748 B CN113544748 B CN 113544748B CN 201980080054 A CN201980080054 A CN 201980080054A CN 113544748 B CN113544748 B CN 113544748B
Authority
CN
China
Prior art keywords
map
persistent
frame
environment
images
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201980080054.4A
Other languages
English (en)
Chinese (zh)
Other versions
CN113544748A (zh
Inventor
A·莫汉
R·B·泰勒
J·D·米兰达
R·D·托雷斯
D·奥利尚斯基
A·沙阿罗克尼
E·格恩德尔曼
N·克莱默
K·托塞尔
S·A·米勒
J·塔吉克
A·斯瓦米纳坦
L·阿加瓦尔
P·辛哈尔
J·D·霍尔德
X·赵
S·乔杜里
H·T·苏祖基
H·H·巴罗特
C·I·R·摩尔
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Magic Leap Inc
Original Assignee
Magic Leap Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Magic Leap Inc filed Critical Magic Leap Inc
Priority to CN202510602090.XA priority Critical patent/CN120780192A/zh
Publication of CN113544748A publication Critical patent/CN113544748A/zh
Application granted granted Critical
Publication of CN113544748B publication Critical patent/CN113544748B/zh
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G06F3/04815—Interaction with a metaphor-based environment or interaction object displayed as three-dimensional [3D], e.g. changing the user viewpoint with respect to the environment or object
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00—Pattern recognition
    • G06F18/20—Analysing
    • G06F18/25—Fusion techniques
    • G06F18/253—Fusion techniques of extracted features
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating three-dimensional [3D] models or images for computer graphics
    • G06T19/006—Mixed reality
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/40—Extraction of image or video features
    • G06V10/46—Descriptors for shape, contour or point-related descriptors, e.g. scale invariant feature transform [SIFT] or bags of words [BoW]; Salient regional features
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/40—Extraction of image or video features
    • G06V10/46—Descriptors for shape, contour or point-related descriptors, e.g. scale invariant feature transform [SIFT] or bags of words [BoW]; Salient regional features
    • G06V10/462—Salient features, e.g. scale invariant feature transforms [SIFT]
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/82—Arrangements for image or video recognition or understanding using pattern recognition or machine learning using neural networks
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/20—Scenes; Scene-specific elements in augmented reality scenes
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/40—Scenes; Scene-specific elements in video content
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/40—Scenes; Scene-specific elements in video content
    • G06V20/49—Segmenting video sequences, i.e. computational techniques such as parsing or cutting the sequence, low-level clustering or determining units such as shots or scenes

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • General Engineering & Computer Science (AREA)
  • Evolutionary Computation (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Software Systems (AREA)
  • Computing Systems (AREA)
  • Artificial Intelligence (AREA)
  • Health & Medical Sciences (AREA)
  • Computer Graphics (AREA)
  • Databases & Information Systems (AREA)
  • General Health & Medical Sciences (AREA)
  • Medical Informatics (AREA)
  • Computer Hardware Design (AREA)
  • Human Computer Interaction (AREA)
  • Data Mining & Analysis (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Bioinformatics & Computational Biology (AREA)
  • Evolutionary Biology (AREA)
  • Bioinformatics & Cheminformatics (AREA)
  • Processing Or Creating Images (AREA)
  • User Interface Of Digital Computer (AREA)
CN201980080054.4A 2018-10-05 2019-10-04 交叉现实系统 Active CN113544748B (zh)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202510602090.XA CN120780192A (zh) 2018-10-05 2019-10-04 交叉现实系统

Applications Claiming Priority (13)

Application Number Priority Date Filing Date Title
US201862742237P 2018-10-05 2018-10-05
US62/742,237 2018-10-05
US201962812935P 2019-03-01 2019-03-01
US62/812,935 2019-03-01
US201962815955P 2019-03-08 2019-03-08
US62/815,955 2019-03-08
US201962868786P 2019-06-28 2019-06-28
US62/868,786 2019-06-28
US201962870954P 2019-07-05 2019-07-05
US62/870,954 2019-07-05
US201962884109P 2019-08-07 2019-08-07
US62/884,109 2019-08-07
PCT/US2019/054819 WO2020072972A1 (en) 2018-10-05 2019-10-04 A cross reality system

Related Child Applications (1)

Application Number Title Priority Date Filing Date
CN202510602090.XA Division CN120780192A (zh) 2018-10-05 2019-10-04 交叉现实系统

Publications (2)

Publication Number Publication Date
CN113544748A CN113544748A (zh) 2021-10-22
CN113544748B true CN113544748B (zh) 2025-06-03

Family

ID=70055505

Family Applications (2)

Application Number Title Priority Date Filing Date
CN201980080054.4A Active CN113544748B (zh) 2018-10-05 2019-10-04 交叉现实系统
CN202510602090.XA Pending CN120780192A (zh) 2018-10-05 2019-10-04 交叉现实系统

Family Applications After (1)

Application Number Title Priority Date Filing Date
CN202510602090.XA Pending CN120780192A (zh) 2018-10-05 2019-10-04 交叉现实系统

Country Status (4)

Country Link
EP (1) EP3861533A4 (cg-RX-API-DMAC7.html)
JP (3) JP7526169B2 (cg-RX-API-DMAC7.html)
CN (2) CN113544748B (cg-RX-API-DMAC7.html)
WO (1) WO2020072972A1 (cg-RX-API-DMAC7.html)

Families Citing this family (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20210148074A (ko) * 2020-05-26 2021-12-07 베이징 센스타임 테크놀로지 디벨롭먼트 컴퍼니 리미티드 Ar 시나리오 콘텐츠의 생성 방법, 전시 방법, 장치 및 저장 매체
US11556961B2 (en) * 2020-07-23 2023-01-17 At&T Intellectual Property I, L.P. Techniques for real-time object creation in extended reality environments
CN112465890B (zh) * 2020-11-24 2024-11-08 深圳市商汤科技有限公司 深度检测方法、装置、电子设备和计算机可读存储介质
US11200754B1 (en) * 2020-12-22 2021-12-14 Accenture Global Solutions Limited Extended reality environment generation
CN113313809B (zh) * 2021-06-03 2024-12-27 中国建设银行股份有限公司 一种渲染方法和装置
CN117999115A (zh) * 2021-09-16 2024-05-07 苹果公司 为多用户通信会话对准扫描环境
CN118265962B (zh) 2021-11-19 2025-01-03 苹果公司 用于电子设备应用程序的场景信息访问
CN114332419B (zh) * 2021-12-28 2025-11-18 深圳市慧鲤科技有限公司 一种虚拟显示的处理方法、装置、设备和介质
CN115562631B (zh) * 2022-09-14 2026-08-04 中国电信股份有限公司 数据显示方法、装置、电子设备及可读存储介质

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104917955A (zh) * 2014-03-10 2015-09-16 全视技术有限公司 一种图像转换和多视图输出系统及方法

Family Cites Families (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7542034B2 (en) * 2004-09-23 2009-06-02 Conversion Works, Inc. System and method for processing video images
US20080090659A1 (en) * 2006-10-12 2008-04-17 Maximino Aguilar Virtual world event notification from a persistent world game server in a logically partitioned game console
JP4292426B2 (ja) * 2007-05-15 2009-07-08 ソニー株式会社 撮像装置および撮像データ補正方法
JP2011154500A (ja) * 2010-01-27 2011-08-11 Sony Corp 学習装置、学習方法、識別装置、識別方法、及びプログラム
GB2506338A (en) 2012-07-30 2014-04-02 Sony Comp Entertainment Europe A method of localisation and mapping
IL308285B2 (en) * 2013-03-11 2024-11-01 Magic Leap Inc System and method for augmentation and virtual reality
US10025486B2 (en) * 2013-03-15 2018-07-17 Elwha Llc Cross-reality select, drag, and drop for augmented reality systems
US10262462B2 (en) * 2014-04-18 2019-04-16 Magic Leap, Inc. Systems and methods for augmented and virtual reality
EP4206870A1 (en) * 2014-06-14 2023-07-05 Magic Leap, Inc. Method for updating a virtual world
US10185775B2 (en) * 2014-12-19 2019-01-22 Qualcomm Technologies, Inc. Scalable 3D mapping system
US10217231B2 (en) * 2016-05-31 2019-02-26 Microsoft Technology Licensing, Llc Systems and methods for utilizing anchor graphs in mixed reality environments
JP2018014579A (ja) * 2016-07-20 2018-01-25 株式会社日立製作所 カメラトラッキング装置および方法
US10007868B2 (en) * 2016-09-19 2018-06-26 Adobe Systems Incorporated Font replacement based on visual similarity

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104917955A (zh) * 2014-03-10 2015-09-16 全视技术有限公司 一种图像转换和多视图输出系统及方法

Also Published As

Publication number Publication date
JP2025122153A (ja) 2025-08-20
JP7526169B2 (ja) 2024-07-31
JP7711263B2 (ja) 2025-07-22
EP3861533A1 (en) 2021-08-11
CN120780192A (zh) 2025-10-14
WO2020072972A8 (en) 2021-09-23
JP2022509731A (ja) 2022-01-24
CN113544748A (zh) 2021-10-22
WO2020072972A1 (en) 2020-04-09
EP3861533A4 (en) 2022-12-21
JP2024103610A (ja) 2024-08-01

Similar Documents

Publication Publication Date Title
CN114600064B (zh) 具有定位服务的交叉现实系统
CN114586071B (zh) 支持多设备类型的交叉现实系统
CN114616534B (zh) 具有无线指纹的交叉现实系统
CN115427758B (zh) 具有精确共享地图的交叉现实系统
CN115398314B (zh) 使用多分辨率帧描述符进行地图处理的交叉现实系统
CN112805750B (zh) 跨现实系统
US11978159B2 (en) Cross reality system
CN115244493B (zh) 用于大规模环境重建的交叉现实系统
CN114616509B (zh) 具有关于持久坐标框架的质量信息的交叉现实系统
US20210279953A1 (en) Cross reality system with wifi/gps based map merge
JP7711263B2 (ja) クロスリアリティシステム
CN116721235A (zh) 利用缓冲的交叉现实系统用于定位精度

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant