CN114502921A - 混合现实中的空间指令和指南 - Google Patents

混合现实中的空间指令和指南 Download PDF

Info

Publication number
CN114502921A
CN114502921A CN202080070151.8A CN202080070151A CN114502921A CN 114502921 A CN114502921 A CN 114502921A CN 202080070151 A CN202080070151 A CN 202080070151A CN 114502921 A CN114502921 A CN 114502921A
Authority
CN
China
Prior art keywords
user
location
virtual
virtual content
persistent virtual
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202080070151.8A
Other languages
English (en)
Chinese (zh)
Inventor
T·阿罗拉
S·克拉玛里克
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Magic Leap Inc
Original Assignee
Magic Leap Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Magic Leap Inc filed Critical Magic Leap Inc
Publication of CN114502921A publication Critical patent/CN114502921A/zh
Pending legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating three-dimensional [3D] models or images for computer graphics
    • G06T19/006—Mixed reality
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/012—Head tracking input arrangements
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
    • G06F3/0346—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor with detection of the device orientation or free movement in a three-dimensional [3D] space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F40/00—Handling natural language data
    • G06F40/10—Text processing
    • G06F40/166—Editing, e.g. inserting or deleting
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F40/00—Handling natural language data
    • G06F40/40—Processing or translation of natural language
    • G06F40/55—Rule-based translation
    • G06F40/56—Natural language generation
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00—Network arrangements or protocols for supporting network services or applications
    • H04L67/01—Protocols
    • H04L67/131—Protocols for games, networked simulations or virtual reality
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04W—WIRELESS COMMUNICATION NETWORKS
    • H04W4/00—Services specially adapted for wireless communication networks; Facilities therefor
    • H04W4/02—Services making use of location information
    • H04W4/024—Guidance services
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04W—WIRELESS COMMUNICATION NETWORKS
    • H04W4/00—Services specially adapted for wireless communication networks; Facilities therefor
    • H04W4/02—Services making use of location information
    • H04W4/025—Services making use of location information using location based information parameters
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/017—Head mounted
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; ELECTRIC HEARING AIDS; PUBLIC ADDRESS SYSTEMS
    • H04R2499/00—Aspects covered by H04R or H04S not otherwise provided for in their subgroups
    • H04R2499/10—General applications
    • H04R2499/15—Transducers incorporated in visual displaying devices, e.g. televisions, computer displays, laptops
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04S—STEREOPHONIC SYSTEMS 
    • H04S7/00—Indicating arrangements; Control arrangements, e.g. balance control
    • H04S7/30—Control circuits for electronic adaptation of the sound field
    • H04S7/302—Electronic adaptation of stereophonic sound system to listener position or orientation
    • H04S7/303—Tracking of listener position or orientation

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Artificial Intelligence (AREA)
  • Health & Medical Sciences (AREA)
  • Computational Linguistics (AREA)
  • General Health & Medical Sciences (AREA)
  • Computer Graphics (AREA)
  • Computer Hardware Design (AREA)
  • Software Systems (AREA)
  • User Interface Of Digital Computer (AREA)
  • Processing Or Creating Images (AREA)
  • Stereophonic System (AREA)
  • Navigation (AREA)
CN202080070151.8A 2019-08-07 2020-08-07 混合现实中的空间指令和指南 Pending CN114502921A (zh)

Applications Claiming Priority (5)

Application Number Priority Date Filing Date Title
US201962884153P 2019-08-07 2019-08-07
US62/884,153 2019-08-07
US201962894448P 2019-08-30 2019-08-30
US62/894,448 2019-08-30
PCT/US2020/045496 WO2021026500A1 (en) 2019-08-07 2020-08-07 Spatial instructions and guides in mixed reality

Publications (1)

Publication Number Publication Date
CN114502921A true CN114502921A (zh) 2022-05-13

Family

ID=74498940

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202080070151.8A Pending CN114502921A (zh) 2019-08-07 2020-08-07 混合现实中的空间指令和指南

Country Status (5)

Country Link
US (4) US11704874B2 (https=)
EP (1) EP4010660B1 (https=)
JP (3) JP7464694B2 (https=)
CN (1) CN114502921A (https=)
WO (1) WO2021026500A1 (https=)

Families Citing this family (17)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11195336B2 (en) * 2018-06-08 2021-12-07 Vulcan Inc. Framework for augmented reality applications
US12003585B2 (en) 2018-06-08 2024-06-04 Vale Group Llc Session-based information exchange
US11704874B2 (en) 2019-08-07 2023-07-18 Magic Leap, Inc. Spatial instructions and guides in mixed reality
US11302077B2 (en) 2020-05-29 2022-04-12 Snap Inc. Augmented reality guidance that generates guidance markers
US11880738B1 (en) * 2021-08-17 2024-01-23 Scandit Ag Visual odometry for optical pattern scanning in a real scene
US12488473B1 (en) 2020-07-27 2025-12-02 Scandit Ag Multi-barcode detection in a real scene using interface enhancement based on user input
WO2022046674A1 (en) * 2020-08-24 2022-03-03 Sterling Labs Llc Devices and methods for motion planning of computer characters
CN113630593A (zh) * 2021-08-17 2021-11-09 宁波未知数字信息技术有限公司 一种多模态高精度全空间混合定位系统
CN113727274B (zh) * 2021-08-20 2023-03-24 中国联合网络通信集团有限公司 一种用户移动性确定方法、装置、设备及存储介质
US11863596B2 (en) * 2021-12-07 2024-01-02 Snap Inc. Shared augmented reality session creation
US12284698B2 (en) * 2022-07-20 2025-04-22 Snap Inc. Secure peer-to-peer connections between mobile devices
US12472435B2 (en) 2022-08-12 2025-11-18 Snap Inc. External controller for an eyewear device
EP4350636A1 (fr) * 2022-10-04 2024-04-10 Atos France Passerelle temps réel entre un environnement virtuel et un environnement réel
US12243266B2 (en) 2022-12-29 2025-03-04 Snap Inc. Device pairing using machine-readable optical label
US12333658B2 (en) 2023-02-21 2025-06-17 Snap Inc. Generating user interfaces displaying augmented reality graphics
CN117170504B (zh) * 2023-11-01 2024-01-19 南京维赛客网络科技有限公司 在虚拟人物交互场景中带人观看的方法、系统及存储介质
US12353784B1 (en) * 2024-03-04 2025-07-08 Curio XR (VR EDU) Modified views for an extended reality environment

Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2001312745A (ja) * 2000-04-28 2001-11-09 Sony Corp 情報処理装置および方法、並びに格納媒体
CN1731316A (zh) * 2005-08-19 2006-02-08 北京航空航天大学 虚拟猿戏的人机交互方法
CN101904185A (zh) * 2007-12-21 2010-12-01 摩托罗拉公司 移动虚拟和增强现实系统
CN106227345A (zh) * 2016-07-21 2016-12-14 深圳市金立通信设备有限公司 一种虚拟现实眼镜及其控制方法
CN106716306A (zh) * 2014-09-30 2017-05-24 索尼互动娱乐股份有限公司 将多个头戴式显示器同步到统一空间并且使统一空间中的对象移动关联
US20170243403A1 (en) * 2014-11-11 2017-08-24 Bent Image Lab, Llc Real-time shared augmented reality experience
CN107967089A (zh) * 2017-12-20 2018-04-27 浙江煮艺文化科技有限公司 一种虚拟现实界面显示方法
CN108983968A (zh) * 2018-06-22 2018-12-11 湖南商学院 一种基于虚拟现实的图像大数据交互控制系统及方法
CN109154862A (zh) * 2016-04-21 2019-01-04 诺基亚技术有限公司 虚拟现实因果概要内容

Family Cites Families (52)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4852988A (en) 1988-09-12 1989-08-01 Applied Science Laboratories Visor and camera providing a parallax-free field-of-view image for a head-mounted eye movement measurement system
US6847336B1 (en) 1996-10-02 2005-01-25 Jerome H. Lemelson Selectively controllable heads-up display system
US6433760B1 (en) 1999-01-14 2002-08-13 University Of Central Florida Head mounted display with eyetracking capability
US6491391B1 (en) 1999-07-02 2002-12-10 E-Vision Llc System, apparatus, and method for reducing birefringence
US6871107B1 (en) * 1999-07-01 2005-03-22 Ftr Pty, Ltd. Digital audio transcription system
CA2316473A1 (en) 1999-07-28 2001-01-28 Steve Mann Covert headworn information display or data display or viewfinder
CA2362895A1 (en) 2001-06-26 2002-12-26 Steve Mann Smart sunglasses or computer information display built into eyewear having ordinary appearance, possibly with sight license
DE10132872B4 (de) 2001-07-06 2018-10-11 Volkswagen Ag Kopfmontiertes optisches Durchsichtssystem
US20030030597A1 (en) 2001-08-13 2003-02-13 Geist Richard Edwin Virtual display apparatus for mobile activities
CA2388766A1 (en) 2002-06-17 2003-12-17 Steve Mann Eyeglass frames based computer display or eyeglasses with operationally, actually, or computationally, transparent frames
US6943754B2 (en) 2002-09-27 2005-09-13 The Boeing Company Gaze tracking system, eye-tracking assembly and an associated method of calibration
US7347551B2 (en) 2003-02-13 2008-03-25 Fergason Patent Properties, Llc Optical system for monitoring eye movement
US7500747B2 (en) 2003-10-09 2009-03-10 Ipventure, Inc. Eyeglasses with electrical components
MXPA06011168A (es) 2004-04-01 2007-04-16 William C Torch Biosensores, comunicadores, y controladores que verifican el movimiento del ojo y metodos para utilizarlos.
US9658473B2 (en) 2005-10-07 2017-05-23 Percept Technologies Inc Enhanced optical and perceptual digital eyewear
US20070081123A1 (en) 2005-10-07 2007-04-12 Lewis Scott W Digital eyewear
US11428937B2 (en) 2005-10-07 2022-08-30 Percept Technologies Enhanced optical and perceptual digital eyewear
US8696113B2 (en) 2005-10-07 2014-04-15 Percept Technologies Inc. Enhanced optical and perceptual digital eyewear
US9021404B2 (en) * 2006-08-25 2015-04-28 Verizon Patent And Licensing Inc. Systems and methods for modifying content based on a positional relationship
JP5100494B2 (ja) 2008-05-08 2012-12-19 株式会社エヌ・ティ・ティ・ドコモ 仮想空間提供装置、プログラム及び仮想空間提供システム
US20110213664A1 (en) 2010-02-28 2011-09-01 Osterhout Group, Inc. Local advertising content on an interactive head-mounted eyepiece
US8890946B2 (en) 2010-03-01 2014-11-18 Eyefluence, Inc. Systems and methods for spatially controlled scene illumination
US8531355B2 (en) 2010-07-23 2013-09-10 Gregory A. Maltz Unitized, vision-controlled, wireless eyeglass transceiver
US9292973B2 (en) 2010-11-08 2016-03-22 Microsoft Technology Licensing, Llc Automatic variable virtual focus for augmented reality displays
US9323325B2 (en) 2011-08-30 2016-04-26 Microsoft Technology Licensing, Llc Enhancing an object of interest in a see-through, mixed reality display device
US20130077147A1 (en) 2011-09-22 2013-03-28 Los Alamos National Security, Llc Method for producing a partially coherent beam with fast pattern update rates
US8929589B2 (en) 2011-11-07 2015-01-06 Eyefluence, Inc. Systems and methods for high-resolution gaze tracking
US8611015B2 (en) 2011-11-22 2013-12-17 Google Inc. User interface
US8235529B1 (en) 2011-11-30 2012-08-07 Google Inc. Unlocking a screen using eye tracking information
US10013053B2 (en) 2012-01-04 2018-07-03 Tobii Ab System for gaze interaction
US8638498B2 (en) 2012-01-04 2014-01-28 David D. Bohn Eyebox adjustment for interpupillary distance
US9274338B2 (en) 2012-03-21 2016-03-01 Microsoft Technology Licensing, Llc Increasing field of view of reflective waveguide
JP6006536B2 (ja) 2012-06-01 2016-10-12 任天堂株式会社 情報処理プログラム、情報処理装置、情報処理システム、およびパノラマ動画表示方法
US8989535B2 (en) 2012-06-04 2015-03-24 Microsoft Technology Licensing, Llc Multiple waveguide imaging structure
CN104903818B (zh) 2012-12-06 2018-12-14 谷歌有限责任公司 眼睛跟踪佩戴式设备和使用方法
CA2896985A1 (en) 2013-01-03 2014-07-10 Meta Company Extramissive spatial imaging digital eye glass for virtual or augmediated vision
US20140195918A1 (en) 2013-01-07 2014-07-10 Steven Friedlander Eye tracking user interface
US9417452B2 (en) 2013-03-15 2016-08-16 Magic Leap, Inc. Display system and method
US10139623B2 (en) 2013-06-18 2018-11-27 Microsoft Technology Licensing, Llc Virtual object orientation and visualization
US9524588B2 (en) 2014-01-24 2016-12-20 Avaya Inc. Enhanced communication between remote participants using augmented and virtual reality
US10602133B2 (en) * 2016-10-04 2020-03-24 Facebook, Inc. Controls and interfaces for user interactions in virtual spaces
MX395185B (es) * 2016-12-05 2025-03-25 Univ Case Western Reserve Sistemas, métodos y medios para mostrar presentaciones interactivas de realidad aumentada.
US11249714B2 (en) 2017-09-13 2022-02-15 Magical Technologies, Llc Systems and methods of shareable virtual objects and virtual objects as message objects to facilitate communications sessions in an augmented reality environment
US10467809B2 (en) * 2018-01-03 2019-11-05 Verizon Patent And Licensing Inc. Methods and systems for presenting a video stream within a persistent virtual reality world
GB201804383D0 (en) * 2018-03-19 2018-05-02 Microsoft Technology Licensing Llc Multi-endpoint mixed reality meetings
US10937249B2 (en) * 2018-05-07 2021-03-02 Google Llc Systems and methods for anchoring virtual objects to physical locations
US10665028B2 (en) * 2018-06-04 2020-05-26 Facebook, Inc. Mobile persistent augmented-reality experiences
US10580218B1 (en) * 2018-07-12 2020-03-03 Facebook, Inc. Augmented-reality image processing
US10375009B1 (en) 2018-10-11 2019-08-06 Richard Fishman Augmented reality based social network with time limited posting
US11854148B2 (en) * 2018-11-16 2023-12-26 Microsoft Technology Licensing, Llc Virtual content display opportunity in mixed reality
WO2020174554A1 (ja) * 2019-02-26 2020-09-03 マクセル株式会社 映像表示装置及び映像表示方法
US11704874B2 (en) 2019-08-07 2023-07-18 Magic Leap, Inc. Spatial instructions and guides in mixed reality

Patent Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2001312745A (ja) * 2000-04-28 2001-11-09 Sony Corp 情報処理装置および方法、並びに格納媒体
CN1731316A (zh) * 2005-08-19 2006-02-08 北京航空航天大学 虚拟猿戏的人机交互方法
CN101904185A (zh) * 2007-12-21 2010-12-01 摩托罗拉公司 移动虚拟和增强现实系统
CN106716306A (zh) * 2014-09-30 2017-05-24 索尼互动娱乐股份有限公司 将多个头戴式显示器同步到统一空间并且使统一空间中的对象移动关联
US20170243403A1 (en) * 2014-11-11 2017-08-24 Bent Image Lab, Llc Real-time shared augmented reality experience
CN109154862A (zh) * 2016-04-21 2019-01-04 诺基亚技术有限公司 虚拟现实因果概要内容
CN106227345A (zh) * 2016-07-21 2016-12-14 深圳市金立通信设备有限公司 一种虚拟现实眼镜及其控制方法
CN107967089A (zh) * 2017-12-20 2018-04-27 浙江煮艺文化科技有限公司 一种虚拟现实界面显示方法
CN108983968A (zh) * 2018-06-22 2018-12-11 湖南商学院 一种基于虚拟现实的图像大数据交互控制系统及方法

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
UNIONSQUARE: "[黑暗之魂2原罪学者]发现新大陆系列：邪眼戒指与血迹的关联设定", pages 2, Retrieved from the Internet <URL:https://www.bilibili.com/video/BV1yx411k7B4/?spm_id_from=333.337.search-card.all.click> *
廖名扬等: "黑暗之魂评测", pages 1 - 2, Retrieved from the Internet <URL:https://www.ign.com.cn/hazhgame/23049/review/hei-an-zhi-hun-ce-ping?p=2> *

Also Published As

Publication number Publication date
JP2022544116A (ja) 2022-10-17
US12020391B2 (en) 2024-06-25
US20230326153A1 (en) 2023-10-12
US20210043005A1 (en) 2021-02-11
US20250391134A1 (en) 2025-12-25
US20240296639A1 (en) 2024-09-05
JP2023130426A (ja) 2023-09-20
EP4010660A1 (en) 2022-06-15
JP7778258B2 (ja) 2025-12-01
EP4010660B1 (en) 2025-09-24
US11704874B2 (en) 2023-07-18
JP2025069241A (ja) 2025-04-30
US12430860B2 (en) 2025-09-30
JP7627720B2 (ja) 2025-02-06
JP7464694B2 (ja) 2024-04-09
WO2021026500A1 (en) 2021-02-11
EP4010660A4 (en) 2022-10-05

Similar Documents

Publication Publication Date Title
JP7778258B2 (ja) 複合現実における空間命令およびガイド
JP7778260B2 (ja) 仮想コンテンツの動的併置
CN115398316B (zh) 3d对象注释
US12315094B2 (en) Session manager

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
WD01 Invention patent application deemed withdrawn after publication
WD01 Invention patent application deemed withdrawn after publication

Application publication date: 20220513