CA3059234A1 - Multimodal task execution and text editing for a wearable system - Google Patents

Multimodal task execution and text editing for a wearable system Download PDF

Info

Publication number
CA3059234A1
CA3059234A1 CA3059234A CA3059234A CA3059234A1 CA 3059234 A1 CA3059234 A1 CA 3059234A1 CA 3059234 A CA3059234 A CA 3059234A CA 3059234 A CA3059234 A CA 3059234A CA 3059234 A1 CA3059234 A1 CA 3059234A1
Authority
CA
Canada
Prior art keywords
user
input
virtual object
wearable system
text
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CA3059234A
Other languages
English (en)
French (fr)
Inventor
James M. Powderly
Savannah NILES
Jennifer M. R. Devine
Adam C. Carlson
Jeffrey Sommers
Praveen BABU JD
Ajoy Savio FERNANDES
Anthony Robert Sheeder
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Magic Leap Inc
Original Assignee
Magic Leap Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Magic Leap Inc filed Critical Magic Leap Inc
Publication of CA3059234A1 publication Critical patent/CA3059234A1/en
Pending legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/017—Head mounted
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/017—Head mounted
    • G02B27/0172—Head mounted characterised by optical features
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0179—Display position adjusting means not related to the information to be displayed
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B6/00—Light guides; Structural details of arrangements comprising light guides and other optical elements, e.g. couplings
    • G02B6/0001—Light guides; Structural details of arrangements comprising light guides and other optical elements, e.g. couplings specially adapted for lighting devices or systems
    • G02B6/0011—Light guides; Structural details of arrangements comprising light guides and other optical elements, e.g. couplings specially adapted for lighting devices or systems the light guides being planar or of plate-like form
    • G02B6/0075—Arrangements of multiple light guides
    • G02B6/0076—Stacked arrangements of multiple light guides of the same or different cross-sectional area
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F1/00—Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
    • G06F1/16—Constructional details or arrangements
    • G06F1/1613—Constructional details or arrangements for portable computers
    • G06F1/163—Wearable computers, e.g. on a belt
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/013—Eye tracking input arrangements
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/16—Sound input; Sound output
    • G06F3/167—Audio in a user interface, e.g. using voice commands for navigating, audio feedback
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating 3D models or images for computer graphics
    • G06T19/003—Navigation within 3D models or images
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating 3D models or images for computer graphics
    • G06T19/006—Mixed reality
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0101—Head-up displays characterised by optical features
    • G02B2027/0127—Head-up displays characterised by optical features comprising devices increasing the depth of field
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0101—Head-up displays characterised by optical features
    • G02B2027/0138—Head-up displays characterised by optical features comprising image capture systems, e.g. camera
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0101—Head-up displays characterised by optical features
    • G02B2027/014—Head-up displays characterised by optical features comprising information/image processing systems
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0179—Display position adjusting means not related to the information to be displayed
    • G02B2027/0187—Display position adjusting means not related to the information to be displayed slaved to motion of at least a part of the body of the user, e.g. head, eye
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
    • G06F2203/038—Indexing scheme relating to G06F3/038
    • G06F2203/0381—Multimodal input, i.e. interface arrangements enabling the user to issue commands by simultaneous use of input devices of different nature, e.g. voice plus gesture on digitizer

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Computer Hardware Design (AREA)
  • Optics & Photonics (AREA)
  • Software Systems (AREA)
  • Computer Graphics (AREA)
  • Remote Sensing (AREA)
  • Radar, Positioning & Navigation (AREA)
  • General Health & Medical Sciences (AREA)
  • Health & Medical Sciences (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Multimedia (AREA)
  • User Interface Of Digital Computer (AREA)
  • Processing Or Creating Images (AREA)
  • Controls And Circuits For Display Device (AREA)
  • Position Input By Displaying (AREA)
  • Macromonomer-Based Addition Polymer (AREA)
  • Document Processing Apparatus (AREA)
CA3059234A 2017-04-19 2018-04-17 Multimodal task execution and text editing for a wearable system Pending CA3059234A1 (en)

Applications Claiming Priority (5)

Application Number Priority Date Filing Date Title
US201762487364P 2017-04-19 2017-04-19
US62/487,364 2017-04-19
US201762609647P 2017-12-22 2017-12-22
US62/609,647 2017-12-22
PCT/US2018/028002 WO2018195099A1 (en) 2017-04-19 2018-04-17 Multimodal task execution and text editing for a wearable system

Publications (1)

Publication Number Publication Date
CA3059234A1 true CA3059234A1 (en) 2018-10-25

Family

ID=63854461

Family Applications (1)

Application Number Title Priority Date Filing Date
CA3059234A Pending CA3059234A1 (en) 2017-04-19 2018-04-17 Multimodal task execution and text editing for a wearable system

Country Status (9)

Country Link
US (4) US10768693B2 (enExample)
EP (2) EP3612878B1 (enExample)
JP (4) JP7149289B2 (enExample)
KR (2) KR102652922B1 (enExample)
CN (2) CN110785688B (enExample)
AU (1) AU2018256365A1 (enExample)
CA (1) CA3059234A1 (enExample)
IL (1) IL270002B2 (enExample)
WO (1) WO2018195099A1 (enExample)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20230306350A1 (en) * 2022-03-22 2023-09-28 Saudi Arabian Oil Company Method and system for verifying performance-based assessments during virtual reality sessions
US11848000B2 (en) * 2019-09-06 2023-12-19 Microsoft Technology Licensing, Llc Transcription revision interface for speech recognition system
US12254434B2 (en) 2022-03-22 2025-03-18 Saudi Arabian Oil Company Method and system for managing automated performance-based assessments using virtual reality
US12293011B2 (en) 2022-03-22 2025-05-06 Saudi Arabian Oil Company Method and system for managing virtual reality user assessment recordings

Families Citing this family (265)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10768704B2 (en) 2015-03-17 2020-09-08 Whirlwind VR, Inc. System and method for modulating a peripheral device based on an unscripted feed using computer vision
EP3862852A1 (en) 2015-10-20 2021-08-11 Magic Leap, Inc. Selecting virtual objects in a three-dimensional space
WO2017068926A1 (ja) * 2015-10-21 2017-04-27 ソニー株式会社 情報処理装置及びその制御方法、並びにコンピュータ・プログラム
US10078919B2 (en) 2016-03-31 2018-09-18 Magic Leap, Inc. Interactions with 3D virtual objects using poses and multiple-DOF controllers
WO2018176017A1 (en) * 2017-03-24 2018-09-27 Revealit Corporation Method, system, and apparatus for identifying and revealing selected objects from video
CN110785688B (zh) 2017-04-19 2021-08-27 奇跃公司 可穿戴系统的多模式任务执行和文本编辑
US11184574B2 (en) 2017-07-17 2021-11-23 Facebook, Inc. Representing real-world objects with a virtual reality environment
WO2019032967A1 (en) * 2017-08-10 2019-02-14 Google Llc HAND INTERACTION SENSITIVE TO THE CONTEXT
US10373332B2 (en) * 2017-12-08 2019-08-06 Nvidia Corporation Systems and methods for dynamic facial analysis using a recurrent neural network
CN111492426B (zh) * 2017-12-22 2024-02-02 瑞典爱立信有限公司 注视启动的语音控制
CN107977586B (zh) * 2017-12-22 2021-04-13 联想(北京)有限公司 显示内容处理方法、第一电子设备以及第二电子设备
US11314326B2 (en) * 2018-01-04 2022-04-26 Sony Corporation Information processing device, information processing method, and program for determining a user gaze
WO2019143117A1 (en) * 2018-01-18 2019-07-25 Samsung Electronics Co., Ltd. Method and apparatus for adjusting augmented reality content
US11907423B2 (en) * 2019-11-25 2024-02-20 Meta Platforms Technologies, Llc Systems and methods for contextualized interactions with an environment
EP3750032B1 (en) * 2018-02-06 2025-11-05 Walmart Apollo, Llc Augmented reality system for filtering items in real-time
WO2019181153A1 (ja) * 2018-03-20 2019-09-26 ソニー株式会社 情報処理装置、情報処理方法および記録媒体
US10540015B2 (en) * 2018-03-26 2020-01-21 Chian Chiu Li Presenting location related information and implementing a task based on gaze and voice detection
US11157075B2 (en) * 2018-05-01 2021-10-26 Dell Products, L.P. Gaze-activated voice services for interactive workspaces
US20190339837A1 (en) * 2018-05-04 2019-11-07 Oculus Vr, Llc Copy and Paste in a Virtual Reality Environment
US10916065B2 (en) * 2018-05-04 2021-02-09 Facebook Technologies, Llc Prevention of user interface occlusion in a virtual reality environment
KR20230173211A (ko) * 2018-05-04 2023-12-26 구글 엘엘씨 감지된 입 움직임 및/또는 시선을 기반으로 자동화된 어시스턴트 적응
EP4481701A3 (en) 2018-05-04 2025-03-19 Google Llc Hot-word free adaptation of automated assistant function(s)
US10890969B2 (en) 2018-05-04 2021-01-12 Google Llc Invoking automated assistant function(s) based on detected gesture and gaze
US10504290B2 (en) * 2018-05-04 2019-12-10 Facebook Technologies, Llc User interface security in a virtual reality environment
US11169668B2 (en) * 2018-05-16 2021-11-09 Google Llc Selecting an input mode for a virtual assistant
EP3797345A4 (en) 2018-05-22 2022-03-09 Magic Leap, Inc. TRANSMODAL INPUT FUSION FOR A BODY WEARABLE SYSTEM
US11733824B2 (en) 2018-06-22 2023-08-22 Apple Inc. User interaction interpreter
US11227435B2 (en) 2018-08-13 2022-01-18 Magic Leap, Inc. Cross reality system
US10937243B2 (en) * 2018-08-29 2021-03-02 Dell Products, L.P. Real-world object interface for virtual, augmented, and mixed reality (xR) applications
US11348316B2 (en) * 2018-09-11 2022-05-31 Apple Inc. Location-based virtual element modality in three-dimensional content
JP7503542B2 (ja) 2018-10-05 2024-06-20 マジック リープ， インコーポレイテッド 任意の場所における場所特有の仮想コンテンツのレンダリング
US12333065B1 (en) 2018-10-08 2025-06-17 Floreo, Inc. Customizing virtual and augmented reality experiences for neurodevelopmental therapies and education
US11288733B2 (en) * 2018-11-14 2022-03-29 Mastercard International Incorporated Interactive 3D image projection systems and methods
JP7502292B2 (ja) 2018-11-30 2024-06-18 マジック リープ， インコーポレイテッド アバタ移動のためのマルチモードの手の場所および配向
WO2020116001A1 (ja) * 2018-12-03 2020-06-11 ソニー株式会社 情報処理装置および情報処理方法
US11120109B2 (en) 2018-12-05 2021-09-14 Bank Of America Corporation Processing authentication requests to secured information systems based on machine-learned event profiles
US11176230B2 (en) 2018-12-05 2021-11-16 Bank Of America Corporation Processing authentication requests to secured information systems based on user behavior profiles
US11048793B2 (en) 2018-12-05 2021-06-29 Bank Of America Corporation Dynamically generating activity prompts to build and refine machine learning authentication models
US11113370B2 (en) 2018-12-05 2021-09-07 Bank Of America Corporation Processing authentication requests to secured information systems using machine-learned user-account behavior profiles
US11036838B2 (en) 2018-12-05 2021-06-15 Bank Of America Corporation Processing authentication requests to secured information systems using machine-learned user-account behavior profiles
US11159510B2 (en) 2018-12-05 2021-10-26 Bank Of America Corporation Utilizing federated user identifiers to enable secure information sharing
US10930275B2 (en) * 2018-12-18 2021-02-23 Microsoft Technology Licensing, Llc Natural language input disambiguation for spatialized regions
KR102760777B1 (ko) * 2018-12-19 2025-02-03 삼성전자주식회사 외부 객체를 컨트롤러로 이용하기 위한 웨어러블 장치 및 방법
US10789952B2 (en) * 2018-12-20 2020-09-29 Microsoft Technology Licensing, Llc Voice command execution from auxiliary input
US11024074B2 (en) * 2018-12-27 2021-06-01 Facebook Technologies, Llc Virtual spaces, mixed reality spaces, and combined mixed reality spaces for improved interaction and collaboration
WO2020145524A1 (ko) * 2019-01-07 2020-07-16 삼성전자 주식회사 전자 장치 및 이를 이용하는 어시스턴트 서비스를 제공하는 방법
KR102736661B1 (ko) * 2019-01-23 2024-12-02 삼성전자주식회사 장치를 제어하기 위한 방법 및 그 전자 장치
KR102743763B1 (ko) * 2019-02-11 2024-12-17 삼성전자주식회사 가상 현실 유저 인터페이스를 제공하기 위한 전자 장치 및 그의 동작 방법
CN110045819B (zh) * 2019-03-01 2021-07-09 华为技术有限公司 一种手势处理方法及设备
US11908055B2 (en) * 2019-03-13 2024-02-20 Sony Group Corporation Information processing device, information processing method, and recording medium
JPWO2020195709A1 (enExample) * 2019-03-28 2020-10-01
WO2020218634A1 (ko) * 2019-04-23 2020-10-29 엘지전자 주식회사 응답 기기 결정 방법 및 장치
US11321436B2 (en) 2019-05-01 2022-05-03 Samsung Electronics Co., Ltd. Human ID for mobile authentication
EP4300430A3 (en) 2019-05-06 2024-03-06 Apple Inc. Device, method, and graphical user interface for composing cgr files
WO2020226832A1 (en) 2019-05-06 2020-11-12 Apple Inc. Device, method, and computer-readable medium for presenting computer-generated reality files
US10969863B2 (en) * 2019-05-08 2021-04-06 International Business Machines Corporation Configurable sensor array for a multi-target environment
US11297366B2 (en) 2019-05-22 2022-04-05 Google Llc Methods, systems, and media for object grouping and manipulation in immersive environments
CN110334330A (zh) * 2019-05-27 2019-10-15 努比亚技术有限公司 一种信息编辑方法、可穿戴设备及计算机可读存储介质
US10937192B2 (en) * 2019-05-29 2021-03-02 Dell Products, L.P. Resolving incorrect distributed simultaneous localization and mapping (SLAM) data in edge cloud architectures
JP7336266B2 (ja) * 2019-06-04 2023-08-31 キヤノン株式会社 電子機器、電子機器の制御方法、プログラム、記憶媒体
US11334212B2 (en) 2019-06-07 2022-05-17 Facebook Technologies, Llc Detecting input in artificial reality systems based on a pinch and pull gesture
US10890983B2 (en) 2019-06-07 2021-01-12 Facebook Technologies, Llc Artificial reality system having a sliding menu
JP2021005157A (ja) * 2019-06-25 2021-01-14 株式会社ソニー・インタラクティブエンタテインメント 画像処理装置および画像処理方法
US11422638B2 (en) 2019-07-08 2022-08-23 Apple Inc. Input devices that use self-mixing interferometry to determine movement within an enclosure
US11017231B2 (en) * 2019-07-10 2021-05-25 Microsoft Technology Licensing, Llc Semantically tagged virtual and physical objects
JP7451110B2 (ja) * 2019-08-27 2024-03-18 ソニーグループ株式会社 測距システム及び電子機器
CN114341747B (zh) 2019-09-03 2025-04-04 光场实验室公司 移动装置的光场显示器
US11409365B2 (en) * 2019-09-06 2022-08-09 Apple Inc. Self-mixing interferometry-based gesture input system including a wearable or handheld device
US10943388B1 (en) * 2019-09-06 2021-03-09 Zspace, Inc. Intelligent stylus beam and assisted probabilistic input to element mapping in 2D and 3D graphical user interfaces
US11307647B2 (en) 2019-09-11 2022-04-19 Facebook Technologies, Llc Artificial reality triggered by physical object
US10991163B2 (en) 2019-09-20 2021-04-27 Facebook Technologies, Llc Projection casting in virtual environments
US11086406B1 (en) 2019-09-20 2021-08-10 Facebook Technologies, Llc Three-state gesture virtual controls
US11189099B2 (en) 2019-09-20 2021-11-30 Facebook Technologies, Llc Global and local mode virtual object interactions
US11176745B2 (en) 2019-09-20 2021-11-16 Facebook Technologies, Llc Projection casting in virtual environments
US11170576B2 (en) 2019-09-20 2021-11-09 Facebook Technologies, Llc Progressive display of virtual objects
US11580869B2 (en) * 2019-09-23 2023-02-14 Revealit Corporation Computer-implemented interfaces for identifying and revealing selected objects from video
US11419546B2 (en) 2019-09-24 2022-08-23 Apple Inc. Wearable self-mixing interferometry device used to sense physiological conditions
JP2022549853A (ja) 2019-09-27 2022-11-29 マジック リープ， インコーポレイテッド 共有空間内の個々の視認
CN113785260B (zh) 2019-09-27 2025-02-11 苹果公司 控制虚拟对象
US11340756B2 (en) * 2019-09-27 2022-05-24 Apple Inc. Devices, methods, and graphical user interfaces for interacting with three-dimensional environments
EP4046070A4 (en) 2019-10-15 2023-10-18 Magic Leap, Inc. CROSS-REALLY SYSTEM THAT SUPPORTS MULTIPLE DEVICE TYPES
EP4046139A4 (en) 2019-10-15 2023-11-22 Magic Leap, Inc. EXTENDED REALITY SYSTEM WITH LOCATION SERVICE
US11632679B2 (en) 2019-10-15 2023-04-18 Magic Leap, Inc. Cross reality system with wireless fingerprints
US11567788B1 (en) 2019-10-18 2023-01-31 Meta Platforms, Inc. Generating proactive reminders for assistant systems
US11308284B2 (en) 2019-10-18 2022-04-19 Facebook Technologies, Llc. Smart cameras enabled by assistant systems
US11086476B2 (en) * 2019-10-23 2021-08-10 Facebook Technologies, Llc 3D interactions with web content
CN114616509B (zh) 2019-10-31 2024-12-27 奇跃公司 具有关于持久坐标框架的质量信息的交叉现实系统
US11289086B2 (en) * 2019-11-01 2022-03-29 Microsoft Technology Licensing, Llc Selective response rendering for virtual assistants
US11493989B2 (en) * 2019-11-08 2022-11-08 Magic Leap, Inc. Modes of user interaction
EP4059007A4 (en) 2019-11-12 2023-11-01 Magic Leap, Inc. CROSS-REALLY SYSTEM WITH LOCATION SERVICE AND SHARED LOCATION-BASED CONTENT
US11175730B2 (en) 2019-12-06 2021-11-16 Facebook Technologies, Llc Posture-based virtual space configurations
EP4073763A4 (en) 2019-12-09 2023-12-27 Magic Leap, Inc. EXTENDED REALITY SYSTEM WITH SIMPLIFIED VIRTUAL CONTENT PROGRAMMING
US11816757B1 (en) * 2019-12-11 2023-11-14 Meta Platforms Technologies, Llc Device-side capture of data representative of an artificial reality environment
US11487423B2 (en) 2019-12-16 2022-11-01 Microsoft Technology Licensing, Llc Sub-display input areas and hidden inputs
US11042222B1 (en) 2019-12-16 2021-06-22 Microsoft Technology Licensing, Llc Sub-display designation and sharing
US11093046B2 (en) 2019-12-16 2021-08-17 Microsoft Technology Licensing, Llc Sub-display designation for remote content source device
US12148120B2 (en) * 2019-12-18 2024-11-19 Ati Technologies Ulc Frame reprojection for virtual reality and augmented reality
US11475639B2 (en) 2020-01-03 2022-10-18 Meta Platforms Technologies, Llc Self presence in artificial reality
US11687778B2 (en) 2020-01-06 2023-06-27 The Research Foundation For The State University Of New York Fakecatcher: detection of synthetic portrait videos using biological signals
EP3851939A1 (en) * 2020-01-14 2021-07-21 Apple Inc. Positioning a user-controlled spatial selector based on extremity tracking information and eye tracking information
CN115380236B (zh) 2020-01-24 2025-05-06 奇跃公司 使用单个控制器的内容移动和交互
EP4104001A4 (en) 2020-02-13 2024-03-13 Magic Leap, Inc. Cross reality system with map processing using multi-resolution frame descriptors
US11830149B2 (en) 2020-02-13 2023-11-28 Magic Leap, Inc. Cross reality system with prioritization of geolocation information for localization
CN115427758B (zh) 2020-02-13 2025-01-17 奇跃公司 具有精确共享地图的交叉现实系统
CN115380264A (zh) * 2020-02-13 2022-11-22 奇跃公司 用于大规模环境的交叉现实系统
WO2021173779A1 (en) 2020-02-26 2021-09-02 Magic Leap, Inc. Cross reality system with fast localization
JP2021157277A (ja) * 2020-03-25 2021-10-07 ソニーグループ株式会社 情報処理装置、情報処理方法及びプログラム
US11789688B1 (en) 2020-03-26 2023-10-17 Apple Inc. Content presentation based on environmental data
CN113297043A (zh) * 2020-04-08 2021-08-24 阿里巴巴集团控股有限公司 数据处理方法、装置、设备和介质
CN111526083B (zh) * 2020-04-15 2022-04-15 上海幂方电子科技有限公司 通过头部动作即时通信的方法、装置、系统及存储介质
CN111459288B (zh) 2020-04-23 2021-08-03 捷开通讯(深圳)有限公司 一种运用头控实现语音输入的方法和装置
JP7402322B2 (ja) * 2020-05-15 2023-12-20 株式会社Ｎｔｔドコモ 情報処理システム
CN111831112A (zh) * 2020-05-26 2020-10-27 北京理工大学 一种基于眼动以及手指微手势的文本输入系统及方法
CN111782031A (zh) * 2020-05-26 2020-10-16 北京理工大学 一种基于头动以及手指微手势的文本输入系统及方法
US11257280B1 (en) 2020-05-28 2022-02-22 Facebook Technologies, Llc Element-based switching of ray casting rules
US11340707B2 (en) * 2020-05-29 2022-05-24 Microsoft Technology Licensing, Llc Hand gesture-based emojis
CN115698632B (zh) * 2020-06-04 2025-07-15 三菱电机株式会社 建筑物的交通管理系统
US11887589B1 (en) * 2020-06-17 2024-01-30 Amazon Technologies, Inc. Voice-based interactions with a graphical user interface
US11995774B2 (en) * 2020-06-29 2024-05-28 Snap Inc. Augmented reality experiences using speech and text captions
US11256336B2 (en) 2020-06-29 2022-02-22 Facebook Technologies, Llc Integration of artificial reality interaction modes
GB202009874D0 (en) * 2020-06-29 2020-08-12 Microsoft Technology Licensing Llc Visual interface for a computer system
CN115836271A (zh) * 2020-07-14 2023-03-21 苹果公司 生成用于工作空间的建议内容
CN111782053B (zh) * 2020-08-10 2023-04-28 Oppo广东移动通信有限公司 模型编辑方法、装置、设备及存储介质
WO2022046367A1 (en) * 2020-08-25 2022-03-03 Sterling Labs Llc Displaying an environment from a selected point-of-view
US11227445B1 (en) 2020-08-31 2022-01-18 Facebook Technologies, Llc Artificial reality augments and surfaces
US11176755B1 (en) 2020-08-31 2021-11-16 Facebook Technologies, Llc Artificial reality augments and surfaces
US11178376B1 (en) 2020-09-04 2021-11-16 Facebook Technologies, Llc Metering for display modes in artificial reality
US11582245B2 (en) 2020-09-15 2023-02-14 Meta Platforms Technologies, Llc Artificial reality collaborative working environments
EP4636558A2 (en) 2020-09-25 2025-10-22 Apple Inc. Methods for interacting with virtual controls and/or an affordance for moving virtual objects in virtual environments
JP7624510B2 (ja) 2020-09-25 2025-01-30 アップル インコーポレイテッド 環境内のオブジェクトを操作するための方法
EP4200691A1 (en) 2020-09-25 2023-06-28 Apple Inc. Methods for navigating user interfaces
CN116420130A (zh) * 2020-09-25 2023-07-11 苹果公司 用于调节和/或控制与用户界面相关联的沉浸度的方法
CN112379799B (zh) * 2020-10-16 2022-04-01 杭州易现先进科技有限公司 在三维渲染中输入框的控制方法、装置和电子装置
US11113893B1 (en) 2020-11-17 2021-09-07 Facebook Technologies, Llc Artificial reality environment with glints displayed by an extra reality device
KR102258531B1 (ko) * 2020-11-23 2021-06-01 (주)펜타유니버스 복합 입력 인지 시스템용 통합 인지 분석부
US11854230B2 (en) 2020-12-01 2023-12-26 Meta Platforms Technologies, Llc Physical keyboard tracking
KR20220080399A (ko) * 2020-12-07 2022-06-14 삼성전자주식회사 사용자 입력을 처리하는 전자 장치 및 방법
US11928263B2 (en) 2020-12-07 2024-03-12 Samsung Electronics Co., Ltd. Electronic device for processing user input and method thereof
US12046252B2 (en) * 2020-12-08 2024-07-23 International Business Machines Corporation Directional voice command identification
US12223104B2 (en) 2020-12-22 2025-02-11 Meta Platforms Technologies, Llc Partial passthrough in virtual reality
US11461973B2 (en) 2020-12-22 2022-10-04 Meta Platforms Technologies, Llc Virtual reality locomotion via hand gesture
US11409405B1 (en) 2020-12-22 2022-08-09 Facebook Technologies, Llc Augment orchestration in an artificial reality environment
WO2022146936A1 (en) 2020-12-31 2022-07-07 Sterling Labs Llc Method of grouping user interfaces in an environment
US11610363B2 (en) * 2020-12-31 2023-03-21 Oberon Technologies, Inc. Systems and methods for virtual reality environments
KR20220105893A (ko) * 2021-01-21 2022-07-28 삼성전자주식회사 외부 웨어러블 전자 장치로부터 정보를 수신하는 웨어러블 전자 장치 및 그 작동 방법
CN116670618A (zh) 2021-01-21 2023-08-29 三星电子株式会社 从外部可穿戴电子设备接收信息的可穿戴电子设备及其操作方法
CA3204224A1 (en) * 2021-01-29 2022-08-04 Victor LUGO Variable effects activation in an interactive environment
JP7665161B2 (ja) * 2021-02-08 2025-04-21 サイトフル コンピューターズ リミテッド エクステンデッドリアリティにおけるユーザ相互作用
JP7713189B2 (ja) 2021-02-08 2025-07-25 サイトフル コンピューターズ リミテッド エクステンデッドリアリティにおけるコンテンツ共有
US11294475B1 (en) 2021-02-08 2022-04-05 Facebook Technologies, Llc Artificial reality multi-modal input switching model
EP4288856A4 (en) 2021-02-08 2025-02-12 Sightful Computers Ltd Extended reality for productivity
US11995230B2 (en) 2021-02-11 2024-05-28 Apple Inc. Methods for presenting and sharing content in an environment
US12183035B1 (en) 2021-03-08 2024-12-31 Meta Platforms, Inc. System and method for positioning a 3D eyeglasses model
US11478927B1 (en) * 2021-04-01 2022-10-25 Giant.Ai, Inc. Hybrid computing architectures with specialized processors to encode/decode latent representations for controlling dynamic mechanical systems
CN117178245A (zh) * 2021-04-01 2023-12-05 苹果公司 凝视和头部姿态交互
JP2024098511A (ja) * 2021-04-08 2024-07-24 株式会社Ｎｔｔドコモ コンテンツ表示制御システム
EP4323852A1 (en) 2021-04-13 2024-02-21 Apple Inc. Methods for providing an immersive experience in an environment
WO2022245629A1 (en) * 2021-05-19 2022-11-24 Snap Inc. Contextual visual and voice search from electronic eyewear device
US12449907B2 (en) 2021-05-19 2025-10-21 Apple Inc. Navigating user interfaces using a cursor
CN113286163B (zh) * 2021-05-21 2022-07-08 成都威爱新经济技术研究院有限公司 一种用于虚拟拍摄直播的时间戳误差标定方法及系统
US11676348B2 (en) 2021-06-02 2023-06-13 Meta Platforms Technologies, Llc Dynamic mixed reality content in virtual reality
WO2022252150A1 (zh) * 2021-06-02 2022-12-08 陈盈吉 避免动晕症发生的虚拟实境控制方法
US11762952B2 (en) 2021-06-28 2023-09-19 Meta Platforms Technologies, Llc Artificial reality application lifecycle
US11295503B1 (en) 2021-06-28 2022-04-05 Facebook Technologies, Llc Interactive avatars in artificial reality
US11521361B1 (en) 2021-07-01 2022-12-06 Meta Platforms Technologies, Llc Environment model with surfaces and per-surface volumes
US12008717B2 (en) 2021-07-07 2024-06-11 Meta Platforms Technologies, Llc Artificial reality environment control through an artificial reality environment schema
WO2023009580A2 (en) 2021-07-28 2023-02-02 Multinarity Ltd Using an extended reality appliance for productivity
CN113627312B (zh) * 2021-08-04 2025-01-10 东南大学 一种通过眼动追踪来协助瘫痪失语者语言输出的系统
US12056268B2 (en) 2021-08-17 2024-08-06 Meta Platforms Technologies, Llc Platformization of mixed reality objects in virtual reality environments
US12141500B2 (en) * 2021-08-18 2024-11-12 Target Brands, Inc. Virtual reality system for retail store design
US20240185856A1 (en) * 2021-09-03 2024-06-06 Apple Inc. Gaze based dictation
CN119960596A (zh) 2021-09-23 2025-05-09 苹果公司 用于内容应用的设备、方法和图形用户界面
US12299251B2 (en) 2021-09-25 2025-05-13 Apple Inc. Devices, methods, and graphical user interfaces for presenting virtual objects in virtual environments
US12190886B2 (en) * 2021-09-27 2025-01-07 International Business Machines Corporation Selective inclusion of speech content in documents
US11810242B2 (en) * 2021-10-12 2023-11-07 Htc Corporation Method for stabilizing raycast and electronic device using the same
US11798247B2 (en) 2021-10-27 2023-10-24 Meta Platforms Technologies, Llc Virtual object structures and interrelationships
US11748944B2 (en) 2021-10-27 2023-09-05 Meta Platforms Technologies, Llc Virtual object structures and interrelationships
TWI817437B (zh) * 2021-11-03 2023-10-01 宏達國際電子股份有限公司 虛擬影像顯示系統及其控制裝置的指向方向的控制方法
TW202324172A (zh) 2021-11-10 2023-06-16 美商元平台技術有限公司 自動建立人工實境世界
US12456271B1 (en) 2021-11-19 2025-10-28 Apple Inc. System and method of three-dimensional object cleanup and text annotation
US12238059B2 (en) 2021-12-01 2025-02-25 Meta Platforms Technologies, Llc Generating a summary of a conversation between users for an additional user in response to determining the additional user is joining the conversation
US11989343B2 (en) * 2022-01-05 2024-05-21 Nokia Technologies Oy Pose validity for XR based services
US12093447B2 (en) 2022-01-13 2024-09-17 Meta Platforms Technologies, Llc Ephemeral artificial reality experiences
US12020704B2 (en) 2022-01-19 2024-06-25 Google Llc Dynamic adaptation of parameter set used in hot word free adaptation of automated assistant
WO2023141535A1 (en) 2022-01-19 2023-07-27 Apple Inc. Methods for displaying and repositioning objects in an environment
US12175614B2 (en) 2022-01-25 2024-12-24 Sightful Computers Ltd Recording the complete physical and extended reality environments of a user
US11948263B1 (en) 2023-03-14 2024-04-02 Sightful Computers Ltd Recording the complete physical and extended reality environments of a user
US12380238B2 (en) 2022-01-25 2025-08-05 Sightful Computers Ltd Dual mode presentation of user interface elements
EP4392858B1 (en) * 2022-01-28 2025-10-29 Samsung Electronics Co., Ltd. Method and electronic device for enhanced interaction with voice assistant using user accessories data
IL290466B2 (en) * 2022-02-02 2024-12-01 Elbit Systems C4I & Cyber Ltd Geolocation system and method
US12067688B2 (en) 2022-02-14 2024-08-20 Meta Platforms Technologies, Llc Coordination of interactions of virtual objects
US20230260239A1 (en) * 2022-02-14 2023-08-17 Meta Platforms, Inc. Turning a Two-Dimensional Image into a Skybox
US12032736B2 (en) * 2022-02-23 2024-07-09 International Business Machines Corporation Gaze based text manipulation
US12272005B2 (en) 2022-02-28 2025-04-08 Apple Inc. System and method of three-dimensional immersive applications in multi-user communication sessions
JP2023127176A (ja) * 2022-03-01 2023-09-13 沖電気工業株式会社 指示者側装置、方法およびプログラム
US11579747B1 (en) * 2022-03-14 2023-02-14 Snap Inc. 3D user interface depth forgiveness
US12334060B2 (en) * 2022-03-22 2025-06-17 Orlin Todorov Intuitive dictation
US12093440B2 (en) * 2022-03-31 2024-09-17 Lenovo (Singapore) Pte. Ltd. Direction of user input to virtual objects based on command metadata
US12321666B2 (en) 2022-04-04 2025-06-03 Apple Inc. Methods for quick message response and dictation in a three-dimensional environment
US20230326144A1 (en) * 2022-04-08 2023-10-12 Meta Platforms Technologies, Llc Triggering Field Transitions for Artificial Reality Objects
US11610376B1 (en) 2022-04-08 2023-03-21 Meta Platforms Technologies, Llc Wrist-stabilized projection casting
US12164741B2 (en) 2022-04-11 2024-12-10 Meta Platforms Technologies, Llc Activating a snap point in an artificial reality environment
US11836205B2 (en) 2022-04-20 2023-12-05 Meta Platforms Technologies, Llc Artificial reality browser configured to trigger an immersive experience
US12360663B2 (en) 2022-04-26 2025-07-15 Snap Inc. Gesture-based keyboard text entry
US12026527B2 (en) * 2022-05-10 2024-07-02 Meta Platforms Technologies, Llc World-controlled and application-controlled augments in an artificial-reality environment
US12386428B2 (en) 2022-05-17 2025-08-12 Apple Inc. User interfaces for device controls
US12327302B2 (en) 2022-05-18 2025-06-10 Snap Inc. Hand-tracked text selection and modification
US12373096B2 (en) * 2022-05-31 2025-07-29 Snap Inc. AR-based virtual keyboard
US20230419617A1 (en) 2022-06-22 2023-12-28 Meta Platforms Technologies, Llc Virtual Personal Interface for Control and Travel Between Virtual Worlds
US12394167B1 (en) 2022-06-30 2025-08-19 Apple Inc. Window resizing and virtual object rearrangement in 3D environments
US12353673B2 (en) 2022-07-15 2025-07-08 Samsung Electronics Co., Ltd. Control-deck graphical user interface in XR
US20240036578A1 (en) * 2022-07-26 2024-02-01 Zebra Technologies Corporation Generation of Navigational Paths Using Recursive Partitioning of Unoccupied Space
CN115237255B (zh) * 2022-07-29 2023-10-31 天津大学 一种基于眼动和语音的自然图像共指目标定位系统及方法
CN115344121A (zh) * 2022-08-10 2022-11-15 北京字跳网络技术有限公司 用于处理手势事件的方法、装置、设备和存储介质
US12277301B2 (en) 2022-08-18 2025-04-15 Meta Platforms Technologies, Llc URL access to assets within an artificial reality universe on both 2D and artificial reality interfaces
US12175602B2 (en) 2022-08-19 2024-12-24 Meta Platforms Technologies, Llc Method of generating a virtual environment by scanning a real-world environment with a first device and displaying the virtual environment on a second device
CN119790456A (zh) * 2022-08-26 2025-04-08 三星电子株式会社 显示模块控制方法和用于实施显示模块控制方法的电子装置
US12097427B1 (en) 2022-08-26 2024-09-24 Meta Platforms Technologies, Llc Alternate avatar controls
US12112011B2 (en) 2022-09-16 2024-10-08 Apple Inc. System and method of application-based three-dimensional refinement in multi-user communication sessions
US12148078B2 (en) 2022-09-16 2024-11-19 Apple Inc. System and method of spatial groups in multi-user communication sessions
US12099653B2 (en) 2022-09-22 2024-09-24 Apple Inc. User interface response based on gaze-holding event assessment
US20240103611A1 (en) * 2022-09-22 2024-03-28 Apple Inc. Method and Device for Waking a Computing System
US12405704B1 (en) 2022-09-23 2025-09-02 Apple Inc. Interpreting user movement as direct touch user interface interactions
US12100111B2 (en) 2022-09-29 2024-09-24 Meta Platforms Technologies, Llc Mapping a real-world room for a shared artificial reality environment
US12175603B2 (en) 2022-09-29 2024-12-24 Meta Platforms Technologies, Llc Doors for artificial reality universe traversal
EP4595015A1 (en) 2022-09-30 2025-08-06 Sightful Computers Ltd Adaptive extended reality content presentation in multiple physical environments
US12218944B1 (en) 2022-10-10 2025-02-04 Meta Platform Technologies, LLC Group travel between artificial reality destinations
US20250123799A1 (en) * 2022-10-20 2025-04-17 Meta Platforms, Inc. Voice-Enabled Virtual Object Disambiguation and Controls in Artificial Reality
US12444152B1 (en) 2022-10-21 2025-10-14 Meta Platforms Technologies, Llc Application multitasking in a three-dimensional environment
US12242672B1 (en) 2022-10-21 2025-03-04 Meta Platforms Technologies, Llc Triggering actions based on detected motions on an artificial reality device
US12074722B2 (en) * 2022-11-14 2024-08-27 Zoom Video Communications, Inc. Sign language control for a virtual meeting
US12276795B2 (en) * 2022-11-17 2025-04-15 Htc Corporation Head-mounted display device, tracking system, and tracking method
US12411918B2 (en) * 2022-11-22 2025-09-09 Bank Of America Corporation Performing secure data interactions in a virtual environment
US12406666B2 (en) * 2022-12-05 2025-09-02 Google Llc Facilitating virtual or physical assistant interactions with virtual objects in a virtual environment
CN116126417A (zh) * 2022-12-20 2023-05-16 深圳市声扬科技有限公司 虚拟对象启动交互方法、装置、电子设备及存储介质
US12361661B1 (en) 2022-12-21 2025-07-15 Meta Platforms Technologies, Llc Artificial reality (XR) location-based displays and interactions
US11947862B1 (en) 2022-12-30 2024-04-02 Meta Platforms Technologies, Llc Streaming native application content to artificial reality devices
KR20240115392A (ko) * 2023-01-18 2024-07-26 한국전자통신연구원 Ar 글래스용 핸드 인터랙션 기반 텍스트 인식 방법 및 장치
US11880936B1 (en) 2023-01-26 2024-01-23 Intuit Inc. Generating and displaying text in a virtual reality environment
US12387449B1 (en) 2023-02-08 2025-08-12 Meta Platforms Technologies, Llc Facilitating system user interface (UI) interactions in an artificial reality (XR) environment
US12400414B2 (en) 2023-02-08 2025-08-26 Meta Platforms Technologies, Llc Facilitating system user interface (UI) interactions in an artificial reality (XR) environment
US12108012B2 (en) 2023-02-27 2024-10-01 Apple Inc. System and method of managing spatial states and display modes in multi-user communication sessions
CN116300092B (zh) * 2023-03-09 2024-05-14 北京百度网讯科技有限公司 智能眼镜的控制方法、装置、设备以及存储介质
JPWO2024190127A1 (enExample) * 2023-03-10 2024-09-19
JP2024135766A (ja) * 2023-03-23 2024-10-04 株式会社栗本鐵工所 触覚提示システム
CN118827847B (zh) * 2023-04-20 2025-09-16 荣耀终端股份有限公司 显示方法和相关装置
US11991222B1 (en) 2023-05-02 2024-05-21 Meta Platforms Technologies, Llc Persistent call control user interface element in an artificial reality environment
US20240385691A1 (en) * 2023-05-05 2024-11-21 Apple Inc. User interfaces for gesture detection
CN116301388B (zh) * 2023-05-11 2023-08-01 环球数科集团有限公司 一种智能多模态组合应用的人机交互场景系统
US12118200B1 (en) 2023-06-02 2024-10-15 Apple Inc. Fuzzy hit testing
US12443286B2 (en) 2023-06-02 2025-10-14 Apple Inc. Input recognition based on distinguishing direct and indirect user interactions
US12229344B2 (en) * 2023-06-02 2025-02-18 Apple Inc. Pinch recognition using finger zones
US12113948B1 (en) 2023-06-04 2024-10-08 Apple Inc. Systems and methods of managing spatial groups in multi-user communication sessions
CN119088205A (zh) * 2023-06-06 2024-12-06 北京视延科技有限公司 光场显示方法及系统、存储介质
WO2025009226A1 (ja) * 2023-07-03 2025-01-09 株式会社ソニー・インタラクティブエンタテインメント 情報処理装置および情報処理方法
WO2025018538A1 (ko) * 2023-07-18 2025-01-23 삼성전자주식회사 객체에 기초한 피드백을 출력하는 장치, 그 동작 방법, 및 기록 매체
WO2024031109A2 (en) * 2023-07-19 2024-02-08 Futurewei Technologies, Inc. Audio-visual information system for smart eyewear
US11995414B1 (en) 2023-08-28 2024-05-28 Sdl Inc. Automatic post-editing systems and methods
US12386418B2 (en) * 2023-09-08 2025-08-12 Huawei Technologies Co., Ltd. Gaze assisted input for an electronic device
EP4544442A1 (en) * 2023-09-11 2025-04-30 Ningbo Xiaofu Technology Co., Ltd. Computer-assisted interactions for photovoltaic wiring system design and installation
JP2025062768A (ja) 2023-10-03 2025-04-15 キヤノン株式会社 情報処理装置、情報処理方法、及びプログラム
CN117348737A (zh) * 2023-12-06 2024-01-05 之江实验室 一种基于多通道交互的数据处理系统及方法
EP4610790A1 (en) * 2024-01-17 2025-09-03 Samsung Electronics Co., Ltd Wearable electronic device for displaying extended reality image, operation method thereof, and recording medium
GB2640721A (en) * 2024-05-03 2025-11-05 Nokia Technologies Oy Virtual space modification
CN119003816B (zh) * 2024-10-24 2025-01-24 青岛歌尔视界科技有限公司 日记生成方法、装置、设备及存储介质

Family Cites Families (83)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH04372012A (ja) * 1991-06-20 1992-12-25 Fuji Xerox Co Ltd 入力装置
US6222525B1 (en) 1992-03-05 2001-04-24 Brad A. Armstrong Image controllers with sheet connected sensors
JP3461980B2 (ja) 1995-08-25 2003-10-27 株式会社東芝 高速描画方法および装置
US5670988A (en) 1995-09-05 1997-09-23 Interlink Electronics, Inc. Trigger operated electronic device
JP3822357B2 (ja) * 1998-02-09 2006-09-20 株式会社東芝 マルチモーダル入出力装置のインタフェース装置及びその方法
US7257575B1 (en) * 2002-10-24 2007-08-14 At&T Corp. Systems and methods for generating markup-language based expressions from multi-modal and unimodal inputs
JP2005222103A (ja) * 2004-02-03 2005-08-18 Dainippon Printing Co Ltd 音声視線複合入力システム
USD514570S1 (en) 2004-06-24 2006-02-07 Microsoft Corporation Region of a fingerprint scanning device with an illuminated ring
US7561717B2 (en) 2004-07-09 2009-07-14 United Parcel Service Of America, Inc. System and method for displaying item information
US11428937B2 (en) 2005-10-07 2022-08-30 Percept Technologies Enhanced optical and perceptual digital eyewear
US8696113B2 (en) 2005-10-07 2014-04-15 Percept Technologies Inc. Enhanced optical and perceptual digital eyewear
US20070081123A1 (en) 2005-10-07 2007-04-12 Lewis Scott W Digital eyewear
JP5145569B2 (ja) 2007-12-19 2013-02-20 株式会社国際電気通信基礎技術研究所 対象物特定方法および装置
KR101477530B1 (ko) * 2010-03-12 2014-12-30 뉘앙스 커뮤니케이션즈, 인코포레이티드 이동 전화의 터치 스크린과 함께 사용하기 위한 다중 모드 문자 입력 시스템
US8645136B2 (en) * 2010-07-20 2014-02-04 Intellisist, Inc. System and method for efficiently reducing transcription error using hybrid voice transcription
US9292973B2 (en) * 2010-11-08 2016-03-22 Microsoft Technology Licensing, Llc Automatic variable virtual focus for augmented reality displays
US9304319B2 (en) 2010-11-18 2016-04-05 Microsoft Technology Licensing, Llc Automatic focus improvement for augmented reality displays
JP5472056B2 (ja) 2010-11-19 2014-04-16 コニカミノルタ株式会社 表示システム、表示処理装置、表示方法、および表示プログラム
US10156722B2 (en) 2010-12-24 2018-12-18 Magic Leap, Inc. Methods and systems for displaying stereoscopy with a freeform optical system with addressable focus for virtual and augmented reality
JP6185844B2 (ja) 2010-12-24 2017-08-30 マジック リープ， インコーポレイテッド 人間工学的ヘッドマウントディスプレイデバイスおよび光学システム
KR101591493B1 (ko) 2011-03-29 2016-02-03 퀄컴 인코포레이티드 각각의 사용자의 시점에 대해 공유된 디지털 인터페이스들의 렌더링을 위한 시스템
CA3035118C (en) 2011-05-06 2022-01-04 Magic Leap, Inc. Massive simultaneous remote digital presence world
USD658094S1 (en) 2011-06-18 2012-04-24 Dunn Scott E Rounded square display device for a cord
US9417754B2 (en) 2011-08-05 2016-08-16 P4tents1, LLC User interface system, method, and computer program product
JP5762892B2 (ja) 2011-09-06 2015-08-12 ビッグローブ株式会社 情報表示システム、情報表示方法、及び情報表示用プログラム
US10795448B2 (en) 2011-09-29 2020-10-06 Magic Leap, Inc. Tactile glove for human-computer interaction
US20130104085A1 (en) 2011-10-21 2013-04-25 Digital Artforms, Inc. Systems and methods for human-computer interaction using a two handed interface
RU2017115669A (ru) 2011-10-28 2019-01-28 Мэджик Лип, Инк. Система и способ для дополненной и виртуальной реальности
WO2013077895A1 (en) 2011-11-23 2013-05-30 Magic Leap, Inc. Three dimensional virtual and augmented reality display system
CA2869781C (en) 2012-04-05 2021-04-27 Magic Leap, Inc Wide-field of view (fov) imaging devices with active foveation capability
WO2013188464A1 (en) 2012-06-11 2013-12-19 Magic Leap, Inc. Multiple depth plane three-dimensional display using a wave guide reflector array projector
US9671566B2 (en) 2012-06-11 2017-06-06 Magic Leap, Inc. Planar waveguide apparatus with diffraction element(s) and system employing same
US20130328925A1 (en) * 2012-06-12 2013-12-12 Stephen G. Latta Object focus in a mixed reality environment
US8754829B2 (en) 2012-08-04 2014-06-17 Paul Lapstun Scanning light field camera and display
KR20150054967A (ko) 2012-09-11 2015-05-20 매직 립, 인코포레이티드 인체공학적 헤드 마운티드 디스플레이 디바이스 및 광학 시스템
JP2014085954A (ja) 2012-10-25 2014-05-12 Kyocera Corp 携帯端末装置、プログラムおよび入力操作受け付け方法
US9092600B2 (en) * 2012-11-05 2015-07-28 Microsoft Technology Licensing, Llc User authentication on augmented reality display device
CA2898283C (en) 2013-01-15 2021-05-11 Magic Leap, Inc. Ultra-high resolution scanning fiber display
EP2967322A4 (en) 2013-03-11 2017-02-08 Magic Leap, Inc. System and method for augmented and virtual reality
NZ735754A (en) 2013-03-15 2019-04-26 Magic Leap Inc Display system and method
JP5900393B2 (ja) 2013-03-21 2016-04-06 ソニー株式会社 情報処理装置、操作制御方法及びプログラム
US9367960B2 (en) * 2013-05-22 2016-06-14 Microsoft Technology Licensing, Llc Body-locked placement of augmented reality objects
US10262462B2 (en) 2014-04-18 2019-04-16 Magic Leap, Inc. Systems and methods for augmented and virtual reality
US9874749B2 (en) 2013-11-27 2018-01-23 Magic Leap, Inc. Virtual and augmented reality systems and methods
KR101566013B1 (ko) * 2013-06-19 2015-11-05 주식회사 이드웨어 전자책 낭독을 통한 발화 정확도 및 표현력 향상을 제공하는 방법 및 시스템
US9129430B2 (en) 2013-06-25 2015-09-08 Microsoft Technology Licensing, Llc Indicating out-of-view augmented reality images
KR20150037254A (ko) 2013-09-30 2015-04-08 엘지전자 주식회사 착용형 디스플레이 디바이스 및 레이어 제어 방법
CA3134562A1 (en) 2013-10-16 2015-04-23 Magic Leap, Inc. Virtual or augmented reality headsets having adjustable interpupillary distance
CN105518657B (zh) 2013-10-24 2019-09-24 索尼公司 信息处理设备、信息处理方法及计算机可读记录介质
US9857591B2 (en) 2014-05-30 2018-01-02 Magic Leap, Inc. Methods and system for creating focal planes in virtual and augmented reality
CN107329260B (zh) 2013-11-27 2021-07-16 奇跃公司 虚拟和增强现实系统与方法
JP2015114757A (ja) 2013-12-10 2015-06-22 ソニー株式会社 情報処理装置、情報処理方法及びプログラム
NZ722903A (en) 2014-01-31 2020-05-29 Magic Leap Inc Multi-focal display system and method
EP3712680B1 (en) 2014-01-31 2022-07-13 Magic Leap, Inc. Multi-focal display system and method
JP2015145934A (ja) 2014-02-03 2015-08-13 セイコーエプソン株式会社 プロジェクター
US20150234501A1 (en) 2014-02-18 2015-08-20 Merge Labs, Inc. Interpupillary distance capture using capacitive touch
US10203762B2 (en) * 2014-03-11 2019-02-12 Magic Leap, Inc. Methods and systems for creating virtual and augmented reality
KR20150110257A (ko) * 2014-03-21 2015-10-02 삼성전자주식회사 웨어러블 디바이스에서 가상의 입력 인터페이스를 제공하는 방법 및 이를 위한 웨어러블 디바이스
US10620700B2 (en) 2014-05-09 2020-04-14 Google Llc Systems and methods for biomechanically-based eye signals for interacting with real and virtual objects
USD759657S1 (en) 2014-05-19 2016-06-21 Microsoft Corporation Connector with illumination region
KR102219464B1 (ko) * 2014-05-23 2021-02-25 삼성전자주식회사 보안 운용 방법 및 이를 지원하는 전자 장치
JP6577962B2 (ja) 2014-05-30 2019-09-18 マジック リープ， インコーポレイテッドＭａｇｉｃ Ｌｅａｐ，Ｉｎｃ． 仮想または拡張現実装置を用いて仮想コンテンツ表示を生成する方法およびシステム
WO2015188011A1 (en) * 2014-06-04 2015-12-10 Quantum Interface, Llc. Dynamic environment for object and attribute display and interaction
USD752529S1 (en) 2014-06-09 2016-03-29 Comcast Cable Communications, Llc Electronic housing with illuminated region
USD758367S1 (en) 2015-05-14 2016-06-07 Magic Leap, Inc. Virtual reality headset
CN107683497B (zh) 2015-06-15 2022-04-08 索尼公司 信息处理设备、信息处理方法及程序
EP3118722B1 (en) * 2015-07-14 2020-07-01 Nokia Technologies Oy Mediated reality
US10101803B2 (en) * 2015-08-26 2018-10-16 Google Llc Dynamic switching and merging of head, gesture and touch input in virtual reality
CA2997789C (en) 2015-09-16 2022-10-04 Magic Leap, Inc. Head pose mixing of audio files
EP3862852A1 (en) 2015-10-20 2021-08-11 Magic Leap, Inc. Selecting virtual objects in a three-dimensional space
WO2017096509A1 (zh) * 2015-12-07 2017-06-15 华为技术有限公司 一种显示、处理的方法及相关装置
CN106997235B (zh) * 2016-01-25 2018-07-13 亮风台（上海）信息科技有限公司 用于实现增强现实交互和展示的方法、设备
US10229541B2 (en) 2016-01-28 2019-03-12 Sony Interactive Entertainment America Llc Methods and systems for navigation within virtual reality space using head mounted display
USD805734S1 (en) 2016-03-04 2017-12-26 Nike, Inc. Shirt
USD794288S1 (en) 2016-03-11 2017-08-15 Nike, Inc. Shoe with illuminable sole light sequence
US10078919B2 (en) 2016-03-31 2018-09-18 Magic Leap, Inc. Interactions with 3D virtual objects using poses and multiple-DOF controllers
US10068134B2 (en) * 2016-05-03 2018-09-04 Microsoft Technology Licensing, Llc Identification of objects in a scene using gaze tracking techniques
CN109804334B (zh) 2016-08-11 2022-07-15 奇跃公司 用于三维空间中虚拟对象的自动放置的系统和方法
US20180095618A1 (en) * 2016-10-04 2018-04-05 Facebook, Inc. Controls and Interfaces for User Interactions in Virtual Spaces
CN108664201B (zh) * 2017-03-29 2021-12-28 北京搜狗科技发展有限公司 一种文本编辑方法、装置及电子设备
CN110785688B (zh) 2017-04-19 2021-08-27 奇跃公司 可穿戴系统的多模式任务执行和文本编辑
US10573171B2 (en) * 2017-05-23 2020-02-25 Lenovo (Singapore) Pte. Ltd. Method of associating user input with a device
WO2019067895A1 (en) 2017-09-29 2019-04-04 Apple Inc. ACCESSING EXTERNAL DEVICE FUNCTIONS USING REALITY INTERFACES

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11848000B2 (en) * 2019-09-06 2023-12-19 Microsoft Technology Licensing, Llc Transcription revision interface for speech recognition system
US20230306350A1 (en) * 2022-03-22 2023-09-28 Saudi Arabian Oil Company Method and system for verifying performance-based assessments during virtual reality sessions
US12254434B2 (en) 2022-03-22 2025-03-18 Saudi Arabian Oil Company Method and system for managing automated performance-based assessments using virtual reality
US12293011B2 (en) 2022-03-22 2025-05-06 Saudi Arabian Oil Company Method and system for managing virtual reality user assessment recordings

Also Published As

Publication number Publication date
IL270002B1 (en) 2023-07-01
JP2020519986A (ja) 2020-07-02
US20220171453A1 (en) 2022-06-02
CN110785688A (zh) 2020-02-11
JP7655992B2 (ja) 2025-04-02
KR20240046613A (ko) 2024-04-09
KR102652922B1 (ko) 2024-03-29
IL270002B2 (en) 2023-11-01
JP2023144096A (ja) 2023-10-06
EP3612878B1 (en) 2023-06-28
IL270002A (enExample) 2019-12-31
KR102857458B1 (ko) 2025-09-09
US11237623B2 (en) 2022-02-01
WO2018195099A1 (en) 2018-10-25
US20180307303A1 (en) 2018-10-25
US20200363865A1 (en) 2020-11-19
US10768693B2 (en) 2020-09-08
KR20190141696A (ko) 2019-12-24
CN113608617A (zh) 2021-11-05
US11960636B2 (en) 2024-04-16
JP7149289B2 (ja) 2022-10-06
EP4220258A1 (en) 2023-08-02
US20240211028A1 (en) 2024-06-27
JP2025015654A (ja) 2025-01-30
EP3612878A1 (en) 2020-02-26
AU2018256365A1 (en) 2019-10-31
CN110785688B (zh) 2021-08-27
JP2022121592A (ja) 2022-08-19
EP3612878A4 (en) 2020-09-23
JP7336005B2 (ja) 2023-08-30

Similar Documents

Publication Publication Date Title
US11960636B2 (en) Multimodal task execution and text editing for a wearable system
US12444146B2 (en) Identifying convergence of sensor data from first and second sensors within an augmented reality wearable device
US12452390B2 (en) Word flow annotation
US11808944B2 (en) Automatic placement of a virtual object in a three-dimensional space