AU2019215346A1 - Eclipse cursor for virtual content in mixed reality displays - Google Patents

Eclipse cursor for virtual content in mixed reality displays Download PDF

Info

Publication number
AU2019215346A1
AU2019215346A1 AU2019215346A AU2019215346A AU2019215346A1 AU 2019215346 A1 AU2019215346 A1 AU 2019215346A1 AU 2019215346 A AU2019215346 A AU 2019215346A AU 2019215346 A AU2019215346 A AU 2019215346A AU 2019215346 A1 AU2019215346 A1 AU 2019215346A1
Authority
AU
Australia
Prior art keywords
cursor
virtual
user
display
focus indicator
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Abandoned
Application number
AU2019215346A
Other languages
English (en)
Inventor
Richard St. Claire BAILEY
John Austin Day
Paul Armistead Hoover
Savannah NILES
Lorena PAZMINO
James Cameron Petty
James M. Powderly
Chris Sorrell
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Magic Leap Inc
Original Assignee
Magic Leap Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from US15/884,117 external-priority patent/US10540941B2/en
Application filed by Magic Leap Inc filed Critical Magic Leap Inc
Publication of AU2019215346A1 publication Critical patent/AU2019215346A1/en
Abandoned legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G06F3/04812—Interaction techniques based on cursor appearance or behaviour, e.g. being affected by the presence of displayed objects
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/012—Head tracking input arrangements
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G06F3/04815—Interaction with a metaphor-based environment or interaction object displayed as three-dimensional [3D], e.g. changing the user viewpoint with respect to the environment or object
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G06F3/04817—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance using icons
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G06F3/0485—Scrolling or panning
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G5/00—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
    • G09G5/08—Cursor circuits
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G5/00—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
    • G09G5/14—Display of multiple viewports
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
    • G06F2203/048—Indexing scheme relating to G06F3/048
    • G06F2203/04804—Transparency, e.g. transparent or translucent windows
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2340/00—Aspects of display data processing
    • G09G2340/12—Overlay of images, i.e. displayed pixel being the result of switching between the corresponding input pixels
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2354/00—Aspects of interface with display user

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Computer Hardware Design (AREA)
  • User Interface Of Digital Computer (AREA)
  • Processing Or Creating Images (AREA)
  • Controls And Circuits For Display Device (AREA)
  • Position Input By Displaying (AREA)
  • Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)
  • Digital Computer Display Output (AREA)
  • Eye Examination Apparatus (AREA)
AU2019215346A 2018-01-30 2019-01-25 Eclipse cursor for virtual content in mixed reality displays Abandoned AU2019215346A1 (en)

Applications Claiming Priority (5)

Application Number Priority Date Filing Date Title
US15/884,117 US10540941B2 (en) 2018-01-30 2018-01-30 Eclipse cursor for mixed reality displays
US15/884,117 2018-01-30
US15/920,830 US11567627B2 (en) 2018-01-30 2018-03-14 Eclipse cursor for virtual content in mixed reality displays
US15/920,830 2018-03-14
PCT/US2019/015274 WO2019152286A2 (en) 2018-01-30 2019-01-25 Eclipse cursor for virtual content in mixed reality displays

Publications (1)

Publication Number Publication Date
AU2019215346A1 true AU2019215346A1 (en) 2020-07-23

Family

ID=67393385

Family Applications (1)

Application Number Title Priority Date Filing Date
AU2019215346A Abandoned AU2019215346A1 (en) 2018-01-30 2019-01-25 Eclipse cursor for virtual content in mixed reality displays

Country Status (9)

Country Link
US (3) US11567627B2 (https=)
EP (2) EP3746870B1 (https=)
JP (4) JP7123148B2 (https=)
KR (1) KR102810829B1 (https=)
CN (1) CN111819522A (https=)
AU (1) AU2019215346A1 (https=)
CA (1) CA3087775A1 (https=)
IL (3) IL305114B2 (https=)
WO (1) WO2019152286A2 (https=)

Families Citing this family (100)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
USD762693S1 (en) * 2014-09-03 2016-08-02 Apple Inc. Display screen or portion thereof with graphical user interface
US12261990B2 (en) 2015-07-15 2025-03-25 Fyusion, Inc. System and method for generating combined embedded multi-view interactive digital media representations
US10242474B2 (en) 2015-07-15 2019-03-26 Fyusion, Inc. Artificially rendering images using viewpoint interpolation and extrapolation
US10222932B2 (en) 2015-07-15 2019-03-05 Fyusion, Inc. Virtual reality environment based manipulation of multilayered multi-view interactive digital media representations
US11095869B2 (en) 2015-09-22 2021-08-17 Fyusion, Inc. System and method for generating combined embedded multi-view interactive digital media representations
US12495134B2 (en) 2015-07-15 2025-12-09 Fyusion, Inc. Drone based capture of multi-view interactive digital media
US10147211B2 (en) 2015-07-15 2018-12-04 Fyusion, Inc. Artificially rendering images using viewpoint interpolation and extrapolation
US11006095B2 (en) 2015-07-15 2021-05-11 Fyusion, Inc. Drone based capture of a multi-view interactive digital media
US11783864B2 (en) 2015-09-22 2023-10-10 Fyusion, Inc. Integration of audio into a multi-view interactive digital media representation
US10437879B2 (en) 2017-01-18 2019-10-08 Fyusion, Inc. Visual search using multi-view interactive digital media representations
US20180227482A1 (en) 2017-02-07 2018-08-09 Fyusion, Inc. Scene-aware selection of filters and effects for visual digital media content
US10313651B2 (en) 2017-05-22 2019-06-04 Fyusion, Inc. Snapshots at predefined intervals or angles
US11069147B2 (en) 2017-06-26 2021-07-20 Fyusion, Inc. Modification of multi-view interactive digital media representation
USD847841S1 (en) * 2017-11-01 2019-05-07 Apple Inc. Display screen or portion thereof with graphical user interface
USD865778S1 (en) * 2018-01-08 2019-11-05 Samsung Electronics Co., Ltd. Display screen or portion thereof with graphical user interface
US11567627B2 (en) 2018-01-30 2023-01-31 Magic Leap, Inc. Eclipse cursor for virtual content in mixed reality displays
US10540941B2 (en) 2018-01-30 2020-01-21 Magic Leap, Inc. Eclipse cursor for mixed reality displays
USD877160S1 (en) * 2018-01-30 2020-03-03 Magic Leap, Inc. Display panel or portion thereof with a transitional mixed reality graphical user interface
BR112020015835A2 (pt) 2018-04-11 2020-12-15 Dolby International Ab Métodos, aparelho e sistemas para renderização de áudio 6dof e representações de dados e estruturas de fluxo de bits para renderização de áudio 6dof
US10592747B2 (en) 2018-04-26 2020-03-17 Fyusion, Inc. Method and apparatus for 3-D auto tagging
US10916065B2 (en) * 2018-05-04 2021-02-09 Facebook Technologies, Llc Prevention of user interface occlusion in a virtual reality environment
US11301050B2 (en) * 2018-06-03 2022-04-12 Apple Inc. Method and device for presenting a synthesized reality user interface
US11157159B2 (en) 2018-06-07 2021-10-26 Magic Leap, Inc. Augmented reality scrollbar
EP3830751A4 (en) * 2018-07-30 2022-05-04 Optimum Semiconductor Technologies, Inc. Object detection using multiple neural networks trained for different image fields
GB2576213A (en) * 2018-08-10 2020-02-12 Sony Corp A method for mapping an object to a location in virtual space
USD904422S1 (en) * 2018-08-28 2020-12-08 Intuit, Inc. Display screen or portion thereof with transitional graphical user interface
US12133682B2 (en) * 2018-09-04 2024-11-05 M2S Co., Ltd Method and system for virtual reality-based visual field inspection
US11004270B2 (en) * 2018-09-11 2021-05-11 Houzz, Inc. Virtual item placement system
US10958887B2 (en) * 2019-01-14 2021-03-23 Fyusion, Inc. Free-viewpoint photorealistic view synthesis from casually captured video
US11644940B1 (en) * 2019-01-31 2023-05-09 Splunk Inc. Data visualization in an extended reality environment
US11009698B2 (en) * 2019-03-13 2021-05-18 Nick Cherukuri Gaze-based user interface for augmented and mixed reality device
USD914722S1 (en) * 2019-04-25 2021-03-30 Samsung Electronics Co., Ltd. Display screen or portion thereof with graphical user interface
USD962981S1 (en) 2019-05-29 2022-09-06 Magic Leap, Inc. Display screen or portion thereof with animated scrollbar graphical user interface
US11307647B2 (en) 2019-09-11 2022-04-19 Facebook Technologies, Llc Artificial reality triggered by physical object
US12175010B2 (en) * 2019-09-28 2024-12-24 Apple Inc. Devices, methods, and graphical user interfaces for interacting with three-dimensional environments
JP2021068000A (ja) * 2019-10-18 2021-04-30 株式会社東海理化電機製作所 制御装置、プログラム、及びシステム
US11488365B2 (en) 2019-10-25 2022-11-01 Magic Leap, Inc. Non-uniform stereo rendering
US11308698B2 (en) * 2019-12-05 2022-04-19 Facebook Technologies, Llc. Using deep learning to determine gaze
US11687778B2 (en) 2020-01-06 2023-06-27 The Research Foundation For The State University Of New York Fakecatcher: detection of synthetic portrait videos using biological signals
USD956064S1 (en) * 2020-03-31 2022-06-28 Google Llc Display screen with animated graphical user interface
USD956065S1 (en) * 2020-03-31 2022-06-28 Google Llc Display screen with animated graphical user interface
GB202009874D0 (en) * 2020-06-29 2020-08-12 Microsoft Technology Licensing Llc Visual interface for a computer system
GB202009876D0 (en) * 2020-06-29 2020-08-12 Microsoft Technology Licensing Llc Visual interface for a computer system
US11954268B2 (en) * 2020-06-30 2024-04-09 Snap Inc. Augmented reality eyewear 3D painting
US11176755B1 (en) 2020-08-31 2021-11-16 Facebook Technologies, Llc Artificial reality augments and surfaces
US11227445B1 (en) 2020-08-31 2022-01-18 Facebook Technologies, Llc Artificial reality augments and surfaces
WO2022060586A1 (en) * 2020-09-16 2022-03-24 Sterling Labs Llc Changing a dimensional representation of a content item
KR20230050466A (ko) * 2020-09-25 2023-04-14 애플 인크. 사용자 인터페이스들을 내비게이팅하기 위한 방법들
WO2022067342A2 (en) 2020-09-25 2022-03-31 Apple Inc. Methods for interacting with virtual controls and/or an affordance for moving virtual objects in virtual environments
CN114327028A (zh) * 2020-09-30 2022-04-12 伊姆西Ip控股有限责任公司 管理虚拟视觉内容的方法、设备和计算机程序产品
US11113893B1 (en) * 2020-11-17 2021-09-07 Facebook Technologies, Llc Artificial reality environment with glints displayed by an extra reality device
US11409405B1 (en) 2020-12-22 2022-08-09 Facebook Technologies, Llc Augment orchestration in an artificial reality environment
WO2022155113A1 (en) * 2021-01-14 2022-07-21 Sterling Labs Llc Method and device for visualizing multi-modal inputs
USD1036475S1 (en) 2021-02-01 2024-07-23 Huawei Technologies Co., Ltd. Display screen or portion thereof with graphical user interface
US11995230B2 (en) 2021-02-11 2024-05-28 Apple Inc. Methods for presenting and sharing content in an environment
USD1035674S1 (en) * 2021-05-11 2024-07-16 Spotify Ab Display screen with graphical user interface
US11676348B2 (en) 2021-06-02 2023-06-13 Meta Platforms Technologies, Llc Dynamic mixed reality content in virtual reality
US11762952B2 (en) 2021-06-28 2023-09-19 Meta Platforms Technologies, Llc Artificial reality application lifecycle
US11521361B1 (en) 2021-07-01 2022-12-06 Meta Platforms Technologies, Llc Environment model with surfaces and per-surface volumes
US12056268B2 (en) 2021-08-17 2024-08-06 Meta Platforms Technologies, Llc Platformization of mixed reality objects in virtual reality environments
JP2024537657A (ja) * 2021-09-24 2024-10-16 アップル インコーポレイテッド メディア及び三次元環境と相互作用するためのデバイス、方法、及びグラフィカルユーザインタフェース
US12236540B2 (en) 2021-09-24 2025-02-25 Apple Inc. Devices, methods, and graphical user interfaces for interacting with three-dimensional environments
USD1042490S1 (en) * 2021-10-22 2024-09-17 Beijing Zitiao Network Technology Co., Ltd. Display screen or portion thereof with a graphical user interface
US11748944B2 (en) 2021-10-27 2023-09-05 Meta Platforms Technologies, Llc Virtual object structures and interrelationships
US11798247B2 (en) 2021-10-27 2023-10-24 Meta Platforms Technologies, Llc Virtual object structures and interrelationships
TW202324172A (zh) 2021-11-10 2023-06-16 美商元平台技術有限公司 自動建立人工實境世界
US12456271B1 (en) 2021-11-19 2025-10-28 Apple Inc. System and method of three-dimensional object cleanup and text annotation
USD1056924S1 (en) * 2021-12-22 2025-01-07 Mcmaster-Carr Supply Company Display screen or portion thereof with animated graphical user interface
EP4463754A1 (en) 2022-01-12 2024-11-20 Apple Inc. Methods for displaying, selecting and moving objects and containers in an environment
US12093447B2 (en) 2022-01-13 2024-09-17 Meta Platforms Technologies, Llc Ephemeral artificial reality experiences
JP7843357B2 (ja) 2022-01-19 2026-04-09 アップル インコーポレイテッド 環境内にオブジェクトを表示及び再位置決めするための方法
US20230260239A1 (en) * 2022-02-14 2023-08-17 Meta Platforms, Inc. Turning a Two-Dimensional Image into a Skybox
US12541280B2 (en) 2022-02-28 2026-02-03 Apple Inc. System and method of three-dimensional placement and refinement in multi-user communication sessions
KR102464232B1 (ko) * 2022-03-22 2022-11-09 주식회사 위피엠 온라인 기반의 가상 전시회를 제공하는 가상현실 콘텐츠 관리시스템의 전시회 설계 및 관리 방법
CN119404170A (zh) 2022-04-20 2025-02-07 苹果公司 三维环境中的被遮蔽对象
US12026527B2 (en) 2022-05-10 2024-07-02 Meta Platforms Technologies, Llc World-controlled and application-controlled augments in an artificial-reality environment
US20230377301A1 (en) * 2022-05-20 2023-11-23 Michael W. Olia System and method for providing information in extended reality environment
CN117170491A (zh) * 2022-05-25 2023-12-05 北京字跳网络技术有限公司 在虚拟现实场景中确定虚拟光标方法、装置、设备和介质
WO2024025126A1 (ko) * 2022-07-26 2024-02-01 삼성전자 주식회사 웨어러블 전자 장치 및 그 동작 방법
US12112011B2 (en) 2022-09-16 2024-10-08 Apple Inc. System and method of application-based three-dimensional refinement in multi-user communication sessions
US12461640B2 (en) * 2022-09-21 2025-11-04 Apple Inc. Devices, methods, and graphical user interfaces for displaying shadow and light effects in three-dimensional environments
US20240103704A1 (en) 2022-09-24 2024-03-28 Apple Inc. Methods for interacting with user interfaces based on attention
WO2024064950A1 (en) 2022-09-24 2024-03-28 Apple Inc. Methods for time of day adjustments for environments and environment presentation during communication sessions
US20240233288A1 (en) 2022-09-24 2024-07-11 Apple Inc. Methods for controlling and interacting with a three-dimensional environment
US11768581B1 (en) * 2022-12-13 2023-09-26 Illuscio, Inc. Systems and methods for multi-modality interactions in a spatial computing environment
CN118244934A (zh) * 2022-12-23 2024-06-25 北京小米移动软件有限公司 信息交互方法及装置、电子设备、存储介质
CN120092281A (zh) * 2022-12-23 2025-06-03 三星电子株式会社 显示设备及其控制方法
CN120813918A (zh) 2023-01-30 2025-10-17 苹果公司 用于响应于注视和/或手势输入来显示多组控件的设备、方法和图形用户界面
WO2024172607A1 (ko) * 2023-02-17 2024-08-22 삼성전자 주식회사 아이콘을 표시하기 위한 전자 장치, 그 동작 방법과, 비 일시적 컴퓨터 판독 가능 저장 매체
US12548245B2 (en) 2023-03-31 2026-02-10 Meta Platforms Technologies, Llc Rendering an artificial reality environment based on a defined hierarchy of multiple states including multiple artificial reality experiences with augments
KR20240151533A (ko) * 2023-04-11 2024-10-18 현대모비스 주식회사 시선 인식을 이용한 마우스 제어 장치 및 방법
JP2024166505A (ja) * 2023-05-19 2024-11-29 シャープ株式会社 ユーザインターフェース提供装置、ユーザインターフェース提供方法及びユーザインターフェース提供プログラム
WO2024254096A1 (en) 2023-06-04 2024-12-12 Apple Inc. Methods for managing overlapping windows and applying visual effects
WO2025023480A1 (ko) * 2023-07-25 2025-01-30 삼성전자주식회사 가상 공간의 전환에 기반하여 화면을 변경하기 위한 전자 장치, 방법, 및 컴퓨터 판독 가능 저장 매체
USD1117233S1 (en) * 2023-10-11 2026-03-10 SimpliSafe, Inc. Display screen or portion thereof with a transitional graphical user interface
USD1119929S1 (en) 2023-10-11 2026-03-24 SimpliSafe, Inc. Display screen or portion thereof with a graphical user interface
TWI876742B (zh) * 2023-12-07 2025-03-11 技嘉科技股份有限公司 亮度控制裝置、電子裝置及亮度控制方法
CN117891352B (zh) * 2024-03-14 2024-05-31 南京市文化投资控股集团有限责任公司 一种基于元宇宙的文旅内容推荐系统及方法
JP2025141153A (ja) * 2024-03-15 2025-09-29 キヤノン株式会社 映像表示装置
US20250377719A1 (en) 2024-06-09 2025-12-11 Apple Inc. Methods of interacting with content in a virtual environment

Family Cites Families (155)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6222525B1 (en) 1992-03-05 2001-04-24 Brad A. Armstrong Image controllers with sheet connected sensors
US5745713A (en) * 1995-08-03 1998-04-28 Silicon Graphics, Inc. Movie-based facility for launching application programs or services
US5670988A (en) 1995-09-05 1997-09-23 Interlink Electronics, Inc. Trigger operated electronic device
JP3148133B2 (ja) * 1996-10-30 2001-03-19 三菱電機株式会社 情報検索装置
US6091415A (en) 1997-05-02 2000-07-18 Inventec Corporation System and method for displaying multiple dialog boxes in a window display
US6882354B1 (en) 1997-09-17 2005-04-19 Sun Microsystems, Inc. Scroll bars with user feedback
US6918087B1 (en) 1999-12-16 2005-07-12 Autodesk, Inc. Visual clues to navigate three-dimensional space in a computer-implemented graphics system
US6636239B1 (en) 2000-02-24 2003-10-21 Sanavigator, Inc. Method of operating a graphical user interface to selectively enable and disable a datapath in a network
US6981229B1 (en) 2000-04-28 2005-12-27 Alias Systems Corp. System for dynamically mapping input device movement as a user's viewpoint changes
USD462076S1 (en) 2001-01-08 2002-08-27 Apple Computer, Inc. User interface for computer display
US7439975B2 (en) 2001-09-27 2008-10-21 International Business Machines Corporation Method and system for producing dynamically determined drop shadows in a three-dimensional graphical user interface
US20030079224A1 (en) 2001-10-22 2003-04-24 Anton Komar System and method to provide additional information associated with selectable display areas
US7202867B1 (en) 2003-01-31 2007-04-10 Microsoft Corporation Generation of glow effect
WO2004107763A1 (ja) * 2003-05-28 2004-12-09 Sanyo Electric Co., Ltd. 立体映像表示装置及びプログラム
US20070186191A1 (en) 2003-11-27 2007-08-09 Koninklijke Philips Electronics N.V. Method of visualizing a pointer during interaction
US7365738B2 (en) 2003-12-02 2008-04-29 International Business Machines Corporation Guides and indicators for eye movement monitoring systems
US8302020B2 (en) 2004-06-25 2012-10-30 Apple Inc. Widget authoring and editing environment
US7546543B2 (en) 2004-06-25 2009-06-09 Apple Inc. Widget authoring and editing environment
US7489306B2 (en) 2004-12-22 2009-02-10 Microsoft Corporation Touch screen accuracy
US20060248447A1 (en) * 2005-05-02 2006-11-02 Nokia Corporation Indicating loading status of information from a computer network
US11428937B2 (en) 2005-10-07 2022-08-30 Percept Technologies Enhanced optical and perceptual digital eyewear
US20070081123A1 (en) 2005-10-07 2007-04-12 Lewis Scott W Digital eyewear
US8696113B2 (en) 2005-10-07 2014-04-15 Percept Technologies Inc. Enhanced optical and perceptual digital eyewear
US7765491B1 (en) 2005-11-16 2010-07-27 Apple Inc. User interface widget for selecting a point or range
US7644373B2 (en) * 2006-01-23 2010-01-05 Microsoft Corporation User interface for viewing clusters of images
US8014760B2 (en) 2006-09-06 2011-09-06 Apple Inc. Missed telephone call management for a portable multifunction device
JP2009080345A (ja) 2007-09-26 2009-04-16 Seiko Epson Corp 画像表示装置およびその制御方法並びにプログラム
KR20090093124A (ko) 2008-02-28 2009-09-02 주식회사 밸럽스 항목 검색 방법
US8612888B2 (en) * 2008-04-01 2013-12-17 Litl, Llc Method and apparatus for managing digital media content
KR101534789B1 (ko) 2008-05-28 2015-07-07 구글 인코포레이티드 모바일 컴퓨팅 디바이스에서의 모션-컨트롤 뷰
US20100180186A1 (en) * 2008-09-16 2010-07-15 James Skinner System and Method for Storage and Distribution of Electronic Publications by Content Creators and Online Publishers with Referral-Based Commissions
US8490026B2 (en) 2008-10-27 2013-07-16 Microsoft Corporation Painting user controls
US20100131886A1 (en) 2008-11-26 2010-05-27 Honeywell International Inc. Display system and method for generating enhanced scrollbar
TWI397840B (zh) 2009-07-23 2013-06-01 Ind Tech Res Inst 基於軌跡之控制方法及裝置
US8970669B2 (en) 2009-09-30 2015-03-03 Rovi Guides, Inc. Systems and methods for generating a three-dimensional media guidance application
USD660313S1 (en) 2009-10-26 2012-05-22 Amazon Technologies, Inc. Display screen portion with user interface
AU2011220382A1 (en) * 2010-02-28 2012-10-18 Microsoft Corporation Local advertising content on an interactive head-mounted eyepiece
US20130278631A1 (en) 2010-02-28 2013-10-24 Osterhout Group, Inc. 3d positioning of augmented reality information
JP2011210138A (ja) * 2010-03-30 2011-10-20 Sony Corp 電子機器、画像出力方法及びプログラム
JP5574849B2 (ja) 2010-06-28 2014-08-20 キヤノン株式会社 情報処理装置及びその制御方法、プログラム
GB201015720D0 (en) 2010-09-20 2010-10-27 Gammons Richard Findability of data elements
US9304319B2 (en) 2010-11-18 2016-04-05 Microsoft Technology Licensing, Llc Automatic focus improvement for augmented reality displays
US8823732B2 (en) 2010-12-17 2014-09-02 Pictometry International Corp. Systems and methods for processing images with edge detection and snap-to feature
US10156722B2 (en) 2010-12-24 2018-12-18 Magic Leap, Inc. Methods and systems for displaying stereoscopy with a freeform optical system with addressable focus for virtual and augmented reality
AU2011348122A1 (en) 2010-12-24 2013-07-11 Magic Leap Inc. An ergonomic head mounted display device and optical system
US8497838B2 (en) * 2011-02-16 2013-07-30 Microsoft Corporation Push actuation of interface controls
US20120218395A1 (en) 2011-02-25 2012-08-30 Microsoft Corporation User interface presentation and interactions
JP6316186B2 (ja) 2011-05-06 2018-04-25 マジック リープ， インコーポレイテッドＭａｇｉｃ Ｌｅａｐ，Ｉｎｃ． 広範囲同時遠隔ディジタル提示世界
US8676937B2 (en) 2011-05-12 2014-03-18 Jeffrey Alan Rapaport Social-topical adaptive networking (STAN) system allowing for group based contextual transaction offers and acceptances and hot topic watchdogging
WO2013049248A2 (en) 2011-09-26 2013-04-04 Osterhout Group, Inc. Video display modification based on sensor input for a see-through near-to-eye display
EP2760363A4 (en) 2011-09-29 2015-06-24 Magic Leap Inc TACTILE GLOVE FOR HUMAN COMPUTER INTERACTION
US9047688B2 (en) * 2011-10-21 2015-06-02 Here Global B.V. Depth cursor and depth measurement in images
US9215293B2 (en) 2011-10-28 2015-12-15 Magic Leap, Inc. System and method for augmented and virtual reality
US8950867B2 (en) 2011-11-23 2015-02-10 Magic Leap, Inc. Three dimensional virtual and augmented reality display system
US9324183B2 (en) 2011-11-29 2016-04-26 Apple Inc. Dynamic graphical interface shadows
CN102662569B (zh) 2012-03-26 2015-11-25 华为技术有限公司 选择光标操作方法、对象显示方法及终端设备
US20130263044A1 (en) * 2012-03-30 2013-10-03 Ebay Inc. Method and system to provide a scroll map
WO2013152205A1 (en) 2012-04-05 2013-10-10 Augmented Vision Inc. Wide-field of view (fov) imaging devices with active foveation capability
US9477303B2 (en) 2012-04-09 2016-10-25 Intel Corporation System and method for combining three-dimensional tracking with a three-dimensional display for a user interface
KR20130134195A (ko) 2012-05-30 2013-12-10 삼성전자주식회사 오디오 스트림을 고속 시각화시키는 전자 장치 및 방법
US9671566B2 (en) 2012-06-11 2017-06-06 Magic Leap, Inc. Planar waveguide apparatus with diffraction element(s) and system employing same
WO2013188464A1 (en) 2012-06-11 2013-12-19 Magic Leap, Inc. Multiple depth plane three-dimensional display using a wave guide reflector array projector
US9285973B1 (en) 2012-08-08 2016-03-15 John S Gable Systems and methods for detecting and displaying bias
KR20140020568A (ko) 2012-08-09 2014-02-19 삼성전자주식회사 디스플레이 장치 및 이의 제어 방법
KR20150054967A (ko) 2012-09-11 2015-05-20 매직 립, 인코포레이티드 인체공학적 헤드 마운티드 디스플레이 디바이스 및 광학 시스템
USD712920S1 (en) 2012-09-28 2014-09-09 Nest Labs, Inc. Display screen or portion thereof with an animated graphical user interface
KR101755625B1 (ko) 2013-01-07 2017-07-07 삼성전자주식회사 디스플레이 장치, 그의 ui 표시 방법 및 컴퓨터 판독가능 기록매체
KR102141992B1 (ko) 2013-01-15 2020-08-06 매직 립, 인코포레이티드 초고해상도 스캐닝 섬유 디스플레이
JP1527512S (https=) 2013-02-22 2015-06-29
IL308285B2 (en) 2013-03-11 2024-11-01 Magic Leap Inc System and method for augmentation and virtual reality
TWD172232S (zh) 2013-03-13 2015-12-01 三星電子股份有限公司 行動通訊裝置之圖形化使用者介面
US9417452B2 (en) 2013-03-15 2016-08-16 Magic Leap, Inc. Display system and method
US10220303B1 (en) * 2013-03-15 2019-03-05 Harmonix Music Systems, Inc. Gesture-based music game
JP6076795B2 (ja) 2013-03-27 2017-02-08 シャープ株式会社 画像提供装置、セットトップボックス、表示装置、表示システム、テレビジョン受像機および制御方法
US9245387B2 (en) 2013-04-12 2016-01-26 Microsoft Technology Licensing, Llc Holographic snap grid
US10262462B2 (en) 2014-04-18 2019-04-16 Magic Leap, Inc. Systems and methods for augmented and virtual reality
US9874749B2 (en) 2013-11-27 2018-01-23 Magic Leap, Inc. Virtual and augmented reality systems and methods
US9360672B2 (en) 2013-07-11 2016-06-07 Seiko Epson Corporation Head mounted display device and control method for head mounted display device
US10295338B2 (en) * 2013-07-12 2019-05-21 Magic Leap, Inc. Method and system for generating map data from an image
US9529513B2 (en) 2013-08-05 2016-12-27 Microsoft Technology Licensing, Llc Two-hand interaction with natural user interface
USD750661S1 (en) 2013-08-27 2016-03-01 Bsh Home Appliances Corporation Kitchen appliance with computer-generated graphical user interface
JP6492419B2 (ja) 2014-05-23 2019-04-03 セイコーエプソン株式会社 頭部装着型表示装置、頭部装着型表示装置を制御する方法、コンピュータープログラム、画像表示システム、および、情報処理装置
US20150062164A1 (en) 2013-09-05 2015-03-05 Seiko Epson Corporation Head mounted display, method of controlling head mounted display, computer program, image display system, and information processing apparatus
JP6479785B2 (ja) 2013-10-16 2019-03-06 マジック リープ， インコーポレイテッドＭａｇｉｃ Ｌｅａｐ，Ｉｎｃ． 調節可能な瞳孔間距離を有する仮想または拡張現実ヘッドセット
CN107272199B (zh) 2013-11-27 2023-04-07 奇跃公司 虚拟和增强现实系统与方法
US9857591B2 (en) 2014-05-30 2018-01-02 Magic Leap, Inc. Methods and system for creating focal planes in virtual and augmented reality
JP6393986B2 (ja) 2013-12-26 2018-09-26 セイコーエプソン株式会社 頭部装着型表示装置、画像表示システム、および、頭部装着型表示装置の制御方法
US20150205358A1 (en) 2014-01-20 2015-07-23 Philip Scott Lyren Electronic Device with Touchless User Interface
US9311718B2 (en) 2014-01-23 2016-04-12 Microsoft Technology Licensing, Llc Automated content scrolling
US9588343B2 (en) 2014-01-25 2017-03-07 Sony Interactive Entertainment America Llc Menu navigation in a head-mounted display
US9619105B1 (en) 2014-01-30 2017-04-11 Aquifi, Inc. Systems and methods for gesture based interaction with viewpoint dependent user interfaces
CN106233189B (zh) 2014-01-31 2020-06-26 奇跃公司 多焦点显示系统和方法
KR102177133B1 (ko) 2014-01-31 2020-11-10 매직 립, 인코포레이티드 멀티-포컬 디스플레이 시스템 및 방법
US10203762B2 (en) 2014-03-11 2019-02-12 Magic Leap, Inc. Methods and systems for creating virtual and augmented reality
US9940006B2 (en) 2014-03-26 2018-04-10 Unanimous A. I., Inc. Intuitive interfaces for real-time collaborative intelligence
EP3140780B1 (en) 2014-05-09 2020-11-04 Google LLC Systems and methods for discerning eye signals and continuous biometric identification
NZ727350A (en) 2014-05-30 2020-08-28 Magic Leap Inc Methods and systems for generating virtual content display with a virtual or augmented reality apparatus
TWD175825S (zh) 2014-06-13 2016-05-21 樂視致新電子科技（天津）有限公司; 顯示螢幕之圖形化使用者介面
KR102217561B1 (ko) 2014-06-23 2021-02-19 엘지전자 주식회사 헤드 마운티드 디스플레이 및 그것의 제어방법
US9904055B2 (en) 2014-07-25 2018-02-27 Microsoft Technology Licensing, Llc Smart placement of virtual objects to stay in the field of view of a head mounted display
US10416760B2 (en) 2014-07-25 2019-09-17 Microsoft Technology Licensing, Llc Gaze-based object placement within a virtual reality environment
US9880631B2 (en) 2014-09-02 2018-01-30 Stmicroelectronics International N.V. Instrument interface for reducing effects of erratic motion
US20160132139A1 (en) 2014-11-11 2016-05-12 Qualcomm Incorporated System and Methods for Controlling a Cursor Based on Finger Pressure and Direction
KR102329124B1 (ko) * 2015-01-05 2021-11-19 삼성전자주식회사 영상 표시 장치 및 영상 표시 방법
USD758367S1 (en) 2015-05-14 2016-06-07 Magic Leap, Inc. Virtual reality headset
US9658736B2 (en) 2015-06-04 2017-05-23 Microsoft Technology Licensing, Llc Contrast-oriented cursor presentation
JP5876607B1 (ja) 2015-06-12 2016-03-02 株式会社コロプラ フローティング・グラフィカルユーザインターフェース
US10409443B2 (en) * 2015-06-24 2019-09-10 Microsoft Technology Licensing, Llc Contextual cursor display based on hand tracking
US10102579B2 (en) * 2015-07-16 2018-10-16 Chicago Mercantile Exchange Inc. Facilitation of deterministic interaction with a dynamically changing transaction processing environment
USD771653S1 (en) 2015-07-29 2016-11-15 Apple Inc. Display screen or portion thereof with animated graphical user interface
CN114998557A (zh) 2015-08-18 2022-09-02 奇跃公司 虚拟和增强现实系统和方法
US9928029B2 (en) * 2015-09-08 2018-03-27 Apple Inc. Device, method, and graphical user interface for providing audiovisual feedback
KR102701209B1 (ko) 2015-10-20 2024-08-29 매직 립, 인코포레이티드 3차원 공간에서 가상 객체들 선택
KR102450416B1 (ko) * 2015-11-04 2022-10-05 삼성전자주식회사 전자 장치, 웨어러블 장치 및 전자 장치에서 디스플레이되는 객체를 제어하는 방법
JP6518582B2 (ja) * 2015-12-21 2019-05-22 株式会社ソニー・インタラクティブエンタテインメント 情報処理装置および操作受付方法
KR20170096420A (ko) * 2016-02-16 2017-08-24 삼성전자주식회사 대화형 3차원 디스플레이 장치 및 방법
WO2017172982A1 (en) 2016-03-31 2017-10-05 Magic Leap, Inc. Interactions with 3d virtual objects using poses and multiple-dof controllers
USD797138S1 (en) 2016-04-28 2017-09-12 Wells Fargo Bank, N.A. Electronic display with animated graphical user interface
US10146334B2 (en) 2016-06-09 2018-12-04 Microsoft Technology Licensing, Llc Passive optical and inertial tracking in slim form-factor
US20180046352A1 (en) * 2016-08-09 2018-02-15 Matthew Johnson Virtual cursor movement
EP4398566A3 (en) 2016-08-11 2024-10-09 Magic Leap, Inc. Automatic placement of a virtual object in a three-dimensional space
USD797735S1 (en) 2016-08-22 2017-09-19 Magic Leap, Inc. Mixed reality head mounted display
USD806107S1 (en) 2016-09-16 2017-12-26 Salesforce.Com, Inc. Display screen or portion thereof with animated graphical user interface
USD820307S1 (en) 2016-11-16 2018-06-12 Airbnb, Inc. Display screen with graphical user interface for a video pagination indicator
USD862464S1 (en) 2016-11-16 2019-10-08 Magic Leap, Inc. Head mounted audio-visual display system
JP2018124651A (ja) * 2017-01-30 2018-08-09 セイコーエプソン株式会社 表示システム
US11269580B2 (en) * 2017-02-13 2022-03-08 Comcast Cable Communications, Llc Guided collaborative viewing of navigable image content
JP2018160735A (ja) 2017-03-22 2018-10-11 セイコーエプソン株式会社 透過型表示装置、表示制御方法、およびコンピュータープログラム
USD797767S1 (en) 2017-03-31 2017-09-19 Microsoft Corporation Display system with a virtual three-dimensional graphical user interface
US10768775B2 (en) 2017-04-06 2020-09-08 Microsoft Technology Licensing, Llc Text direction indicator
CA3060209C (en) 2017-05-01 2024-10-15 Magic Leap, Inc. MATCHING CONTENT WITH A 3D SPATIAL ENVIRONMENT
US20180350145A1 (en) 2017-05-30 2018-12-06 Reston Restoration Augmented Reality Devices and Methods Thereof for Rendering Virtual Objects
USD908728S1 (en) 2017-08-22 2021-01-26 Samsung Electronics Co., Ltd. Display screen or portion thereof with transitional graphical user interface
US20190066529A1 (en) * 2017-08-23 2019-02-28 Steven E. Grubbs Virtual Reality Learning Management System for Classroom Instructors
USD850464S1 (en) 2017-08-31 2019-06-04 Aristocrat Technologies Australia Pty Limited Display screen or portion thereof with transitional graphical user interface
US10930075B2 (en) 2017-10-16 2021-02-23 Microsoft Technology Licensing, Llc User interface discovery and interaction for three-dimensional virtual environments
USD858549S1 (en) 2017-10-27 2019-09-03 Waymo Llc Display screen portion with graphical user interface
USD858550S1 (en) 2017-10-27 2019-09-03 Waymo Llc Display screen portion with graphical user interface
USD897353S1 (en) 2017-10-27 2020-09-29 Waymo Llc Display screen portion with graphical user interface
USD829239S1 (en) 2017-12-08 2018-09-25 Technonet Co., Ltd. Video player display screen or portion thereof with graphical user interface
USD851113S1 (en) 2017-12-19 2019-06-11 HumanCode, Inc. Display screen with graphical user interface
US20190215503A1 (en) * 2018-01-05 2019-07-11 Microsoft Technology Licensing, Llc 360-degree video post-roll
US10540941B2 (en) 2018-01-30 2020-01-21 Magic Leap, Inc. Eclipse cursor for mixed reality displays
US11567627B2 (en) 2018-01-30 2023-01-31 Magic Leap, Inc. Eclipse cursor for virtual content in mixed reality displays
US11157159B2 (en) 2018-06-07 2021-10-26 Magic Leap, Inc. Augmented reality scrollbar
USD879821S1 (en) 2018-08-02 2020-03-31 Palantir Technologies, Inc. Display screen or portion thereof with graphical user interface
USD934873S1 (en) 2018-09-18 2021-11-02 Magic Leap, Inc. Mobile computing support system having an illumination region
USD934872S1 (en) 2018-09-18 2021-11-02 Magic Leap, Inc. Mobile computing support system having an illumination region
USD923028S1 (en) 2018-09-28 2021-06-22 Exfo, Inc. Display screen or portion thereof with graphical user interface
USD905730S1 (en) 2018-10-03 2020-12-22 Allstate Insurance Company Display screen with graphical user interface
USD962981S1 (en) 2019-05-29 2022-09-06 Magic Leap, Inc. Display screen or portion thereof with animated scrollbar graphical user interface
USD934885S1 (en) 2019-07-31 2021-11-02 Samsung Electronics Co., Ltd. Display screen or portion thereof with graphical user interface
USD915424S1 (en) 2019-08-16 2021-04-06 Butterfly Network, Inc. Display panel or portion thereof with graphical user interface
USD936093S1 (en) 2019-10-10 2021-11-16 Samsung Electronics Co., Ltd. Display screen or portion thereof with transitional graphical user interface
USD938978S1 (en) 2019-11-12 2021-12-21 X Development Llc Display panel portion with an animated icon

Also Published As

Publication number Publication date
JP2022119960A (ja) 2022-08-17
US11567627B2 (en) 2023-01-31
EP3746870A2 (en) 2020-12-09
EP3746870A4 (en) 2022-02-09
CA3087775A1 (en) 2019-08-08
IL305114A (en) 2023-10-01
JP2025157211A (ja) 2025-10-15
US12449950B2 (en) 2025-10-21
JP2024105363A (ja) 2024-08-06
JP7791931B2 (ja) 2025-12-24
US20260029893A1 (en) 2026-01-29
EP4333427A2 (en) 2024-03-06
CN111819522A (zh) 2020-10-23
EP3746870B1 (en) 2023-11-22
EP4333427A3 (en) 2024-05-15
WO2019152286A3 (en) 2019-09-19
IL305114B2 (en) 2024-09-01
IL305114B1 (en) 2024-05-01
KR20200115531A (ko) 2020-10-07
IL276047B1 (en) 2023-09-01
IL276047A (en) 2020-08-31
WO2019152286A2 (en) 2019-08-08
US20230266859A1 (en) 2023-08-24
IL276047B2 (en) 2024-01-01
JP2021512353A (ja) 2021-05-13
KR102810829B1 (ko) 2025-05-20
JP7123148B2 (ja) 2022-08-22
JP7526226B2 (ja) 2024-07-31
US20190235729A1 (en) 2019-08-01
IL312455A (en) 2024-06-01

Similar Documents

Publication Publication Date Title
US12449950B2 (en) Eclipse cursor for virtual content in mixed reality displays
US11741917B2 (en) Eclipse cursor for mixed reality displays
US11520477B2 (en) Augmented reality scrollbar
EP3436863B1 (en) Interactions with 3d virtual objects using poses and multiple-dof controllers
AU2022202722A1 (en) Visual aura around field of view
IL303843B2 (en) Automatic placement of a virtual object in a three-dimensional space

Legal Events

Date Code Title Description
MK4 Application lapsed section 142(2)(d) - no continuation fee paid for the application