CA3237710A1 - Metaverse content modality mapping - Google Patents

Metaverse content modality mapping Download PDF

Info

Publication number
CA3237710A1
CA3237710A1 CA3237710A CA3237710A CA3237710A1 CA 3237710 A1 CA3237710 A1 CA 3237710A1 CA 3237710 A CA3237710 A CA 3237710A CA 3237710 A CA3237710 A CA 3237710A CA 3237710 A1 CA3237710 A1 CA 3237710A1
Authority
CA
Canada
Prior art keywords
modality
implementations
device type
processors
user
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CA3237710A
Other languages
English (en)
French (fr)
Inventor
Erik Murphy-Chutorian
Nicholas BUTKO
Thomas Emrich
Joel UDWIN
Rigel Gareth BENTON
Christoph Michael BARTSCHAT
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Niantic Inc
Original Assignee
Niantic Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Niantic Inc filed Critical Niantic Inc
Publication of CA3237710A1 publication Critical patent/CA3237710A1/en
Pending legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/017—Head mounted
    • G02B27/0172—Head mounted characterised by optical features
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/013—Eye tracking input arrangements
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G06F3/04815—Interaction with a metaphor-based environment or interaction object displayed as three-dimensional [3D], e.g. changing the user viewpoint with respect to the environment or object
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • G06F3/04883—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures for inputting data by handwriting, e.g. gesture or text
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00—Arrangements for program control, e.g. control units
    • G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44—Arrangements for executing specific programs
    • G06F9/451—Execution arrangements for user interfaces
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T17/00—Three-dimensional [3D] modelling for computer graphics

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Software Systems (AREA)
  • Optics & Photonics (AREA)
  • Computer Graphics (AREA)
  • Geometry (AREA)
  • User Interface Of Digital Computer (AREA)
  • Medicines Containing Antibodies Or Antigens For Use As Internal Diagnostic Agents (AREA)
  • Stored Programmes (AREA)
  • Preparation Of Compounds By Using Micro-Organisms (AREA)
  • Processing Or Creating Images (AREA)
CA3237710A 2021-11-08 2022-11-07 Metaverse content modality mapping Pending CA3237710A1 (en)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US202163277163P 2021-11-08 2021-11-08
US63/277,163 2021-11-08
PCT/IB2022/060698 WO2023079527A1 (en) 2021-11-08 2022-11-07 Metaverse content modality mapping

Publications (1)

Publication Number Publication Date
CA3237710A1 true CA3237710A1 (en) 2023-05-11

Family

ID=86228673

Family Applications (1)

Application Number Title Priority Date Filing Date
CA3237710A Pending CA3237710A1 (en) 2021-11-08 2022-11-07 Metaverse content modality mapping

Country Status (9)

Country Link
US (1) US20230147561A1 (https=)
EP (1) EP4430554A4 (https=)
JP (1) JP2024543831A (https=)
KR (1) KR20240112287A (https=)
CN (1) CN118525262A (https=)
AU (1) AU2022382108A1 (https=)
CA (1) CA3237710A1 (https=)
TW (1) TW202328872A (https=)
WO (1) WO2023079527A1 (https=)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11949564B2 (en) * 2022-03-04 2024-04-02 Lan Party Technologies, Inc. Virtual gaming environment
JP7626173B2 (ja) * 2022-10-26 2025-02-04 株式会社リコー 端末装置、情報処理方法、プログラム、および情報処理システム

Family Cites Families (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8127297B2 (en) * 2007-10-31 2012-02-28 International Business Machines Corporation Smart virtual objects of a virtual universe independently select display quality adjustment settings to conserve energy consumption of resources supporting the virtual universe
KR20110007419A (ko) * 2009-07-16 2011-01-24 한국전자통신연구원 멀티 메타버스 환경에서의 콘텐츠 전송 시스템 및 이를 이용한 콘텐츠 관리 방법
US20110296030A1 (en) * 2010-05-25 2011-12-01 Sony Corporation Single rui renderer on a variety of devices with different capabilities
CN105074617B (zh) * 2013-03-11 2018-03-02 日本电气方案创新株式会社 三维用户界面装置和三维操作处理方法
US9501138B2 (en) * 2014-05-05 2016-11-22 Aquifi, Inc. Systems and methods for remapping three-dimensional gestures onto a finite-size two-dimensional surface
KR102471977B1 (ko) * 2015-11-06 2022-11-30 삼성전자 주식회사 복수의 전자장치 사이에서 가상 객체를 표시하는 방법 및 이를 지원하는 전자 장치
US10445935B2 (en) * 2017-05-26 2019-10-15 Microsoft Technology Licensing, Llc Using tracking to simulate direct tablet interaction in mixed reality
US11516521B2 (en) * 2018-07-30 2022-11-29 Koninklijke Kpn N.V. Generating composite video stream for display in VR
US11611738B2 (en) * 2018-10-21 2023-03-21 Saras-3D, Inc. User interface module for converting a standard 2D display device into an interactive 3D display device
CN119766984A (zh) * 2018-11-30 2025-04-04 Pcms控股公司 显示3d对象的方法和系统
US10748391B2 (en) * 2018-12-27 2020-08-18 Immersion Corporation Haptic signal conversion system
US11521356B2 (en) 2019-10-10 2022-12-06 Meta Platforms Technologies, Llc Systems and methods for a shared interactive environment
US11195020B1 (en) * 2019-10-29 2021-12-07 Facebook Technologies, Llc Systems and methods for maintaining virtual spaces
US20210358294A1 (en) * 2020-05-15 2021-11-18 Microsoft Technology Licensing, Llc Holographic device control

Also Published As

Publication number Publication date
AU2022382108A1 (en) 2024-06-20
EP4430554A1 (en) 2024-09-18
EP4430554A4 (en) 2025-10-08
US20230147561A1 (en) 2023-05-11
WO2023079527A1 (en) 2023-05-11
TW202328872A (zh) 2023-07-16
KR20240112287A (ko) 2024-07-18
JP2024543831A (ja) 2024-11-26
CN118525262A (zh) 2024-08-20

Similar Documents

Publication Publication Date Title
US12566532B2 (en) Methods for interacting with virtual controls and/or an affordance for moving virtual objects in virtual environments
US12315091B2 (en) Methods for manipulating objects in an environment
AU2021242208B2 (en) Devices, methods, and graphical user interfaces for gaze-based navigation
US12124674B2 (en) Devices, methods, and graphical user interfaces for interacting with three-dimensional environments
US11954245B2 (en) Displaying physical input devices as virtual objects
US20170263033A1 (en) Contextual Virtual Reality Interaction
WO2019005366A1 (en) ANNOTATION USING A MIXED INTERACTIVITY SYSTEM WITH MULTIPLE DEVICES
EP3646143A1 (en) Selection using a multi-device mixed interactivity system
US12461640B2 (en) Devices, methods, and graphical user interfaces for displaying shadow and light effects in three-dimensional environments
US20230147561A1 (en) Metaverse Content Modality Mapping
US20250044911A1 (en) Devices, Methods, and Graphical User Interfaces for Interacting with Three-Dimensional Environments
US20250298470A1 (en) Devices, Methods, and Graphical User Interfaces for Navigating User Interfaces within Three-Dimensional Environments
WO2025198713A1 (en) Devices, methods, and graphical user interfaces for navigating user interfaces within three-dimensional environments
WO2024063786A1 (en) Devices, methods, and graphical user interfaces for displaying shadow and light effects in three-dimensional environments
WO2025255162A1 (en) Devices, methods, and graphical user interfaces for interacting with volumetric application user interfaces within three-dimensional environments

Legal Events

Date Code Title Description
MFA Maintenance fee for application paid

Free format text: FEE DESCRIPTION TEXT: MF (APPLICATION, 2ND ANNIV.) - STANDARD

Year of fee payment: 2

U00 Fee paid

Free format text: ST27 STATUS EVENT CODE: A-1-1-U10-U00-U101 (AS PROVIDED BY THE NATIONAL OFFICE); EVENT TEXT: MAINTENANCE REQUEST RECEIVED

Effective date: 20241030

U11 Full renewal or maintenance fee paid

Free format text: ST27 STATUS EVENT CODE: A-1-1-U10-U11-U102 (AS PROVIDED BY THE NATIONAL OFFICE); EVENT TEXT: MAINTENANCE FEE PAYMENT DETERMINED COMPLIANT

Effective date: 20241030

Free format text: ST27 STATUS EVENT CODE: A-1-1-U10-U11-U102 (AS PROVIDED BY THE NATIONAL OFFICE); EVENT TEXT: MAINTENANCE FEE PAYMENT PAID IN FULL

Effective date: 20241030

R11 Change to the name of applicant or owner or transfer of ownership requested

Free format text: ST27 STATUS EVENT CODE: A-1-1-R10-R11-R127 (AS PROVIDED BY THE NATIONAL OFFICE); EVENT TEXT: TRANSFER RECORDAL REQUEST OR RESPONSE

Effective date: 20250711

W00 Other event occurred

Free format text: ST27 STATUS EVENT CODE: A-1-1-W10-W00-W111 (AS PROVIDED BY THE NATIONAL OFFICE); EVENT TEXT: CORRESPONDENT DETERMINED COMPLIANT

Effective date: 20250711

R14 Transfer of ownership recorded

Free format text: ST27 STATUS EVENT CODE: A-1-1-R10-R14-R129 (AS PROVIDED BY THE NATIONAL OFFICE); EVENT TEXT: TRANSFER REQUIREMENTS DETERMINED COMPLIANT

Effective date: 20250721

MFA Maintenance fee for application paid

Free format text: FEE DESCRIPTION TEXT: MF (APPLICATION, 3RD ANNIV.) - STANDARD

Year of fee payment: 3

U00 Fee paid

Free format text: ST27 STATUS EVENT CODE: A-1-1-U10-U00-U101 (AS PROVIDED BY THE NATIONAL OFFICE); EVENT TEXT: MAINTENANCE REQUEST RECEIVED

Effective date: 20250916

U11 Full renewal or maintenance fee paid

Free format text: ST27 STATUS EVENT CODE: A-1-1-U10-U11-U102 (AS PROVIDED BY THE NATIONAL OFFICE); EVENT TEXT: MAINTENANCE FEE PAYMENT PAID IN FULL

Effective date: 20250916