WO2024054433A3 - Devices, methods, and graphical user interfaces for controlling avatars within three-dimensional environments - Google Patents

Devices, methods, and graphical user interfaces for controlling avatars within three-dimensional environments Download PDF

Info

Publication number
WO2024054433A3
WO2024054433A3 PCT/US2023/031979 US2023031979W WO2024054433A3 WO 2024054433 A3 WO2024054433 A3 WO 2024054433A3 US 2023031979 W US2023031979 W US 2023031979W WO 2024054433 A3 WO2024054433 A3 WO 2024054433A3
Authority
WO
WIPO (PCT)
Prior art keywords
user interfaces
methods
devices
graphical user
dimensional environments
Prior art date
Application number
PCT/US2023/031979
Other languages
French (fr)
Other versions
WO2024054433A2 (en
Inventor
Jason D. Rickwald
Andrew R. Bacon
Kristi E. Bauerly
Rupert Burton
Jordan A. CAZAMIAS
Tong Chen
Shih-Sang CHIU
Stephen O. Lemay
Jonathan PERRON
William A. Sorrentino III
Giancarlo Yerkes
Original Assignee
Apple Inc.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from US18/241,802 external-priority patent/US20240077937A1/en
Application filed by Apple Inc. filed Critical Apple Inc.
Publication of WO2024054433A2 publication Critical patent/WO2024054433A2/en
Publication of WO2024054433A3 publication Critical patent/WO2024054433A3/en

Links

Classifications

    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/20—Input arrangements for video game devices
    • A63F13/21—Input arrangements for video game devices characterised by their sensors, purposes or types
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/40—Processing input control signals of video game devices, e.g. signals generated by the player or derived from the environment
    • A63F13/42—Processing input control signals of video game devices, e.g. signals generated by the player or derived from the environment by mapping the input signals into game commands, e.g. mapping the displacement of a stylus on a touch screen to the steering angle of a virtual vehicle
    • A63F13/428—Processing input control signals of video game devices, e.g. signals generated by the player or derived from the environment by mapping the input signals into game commands, e.g. mapping the displacement of a stylus on a touch screen to the steering angle of a virtual vehicle involving motion or position input signals, e.g. signals representing the rotation of an input controller or a player's arm motions sensed by accelerometers or gyroscopes
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/012—Head tracking input arrangements
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/013—Eye tracking input arrangements
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating 3D models or images for computer graphics
    • G06T19/20—Editing of 3D images, e.g. changing shapes or colours, aligning objects or positioning parts
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/20—Scenes; Scene-specific elements in augmented reality scenes
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/18—Eye characteristics, e.g. of the iris
    • G06V40/19—Sensors therefor
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/18—Eye characteristics, e.g. of the iris
    • G06V40/193—Preprocessing; Feature extraction
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/20—Movements or behaviour, e.g. gesture recognition
    • G06V40/28—Recognition of hand or arm movements, e.g. recognition of deaf sign language
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F2300/00—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
    • A63F2300/50—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by details of game servers
    • A63F2300/55—Details of game data or player data management
    • A63F2300/5546—Details of game data or player data management using player registration data, e.g. identification, account, preferences, game history
    • A63F2300/5553—Details of game data or player data management using player registration data, e.g. identification, account, preferences, game history user representation in the game field, e.g. avatar
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2219/00—Indexing scheme for manipulating 3D models or images for computer graphics
    • G06T2219/20—Indexing scheme for editing of 3D models
    • G06T2219/2016—Rotation, translation, scaling
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2219/00—Indexing scheme for manipulating 3D models or images for computer graphics
    • G06T2219/20—Indexing scheme for editing of 3D models
    • G06T2219/2021—Shape modification

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Multimedia (AREA)
  • General Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Ophthalmology & Optometry (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Psychiatry (AREA)
  • Architecture (AREA)
  • Computer Graphics (AREA)
  • Computer Hardware Design (AREA)
  • Software Systems (AREA)
  • Social Psychology (AREA)
  • Information Transfer Between Computers (AREA)
  • Processing Or Creating Images (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

The present disclosure generally relates to techniques and user interfaces for controlling and displaying representations of user in environments, such as during a live communication session and/or a live collaboration session.
PCT/US2023/031979 2022-09-06 2023-09-05 Devices, methods, and graphical user interfaces for controlling avatars within three-dimensional environments WO2024054433A2 (en)

Applications Claiming Priority (6)

Application Number Priority Date Filing Date Title
US202263404022P 2022-09-06 2022-09-06
US63/404,022 2022-09-06
US202363470879P 2023-06-03 2023-06-03
US63/470,879 2023-06-03
US18/241,802 US20240077937A1 (en) 2022-09-06 2023-09-01 Devices, methods, and graphical user interfaces for controlling avatars within three-dimensional environments
US18/241,802 2023-09-01

Publications (2)

Publication Number Publication Date
WO2024054433A2 WO2024054433A2 (en) 2024-03-14
WO2024054433A3 true WO2024054433A3 (en) 2024-04-18

Family

ID=88236520

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2023/031979 WO2024054433A2 (en) 2022-09-06 2023-09-05 Devices, methods, and graphical user interfaces for controlling avatars within three-dimensional environments

Country Status (1)

Country Link
WO (1) WO2024054433A2 (en)

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20020135581A1 (en) * 2001-03-26 2002-09-26 Russell Ryan S. Method and system for controlling an avatar using computer vision
US20190088018A1 (en) * 2016-03-11 2019-03-21 Sony Interactive Entertainment Europe Limited Virtual Reality
US20190160378A1 (en) * 2016-06-28 2019-05-30 Against Gravity Corp. Systems and methods providing temporary decoupling of user avatar synchronicity for presence enhancing experiences

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20020135581A1 (en) * 2001-03-26 2002-09-26 Russell Ryan S. Method and system for controlling an avatar using computer vision
US20190088018A1 (en) * 2016-03-11 2019-03-21 Sony Interactive Entertainment Europe Limited Virtual Reality
US20190160378A1 (en) * 2016-06-28 2019-05-30 Against Gravity Corp. Systems and methods providing temporary decoupling of user avatar synchronicity for presence enhancing experiences

Also Published As

Publication number Publication date
WO2024054433A2 (en) 2024-03-14

Similar Documents

Publication Publication Date Title
WO2020172492A3 (en) Bacterial membrane preparations
EP1498164A3 (en) Network game system and network game processing method
WO2003038552A3 (en) System and method for using an instant messaging environment to establish a hosted application sharing session
WO2020191337A4 (en) Methods of applying virtual world elements into augmented reality
WO2010021842A3 (en) Social virtual avatar modification
AU2003293868A1 (en) Hair treatment compositions
WO2021061209A3 (en) Spherical tantalum-titanium alloy powder, products containing the same, and methods of making the same
EP4273682A3 (en) Avatar integration with multiple applications
WO2003015696A8 (en) Ultra fine dead sea mineral compound and method of manufacture
SI1407763T1 (en) Compositions containing a cosmetically active organic acid and a legume product
WO2024054433A3 (en) Devices, methods, and graphical user interfaces for controlling avatars within three-dimensional environments
MX2021008904A (en) Microfibrillated cellulose as rheology modifier in high ionic strength agricultural formulations.
WO2020190362A3 (en) A social interaction robot
IN2013MU02192A (en)
WO2006129095A3 (en) Sustained release preparations of pro-insulin c-peptide
WO2016167459A8 (en) Method for expressing social presence of virtual avatar, using change in pupil size according to heartbeats, and system employing same
CN104494351A (en) Antique-looking agate mosaic pasted lazurite vase
NZ624275A (en) Sustained-release preparation
WO2019126345A8 (en) Compositions and methods for stabilizing meat substitute products
CN208224626U (en) A kind of novel shared VR equipment
WO2020181130A3 (en) Polynucleotide conjugates and uses thereof
WO2016030917A3 (en) A device for generating bilateral pressure impulses
JP3160597U (en) Bone shaped stick for meat decoration
PH22019050143Y1 (en) A Composition of Pickle Relish from Pako (Diplazium esculentum (Retz.)Sw.)
WO2002072048A3 (en) Use of divalent tropolone salts for treatment of the hair

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 23782653

Country of ref document: EP

Kind code of ref document: A2