EP3935877A1 - Liaison secondaire servant à des applications ar/vr - Google Patents

Liaison secondaire servant à des applications ar/vr

Info

Publication number
EP3935877A1
EP3935877A1 EP20715992.2A EP20715992A EP3935877A1 EP 3935877 A1 EP3935877 A1 EP 3935877A1 EP 20715992 A EP20715992 A EP 20715992A EP 3935877 A1 EP3935877 A1 EP 3935877A1
Authority
EP
European Patent Office
Prior art keywords
console
threshold
link
primary link
wearable display
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Withdrawn
Application number
EP20715992.2A
Other languages
German (de)
English (en)
Inventor
Gang Lu
Yuting FAN
William Louis Abbott
Dong Zheng
Qi Qu
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Meta Platforms Technologies LLC
Original Assignee
Facebook Technologies LLC
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Facebook Technologies LLC filed Critical Facebook Technologies LLC
Publication of EP3935877A1 publication Critical patent/EP3935877A1/fr
Withdrawn legal-status Critical Current

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04W—WIRELESS COMMUNICATION NETWORKS
    • H04W4/00—Services specially adapted for wireless communication networks; Facilities therefor
    • H04W4/80—Services using short range communication, e.g. near-field communication [NFC], radio-frequency identification [RFID] or low energy communication
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/0093—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00 with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/017—Head mounted
    • G02B27/0172—Head mounted characterised by optical features
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G5/00—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
    • G09G5/003—Details of a display terminal, the details relating to the control arrangement of the display terminal and to the interfaces thereto
    • G09G5/006—Details of the interface to the display terminal
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L45/00—Routing or path finding of packets in data switching networks
    • H04L45/22—Alternate routing
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L69/00—Network arrangements, protocols or services independent of the application payload and not provided for in the other groups of this subclass
    • H04L69/14—Multichannel or multilink protocols
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04W—WIRELESS COMMUNICATION NETWORKS
    • H04W24/00—Supervisory, monitoring or testing arrangements
    • H04W24/08—Testing, supervising or monitoring using real traffic
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04W—WIRELESS COMMUNICATION NETWORKS
    • H04W24/00—Supervisory, monitoring or testing arrangements
    • H04W24/10—Scheduling measurement reports ; Arrangements for measurement reports
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04W—WIRELESS COMMUNICATION NETWORKS
    • H04W28/00—Network traffic management; Network resource management
    • H04W28/02—Traffic management, e.g. flow control or congestion control
    • H04W28/08—Load balancing or load distribution
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04W—WIRELESS COMMUNICATION NETWORKS
    • H04W40/00—Communication routing or communication path finding
    • H04W40/02—Communication route or path selection, e.g. power-based or shortest path routing
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04W—WIRELESS COMMUNICATION NETWORKS
    • H04W40/00—Communication routing or communication path finding
    • H04W40/02—Communication route or path selection, e.g. power-based or shortest path routing
    • H04W40/12—Communication route or path selection, e.g. power-based or shortest path routing based on transmission quality or channel quality
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04W—WIRELESS COMMUNICATION NETWORKS
    • H04W40/00—Communication routing or communication path finding
    • H04W40/02—Communication route or path selection, e.g. power-based or shortest path routing
    • H04W40/12—Communication route or path selection, e.g. power-based or shortest path routing based on transmission quality or channel quality
    • H04W40/16—Communication route or path selection, e.g. power-based or shortest path routing based on transmission quality or channel quality based on interference
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04W—WIRELESS COMMUNICATION NETWORKS
    • H04W40/00—Communication routing or communication path finding
    • H04W40/02—Communication route or path selection, e.g. power-based or shortest path routing
    • H04W40/22—Communication route or path selection, e.g. power-based or shortest path routing using selective relaying for reaching a BTS [Base Transceiver Station] or an access point
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04W—WIRELESS COMMUNICATION NETWORKS
    • H04W48/00—Access restriction; Network selection; Access point selection
    • H04W48/18—Selecting a network or a communication service
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04W—WIRELESS COMMUNICATION NETWORKS
    • H04W76/00—Connection management
    • H04W76/10—Connection setup
    • H04W76/15—Setup of multiple wireless link connections
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04W—WIRELESS COMMUNICATION NETWORKS
    • H04W76/00—Connection management
    • H04W76/30—Connection release
    • H04W76/34—Selective release of ongoing connections
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0101—Head-up displays characterised by optical features
    • G02B2027/011—Head-up displays characterised by optical features comprising device for correcting geometrical aberrations, distortion
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0101—Head-up displays characterised by optical features
    • G02B2027/0138—Head-up displays characterised by optical features comprising image capture systems, e.g. camera
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0101—Head-up displays characterised by optical features
    • G02B2027/014—Head-up displays characterised by optical features comprising information/image processing systems
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/017—Head mounted
    • G02B2027/0178—Eyeglass type
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0179—Display position adjusting means not related to the information to be displayed
    • G02B2027/0187—Display position adjusting means not related to the information to be displayed slaved to motion of at least a part of the body of the user, e.g. head, eye
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2340/00—Aspects of display data processing
    • G09G2340/02—Handling of images in compressed format, e.g. JPEG, MPEG
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2340/00—Aspects of display data processing
    • G09G2340/04—Changes in size, position or resolution of an image
    • G09G2340/0407—Resolution change, inclusive of the use of different resolutions for different screen areas
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2350/00—Solving problems of bandwidth in display systems
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2370/00—Aspects of data communication
    • G09G2370/16—Use of wireless transmission of display information
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04W—WIRELESS COMMUNICATION NETWORKS
    • H04W36/00—Hand-off or reselection arrangements
    • H04W36/0005—Control or signalling for completing the hand-off
    • H04W36/0083—Determination of parameters used for hand-off, e.g. generation or modification of neighbour cell lists
    • H04W36/0085—Hand-off measurements
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04W—WIRELESS COMMUNICATION NETWORKS
    • H04W36/00—Hand-off or reselection arrangements
    • H04W36/14—Reselecting a network or an air interface
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04W—WIRELESS COMMUNICATION NETWORKS
    • H04W36/00—Hand-off or reselection arrangements
    • H04W36/24—Reselection being triggered by specific parameters
    • H04W36/30—Reselection being triggered by specific parameters by measured or perceived connection quality data
    • H04W36/302—Reselection being triggered by specific parameters by measured or perceived connection quality data due to low signal strength

Definitions

  • the present disclosure is generally related to display systems and methods, including but not limited to systems and methods for providing a secondary link for virtual reality (VR) or augmented reality (AR) applications.
  • VR virtual reality
  • AR augmented reality
  • Wearable display technologies can provide a virtual reality or augmented reality experience to a user wearing the respective display device. They can provide a series of computer generated images to allow the user to interact with the respective images.
  • the display devices can include head mounted devices that are positioned over or within the field of view of the user such that the field of view of the display device replaces the users natural field of view.
  • a head wearable display can be connected with a console to provide a VR or AR application (e.g., VR/AR experience) to a user of the head wearable display.
  • the console and head wearable display can be connected through at least one primary link and/or secondary link.
  • the primary link can provide or support a full VR/AR experience and the secondary link can provide supplemental or back-up coverage for the primary link or can support limited/minimum use cases.
  • the secondary link can be activated to support traffic between the console and the head wearable display in response to a reduced quality (e.g., delays, failures, blockage being detected/experienced) of the primary link.
  • the console can determine to use the primary link or the secondary link based in part on a type of use and/or a link quality of the primary link.
  • a method can include determining, by a console, that a first measurement of a primary link between the console and a head wearable display is less than a first threshold.
  • the first measurement can include, or correspond to, a quality metric of the primary link.
  • the method can include activating, by the console responsive to the first measurement being less than the first threshold, a secondary link between the console and the head wearable display.
  • the method can include determining, by a console, whether a second measurement of the primary link between the console and the head wearable display is less than a second threshold.
  • the second threshold can be less than the first threshold.
  • the method can include transitioning, by the console when the second measurement is less than the second threshold, traffic on the primary link to the activated secondary link.
  • the quality metric can include or comprise a signal to noise ratio of the primary link.
  • the method can include maintaining, by the console, the traffic on the primary link when the second measurement is greater than the second threshold.
  • the method can include performing, by the console responsive to the second measurement being less than the second threshold, measurements of the primary link at first determined intervals.
  • the method can include performing, by the console responsive to a third measurement after the second measurement being less than the second threshold, additional measurements of the primary link at second determined intervals.
  • each of the second determined intervals can be greater than each of the first determined intervals.
  • the method can include determining, by the console, that a third measurement of the primary link is greater than a third threshold.
  • the third threshold can be greater than the second threshold and less than the first threshold.
  • the method can include identifying, by the console, a first candidate beam for the primary link.
  • the method can include determining, by the console, a failure of the first candidate beam.
  • the method can include initiating, by the console, a determined period to suspend search for a second candidate beam for the primary link.
  • the method can include transitioning, by the console, the traffic on the secondary link to the primary link using the first candidate beam, responsive to the third measurement being greater than the third threshold.
  • the method can include de-activating, by the console, the secondary link responsive to a fourth measurement being greater than a fourth threshold.
  • the fourth threshold can be greater than the first threshold.
  • the method can include selecting, by the console, the primary link or the secondary link for the traffic between the console and the head wearable display according to a type of the traffic between the console and the head
  • a console in at least one aspect, can include one or more processors.
  • the one or more processors can be configured to determine that a first measurement of a primary link between the console and a head wearable display is less than a first threshold.
  • the first measurement can correspond to a quality metric of the primary link.
  • the one or more processors can be configured to activate, responsive to the first measurement being less than the first threshold, a secondary link between the console and the head wearable display.
  • the one or more processors can be configured to determine whether a second measurement of the primary link between the console and the head wearable display is less than a second threshold.
  • the second threshold can be less than the first threshold.
  • the one or more processors can be configured to transition, when the second measurement is less than the second threshold, traffic on the primary link to the activated secondary link.
  • the quality metric can comprise or include a signal to noise ratio of the primary link.
  • the console, or the one or more processors can be configured to maintain the traffic on the primary link when the second measurement is greater than the second threshold.
  • the console, or the one or more processors can be configured to perform, responsive to the second measurement being less than the second threshold, measurements of the primary link at first determined intervals.
  • the console, or the one or more processors can be configured to perform, responsive to a third measurement after the second measurement being less than the second threshold, additional measurements of the primary link at second determined intervals.
  • each of the second determined intervals can be greater than each of the first determined intervals.
  • the console, or the one or more processors can be configured to determine that a third measurement of the primary link is greater than a third threshold.
  • the third threshold can be greater than the second threshold and less than the first threshold.
  • the console, or the one or more processors can be configured to identify a first candidate beam for the primary link.
  • the console, or the one or more processors can be configured to determine a failure of the candidate beam.
  • the console, or the one or more processors can be configured to initiate a determined period to suspend search for a second candidate beam for the primary link.
  • the console, or the one or more processors can be configured to transition the traffic on the secondary link to the primary link using the first candidate beam, responsive to the third measurement being greater than the third threshold.
  • a non-transitory computer readable medium storing instructions.
  • the instructions when executed by one or more processors can cause the one or more processors to determine that a first measurement of a primary link between a console and a head wearable display is less than a first threshold.
  • the first measurement can correspond to a quality metric of the primary link.
  • the instructions when executed by one or more processors can cause the one or more processors to activate, responsive to the first measurement being less than the first threshold, a secondary link between the console and the head wearable display.
  • the instructions when executed by one or more processors can cause the one or more processors to determine whether a second measurement of the primary link between the console and the head wearable display is less than a second threshold.
  • the second threshold can be less than the first threshold.
  • the instructions when executed by one or more processors can cause the one or more processors to transition, when the second measurement is less than the second threshold, traffic on the primary link to the activated secondary link.
  • the instructions when executed by one or more processors can cause the one or more processors to select the primary link or the secondary link for the traffic between the console and the head wearable display according to a type of the traffic between the console and the head wearable display.
  • FIG. 1A is a block diagram of an embodiment of a system for selecting between a primary link and a secondary link for artificial reality applications, according to an example implementation of the present disclosure.
  • FIG. IB is a diagram of a head wearable display, according to an example
  • FIGs. 2A is a diagram of an inter- scheduling algorithm for selecting between a primary link and a secondary link for AR/VR applications, according to an example implementation of the present disclosure.
  • FIGs. 2B is a diagram of an inner decision loop for selecting between a primary link and a secondary link using link quality AR/VR applications, according to an example
  • FIGs. 3A-3E include a flow chart illustrating a process or method for selecting between a primary link and a secondary link for AR/VR applications, according to an example
  • FIG. 4 is a block diagram of a computing environment according to an example implementation of the present disclosure. DETAILED DESCRIPTION
  • Section A describes embodiments of devices, systems and methods for selecting between a primary link and a secondary link for AR/VR applications.
  • Section B describes embodiments of a computing system.
  • the subject matter of this disclosure is directed to secondary links for artificial reality (e.g., AR, VR, mixed reality (MR)) applications.
  • the application addresses a wireless AR/VR/MR configuration of a goggle/glass (or head wearable display) paired with a puck (or console), where transmissions are primarily between the goggle and the puck using a 60GHz wireless link (e.g., primary link).
  • a 60GHz wireless link e.g., primary link
  • the 60GHz link may be lost or severely degraded.
  • a secondary link can be activated and introduced to provide a certain level of minimum coverage as a back-up to the main 60GHz link.
  • the minimum coverage can include support for checking time, receiving text messages or emails, making/receiving a voice call, performing voice guidance/control, listening to online music, checking weather/stock information, for instance.
  • the secondary link can be configured to provide high availability and reliability (e.g., not require too much line-of- sight), provide sufficient range (e.g., 16mxl6m), and may be always-on (e.g., standby) or can be turned on and established quickly.
  • the secondary link can be low-power, low cost, and can support moderate-low throughput with good latency, e.g., for supporting basic texts and rendering, control commands, audio, and for controlling response, audio, etc.
  • the secondary link can comprise Bluetooth Classic, Bluetooth low energy (BLE), or low power WiFi. Based on the transmission rate, the option having an optimal power efficiency can be implemented.
  • One embodiment of the solution involves both the primary and the secondary link sharing a single WiFi/BT chip/device on the puck, assuming that there is a limited or acceptable level of competition for traffic bandwidth between both links.
  • Another embodiment can involve having a separate radio chip/device to support the secondary link, with BT being the preferred option to ensure good isolation from the main WiFi link.
  • the systems, devices and methods described herein can include an inter-scheduling algorithm to activate primary and second links, and to switch between these links.
  • the inter- scheduling algorithm can include or involve a 2 stage inter link switching and/or scheduling process, which includes an outer (or first) decision loop where the link is chosen or determined based on use case, e.g., choose primary link if full use case (e.g., supporting full AR experience) is required, and choose secondary link if only minimum use case is required.
  • inter-link scheduling can be based on link quality.
  • the system head wearable display and/or console
  • the system can bring up the secondary link if the primary link quality is still down, and can move traffic to the secondary link with reduced user experience.
  • Periodic measurement can be performed on the primary link, and switching can occur back to the primary link if the link condition of the primary link backs to a certain acceptable level.
  • the system 100 can include a console 102 and a head wearable display 130.
  • the head wearable display 130 e.g., goggle, glass, head mounted device
  • the console 102 e.g., puck
  • the user session can include a VR experience, AR experience or MR experience via the head wearable display 130.
  • the console 102 and/or the head wearable display 130 can determine to communicate through a primary link 108 and/or a secondary link 110 based in part of a type of use (e.g., type of traffic, priority of traffic) and/or a quality of link between the console 102 and the head wearable display 130.
  • a type of use e.g., type of traffic, priority of traffic
  • the artificial reality system environment 100 includes a head wearable display 130 worn by a user, and a console 102 providing content of artificial reality to the head wearable display 130.
  • the head wearable display 130 may detect its location and/or orientation of the head wearable display 130, and provide the detected location/or orientation of the head wearable display 130 to the console 102.
  • the console 102 may generate image data indicating an image of the artificial reality according to the detected location and/or orientation of the head wearable display 130 as well as a user input for the artificial reality, and transmit the image data to the head wearable display 130 for presentation.
  • the artificial reality system environment 100 includes more, fewer, or different components than shown in FIG. 1A.
  • functionality of one or more components of the artificial reality system environment 100 can be distributed among the components in a different manner than is described here.
  • some of the functionality of the console 102 may be performed by the head wearable display 130.
  • some of the functionality of the head wearable display 130 may be performed by the console 102.
  • the console 102 is integrated as part of the head wearable display 130.
  • Various components and elements of the artificial reality system 100 may be
  • the console 102 and head wearable display 130 may include or incorporate a computing system similar to the computing system 414 shown in FIG. 4 and subsequently described.
  • the console 102 and head wearable display 130 may include one or more processing unit(s) 416, storage 418, a network interface 420, user input device 422, and/or user output device 424.
  • the console 102 can include a computing system or WiFi device.
  • the console 102 can be implemented, for example, as a wearable computing device (e.g., smart watch, smart eyeglasses, head wearable display), smartphone, other mobile phone, device (e.g., consumer device), desktop computer, laptop computer, a virtual reality (VR) puck, a VR personal computer (PC), VR computing device, a head mounted device, or implemented with distributed computing devices.
  • the console 102 can be implemented to provide VR, augmented reality (AR), and/or mixed reality (MR) experience.
  • AR augmented reality
  • MR mixed reality
  • the console 102 can include conventional, specialized or custom computer components such as processors 104, a storage device 106, a network interface, a user input device, and/or a user output device. In embodiments, the console 102 may include some elements of the device shown in FIG. 4 and subsequently described.
  • the head wearable display 130 can include a computing system or WiFi device.
  • a head wearable display (HWD) may be referred to as, include, or be part of a head mounted display (HMD), head mounted device (HMD), head wearable device (HWD), head worn display (HWD) or head worn device (HWD).
  • the head wearable display 130 can be implemented, for example, as a wearable computing device (e.g., smart watch, smart eyeglasses, head wearable display), smartphone, other mobile phone, device (e.g., consumer device), desktop computer, laptop computer, a virtual reality (VR) puck, a VR personal computer (PC), VR computing device, a head mounted device, or implemented with distributed computing devices.
  • a wearable computing device e.g., smart watch, smart eyeglasses, head wearable display
  • smartphone other mobile phone
  • device e.g., consumer device
  • desktop computer laptop computer
  • VR virtual reality
  • PC VR personal computer
  • the head wearable display 130 can be implemented to provide VR, augmented reality (AR), and/or mixed reality (MR) experience to a user (e.g., wearing the display) of the head wearable display 130.
  • the head wearable display 130 can include conventional, specialized or custom computer components such as processors 104, a storage device 106, a network interface, a user input device, and/or a user output device.
  • the head wearable display 130 may include some elements of the device shown in FIG. 4 and
  • the console 102 and the head wearable display 130 can include one or more processors 104.
  • the one or more processors 104 can include any logic, circuitry and/or processing component (e.g., a microprocessor) for pre-processing input data for the console 102 and/or head wearable display 130, and/or for post-processing output data for the console 102 and/or head wearable display 130.
  • the one or more processors 104 can provide logic, circuitry, processing component and/or functionality for configuring, controlling and/or managing one or more operations of the console 102 and/or head wearable display 130.
  • a processor 104 may receive data and metrics, including but not limited to, one or more measurements 112 of a primary link 108 and/or secondary link 110 between the console 102 and the head wearable display 130.
  • the console 102 and head wearable display 130 can include a storage device 106.
  • the storage device 106 can be designed or implemented to store, hold or maintain any type or form of data associated with the console 102 and head wearable display 130.
  • the console 102 and the head wearable display 130 can store one or more measurements 112, thresholds 120 and quality metrics 124.
  • the storage device 106 can include a static random access memory (SRAM) or internal SRAM, internal to the console 102.
  • the storage device 106 can be included within an integrated circuit of the console 102.
  • the storage device 106 can include a memory (e.g., memory, memory unit, storage device, etc.).
  • the memory may include one or more devices (e.g., RAM, ROM, Flash memory, hard disk storage, etc.) for storing data and/or computer code for completing or facilitating the various processes, layers and modules described in the present disclosure.
  • the memory may be or include volatile memory or non-volatile memory, and may include database components, object code
  • the memory is communicably connected to the processor 104 via a processing circuit and includes computer code for executing (e.g., by the processing circuit and/or the processor) the one or more processes or methods (e.g., method 300) described herein.
  • the console 102 can establish one or more primary links 108 to the head wearable display 130.
  • the head wearable display 130 can establish one or more primary links 108 to the console 102.
  • the primary link 108 can include a connection (e.g., wireless connection), session (e.g., user and/or application session) and/or channel established between the console 102 and the head wearable display 130.
  • the primary link 108 can include a high capacity, low latency and power saving connection established between the console 102 and the head wearable display 130.
  • the primary link can include, but not limited to, a link using millimeter wave spectrum or frequency ranging from 30 GHz to 100 GHz.
  • the primary link 108 can include, but not limited to, a 60GHz frequency connection (e.g., 60 GHz WiFi, IEEE 802.1 lay/ad).
  • the primary link 108 can be used to provide or support a full VR experience, AR experience or MR experience for a user of the head wearable display 130.
  • the console 102 can establish one or more secondary links 110 to the head wearable display 130.
  • the head wearable display 130 can establish one or more secondary links 110 to the console 102.
  • the secondary link 110 can include a connection (e.g., wireless connection), session and/or channel established between the console 102 and the head wearable display 130.
  • the secondary link 110 can include a high availability, high reliability and/or low power consumption connection established between the console 102 and the head wearable display 130.
  • the secondary link 110 can be configured to provide sufficient range (e.g., 16mxl6m), and can be always-on (e.g., in at least standby mode) or can be turned on and established quickly.
  • the secondary link 110 can be configured to support moderate-low throughput with good latency.
  • the secondary link 110 can be activated for or used to support minimum use cases such as, but not limited to, checking time, receiving text messages or emails, making/receiving a voice call, performing voice
  • the secondary link 110 can be established using different forms of short-range wireless communications technologies including, but not limited to, Bluetooth (BT), Bluetooth low energy (BLE), and/or low power WiFi.
  • the secondary link 110 is based in part on properties of a connection or channel between the console 102 and the head wearable display 130.
  • the secondary link 110 can be established using BT for connection speeds in a range from 1 Megabits per second (Mbps) to 2 Mbps.
  • the secondary link 110 can be established using low power WiFi for connection speeds in a range from 2 Mbps to 10 Mbps.
  • the secondary link 110 can be established using 802.1 lax standards for connection speeds at or greater than 24 Mbps.
  • the console 102 and/or the head wearable display 130 can take or perform measurements 112 on the primary link 108 and/or the secondary link 110 to determine various characteristics or properties of the links (e.g., status, quality, level of traffic).
  • the measurements 112 can include a status measurement (e.g., on, off, activated), an availability of the respective link, a connection speed, a signal to noise ratio, a latency value, a power consumption value and/or a reliability of the respective link.
  • the measurements 112 can include a quality measurement of the respective link.
  • the console 102 and/or the head wearable display 130 can take or perform measurements 112 on the primary link 108 and/or the secondary link 110 to determine one or more quality metrics 124 for the primary link 108 and/or secondary link 110.
  • the quality metric 124 can include a signal to noise ratio and/or a modulation and coding scheme (MCS) value of the primary link 108 and/or secondary link 110 to determine if the quality of the respective link is greater than a particular threshold 120.
  • MCS modulation and coding scheme
  • the console 102 and/or head wearable display 130 can generate or establish one or more thresholds 120 to determine if a link can support a particular type of use and/or to verify a quality of the link. For example, in some embodiments, responsive to a measurement 112 of the primary link being less than a threshold 120, traffic between the console 102 and the head wearable display 130 can be transitioned from the primary link 108 to the secondary link 110. In some embodiments, responsive to a measurement 112 of the primary link being greater than a threshold 120, traffic between the console 102 and the head wearable display 130 can be transitioned from the secondary link 110 to the primary link 108.
  • the thresholds 120 can include or correspond to different quality metrics (e.g., signal to noise ratio values) of the primary link 108 or secondary link 110 to determine if the respective link can provide or support one or more different types of uses or levels of service to a user of the head wearable display 130.
  • the console 102 and/or head wearable display 130 can generate or establish a single threshold 120 or a plurality of thresholds 120.
  • the console 102 and/or head wearable display 130 can generate or establish one or more intervals 122.
  • the intervals 122 can include or correspond to a particular time period to take or perform measurements 112 of the primary link 108 and/or secondary link 110.
  • the intervals 122 can include a time period, a time range, and/or a time value.
  • the intervals 122 can include or correspond to a length of time or a duration between different measurements 112 and the intervals can have different time values.
  • a first determined interval 122 can be different (e.g., shorter time period, longer time period) from a second determined interval 122.
  • the primary link 108 and/or secondary link 110 can include one or more beams 114 (e.g., candidate beams 114) that correspond to a communication path (e.g., transmission path, signal path) between the console 102 and the head wearable display 130.
  • the console 102 and/or head wearable display 130 can select at least one beam 114 or candidate beam 114 from a plurality of available beams 114 to support the primary link 108 or the secondary link 110 between the console 102 and/or head wearable display 130.
  • the console 102 and/or head wearable display 130 can perform or use
  • beamforming to select at least one beam 114 or candidate beam 114 to support the primary link 108 or the secondary link 110 between the console 102 and/or head wearable display 130.
  • the console 102 can include one or more chips 116 to support the primary link 108 and the secondary link 110.
  • the chips 116 can include, but not limited to, an integrated circuit or radio frequency integrated circuit embedded or disposed within the console 102 to support the primary link 108 and the secondary link 110.
  • the primary link 108 and the secondary link 110 can share a functionality and/or processes of a single chip 116.
  • the console 102 can include a first chip 116 configured to support a WiFi connection and a BT connection at the console 102 for the primary link 108 and the secondary link 110, respectively.
  • the first chip can support an internet link and the secondary link 110 (e.g., intra-link connection) from the console 102.
  • the console 102 can include a first chip 116 to support the primary link 108 and a second, different chip 116 to support the secondary link 110.
  • the console 102 can include a first chip 116 configured to support a WiFi connection for the primary link 108 and a second chip 116 to support a BT connection for the secondary link 110.
  • the head wearable display 130 is an electronic component that can be worn by a user and can present or provide an artificial reality experience to the user.
  • the head wearable display 130 may render one or more images, video, audio, or some combination thereof to provide the artificial reality experience to the user.
  • audio is presented via an external device (e.g., speakers and/or headphones) that receives audio information from the head wearable display 130, the console 102, or both, and presents audio based on the audio information.
  • the head wearable display 130 includes sensors 142, eye trackers 144, a hand tracker 146, a communication interface 148, an image renderer 150, an electronic display 152, a lens 154, and a compensator 156.
  • the head wearable display 130 includes more, fewer, or different components than shown in FIG. 1A.
  • the sensors 142 include electronic components or a combination of electronic components and software components that detect a location and an orientation of the head wearable display 130.
  • the sensors 142 can include: one or more imaging sensors, one or more accelerometers, one or more gyroscopes, one or more magnetometers, or another suitable type of sensor that detects motion and/or location.
  • one or more accelerometers can measure translational movement (e.g., forward/back, up/down, left/right) and one or more gyroscopes can measure rotational movement (e.g., pitch, yaw, roll).
  • the sensors 142 detect the translational movement and the rotational movement, and determine an orientation and location of the head wearable display 130.
  • the sensors 142 can detect the translational movement and the rotational movement with respect to a previous orientation and location of the head wearable display 130, and determine a new orientation and/or location of the head wearable display 130 by accumulating or integrating the detected translational movement and/or the rotational movement. Assuming for an example that the head wearable display 130 is oriented in a direction 25 degrees from a reference direction, in response to detecting that the head wearable display 130 has rotated 20 degrees, the sensors 142 may determine that the head wearable display 130 now faces or is oriented in a direction 45 degrees from the reference direction.
  • the sensors 142 may determine that the head wearable display 130 is now located at a vector multiplication of the two feet in the first direction and the three feet in the second direction.
  • the eye trackers 144 include electronic components or a combination of electronic components and software components that determine a gaze direction of the user of the head wearable display 130.
  • the head wearable display 130, the console 102 or a combination of them may incorporate the gaze direction of the user of the head wearable display 130 to generate image data for artificial reality.
  • the eye trackers 144 include two eye trackers, where each eye tracker 144 captures an image of a corresponding eye and determines a gaze direction of the eye.
  • the eye tracker 144 determines an angular rotation of the eye, a translation of the eye, a change in the torsion of the eye, and/or a change in shape of the eye, according to the captured image of the eye, and determines the relative gaze direction with respect to the head wearable display 130, according to the determined angular rotation, translation and the change in the torsion of the eye.
  • the eye tracker 144 may shine or project a predetermined reference or structured pattern on a portion of the eye, and capture an image of the eye to analyze the pattern projected on the portion of the eye to determine a relative gaze direction of the eye with respect to the head wearable display 130.
  • the eye trackers 144 incorporate the orientation of the head wearable display 130 and the relative gaze direction with respect to the head wearable display 130 to determine a gate direction of the user.
  • the eye trackers 144 may determine that the gaze direction of the user is 20 degrees from the reference direction.
  • a user of the head wearable display 130 can configure the head wearable display 130 (e.g., via user settings) to enable or disable the eye trackers 144.
  • a user of the head wearable display 130 is prompted to enable or disable the eye trackers 144.
  • the hand tracker 146 includes an electronic component or a combination of an electronic component and a software component that tracks a hand of the user.
  • the hand tracker 146 includes or is coupled to an imaging sensor (e.g., camera) and an image processor that can detect a shape, a location and an orientation of the hand. The hand tracker 146 may generate hand tracking measurements indicating the detected shape, location and orientation of the hand.
  • the communication interface 148 includes an electronic component or a combination of an electronic component and a software component that communicates with the console 102.
  • the communication interface 148 may communicate with a communication interface 118 of the console 102 through a communication link.
  • the communication link may be a wireless link. Examples of the wireless link can include a cellular communication link, a near field communication link, Wi-Fi, Bluetooth, 60 GHz wireless link, or any communication wireless communication link.
  • the communication interface 148 may transmit to the console 102 data indicating the determined location and/or orientation of the head wearable display 130, the determined gaze direction of the user, and/or hand tracking measurement.
  • the communication interface 148 may receive from the console 102 image data indicating or corresponding to an image to be rendered and additional data associated with the image.
  • the image Tenderer 150 includes an electronic component or a combination of an electronic component and a software component that generates one or more images for display, for example, according to a change in view of the space of the artificial reality.
  • the image Tenderer 150 is implemented as a processor (or a graphical processing unit (GPU)) that executes instructions to perform various functions described herein.
  • the image Tenderer 150 may receive, through the communication interface 148, image data describing an image of artificial reality to be rendered and additional data associated with the image, and render the image through the electronic display 152.
  • the image data from the console 102 may be encoded, and the image Tenderer 150 may decode the image data to render the image.
  • the image Tenderer 150 receives, from the console 102 in additional data, object information indicating virtual objects in the artificial reality space and depth information indicating depth (or distances from the head wearable display 130) of the virtual objects.
  • object information indicating virtual objects in the artificial reality space
  • depth information indicating depth (or distances from the head wearable display 130) of the virtual objects.
  • the image Tenderer 150 may perform shading, reprojection, and/or blending to update the image of the artificial reality to correspond to the updated location and/or orientation of the head wearable display 130.
  • the image Tenderer 150 may generate a small portion (e.g., 10 %) of an image corresponding to an updated view within the artificial reality according to the updated sensor measurements, and append the portion to the image in the image data from the console 102 through reprojection.
  • the image Tenderer 150 may perform shading and/or blending on the appended edges. Hence, without recreating the image of the artificial reality according to the updated sensor measurements, the image Tenderer 150 can generate the image of the artificial reality.
  • the image Tenderer 150 receives hand model data indicating a shape, a location and an orientation of a hand model corresponding to the hand of the user, and overlay the hand model on the image of the artificial reality.
  • hand model may be presented as a visual feedback to allow a user to provide various interactions within the artificial reality.
  • the electronic display 152 is an electronic component that displays an image.
  • the electronic display 152 may, for example, be a liquid crystal display or an organic light emitting diode display.
  • the electronic display 152 may be a transparent display that allows the user to see through.
  • the electronic display 152 when the head wearable display 130 is worn by a user, the electronic display 152 is located proximate (e.g., less than 3 inches) to the user’s eyes.
  • the electronic display 152 emits or projects light towards the user’s eyes according to image generated by the image Tenderer 150.
  • the lens 154 is a mechanical component that alters received light from the electronic display 152.
  • the lens 154 may magnify the light from the electronic display 152, and correct for optical error associated with the light.
  • the lens 154 may be a Fresnel lens, a convex lens, a concave lens, a filter, or any suitable optical component that alters the light from the electronic display 152.
  • light from the electronic display 152 can reach the pupils, such that the user can see the image displayed by the electronic display 152, despite the close proximity of the electronic display 152 to the eyes.
  • the compensator 156 includes an electronic component or a combination of an electronic component and a software component that performs compensation to compensate for any distortions or aberrations.
  • the lens 154 introduces optical aberrations such as a chromatic aberration, a pin-cushion distortion, barrel distortion, etc.
  • the compensator 156 may determine a compensation (e.g., predistortion) to apply to the image to be rendered from the image Tenderer 150 to compensate for the distortions caused by the lens 154, and apply the determined compensation to the image from the image Tenderer 150.
  • the compensator 156 may provide the predistorted image to the electronic display 152.
  • the console 102 is an electronic component or a combination of an electronic component and a software component that provides content to be rendered to the head wearable display 130.
  • the console 102 includes a communication interface 118 and a content provider 128. These components may operate together to determine a view (e.g., a FOV of the user) of the artificial reality corresponding to the location of the head wearable display 130 and the gaze direction of the user of the head wearable display 130, and can generate image data indicating an image of the artificial reality corresponding to the determined view.
  • these components may operate together to generate additional data associated with the image. Additional data may be information associated with presenting or rendering the artificial reality other than the image of the artificial reality.
  • additional data examples include, hand model data, mapping information for translating a location and an orientation of the head wearable display 130 in a physical space into a virtual space (or simultaneous localization and mapping (SLAM) data), motion vector information, depth information, edge information, object information, etc.
  • the console 102 may provide the image data and the additional data to the head wearable display 130 for presentation of the artificial reality.
  • the console 102 includes more, fewer, or different components than shown in FIG. 1A.
  • the console 102 is integrated as part of the head wearable display 130.
  • the communication interface 118 is an electronic component or a combination of an electronic component and a software component that communicates with the head wearable display 130.
  • the communication interface 118 may be a counterpart component to the communication interface 148 to communicate with a communication interface 118 of the console 102 through a communication link (e.g., wireless link).
  • a communication link e.g., wireless link.
  • the communication interface 118 may receive from the head wearable display 130 data indicating the determined location and/or orientation of the head wearable display 130, the determined gaze direction of the user, and the hand tracking measurement.
  • the communication interface 118 may transmit to the head wearable display 130 image data describing an image to be rendered and additional data associated with the image of the artificial reality.
  • the content provider 128 can include or correspond to a component that generates content to be rendered according to the location and/or orientation of the head wearable display 130.
  • the content provider 128 may incorporate the gaze direction of the user of the head wearable display 130, and a user interaction in the artificial reality based on hand tracking measurements to generate the content to be rendered.
  • the content provider 128 determines a view of the artificial reality according to the location and/or orientation of the head wearable display 130. For example, the content provider 128 maps the location of the head wearable display 130 in a physical space to a location within an artificial reality space, and determines a view of the artificial reality space along a direction corresponding to the mapped orientation from the mapped location in the artificial reality space.
  • the content provider 128 may generate image data describing an image of the determined view of the artificial reality space, and transmit the image data to the head wearable display 130 through the communication interface 118.
  • the content provider 128 may also generate a hand model corresponding to a hand of a user of the head wearable display 130 according to the hand tracking measurement, and generate hand model data indicating a shape, a location, and an orientation of the hand model in the artificial reality space.
  • the content provider 128 may generate additional data including motion vector information, depth information, edge information, object information, hand model data, etc., associated with the image, and transmit the additional data together with the image data to the head wearable display 130 through the communication interface 118.
  • the content provider 128 may encode the image data describing the image, and can transmit the encoded data to the head wearable display 130.
  • the content provider 128 generates and provides the image data to the head wearable display 130 periodically (e.g., every 11 ms).
  • the communication interface 118 can adaptively transmit the additional data to the head wearable display 130 as described below with respect to FIGS. 2A through 4.
  • FIG. IB is a diagram 160 of a head wearable display 130, in accordance with an example embodiment.
  • the head wearable display 130 includes a front rigid body 162 and a band 164.
  • the front rigid body 162 includes the electronic display 152 (not shown in FIG. IB), the lens 154 (not shown in FIG. IB), the sensors 142, the eye trackers 144A, 144B, the communication interface 148, and the image Tenderer 150.
  • FIG. IB includes the electronic display 152 (not shown in FIG. IB), the lens 154 (not shown in FIG. IB), the sensors 142, the eye trackers 144A, 144B, the communication interface 148, and the image Tenderer 150.
  • the communication interface 148, the image Tenderer 150, and the sensors 142 are located within the front rigid body 162, and may not visible to the user.
  • the head wearable display 130 has a different configuration than shown in FIG. IB.
  • the communication interface 148, the image Tenderer 150, the eye trackers 144A, 144B, and/or the sensors 142 may be in different locations than shown in FIG. IB.
  • the console 102 can include or execute an inter-scheduling algorithm 126 to determine whether to use a primary link 108 or a secondary link 110 for a session between the console 102 and the head wearable display 130.
  • the console 102 can include or execute an inter- scheduling algorithm 126 to determine whether to activate and/or switch between the primary link 108 and secondary link 110, in response to a link quality of the primary link 108.
  • the inter- scheduling algorithm 126 can include a two- stage inter- link switching and scheduling process, having an outer/first decision loop 202 and an inner/second decision loop 204.
  • the outer/first decision loop 202 can for instance make a determination between the primary link 108 and the secondary link 110 based in part on a use case or type of use.
  • the console 102 can execute the outer decision loop 202 of the inter- scheduling algorithm 126 to select the primary link 108 for a full AR experience and select the secondary link 110 for a minimum use case.
  • the inner decision loop 204 can make a determination between the primary link 108 and the secondary link 110, e.g., on which link to use or switch to, based in part on a link quality (e.g., signal to noise ratio level) of the primary link 108.
  • the console 102 can execute the inner decision loop 204 of the inter- scheduling algorithm 126 to determine whether to activate the secondary link 110 and/or transition traffic to from the primary link 108 to the secondary link 110 in response to one or more measurements of the primary link 108 indicating a link quality of the primary link 108.
  • FIG. 2B a diagram 250 of multiple thresholds used during one example embodiment of the inner decision loop 204 of the inter- scheduling algorithm 126 is depicted.
  • the inner decision loop 204 can use or apply multiple thresholds 120 (e.g., quality thresholds, signal to noise ration thresholds) to monitor and verify a quality of the primary link 108.
  • the console 102 can execute the inner decision loop 204 by providing or communicating instruction(s) or message(s) based on and/or including one or more
  • the inter- scheduling algorithm 126 can determine whether the primary link 108 can support a current session between the console 102 and the head wearable display 130 by applying one or more thresholds 120 to the measurements 112 of the primary link 108.
  • the inner decision loop 204 can include four thresholds 120.
  • the inner decision loop 204 can include a first threshold 120 (Cl), a second threshold 120 (C2), a third threshold 120 (C3), and a fourth threshold 120 (C4).
  • the first threshold 120a can correspond to a quality metric or value/level that is greater than the second threshold 120 and the third threshold 120 and less than the fourth threshold 120.
  • the console 102 can compare a first measurement 112 of the primary link 108 to the first threshold 120 at a first time period to determine whether or not to activate a secondary link 110.
  • the second threshold 120 can correspond to a quality metric that is less than the first threshold 120, the third threshold 120 and the fourth threshold 120.
  • the console 102 can compare a second measurement 112 of the primary link 108 to the second threshold 120 at a second time period to determine whether or not to transition traffic from the primary link 108 to the secondary link 110.
  • the third threshold 120 can correspond to a quality metric that is greater than the second threshold 120 and less than the first threshold 120 and the fourth threshold 120.
  • the console 102 can compare a third measurement 112 of the primary link 108 to the third threshold 120 at a third time period to determine whether or not to transition traffic from the secondary link 110 to the primary link 108.
  • the fourth threshold 120 can correspond to a quality metric that is greater than the first threshold 120, the second threshold 120 and the third threshold 120.
  • the console 102 can compare a fourth measurement 112 of the primary link 108 to the fourth threshold 120 at a fourth time period to determine whether or not to transition all traffic to the primary link 108 and/or to de-activate the secondary link 110.
  • the number of thresholds 120 of the inner decision loop 204 can vary.
  • the inner decision loop 204 can include less than four thresholds 120 or more than four thresholds 120.
  • the method 300 can include one or more of: establishing a primary link (302), determining a type of use (304), selecting a type of link (306), performing measurements of a link (310), comparing the measurement to a first threshold (312), maintaining traffic on the primary link (314), activating a secondary link (316), performing measurements of a link (318), comparing the measurement to a second threshold (320), maintaining traffic on the primary link (322), transitioning traffic to the secondary link (324), performing periodic measurements (326), comparing the measurement to a third threshold (328), maintaining traffic on the secondary link (330), performing measurements at determined intervals (332), identifying a candidate beam (334), waiting a determined time period (336), , performing measurements of a link (338), comparing the measurement to a fourth threshold (340), maintaining traffic on the primary link (342), transitioning traffic to the primary link (344), and deactivating the secondary link (346
  • a primary link 108 can be established between a console 102 and a head wearable display 130.
  • the primary link 108 can be established by the console 102 or the head wearable display 130, for example, to provide at least one of a VR, AR, MR experience to a user of the head wearable display 130.
  • the primary link 108 can include one or more connections, sessions or channels established between the console 102 and the head wearable display 130.
  • the primary link 108 can include, but not limited to, a 60 GHz frequency connection (e.g., 60 GHZ WiFi, IEEE 802.1 lay/ad) between the console 102 and the head wearable display 130.
  • a type of use can be determined.
  • the console 102 and/or the head wearable display 130 can determine a type of use for the link between the console 102 and the head wearable display 130.
  • the console 102 can determine the type of content to be transmitted, a type of traffic, a use case and/or a type of VR/AR experience to be provided to a user.
  • the console 102 and/or head wearable display 130 can collect properties of a primary link 108 and/or secondary link 110 between the console 102 and the head wearable display 130.
  • the console 102 and/or head wearable display 130 can collect characteristics of a user of the head wearable display 130.
  • the console 102 and/or head wearable display 130 can receive an input from a user requesting a particular type of use or a type of VR/AR experience.
  • the user can request a full VR/AR experience or application or the user can request a limited type of use (e.g., messaging, checking time, making/receiving a voice call).
  • a link can be selected.
  • the console 102 can select the primary link 108 or the secondary link 110 for the traffic between the console 102 and the head wearable display 130 for instance according to a type of the traffic between the console 102 and the head wearable display 130.
  • the primary link 108 can be selected to carry traffic between the console 102 and the head wearable display 130. If the type of use or traffic corresponds to or includes a minimum use, partial VR/AR experience, or less than full VR/AR experience, the secondary link 110 can be selected to carry traffic between the console 102 and the head wearable display 130.
  • the console 102 can execute an inter- scheduling algorithm 126 to determine whether to use a primary link 108 or a secondary link 110 to transmit traffic (e.g., data, information) between the console 102 and the head wearable display 130.
  • the console 102 and/or head wearable display 130 can provide one or more inputs (e.g., type of use, user, type of traffic) to the inter-scheduling algorithm, and can execute the inter-scheduling algorithm to determine whether to use the primary link 108 or secondary link 110 for a particular type of use and/or type of traffic.
  • 302 and 304 of method 300 can correspond to an outer/first decision loop 202 of the inter-scheduling algorithm 126 and 31-348 of method 300 can correspond to an inner/second decision loop 204 of the inter- scheduling algorithm 126.
  • the console 102 and/or head wearable display 130 can provide one or more inputs (e.g., type of use, user, type of traffic) to the outer decision loop 202 of the inter-scheduling algorithm 126 and can execute the inter- scheduling algorithm 126 to determine whether to use the primary link 108 or secondary link 110 for a particular type of use.
  • the console 102 and/or head wearable display 130 can provide one or more inputs (e.g., type of use, user, type of traffic) to the inner/second decision loop 204 of the inter- scheduling algorithm 126 and execute the inter scheduling algorithm 126 to determine whether to use the primary link 108 or secondary link 110 based in part on a link quality of the primary link 108.
  • the console 102 can execute the inter-scheduling algorithm 126 and can select the primary link 108 or the secondary link 110 to transmit traffic (e.g., data, information) between the console 102 and the head wearable display 130 responsive to executing the inter-scheduling algorithm 126.
  • measurements of a link can be performed.
  • the console 102 and/or the head wearable display 130 can perform measurements 112 of a primary link 108 and can determine metrics (e.g., quality metrics 124) of the primary link 108 between the console 102 and the head wearable display 130.
  • the measurements 112 can be performed at a first time period or an initial time period to monitor the status and/or quality of the primary link 108.
  • the console 102 can perform measurements 112 on the primary link 108 to determine if the primary link 108 is active (e.g., turned on, turned off) and/or determine a current level of traffic on the primary link 108. In some embodiments, the console 102 can perform measurements 112 on the primary link 108 to determine a link quality of the primary link 108, such as but not limited to, a signal to noise ratio of the primary link 108.
  • the measurements can be compared to a first threshold.
  • the console 102 can compare the measurements 112 of the primary link 108 to a first threshold 120.
  • the first threshold 120 can include or correspond to a quality metric 124 of the primary link 108.
  • the console 102 can determine if the quality of the primary link 108 is greater than or less than a threshold 120.
  • the first threshold 120 can be used to determine if a secondary link should be activated or if the traffic between the console 102 and the head wearable display 130 can be supported by the primary link 108.
  • the traffic can be maintained on the primary link.
  • the console 102 can determine that the measurements of the primary link 108 are greater or higher than the first threshold 120 and can determine that the quality of the primary link 108 is strong (e.g., stable or good) enough to support the traffic between the console 102 and the head wearable display 130.
  • the console 102 can determine, responsive to the comparison, that the signal to noise ratio is high enough or strong enough to support the traffic (e.g., current traffic, current type of use) between the console 102 and the head wearable display 130 and maintain the traffic on the primary link 108.
  • the console 102 can maintain a secondary link 110 in a deactivated or turned off state.
  • the console 102 can turn off or not maintain a secondary link when the measurements 112 of the primary link 108 are greater than the first threshold 120.
  • the method 300 can retum/proceed to (310) and the console 102 can perform subsequent or additional measurements of the primary link 108 to continue to monitor the quality or status of the primary link 108.
  • a secondary link can be activated.
  • the console 102 can, responsive to the first measurement 112 being less than the first threshold 120, activate a secondary link 110 between the console 102 and the head wearable display 130.
  • the console 102 can determine that the measurements of the primary link 108 are less than the first threshold 120 and determine that the quality of the primary link 108 is decreasing such that the primary link 108 may not be strong enough to support the traffic between the console 102 and the head wearable display 130.
  • the console 102 can determine that the primary link 108 is experiencing or causing delays, service disruptions and/or failures for a user of the head wearable display 130.
  • the console 102 can determine, responsive to the comparison, that the signal to noise ratio is less than the first threshold (or a fourth threshold 120) and that the primary link 108 is experiencing difficulty or cannot support the traffic (e.g., current traffic, current type of use) between the console 102 and the head wearable display 130.
  • the console 102 can activate a secondary link 110 between the console 102 and the head wearable display 130.
  • the console 102 can configure the secondary link 110 and can place the secondary link 110 on standby such that the secondary link 110 is activated (e.g., established) and not carrying or supporting the traffic between the console 102 and the head wearable display 130.
  • the console 102 and/or head wearable display 130 can generate and/or provide an indication or message to the user of the head wearable display 130 that the secondary link 110 has been activated.
  • measurements of a link can be performed.
  • the console 102 and/or the head wearable display 130 can perform measurements 112 of the primary link 108 to continue to monitor the status or quality of the primary link 108.
  • the console 102 can perform the measurements 112 at a second time period or subsequent to first or initial measurements 112 of the primary link 108.
  • the console 102 can perform measurements 112 on the primary link 108 to determine if the quality of the primary link 108 is greater than or less than a second threshold 120.
  • the measurements can be compared to a second threshold.
  • the console 102 can determine whether a second measurement 112 (e.g., value(s) of measured quality metric(s)) of the primary link 108 between the console 102 and the head wearable display 130 is less than a second threshold 120.
  • the second threshold 120 can be less than the first threshold 120.
  • the second threshold 120 can include or correspond to a value or level (e.g., a quality metric 124 of the primary link 108) that is less than the first threshold 120.
  • the console 102 can determine if the quality of the primary link 108 has decreased from the first measurement using the second threshold 120.
  • the second threshold 120 can be used to determine if traffic should be transitioned to the secondary link 110 from the primary link 108.
  • the traffic can be maintained on the primary link.
  • the console 102 can maintain the traffic on the primary link 108 when the second measurement 112 is greater than the second threshold 120.
  • the console 102 can determine that the second or subsequent measurements 112 of the primary link 108 are greater than the second threshold 120 and may determine that the quality of the primary link 108 can support the traffic between the console 102 and the head wearable display 130.
  • the console 102 can maintain the traffic on the primary link 108 and can maintain the secondary link 110 on standby (e.g., active, no traffic).
  • the console 102 can determine, responsive to the comparison, that the signal to noise ratio is high enough or strong enough to support the traffic (e.g., current traffic, current type of use) between the console 102 and the head wearable display 130 and maintain the secondary link 110 on standby.
  • the method 300 can return to (318) and the console 102 can perform subsequent or additional measurements of the primary link 108 to continue to monitor the quality or status of the primary link 108.
  • traffic can be transitioned to a secondary link.
  • the console 102 can transition, when the second measurement 112 is less than the second threshold 120, traffic on the primary link 108 to the activated secondary link 110.
  • the console 102 can determine that the measurements of the primary link 108 are less than the second threshold 120 and can determine that the quality of the primary link 108 is not strong (e.g., stable, good) enough to support the traffic between the console 102 and the head wearable display 130.
  • the console 102 can determine, responsive to the comparison, that the signal to noise ratio is less than the second threshold 120 and that the primary link 108 is experiencing difficulty or cannot support the traffic (e.g., current traffic, current type of use) between the console 102 and the head wearable display 130.
  • the console 102 can begin transitioning or moving traffic from the primary link 108 to the secondary link 110 between the console 102 and the head wearable display 130.
  • the console 102 can transition some or all of the traffic between the console 102 and the head wearable display 130 to the secondary link in some embodiments.
  • the console 102 can use the secondary link 110 to transmit subsequent data and information between the console 102 and the secondary link 110 received after the comparison.
  • the console 102 can for instance transition or move a portion (e.g., half, determined percentage) of the traffic to the secondary link 110, to transmit subsequent data and information between the console 102 and the head wearable display 130 received after the comparison.
  • the console 102 can transition all of the traffic between the console 102 and the head wearable display 130 to the secondary link 110 responsive to the second measurement 112 being less than the second threshold 120.
  • the console 102 can provide an indication, message or command to the head wearable display 130 to inform or instruct the head wearable display 130 to use the secondary link 110 to transmit data.
  • the console 102 and/or head wearable display 130 can generate and provide an indication or message to the user of the head wearable display 130 that traffic has been, is being or will be transitioned to the secondary link 110 from the primary link 108.
  • periodic measurements of the primary link can be performed.
  • the console 102 can perform, responsive to the second measurement 112 being less than the second threshold 120, measurements 112 of the primary link 108 at first determined intervals 122 or perform periodic measurements 112.
  • the console 102 can monitor the primary link 108 by taking periodic measurements on the primary link 108 to determine when the quality of the primary link 108 increases.
  • the measurements 112 can be performed at determined intervals or time periods.
  • the periodic measurements 112 can be performed at evenly spaced or regularly occurring intervals such that a length of time between a first two measurements and subsequent measurements is equal.
  • the console 102 can determine a length or time between measurements 112 (e.g., time between a first measurement and a second measurement) based in part on the signal to noise ratio of the primary link 108 at a previous measurement 112. For example, the console 102 can increase a frequency (e.g., more often) or decrease the length of time between measurements 112 if the console 102 determines that the quality of the primary link 108 is increasing and/or within a determined distance from a threshold 120. In some embodiments, the console 102 can decrease a frequency (e.g., less often) or increase the length of time between measurements 112 if the console 102 determines that the quality of the primary link 108 is decreasing and/or outside a determined distance from a threshold 120.
  • a frequency e.g., more often
  • the console 102 can decrease a frequency (e.g., less often) or increase the length of time between measurements 112 if the console 102 determines that the quality of the primary link 108 is decreasing and/or outside a
  • measurements 112 can be compared to a third threshold 120.
  • the console 102 can determine whether a third or subsequent
  • the third threshold 120 can be less than the first threshold 120 and greater than the second threshold 120.
  • the third threshold 120 can include or correspond to a quality metric 124 of the primary link 108 indicating that the quality of the primary link 108 is increasing (e.g., when greater than the third threshold 120) or decreasing (e.g., when less than the third threshold 120).
  • the console 102 can use the third threshold 120 to determine if traffic can be transitioned back to the primary link 108 or if the traffic should be maintained on the secondary link 110.
  • the traffic can be maintained on the secondary link.
  • the console 102 can determine that the third or subsequent measurements 112 of the primary link 108 are less than the third threshold 120 and may determine that the quality of the primary link 108 cannot support the traffic between the console 102 and the head wearable display 130.
  • the console 102 can maintain the traffic on the secondary link 110, e.g., responsive to the determination.
  • the console 102 can determine, responsive to the comparison, that the signal to noise ratio of the primary link 108 is less than the third threshold 120.
  • the console 102 can perform, responsive to a third measurement 112 after the second measurement 112 being less than the second threshold, additional measurements of the primary link 108 at second determined intervals 122.
  • the second determined intervals 122 can be greater (e.g., longer duration between measurements) than each of the first determined intervals 122.
  • the method 300 can return/proceed to (326) and the console 102 can perform subsequent or additional measurements of the primary link 108 to continue to monitor the quality or status of the primary link 108.
  • measurements of the primary link can be performed at determined intervals.
  • the console 102 can determine that a third measurement 112 of the primary link 108 is greater than a third threshold 120.
  • the third threshold 120 can be greater than the second threshold 120 and less than the first threshold 120.
  • the console 102 can determine, responsive to the comparison, that the third or subsequent measurement 112 of the primary link 108 is greater than the third threshold and that the quality of the primary link 108 has improved or increased since the second or previous measurement 112.
  • the console 102 can initiate taking measurements 112 of the primary link 108 at determined intervals 122.
  • the console 102 and/or head wearable display 130 can wake up at the determined intervals and perform a measurement of the primary link 108.
  • the determined intervals 122 can be the same or modified. In some embodiments, the determined intervals 122 can be equal such that a length of time between a first two
  • the console 102 can perform measurements at first determined intervals 122 for a first time period and at second determined intervals 122 for a second or subsequent time period.
  • the first determined intervals 122 can be different (e.g., less time, more time) than the second determined intervals 122.
  • the console 102 can determine a length of a determined interval 122 based in part on the signal to noise ratio of the primary link 108 at a previous measurement 112. For example, the console 102 can increase a frequency (e.g., more often) or decrease the length of time between measurements 112 if the console 102 determines that the quality of the primary link 108 is increasing and/or within a determined distance from a threshold 120.
  • the console 102 can decrease a frequency (e.g., less often) or increase the length of time between measurements 112 if the console 102 determines that the quality of the primary link 108 is decreasing and/or outside a determined distance from a threshold 120.
  • the console 102 can use or apply exponential backoff to determine a length of time for the determined intervals 122.
  • the console 102 can multiplicatively decrease (or increase) the rate or frequency at which the measurements 112 of the primary link 108 occur such that a first determined interval 122 is different from a second, subsequent interval 122.
  • the console 102 can determine whether a signal to noise ratio of the primary link 108 is greater than the third threshold 120 during the measurements 112 at the determined intervals 122.
  • the console 102 can monitor the primary link 108 by taking measurements 112 at the determined intervals 122 to determine if the primary link 108 is ready to support a session between the console 102 and the head wearable display 130, or if the third measurement 112 being greater than the third threshold 120 corresponds to a false or inaccurate measurement 112.
  • a candidate beam can be identified.
  • the console 102 can determine that the third or subsequent measurement 112 of the primary link 108 is greater than the third threshold 120 and can identify a candidate beam 114 to establish or use for the primary link 108.
  • the candidate beam 114 can correspond to at least one beam or signal path between the console 102 and the head wearable display 130 having a signal to noise ratio that is greater than the third threshold 120.
  • the console 102 can select at least one beam 114 having a highest signal to noise ratio out of the plurality of beams 114 that have a signal to noise ratio greater than the third threshold 120.
  • the console 102 can attempt to establish a connection using the candidate beam 114.
  • a connection using the candidate beam can fail (e.g., to adequately support traffic, for instance due to an unstable connection, changed conditions, dropped packets, and/or otherwise).
  • the console 102 can determine a failure of the candidate beam 114 and can initiate a determined period to suspend search for a second candidate beam 114 for the primary link 108.
  • the console 102 can attempt to establish a connection using the candidate beam 114 and the connection may fail or the beam 114 may not be able to support the primary link 108.
  • the console 102 can determine that the candidate beam 114 is not able to support the primary link 108, and/or that the third
  • the console 102 can determine or be configured to wait a determined time period for perform subsequent measurements 112 (e.g., corresponding to a forbidden time period). The length of the determined time period or wait period can vary and be selected based in part on one or more measurements 112 of the primary link 108. The console 102 can select a length of time or duration for the determined time period (e.g., wait period) and may stop performing measurements 112 of the primary link 108 during the determined time period. When the determined time period is over or complete, the console 102 can return/proceed to (332) and can perform measurements 112 at the determined intervals 122.
  • a determined time period for perform subsequent measurements 112 (e.g., corresponding to a forbidden time period).
  • the length of the determined time period or wait period can vary and be selected based in part on one or more measurements 112 of the primary link 108.
  • the console 102 can select a length of time or duration for the determined time period (e.g., wait period) and may stop performing measurements 112 of
  • the console 102 can establish a connection using the candidate beam 114 for the primary link 108.
  • the console 102 can use the beam 114 or signal path to re-start and/or to reconfigure (e.g., reconfigure properties of) the primary link 108 between the console 102 and the head wearable display 130.
  • the console 102 can modify one or more properties of the primary link 108 to re-establish or reconnect the primary link 108 between the console 102 and the head wearable display 130 using the beam 114 or signal path.
  • the console 102 can transition the traffic on the secondary link 110 to the primary link 108 responsive to the third measurement 112 being greater than the third threshold 120. For example, the console 102 can determine that the primary link 108 can support a user session between the console 102 and the head wearable display 130 and can begin transitioning traffic from the secondary link 110 to the primary link 108. The console 102 can transition, when the third or subsequent measurement 112 is greater than the third threshold 120, traffic on the secondary link 110 to the primary link 108. The console 102 can transition some or all of the traffic between the console 102 and the head wearable display 130 to the primary link 108. For example, the console 102 can use the primary link 108 to transmit subsequent data and information between the console 102 and the head wearable display 130. The console 102 can transition or move a portion (e.g., half, determined percentage) of the traffic to the primary link 108 to transmit subsequent data and information between the console 102 and the head wearable display 130.
  • a portion e.g., half, determined percentage
  • measurements of a link can be performed.
  • the console 102 and/or the head wearable display 130 can perform measurements 112 of the primary link 108 to continue to monitor the status or quality of the primary link 108.
  • the console 102 can perform the measurements 112 at a fourth time period or subsequent to a third or previous measurements 112 of the primary link 108.
  • the console 102 can perform measurements 112 on the primary link 108 to determine if the quality of the primary link 108 is greater than or less than a fourth threshold 120.
  • the measurements can be compared to a fourth threshold.
  • the console 102 can determine whether a fourth or subsequent measurement 112 of the primary link 108 between the console 102 and the head wearable display 130 is greater than or less than a fourth threshold 120.
  • the fourth threshold 120 can be greater than the first, second and third thresholds 120.
  • the fourth threshold 120 can include or correspond to a value or level (e.g., a quality metric 124 of the primary link 108) that is greater than the first threshold 120.
  • the fourth threshold 120 can be used to determine if secondary link 110 can be deactivated or turned off.
  • the traffic can be maintained on the secondary link 108.
  • the console 102 can determine that the fourth or subsequent measurement 112 of the primary link 108 is less than the fourth threshold 120. In some embodiments, the console 102 can determine that a signal to noise ratio of the primary link 108 at the fourth time period is less than the fourth threshold 120.
  • the console 102 can (e.g., responsive to the determination) maintain the traffic between the console 102 and the head wearable display 130 on the secondary link 110. In some embodiments, the console 102 can (e.g., responsive to the determination) maintain a portion of the traffic between the console 102 and the head wearable display 130 on the primary link 108 and maintain the secondary link 110 on standby.
  • the traffic can be transitioned to the primary link 108.
  • the console 102 can determine that the fourth or subsequent measurement 112 of the primary link 108 is greater than the fourth threshold 120. In some embodiments, the console 102 can determine that a signal to noise ratio of the primary link 108 at the fourth time period is greater than the fourth threshold 120.
  • the console 102 can determine if any traffic is still being supported by the secondary link 110 and may transition all traffic to the primary link 108 such that the primary link 108 fully supports one or more user sessions between the console 102 and the head wearable display 130.
  • the console 102 can transmit an indication, message or command to the head wearable display 130 to stop using the secondary link 110.
  • the secondary link can be deactivated.
  • the console 102 can de-activate the secondary link 110 responsive to a fourth measurement 112 being greater than a fourth threshold 120.
  • the fourth threshold 120 can be greater than the first threshold 120.
  • the console 102 can turn off or de-activate (e.g., disconnect, dis-establish) the secondary link 110 between the console 102 and the head wearable display 130.
  • the console 102 can check or verify that the secondary link 110 is no longer supporting traffic between the console 102 and the head wearable display 130, and can turn off the secondary link 110.
  • the console 102 can change a status of the secondary link 110 from standby to de-activated such that the secondary link 110 is no longer available to transmit traffic between the console 102 and the head wearable display 130.
  • the console 102 and/or head wearable display 130 can generate and provide an indication or message to the user of the head wearable display 130 that the secondary link 110 has been de-activated or turned off.
  • the method 300 can return to (304) to continue to monitor the quality of the primary link 108 during one or more user sessions between the console 102 and the head wearable display 130.
  • FIG. 4 shows a block diagram of a representative computing system 414 usable to implement the present disclosure.
  • the console 102 and head wearable display 130 of FIGs. 1A-1B are implemented by the computing system 414.
  • Computing system 414 can be implemented, for example, as a consumer device such as a smartphone, other mobile phone, tablet computer, wearable computing device (e.g., smart watch, eyeglasses, head wearable display), desktop computer, laptop computer, or implemented with distributed computing devices.
  • the computing system 414 can be implemented to provide VR, AR, MR experience.
  • the computing system 414 can include conventional computer components such as processors 416, storage device 418, network interface 420, user input device 422, and user output device 424.
  • Network interface 420 can provide a connection to a wide area network (e.g., the Internet) to which WAN interface of a remote server system is also connected.
  • Network interface 420 can include a wired interface (e.g., Ethernet) and/or a wireless interface
  • RF data communication standards such as Wi-Fi, Bluetooth, or cellular data network standards (e.g., 3G, 4G, 5G, 60 GHz, LTE, etc.).
  • cellular data network standards e.g., 3G, 4G, 5G, 60 GHz, LTE, etc.
  • User input device 422 can include any device (or devices) via which a user can provide signals to computing system 414; computing system 414 can interpret the signals as indicative of particular user requests or information.
  • User input device 422 can include any or all of a keyboard, touch pad, touch screen, mouse or other pointing device, scroll wheel, click wheel, dial, button, switch, keypad, microphone, sensors (e.g., a motion sensor, an eye tracking sensor, etc.), and so on.
  • User output device 424 can include any device via which computing system 414 can provide information to a user.
  • user output device 424 can include a display to display images generated by or delivered to computing system 414.
  • the display can incorporate various image generation technologies, e.g., a liquid crystal display (LCD), light-emitting diode (LED) including organic light-emitting diodes (OLED), projection system, cathode ray tube (CRT), or the like, together with supporting electronics (e.g., digital-to-analog or analog-to- digital converters, signal processors, or the like).
  • a device such as a touchscreen that function as both input and output device can be used.
  • Output devices 424 can be provided in addition to or instead of a display. Examples include indicator lights, speakers, tactile“display” devices, printers, and so on.
  • Some implementations include electronic components, such as microprocessors, storage and memory that store computer program instructions in a computer readable storage medium. Many of the features described in this specification can be implemented as processes that are specified as a set of program instructions encoded on a computer readable storage medium.
  • processors When these program instructions are executed by one or more processors, they cause the processors to perform various operation indicated in the program instructions. Examples of program instructions or computer code include machine code, such as is produced by a compiler, and files including higher-level code that are executed by a computer, an electronic component, or a microprocessor using an interpreter.
  • processor 416 can provide various functionality for computing system 414, including any of the functionality described herein as being performed by a server or client, or other functionality associated with message management services.
  • computing system 414 is illustrative and that variations and modifications are possible. Computer systems used in connection with the present disclosure can have other capabilities not specifically described here. Further, while computing system 414 is described with reference to particular blocks, it is to be understood that these blocks are defined for convenience of description and are not intended to imply a particular physical arrangement of component parts. For instance, different blocks can be located in the same facility, in the same server rack, or on the same motherboard. Further, the blocks need not correspond to physically distinct components. Blocks can be configured to perform various operations, e.g., by programming a processor or providing appropriate control circuitry, and various blocks might or might not be reconfigurable depending on how the initial configuration is obtained.
  • Implementations of the present disclosure can be realized in a variety of apparatus including electronic devices implemented using any combination of circuitry and software.
  • DSP digital signal processor
  • ASIC application specific integrated circuit
  • FPGA field programmable gate array
  • a general purpose processor may be a microprocessor, or, any conventional processor, controller, microcontroller, or state machine.
  • a processor also may be implemented as a combination of computing devices, such as a combination of a DSP and a microprocessor, a plurality of microprocessors, one or more microprocessors in conjunction with a DSP core, or any other such configuration.
  • particular processes and methods may be performed by circuitry that is specific to a given function.
  • the memory e.g., memory, memory unit, storage device, etc.
  • the memory may include one or more devices (e.g., RAM, ROM, Flash memory, hard disk storage, etc.) for storing data and/or computer code for completing or facilitating the various processes, layers and modules described in the present disclosure.
  • the memory may be or include volatile memory or non- volatile memory, and may include database components, object code components, script components, or any other type of information structure for supporting the various activities and information structures described in the present disclosure.
  • the memory is communicably connected to the processor via a processing circuit and includes computer code for executing (e.g., by the processing circuit and/or the processor) the one or more processes described herein.
  • the present disclosure contemplates methods, systems and program products on any machine-readable media for accomplishing various operations.
  • the embodiments of the present disclosure may be implemented using existing computer processors, or by a special purpose computer processor for an appropriate system, incorporated for this or another purpose, or by a hardwired system.
  • Embodiments within the scope of the present disclosure include program products comprising machine-readable media for carrying or having machine-executable instructions or data structures stored thereon.
  • Such machine-readable media can be any available media that can be accessed by a general purpose or special purpose computer or other machine with a processor.
  • machine-readable media can comprise RAM, ROM, EPROM, EEPROM, or other optical disk storage, magnetic disk storage or other magnetic storage devices, or any other medium which can be used to carry or store desired program code in the form of machine-executable instructions or data structures and which can be accessed by a general purpose or special purpose computer or other machine with a processor. Combinations of the above are also included within the scope of machine-readable media.
  • Machine-executable instructions include, for example, instructions and data which cause a general purpose computer, special purpose computer, or special purpose processing machines to perform a certain function or group of functions.
  • references in the singular or plural form are not intended to limit the presently disclosed systems or methods, their components, acts, or elements to single or plural configurations. References to any act or element being based on any information, act or element can include implementations where the act or element is based at least in part on any information, act, or element.
  • implementation can be included in at least one implementation or embodiment. Such terms as used herein are not necessarily all referring to the same implementation. Any implementation can be combined with any other implementation, inclusively or exclusively, in any manner consistent with the aspects and implementations disclosed herein.
  • Coupled elements can be electrically, mechanically, or physically coupled with one another directly or with intervening elements. Scope of the systems and methods described herein is thus indicated by the appended claims, rather than the foregoing description, and changes that come within the meaning and range of equivalency of the claims are embraced therein.
  • the term“coupled” and variations thereof includes the joining of two members directly or indirectly to one another. Such joining may be stationary (e.g., permanent or fixed) or moveable (e.g., removable or releasable).
  • Such joining may be achieved with the two members coupled directly with or to each other, with the two members coupled with each other using a separate intervening member and any additional intermediate members coupled with one another, or with the two members coupled with each other using an intervening member that is integrally formed as a single unitary body with one of the two members.
  • additional term e.g., directly coupled
  • the generic definition of“coupled” provided above is modified by the plain language meaning of the additional term (e.g.,“directly coupled” means the joining of two members without any separate intervening member), resulting in a narrower definition than the generic definition of“coupled” provided above.
  • Such coupling may be mechanical, electrical, or fluidic.
  • references to“or” can be construed as inclusive so that any terms described using“or” can indicate any of a single, more than one, and all of the described terms.
  • a reference to“at least one of‘A’ and‘B’” can include only‘A’, only‘B’, as well as both‘A’ and‘B’.
  • Such references used in conjunction with“comprising” or other open terminology can include additional items.
  • references herein to the positions of elements are merely used to describe the orientation of various elements in the FIGURES.
  • the orientation of various elements may differ according to other exemplary embodiments, and that such variations are intended to be encompassed by the present disclosure.

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Security & Cryptography (AREA)
  • Optics & Photonics (AREA)
  • Human Computer Interaction (AREA)
  • General Engineering & Computer Science (AREA)
  • Computer Hardware Design (AREA)
  • User Interface Of Digital Computer (AREA)
  • Controls And Circuits For Display Device (AREA)
  • Mobile Radio Communication Systems (AREA)

Abstract

L'invention concerne un système, un procédé et un dispositif de sélection entre une liaison primaire et une liaison secondaire servant à des applications AR/VR. Une console peut fournir une session VR/AR à un utilisateur par l'intermédiaire d'un dispositif d'affichage pouvant être porté sur la tête. La console peut déterminer qu'une première mesure d'une liaison primaire entre la console et un dispositif d'affichage pouvant être porté sur la tête est inférieure à un premier seuil. La première mesure peut comprendre une mesure de qualité de la liaison primaire. La console peut activer une liaison secondaire entre la console et le dispositif d'affichage pouvant être porté. La console peut déterminer si une seconde mesure de la liaison primaire entre la console et le dispositif d'affichage pouvant être porté est inférieure à un second seuil. Quand la seconde mesure est inférieure au second seuil, la console peut effectuer une transition du trafic sur la liaison primaire vers la liaison secondaire activée.
EP20715992.2A 2019-03-08 2020-02-27 Liaison secondaire servant à des applications ar/vr Withdrawn EP3935877A1 (fr)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US201962815849P 2019-03-08 2019-03-08
US16/773,515 US11452014B2 (en) 2019-03-08 2020-01-27 Secondary link for AR/VR applications
PCT/US2020/020017 WO2020185410A1 (fr) 2019-03-08 2020-02-27 Liaison secondaire servant à des applications ar/vr

Publications (1)

Publication Number Publication Date
EP3935877A1 true EP3935877A1 (fr) 2022-01-12

Family

ID=72335815

Family Applications (1)

Application Number Title Priority Date Filing Date
EP20715992.2A Withdrawn EP3935877A1 (fr) 2019-03-08 2020-02-27 Liaison secondaire servant à des applications ar/vr

Country Status (6)

Country Link
US (2) US11452014B2 (fr)
EP (1) EP3935877A1 (fr)
JP (1) JP2022522583A (fr)
KR (1) KR20210137126A (fr)
CN (1) CN113545112A (fr)
WO (1) WO2020185410A1 (fr)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2024032906A1 (fr) * 2022-08-12 2024-02-15 Telefonaktiebolaget Lm Ericsson (Publ) Mise à jour de topologie dynamique sensible à une application

Family Cites Families (18)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE10139155C2 (de) * 2001-08-09 2003-07-24 Siemens Ag Signalisierungs-Proxy-Einrichtung zum automatischen Aufbau von Ersatzpfaden in optischen Netzen
JP2006527519A (ja) * 2003-06-06 2006-11-30 コーニンクレッカ　フィリップス　エレクトロニクス　エヌ　ヴィ 短距離無線技術と長距離無線技術とを切り替えることにより無線データ伝送を制御する方法
US8897152B1 (en) * 2011-08-30 2014-11-25 Amazon Technologies, Inc. System and method for minimizing network transition latencies while minimizing power consumption
GB2500410A (en) * 2012-03-21 2013-09-25 Renesas Mobile Corp Swapping an actual channel on a secondary link with a shadow channel on a primary link with when the secondary link is no longer available
US9521601B2 (en) * 2013-02-01 2016-12-13 Apple Inc. Management of multiple radio links for wireless peer-to-peer communication
US9063330B2 (en) * 2013-05-30 2015-06-23 Oculus Vr, Llc Perception based predictive tracking for head mounted displays
US9591497B2 (en) * 2014-05-30 2017-03-07 Apple Inc. Wireless link quality monitoring
KR20160003450A (ko) * 2014-07-01 2016-01-11 삼성전자주식회사 전자장치의 데이터를 공유하기 위한 방법 및 장치
US10098016B2 (en) * 2015-01-22 2018-10-09 Qualcomm Incorporated Adaptive scanning with multi-radio device
US9787579B2 (en) * 2015-04-06 2017-10-10 Verizon Digital Media Services Inc. Application controlled path selection based on type-of-service
KR20160141560A (ko) 2015-06-01 2016-12-09 삼성전기주식회사 무선 통신 장치 및 이를 이용한 운용 방법
US9832716B2 (en) * 2015-08-12 2017-11-28 Google Llc Switching between networks based on quality of available networks
US10129919B2 (en) 2016-10-20 2018-11-13 Plantronics, Inc. Video headset
US9866286B1 (en) * 2017-02-15 2018-01-09 Oculus Vr, Llc Positional tracking assisted beam forming in wireless virtual reality systems
KR102606976B1 (ko) * 2017-02-15 2023-11-29 삼성전자주식회사 전자 장치 및 전자 장치의 이미지 데이터 송수신 방법
US10433307B2 (en) * 2017-04-20 2019-10-01 Facebook Technologies, Llc Diversity based relay for wireless communications between a head-mounted display and a console
CN109246732B (zh) * 2017-04-28 2020-05-15 维沃移动通信有限公司 波束失败恢复方法和终端
US10531344B2 (en) * 2018-05-24 2020-01-07 Verizon Patent And Licensing Inc. Radio access technology change reporting

Also Published As

Publication number Publication date
JP2022522583A (ja) 2022-04-20
KR20210137126A (ko) 2021-11-17
WO2020185410A1 (fr) 2020-09-17
CN113545112A (zh) 2021-10-22
US11930411B2 (en) 2024-03-12
US20200288360A1 (en) 2020-09-10
US11452014B2 (en) 2022-09-20
US20230016201A1 (en) 2023-01-19

Similar Documents

Publication Publication Date Title
US11882552B2 (en) Switching between different communication protocols
US11678324B2 (en) Systems and methods for dynamic scheduling
US20240323844A1 (en) Systems and methods for quiet element in twt for wireless communication
US20220247513A1 (en) Systems and methods for beamforming
US11930411B2 (en) Secondary link for AR/VR applications
US20230064582A1 (en) Interference mitigation through sinr-based iterative distributed beam selection
US20230254768A1 (en) Power management of receiver chain circuits based on traffic awareness
US12081281B2 (en) Systems and methods for managing energy detection thresholds
US12035236B2 (en) Systems and methods for quiet element in TWT for wireless communication
US20240314877A1 (en) Methods and systems for low power reconnection
WO2023154300A1 (fr) Gestion de puissance de circuits de chaîne de récepteur sur la base de la connaissance du trafic
TW202415111A (zh) 在動態頻率選擇(dfs)頻道中的子群組無線操作
WO2023177653A1 (fr) Systèmes et procédés d'utilisation d'une liaison montante supplémentaire

Legal Events

Date Code Title Description
STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: UNKNOWN

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE

PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE

17P Request for examination filed

Effective date: 20210915

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

DAV Request for validation of the european patent (deleted)
DAX Request for extension of the european patent (deleted)
STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: EXAMINATION IS IN PROGRESS

17Q First examination report despatched

Effective date: 20230131

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE APPLICATION IS DEEMED TO BE WITHDRAWN

18D Application deemed to be withdrawn

Effective date: 20230613