CN113824746A - Virtual reality information transmission method and virtual reality system - Google Patents
Virtual reality information transmission method and virtual reality system Download PDFInfo
- Publication number
- CN113824746A CN113824746A CN202111407867.5A CN202111407867A CN113824746A CN 113824746 A CN113824746 A CN 113824746A CN 202111407867 A CN202111407867 A CN 202111407867A CN 113824746 A CN113824746 A CN 113824746A
- Authority
- CN
- China
- Prior art keywords
- virtual reality
- host
- data
- time interval
- user
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/80—Responding to QoS
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T19/00—Manipulating 3D models or images for computer graphics
- G06T19/006—Mixed reality
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Computer Graphics (AREA)
- Computer Hardware Design (AREA)
- General Engineering & Computer Science (AREA)
- Software Systems (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Information Transfer Between Computers (AREA)
Abstract
The invention discloses a virtual reality information transmission method, which comprises the following steps: receiving, by a first virtual reality host, virtual reality image data sent by a virtual reality service provider server; receiving, by the second virtual reality host, virtual reality sound data transmitted by the virtual reality service provider server; after receiving the virtual reality image data, sending a first virtual reality data distribution message to the user wearing equipment by the first virtual reality host at a first time interval; after receiving the virtual reality image data, sending a second virtual reality data distribution message to the user wearing equipment by a second virtual reality host at a first time interval; after receiving the first virtual reality data distribution message and the second virtual reality data distribution message, the user wearing equipment judges whether the first virtual reality data resource and the third virtual reality data resource are overlapped in a frequency domain.
Description
Technical Field
The present invention relates to the field of virtual reality technologies, and in particular, to a virtual reality information transmission method and a virtual reality system.
Background
At present, virtual reality equipment has entered daily life, and experience projects based on virtual reality are started to be introduced from a plurality of large-scale shopping malls. Many current virtual reality experience projects need to send and receive information based on wired communication transmission, but wired communication transmission needs connection of cables, so the freedom of movement of users is greatly limited by the devices, and the user experience of the virtual reality projects is reduced. Many virtual reality devices based on wireless transmission have been proposed at present, and these virtual reality devices send sound and video signals to wearable devices through a host, and the requirement for the host is relatively high, because the host needs to process complex stereo signals and video signals simultaneously, when the host is not powerful enough, the problem of image and sound maladjustment or distortion may occur, even if the host is powerful enough, the coordination in terms of transmission resources between the two can be guaranteed by transmitting sound segments and image segments with what granularity, which also is a problem to be considered under the condition of a single host.
Disclosure of Invention
The invention aims to provide a virtual reality information transmission method and a virtual reality system.
In order to achieve the above object, the present invention provides a virtual reality information transmission method, which is characterized in that the virtual reality information transmission method comprises the following steps: receiving, by a first virtual reality host, virtual reality image data sent by a virtual reality service provider server; receiving, by the second virtual reality host, virtual reality sound data transmitted by the virtual reality service provider server; after receiving the virtual reality image data, sending a first virtual reality data allocation message to the user wearing equipment at a first time interval by a first virtual reality host, wherein the first virtual reality data allocation message allocates a first virtual reality data resource and a second virtual reality data resource to the user wearing equipment, wherein the first virtual reality data resource and the second virtual reality data resource are used for transmitting the virtual reality image data, the first virtual reality data resource is located in a second time interval, the second virtual reality data resource is located in a third time interval, and at least one time interval is arranged between the second time interval and the first time interval; after receiving the virtual reality image data, sending a second virtual reality data allocation message to the user wearing equipment by a second virtual reality host at a first time interval, wherein the second virtual reality data allocation message allocates a third virtual reality data resource and a fourth virtual reality data resource to the user wearing equipment, wherein the third virtual reality data resource and the fourth virtual reality data resource are used for transmitting virtual reality sound data, the third virtual reality data resource is located in the second time interval, and the fourth virtual reality data resource is located in the third time interval; after receiving the first virtual reality data distribution message and the second virtual reality data distribution message, judging whether the first virtual reality data resource and the third virtual reality data resource are overlapped in a frequency domain by the user wearing equipment; if the first virtual reality data resource and the third virtual reality data resource are not overlapped in the frequency domain, receiving virtual reality image data on the first virtual reality data resource by the user wearing equipment and receiving virtual reality sound data on the third virtual reality data resource by the user wearing equipment; after receiving the virtual reality image data and the virtual reality sound data, the user wearing equipment provides the virtual reality image data and the virtual reality sound data for the user.
In a preferred embodiment, the virtual reality information transmission method includes the following steps: if the first virtual reality data resource and the third virtual reality data resource are overlapped in the frequency domain, the user wearing equipment sends a conflict notice to the first virtual reality host machine in a fourth time interval, and the user wearing equipment sends the conflict notice to the second virtual reality host machine in the fourth time interval, wherein in terms of time, the fourth time interval is positioned after the first time interval and before the second time interval; after receiving the conflict notification, sending, by the first virtual reality host, the conflict notification to the second virtual reality host over the fiber optic communication connection; after receiving the conflict notification, the second virtual reality host abandons sending virtual reality sound data to the user wearable device on the third virtual reality data resource; after receiving the conflict notification, the first virtual reality host continues to send virtual reality image data to the user wearable device on the first virtual reality data resource; after a conflict notification is sent to the first virtual reality host and the second virtual reality host, receiving virtual reality image data on a first virtual reality data resource by the user wearable device; after receiving the virtual reality image data, providing, by the user-worn device, the virtual reality image data to the user.
In a preferred embodiment, the virtual reality information transmission method includes the following steps: after receiving the first virtual reality data allocation message and the second virtual reality data allocation message, judging whether the first virtual reality data resource and the third virtual reality data resource are overlapped in a frequency domain by the user wearing equipment, and judging whether the second virtual reality data resource and the fourth virtual reality data resource are overlapped in the frequency domain by the user wearing equipment; if the first virtual reality data resource and the third virtual reality data resource are overlapped in the frequency domain, the user wearing equipment sends a conflict notice to the first virtual reality host machine in a fourth time interval, and the user wearing equipment sends the conflict notice to the second virtual reality host machine in the fourth time interval, wherein in terms of time, the fourth time interval is positioned after the first time interval and before the second time interval; if the second virtual reality data resource and the fourth virtual reality data resource are overlapped in the frequency domain, the user wearing equipment sends a second conflict notice to the first virtual reality host machine in a fourth time interval, and the user wearing equipment sends the second conflict notice to the second virtual reality host machine in the fourth time interval; after receiving the conflict notification, sending, by the first virtual reality host, the conflict notification to the second virtual reality host over the fiber optic communication connection; after receiving the second conflict notification, sending, by the first virtual reality host, the second conflict notification to the second virtual reality host through the optical fiber communication connection; after receiving the conflict notification, the second virtual reality host abandons sending virtual reality sound data to the user wearable device on the third virtual reality data resource; after receiving the conflict notification, the first virtual reality host continues to send virtual reality image data to the user wearable device on the first virtual reality data resource; after receiving the second conflict notification, the second virtual reality host abandons sending virtual reality sound data to the user wearable device on the fourth virtual reality data resource; after receiving the second conflict notification, continuing, by the first virtual reality host, to send virtual reality image data to the user-worn device on the second virtual reality data resource.
In a preferred embodiment, the virtual reality information transmission method includes the following steps: setting, by a user, a user-worn device to a sound-priority mode; after the user wearing equipment is set to be in the sound priority mode, the user wearing equipment receives a first virtual reality data distribution message and a second virtual reality data distribution message; after receiving the first virtual reality data distribution message and the second virtual reality data distribution message, judging whether the first virtual reality data resource and the third virtual reality data resource are overlapped in a frequency domain by the user wearing equipment;
if the first virtual reality data resource and the third virtual reality data resource are overlapped in the frequency domain, sending a third collision notification to the first virtual reality host by the user wearing equipment in a fourth time interval, and sending the third collision notification to the second virtual reality host by the user wearing equipment in the fourth time interval, wherein in terms of time, the fourth time interval is positioned after the first time interval and before the second time interval; after receiving the third conflict notification, sending, by the second virtual reality host, the third conflict notification to the first virtual reality host over the fiber optic communication connection.
In a preferred embodiment, the virtual reality information transmission method includes the following steps: after receiving the third conflict notification, the second virtual reality host continues to send virtual reality sound data to the user wearable device on the third virtual reality data resource; after receiving the third conflict notification, the first virtual reality host abandons sending virtual reality image data to the user-worn device on the first virtual reality data resource; after the third conflict notification is sent to the first virtual reality host and the second virtual reality host, the user-worn device receives virtual reality sound data on a third virtual reality data resource.
The invention also provides a virtual reality system, which is characterized by comprising modules for: receiving, by a first virtual reality host, virtual reality image data sent by a virtual reality service provider server; receiving, by the second virtual reality host, virtual reality sound data transmitted by the virtual reality service provider server; after receiving the virtual reality image data, sending a first virtual reality data allocation message to the user wearing equipment at a first time interval by a first virtual reality host, wherein the first virtual reality data allocation message allocates a first virtual reality data resource and a second virtual reality data resource to the user wearing equipment, wherein the first virtual reality data resource and the second virtual reality data resource are used for transmitting the virtual reality image data, the first virtual reality data resource is located in a second time interval, the second virtual reality data resource is located in a third time interval, and at least one time interval is arranged between the second time interval and the first time interval; after receiving the virtual reality image data, sending a second virtual reality data allocation message to the user wearing equipment by a second virtual reality host at a first time interval, wherein the second virtual reality data allocation message allocates a third virtual reality data resource and a fourth virtual reality data resource to the user wearing equipment, wherein the third virtual reality data resource and the fourth virtual reality data resource are used for transmitting virtual reality sound data, the third virtual reality data resource is located in the second time interval, and the fourth virtual reality data resource is located in the third time interval; after receiving the first virtual reality data distribution message and the second virtual reality data distribution message, judging whether the first virtual reality data resource and the third virtual reality data resource are overlapped in a frequency domain by the user wearing equipment; if the first virtual reality data resource and the third virtual reality data resource are not overlapped in the frequency domain, receiving virtual reality image data on the first virtual reality data resource by the user wearing equipment and receiving virtual reality sound data on the third virtual reality data resource by the user wearing equipment; after receiving the virtual reality image data and the virtual reality sound data, the user wearing equipment provides the virtual reality image data and the virtual reality sound data for the user.
In a preferred embodiment, the virtual reality system includes modules for: if the first virtual reality data resource and the third virtual reality data resource are overlapped in the frequency domain, the user wearing equipment sends a conflict notice to the first virtual reality host machine in a fourth time interval, and the user wearing equipment sends the conflict notice to the second virtual reality host machine in the fourth time interval, wherein in terms of time, the fourth time interval is positioned after the first time interval and before the second time interval; after receiving the conflict notification, sending, by the first virtual reality host, the conflict notification to the second virtual reality host over the fiber optic communication connection; after receiving the conflict notification, the second virtual reality host abandons sending virtual reality sound data to the user wearable device on the third virtual reality data resource; after receiving the conflict notification, the first virtual reality host continues to send virtual reality image data to the user wearable device on the first virtual reality data resource; after a conflict notification is sent to the first virtual reality host and the second virtual reality host, receiving virtual reality image data on a first virtual reality data resource by the user wearable device; after receiving the virtual reality image data, providing, by the user-worn device, the virtual reality image data to the user.
In a preferred embodiment, the virtual reality system includes modules for: after receiving the first virtual reality data allocation message and the second virtual reality data allocation message, judging whether the first virtual reality data resource and the third virtual reality data resource are overlapped in a frequency domain by the user wearing equipment, and judging whether the second virtual reality data resource and the fourth virtual reality data resource are overlapped in the frequency domain by the user wearing equipment; if the first virtual reality data resource and the third virtual reality data resource are overlapped in the frequency domain, the user wearing equipment sends a conflict notice to the first virtual reality host machine in a fourth time interval, and the user wearing equipment sends the conflict notice to the second virtual reality host machine in the fourth time interval, wherein in terms of time, the fourth time interval is positioned after the first time interval and before the second time interval; if the second virtual reality data resource and the fourth virtual reality data resource are overlapped in the frequency domain, the user wearing equipment sends a second conflict notice to the first virtual reality host machine in a fourth time interval, and the user wearing equipment sends the second conflict notice to the second virtual reality host machine in the fourth time interval; after receiving the conflict notification, sending, by the first virtual reality host, the conflict notification to the second virtual reality host over the fiber optic communication connection; after receiving the second conflict notification, sending, by the first virtual reality host, the second conflict notification to the second virtual reality host through the optical fiber communication connection; after receiving the conflict notification, the second virtual reality host abandons sending virtual reality sound data to the user wearable device on the third virtual reality data resource; after receiving the conflict notification, the first virtual reality host continues to send virtual reality image data to the user wearable device on the first virtual reality data resource; after receiving the second conflict notification, the second virtual reality host abandons sending virtual reality sound data to the user wearable device on the fourth virtual reality data resource; after receiving the second conflict notification, continuing, by the first virtual reality host, to send virtual reality image data to the user-worn device on the second virtual reality data resource.
In a preferred embodiment, the virtual reality system includes modules for: setting, by a user, a user-worn device to a sound-priority mode; after the user wearing equipment is set to be in the sound priority mode, the user wearing equipment receives a first virtual reality data distribution message and a second virtual reality data distribution message; after receiving the first virtual reality data distribution message and the second virtual reality data distribution message, judging whether the first virtual reality data resource and the third virtual reality data resource are overlapped in a frequency domain by the user wearing equipment; if the first virtual reality data resource and the third virtual reality data resource are overlapped in the frequency domain, sending a third collision notification to the first virtual reality host by the user wearing equipment in a fourth time interval, and sending the third collision notification to the second virtual reality host by the user wearing equipment in the fourth time interval, wherein in terms of time, the fourth time interval is positioned after the first time interval and before the second time interval; after receiving the third conflict notification, sending, by the second virtual reality host, the third conflict notification to the first virtual reality host over the fiber optic communication connection.
In a preferred embodiment, the virtual reality system includes modules for: after receiving the third conflict notification, the second virtual reality host continues to send virtual reality sound data to the user wearable device on the third virtual reality data resource; after receiving the third conflict notification, the first virtual reality host abandons sending virtual reality image data to the user-worn device on the first virtual reality data resource; after the third conflict notification is sent to the first virtual reality host and the second virtual reality host, the user-worn device receives virtual reality sound data on a third virtual reality data resource.
Compared with the prior art, the present invention has the following advantages that as stated in the background art, many virtual reality devices based on wireless transmission have been proposed, wherein the virtual reality devices transmit sound and video signals to the wearable device through a host, the transmission mode has high requirements on the host, when the host is not sufficiently computing, the problem of image and sound maladjustment or distortion may occur, even if the host is sufficiently computing, the sound and image segments can be transmitted at any granularity, so that the resource coordination between the two can be ensured (for example, whether the transmission of sound after the transmission of one frame of picture is completed causes the resource allocation to be too biased to the image, or if the information of 1/4 in one frame of picture is transmitted to the user, and then the transmission of sound information is started, in fact, these problems have not been unified solutions to date) are also issues that need to be considered in the case of a single host. It is currently considered to solve this problem by providing two (or more) hosts to provide sound and image to the wearable device, respectively, but this method faces the problem of how to coordinate the transmission of the two hosts, and the method proposed by the present application aims to solve this problem.
Drawings
FIG. 1 is a flow diagram according to an embodiment of the present invention.
Fig. 2 is a flow diagram according to an embodiment of the invention.
Detailed Description
The present invention is described in detail below with reference to specific embodiments in order to make the concept and idea of the present invention more clearly understood by those skilled in the art. It is to be understood that the embodiments presented herein are only a few of all embodiments that the present invention may have. Those skilled in the art who review this disclosure will readily appreciate that many modifications, variations, or alterations to the described embodiments, either in whole or in part, are possible and within the scope of the invention as claimed.
As used herein, the terms "first," "second," and the like are not intended to imply any order, quantity, or importance, but rather are used to distinguish one element from another. As used herein, the terms "a," "an," and other similar terms are not intended to mean that there is only one of the things, but rather that the pertinent description is directed to only one of the things, which may have one or more. As used herein, the terms "comprises," "comprising," and other similar words are intended to refer to logical interrelationships, and are not to be construed as referring to spatial structural relationships. For example, "a includes B" is intended to mean that logically B belongs to a, and not that spatially B is located inside a. Furthermore, the terms "comprising," "including," and other similar words are to be construed as open-ended, rather than closed-ended. For example, "a includes B" is intended to mean that B belongs to a, but B does not necessarily constitute all of a, and a may also include C, D, E and other elements.
The terms "embodiment," "present embodiment," "an embodiment," "one embodiment," and "one embodiment" herein do not mean that the pertinent description applies to only one particular embodiment, but rather that the description may apply to yet another embodiment or embodiments. Those skilled in the art will appreciate that any descriptions made in relation to one embodiment may be substituted, combined, or otherwise combined with the descriptions in relation to another embodiment or embodiments, and that the substitution, combination, or otherwise combination of the new embodiments as produced herein may occur to those skilled in the art and are intended to be within the scope of the present invention.
The virtual reality information transmission method provided by the invention comprises the following steps:
receiving, by a first virtual reality host, virtual reality image data sent by a virtual reality service provider server; in one embodiment, the virtual reality host is a computer commonly used in a shopping mall for providing data to VR glasses, for example, and the virtual reality host of the present application requires a wireless communication function; in one embodiment, the image data may be referred to as video data;
receiving, by the second virtual reality host, virtual reality sound data transmitted by the virtual reality service provider server; in one embodiment, the sound data may be referred to as audio data;
after receiving the virtual reality image data, sending a first virtual reality data allocation message to the user wearing equipment at a first time interval by a first virtual reality host, wherein the first virtual reality data allocation message allocates a first virtual reality data resource and a second virtual reality data resource to the user wearing equipment, wherein the first virtual reality data resource and the second virtual reality data resource are used for transmitting the virtual reality image data, the first virtual reality data resource is located in a second time interval, the second virtual reality data resource is located in a third time interval, and at least one time interval is arranged between the second time interval and the first time interval; in one embodiment, a time interval may be 0.25ms, 0.5ms, 1ms, 2ms, etc., as a basic principle, if the virtual reality application is a game-like application, the time interval should be as small as possible, and if the virtual reality application is a quasi-static application (e.g., a VR application that relieves emotion through VR natural wind-solar presentation), the time interval may be larger; in one embodiment, once the time interval is selected, the time interval cannot be changed during the operation of the entire VR application; in one embodiment, the virtual reality data allocation message may be designed with reference to a downlink control message or a sidelink control message, and in one embodiment, the virtual reality data resource needs to occupy a certain time domain resource and a certain frequency domain resource; if the two pieces of virtual reality data occupy the same time but different frequencies, the two pieces of virtual reality data are equivalent to frequency division multiplexing; it will be appreciated by those skilled in the art that the third time interval is subsequent to the second time interval;
after receiving the virtual reality image data, sending a second virtual reality data allocation message to the user wearing equipment by a second virtual reality host at a first time interval, wherein the second virtual reality data allocation message allocates a third virtual reality data resource and a fourth virtual reality data resource to the user wearing equipment, wherein the third virtual reality data resource and the fourth virtual reality data resource are used for transmitting virtual reality sound data, the third virtual reality data resource is located in the second time interval, and the fourth virtual reality data resource is located in the third time interval;
after receiving the first virtual reality data distribution message and the second virtual reality data distribution message, judging whether the first virtual reality data resource and the third virtual reality data resource are overlapped in a frequency domain by the user wearing equipment;
if the first virtual reality data resource and the third virtual reality data resource are not overlapped in the frequency domain, receiving virtual reality image data on the first virtual reality data resource by the user wearing equipment and receiving virtual reality sound data on the third virtual reality data resource by the user wearing equipment; in one embodiment, both the first virtual reality data allocation message and the second virtual reality data allocation message allocate two data resources to the user-worn device, one data resource being temporally forward and one data resource being temporally backward;
after receiving the virtual reality image data and the virtual reality sound data, the user wearing equipment provides the virtual reality image data and the virtual reality sound data for the user.
Further, the virtual reality information transmission method comprises the following steps: and if the first virtual reality data resource and the third virtual reality data resource are overlapped in the frequency domain, sending a conflict notice to the first virtual reality host by the user wearing equipment in a fourth time interval, and sending the conflict notice to the second virtual reality host by the user wearing equipment in the fourth time interval, wherein the fourth time interval is positioned after the first time interval and before the second time interval in terms of time.
In one embodiment, the conflict notification used by the present invention may have a simple format, such as the following table:
TABLE 1
The collision notification design of the application has strong expandability, and if three hosts need to be designed to simultaneously transmit gray level images, color data and sounds, the application can design the following steps by combining the steps,
receiving, by a first virtual reality host, virtual reality grayscale image data sent by a virtual reality service provider server; receiving, by the second virtual reality host, virtual reality sound data transmitted by the virtual reality service provider server; receiving, by the third virtual reality host, virtual reality image color data sent by the virtual reality service provider server;
the first and second virtual reality hosts operate according to the steps described above, and the third virtual reality host sends a third virtual reality data allocation message to the user-worn device at the first time interval, where the third virtual reality data allocation message allocates a fifth virtual reality data resource and a sixth virtual reality data resource to the user-worn device, where the fifth virtual reality data resource and the sixth virtual reality data resource are used to transmit virtual reality image color data, where the fifth virtual reality data resource is located at the second time interval, and the sixth virtual reality data resource is located at the third time interval.
In this case, the conflict notification may be designed based on the following manner,
TABLE 2
In the case of this embodiment (embodiment associated with table 2), if the second virtual reality host receives the collision notification, the second virtual reality host does not transmit sound data for the second time interval, and if the third second virtual reality host receives the collision notification, the third virtual reality host does not transmit color data for the second time interval.
It may also be preferable to design the collision notification based on,
TABLE 3
It should be appreciated that in embodiments having separate color data transfer hosts, the color data will not have the highest priority because transferring the color data alone has no meaning;
after receiving the conflict notification, sending, by the first virtual reality host, the conflict notification to the second virtual reality host over the fiber optic communication connection;
after receiving the conflict notification, the second virtual reality host abandons sending virtual reality sound data to the user wearable device on the third virtual reality data resource;
after receiving the conflict notification, the first virtual reality host continues to send virtual reality image data to the user wearable device on the first virtual reality data resource;
after a conflict notification is sent to the first virtual reality host and the second virtual reality host, receiving virtual reality image data on a first virtual reality data resource by the user wearable device;
after receiving the virtual reality image data, providing, by the user-worn device, the virtual reality image data to the user.
Further, the virtual reality information transmission method comprises the following steps:
after receiving the first virtual reality data allocation message and the second virtual reality data allocation message, judging whether the first virtual reality data resource and the third virtual reality data resource are overlapped in a frequency domain by the user wearing equipment, and judging whether the second virtual reality data resource and the fourth virtual reality data resource are overlapped in the frequency domain by the user wearing equipment;
if the first virtual reality data resource and the third virtual reality data resource are overlapped in the frequency domain, the user wearing equipment sends a conflict notice to the first virtual reality host machine in a fourth time interval, and the user wearing equipment sends the conflict notice to the second virtual reality host machine in the fourth time interval, wherein in terms of time, the fourth time interval is positioned after the first time interval and before the second time interval;
if the second virtual reality data resource and the fourth virtual reality data resource are overlapped in the frequency domain, the user wearing equipment sends a second conflict notice to the first virtual reality host machine in a fourth time interval, and the user wearing equipment sends the second conflict notice to the second virtual reality host machine in the fourth time interval;
after receiving the conflict notification, sending, by the first virtual reality host, the conflict notification to the second virtual reality host over the fiber optic communication connection;
after receiving the second conflict notification, sending, by the first virtual reality host, the second conflict notification to the second virtual reality host through the optical fiber communication connection;
after receiving the conflict notification, the second virtual reality host abandons sending virtual reality sound data to the user wearable device on the third virtual reality data resource;
after receiving the conflict notification, the first virtual reality host continues to send virtual reality image data to the user wearable device on the first virtual reality data resource;
after receiving the second conflict notification, the second virtual reality host abandons sending virtual reality sound data to the user wearable device on the fourth virtual reality data resource;
after receiving the second conflict notification, continuing, by the first virtual reality host, to send virtual reality image data to the user-worn device on the second virtual reality data resource.
Further, the virtual reality information transmission method comprises the following steps:
setting, by a user, a user-worn device to a sound-priority mode; in one embodiment, for example, where the virtual reality application is a recorded concert venue, high fidelity voice transmission is preferred over image transmission, in which case the user may select the voice preference mode in the user-worn device via software (based on "setting" options on the human-machine interface) or hardware (e.g., keys on the user-worn device);
after the user wearing equipment is set to be in the sound priority mode, the user wearing equipment receives a first virtual reality data distribution message and a second virtual reality data distribution message;
after receiving the first virtual reality data distribution message and the second virtual reality data distribution message, judging whether the first virtual reality data resource and the third virtual reality data resource are overlapped in a frequency domain by the user wearing equipment;
if the first virtual reality data resource and the third virtual reality data resource are overlapped in the frequency domain, sending a third collision notification to the first virtual reality host by the user wearing equipment in a fourth time interval, and sending the third collision notification to the second virtual reality host by the user wearing equipment in the fourth time interval, wherein in terms of time, the fourth time interval is positioned after the first time interval and before the second time interval;
after receiving the third conflict notification, sending, by the second virtual reality host, the third conflict notification to the first virtual reality host over the fiber optic communication connection.
Further, the virtual reality information transmission method comprises the following steps:
after receiving the third conflict notification, the second virtual reality host continues to send virtual reality sound data to the user wearable device on the third virtual reality data resource;
after receiving the third conflict notification, the first virtual reality host abandons sending virtual reality image data to the user-worn device on the first virtual reality data resource;
after the third conflict notification is sent to the first virtual reality host and the second virtual reality host, the user-worn device receives virtual reality sound data on a third virtual reality data resource.
The concepts, principles and concepts of the invention have been described above in detail in connection with specific embodiments (including examples and illustrations). Those skilled in the art will appreciate that the embodiments of the present invention are capable of other than the several forms described above and that the steps, methods, systems, and components of the embodiments described herein are capable of further modifications, permutations and equivalents after reading the present specification, which should be considered as falling within the scope of the present invention, which is limited only by the claims.
Claims (10)
1. A virtual reality information transmission method is characterized by comprising the following steps:
receiving, by a first virtual reality host, virtual reality image data sent by a virtual reality service provider server;
receiving, by the second virtual reality host, virtual reality sound data transmitted by the virtual reality service provider server;
after receiving the virtual reality image data, sending, by a first virtual reality host, a first virtual reality data allocation message to a user-worn device at a first time interval, wherein the first virtual reality data allocation message allocates first virtual reality data resources and second virtual reality data resources to the user-worn device, wherein the first virtual reality data resources and the second virtual reality data resources are used for transmitting the virtual reality image data, wherein the first virtual reality data resources are located in a second time interval, the second virtual reality data resources are located in a third time interval, and wherein the second time interval is separated from the first time interval by at least one time interval;
after receiving the virtual reality image data, sending, by a second virtual reality host, a second virtual reality data allocation message to a user-worn device at a first time interval, wherein the second virtual reality data allocation message allocates a third virtual reality data resource and a fourth virtual reality data resource to the user-worn device, wherein the third virtual reality data resource and the fourth virtual reality data resource are used for transmitting the virtual reality sound data, wherein the third virtual reality data resource is located in the second time interval, and the fourth virtual reality data resource is located in the third time interval;
after receiving the first virtual reality data distribution message and the second virtual reality data distribution message, judging whether the first virtual reality data resource and the third virtual reality data resource are overlapped in a frequency domain by the user wearing equipment;
if the first virtual reality data resource and the third virtual reality data resource are not overlapped in the frequency domain, receiving virtual reality image data on the first virtual reality data resource by the user wearing equipment and receiving virtual reality sound data on the third virtual reality data resource by the user wearing equipment;
after receiving the virtual reality image data and the virtual reality sound data, the user wearing equipment provides the virtual reality image data and the virtual reality sound data for the user.
2. The virtual reality information transmission method according to claim 1, comprising the steps of:
if the first virtual reality data resource and the third virtual reality data resource are overlapped in the frequency domain, sending a collision notification to the first virtual reality host by the user wearing equipment in a fourth time interval, and sending the collision notification to the second virtual reality host by the user wearing equipment in the fourth time interval, wherein the fourth time interval is positioned after the first time interval and before the second time interval in terms of time;
after receiving the conflict notification, sending, by the first virtual reality host, the conflict notification to the second virtual reality host over a fiber optic communication connection;
after receiving the conflict notification, forgoing, by a second virtual reality host, sending virtual reality sound data to the user-worn device on the third virtual reality data resource;
after receiving the conflict notification, continuing, by the first virtual reality host, to send virtual reality image data to the user-worn device on the first virtual reality data resource;
receiving, by the user-worn device, virtual reality image data on a first virtual reality data resource after sending the conflict notification to the first virtual reality host and a second virtual reality host;
after receiving the virtual reality image data, providing, by the user-worn device, the virtual reality image data to the user.
3. The virtual reality information transmission method according to claim 2, comprising the steps of:
after receiving the first virtual reality data allocation message and the second virtual reality data allocation message, judging whether the first virtual reality data resource and the third virtual reality data resource are overlapped in a frequency domain by the user wearing equipment, and judging whether the second virtual reality data resource and the fourth virtual reality data resource are overlapped in the frequency domain by the user wearing equipment;
if the first virtual reality data resource and the third virtual reality data resource are overlapped in the frequency domain, sending a collision notification to the first virtual reality host by the user wearing equipment in a fourth time interval, and sending the collision notification to the second virtual reality host by the user wearing equipment in the fourth time interval, wherein the fourth time interval is positioned after the first time interval and before the second time interval in terms of time;
if the second virtual reality data resource and the fourth virtual reality data resource are overlapped in the frequency domain, the user wearing equipment sends a second collision notification to the first virtual reality host machine in a fourth time interval, and the user wearing equipment sends the second collision notification to the second virtual reality host machine in the fourth time interval;
after receiving the conflict notification, sending, by the first virtual reality host, the conflict notification to the second virtual reality host over a fiber optic communication connection;
after receiving the second conflict notification, sending, by the first virtual reality host, the second conflict notification to the second virtual reality host over the fiber optic communication connection;
after receiving the conflict notification, forgoing, by a second virtual reality host, sending virtual reality sound data to the user-worn device on the third virtual reality data resource;
after receiving the conflict notification, continuing, by the first virtual reality host, to send virtual reality image data to the user-worn device on the first virtual reality data resource;
after receiving the second conflict notification, forgoing, by a second virtual reality host, sending virtual reality sound data to the user-worn device on the fourth virtual reality data resource;
after receiving the second conflict notification, continuing, by the first virtual reality host, to send virtual reality image data to the user-worn device on the second virtual reality data resource.
4. The virtual reality information transmission method according to claim 3, comprising the steps of:
setting, by a user, a user-worn device to a sound-priority mode;
after the user wearing equipment is set to be in a sound priority mode, the user wearing equipment receives the first virtual reality data distribution message and the second virtual reality data distribution message;
after receiving the first virtual reality data distribution message and the second virtual reality data distribution message, judging whether the first virtual reality data resource and the third virtual reality data resource are overlapped in a frequency domain by the user wearing equipment;
if the first virtual reality data resource and the third virtual reality data resource are overlapped in the frequency domain, sending a third collision notification to the first virtual reality host by the user-worn device in a fourth time interval, and sending the third collision notification to the second virtual reality host by the user-worn device in the fourth time interval, wherein the fourth time interval is after the first time interval and before the second time interval in terms of time;
after receiving the third collision notification, sending, by a second virtual reality host, the third collision notification to the first virtual reality host over a fiber optic communication connection.
5. The virtual reality information transmission method according to claim 4, comprising the steps of:
after receiving the third collision notification, continuing, by a second virtual reality host, to send virtual reality sound data to the user-worn device on the third virtual reality data resource;
after receiving the third conflict notification, forgoing, by a first virtual reality host, sending virtual reality image data to the user-worn device on the first virtual reality data resource;
after the third conflict notification is sent to the first virtual reality host and the second virtual reality host, receiving, by the user-worn device, virtual reality sound data on a third virtual reality data resource.
6. A virtual reality system, comprising modules for:
receiving, by a first virtual reality host, virtual reality image data sent by a virtual reality service provider server;
receiving, by the second virtual reality host, virtual reality sound data transmitted by the virtual reality service provider server;
after receiving the virtual reality image data, sending, by a first virtual reality host, a first virtual reality data allocation message to a user-worn device at a first time interval, wherein the first virtual reality data allocation message allocates first virtual reality data resources and second virtual reality data resources to the user-worn device, wherein the first virtual reality data resources and the second virtual reality data resources are used for transmitting the virtual reality image data, wherein the first virtual reality data resources are located in a second time interval, the second virtual reality data resources are located in a third time interval, and wherein the second time interval is separated from the first time interval by at least one time interval;
after receiving the virtual reality image data, sending, by a second virtual reality host, a second virtual reality data allocation message to a user-worn device at a first time interval, wherein the second virtual reality data allocation message allocates a third virtual reality data resource and a fourth virtual reality data resource to the user-worn device, wherein the third virtual reality data resource and the fourth virtual reality data resource are used for transmitting the virtual reality sound data, wherein the third virtual reality data resource is located in the second time interval, and the fourth virtual reality data resource is located in the third time interval;
after receiving the first virtual reality data distribution message and the second virtual reality data distribution message, judging whether the first virtual reality data resource and the third virtual reality data resource are overlapped in a frequency domain by the user wearing equipment;
if the first virtual reality data resource and the third virtual reality data resource are not overlapped in the frequency domain, receiving virtual reality image data on the first virtual reality data resource by the user wearing equipment and receiving virtual reality sound data on the third virtual reality data resource by the user wearing equipment;
after receiving the virtual reality image data and the virtual reality sound data, the user wearing equipment provides the virtual reality image data and the virtual reality sound data for the user.
7. The virtual reality system of claim 6, comprising modules to:
if the first virtual reality data resource and the third virtual reality data resource are overlapped in the frequency domain, sending a collision notification to the first virtual reality host by the user wearing equipment in a fourth time interval, and sending the collision notification to the second virtual reality host by the user wearing equipment in the fourth time interval, wherein the fourth time interval is positioned after the first time interval and before the second time interval in terms of time;
after receiving the conflict notification, sending, by the first virtual reality host, the conflict notification to the second virtual reality host over a fiber optic communication connection;
after receiving the conflict notification, forgoing, by a second virtual reality host, sending virtual reality sound data to the user-worn device on the third virtual reality data resource;
after receiving the conflict notification, continuing, by the first virtual reality host, to send virtual reality image data to the user-worn device on the first virtual reality data resource;
receiving, by the user-worn device, virtual reality image data on a first virtual reality data resource after sending the conflict notification to the first virtual reality host and a second virtual reality host;
after receiving the virtual reality image data, providing, by the user-worn device, the virtual reality image data to the user.
8. The virtual reality system of claim 7, comprising modules to:
after receiving the first virtual reality data allocation message and the second virtual reality data allocation message, judging whether the first virtual reality data resource and the third virtual reality data resource are overlapped in a frequency domain by the user wearing equipment, and judging whether the second virtual reality data resource and the fourth virtual reality data resource are overlapped in the frequency domain by the user wearing equipment;
if the first virtual reality data resource and the third virtual reality data resource are overlapped in the frequency domain, sending a collision notification to the first virtual reality host by the user wearing equipment in a fourth time interval, and sending the collision notification to the second virtual reality host by the user wearing equipment in the fourth time interval, wherein the fourth time interval is positioned after the first time interval and before the second time interval in terms of time;
if the second virtual reality data resource and the fourth virtual reality data resource are overlapped in the frequency domain, the user wearing equipment sends a second collision notification to the first virtual reality host machine in a fourth time interval, and the user wearing equipment sends the second collision notification to the second virtual reality host machine in the fourth time interval;
after receiving the conflict notification, sending, by the first virtual reality host, the conflict notification to the second virtual reality host over a fiber optic communication connection;
after receiving the second conflict notification, sending, by the first virtual reality host, the second conflict notification to the second virtual reality host over the fiber optic communication connection;
after receiving the conflict notification, forgoing, by a second virtual reality host, sending virtual reality sound data to the user-worn device on the third virtual reality data resource;
after receiving the conflict notification, continuing, by the first virtual reality host, to send virtual reality image data to the user-worn device on the first virtual reality data resource;
after receiving the second conflict notification, forgoing, by a second virtual reality host, sending virtual reality sound data to the user-worn device on the fourth virtual reality data resource;
after receiving the second conflict notification, continuing, by the first virtual reality host, to send virtual reality image data to the user-worn device on the second virtual reality data resource.
9. The virtual reality system of claim 8, comprising modules to:
setting, by a user, a user-worn device to a sound-priority mode;
after the user wearing equipment is set to be in a sound priority mode, the user wearing equipment receives the first virtual reality data distribution message and the second virtual reality data distribution message;
after receiving the first virtual reality data distribution message and the second virtual reality data distribution message, judging whether the first virtual reality data resource and the third virtual reality data resource are overlapped in a frequency domain by the user wearing equipment;
if the first virtual reality data resource and the third virtual reality data resource are overlapped in the frequency domain, sending a third collision notification to the first virtual reality host by the user-worn device in a fourth time interval, and sending the third collision notification to the second virtual reality host by the user-worn device in the fourth time interval, wherein the fourth time interval is after the first time interval and before the second time interval in terms of time;
after receiving the third collision notification, sending, by a second virtual reality host, the third collision notification to the first virtual reality host over a fiber optic communication connection.
10. The virtual reality system of claim 9, comprising modules for:
after receiving the third collision notification, continuing, by a second virtual reality host, to send virtual reality sound data to the user-worn device on the third virtual reality data resource;
after receiving the third conflict notification, forgoing, by a first virtual reality host, sending virtual reality image data to the user-worn device on the first virtual reality data resource;
after the third conflict notification is sent to the first virtual reality host and the second virtual reality host, receiving, by the user-worn device, virtual reality sound data on a third virtual reality data resource.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111407867.5A CN113824746B (en) | 2021-11-25 | 2021-11-25 | Virtual reality information transmission method and virtual reality system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111407867.5A CN113824746B (en) | 2021-11-25 | 2021-11-25 | Virtual reality information transmission method and virtual reality system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113824746A true CN113824746A (en) | 2021-12-21 |
| CN113824746B CN113824746B (en) | 2022-02-18 |
Family
ID=78918207
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111407867.5A Active CN113824746B (en) | 2021-11-25 | 2021-11-25 | Virtual reality information transmission method and virtual reality system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113824746B (en) |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20010056574A1 (en) * | 2000-06-26 | 2001-12-27 | Richards Angus Duncan | VTV system |
| US20030037101A1 (en) * | 2001-08-20 | 2003-02-20 | Lucent Technologies, Inc. | Virtual reality systems and methods |
| US20030063133A1 (en) * | 2001-09-28 | 2003-04-03 | Fuji Xerox Co., Ltd. | Systems and methods for providing a spatially indexed panoramic video |
| US8965460B1 (en) * | 2004-01-30 | 2015-02-24 | Ip Holdings, Inc. | Image and augmented reality based networks using mobile devices and intelligent electronic glasses |
| CN109074152A (en) * | 2017-03-22 | 2018-12-21 | 华为技术有限公司 | A kind of virtual reality image sending method and device |
| EP3522096A1 (en) * | 2017-03-01 | 2019-08-07 | Alibaba Group Holding Limited | Augmented reality-based offline interaction method and device |
| CN111641847A (en) * | 2020-06-11 | 2020-09-08 | 南昌威爱教育科技有限公司 | Data transmission method for virtual reality teaching |
| CN112261421A (en) * | 2020-10-12 | 2021-01-22 | Oppo广东移动通信有限公司 | Virtual reality display method and device, electronic equipment and storage medium |
-
2021
- 2021-11-25 CN CN202111407867.5A patent/CN113824746B/en active Active
Patent Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20010056574A1 (en) * | 2000-06-26 | 2001-12-27 | Richards Angus Duncan | VTV system |
| US20030037101A1 (en) * | 2001-08-20 | 2003-02-20 | Lucent Technologies, Inc. | Virtual reality systems and methods |
| US20030063133A1 (en) * | 2001-09-28 | 2003-04-03 | Fuji Xerox Co., Ltd. | Systems and methods for providing a spatially indexed panoramic video |
| US8965460B1 (en) * | 2004-01-30 | 2015-02-24 | Ip Holdings, Inc. | Image and augmented reality based networks using mobile devices and intelligent electronic glasses |
| EP3522096A1 (en) * | 2017-03-01 | 2019-08-07 | Alibaba Group Holding Limited | Augmented reality-based offline interaction method and device |
| CN109074152A (en) * | 2017-03-22 | 2018-12-21 | 华为技术有限公司 | A kind of virtual reality image sending method and device |
| US20200064907A1 (en) * | 2017-03-22 | 2020-02-27 | Huawei Technologies Co., Ltd. | Method and apparatus for sending virtual reality image |
| CN111641847A (en) * | 2020-06-11 | 2020-09-08 | 南昌威爱教育科技有限公司 | Data transmission method for virtual reality teaching |
| CN112261421A (en) * | 2020-10-12 | 2021-01-22 | Oppo广东移动通信有限公司 | Virtual reality display method and device, electronic equipment and storage medium |
Non-Patent Citations (3)
| Title |
|---|
| ALEXANDRE CARDOSO; EDGARD LAMOUNIER;ETC: "VRCEMIG: A virtual reality system for real time control of electric substations", 《2013 IEEE VIRTUAL REALITY (VR)》 * |
| 赵沁平: "虚拟现实综述", 《中国科学（F辑:信息科学）》 * |
| 魏三强; 孙彦景: "虚拟现实的无线网络传输技术研究进展", 《华侨大学学报(自然科学版)》 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113824746B (en) | 2022-02-18 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108733334B (en) | Image quality parameter adjusting method, device, terminal and storage medium | |
| WO2021052318A1 (en) | Audio playing method and apparatus, and tws bluetooth earphone | |
| JP3866793B2 (en) | Network system | |
| JP6582100B2 (en) | Method and apparatus for providing voice service | |
| CN109769127A (en) | Audio video synchronization dissemination method, device, electronic equipment and readable storage medium storing program for executing | |
| CN108881955A (en) | A kind of method and system for realizing the output of distributed node equipment audio video synchronization | |
| CN112788276A (en) | Video stream display method, transmission method, device, terminal, server and medium | |
| CN107770255A (en) | Terminal device data sharing master control device and method for collaborative work | |
| CN109684114A (en) | Message distributing method, device, terminal and medium based on iOS system | |
| CN113542660A (en) | Method, system and storage medium for realizing conference multi-picture high-definition display | |
| CN103391228A (en) | Method and system for networking personal network devices | |
| CN115606170A (en) | Multi-grouping for immersive teleconferencing and telepresence | |
| CN111381787A (en) | Screen projection method and equipment | |
| CN113824746B (en) | Virtual reality information transmission method and virtual reality system | |
| CN102035950B (en) | Seat service processing method and IP (Internet Protocol) seat terminal | |
| WO2024002317A1 (en) | Live-streaming video processing method and apparatus, and device and medium | |
| US20090100190A1 (en) | Method and System for the Dynamic Management of the Transmission of Streams within a Plurality of Terminals | |
| CN111405026B (en) | Method and device for synchronously controlling volumes of android mobile phone and cloud mobile phone | |
| CN208094697U (en) | Video conferencing system | |
| CN112911168B (en) | Data transmission method and device | |
| US10681761B2 (en) | Apparatus for distributing short-range wireless signals using an interconnection protocol for electronic devices | |
| CN216490778U (en) | Structure for integrating seat system and desktop cloud system into unified management and control | |
| CN111211964B (en) | Instruction transmission method, device, storage medium and server | |
| KR101844931B1 (en) | Data management apparatus, system and method for dividing display | |
| CN112040070B (en) | Information transmission method for identifying currently used equipment of user |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |