WO2022127606A1

WO2022127606A1 - Adaptive cloud rendering system and method based on network communication quality

Info

Publication number: WO2022127606A1
Application number: PCT/CN2021/134994
Authority: WO
Inventors: 陈涛; 邢省委; 康志伟; 程华灼; 刘伟峰; 席磊磊
Original assignee: 微网优联科技(成都)有限公司
Priority date: 2020-12-18
Filing date: 2021-12-02
Publication date: 2022-06-23
Also published as: CN112738553A

Abstract

Provided are an adaptive cloud rendering system and method based on network communication quality. The system comprises: a cloud rendering server and a network quality detection platform; the cloud rendering server establishes a communication connection with a virtual reality terminal by means of a network data transmission channel, the network data transmission channel comprising a plurality of communication relay devices; the cloud rendering server is configured to receive periodically, during the operation of a target cloud application process, network quality parameters of the network data transmission channel sent by the network quality detection platform, and adjust the manner of rendering and/or manner of encoding of said target cloud application according to said network quality parameters; the network quality detection platform is configured to receive a network quality detection result obtained in response to the described network detection instruction sent by the network detection endpoint device, and send the network quality parameters to the cloud rendering server.

Description

Adaptive cloud rendering system and method based on network communication quality

Citations to Related Applications

This disclosure requires the application number 202011515196.X to be submitted to the State Intellectual Property Office of the People's Republic of China on December 18, 2020, and the invention patent application titled "An adaptive cloud rendering system and method based on network communication quality". All rights are hereby incorporated by reference into this disclosure.

field

The present disclosure generally relates to the field of communication technologies, and more particularly, to an adaptive cloud rendering system and method based on network communication quality.

background

With the development of high-bandwidth communication technologies such as 5G and fiber-to-the-home, the development of virtual reality technology is getting faster and faster. The development of high-bandwidth communication technology can not only reduce transmission delay and improve transmission speed, but also save costs and allow consumers The experience of virtual reality technology related applications is improved and more refined.

Overview

In a first aspect, the present disclosure relates to an adaptive cloud rendering system based on network communication quality, the system includes: a cloud rendering server and a network quality detection platform, the cloud rendering server establishes a communication connection with a virtual reality terminal through a network data transmission channel , the network data transmission channel includes a plurality of communication relay devices;

The cloud rendering server is configured to start the target cloud application in response to the start instruction of the target cloud application sent by the terminal, and render the application scene generated by the operation of the target cloud application to obtain image data and audio data, encoding the image data and the audio data into a video stream, and sending the video stream to the virtual reality terminal through the data transmission channel;

The cloud rendering server is further configured to, during the running process of the target cloud application, regularly receive the network quality parameter of the network data transmission channel sent by the network quality detection platform, and adjust the target cloud application according to the network quality parameter. how the image is rendered; and

The network quality detection platform is configured to periodically send network quality detection instructions to at least two communication relay devices on the network transmission data transmission channel, and the at least two communication relay devices include a network detection starting point device and a network detection end point device , receiving the detection result uploaded by the network detection endpoint device in response to the network detection instruction, determining the network quality parameter based on the detection result, and sending the network quality parameter to the cloud rendering server.

In a second aspect, the present disclosure relates to an adaptive rendering method based on network communication quality, including:

The cloud rendering server starts the target cloud application in response to the start instruction of the target cloud application sent by the terminal, renders the application scene generated by the operation of the target cloud application to obtain image data and audio data, and converts the image data and the The audio data is encoded into a video stream, and the video stream is sent to the virtual reality terminal through the data transmission channel;

During the running process of the target cloud application, the cloud rendering server regularly receives the network quality parameter of the network data transmission channel sent by the network quality detection platform, and adjusts the image rendering of the target cloud application according to the network quality parameter. manner; and

The network quality detection platform periodically sends network quality detection instructions to at least two communication relay devices on the network transmission data transmission channel, and the at least two communication relay devices include a network detection starting point device and a network detection end point device, receiving The network detection endpoint device determines the network quality parameter based on the detection result in response to the detection result uploaded by the network detection instruction, and sends the network quality parameter to the cloud rendering server.

According to the network communication quality-based adaptive cloud rendering system and method provided in the embodiments of the present disclosure, the cloud rendering server starts the target cloud application process in response to the start instruction of the target cloud application sent by the terminal, and runs the generated cloud rendering process on the target cloud application process. The application scene is rendered to obtain an application image, the application image and the corresponding audio data are encoded into a video stream, and the data transmission channel is sent to the virtual reality terminal; and the data transmission channel on the network quality detection platform is regularly transmitted to the network. At least two communication relay devices send network quality detection instructions, the at least two communication relay devices include a network detection starting point device and a network detection end point device, and the network quality detection platform receives the network detection end point device. The network quality detection result uploaded by the network detection instruction in response to the network detection instruction , determine the network quality parameters based on the network quality detection results, and send the network quality parameters to the cloud rendering server, so that the cloud rendering server can periodically receive the network data transmission channel sent by the network quality detection platform during the running process of the target cloud application process. Network quality parameter, adjust the rendering mode and/or encoding mode of the target cloud application according to the network quality parameter; in the embodiment of the present disclosure, the cloud rendering server adaptively adjusts the rendering and/or encoding work of the cloud application according to the network quality, so that the virtual reality terminal The received picture can be kept in line with the user's field of view to avoid situations such as the picture being out of frame.

Brief Description of Drawings

FIG. 1 is a schematic diagram of the architecture of an adaptive cloud rendering system based on network communication quality according to an exemplary embodiment of the present disclosure;

FIG. 2 is a schematic diagram of a network data transmission channel according to an exemplary embodiment of the present disclosure; and

FIG. 3 is a schematic flowchart of an adaptive rendering method based on network communication quality according to an exemplary embodiment of the present disclosure.

detail

Exemplary embodiments will be described in detail herein, examples of which are illustrated in the accompanying drawings. Where the following description refers to the drawings, the same numerals in different drawings refer to the same or similar elements unless otherwise indicated. The implementations described in the illustrative examples below are not intended to represent all implementations consistent with this disclosure. Rather, they are merely examples of apparatus and methods consistent with some aspects of the present disclosure as recited in the appended claims.

The terminology used in the present disclosure is for the purpose of describing particular embodiments only and is not intended to limit the present disclosure. As used in this disclosure and the appended claims, the singular forms "a," "the," and "the" are intended to include the plural forms as well, unless the context clearly dictates otherwise. It will also be understood that the term "and/or" as used herein refers to and includes any and all possible combinations of one or more of the associated listed items.

It should be understood that although the terms first, second, third, etc. may be used in this disclosure to describe various pieces of information, such information should not be limited by these terms. These terms are only used to distinguish the same type of information from one another. For example, the first information may also be referred to as the second information, and similarly, the second information may also be referred to as the first information, without departing from the scope of the present disclosure. Depending on the context, the word "if" as used herein can be interpreted as "at the time of" or "when" or "in response to determining."

FIG. 1 is a schematic diagram of the architecture of an adaptive cloud rendering system based on network communication quality according to an exemplary embodiment of the present disclosure. 1, the system includes: a cloud rendering server 10 and a network quality detection platform 20, the cloud rendering server 10 establishes a communication connection with the virtual reality terminal 40 through a network data transmission channel 30, and the network data transmission channel 30 includes a plurality of Communication relay device; exemplarily, three communication relay devices are shown in the figure, namely: a first communication relay device, a second communication relay device and a third communication relay device.

In some embodiments, the cloud rendering server 10 is configured to start the target cloud application process in response to the start instruction of the target cloud application sent by the virtual reality terminal 40, and render the application scene generated by the running of the target cloud application process to obtain the application image , collect the application image and the corresponding audio data, encode it into a video stream, and send the video stream to the virtual reality terminal 40 through the network data transmission channel 30 .

The above-mentioned cloud rendering server 10 is also configured to periodically receive network quality parameters representing the network quality of the network data transmission channel sent by the network quality detection platform 20 during the running process of the target cloud application process, and adjust the network quality parameters of the target cloud application according to the network quality parameters. Rendering method and/or encoding method.

In some embodiments, the above-mentioned network quality detection platform 20 is configured to periodically send network quality detection instructions to at least two communication relay devices on the network transmission data transmission channel 30, and the at least two communication relay devices include a network detection starting point device and the network detection endpoint device, the network quality detection platform is further configured to receive the network quality detection result obtained by responding to the network detection instruction sent by the network detection endpoint device, determine the network quality parameter based on the network quality detection result, and send the network quality parameter to the cloud. render server.

In some embodiments, the above-mentioned communication relay device is configured as:

Receive a network quality detection instruction sent by the network quality detection platform; wherein, the network quality detection instruction includes the identifier of the target cloud application to be detected and the network quality detection strategy. The network quality detection strategy indicates the required quality detection methods, such as delay detection and packet loss detection.

In the case where the network quality detection strategy includes delay detection; the communication relay device, which is the starting device for delay detection, after receiving the detection instruction, generates the same service level and the same transmission path as the service level of the service packet sent by the target application process. A detection packet is delayed and sent, and the detection packet includes time stamp information.

As the communication transit device of the terminal device of delay detection, if it receives the above-mentioned delay detection packet, it parses the delay detection packet to obtain timestamp information, calculates the delay data according to the timestamp information, and obtains the delay data according to the timestamp information. Upload to the network quality detection platform. The network quality detection platform further sends the delay data to the cloud rendering server.

In some embodiments, it is determined whether the communication relay device serves as the origin device or the end device according to the detection instruction issued by the network quality management platform.

When the network quality detection strategy includes the packet loss detection method, the communication relay device, which is the starting device for packet loss detection, encapsulates the service packets of the target application with a packet loss detection label and sends them. A field for packet loss detection and a coding field for counting service packets.

The packet encapsulation format includes:

Extended label (XL): The standard extended label value 15 defined in RFC7274 is used to indicate that the subsequent label is an extended special-purpose label;

Extended Special Purpose Label (ESPL): Takes a value that has not been assigned in the IANA definition and is used to indicate that subsequent labels are application identification labels, such as label 101 may be used.

Quality Detection Label: Quality detection information used to identify the application. A total of 20 bits in the label are available, and various types of quality detection information for different applications can be represented by the combination of meanings of different bits.

Application Identification: Multiple digits can be used to identify an application.

Quality category: It can be divided into different quality categories such as packet loss and delay.

Quality information: can carry specific quality information. In packet loss detection, it is an encoded field used for counting.

The packaging sequence of the tags can refer to the prior art.

As the communication relay device of the packet loss detection end device, it compares the statistics of the number of packets actually received in the specified sending period with the number of the service packets actually sent in the specified period, and calculates the packet loss data. , and upload the packet loss data to the network quality detection platform; the network quality detection platform is configured to send the packet loss data to the cloud rendering server.

In some implementations, when the communication relay device is used as the starting device for packet loss detection, it performs packet continuous coding on the service packets, and sends a specified number of sets of the service packets within one transmission cycle; if all If the communication relay device is an end device of packet loss detection, the communication relay device is configured to perform statistical detection on the number of received service packets after more than one transmission period.

In some embodiments, the sending end device performs block tag count encoding on the service packets belonging to the target application, and the receiving end device delays detection after receiving the service packets. Exemplarily, the 1st to 50th packets that are sent belonging to the same application are encoded respectively, for example, the count code is 1, and the count code is set to 2 for the 51st to 100th packets sent belonging to the application. , set the count code to 3 for the 101st to 150th packets sent belonging to the application, and encode them in sequence until the code is 4, and re-encode the service packets according to the above method. After receiving the service packet, the receiving end device parses the label of the service packet, and counts the number of received packets with different count codes in real time. After the message is sent, it is judged whether the counted number of service packets with code 1 is 50. If not, it is judged that data packet loss has occurred, and the number of lost packets is calculated; after receiving the first packet with code 1 Afterwards, it is judged whether the counted number of service packets with code 2 is 50, and so on; it may also be after receiving the first packet with code 3, to judge the data of service packets with code 1 that have been counted Whether it is 50 is equivalent to checking the received service packets every three count cycles.

Using the above method to detect network quality has the advantages of more accurate detection and the ability to locate network faults.

The above-mentioned network quality detection platform may be triggered by the cloud rendering server to perform quality detection, or may perform network quality detection according to user settings, which is not limited in the present disclosure.

Referring to FIG. 2 , the above-mentioned first communication relay device 301 , second communication relay device 302 and third communication relay device 303 may be switch devices.

In some embodiments, the cloud rendering server is configured to adjust the rendering based on the network quality data by:

In the case that the packet loss data is less than the specified packet loss data, if the delay data is greater than the specified delay threshold, the application scene generated by running the target application process is rendered in a way larger than the FOV of the virtual reality terminal.

If the delay data is smaller than the specified delay threshold, the application picture is rendered according to the field of view of the terminal display device, or the above-mentioned way greater than the FOV of the virtual reality terminal is used for rendering.

In some implementations, the FOV of the existing virtual display terminal is generally a horizontal field of view of 120 degrees. In this embodiment, when the delay data is greater than the specified delay threshold, the average speed of the user's head movement is comprehensively considered , and a new magnification ratio K=(fov+tw)/fov is obtained according to the following formula. Then, the magnification ratio K is used to magnify and render the application scene, so as to avoid the situation that the screen display of the virtual reality terminal deviates and cannot completely cover the user's field of view if the network quality is poor under the condition of the user's head movement.

In some embodiments, the above-mentioned cloud rendering server is further configured to adjust the rendering mode according to the network quality data in the following ways:

In the case that the packet loss data is greater than the specified packet loss data, the operating system is triggered to close the target cloud application process.

If the packet loss is greater than the specified number of packet losses, it indicates that the network quality is poor and the experience of the end user cannot be guaranteed. In this case, the operating system will be triggered to terminate the target application process.

In some embodiments, the above-mentioned cloud rendering server is configured to render the application scene in a manner greater than the FOV of the virtual reality terminal in the following manner:

The application scene is rendered in a manner larger than the FOV of the virtual reality terminal, and the part corresponding to the user's area of interest is rendered in accordance with the first resolution (for example, the resolution is 1080P), and the part corresponding to the user's non-interesting area is rendered in accordance with Rendering is performed at a second resolution (for example, the resolution is 720P), and the first resolution is greater than the second resolution.

High-resolution rendering is used for the user's area of interest, and the user experience is guaranteed while fully considering the large network delay.

In some embodiments, after rendering is performed according to a field of view angle larger than the FOV of the virtual reality terminal, in order to further improve the transmission efficiency, the above-mentioned cloud rendering server is further configured as:

Dividing different parts of the image obtained by rendering the image according to the first resolution and the second resolution, respectively, to obtain a first image block and a second image block; and

The first image block and the second image block are encoded according to the first code rate (for example, the code rate is 40M) and the second code rate (for example, the code rate is 20M), and the encoded first image block and the second image block are encoded. The two images are sent to the terminal according to the corresponding relationship; the first code rate is lower than the second code rate.

FIG. 3 is a schematic flowchart of an adaptive rendering method based on network communication quality of the present disclosure; with reference to FIG. 3 , the method includes the following steps S31-S33:

S31, the cloud rendering server starts the target cloud application in response to the start instruction of the target cloud application sent by the terminal, renders the application scene generated by running the target cloud application to obtain image data and audio data, and renders the image data and audio data. Data and audio data are encoded into a video stream, and the video stream is sent to the virtual reality terminal through the data transmission channel;

S32, the network quality detection platform periodically sends a network quality detection instruction to at least two communication relay devices on the network transmission data transmission channel, the at least two communication relay devices include a network detection start point device and a network detection end point device, receive The network detection endpoint device determines the network quality parameter based on the detection result in response to the detection result uploaded by the network detection instruction, and sends the network quality parameter to the cloud rendering server; and

S33: The cloud rendering server receives the network quality parameter of the network data transmission channel sent by the network quality detection platform, and adjusts the rendering mode and/or encoding mode of the target cloud application according to the network quality parameter.

In some embodiments, the above-mentioned communication relay device is configured to receive a network quality detection instruction sent by a network quality detection platform; wherein, the network quality detection instruction includes an identifier of the target cloud application to be detected and a network quality detection strategy. The network quality detection strategy indicates the required quality detection methods, such as delay detection and packet loss detection.

As the communication transit device of the terminal device of delay detection, if it receives the above-mentioned delay detection packet, it parses the delay detection packet to obtain timestamp information, calculates the delay data according to the timestamp information, and obtains the delay data according to the timestamp information. Upload to the network quality detection platform. Then, the network quality detection platform further sends the delay data to the cloud rendering server.

The above cloud rendering server is configured to adjust the rendering method according to the network quality data in the following ways:

In the case where the packet loss data is less than the specified packet loss data, if the delay data is greater than the specified delay threshold, the application scene generated by the running of the target application process is rendered in a way larger than the FOV of the virtual reality terminal; if the delay data is greater than If the specified delay threshold is used, the application picture is rendered according to the field of view of the terminal display device. In the case that the packet loss data is greater than the specified packet loss data, the operating system is triggered to close the target cloud application process.

In some embodiments, the above-mentioned cloud rendering server renders the application scene in a manner larger than the FOV of the virtual reality terminal, and the part corresponding to the user's area of interest is rendered in accordance with the first resolution (for example, the resolution is 1080P), The part corresponding to the non-interested area of the user is rendered according to a second resolution (for example, the resolution is 720P), and the first resolution is larger than the second resolution.

In some embodiments, after rendering according to a field of view larger than the FOV of the virtual reality terminal, in order to further improve transmission efficiency, the cloud rendering server renders the image according to the first resolution and the second resolution respectively. Different parts of the obtained image are divided into blocks to obtain the first image block and the second image block; An image block and a second image block are encoded, and the encoded first image block and the second image are sent to the terminal according to the corresponding relationship; the first code rate is lower than the second code rate.

In certain embodiments, the method further comprises:

The communication relay device receives a network quality detection instruction sent by the network quality detection platform, where the network quality detection instruction includes the identifier of the target cloud application and a network quality detection strategy;

If the network quality detection strategy includes: delay detection;

If the communication relay device is used as the starting device for delay detection, it will generate a delay detection packet with the same sending service level and the same transmission path as the service packet of the application, and the detection packet includes time stamp information. ;

If the communication relay device is used as the end device of the delay detection, it receives the delay detection message, parses the time stamp information in the delay detection message, and calculates the time delay according to the time stamp information and the reception time stamp. data, and upload the delay data to the network quality detection platform; and

The network quality detection platform sends the delay data to the cloud rendering server.

For the execution steps of each device in the system in the embodiment of the present disclosure, reference may be made to the process described in the foregoing system embodiment.

For the apparatus embodiments, since they basically correspond to the method embodiments, reference may be made to the partial descriptions of the method embodiments for related parts. The device embodiments described above are only illustrative, wherein the units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in One place, or it can be distributed over multiple network elements. Some or all of the modules can be selected according to actual needs to achieve the purpose of the solution of the present disclosure. Those of ordinary skill in the art can understand and implement it without creative effort.

Computers suitable for the execution of a computer program include, for example, general and/or special purpose microprocessors, or any other type of central processing unit. Typically, the central processing unit will receive instructions and data from read only memory and/or random access memory. The basic components of a computer include a central processing unit configured to implement or execute instructions and one or more memory devices configured to store instructions and data. Typically, a computer will also include, or be operatively coupled to, one or more mass storage devices configured to store data, such as magnetic, magneto-optical or optical disks, to receive data therefrom or to It transmits data, or both. However, the computer does not have to have such a device. Additionally, the computer may be embedded in another device, such as a mobile phone, personal digital assistant (PDA), mobile audio or video player, game console, global positioning system (GPS) receiver, or universal serial bus (USB) Flash drives are portable storage devices.

Computer-readable media suitable for storage of computer program instructions and data include all forms of non-volatile memory, media, and memory devices, including semiconductor memory devices (eg, EPROM, EEPROM, and flash memory devices), magnetic disks (eg, internal hard disks or removable discs), magneto-optical discs, and CD-ROM and DVD-ROM discs. The processor and memory may be supplemented by or incorporated in special purpose logic circuitry.

Although this specification contains many specific implementation details, these should not be construed as limiting the scope of any disclosure or what may be claimed, but rather are used primarily to describe features of particular disclosed specific embodiments. Certain features that are described in this specification in multiple embodiments can also be implemented in combination in a single embodiment. On the other hand, various features that are described in the context of a single embodiment can also be implemented in multiple embodiments separately or in any suitable subcombination. Furthermore, although features may function as described above in certain combinations and even be originally claimed as such, one or more features from a claimed combination may in some cases be removed from the combination and the claimed A protected combination may point to a subcombination or a variation of a subcombination.

Although operations are depicted in the figures in a particular order, this should not be construed as requiring that the operations be performed in the particular order shown or sequentially, or that all illustrated operations be performed, to achieve desirable results. In some cases, multitasking and parallel processing may be advantageous. Furthermore, the separation of the various system modules and components in the above-described embodiments should not be construed as requiring such separation in all embodiments, and it should be understood that the described program components and systems may generally be integrated together in a single software product , or packaged into multiple software products.

Specific embodiments of the subject matter have been described. Other embodiments are within the scope of the appended claims. In some cases, the actions recited in the claims can be performed in a different order and still achieve desirable results. Furthermore, the processes depicted in the figures do not necessarily require the particular order shown, or sequential order, to achieve desirable results. In some implementations, multitasking and parallel processing may be advantageous.

The above descriptions are only preferred embodiments of the present disclosure, and are not intended to limit the present disclosure. Any modifications, equivalent replacements, improvements, etc. made within the spirit and principles of the present disclosure shall be included in the present disclosure. within the scope of protection.

Claims

An adaptive cloud rendering system based on network communication quality, comprising: a cloud rendering server and a network quality detection platform, the cloud rendering server establishes a communication connection with a virtual reality terminal through a network data transmission channel, and the network data transmission channel includes multiple Communication relay equipment;

The cloud rendering server is configured to start the target cloud application process in response to the start instruction of the target cloud application sent by the virtual reality terminal, render the application scene generated by the operation of the target cloud application process to obtain the application image, and The application image and the corresponding audio data are encoded into a video stream, and the video stream is sent to the virtual reality terminal through the data transmission channel;

The cloud rendering server is further configured to, during the running process of the target cloud application process, regularly receive the network quality parameter of the network data transmission channel sent by the network quality detection platform, and adjust the target according to the network quality parameter how the cloud application is rendered and/or encoded; and

The network quality detection platform is configured to periodically send network quality detection instructions to at least two communication relay devices on the network transmission data transmission channel, and the at least two communication relay devices include a network detection starting point device and a network detection end point device; the network quality detection platform is further configured to receive a network quality detection result sent by the network detection endpoint device in response to the network detection instruction, determine a network quality parameter based on the network quality detection result, and determine the network quality based on the network quality detection result. parameters are sent to the cloud rendering server.
The method of claim 1, wherein the communication relay device is configured to:

receiving the network quality detection instruction sent by the network quality detection platform; wherein, the network quality detection instruction includes the application identifier of the target cloud application and the network quality detection strategy;

If the network quality detection strategy includes: delay detection;

If the communication relay device is used as a starting device for delay detection, it generates and sends a delay detection packet with the same service level and transmission path as the service packet of the target application process, and sends the detection packet. including timestamp information;

If the communication relay device is used as the end device of the delay detection, it receives the delay detection message, parses the delay detection message to obtain the timestamp information, and calculates the delay according to the timestamp information. data, and upload the delay data to the network quality detection platform; and

The network quality detection platform is configured to send the delay data to the cloud rendering server.
The method of claim 2, wherein, if the network quality detection strategy includes packet loss detection, the communication relay device is configured to:

If the communication relay device is used as a starting point device for packet loss detection, it will encapsulate the service packet of the application with a packet loss detection label and send it; wherein, the packet loss detection label contains a packet loss detection label. field and an encoded field used to count the service message;

If the communication relay device is used as the end device of the packet loss detection, it will compare the number of packets actually received in the specified sending period with the number of the service packets actually sent in the specified period. , calculate the packet loss data, and upload the packet loss data to the network quality detection platform; and

The network quality detection platform is configured to send the packet loss data to the cloud rendering server.
The system according to claim 3, wherein, when the communication relay device is used as a starting device for packet loss detection, the communication relay device is configured as:

Carrying out grouping and continuous coding on the service message, and sending a group of the service message in a specified number within one transmission cycle; and

If the communication relay device is an end device of packet loss detection, the communication relay device is configured to perform statistical detection on the number of the service packets received after more than one transmission period.
The system of claim 4, wherein the cloud rendering server is configured to adjust the rendering mode according to the network quality data in the following manner:

In the case that the packet loss data is less than the specified packet loss data, if the delay data is greater than the specified delay threshold, the application scenario generated by running the target application process is larger than the FOV of the virtual reality terminal. to render.
The system of claim 5, wherein the cloud rendering server is further configured to adjust the rendering mode according to the network quality data in the following manner:

In the case that the packet loss data is greater than the specified packet loss data, the operating system is triggered to close the target cloud application process.
The system according to claim 5 or 6, wherein the cloud rendering server is configured to render the application scene in a manner greater than the FOV of the virtual reality terminal in the following manner:

Rendering the application scene in a manner larger than the FOV of the virtual reality terminal, and rendering the part corresponding to the user's region of interest according to the first resolution, and rendering the part corresponding to the user's non-interesting region according to the second resolution; Wherein, the first resolution is greater than the second resolution.
The system of claim 7, wherein the cloud rendering server is further configured to:

Dividing different parts of the image obtained by rendering the image according to the first resolution and the second resolution, respectively, to obtain a first image block and a second image block; and

encoding the first image block and the second image block according to the first code rate and the second code rate respectively, and sending the encoded first image block and the second image to the terminal according to the corresponding relationship;

Wherein, the first code rate is lower than the second code rate.
An adaptive rendering method based on network communication quality, which includes:

The cloud rendering server starts the target cloud application in response to the start instruction of the target cloud application sent by the terminal, renders the application scene generated by the operation of the target cloud application to obtain image data and audio data, and converts the image data and the The audio data is encoded into a video stream, and the video stream is sent to the virtual reality terminal through the data transmission channel;

The network quality detection platform periodically sends network quality detection instructions to at least two communication relay devices on the network transmission data transmission channel, and the at least two communication relay devices include a network detection starting point device and a network detection end point device, and receives the network quality detection instructions. The network detection endpoint device responds to the detection result uploaded by the network detection instruction, determines the network quality parameter based on the detection result, and sends the network quality parameter to the cloud rendering server; and

The cloud rendering server receives the network quality parameter of the network data transmission channel sent by the network quality detection platform, and adjusts the rendering mode and/or the encoding mode of the target cloud application according to the network quality parameter.
The method according to claim 9, further comprising: the communication relay device receiving a network quality detection instruction sent by the network quality detection platform, wherein the network quality detection instruction includes the identifier of the target cloud application and the network quality detection strategy;

If the network quality detection strategy includes: delay detection;

If the communication relay device is used as the starting device for delay detection, it will generate a delay detection packet with the same sending service level and the same transmission path as the service packet of the application, and the detection packet includes time stamp information. ;

If the communication relay device is used as the end device of the delay detection, it receives the delay detection message, parses the time stamp information in the delay detection message, and calculates the time delay according to the time stamp information and the reception time stamp. data, and upload the delay data to the network quality detection platform; and

The network quality detection platform sends the delay data to the cloud rendering server.