WO2022127890A1

WO2022127890A1 - Rendering method based on cloud service, and related device therefor

Info

Publication number: WO2022127890A1
Application number: PCT/CN2021/139019
Authority: WO
Inventors: 陈普
Original assignee: 华为云计算技术有限公司
Priority date: 2020-12-18
Filing date: 2021-12-17
Publication date: 2022-06-23
Also published as: CN114650434A

Abstract

Disclosed are a rendering method based on a cloud service, and a related device therefor, which can render a video having a better quality, and can play the video on a terminal device having a limited computation capability, thereby improving the user experience. The method of the present application comprises: a serving node receiving a rendering instruction of a client for a target display area; the service node sending a rendering request to a rendering node according to the rendering instruction, wherein the rendering request is used for instructing the rendering node to invoke a graphics processing unit (GPU) provided in the rendering node to render the target display area, so as to generate a video stream that comprises a plurality of playing pictures; the serving node sending, to the client, notification information carrying a stream pulling address of the video stream, wherein the notification information is used for instructing the client to acquire the video stream from the stream pulling address and play the video stream in the target display area.

Description

A cloud service-based rendering method and related equipment

This application claims the priority of the Chinese patent application filed on December 18, 2020 with the application number 202011505914.5 and the application title is "a rendering method based on cloud services and related equipment", the entire contents of which are by reference Incorporated in this application.

technical field

The present application relates to the technical field of computer graphics, and in particular, to a cloud service-based rendering method and related devices.

Background technique

With the rapid development of the computer industry, the content in the browser has become richer and more interesting. For example, a browser on a certain terminal device can play dynamic content such as large-scale three-dimensional (3-dimension, 3D) games and high-definition multimedia videos, thereby providing users with a better viewing experience.

If the browser of the terminal device wants to play a certain video, an image processing unit (graphics processing unit, GPU) on the terminal device needs to perform a series of complex image rendering processing, so as to render the video to be displayed. However, on some portable terminal devices, such as smart phones, tablet computers, etc., the computing power of the GPU of such devices is generally poor, so such devices with limited computing power perform video rendering through their own GPUs During processing, it is often impossible to render videos with better quality, resulting in poor user experience.

SUMMARY OF THE INVENTION

Embodiments of the present application provide a cloud service-based rendering method and related devices, which can render a video with better quality and play it on a terminal device with limited computing power, thereby improving user experience.

A first aspect of the embodiments of the present application provides a rendering method based on a cloud service, the method comprising:

On a terminal device with limited computing power, a client, such as a browser, is usually deployed. The client can display certain content in the entire screen area (for example, display a three-dimensional web page, including static content and dynamic content) for the user to watch and use. When the client determines that the GPU of its terminal device cannot render the video stream that needs to be played in the target display area, it sends a rendering instruction for the target display area to the service node, and the rendering instruction is used to instruct the server node to complete the video stream. remote rendering to play the video stream in the target display area.

After receiving the client's rendering instruction for the target display area, the service node can determine, based on the rendering instruction, that the client requests remote rendering of the target display area, and then generates a rendering request, which is used to instruct the rendering node to call its own GPU to display the target. Regions are rendered to generate a video stream that includes multiple playback frames. The service node then sends the render request to the render node.

After the rendering node receives the rendering request, it completes the rendering of the video stream through the GPU, thereby obtaining the video stream.

Finally, the service node sends notification information carrying the streaming address of the video stream to the client, where the notification information is used to instruct the client to obtain the video stream from the streaming address and play the video stream in the target display area. In this way, after receiving the notification information, the client can obtain the pull stream address from the notification information, and obtain the video stream from the rendering node based on the pull stream address, so as to play the video stream in the target display area.

It can be seen from the above method that after receiving the rendering instruction for the target display area from the client, the service node can send a rendering request to the rendering node, so that the rendering node invokes its own GPU to render the target display area to obtain a video stream. Then, the service node sends notification information carrying the streaming address of the video stream to the client, so that the client obtains the video stream from the rendering node based on the streaming address, so as to play the video stream in the target display area. In the foregoing process, since the rendering processing of the video stream is completed by a remote rendering node, the GPU of the rendering node generally has relatively strong computing power, and can render a video stream with better quality. Therefore, even if the computing power of the terminal device where the client is located is limited, it can obtain the rendered video stream with better quality from the rendering unit, and play the video stream in the target display area, thereby improving user experience.

In a possible implementation manner, the rendering instruction carries rendering demand information, and before the service node sends the rendering request to the rendering node, the method further includes: the service node selects a rendering node matching the rendering demand information from the rendering resource pool. In the foregoing implementation manner, the rendering resource pool includes multiple rendering nodes, and GPUs of different rendering nodes have different computing capabilities. After receiving the rendering instruction from the client, the service node may determine the rendering requirement information from the rendering instruction, where the rendering requirement information is used to indicate the computing power required for rendering the target display area. Therefore, the service node can select the rendering node matching the rendering requirement information from the rendering resource pool. In this way, since the GPU of the selected rendering node has sufficient computing power, a video stream with better quality can be rendered.

In a possible implementation manner, the rendering instruction carries rendering demand information, and before the service node sends the rendering request to the rendering node, the method further includes: the service node invokes the cloud service to create a rendering node matching the rendering demand information. In the foregoing implementation manner, after receiving the rendering instruction from the client, the service node may determine the rendering requirement information from the rendering instruction, where the rendering requirement information is used to indicate the computing power required for rendering the target display area. Therefore, the service node can directly call the cloud service to create a rendering node that matches the rendering demand information. In this way, since the GPU of the created rendering node has sufficient computing power, a video stream with better quality can be rendered.

In a possible implementation manner, before the service node receives the rendering request from the client for the target display area, the method further includes: the service node provides an access entry for the 3D web page; the service node receives the access request from the client for the 3D web page; serving The node sends a rendering instruction of the 3D webpage to the client according to the access request. In the foregoing implementation manner, the service node may provide the client with an access entry for the three-dimensional web page, so that the client sends an access request for the three-dimensional web page to the service node through the access entry. Then, after determining that the client needs to access the three-dimensional webpage based on the access request, the service node sends a rendering instruction of the three-dimensional webpage to the client, so that the client renders the entire screen area to generate the three-dimensional webpage.

In a possible implementation manner, before the service node sends the notification information carrying the streaming address of the video stream to the client, the method further includes: the service node receives the streaming address sent by the rendering node. In the foregoing implementation manner, after the rendering node completes rendering and obtains the video stream, it can set a dedicated streaming address for the video stream, and send the streaming address to the service node, so that the service node forwards the streaming address to the client. Further, the client can obtain the rendered video stream from the rendering node based on the pull stream address.

In a possible implementation manner, before the service node sends the notification information carrying the streaming address of the video stream to the client, the method further includes: the service node pre-records the streaming address. In the foregoing implementation manner, the service node and the rendering node record the streaming address set for the video stream in advance. Therefore, after the rendering node completes rendering and obtains the video stream, the service node can directly send the streaming address of the video stream to the client, so that the client can obtain the rendered video stream from the rendering node based on the streaming address.

In a possible implementation manner, the rendering node includes a virtual machine provided with a GPU, a container, and a bare metal server provided in a data center.

In a possible implementation manner, the rendering node is a physical server provided with a GPU.

As can be seen from the above technical solutions, the embodiments of the present application have the following advantages:

A second aspect of the embodiments of the present application provides a rendering device based on cloud services, the device is the aforementioned service node, and the device includes: a receiving module for receiving a rendering instruction from a client for a target display area; a sending module is used to send a rendering request to the rendering node according to the rendering instruction, and the rendering request is used to instruct the rendering node to call the image processing unit GPU arranged on the rendering node to render the target display area to generate a video stream including a plurality of playback pictures; the sending module, It is also used to send notification information carrying the streaming address of the video stream to the client, where the notification information is used to instruct the client to obtain the video stream from the streaming address and play the video stream in the target display area.

It can be seen from the above device that after receiving the rendering instruction for the target display area from the client, the service node can send a rendering request to the rendering node, so that the rendering node invokes its own GPU to render the target display area to obtain a video stream. Then, the service node sends notification information carrying the streaming address of the video stream to the client, so that the client obtains the video stream from the rendering node based on the streaming address, so as to play the video stream in the target display area. In the foregoing process, since the rendering processing of the video stream is completed by a remote rendering node, the GPU of the rendering node generally has relatively strong computing power, and can render a video stream with better quality. Therefore, even if the computing power of the terminal device where the client is located is limited, it can obtain the rendered video stream with better quality from the rendering unit, and play the video stream in the target display area, thereby improving user experience.

In a possible implementation manner, the rendering instruction carries rendering requirement information, and the apparatus further includes: a processing module configured to select a rendering node matching the rendering requirement information from the rendering resource pool.

In a possible implementation manner, the rendering instruction carries rendering requirement information, and the apparatus further includes: a processing module configured to call a cloud service to create a rendering node matching the rendering requirement information.

In a possible implementation manner, the sending module is further configured to provide an access entry for the three-dimensional web page; the receiving module is further configured to receive an access request from the client for the three-dimensional web page; the sending module is further configured to send the client to the client according to the access request Sends rendering instructions for 3D web pages.

In a possible implementation manner, the receiving module is further configured to receive the pull stream address sent by the rendering node.

In a possible implementation manner, the processing module is further configured to record the pull stream address in advance.

A third aspect of the embodiments of the present application provides a network device, where the network device includes: a processor and a memory;

memory for storing computer-executed instructions;

The processor is configured to execute computer-executable instructions stored in the memory, so that the network device implements the method described in the first aspect or any possible implementation manner of the first aspect.

A fourth aspect of the embodiments of the present application is a computer storage medium, comprising computer-readable instructions, when the computer-readable instructions are executed, the method described in the first aspect or any possible implementation manner of the first aspect is implemented .

A fifth aspect of the embodiments of the present application is a computer program product containing instructions, which, when executed on a computer, cause the computer to execute the method described in the first aspect or any possible implementation manner of the first aspect.

In the embodiment of the present application, after receiving the rendering instruction for the target display area from the client, the service node may send a rendering request to the rendering node, so that the rendering node invokes its own GPU to perform rendering processing on the target display area to obtain a video stream. Then, the service node sends notification information carrying the streaming address of the video stream to the client, so that the client obtains the video stream from the rendering node based on the streaming address, so as to play the video stream in the target display area. In the foregoing process, since the rendering processing of the video stream is completed by a remote rendering node, the GPU of the rendering node generally has relatively strong computing power, and can render a video stream with better quality. Therefore, even if the computing power of the terminal device where the client is located is limited, it can obtain the rendered video stream with better quality from the rendering unit, and play the video stream in the target display area, thereby improving user experience.

Description of drawings

1 is a schematic diagram of a cloud service system provided by an embodiment of the present application;

2 is a schematic flowchart of a rendering method based on a cloud service provided by an embodiment of the present application;

3 is another schematic flowchart of a rendering method based on a cloud service provided by an embodiment of the present application;

4 is another schematic flowchart of a rendering method based on a cloud service provided by an embodiment of the present application;

5 is a schematic structural diagram of a rendering apparatus based on a cloud service provided by an embodiment of the present application;

FIG. 6 is a schematic structural diagram of a network device provided by an embodiment of the present application.

Detailed ways

The technical solutions in the embodiments of the present application will be described in detail below with reference to the accompanying drawings in the embodiments of the present application.

The terms "first", "second" and the like in the description and claims of the present application and the above drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It is to be understood that data so used may be interchanged under appropriate circumstances so that the embodiments described herein can be practiced in sequences other than those illustrated or described herein. Furthermore, the terms "comprising" and "having", and any variations thereof, are intended to cover non-exclusive inclusion, for example, a process, method, system, product or device comprising a series of steps or modules is not necessarily limited to those expressly listed Rather, those steps or modules may include other steps or modules not expressly listed or inherent to the process, method, product or apparatus. The naming or numbering of the steps in this application does not mean that the steps in the method flow must be executed in the time/logical sequence indicated by the naming or numbering, and the named or numbered process steps can be implemented according to the The technical purpose is to change the execution order, as long as the same or similar technical effects can be achieved. The division of modules in this application is a logical division. In practical applications, there may be other divisions. For example, multiple modules may be combined or integrated into another system, or some features may be ignored. , or not implemented, in addition, the shown or discussed mutual coupling or direct coupling or communication connection may be through some ports, and the indirect coupling or communication connection between modules may be electrical or other similar forms. There are no restrictions in the application. In addition, the modules or sub-modules described as separate components may or may not be physically separated, may or may not be physical modules, or may be distributed into multiple circuit modules, and some or all of them may be selected according to actual needs. module to achieve the purpose of the solution of this application.

With the rapid development of computer technology, users' requirements for browsers have also increased. For example, the web pages displayed by browsers include both static content such as text information, and dynamic content such as high-definition videos, so as to satisfy users' needs various needs. If the browser of the terminal device wants to play a certain video, an image processing unit (graphics processing unit, GPU) on the terminal device needs to perform a series of complex image rendering processing, so as to render the video to be displayed. However, on some portable terminal devices, such as smart phones, tablet computers, etc., the computing power of the GPU of such devices is generally poor, so such devices with limited computing power perform video rendering through their own GPUs During processing, it is often impossible to render videos with better quality, resulting in poor user experience.

In order to solve the above problem, an embodiment of the present application provides a cloud service system. FIG. 1 is a schematic diagram of a cloud service system provided by an embodiment of the present application. As shown in FIG. 1 , the cloud service system includes: a client, a service node, and a rendering node. Communication can be achieved between the client, the service node, and the rendering node, that is, information transmission can be achieved between them. It can be seen that the client can communicate with the rendering node directly, or communicate with the rendering node through the service node. The following will introduce the client, service node and rendering node respectively:

The client is usually deployed on a certain terminal device, that is, the client is an application running on the terminal device, such as a browser, so the user can start the browser on the terminal device to browse three-dimensional web pages through the browser. It should be noted that the information transmission can be completed between the client and the service node through the hypertext transfer protocol (HTTP), and the client and the rendering node can be through Websocket, hypertext live streaming (http live streaming, HLS), webrtc, etc. to complete information transmission, the web page displayed by the client can be described by hyper text markup language (HTML), and the programming language supported by the client can be javascript or other types of Programming language. It is worth noting that the client can detect the rendering capability of the terminal device where it is located based on javascript, that is, the computing capability of the GPU of the terminal device where it is located, so as to determine whether the GPU can render dynamic content with better quality, for example, Video streaming and more.

A service node is a network (Web) service node, which can be deployed in various ways. For example, a service node can be a separate physical server (also called a network device), or a service node can also be a certain server. A virtual machine loaded on a physical server, for example, a service node can also be a container loaded on a physical server, and so on. Serving nodes can serve pages to clients and rendering nodes, such as serving pages with static content, serving pages with dynamic content, and serving pages with static content and dynamic content, and so on. The foregoing page service is briefly introduced through an example: the service node can send a rendering program for rendering a certain webpage to the client, and the client can execute the rendering program to render the webpage for display.

Rendering nodes can also be deployed in various ways. For example, a rendering node can be a separate physical server, or a rendering node can also be a virtual machine loaded on a physical server. Could be a container loaded on a physical server, etc. It is worth noting that when both the rendering node and the service node are virtual machines (or containers), they can be deployed on the same physical server or on different physical servers, which is not limited here. No matter how the rendering node is deployed, the rendering node contains a GPU, so the rendering node can execute the rendering program on behalf of the client, thereby realizing remote rendering, and after the rendering is completed and the video stream is obtained, the video stream can be sent to the client for display. . It should be noted that the client and the rendering unit support the same three-dimensional rendering programming technology, for example, a network graphics library (web graphics library, WebGL) technology and so on. Correspondingly, the rendering program can be presented in a WebGL program or in other forms. The WebGL program can write a WebGL interface through javascript, and the program can include the rendering data to be used during rendering and the rendering operations to be performed, wherein the rendering data can include the rendering data to be rendered. The target's vertex coordinates, triangle index, color, metalness, and roughness data, and rendering operations can include a series of rasterization operations, such as coordinate transformation, geometric discretization, and so on.

It should be noted that, for the convenience of description, "the client executes the rendering program" involved in this application may be understood as "the GPU of the terminal device where the client is located executes the rendering program". Similarly, "the rendering node executes the rendering program" can be understood as "the GPU of the rendering node executes the rendering program", which will not be repeated in the following.

In order to further understand the implementation process of the above-mentioned system, a further introduction is given below with reference to FIG. 2 . FIG. 2 is a schematic flowchart of a rendering method based on a cloud service provided by an embodiment of the present application. As shown in FIG. 2 , the method includes:

201. The service node provides an access entry for a three-dimensional webpage.

In this embodiment, the service node can provide the client with an access portal for the 3D web page, so that the client terminal displays the access portal on the screen. If the user needs to access the 3D web page, the user can input a 3D page access request to the access portal. It should be noted that the access portal of a 3D web page is usually a web page containing static content, so the computing power required to render the access portal is not high, so the client can complete the rendering processing of the access portal locally. Specifically, the service node can send the rendering program of the access entry of the three-dimensional page to the client, and the client directly executes the rendering program, thereby rendering the access entry of the three-dimensional page, and displays the access entry on the screen of the terminal device to for users to use.

For example, suppose a three-dimensional web page is a product website containing text (information describing the product, etc.) and video stream (showing the shape of the product, etc.), and users can browse the specific information of the product on the product website. In this case, the access entrance of the 3D web page may be a login page, and after the user enters the account password on the login page, he can enter the product website for browsing.

For another example, suppose a three-dimensional web page is a three-dimensional building constructed based on virtual reality (VR) technology, and a user can tour the interior of the three-dimensional building to learn the information of the building. In this case, the access entrance of the 3D webpage may be the initial image of the 3D building, such as the door of the 3D building. After the user clicks on the door, the user can enter the interior of the 3D building for tour.

202. The service node receives an access request from the client for the three-dimensional webpage.

After the client terminal displays the access portal of the three-dimensional web page, the user may input an access request for the three-dimensional web page to the client. The access request may be the aforementioned user's login operation or the user's page click operation, or may be an operation for implementing functions such as webpage jumping, adding a website to favorites, popping up a prompt box, and audio output. Therefore, after receiving the access request for the three-dimensional web page through the access portal, the client sends the access request for the three-dimensional web page to the service node.

203. The service node sends a rendering instruction of the three-dimensional webpage to the client according to the access request.

After receiving the access request from the client, the service node can determine that the client needs to access the 3D web page, and then sends a rendering instruction of the 3D web page to the client. Rendering of 3D web pages.

In addition, the service node can also send the rendering program of the 3D web page to the client. It should be noted that the rendering program of the 3D web page and the rendering instruction of the 3D web page may be sent to the client synchronously, or may be sent to the client asynchronously. For example, the service node first sends the rendering instruction of the 3D webpage to the client, and then sends the rendering program of the 3D webpage to the client. For another example, the service node first sends the rendering program of the 3D webpage to the client, and then sends the rendering instruction of the 3D webpage to the client. For another example, the service node sends the rendering program of the 3D web page and the rendering instruction of the 3D web page to the client together, which is not limited here.

204. The client detects the local rendering capability according to the rendering instruction of the 3D webpage, and determines whether the local rendering capability meets the requirements.

After the client receives the rendering instruction of the 3D web page from the service node, it detects the local rendering capability. The client can detect local rendering capabilities in various ways: for example, the client can try to run a rendering program for a small video (the rendering program can be preset in the client, or it can be sent to the client by the service node. There is no restriction), and obtain parameters such as the power consumption and frame rate of the GPU running the rendering program, and determine the local rendering capability based on these parameters, that is, the computing capability of the GPU of the terminal device where the client is located. For another example, the client can directly obtain the model of the graphics card (including the GPU) of the terminal device where it is located, so as to determine the local rendering capability.

3D web pages usually include static content such as text information and dynamic content such as video streams. For ease of description, the text information is used to represent the static content, and the video stream is used to represent the dynamic content. Therefore, in the rendering program of the 3D web page, the client can determine the computing power required for executing the rendering program for text information and the computing power required for executing the rendering program for video streams. Generally, the rendering program for executing text information needs to be The computing power is less than the computing power required to execute the rendering program of the video stream. If it is determined that the computing capability of the GPU of the terminal device where the client is located is greater than the computing capability required to execute the rendering program of the video stream, it means that the client determines that the local rendering capability meets the requirements, and the client can render the 3D webpage locally. That is, the rendering program of the 3D web page is directly executed, thereby rendering the 3D web page, and displaying the 3D web page (including text information and video stream) on the screen. The rest of the area outside the area is used to display textual information.

If it is determined that the computing capability of the GPU of the terminal device where the client is located is less than the computing capability required for executing the rendering program of the video stream, it means that the client determines that the local rendering capability does not meet the requirements, and step 205 is performed.

205. If the client determines that the local rendering capability does not meet the requirements, send a rendering instruction for the target display area to the service node.

When the client determines that the local rendering capability does not meet the requirements, it implements the rendering processing of the text information locally, and requests the remote rendering processing of the video stream from the service node. Specifically, the client executes a rendering program for text information, thereby rendering the text information, and displaying the text information in the remaining areas of the screen except the target display area. At the same time, the client can also send a rendering instruction for the target display area to the service node (which can also be understood as a rendering instruction of the video stream), and the rendering instruction is used to instruct the server node to complete the remote rendering of the video stream, so that the target display play the video stream in the zone.

206. The service node sends a rendering request to the rendering node according to the rendering instruction for the target display area.

After the service node receives the rendering instruction from the client for the target display area, it sends a rendering request to the rendering node, and the rendering request is used to instruct the rendering node to call the GPU set on the rendering node to render the target display area to generate a rendering including multiple playback images. video stream.

For example, the rendering request includes the above-mentioned rendering instructions.

Optionally, the service node can perform format conversion on the above rendering instruction, and convert the received rendering instruction into a format suitable for rendering the image by the rendering node.

Furthermore, before the service node sends a rendering request, the service node may determine a render node for implementing remote rendering processing. Specifically, the rendering instruction for the target display area carries the rendering requirement information, and the rendering requirement information is used to indicate the computing power required for rendering the target display area, that is, the computing power required for rendering the video stream. Therefore, the service node can determine the rendering node that implements remote rendering processing in various ways according to the rendering demand information. For example, a rendering resource pool is pre-deployed in the cloud service system. Render nodes can form virtual machine clusters, container clusters, physical server clusters, and more. The GPUs of different rendering nodes have different computing capabilities. Therefore, the service node can select a rendering node that matches the rendering demand information in the rendering resource pool to implement remote rendering processing of video streams. For another example, the service node can directly call the cloud service in the cloud service system to create a new rendering node. The rendering node can be a virtual machine, container, etc., and the rendering node matches the rendering demand information, so it can be used to implement Remote rendering processing of video streams.

207. The rendering node prepares for rendering according to the rendering request.

After the rendering node receives the rendering request from the service node, it determines that it needs to meet the remote rendering requirements of the client, so it will start a series of rendering preparations related to the client. It can be understood that the rendering node is a virtual machine, container or physical server with GPU, that is, the system of the rendering node itself provides a running environment for the program related to the client (for example, browser kernel, etc.), so the rendering node It is also possible to run a program related to the client, and after the preparation, the rendering node can replace the client to perform the rendering processing of the video stream.

208. The rendering node obtains a rendering program of the video stream from the service node.

The service node stores the rendering program of the three-dimensional web page, that is, the rendering program that stores the video stream. Therefore, after the rendering node completes the rendering preparation, the rendering program of the video stream can be obtained from the service node.

209. The rendering node executes a rendering program of the video stream, so as to generate a video stream including a plurality of playback pictures, and set a stream pull address for the video stream.

After obtaining the rendering program of the video stream, the rendering node invokes the GPU set in the rendering node to execute the rendering program of the video stream, thereby generating a video stream that can be played in the target display area.

After obtaining the video stream, the rendering node can set a dedicated streaming address for the video stream. The streaming address of the video stream includes the Internet Protocol (IP) address and port of the rendering node, the client's token (token), the current session The identity document (ID), the ID of the video stream and other information.

210. The service node receives the streaming address of the video stream sent by the rendering node.

After the rendering node obtains the pull stream address of the video stream, it sends the pull stream address of the video stream to the service node.

211. The service node sends notification information carrying the streaming address of the video stream to the client.

After receiving the pull stream address of the video stream, the service node wraps the pull stream address into notification information, and the notification information is used to instruct the client to obtain the video stream from the pull stream address and play the video stream in the target display area. Then, the service node sends the notification information to the client.

212. The client obtains the video stream from the streaming address, and plays the video stream in the target display area.

After receiving the notification information from the service node, the client can obtain the streaming address of the video stream from the notification information. Then, obtain the encoded video stream from the rendering node based on the pull stream address, decode the encoded video stream, and finally play the decoded video stream in the target display area. In this way, the client can play the video stream in the target display area of the screen, display text information in the rest of the screen, and present a complete three-dimensional web page for the user to use.

In the embodiment of the present application, after receiving the rendering instruction for the target display area from the client, the service node may send a rendering request to the rendering node, so that the rendering node invokes its own GPU to render the target display area to obtain a video stream. Then, the service node sends notification information carrying the streaming address of the video stream to the client, so that the client obtains the video stream from the rendering node based on the streaming address, so as to play the video stream in the target display area. In the foregoing process, since the rendering processing of the video stream is completed by a remote rendering node, the GPU of the rendering node generally has relatively strong computing power, and can render a video stream with better quality. Therefore, even if the computing power of the terminal device where the client is located is limited, it can obtain the rendered video stream with better quality from the rendering unit, and play the video stream in the target display area, thereby improving user experience.

FIG. 3 is another schematic flowchart of a rendering method based on a cloud service provided by an embodiment of the present application. As shown in FIG. 3 , the method includes:

301. The administrator deploys the rendering program of the video stream in the rendering node in advance.

Managers (usually the owners of 3D pages) can package rendering programs for dynamic content such as video streams, and then pre-deploy them in rendering nodes. In this way, rendering nodes are equivalent to rendering programs that store video streams in advance.

302. The rendering node and the service node pre-record the streaming address of the video stream.

The rendering node can also make a prior agreement with the service node to jointly set a dedicated streaming address for the video stream in advance, and store the streaming address of the video stream. For the introduction of the streaming address of the video stream, reference may be made to the relevant description part of step 209 in the embodiment shown in FIG. 2 , and details are not repeated here.

303. The service node provides an access entry for the three-dimensional webpage.

304. The service node receives an access request from the client for the three-dimensional webpage.

305. The service node sends a rendering instruction of the three-dimensional webpage to the client according to the access request.

306. The client detects the local rendering capability according to the rendering instruction of the 3D webpage, and determines whether the local rendering capability meets the requirements.

307. If the client determines that the local rendering capability does not meet the requirements, send a rendering instruction for the target display area to the service node.

308. The service node sends a rendering request to the rendering node according to the rendering instruction for the target display area.

309. The rendering node prepares for rendering according to the rendering request.

For the introduction of step 303 to step 309, reference may be made to the relevant description part of step 201 to step 207 in the embodiment shown in FIG. 2, and details are not repeated here.

310. The rendering node executes a rendering program of the video stream to generate a video stream including multiple playback pictures.

In this embodiment, since the rendering node pre-stores the rendering program of the video stream, the rendering node can directly execute the rendering program of the video stream after completing the rendering preparation, so as to generate a video stream that can be played in the target display area.

311. The service node sends notification information carrying the streaming address of the video stream to the client.

After the rendering node completes the rendering and obtains the video stream, the service node can locally obtain the pull address of the pre-stored video stream, wrap the pull address of the video stream into notification information, and then send the notification information to the client.

312. The client obtains the video stream from the streaming address, and plays the video stream in the target display area.

For the introduction of step 312, reference may be made to the relevant description part of step 212 in the embodiment shown in FIG. 2, and details are not repeated here.

FIG. 4 is another schematic flowchart of a cloud service-based rendering method provided by an embodiment of the present application. As shown in FIG. 4 , the method includes:

401. The service node provides an access entry for a three-dimensional webpage.

402. The service node receives an access request from the client for the three-dimensional webpage.

403. The service node sends a rendering instruction of the three-dimensional webpage to the client according to the access request.

404. The client detects the local rendering capability according to the rendering instruction of the 3D webpage, and determines whether the local rendering capability meets the requirements.

For the introduction of steps 401 to 404 , reference may be made to the relevant descriptions of steps 201 to 204 in the embodiment shown in FIG. 2 , and details are not repeated here.

405. If the client determines that the local rendering capability does not meet the requirements, send the rendering program of the video stream to the rendering node.

In this embodiment, if the client determines that the local rendering capability does not meet the requirements, since the rendering program of the 3D page has been obtained in the client (obtained from the service node in step 403), the client directly converts the video stream to the rendering program. The renderer is sent to the render node.

406. The rendering node prepares for rendering.

After the rendering node receives the rendering program of the video stream from the client, it performs a series of rendering preparations related to the client. For the process of rendering preparation by the rendering node, reference may be made to the relevant description part of step 207 in the embodiment shown in FIG. 2 , and details are not repeated here.

407. The rendering node executes a rendering program of the video stream to generate a video stream including multiple playback pictures, and sets a streaming address for the video stream.

For the introduction of step 407, reference may be made to the relevant description part of step 209 in the embodiment shown in FIG. 2, and details are not repeated here.

408. The rendering node sends the streaming address of the video stream to the client.

After the rendering node completes rendering and obtains the video stream, and after setting a dedicated streaming address for the video stream, the streaming address is sent directly to the client. There are various ways for the render node to send the pull stream address to the client. For example, the render node can directly send the pull stream address of the video stream to the render node, and for example, the render node can send the pull stream address of the video stream to the service node. , so that the service node wraps the pull stream address of the video stream into notification information, and then sends it to the client and so on.

409. The client obtains the video stream from the streaming address, and plays the video stream in the target display area.

For the introduction of step 409, reference may be made to the relevant description part of step 212 in the embodiment shown in FIG. 2, and details are not repeated here.

The above is a detailed description of the rendering method based on the cloud service provided by the embodiment of the present application, and the following will introduce the rendering device based on the cloud service provided by the embodiment of the present application. FIG. 5 is a schematic structural diagram of a cloud service-based rendering device provided by an embodiment of the present application. As shown in FIG. 5 , the device is the aforementioned service node, and the device includes:

A receiving module 501, configured to receive a client rendering instruction for the target display area;

The sending module 503 is used to send a rendering request to the rendering node according to the rendering instruction, and the rendering request is used to instruct the rendering node to call the image processing unit GPU arranged on the rendering node to render the target display area to generate a video stream including a plurality of playback pictures;

The sending module 503 is also used to send notification information carrying the pull stream address of the video stream to the client, where the notification information is used to instruct the client to obtain the video stream from the pull stream address and play the video stream in the target display area.

In a possible implementation manner, the rendering instruction carries rendering requirement information, and the apparatus further includes: a processing module 502, configured to select a rendering node matching the rendering requirement information from the rendering resource pool.

In a possible implementation manner, the rendering instruction carries rendering requirement information, and the apparatus further includes: a processing module 502, configured to call a cloud service to create a rendering node matching the rendering requirement information.

In a possible implementation manner, the sending module 503 is further configured to provide an access entry for the three-dimensional web page; the receiving module 501 is further configured to receive an access request from the client for the three-dimensional web page; the sending module 503 is further configured to access the three-dimensional web page according to the access request Send a rendering command of the 3D web page to the client.

In a possible implementation manner, the receiving module 501 is further configured to receive the streaming address sent by the rendering node.

In a possible implementation manner, the processing module 502 is further configured to record the pull stream address in advance.

It should be noted that the information exchange, execution process and other contents between the modules/units of the above-mentioned apparatus are based on the same concept as the method embodiments of the present application, and the technical effects brought by them are the same as those of the method embodiments of the present application, and the specific content can be Reference is made to the descriptions in the method embodiments shown in the foregoing embodiments of the present application, which will not be repeated here.

FIG. 6 is a schematic structural diagram of a network device provided by an embodiment of the present application. As shown in FIG. 6 , an embodiment of the network device in this embodiment of the present application may include one or more central processing units 601 , a memory 602 , an input/output interface 603 , a wired or wireless network interface 604 , and a power supply 605 .

The memory 602 may be ephemeral storage or persistent storage. Furthermore, the central processing unit 601 may be configured to communicate with the memory 602 to execute a series of instruction operations in the memory 602 on the network device.

In this embodiment, the central processing unit 601 may perform the operations performed by the service nodes in the foregoing embodiments shown in FIG. 2 , FIG. 3 , and FIG. 4 , and details are not repeated here.

In this embodiment, the division of specific functional modules in the central processing unit 601 may be similar to the division of modules such as the receiving module, the processing module, and the sending module described above in FIG. 5 , which will not be repeated here.

The embodiments of the present application also relate to a computer storage medium, including computer-readable instructions, when the computer-readable instructions are executed, the methods described in FIG. 2 , FIG. 3 and FIG. 4 are implemented.

Embodiments of the present application also relate to a computer program product containing instructions, which, when executed on a computer, cause the computer to execute the methods described in FIG. 2 , FIG. 3 and FIG. 4 .

Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working process of the system, device and unit described above can refer to the corresponding process in the foregoing method embodiments, which is not repeated here.

In the several embodiments provided in this application, it should be understood that the disclosed system, apparatus and method may be implemented in other manners. For example, the apparatus embodiments described above are only illustrative. For example, the division of the units is only a logical function division. In actual implementation, there may be other division methods. For example, multiple units or components may be combined or Can be integrated into another system, or some features can be ignored, or not implemented. On the other hand, the shown or discussed mutual coupling or direct coupling or communication connection may be through some interfaces, indirect coupling or communication connection of devices or units, and may be in electrical, mechanical or other forms.

The units described as separate components may or may not be physically separated, and components displayed as units may or may not be physical units, that is, may be located in one place, or may be distributed to multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution in this embodiment.

In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically alone, or two or more units may be integrated into one unit. The above-mentioned integrated units may be implemented in the form of hardware, or may be implemented in the form of software functional units.

The integrated unit, if implemented in the form of a software functional unit and sold or used as an independent product, may be stored in a computer-readable storage medium. Based on this understanding, the technical solutions of the present application can be embodied in the form of software products in essence, or the parts that contribute to the prior art, or all or part of the technical solutions, and the computer software products are stored in a storage medium , including several instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of the present application. The aforementioned storage medium includes: U disk, mobile hard disk, Read-Only Memory (ROM, Read-Only Memory), Random Access Memory (RAM, Random Access Memory), magnetic disk or optical disk and other media that can store program codes .

Claims

A rendering method based on cloud services, characterized in that the method comprises:

The service node receives the client's rendering instruction for the target display area;

The service node sends a rendering request to the rendering node according to the rendering instruction, where the rendering request is used to instruct the rendering node to call the image processing unit GPU disposed on the rendering node to render the target display area to generate a rendering including: Video streams of multiple playback screens;

The service node sends notification information carrying the streaming address of the video stream to the client, where the notification information is used to instruct the client to obtain the video stream from the streaming address and upload the video stream in the The target display area plays the video stream.
The method according to claim 1, wherein the rendering instruction carries rendering requirement information, and before the service node sends the rendering request to the rendering node, the method further comprises:

The service node selects the rendering node matching the rendering requirement information from the rendering resource pool.
The method according to claim 1, wherein the rendering instruction carries rendering requirement information, and before the service node sends the rendering request to the rendering node, the method further comprises:

The service node invokes a cloud service to create the rendering node matching the rendering requirement information.
The method according to claim 2 or 3, wherein the rendering node comprises a virtual machine provided with the GPU, a container and a bare metal server provided in a data center.
The method according to claim 1, wherein the rendering node is a physical server provided with the GPU.
The method according to any one of claims 1 to 5, wherein before the service node receives a rendering request from the client for the target display area, the method further comprises:

The service node provides the access portal of the three-dimensional webpage;

receiving, by the service node, an access request from the client for the three-dimensional web page;

The service node sends a rendering instruction of the three-dimensional webpage to the client according to the access request.
The method according to any one of claims 1 to 6, wherein before the service node sends the notification information carrying the streaming address of the video stream to the client, the method further comprises:

The service node receives the streaming address sent by the rendering node.
The method according to any one of claims 1 to 6, wherein before the service node sends the notification information carrying the streaming address of the video stream to the client, the method further comprises:

The service node pre-records the pull stream address.
A cloud service-based rendering device, characterized in that the device comprises:

The receiving module is used to receive the rendering instruction of the client for the target display area;

A sending module, configured to send a rendering request to a rendering node according to the rendering instruction, where the rendering request is used to instruct the rendering node to call the image processing unit GPU disposed on the rendering node to render the target display area to generate A video stream including multiple playback screens;

The sending module is further configured to send notification information carrying the streaming address of the video stream to the client, where the notification information is used to instruct the client to obtain the video stream from the streaming address and play the video stream in the target display area.
The apparatus according to claim 9, wherein the rendering instruction carries rendering requirement information, and the apparatus further comprises:

A processing module, configured to select the rendering node matching the rendering requirement information from the rendering resource pool.
The apparatus according to claim 9, wherein the rendering instruction carries rendering requirement information, and the apparatus further comprises:

A processing module, configured to call a cloud service to create the rendering node matching the rendering requirement information.
The apparatus according to claim 10 or 11, wherein the rendering node comprises a virtual machine provided with the GPU, a container and a bare metal server provided in a data center.
The apparatus according to claim 9, wherein the rendering node is a physical server provided with the GPU.
The device according to any one of claims 9 to 13, wherein the sending module is further configured to provide an access entry for a three-dimensional webpage;

The receiving module is further configured to receive an access request from the client for the three-dimensional webpage;

The sending module is further configured to send a rendering instruction of the three-dimensional webpage to the client according to the access request.
The apparatus according to any one of claims 9 to 14, wherein the receiving module is further configured to receive the pull stream address sent by the rendering node.
The apparatus according to any one of claims 9 to 14, wherein the processing module is further configured to record the pull stream address in advance.
A network device, characterized in that the network device comprises: a processor and a memory;

the memory is used to store computer-executable instructions;

The processor is configured to execute computer-executable instructions stored in the memory to cause the network device to implement the method of any one of claims 1 to 8.
A computer storage medium, characterized by comprising computer-readable instructions, which, when executed, implement the method according to any one of claims 1 to 8.
A computer program product comprising instructions which, when run on a computer, cause the computer to perform the method of any one of claims 1 to 8.