CN114650434A

CN114650434A - Cloud service-based rendering method and related equipment thereof

Info

Publication number: CN114650434A
Application number: CN202011505914.5A
Authority: CN
Inventors: 陈普
Original assignee: Huawei Cloud Computing Technologies Co Ltd
Current assignee: Huawei Cloud Computing Technologies Co Ltd
Priority date: 2020-12-18
Filing date: 2020-12-18
Publication date: 2022-06-21
Also published as: WO2022127890A1

Abstract

The embodiment of the application discloses a rendering method based on cloud service and related equipment thereof, which can render a video with better quality and play the video on terminal equipment with limited computing power, thereby improving user experience. The method of the present application comprises: the service node receives a rendering instruction of a client aiming at a target display area; the service node sends a rendering request to the rendering node according to the rendering instruction, wherein the rendering request is used for instructing the rendering node to call an image processing unit (GPU) arranged at the rendering node to render aiming at a target display area so as to generate a video stream comprising a plurality of playing pictures; and the service node sends notification information carrying the pull stream address of the video stream to the client, wherein the notification information is used for indicating the client to acquire the video stream from the pull stream address and play the video stream in the target display area.

Description

Cloud service-based rendering method and related equipment thereof

Technical Field

The application relates to the technical field of computer graphics, in particular to a rendering method based on cloud service and related equipment thereof.

Background

With the rapid development of the computer industry, the content in the browser becomes richer and more interesting. For example, a browser on a certain terminal device can play dynamic content such as a large-scale three-dimensional (3D) game, a high-definition multimedia video, and the like, thereby providing a better viewing experience for a user.

If a browser of a terminal device wants to play a certain video, a Graphics Processing Unit (GPU) on the terminal device is required to perform a series of complex image rendering processes, so as to render the video to be displayed. However, in some portable terminal devices, such as smart phones, tablet computers, and the like, the GPU of such devices generally has poor computing capability, so when such devices with limited computing capability perform video rendering processing through their own GPU, the video with better quality often cannot be rendered, resulting in poor user experience.

Disclosure of Invention

The embodiment of the application provides a rendering method based on cloud service and related equipment thereof, which can render a video with better quality and play the video on terminal equipment with limited computing power, thereby improving user experience.

A first aspect of an embodiment of the present application provides a cloud service-based rendering method, including:

on a certain computationally limited terminal device, a client, e.g. a browser or the like, is typically deployed. The client may display certain content (e.g., display certain three-dimensional web pages, including static content and dynamic content) in the entire screen area for viewing and use by the user. When the client determines that the GPU of the terminal equipment where the client is located cannot render the video stream which needs to be played in the target display area, a rendering instruction for the target display area is sent to the service node, and the rendering instruction is used for indicating the server node to finish remote rendering of the video stream so as to play the video stream in the target display area.

After receiving a rendering instruction of the client for the target display area, the service node may determine, based on the rendering instruction, that the client requests remote rendering of the target display area, and may generate a rendering request, where the rendering request is used to instruct the rendering node to invoke its GPU to render for the target display area, so as to generate a video stream including multiple playing pictures. The service node then sends the rendering request to the rendering node.

And after the rendering node receives the rendering request, the rendering of the video stream is completed through the GPU, so that the video stream is obtained.

And finally, the service node sends notification information carrying the pull stream address of the video stream to the client, wherein the notification information is used for indicating the client to acquire the video stream from the pull stream address and play the video stream in the target display area. In this way, the client receives the notification information, and can obtain the pull address from the notification information, and obtain the video stream from the rendering node based on the pull address, so as to play the video stream in the target display area.

From the above method, it can be seen that: after receiving the rendering instruction of the client for the target display area, the service node can send a rendering request to the rendering node, so that the rendering node calls a GPU of the service node to render for the target display area, and a video stream is obtained. Then, the service node sends notification information carrying the pull address of the video stream to the client, so that the client acquires the video stream from the rendering node based on the pull address, and the video stream is played in the target display area. In the foregoing process, since the rendering processing of the video stream is completed by the remote rendering node, the GPU of the rendering node generally has a strong computing capability, and a video stream with a better quality can be rendered. Therefore, even if the computing power of the terminal equipment where the client is located is limited, the rendered video stream with better quality can be obtained from the rendering unit, and the video stream is played in the target display area, so that the user experience is improved.

In a possible implementation manner, the rendering instruction carries rendering requirement information, and before the service node sends the rendering request to the rendering node, the method further includes: and the service node selects a rendering node matched with the rendering requirement information from the rendering resource pool. In the foregoing implementation manner, the rendering resource pool includes a plurality of rendering nodes, and GPUs of different rendering nodes have different computing capabilities. After receiving the rendering instruction from the client, the service node may determine rendering requirement information from the rendering instruction, where the rendering requirement information indicates a computing capacity required for rendering the target display area. Therefore, the service node may select a rendering node matching the rendering requirement information from the rendering resource pool. In this way, the GPU of the selected rendering node has sufficient computing power, and thus a video stream with better quality can be rendered.

In a possible implementation manner, the rendering instruction carries rendering requirement information, and before the service node sends the rendering request to the rendering node, the method further includes: and the service node calls the cloud service to create a rendering node matched with the rendering demand information. In the foregoing implementation manner, after receiving the rendering instruction from the client, the service node may determine rendering requirement information from the rendering instruction, where the rendering requirement information is used to indicate the computing capacity required for rendering the target display area. Therefore, the service node can create a rendering node matched with the rendering requirement information by directly calling the cloud service. In this way, since the GPU of the created rendering node has sufficient computing power, a video stream with better quality can be rendered.

In one possible implementation, before the service node receives a rendering request of the client for the target display area, the method further includes: the service node provides an access entrance of the three-dimensional webpage; the method comprises the steps that a service node receives an access request of a client for a three-dimensional webpage; and the service node sends a rendering instruction of the three-dimensional webpage to the client according to the access request. In the foregoing implementation manner, the service node may provide an access portal of the three-dimensional web page to the client, so that the client sends an access request of the three-dimensional web page to the service node through the access portal. Then, after determining that the client needs to access the three-dimensional webpage based on the access request, the service node sends a rendering instruction of the three-dimensional webpage to the client, so that the client renders the whole screen area to generate the three-dimensional webpage.

In a possible implementation manner, before the service node sends notification information carrying a pull stream address of the video stream to the client, the method further includes: and the service node receives the pull address sent by the rendering node. In the foregoing implementation manner, after the rendering node finishes rendering to obtain the video stream, the rendering node may set a dedicated stream pulling address for the video stream, and send the stream pulling address to the service node, so that the service node forwards the stream pulling address to the client, and the client can obtain the rendered video stream from the rendering node based on the stream pulling address.

In a possible implementation manner, before the service node sends notification information carrying a pull stream address of the video stream to the client, the method further includes: the service node records the pull address in advance. In the foregoing implementation manner, the service node and the rendering node record the pull stream address set for the video stream in advance. Therefore, after the rendering node finishes rendering to obtain the video stream, the service node can directly send the pull stream address of the video stream to the client, so that the client can obtain the rendered video stream from the rendering node based on the pull stream address.

In one possible implementation manner, the rendering node includes a virtual machine provided with a GPU, a container, and a bare metal server, which are provided in a data center.

In one possible implementation, the rendering node is a physical server provided with a GPU.

According to the technical scheme, the embodiment of the application has the following advantages:

a second aspect of the embodiments of the present application provides a rendering apparatus based on a cloud service, where the apparatus is the foregoing service node, and the apparatus includes: the receiving module is used for receiving a rendering instruction of the client aiming at the target display area; the sending module is used for sending a rendering request to the rendering node according to the rendering instruction, wherein the rendering request is used for indicating the rendering node to call an image processing unit (GPU) arranged at the rendering node to render aiming at the target display area so as to generate a video stream comprising a plurality of playing pictures; and the sending module is further used for sending notification information carrying the pull stream address of the video stream to the client, wherein the notification information is used for indicating the client to acquire the video stream from the pull stream address and play the video stream in the target display area.

From the above device it can be seen that: after receiving the rendering instruction of the client for the target display area, the service node can send a rendering request to the rendering node, so that the rendering node calls a GPU of the service node to render for the target display area, and a video stream is obtained. Then, the service node sends notification information carrying the pull address of the video stream to the client, so that the client acquires the video stream from the rendering node based on the pull address, and the video stream is played in the target display area. In the foregoing process, since the rendering processing of the video stream is completed by the remote rendering node, the GPU of the rendering node generally has a strong computing capability, and a video stream with a better quality can be rendered. Therefore, even if the computing power of the terminal equipment where the client is located is limited, the rendered video stream with better quality can be obtained from the rendering unit, and the video stream is played in the target display area, so that the user experience is improved.

In a possible implementation manner, the rendering instruction carries rendering requirement information, and the apparatus further includes: and the processing module is used for selecting the rendering nodes matched with the rendering demand information from the rendering resource pool.

In a possible implementation manner, the rendering instruction carries rendering requirement information, and the apparatus further includes: and the processing module is used for calling the cloud service to create the rendering nodes matched with the rendering demand information.

In a possible implementation manner, the sending module is further configured to provide an access entry of the three-dimensional webpage; the receiving module is also used for receiving an access request of the client for the three-dimensional webpage; and the sending module is also used for sending a rendering instruction of the three-dimensional webpage to the client according to the access request.

In a possible implementation manner, the receiving module is further configured to receive a pull address sent by the rendering node.

In a possible implementation manner, the processing module is further configured to record the pull stream address in advance.

A third aspect of an embodiment of the present application provides a network device, including: a processor and a memory;

the memory is used for storing computer execution instructions;

the processor is configured to execute computer-executable instructions stored by the memory to cause the network device to implement the method according to the first aspect or any one of the possible implementations of the first aspect.

A fourth aspect of embodiments of the present application is a computer storage medium including computer readable instructions that, when executed, implement a method according to the first aspect or any one of the possible implementation manners of the first aspect.

A fifth aspect of embodiments of the present application is a computer program product containing instructions, which when executed on a computer, cause the computer to perform the method according to the first aspect or any one of the possible implementations of the first aspect.

In the embodiment of the application, after receiving the rendering instruction of the client for the target display area, the service node can send a rendering request to the rendering node, so that the rendering node calls the GPU of the service node to perform rendering processing on the target display area, and a video stream is obtained. Then, the service node sends notification information carrying the pull address of the video stream to the client, so that the client acquires the video stream from the rendering node based on the pull address, and the video stream is played in the target display area. In the foregoing process, since the rendering processing of the video stream is completed by the remote rendering node, the GPU of the rendering node generally has a strong computing capability, and a video stream with a better quality can be rendered. Therefore, even if the terminal equipment where the client is located is limited in computing power, the rendered video stream with better quality can be obtained from the rendering unit, and the video stream is played in the target display area, so that the user experience is improved.

Drawings

Fig. 1 is a schematic diagram of a cloud service system provided in an embodiment of the present application;

fig. 2 is a schematic flowchart of a cloud service-based rendering method according to an embodiment of the present disclosure;

fig. 3 is another schematic flowchart of a cloud service-based rendering method according to an embodiment of the present disclosure;

fig. 4 is a schematic flowchart of a cloud service-based rendering method according to an embodiment of the present disclosure;

fig. 5 is a schematic structural diagram of a cloud service-based rendering apparatus according to an embodiment of the present application;

fig. 6 is a schematic structural diagram of a network device according to an embodiment of the present application.

Detailed Description

The terms "first," "second," and the like in the description and in the claims of the present application and in the above-described drawings are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It will be appreciated that the data so used may be interchanged under appropriate circumstances such that the embodiments described herein may be practiced otherwise than as specifically illustrated or described herein. Moreover, the terms "comprises," "comprising," and any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, system, article, or apparatus that comprises a list of steps or modules is not necessarily limited to those steps or modules explicitly listed, but may include other steps or modules not expressly listed or inherent to such process, method, article, or apparatus. The naming or numbering of the steps appearing in the present application does not mean that the steps in the method flow have to be executed in the chronological/logical order indicated by the naming or numbering, and the named or numbered process steps may be executed in a modified order depending on the technical purpose to be achieved, as long as the same or similar technical effects are achieved. The division of the modules presented in this application is a logical division, and in practical applications, there may be another division, for example, multiple modules may be combined or integrated into another system, or some features may be omitted, or not executed, and in addition, the shown or discussed coupling or direct coupling or communication connection between each other may be through some ports, and the indirect coupling or communication connection between the modules may be in an electrical or other similar form, which is not limited in this application. The modules or sub-modules described as separate components may or may not be physically separated, may or may not be physical modules, or may be distributed in a plurality of circuit modules, and some or all of the modules may be selected according to actual needs to achieve the purpose of the present disclosure.

With the rapid development of computer technology, the requirements of users on browsers have been increased, for example, a webpage displayed by a browser includes both static content such as text information and dynamic content such as high-definition video, so as to meet various requirements of users. If a browser of a terminal device wants to play a certain video, a Graphics Processing Unit (GPU) on the terminal device is required to perform a series of complex image rendering processes, so as to render the video to be displayed. However, in some portable terminal devices, such as smart phones, tablet computers, and the like, the GPU of such devices generally has poor computing capability, so when such devices with limited computing capability perform video rendering processing through their own GPU, the video with better quality often cannot be rendered, resulting in poor user experience.

In order to solve the above problem, an embodiment of the present application provides a cloud service system. Fig. 1 is a schematic view of a cloud service system provided in an embodiment of the present application, and as shown in fig. 1, the cloud service system includes: client, service node and rendering node. Communication can be realized between the client, the service node and the rendering node, namely, information transmission can be realized between the client, the service node and the rendering node. Therefore, the client can directly communicate with the rendering node and can also communicate with the rendering node through the service node. The following will introduce the client, the service node, and the rendering node, respectively:

the client is usually deployed on a certain terminal device, that is, the client is an application program running on the terminal device, for example, a browser, so that a user can start the browser on the terminal device, so as to browse a three-dimensional web page through the browser, and the like. It should be noted that information transmission between the client and the service node may be completed through a hypertext transfer protocol (HTTP), information transmission between the client and the rendering node may be completed through Websocket, Hypertext Live Streaming (HLS), webrtc, and the like, a webpage displayed by the client may be described through hypertext markup language (HTML), and the programming language supported by the client may be javascript or other types of programming languages. It should be noted that the client may detect the rendering capability of the terminal device where the client is located, that is, the computing capability of the GPU of the terminal device where the client is located, based on javascript, so as to determine whether the GPU can render dynamic content with better quality, such as a video stream, and the like.

The service node is a network (Web) service node and can be deployed in various ways, for example, the service node may be a single physical server (also referred to as a network device), or for example, the service node may also be a virtual machine loaded on a certain physical server, or for example, the service node may also be a container loaded on a certain physical server, and so on. The service nodes may provide page services for the clients and rendering nodes, such as a page service containing static content, a page service containing dynamic content, and a page service containing both static content and dynamic content, among others. The foregoing page service is briefly described by way of an example below: the service node may send a rendering program for rendering a web page to the client, which may execute the rendering program to render the web page for display.

The rendering node may also be deployed in multiple ways, for example, the rendering node may be a single physical server, or for example, the rendering node may also be a certain virtual machine loaded on a certain physical server, or for example, the rendering node may also be a certain container loaded on a certain physical server, and the like. It should be noted that, when both the rendering node and the service node are virtual machines (or containers), both the rendering node and the service node may be deployed on the same physical server or on different physical servers, which is not limited herein. No matter how the rendering node is deployed, the rendering node comprises the GPU, so that the rendering node can replace a client to execute a rendering program, remote rendering is achieved, and after the rendering is completed to obtain a video stream, the video stream can be sent to the client to be displayed. It should be noted that the client and the rendering unit support the same three-dimensional rendering programming technology, for example, web graphics library (WebGL) technology, and the like. Accordingly, the rendering program may be presented in a WebGL program or other forms, the WebGL program may write a WebGL interface through javascript, the program may include rendering data required to be used in rendering and rendering operations required to be performed, where the rendering data may include vertex coordinates of an object to be rendered, triangle indexes, colors, metal degrees, roughness and the like, and the rendering operations may include a rasterization series of operations, such as coordinate transformation, geometric discretization and the like.

For convenience of description, the term "the client executes the rendering program" in the present application may be understood as "the GPU of the terminal device where the client is located executes the rendering program". Likewise, "rendering node executes rendering program" may be understood as "rendering node GPU executes rendering program", which is not described in detail later.

To further understand the implementation flow of the above system, the following description is further provided with reference to fig. 2. Fig. 2 is a schematic flowchart of a cloud service-based rendering method provided in an embodiment of the present application, and as shown in fig. 2, the method includes:

201. the service node provides an access entrance of the three-dimensional webpage.

In this embodiment, the service node may provide an access entry of the three-dimensional webpage for the client, so that the client displays the access entry on the screen, and if the user needs to access the three-dimensional webpage, the service node may input an access request of the three-dimensional webpage to the access entry. It should be noted that the access portal of the three-dimensional web page is usually a web page containing static content, and then the computing power required for rendering the access portal is not high, so that the client can locally complete the rendering process of the access portal. Specifically, the service node may send a rendering program of an access entry of the three-dimensional page to the client, and the client directly executes the rendering program, so as to render the access entry of the three-dimensional page and display the access entry on a screen of the terminal device, so that the user can use the access entry.

For example, let a three-dimensional web page be a product web site containing text (information describing a product, etc.) and video streams (showing the shape of a product, etc.), on which a user can browse product-specific information. At this time, the access entry of the three-dimensional webpage can be a login page, and after the user inputs an account number and a password on the login page, the user can enter a product website to browse.

For another example, if the three-dimensional webpage is a three-dimensional building constructed based on Virtual Reality (VR) technology, the user can navigate inside the three-dimensional building to know the information of the building. At this time, the access entrance of the three-dimensional webpage may be an initial picture of the three-dimensional building, for example, a doorway of the three-dimensional building, and the user may enter the three-dimensional building for visiting after clicking the doorway.

202. And the service node receives an access request of the client for the three-dimensional webpage.

After the client displays the access entrance of the three-dimensional webpage, the user can input an access request of the three-dimensional webpage to the client. The access request may be a login operation of the user or a page click operation of the user, or may be an operation for implementing functions such as web page skip, adding a website to a favorite, popping up a prompt box, and outputting audio. Therefore, after receiving the access request for the three-dimensional webpage through the access entrance, the client sends the access request for the three-dimensional webpage to the service node.

203. And the service node sends a rendering instruction of the three-dimensional webpage to the client according to the access request.

After receiving an access request from a client, a service node can determine that the client needs to access the three-dimensional webpage, and then sends a rendering instruction of the three-dimensional webpage to the client, wherein the rendering instruction is used for indicating the client to detect local rendering capability, so that whether the rendering processing of the three-dimensional webpage is completed locally is determined.

In addition, the service node can also send a rendering program of the three-dimensional webpage to the client. It should be noted that the rendering program of the three-dimensional webpage and the rendering instruction of the three-dimensional webpage may be synchronously sent to the client, or may be asynchronously sent to the client. For example, the service node sends the rendering instruction of the three-dimensional webpage to the client, and then sends the rendering program of the three-dimensional webpage to the client. For another example, the service node sends the rendering program of the three-dimensional webpage to the client, and then sends the rendering instruction of the three-dimensional webpage to the client. For another example, the service node sends the rendering program of the three-dimensional webpage and the rendering instruction of the three-dimensional webpage to the client together, which is not limited herein.

204. And the client detects the local rendering capability according to the rendering instruction of the three-dimensional webpage and judges whether the local rendering capability meets the requirement.

And after receiving a rendering instruction of the three-dimensional webpage from the service node, the client detects the local rendering capability. The client may detect the local rendering capability in a number of ways: for example, the client may attempt to run a rendering program of a certain small video (the rendering program may be preset in the client, or may be sent to the client by a service node, which is not limited herein), obtain parameters such as power consumption and frame rate of the GPU running the rendering program, and determine a local rendering capability based on the parameters, that is, a computing capability of the GPU of the terminal device where the client is located. For another example, the client may directly obtain the model of the graphics card (including the GPU) of the terminal device where the client is located, so as to determine the local rendering capability.

For convenience of description, the text information represents the static content, and the video stream represents the dynamic content. Therefore, the client may determine, in the rendering program of the three-dimensional webpage, a computing power required to execute the rendering program of the text information and a computing power required to execute the rendering program of the video stream, and generally, the computing power required to execute the rendering program of the text information is less than the computing power required to execute the rendering program of the video stream. If the calculation capacity of the GPU of the terminal equipment where the client is located is determined to be larger than the calculation capacity required for executing the rendering program of the video stream, the fact that the local rendering capacity of the client is determined to meet the requirement is indicated, the client can locally perform rendering processing on the three-dimensional webpage, namely the rendering program of the three-dimensional webpage is directly executed, the three-dimensional webpage is rendered, and the three-dimensional webpage (including text information and the video stream) is displayed on a screen, wherein a target display area in the screen is used for playing the video stream, and the rest areas except the target display area in the screen are used for displaying the text information.

If it is determined that the computing power of the GPU of the terminal device where the client is located is less than the computing power required for executing the rendering program of the video stream, it indicates that the client determines that the local rendering power does not meet the requirement, then step 205 is executed.

205. And if the client determines that the local rendering capability does not meet the requirement, sending a rendering instruction aiming at the target display area to the service node.

And when the client determines that the local rendering capability does not meet the requirement, the rendering processing of the text information is realized locally, and the remote rendering processing of the video stream is requested to the service node. Specifically, the client executes a rendering program of the text information, thereby rendering the text information and displaying the text information in the remaining area except for the target display area in the screen. At the same time, the client may also send a rendering instruction (which may also be understood as a rendering instruction of the video stream) for the target display area to the service node, where the rendering instruction is used to instruct the server node to complete remote rendering of the video stream, so as to play the video stream in the target display area.

206. And the service node sends a rendering request to the rendering node according to the rendering instruction aiming at the target display area.

And after receiving a rendering instruction of the client aiming at the target display area, the service node sends a rendering request to the rendering node, wherein the rendering request is used for indicating the rendering node to call a GPU arranged on the rendering node to render aiming at the target display area so as to generate a video stream comprising a plurality of playing pictures.

For example, the rendering request includes the rendering instructions described above.

Optionally, the service node may perform format conversion on the rendering instruction, and convert the received rendering instruction into a format suitable for the rendering node to perform image rendering.

Further, before the service node sends the rendering request, the service node may determine a rendering node for implementing the remote rendering process. Specifically, the rendering instruction for the target display area carries rendering requirement information, where the rendering requirement information is used to indicate a computing capacity required for rendering the target display area, that is, a computing capacity required for rendering the video stream. Therefore, the service node may determine, according to the rendering demand information, a rendering node that implements remote rendering processing in multiple ways, for example, a rendering resource pool is pre-deployed in the cloud service system, where the rendering resource pool includes multiple rendering nodes, and the multiple rendering nodes may form a virtual machine cluster, a container cluster, a physical server cluster, and the like. The GPU of different rendering nodes has different computing power, so that the service node can select the rendering node matched with the rendering demand information in the rendering resource pool for realizing remote rendering processing of the video stream. For another example, the service node may directly invoke the cloud service to create a new rendering node in the cloud service system, where the rendering node may be a virtual machine, a container, or the like, and the rendering node is matched with the rendering requirement information, so that the service node may be used to implement remote rendering processing of the video stream.

207. And the rendering node performs rendering preparation according to the rendering request.

After the rendering node receives the rendering request from the service node, it determines that the remote rendering requirement of the client needs to be met, and therefore, a series of rendering preparations related to the client are started. It can be understood that the rendering node is a virtual machine, a container, a physical server, or the like having a GPU, that is, a system of the rendering node itself provides a running environment for a program (e.g., a browser kernel, or the like) related to the client, so that the rendering node can also run the program related to the client, and after the preparation, the rendering node can perform rendering processing on the video stream instead of the client.

208. And the rendering node acquires a rendering program of the video stream from the service node.

The service node stores a rendering program of a three-dimensional webpage, namely a rendering program of a video stream. Therefore, after the rendering node finishes the rendering preparation, the rendering program of the video stream can be acquired from the service node.

209. And the rendering node executes a rendering program of the video stream to generate the video stream comprising a plurality of playing pictures and sets a pull stream address for the video stream.

And after the rendering program of the video stream is obtained, the rendering node calls a GPU arranged on the rendering node to execute the rendering program of the video stream, so that the video stream capable of being played in the target display area is generated.

After obtaining the video stream, the rendering node may set a dedicated pull address for the video stream, where the pull address of the video stream includes information such as an Internet Protocol (IP) address and port of the rendering node, an identifier (token) of the client, an Identity Document (ID) of the current session, and an ID of the video stream.

210. And the service node receives the pull address of the video stream sent by the rendering node.

And after the rendering node obtains the pull stream address of the video stream, the pull stream address of the video stream is sent to the service node.

211. And the service node sends notification information carrying the pull stream address of the video stream to the client.

And after receiving the pull address of the video stream, the service node packages the pull address into notification information, and the notification information is used for indicating the client to acquire the video stream from the pull address and play the video stream in the target display area. The service node then sends the notification information to the client.

212. And the client acquires the video stream from the stream pulling address and plays the video stream in the target display area.

After receiving the notification information from the service node, the client can obtain the pull stream address of the video stream from the notification information. And then, acquiring the coded video stream from the rendering node based on the pull stream address, decoding the coded video stream, and finally playing the decoded video stream in the target display area. Therefore, the client can play the video stream in the target display area of the screen, display the text information in the rest areas of the screen, and display a complete three-dimensional webpage for the user to use.

In the embodiment of the application, after receiving a rendering instruction for a target display area from a client, a service node may send a rendering request to a rendering node, so that the rendering node invokes its GPU to render for the target display area, thereby obtaining a video stream. Then, the service node sends notification information carrying the pull address of the video stream to the client, so that the client acquires the video stream from the rendering node based on the pull address, and the video stream is played in the target display area. In the foregoing process, since the rendering processing of the video stream is completed by the remote rendering node, the GPU of the rendering node generally has a strong computing capability, and a video stream with a better quality can be rendered. Therefore, even if the computing power of the terminal equipment where the client is located is limited, the rendered video stream with better quality can be obtained from the rendering unit, and the video stream is played in the target display area, so that the user experience is improved.

Fig. 3 is another schematic flow diagram of a cloud service-based rendering method provided in an embodiment of the present application, and as shown in fig. 3, the method includes:

301. and the manager deploys a rendering program of the video stream in the rendering node in advance.

A manager (usually, an owner of the three-dimensional page) may package a rendering program of dynamic content such as a video stream and then deploy the packaging program in a rendering node in advance, so that the rendering node corresponds to the rendering program in which the video stream is stored in advance.

302. The rendering node and the service node record the pull address of the video stream in advance.

The rendering node can also be appointed with the service node in advance, a dedicated pull address is set for the video stream in advance, and the pull address of the video stream is stored. For the description of the pull address of the video stream, reference may be made to the relevant description part of step 209 in the embodiment shown in fig. 2, and details are not repeated here.

303. The service node provides an access entrance of the three-dimensional webpage.

304. And the service node receives an access request of the client for the three-dimensional webpage.

305. And the service node sends a rendering instruction of the three-dimensional webpage to the client according to the access request.

306. And the client detects the local rendering capability according to the rendering instruction of the three-dimensional webpage and judges whether the local rendering capability meets the requirement.

307. And if the client determines that the local rendering capability does not meet the requirement, sending a rendering instruction aiming at the target display area to the service node.

308. And the service node sends a rendering request to the rendering node according to the rendering instruction aiming at the target display area.

309. And the rendering node performs rendering preparation according to the rendering request.

For the description of step 303 to step 309, reference may be made to the relevant description part of step 201 to step 207 in the embodiment shown in fig. 2, and details are not repeated here.

310. The rendering node executes a rendering program of the video stream to generate a video stream including a plurality of play screens.

In this embodiment, since the rendering node stores the rendering program of the video stream in advance, after the rendering node completes the rendering preparation, the rendering node can directly execute the rendering program of the video stream to generate the video stream that can be played in the target display area.

311. And the service node sends notification information carrying the pull stream address of the video stream to the client.

After the rendering node finishes rendering to obtain the video stream, the service node can locally obtain the pull stream address of the video stream stored in advance, package the pull stream address of the video stream into notification information, and then send the notification information to the client.

312. And the client acquires the video stream from the stream pulling address and plays the video stream in the target display area.

For the description of step 312, reference may be made to relevant description parts of step 212 in the embodiment shown in fig. 2, and details are not repeated here.

Fig. 4 is another schematic flowchart of a cloud service-based rendering method provided in an embodiment of the present application, and as shown in fig. 4, the method includes:

401. the service node provides an access entrance of the three-dimensional webpage.

402. And the service node receives an access request of the client for the three-dimensional webpage.

403. And the service node sends a rendering instruction of the three-dimensional webpage to the client according to the access request.

404. And the client detects the local rendering capability according to the rendering instruction of the three-dimensional webpage and judges whether the local rendering capability meets the requirement.

For the description of step 401 to step 404, reference may be made to the relevant description part of step 201 to step 204 in the embodiment shown in fig. 2, and details are not repeated here.

405. And if the client determines that the local rendering capability does not meet the requirement, sending a rendering program of the video stream to the rendering node.

In this embodiment, if the client determines that the local rendering capability does not meet the requirement, the client directly sends the rendering program of the video stream to the rendering node because the rendering program of the three-dimensional page is already obtained in the client (obtained from the service node in step 403).

406. And the rendering node performs rendering preparation.

After receiving a rendering program of a video stream from a client, the rendering node performs a series of rendering preparations related to the client. The process of rendering preparation by the rendering node may refer to the relevant description part of step 207 in the embodiment shown in fig. 2, and is not described here again.

407. And the rendering node executes a rendering program of the video stream to generate the video stream comprising a plurality of playing pictures and sets a pull stream address for the video stream.

For the description of step 407, reference may be made to relevant description parts of step 209 in the embodiment shown in fig. 2, and details are not repeated here.

408. And the rendering node sends the pull stream address of the video stream to the client.

After the rendering node finishes rendering to obtain the video stream and sets a dedicated stream pulling address for the video stream, the stream pulling address is directly sent to the client. There are various ways for the rendering node to send the pull address to the client, for example, the rendering node may directly send the pull address of the video stream to the rendering node, or, for example, the rendering node may send the pull address of the video stream to the service node, so that the service node packages the pull address of the video stream into notification information and sends the notification information to the client, and the like.

409. And the client acquires the video stream from the stream pulling address and plays the video stream in the target display area.

For the description of step 409, reference may be made to the relevant description part of step 212 in the embodiment shown in fig. 2, and details are not repeated here.

The above is a detailed description of the cloud service based rendering method provided in the embodiment of the present application, and the cloud service based rendering device provided in the embodiment of the present application will be described below. Fig. 5 is a schematic structural diagram of a cloud service-based rendering apparatus provided in an embodiment of the present application, and as shown in fig. 5, the apparatus is the foregoing service node, and the apparatus includes:

a receiving module 501, configured to receive a rendering instruction of a client for a target display area;

a sending module 503, configured to send a rendering request to the rendering node according to the rendering instruction, where the rendering request is used to instruct the rendering node to invoke an image processing unit GPU arranged at the rendering node to render for the target display area so as to generate a video stream including multiple playing screens;

the sending module 503 is further configured to send notification information carrying the pull stream address of the video stream to the client, where the notification information is used to instruct the client to obtain the video stream from the pull stream address and play the video stream in the target display area.

In a possible implementation manner, the rendering instruction carries rendering requirement information, and the apparatus further includes: and a processing module 502, configured to select a rendering node matching the rendering requirement information from the rendering resource pool.

In a possible implementation manner, the rendering instruction carries rendering requirement information, and the apparatus further includes: and the processing module 502 is used for calling the cloud service to create a rendering node matched with the rendering demand information.

In a possible implementation manner, the sending module 503 is further configured to provide an access entry of a three-dimensional webpage; the receiving module 501 is further configured to receive an access request of a client for the three-dimensional webpage; the sending module 503 is further configured to send a rendering instruction of the three-dimensional webpage to the client according to the access request.

In a possible implementation manner, the receiving module 501 is further configured to receive a pull stream address sent by a rendering node.

In a possible implementation, the processing module 502 is further configured to pre-record the pull address.

It should be noted that, because the contents of information interaction, execution process, and the like between the modules/units of the apparatus are based on the same concept as the method embodiment of the present application, the technical effect brought by the contents is the same as the method embodiment of the present application, and specific contents may refer to the description in the foregoing method embodiment of the present application, and are not repeated herein.

Fig. 6 is a schematic structural diagram of a network device according to an embodiment of the present application. As shown in fig. 6, an embodiment of a network device in the embodiment of the present application may include one or more central processing units 601, a memory 602, an input/output interface 603, a wired or wireless network interface 604, and a power supply 605.

The memory 602 may be transient or persistent storage. Still further, the central processor 601 may be configured to communicate with the memory 602 to execute a series of instruction operations in the memory 602 on a network device.

In this embodiment, the central processing unit 601 may perform operations performed by the service node in the embodiments shown in fig. 2, fig. 3, and fig. 4, which are not described herein again in detail.

In this embodiment, the specific functional module division in the central processing unit 601 may be similar to the division manner of the receiving module, the processing module, and the sending module described in fig. 5, and details are not repeated here.

The embodiment of the present application also relates to a computer storage medium, which comprises computer readable instructions, and when the computer readable instructions are executed, the method described in fig. 2, fig. 3 and fig. 4 is realized.

Embodiments of the present application also relate to a computer program product containing instructions which, when run on a computer, cause the computer to perform the method as described in fig. 2, fig. 3 and fig. 4.

It is clear to those skilled in the art that, for convenience and brevity of description, the specific working processes of the above-described systems, apparatuses and units may refer to the corresponding processes in the foregoing method embodiments, and are not described herein again.

In the several embodiments provided in the present application, it should be understood that the disclosed system, apparatus and method may be implemented in other manners. For example, the above-described apparatus embodiments are merely illustrative, and for example, the division of the units is only one logical division, and other divisions may be realized in practice, for example, a plurality of units or components may be combined or integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, devices or units, and may be in an electrical, mechanical or other form.

The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.

In addition, functional units in the embodiments of the present application may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit. The integrated unit may be implemented in the form of hardware, or may also be implemented in the form of a software functional unit.

The integrated unit, if implemented in the form of a software functional unit and sold or used as a stand-alone product, may be stored in a computer readable storage medium. Based on such understanding, the technical solutions of the present application, which are essential or part of the technical solutions contributing to the prior art, or all or part of the technical solutions, may be embodied in the form of a software product, which is stored in a storage medium and includes several instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the methods described in the embodiments of the present application. And the aforementioned storage medium includes: a U-disk, a removable hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk, or an optical disk, and various media capable of storing program codes.

Claims

1. A cloud service-based rendering method, the method comprising:

the service node receives a rendering instruction of a client aiming at a target display area;

the service node sends a rendering request to a rendering node according to the rendering instruction, wherein the rendering request is used for instructing the rendering node to call an image processing unit (GPU) arranged at the rendering node to render aiming at the target display area so as to generate a video stream comprising a plurality of playing pictures;

and the service node sends notification information carrying the pull stream address of the video stream to the client, wherein the notification information is used for indicating the client to acquire the video stream from the pull stream address and play the video stream in the target display area.

2. The method according to claim 1, wherein the rendering instruction carries rendering requirement information, and before the service node sends the rendering request to a rendering node, the method further comprises:

the service node selects the rendering node matched with the rendering demand information from a rendering resource pool.

3. The method according to claim 1, wherein the rendering instruction carries rendering requirement information, and before the service node sends the rendering request to a rendering node, the method further comprises:

and the service node calls a cloud service to create the rendering node matched with the rendering requirement information.

4. The method according to claim 2 or 3, wherein the rendering nodes comprise a virtual machine provided with the GPU, a container and a bare metal server, which are provided in a data center.

5. The method of claim 1, wherein the rendering node is a physical server on which the GPU is located.

6. The method of any of claims 1 to 5, wherein before the service node receives a client request for rendering of the target display area, the method further comprises:

the service node provides an access entrance of the three-dimensional webpage;

the service node receives an access request of the client for the three-dimensional webpage;

and the service node sends a rendering instruction of the three-dimensional webpage to the client according to the access request.

7. The method according to any one of claims 1 to 6, wherein before the service node sends notification information carrying the pull address of the video stream to the client, the method further comprises:

and the service node receives the pull address sent by the rendering node.

8. The method according to any one of claims 1 to 6, wherein before the service node sends notification information carrying the pull address of the video stream to the client, the method further comprises:

the service node records the pull flow address in advance.

9. An apparatus for rendering based on a cloud service, the apparatus comprising:

the receiving module is used for receiving a rendering instruction of the client aiming at the target display area;

a sending module, configured to send a rendering request to a rendering node according to the rendering instruction, where the rendering request is used to instruct the rendering node to invoke an image processing unit GPU arranged at the rendering node to render the target display area so as to generate a video stream including multiple playing pictures;

the sending module is further configured to send notification information carrying a pull stream address of the video stream to the client, where the notification information is used to instruct the client to obtain the video stream from the pull stream address and play the video stream in the target display area.

10. The apparatus of claim 9, wherein the rendering instruction carries rendering requirement information, the apparatus further comprising:

and the processing module is used for selecting the rendering node matched with the rendering demand information from a rendering resource pool.

11. The apparatus of claim 9, wherein the rendering instruction carries rendering requirement information, the apparatus further comprising:

and the processing module is used for calling cloud service to create the rendering nodes matched with the rendering demand information.

12. The apparatus according to claim 10 or 11, wherein the rendering node comprises a virtual machine provided with the GPU, a container, and a bare metal server provided in a data center.

13. The apparatus of claim 9, wherein the rendering node is a physical server on which the GPU is disposed.

14. The apparatus according to any one of claims 9 to 13, wherein the sending module is further configured to provide an access portal for a three-dimensional web page;

the receiving module is further used for receiving an access request of the client for the three-dimensional webpage;

the sending module is further configured to send a rendering instruction of the three-dimensional webpage to the client according to the access request.

15. The apparatus according to any of claims 9 to 14, wherein the receiving module is further configured to receive the pull address sent by the rendering node.

16. The apparatus of any of claims 9 to 14, wherein the processing module is further configured to pre-record the pull address.

17. A network device, characterized in that the network device comprises: a processor and a memory;

the memory is used for storing computer execution instructions;

the processor is configured to execute computer-executable instructions stored by the memory to cause the network device to implement the method of any of claims 1-8.

18. A computer storage medium comprising computer readable instructions which, when executed, implement the method of any of claims 1 to 8.

19. A computer program product comprising instructions which, when run on a computer, cause the computer to perform the method of any one of claims 1 to 8.