CN116319790A

CN116319790A - Rendering method, device, equipment and storage medium of full-true scene

Info

Publication number: CN116319790A
Application number: CN202310237587.7A
Authority: CN
Inventors: 张锐杰; 史茹
Original assignee: Beijing Xintang Sichuang Educational Technology Co Ltd
Current assignee: Beijing Xintang Sichuang Educational Technology Co Ltd
Priority date: 2023-03-13
Filing date: 2023-03-13
Publication date: 2023-06-23

Abstract

The disclosure relates to a rendering method, device, equipment and storage medium of an all-true scene. The rendering method of the all-true scene is applied to the client and comprises the following steps: the method comprises the steps of sending a rendering request of a target all-true scene to a cloud end, wherein the cloud end is used for rendering the target all-true scene according to the rendering request and related resources, and collecting at least one picture generated in a rendering process in real time to obtain video data; and downloading and displaying the video data from a target address in a streaming mode to finish the rendering of the target all-true scene, wherein the target address is an address to which the cloud pushes the video data in a streaming mode. The method provided by the disclosure can rapidly complete rendering of the full-true scene, and render the full-true scene smoothly and clearly, so that the immersive experience of the user is greatly improved.

Description

Rendering method, device, equipment and storage medium of full-true scene

Technical Field

The disclosure relates to the technical field of data processing, and in particular relates to a rendering method, device, equipment and storage medium of an all-true scene.

Background

In an all-true scene, in order to provide a user with a different immersive experience from a completely new perspective, it is often necessary to create an immersive real scene to show a great deal of colorful details, which requires a device with very powerful hardware capabilities to support the picture rendering of the all-true scene.

However, due to different hardware performances of device configuration, the devices have different capacities of carrying fluency, and especially when rendering of the full-true scene is performed on the device with poor performance, the device cannot render the fluent and clear full-true scene due to insufficient hardware capacity, so that a user cannot experience the full-true scene immersively.

Disclosure of Invention

In order to solve the technical problems, the present disclosure provides a rendering method of an all-true scene, which can rapidly complete rendering of the all-true scene, render the smooth and clear all-true scene, and greatly promote immersive experience of a user.

According to an aspect of the present disclosure, there is provided a rendering method of an all-true scene, applied to a client, including:

the method comprises the steps of sending a rendering request of a target all-true scene to a cloud end, wherein the cloud end is used for rendering the target all-true scene according to the rendering request and related resources, and collecting at least one picture generated in a rendering process in real time to obtain video data;

and downloading and displaying the video data from a target address in a streaming mode to finish the rendering of the target all-true scene, wherein the target address is an address to which the cloud pushes the video data in a streaming mode.

According to another aspect of the present disclosure, there is provided a rendering method of an all-true scene, applied to a cloud, including:

receiving a rendering request of a target full-true scene sent by a client;

rendering the target all-true scene according to the rendering request and related resources, and collecting at least one picture generated in the rendering process in real time to obtain video data;

and pushing the video data to a target address in a push-stream mode, wherein the client is used for downloading the video data from the target address in a pull-stream mode and displaying the video data so as to complete the rendering of the target all-true scene.

According to another aspect of the present disclosure, there is provided a rendering apparatus of an all-true scene, applied to a client, including:

the system comprises a sending module, a rendering module and a rendering module, wherein the sending module is used for sending a rendering request of a target all-true scene to a cloud end, and the cloud end is used for rendering the target all-true scene according to the rendering request and related resources and collecting at least one picture generated in the rendering process in real time to obtain video data;

and the streaming module is used for downloading and displaying the video data from a target address in a streaming mode so as to complete the rendering of the target all-true scene, wherein the target address is an address to which the cloud pushes the video data in a streaming mode.

According to another aspect of the present disclosure, there is provided a rendering apparatus of an all-true scene, applied to a cloud, including:

the receiving module is used for receiving a rendering request of the target full-true scene sent by the client;

the rendering module is used for rendering the target all-true scene according to the rendering request and related resources, and collecting at least one picture generated in the rendering process in real time to obtain video data;

and the pushing module is used for pushing the video data to a target address in a pushing manner, and the client is used for downloading the video data from the target address in a pulling manner and displaying the video data so as to complete the rendering of the target all-true scene.

According to another aspect of the present disclosure, there is provided an electronic device including: a processor; and a memory storing a program, wherein the program comprises instructions that when executed by the processor cause the processor to perform a rendering method according to the above-described all-true scene.

According to another aspect of the present disclosure, there is provided a non-transitory computer-readable storage medium storing computer instructions for causing the computer to perform a rendering method according to an all-true scene.

According to another aspect of the present disclosure, there is provided a computer program product comprising a computer program which, when executed by a processor, implements the above-described method of rendering an all-true scene.

Compared with the prior art, the technical scheme provided by the embodiment of the disclosure has the following advantages:

the embodiment of the disclosure provides a rendering method of an all-true scene, which is applied to a client and comprises the following steps: the method comprises the steps of sending a rendering request of a target all-true scene to a cloud end, wherein the cloud end is used for rendering the target all-true scene according to the rendering request and related resources, and collecting at least one picture generated in a rendering process in real time to obtain video data; and downloading and displaying the video data from a target address in a streaming mode to finish the rendering of the target all-true scene, wherein the target address is an address to which the cloud pushes the video data in a streaming mode. The method provided by the disclosure can be used for efficiently and rapidly completing the rendering of the full-true scene, the influence of the performance of the equipment is reduced, the smooth and clear full-true scene can be maximally rendered for the equipment with poor performance, and the immersive experience of the user is greatly improved.

Drawings

The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the disclosure and together with the description, serve to explain the principles of the disclosure.

In order to more clearly illustrate the embodiments of the present disclosure or the solutions in the prior art, the drawings that are required for the description of the embodiments or the prior art will be briefly described below, and it will be obvious to those skilled in the art that other drawings can be obtained from these drawings without inventive effort.

Fig. 1 is a diagram of a rendering system of an all-true scene provided by an embodiment of the present disclosure;

fig. 2 is a flowchart of a rendering method of an all-true scene provided by an embodiment of the disclosure;

FIG. 3 is a flowchart of a rendering method of an all-true scene provided by an embodiment of the disclosure;

fig. 4 is a flowchart of a rendering method of an all-true scene provided by an embodiment of the disclosure;

fig. 5 is a schematic structural diagram of a rendering device for a full-true scene according to an embodiment of the disclosure;

fig. 6 is a schematic structural diagram of a rendering device for a full-true scene according to an embodiment of the disclosure;

fig. 7 is a schematic structural diagram of an electronic device according to an embodiment of the disclosure.

Detailed Description

In order that the above objects, features and advantages of the present disclosure may be more clearly understood, embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. While certain embodiments of the present disclosure have been shown in the accompanying drawings, it is to be understood that the present disclosure may be embodied in various forms and should not be construed as limited to the embodiments set forth herein, but are provided to provide a more thorough and complete understanding of the present disclosure. It should be understood that the drawings and embodiments of the present disclosure are for illustration purposes only and are not intended to limit the scope of the present disclosure.

It should be understood that the various steps recited in the method embodiments of the present disclosure may be performed in a different order and/or performed in parallel. Furthermore, method embodiments may include additional steps and/or omit performing the illustrated steps. The scope of the present disclosure is not limited in this respect.

The term "including" and variations thereof as used herein are intended to be open-ended, i.e., including, but not limited to. The term "based on" is based at least in part on. The term "one embodiment" means "at least one embodiment"; the term "another embodiment" means "at least one additional embodiment"; the term "some embodiments" means "at least some embodiments. Related definitions of other terms will be given in the description below. It should be noted that the terms "first," "second," and the like in this disclosure are merely used to distinguish between different devices, modules, or units and are not used to define an order or interdependence of functions performed by the devices, modules, or units.

It should be noted that references to "one", "a plurality" and "a plurality" in this disclosure are intended to be illustrative rather than limiting, and those of ordinary skill in the art will appreciate that "one or more" is intended to be understood as "one or more" unless the context clearly indicates otherwise.

The names of messages or information interacted between the various devices in the embodiments of the present disclosure are for illustrative purposes only and are not intended to limit the scope of such messages or information.

Before explaining the embodiments of the present disclosure in detail, related terms referred to in the present disclosure are explained first.

Full true environment/full true scene: is a virtual scene that an application (e.g., educational application) client displays (or provides) while running on a terminal, and can provide a real immersive experience for the user. The virtual scene may be a scene that simulates a real world, or may also be a fictional scene, or may be a semi-real and semi-fictional scene. It is to be appreciated that the present disclosure provides for a full true scene that is three-dimensional (3D), which can be understood as a three-dimensional virtual scene.

RTC: is the short name of real-time communication (Real time communication), which is an audio-video communication technology of real-time interaction.

At present, more lifelike and rich 3D pictures in the full-true scene are required to be displayed, and the performance requirements on equipment are often higher, so that the same full-true scene is different in performance on equipment with different performances. Especially, under the condition that the performances of various existing devices are uneven, the conditions of rendering jam, screen blackout, abnormal exit and the like often occur when the low-end device renders the full-true scene. These situations have a very negative impact on the user experience of the low-end device.

Currently, in the conventional scheme 1, resources, image quality, shadow effect, and the like used in a scene are adjusted according to different device types. For equipment with poor hardware performance, hardware cost required by rendering is reduced by loading lower resolution, poor image quality and using poor shadow effect, so that smoothness of picture rendering is improved to a certain extent, and user experience is improved. Although the scheme 1 can improve the smoothness of picture rendering to a certain extent, the smoothness of rendering is replaced by sacrificing the picture definition and detail effect, so that users with requirements on the picture definition are difficult to meet, and the immersive experience of the users is poor. In the scheme 1, the effects of loading resources, image quality, mapping, shading and the like are adjusted according to different equipment types, so that the loaded adjustment logic is needed to be judged for a plurality of times in the software code, the code complexity is increased, the error rate of the code is possibly increased, and the implementation is relatively poor.

In order to achieve better rendering performance, in the existing scheme 2, the rendering technologies such as shadow effect, shielding, illumination and the like in a scene are optimized by modifying a rendering pipeline, so that the performance requirement on hardware in operation is reduced from a rendering flow, and the smoothness of rendering and user experience are improved. However, the scheme 2 involves modification of the rendering pipeline, so that modification personnel are very familiar with the rendering technology, and the learning cost is high, so that the technical difficulty is high and the implementation complexity is high. Secondly, after the rendering pipeline is customized through transformation, the original rendering pipeline flow is affected, and the normal rendering flow may be abnormal to different degrees.

Aiming at the technical problems, the embodiment of the disclosure provides a rendering method of an all-true scene, which is applied to a client, wherein the client can be various types of electronic equipment, and specifically, the client sends a rendering request of a target all-true scene to a cloud end, the cloud end hardware configuration is higher, the target all-true scene can be rendered according to the rendering request and related resources by adopting a normal rendering flow, meanwhile, video data is acquired by collecting visual rendering pictures in the rendering process, the video data is pushed to a target address in an RTC push mode, and then the client pulls the video data from the target address in an RTC pull mode, so that the video stream of the target all-true scene can be rapidly acquired in real time, and real all-true scene can be smoothly loaded, clear and colorful details can be smoothly rendered. And in particular by one or more of the following examples.

Fig. 1 is a block diagram of a rendering system of an all-true scene provided in an embodiment of the present disclosure, and before explaining a rendering method of an all-true scene provided in an embodiment of the present disclosure in detail, a detailed description is preferably given to a structure/architecture of a rendering system of an all-true scene (hereinafter referred to as a rendering system), specifically, referring to fig. 1, the rendering system includes a client, a cloud, and a service backend, where:

cloud (cloud server): the cloud service is used for providing cloud service for the client, and the cloud service is a container for actually deploying and loading the scene. The cloud comprises a plurality of machines, at least one application program is deployed on each machine, and the application programs of the scenes can be called through a cloud service, for example. The cloud comprises a deployment loading module, a dispatching and distributing module, a rendering and collecting module and a pushing module, wherein the deployment loading module is used for scene deployment and loading, the dispatching and distributing module is used for resource dispatching and distributing service, the rendering and collecting module is used for scene rendering and video data collection, and the pushing module is used for pushing video data RTG to a far-end address. The rendering process of the cloud is as follows: when receiving a scheduling task sent by a service back end, the cloud end locks or unlocks a machine to start or close an application program process on the machine, and the performance of the application program equipment running on the machine is relatively high-end and stable so as to ensure that real and detailed full-true scenes are quickly, smoothly and clearly rendered, meanwhile, a rendering picture is collected in real time and is used as video data, the video data is pushed to a far-end address through an RTC, and the client is enabled to pull the video data from the far-end address in real time and efficiently and display the video data.

Business back end: the cloud terminal can be regarded as a business background for processing the business of the client terminal, and is used for receiving the rendering task starting or closing task of the client terminal, managing and distributing task scheduling, requesting the cloud terminal to lock or unlock machine resources by the scheduling task, and feeding back the task state to the client terminal. The service back end comprises a management module, a request forwarding module, a release forwarding module and an association establishing module, wherein the management module is used for managing a task queue, the request forwarding module is used for forwarding rendering requests sent by clients to the cloud, the release forwarding module is used for forwarding closing requests sent by different clients to the cloud, the association establishing module is used for transmitting binding information for establishing links to the clients, and the links refer to transmission links between the clients and machines. The business processing flow of the business back end is as follows: when a rendering request sent by a client is received to request a cloud service, if at the moment, a machine with an idle running state exists in the cloud, machine locking information returned by the cloud service is received, and if at the moment, no machine with the idle running state exists in the cloud, a service back end is required to start to manage a task queue, so that when the next time the cloud has the machine released (unlocked) and then is in the idle state, the machine can be timely allocated to the rendering request in the management task queue, and the machine can be timely locked.

Client side: is the terminal that actually accepts rendering. The client comprises a streaming module and a processing module, wherein the streaming module is used for streaming video data from a remote address through an RTC, the processing module is used for sending rendering requests, closing requests and the like to a service background, and receiving locking information fed back by the service back end so as to lock the cloud machine in real time. The rendering process of the client is as follows: after the cloud machine is successfully connected with the cloud machine request, video data is pulled from a remote address through RTC streaming, so that a user can watch high-quality real-time pictures started and rendered by the cloud, and when watching is finished, the request is closed to the cloud service through the service rear end, and scene rendering and real-time plug flow are finished.

Fig. 2 is a flowchart of a rendering method of an all-true scene provided in an embodiment of the disclosure. The method can be suitable for smoothly and clearly rendering the application scene of the complex full-true scene by the client sides of different equipment types, so that the user can conveniently experience the full-true scene in an immersive mode. The rendering method of the all-true scene can be executed by a rendering device of the all-true scene, the device can be realized in a software and/or hardware mode, the device can be configured in electronic equipment, and the electronic equipment is a client in the rendering system, and specifically comprises but is not limited to electronic equipment with a display screen, such as a smart phone, a palm computer, a tablet personal computer, portable wearable equipment, intelligent home equipment (e.g. a desk lamp) and the like.

As shown in fig. 2, the method may specifically include the following steps S210 to S220:

s210, sending a rendering request of a target all-true scene to a cloud end, wherein the cloud end is used for rendering the target all-true scene according to the rendering request and related resources, and collecting at least one picture generated in the rendering process in real time to obtain video data.

Optionally, before executing S210 to send the rendering request of the target all-true scene to the cloud, the rendering request needs to be generated, which is specifically implemented by the following steps:

responding to the scene starting operation of the target full-true scene, and acquiring the equipment information of the client; and if the equipment information accords with the preset standard, determining the client as low-end equipment.

It can be understood that a start interface of the target all-true scene is displayed, the start interface includes a scene start identifier, and the scene start operation is executed in response to a trigger operation of the scene start identifier. The scene starting operation refers to starting to prepare for requesting to render the scene, that is, after the user clicks the scene starting identifier, starting to prepare for rendering the target full-true scene. The method comprises the steps of responding to scene starting operation of a target full-true scene, acquiring equipment information of a client, wherein the equipment information comprises hardware information such as an equipment processor and a memory, judging the hardware condition according to a preset judging standard, judging the equipment type of the client, wherein the equipment type comprises low-end equipment, middle-end equipment and high-end equipment, different equipment types have different judging standards, the judging standard comprises preset standards, the preset standards are used for distinguishing the low-end equipment and the middle-end equipment and the high-end equipment (the middle-end equipment and the high-end equipment), if the equipment information accords with the preset standards, the client is indicated to belong to the low-end equipment, namely, the client is indicated to belong to the middle-end equipment and the high-end equipment only by virtue of the equipment, if the equipment information does not accord with the preset standards, the equipment type of the client can be indicated to a certain extent by virtue of the equipment smoothness and the clarity, the preset standards of the low-end equipment and the middle-end equipment comprise the standard of the equipment, the preset standards of the two parameters of the memory and the processor can be determined by self according to the user requirements, and the setting of specific parameter standards can be determined by self according to the user requirements, and the requirements are not limited.

Optionally, in the step S210, a rendering request of the target all true scene is sent to the cloud, which is specifically implemented by the following steps:

and under the condition that the client is determined to be low-end equipment, generating a rendering request aiming at the target all-true scene, and sending the rendering request to a cloud.

It can be understood that if it is determined that the client belongs to the low-end device, cloud remote rendering needs to be started, a rendering request for a target all-true scene can be directly generated, and the rendering request is sent to the cloud through the service back end, where the rendering request includes related information of the target all-true scene and request information for starting cloud service, and the related information of the target all-true scene includes a scene name, a scene identifier, a user identifier corresponding to the client, and a unique identifier, for example, in an educational scene, the scene name is a course name, the scene identifier is a lesson identifier, for example, an educational scene of a third language course is to be rendered at the cloud remote end.

It can be understood that if the client belongs to the middle-high-end device, whether to start cloud remote rendering and the time for starting the cloud remote rendering can be determined according to the user requirements. A feasible scene, whether the cloud end remote rendering is started or not can be automatically triggered by the middle-high-end equipment in a man-machine interaction mode, and if the load of the middle-high-end equipment is overloaded due to other task processes, the cloud end remote rendering can be started to reduce the overload condition. And after the middle-high-end equipment automatically finishes the rendering of the partial full-true scene, starting cloud remote rendering to continuously finish the rendering of the rest partial full-true scene, wherein other feasible application scenes are not limited.

S220, downloading the video data from the target address in a streaming mode and displaying the video data so as to complete rendering of the target all-true scene.

The target address is an address to which the cloud pushes the video data in a push mode.

It can be understood that after the cloud receives the rendering request of the service rear end, the cloud machine which is currently idle is locked for the client, the cloud service deployed on the cloud machine is started to render the target full-true scene according to the rendering request and related resources by utilizing the cloud machine, at least one rendering picture generated in the rendering process is acquired in real time to obtain video data, then the cloud service pushes the video data acquired in real time to a preset address in a live broadcast push mode of the RTC, and the pushed preset address is the target address and can be also understood as a push address.

It can be understood that, on the basis of S210, after determining that the cloud pushes the video data to the target address, the cloud starts the client for remote rendering, downloads the video data from the target address by linking the corresponding RTC channel and adopting a streaming manner, that is, pulls the real-time rendering picture of the cloud service push stream through the RTC channel, and displays the video data, so as to complete the cloud remote rendering of the target all-true scene, and realize the high-performance rendering of the client. Each client end establishing cloud remote rendering with the cloud end has a corresponding RTC channel, after the cloud end distributes cloud machines for the client ends and locks, the service rear end returns the RTC channels to the client ends after determining machine locking (the machine establishes a binding relation with the client ends), and links of the client ends and machine users for transmitting video data are established, so that the client ends pull the video data based on the RTC channels, machine locking can be understood as marking the machine with a user identifier of the client ends, for example, the client ends 1 and the machine 1 establish the binding relation, and the machine 1 is in a non-idle state in the case that rendering tasks of the client ends 1 are distributed for the machine 1.

Optionally, after the rendering request is sent to the cloud, the cloud starts to execute the rendering task, in this case, the client may send a scene closing request to the cloud to instruct the cloud to stop/interrupt the rendering task, which is specifically implemented by the following steps:

responding to the scene closing operation of the target full-true scene, and generating a closing request; and sending the closing request to the cloud end, wherein the cloud end is used for stopping the collection of at least one picture generated in the rendering process and pushing the video data according to the closing request.

It can be understood that, the display interface displays the target all-true scene, where the display interface includes a scene closing identifier, and the scene closing operation is performed in response to the triggering operation of the scene closing identifier, that is, after the client views all-true scenes in the video data, or when the client needs to close all-true scenes in the video data, the scene closing identifier of the display interface is clicked. In this case, a scene closing operation of the target full-true scene is responded, a closing request for the target full-true scene is generated, the closing request is a request for closing the full-true scene, the closing request is sent to a service back end, and when the service back end receives the closing request, the closing request is forwarded to a cloud end, so that the cloud end service stops/interrupts a rendering task, and specifically, the stopping/interrupting the rendering task includes: and stopping the collection of at least one rendering picture generated in the rendering process and/or pushing video data and unlocking the machine so as to enable the next client to conduct cloud remote rendering.

The embodiment of the disclosure provides a rendering method of an all-true scene, which is applied to a client, adopts a cloud plug-flow client to pull streams, is similar to a live broadcast mode, can realize synchronous rendering of the client and the cloud to a certain extent, and effectively reduces the rendering waiting time of a user for watching a target all-true scene. Secondly, the client pulls RTC video data from the target address on the basis of not consuming excessive hardware performance, so that smooth, clear and real 3D rendering pictures can be experienced, that is, actual rendering is not needed on the client, and therefore the rendering process is not influenced by the equipment performance and has strong practicability.

On the basis of the foregoing embodiments, fig. 3 is a flowchart of a rendering method of an all-true scene provided in an embodiment of the present disclosure, which is applied to a cloud in the foregoing rendering system, and specifically includes the following steps S310 to S330 as shown in fig. 3:

s310, receiving a rendering request of the target all-true scene sent by the client.

It can be understood that the rendering request for the target all-true scene sent by the client is received based on the service rear end. It can be understood that the service back end can monitor the running condition of each machine in the cloud, specifically can monitor the locking result of the machines fed back by the cloud, if the locking of the machines by the cloud fails, it is indicated that the cloud does not have a machine in an idle state, and if the locking of the machines by the cloud fails, the cloud has a machine in an idle state. If the service back end monitors and determines that the cloud end has a machine in an idle state or receives information of success of locking the machine fed back by the cloud end, the client end can directly send a rendering request to the cloud end.

And S320, rendering the target all-true scene according to the rendering request and related resources, and acquiring at least one picture generated in the rendering process in real time to obtain video data.

It can be understood that, on the basis of S310, relevant resources are loaded according to the rendering request to render the target all-true scene, and the cloud device condition supports the normal rendering process, so that the specific rendering process is not limited. After the rendering of the target all-true scene is started, the cloud service starts to acquire a real-time rendering picture of the current cloud service for the starting, loading and rendering of the target all-true scene by screen capturing or other modes capable of acquiring the rendering picture, so as to obtain a video stream. Specifically, the rendering request may further include a frame number of the acquired frames of the frames and a preset resolution, for example, 20 frames of frames are acquired by screen capturing according to the preset resolution every second in the rendering process, and the 20 frames of frames can form video data. In addition, the duration of the video data of the push stream can also be controlled, for example, based on the above example, the video data with one second duration is pushed to the target address, or the video data with three seconds duration is obtained and then pushed to the target address, at this time, the video data with three seconds duration includes 60 frames of pictures, the duration of the video data of the specific push stream and the acquired frames of the video data are not limited herein, and can be determined by the user according to the needs.

Wherein the cloud includes a plurality of machines for rendering, the rendering request including a user identification.

Optionally, in S320, the target all-true scene is rendered according to the rendering request and related resources, which is specifically implemented by the following steps:

inquiring the running states of the multiple machines to obtain a current inquiring result; if the current query result is that a target machine with an idle running state exists in the multiple machines, determining the rendering request as a target request; establishing an association relationship between the target machine and the client according to the user identification in the target request; and after the association relation is established, rendering the target all-true scene by the target machine according to the related resources.

It can be understood that after the cloud service receives the rendering request of the service back end, the running states of the multiple machines are queried to obtain the current query result, wherein the running states include an idle state and a non-idle state, and the non-idle state refers to that other tasks are allocated and cannot execute new tasks, that is, the machines currently have tasks being executed. The load condition of the machine can be queried when the running state is determined, if the memory occupied by the machine for executing the current task is less, a new rendering task can be allocated to the machine according to the memory occupied by each rendering task, and the mode for specifically determining the running state of the machine is not limited. If the current query result is that a target machine with an idle running state exists in a plurality of machines, determining a rendering request as a target request, wherein the target request refers to a request to be processed, then establishing an association relationship between the target machine and a client which sends the target request according to a user identifier in the target request, namely locking the currently idle machine for the client, establishing a binding relationship, and returning an RTC channel number corresponding to the machine to a service back end so as to enable the machine and the client to establish a transmission link for transmitting video data. After the association relation between the client and the target machine is established, the cloud service starts an application program on the target machine, and starts rendering of the target full-true scene according to related resources so as to render the smooth and clear target full-true scene.

Optionally, after the querying the running states of the multiple machines, determining, by different processing manners, the target machine for the client based on different running states of the multiple machines, where all machines are in a non-idle state, is specifically implemented by:

if the current query result is that the target machine with the idle running state does not exist in the multiple machines, adding the rendering request into a queue to be processed, and determining the moment of next querying the running states of the multiple machines to obtain the next query result; and if the next query result is that a first machine with an idle running state exists in the multiple machines or information of the first machine to release the association relation is received before the next query is performed, determining the first machine as a target machine, and determining the rendering request in the queue to be processed as a target request.

It can be understood that if the current query result is that there is no target machine whose running state is idle state in the multiple machines, that is, there is no machine whose cloud end is idle currently, and locking the machine for the client fails, the service back end is required to open a queuing queue, add the rendering request into the queue to be processed, query the running state of the machine at regular time, allocate the machine for the rendering task to be started in the queue in time, and determine the time for querying the running states of the multiple machines at the next time according to the set time for timing query, so as to obtain the next query result. If the next query result is that a first machine with an idle running state exists in the multiple machines, that is, a currently idle machine can distribute a rendering task, the situation may be that the first machine completes the rendering task, or information that the first machine is unlocked before the next query is performed, that is, information that the first machine is unlocked before the moment of next query of the running state is received, where the client self-closes a rendering scene in rendering, where the two possible cases may be that the first machine is determined to be a target machine, the target machine refers to a machine to perform the rendering task, and the first machine appearing in the two cases refers to the currently idle machine appearing in different cases. Then, the rendering request in the queue to be processed is determined as the target request, where the rendering request may be the first rendering request in the queue to be processed, which is ordered according to other modes such as time or priority, and the flow after determining the target machine and the target request is referred to the above embodiments, which are not described herein in detail.

Wherein the rendering request further includes a session identification of the target all-true scene.

Optionally, in S320, the target all true scene is rendered according to the related resources, which is specifically implemented by the following steps:

downloading related resources according to the session identifier and/or reading related resources corresponding to the session identifier from pre-stored rendering resources; and loading the related resources to render the target all-true scene.

Understandably, after the association relation between the client and the target machine is established, the resource downloading and deployment of the all-true 3D scene are started at the cloud, and the target all-true scene is loaded and rendered.

S330, pushing the video data to a target address in a push-stream mode, wherein the client is used for downloading the video data from the target address in a pull-stream mode and displaying the video data so as to complete rendering of the target all-true scene.

It can be understood that, based on S320, the rendered part of the video data may be pushed to the target address for the client to pull the video data from the target address and display, that is, in the rendering process of the whole target full-true scene, the rendering and the pushing are performed synchronously, that is, the pushing is performed while the rendering is performed, so as to provide the user with fast, smooth and clear scene content at the client.

Optionally, in the executing process of S320 and/or S330, that is, the cloud may push the partial video data to the target address after obtaining the partial video data in the rendering process, so that the partial video data is pulled and displayed by the client, which is equivalent to the process that the client views the scene in real time or synchronously to render the scene, so as to reduce the waiting time of the user. In the process of executing the rendering task by the cloud, if the client closes the scene, the cloud also needs to stop the executing rendering task, which is realized by the following steps:

receiving a closing request sent by the client; and stopping the collection of at least one picture generated in the rendering process and the pushing of the video data according to the closing request, and releasing the association relation between the target machine and the client.

It can be understood that, in the rendering process, a closing request sent by the client through the service back end is received, and the closing request is used for indicating the machine to interrupt/stop the rendering task, specifically, stopping the collection of the picture, the generation of the video data and the pushing of the video data, and releasing the association relationship between the target machine and the client, so as to release the transmission link between the client and the target machine for transmitting the video data.

The embodiment of the disclosure provides a rendering method of an all-true scene, which is applied to a cloud, wherein the cloud distributes a machine which executes a rendering task and has high equipment performance for a client, and the machine is started to rapidly load out the target all-true scene through a normal rendering process, so that a smooth and clear picture can be rendered without modifying the rendering process. Meanwhile, the screen capturing acquisition is carried out on the rendered picture to obtain video data, the video data is pushed to the target address through the RTC, so that the client can pull the video data on the target address through the RTC, and the client can immersion experience a smooth and clear full-true scene picture without consuming excessive hardware performance. And in the rendering process, the rendering pictures are collected in real time and are pushed in real time, so that a user can watch the rendering pictures of the target full-true scene in a short time, and the experience effect of the full-true immersive scene of the user is greatly improved.

Fig. 4 is a flowchart of a rendering method of an all-true scene provided in an embodiment of the present disclosure, which is applied to the above-mentioned rendering system, and specifically includes the following steps S410 to S490 as described in fig. 4:

s410, the client starts a target all-true scene.

And S420, the client sends a rendering request of the target all-true scene to the service back end under the condition that the client is determined to be the low-end device according to the device information so as to start rendering service of the cloud.

S430, the cloud establishes an association relationship between the currently idle target machine and the client.

S440, starting an application program deployed on the target machine by the cloud to render the target application scene.

S450, the cloud acquires at least one rendering picture of the application program in the rendering process to obtain video data.

S460, pushing the video data to the target address through the RTC by the cloud.

And S470, the client pulls and displays the video data of the target all-true scene through the RTC.

S480, the client closes the target all-true scene, and initiates a closing request to the cloud through the service back end.

S490, the cloud end closes a transmission link between the client and the target machine for transmitting video data based on the closing request, releases the association relation between the target machine and the client, and stops the acquisition of the rendering picture and RTC plug flow of the video data.

It can be appreciated that the specific implementation process of S410 to S490 is referred to the above embodiment, and is not described herein.

Fig. 5 is a schematic structural diagram of a rendering device for an all-true scene according to an embodiment of the disclosure. The apparatus for rendering an all-true scene provided in the embodiments of the present disclosure is applied to a client in the foregoing rendering system, and may execute a processing flow provided by the embodiment of a rendering method for an all-true scene, as shown in fig. 5, where, the apparatus 500 for rendering an all-true scene includes a sending module 510 and a streaming module 520, where:

the sending module 510 is configured to send a rendering request of a target all-true scene to a cloud, where the cloud is configured to render the target all-true scene according to the rendering request and related resources, and collect at least one picture generated in a rendering process in real time to obtain video data;

and the streaming module 520 is configured to download and display the video data from a target address in a streaming manner, so as to complete rendering of the target all-true scene, where the target address is an address to which the cloud pushes the video data in a streaming manner.

Optionally, the apparatus 500 is further configured to:

responding to the scene starting operation of the target full-true scene, and acquiring the equipment information of the client;

If the equipment information accords with the preset standard, the client is determined to be low-end equipment;

optionally, the sending module 510 is configured to:

Optionally, the apparatus 500 is further configured to:

responding to the scene closing operation of the target full-true scene, and generating a closing request;

and sending the closing request to the cloud end, wherein the cloud end is used for stopping the collection of at least one picture generated in the rendering process and pushing the video data according to the closing request.

The device provided in this embodiment has the same implementation principle and technical effects as those of the foregoing method embodiment, and for brevity, reference may be made to the corresponding content of the foregoing method embodiment where the device embodiment is not mentioned.

Fig. 6 is a schematic structural diagram of a rendering device for an all-true scene according to an embodiment of the disclosure. The apparatus for rendering a full-true scene provided in the embodiments of the present disclosure is applied to the cloud end in the above-mentioned rendering system, and may execute the processing flow provided by the embodiment of the method for rendering a full-true scene, as shown in fig. 6, where the apparatus 600 for rendering a full-true scene includes a receiving module 610, a rendering module 620, and a plug flow module 630, where:

A receiving module 610, configured to receive a rendering request of a target all-true scene sent by a client;

the rendering module 620 is configured to render the target all-true scene according to the rendering request and related resources, and acquire at least one picture generated in the rendering process in real time to obtain video data;

and the push module 630 is configured to push the video data to a target address in a push manner, and the client is configured to download and display the video data from the target address in a pull manner, so as to complete rendering of the target all-true scene.

Optionally, the rendering module 620 is specifically configured to:

inquiring the running states of the multiple machines to obtain a current inquiring result;

if the current query result is that a target machine with an idle running state exists in the multiple machines, determining the rendering request as a target request;

establishing an association relationship between the target machine and the client according to the user identification in the target request;

and after the association relation is established, rendering the target all-true scene by the target machine according to the related resources.

Optionally, the apparatus 600 is further configured to:

if the current query result is that the target machine with the idle running state does not exist in the multiple machines, adding the rendering request into a queue to be processed, and determining the moment of next querying the running states of the multiple machines to obtain the next query result;

and if the next query result is that a first machine with an idle running state exists in the multiple machines or information of the first machine to release the association relation is received before the next query is performed, determining the first machine as a target machine, and determining the rendering request in the queue to be processed as a target request.

Optionally, the rendering module 620 is specifically configured to:

downloading related resources according to the session identifier and/or reading related resources corresponding to the session identifier from pre-stored rendering resources;

and loading the related resources to render the target all-true scene.

Optionally, the apparatus 600 is further configured to:

receiving a closing request sent by the client;

and stopping the collection of at least one picture generated in the rendering process and the pushing of the video data according to the closing request, and releasing the association relation between the target machine and the client.

The exemplary embodiments of the present disclosure also provide an electronic device including: at least one processor; and a memory communicatively coupled to the at least one processor. The memory stores a computer program executable by the at least one processor for causing the electronic device to perform a method according to embodiments of the present disclosure when executed by the at least one processor.

The present disclosure also provides a computer program product comprising a computer program, wherein the computer program, when executed by a processor of a computer, is for causing the computer to perform a method according to embodiments of the disclosure.

Referring to fig. 7, a block diagram of an electronic device 400 that may be a server or a client of the present disclosure, which is an example of a hardware device that may be applied to aspects of the present disclosure, will now be described. Electronic devices are intended to represent various forms of digital electronic computer devices, such as laptops, desktops, workstations, personal digital assistants, servers, blade servers, mainframes, and other suitable computers. The electronic device may also represent various forms of mobile devices, such as personal digital processing, cellular telephones, smartphones, wearable devices, and other similar computing devices. The components shown herein, their connections and relationships, and their functions, are meant to be exemplary only, and are not meant to limit implementations of the disclosure described and/or claimed herein.

As shown in fig. 7, the electronic device 700 includes a computing unit 701 that can perform various appropriate actions and processes according to a computer program stored in a Read Only Memory (ROM) 702 or a computer program loaded from a storage unit 708 into a Random Access Memory (RAM) 703. In the RAM 703, various programs and data required for the operation of the device 700 may also be stored. The computing unit 701, the ROM 702, and the RAM 703 are connected to each other through a bus 704. An input/output (I/O) interface 705 is also connected to bus 704.

Various components in the electronic device 700 are connected to the I/O interface 705, including: an input unit 706, an output unit 707, a storage unit 708, and a communication unit 709. The input unit 706 may be any type of device capable of inputting information to the electronic device 700, and the input unit 706 may receive input numeric or character information and generate key signal inputs related to user settings and/or function controls of the electronic device. The output unit 707 may be any type of device capable of presenting information and may include, but is not limited to, a display, speakers, video/audio output terminals, vibrators, and/or printers. Storage unit 704 may include, but is not limited to, magnetic disks, optical disks. The communication unit 709 allows the electronic device 700 to exchange information/data with other devices through computer networks, such as the internet, and/or various telecommunications networks, and may include, but is not limited to, modems, network cards, infrared communication devices, wireless communication transceivers and/or chipsets, such as bluetooth (TM) devices, wiFi devices, wiMax devices, cellular communication devices, and/or the like.

The computing unit 701 may be a variety of general and/or special purpose processing components having processing and computing capabilities. Some examples of computing unit 701 include, but are not limited to, a Central Processing Unit (CPU), a Graphics Processing Unit (GPU), various specialized Artificial Intelligence (AI) computing chips, various computing units running machine learning model algorithms, a Digital Signal Processor (DSP), and any suitable processor, controller, microcontroller, etc. The computing unit 701 performs the various methods and processes described above. For example, in some embodiments, the method of rendering an all-true scene or the method of rendering an all-true scene may be implemented as a computer software program tangibly embodied on a machine-readable medium, such as the storage unit 708. In some embodiments, part or all of the computer program may be loaded and/or installed onto the electronic device 700 via the ROM 702 and/or the communication unit 709. In some embodiments, the computing unit 701 may be configured to perform the rendering method of the all-true scene by any other suitable means (e.g., by means of firmware).

Program code for carrying out methods of the present disclosure may be written in any combination of one or more programming languages. These program code may be provided to a processor or controller of a general purpose computer, special purpose computer, or other programmable data processing apparatus such that the program code, when executed by the processor or controller, causes the functions/operations specified in the flowchart and/or block diagram to be implemented. The program code may execute entirely on the machine, partly on the machine, as a stand-alone software package, partly on the machine and partly on a remote machine or entirely on the remote machine or server.

In the context of this disclosure, a machine-readable medium may be a tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. The machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. The machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing. More specific examples of a machine-readable storage medium would include an electrical connection based on one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

As used in this disclosure, the terms "machine-readable medium" and "computer-readable medium" refer to any computer program product, apparatus, and/or device (e.g., magnetic discs, optical disks, memory, programmable Logic Devices (PLDs)) used to provide machine instructions and/or data to a programmable processor, including a machine-readable medium that receives machine instructions as a machine-readable signal. The term "machine-readable signal" refers to any signal used to provide machine instructions and/or data to a programmable processor.

To provide for interaction with a user, the systems and techniques described here can be implemented on a computer having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to a user; and a keyboard and pointing device (e.g., a mouse or trackball) by which a user can provide input to the computer. Other kinds of devices may also be used to provide for interaction with a user; for example, feedback provided to the user may be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user may be received in any form, including acoustic input, speech input, or tactile input.

The systems and techniques described here can be implemented in a computing system that includes a background component (e.g., as a data server), or that includes a middleware component (e.g., an application server), or that includes a front-end component (e.g., a user computer having a graphical user interface or a web browser through which a user can interact with an implementation of the systems and techniques described here), or any combination of such background, middleware, or front-end components. The components of the system can be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: local Area Networks (LANs), wide Area Networks (WANs), and the internet.

The computer system may include a client and a server. The client and server are typically remote from each other and typically interact through a communication network. The relationship of client and server arises by virtue of computer programs running on the respective computers and having a client-server relationship to each other.

The foregoing is merely a specific embodiment of the disclosure to enable one skilled in the art to understand or practice the disclosure. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other embodiments without departing from the spirit or scope of the disclosure. Thus, the present disclosure is not intended to be limited to the embodiments shown and described herein but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.

Claims

1. The rendering method of the all-true scene is characterized by being applied to a client and comprising the following steps of:

2. The method of claim 1, wherein prior to sending the rendering request for the target all-true scene to the cloud, the method further comprises:

the sending the rendering request of the target all-true scene to the cloud comprises the following steps:

3. The method according to claim 1 or 2, wherein after sending the rendering request to the cloud, the method further comprises:

4. The rendering method of the all-true scene is characterized by being applied to a cloud and comprising the following steps of:

receiving a rendering request of a target full-true scene sent by a client;

5. The method of claim 4, wherein the cloud comprises a plurality of machines for rendering, wherein the rendering request comprises a user identification, wherein rendering the target total-true scene from the rendering request and related resources comprises:

6. The method of claim 5, wherein upon querying the operating state of the plurality of machines, the method further comprises:

7. The method of claim 5, wherein the rendering request further includes a session identification of the target all-true scene, the rendering the target all-true scene from the associated resource comprising:

And loading the related resources to render the target all-true scene.

8. The method of claim 5, wherein the method further comprises:

receiving a closing request sent by the client;

9. A rendering apparatus for a full-true scene, applied to a client, comprising:

10. A rendering device of an all-true scene, applied to a cloud, comprising:

11. An electronic device, the electronic device comprising:

a processor; and

a memory in which a program is stored,

wherein the program comprises instructions which, when executed by the processor, cause the processor to perform the method of rendering an all-true scene according to any one of claims 1 to 8.

12. A non-transitory computer-readable storage medium storing computer instructions for causing the computer to perform the method of rendering an all-true scene according to any one of claims 1 to 8.