WO2022127278A1 - Method and apparatus for rendering virtual scene - Google Patents

Abstract

A method and apparatus for rendering a virtual scene. The method comprises: when rendering a virtual scene, acquiring a rendering frame graph corresponding to the virtual scene, wherein rendering process information and rendering resource information corresponding to the virtual scene are recorded in the rendering frame graph, the rendering process information being used for indicating render passes divided for rendering the virtual scene and sub render passes into which each render pass is divided, and the rendering resource information being used for indicating a resource state of a rendering resource corresponding to an on-chip tile buffer, which is allowed to be used in each sub render pass, of a graphics processing unit (S202); according to the rendering frame graph, creating a target rendering process corresponding to the virtual scene, wherein a target rendering resource used in the target rendering process satisfies the resource state indicated by the rendering resource information (S204); and rendering the virtual scene according to the target rendering process (S206). By means of the method, the technical problem of the rendering efficiency of a virtual scene being relatively low is solved.

Description

Rendering method and device for virtual scene

cross reference

This application claims the priority of the Chinese patent application filed on December 18, 2020 with the application number "202011501111.2" and the invention titled "A method and device for rendering a virtual scene", the entire contents of which are incorporated herein by reference middle.

technical field

The present invention relates to the field of computers, and in particular, to a method and device for rendering a virtual scene.

Background technique

The current process of rendering a virtual scene is usually to first abstract the renderer interface of the engine, and then implement the renderer according to different types of rendering interfaces. This implementation is to convert special to general, and use a set of general code to realize the general rendering process, because this implementation needs to be compatible with the lower version of the rendering interface, and supporting the lower version of the rendering interface will cause the system to run. Therefore, it is impossible to exert the maximum performance of the system hardware according to the characteristics of the hardware, resulting in low rendering efficiency of the virtual scene.

For the above problems, no effective solution has been proposed yet.

SUMMARY OF THE INVENTION

The present invention proposes the following technical solutions to overcome or at least partially solve or alleviate the above-mentioned problems:

According to an aspect of the present invention, there is provided a method for rendering a virtual scene, comprising:

When rendering a virtual scene, a rendering frame diagram corresponding to the virtual scene is obtained, wherein the rendering frame diagram records the rendering process information and rendering resource information corresponding to the virtual scene, and the rendering process information is used to indicate rendering The rendering stage divided by the virtual scene and the rendering substage divided by each rendering stage, the rendering resource information is used to indicate that each rendering substage is allowed to use the rendering corresponding to the on-chip fragment cache of the graphics processor the resource status of the resource;

Create a target rendering process corresponding to the virtual scene according to the rendering frame diagram, wherein the target rendering resource used in the target rendering process satisfies the resource state indicated by the rendering resource information;

The virtual scene is rendered according to the target rendering process.

According to another aspect of the present invention, a device for rendering a virtual scene is provided, comprising:

An acquisition module, configured to acquire a rendering frame diagram corresponding to the virtual scene when rendering the virtual scene, wherein the rendering frame diagram records the rendering process information and rendering resource information corresponding to the virtual scene, and the rendering process The information is used to indicate the rendering stage divided for rendering the virtual scene and the rendering substage divided by each of the rendering stages, and the rendering resource information is used to indicate that each rendering substage is allowed to use the on-chip slice of the graphics processor The resource status of the rendering resource corresponding to the cache;

a first creation module, configured to create a target rendering process corresponding to the virtual scene according to the rendering frame diagram, wherein the target rendering resource used in the target rendering process satisfies the resource state indicated by the rendering resource information;

A rendering module, configured to render the virtual scene according to the target rendering process.

According to another aspect of the present invention, an electronic device is provided, comprising a memory, a processor, and a computer program/instruction stored on the memory, the processor implementing the above-mentioned method for rendering a virtual scene when the computer program/instruction is executed A step of.

According to yet another aspect of the present invention, there is provided a computer device/equipment/system, comprising a memory, a processor, and a computer program/instruction stored on the memory, the processor implements the above virtual when executing the computer program/instruction The steps of the rendering method of the scene.

According to yet another aspect of the present invention, a computer-readable medium is provided, on which computer programs/instructions are stored, and when the computer programs/instructions are executed by a processor, implement the steps of the above-mentioned method for rendering a virtual scene.

According to yet another aspect of the present invention, a computer program product is provided, comprising computer programs/instructions, when the computer programs/instructions are executed by a processor, the steps of the above method for rendering a virtual scene are implemented.

In the embodiment of the present application, when rendering a virtual scene, a rendering frame diagram corresponding to the virtual scene is obtained, wherein the rendering frame diagram records the rendering process information and rendering resource information corresponding to the virtual scene, and the rendering process information is used to indicate rendering. The rendering stage divided by the virtual scene and the rendering substage divided by each rendering stage, and the rendering resource information is used to indicate the resource status of the rendering resource corresponding to the on-chip fragment cache of the graphics processor that allows each rendering substage; according to The rendering frame diagram creates the target rendering process corresponding to the virtual scene, wherein the target rendering resources used in the target rendering process satisfy the resource state indicated by the rendering resource information; according to the way of rendering the virtual scene in the target rendering process, the rendering frame diagram records the Use the resource state required by the graphics processing unit (GPU) on-chip shard cache and the divided rendering stages and sub-stages. When rendering a virtual scene, create a rendering process according to the rendering frame diagram for scene rendering, which can ensure that the rendering process is optimized for the hardware. The technical effect of improving the rendering efficiency of the virtual scene is achieved, thereby solving the technical problem of low rendering efficiency of the virtual scene.

Description of drawings

The above and various other advantages and benefits of the present invention will become apparent to those of ordinary skill in the art upon reading the following detailed description of the preferred embodiments. In the attached image:

1 is a schematic diagram of a hardware environment of a method for rendering a virtual scene according to an embodiment of the present application;

2 is a flowchart of an optional virtual scene rendering method according to an embodiment of the present application;

3 is a schematic diagram of a rendering process of a virtual scene according to an optional embodiment of the present application;

4 is a schematic diagram of constructing a rendering frame diagram according to an embodiment of the present application;

5 is a schematic diagram of a process of constructing a rendering frame diagram based on Vulkan according to an optional embodiment of the present application;

6 is a schematic diagram of an optional virtual scene rendering apparatus according to an embodiment of the present application;

7 is a structural block diagram of an electronic device according to an embodiment of the present application;

8 is a schematic diagram of a computer apparatus/equipment/system according to an embodiment of the present application;

Figure 9 is a block diagram of a computer program product according to an embodiment of the present application.

Detailed ways

The present invention will be further described below with reference to the accompanying drawings and specific embodiments. The following description is merely illustrative of the basic principles of the present invention and is not intended to limit it.

According to an aspect of the embodiments of the present application, an embodiment of a method for rendering a virtual scene is provided.

Optionally, in this embodiment, the foregoing virtual scene rendering method may be applied to a hardware environment composed of a terminal 101 and a server 103 as shown in FIG. 1 . As shown in FIG. 1 , the server 103 is connected to the terminal 101 through the network, and can be used to provide services (such as game services, application services, etc.) for the terminal or the client installed on the terminal, and a database can be set on the server or independently of the server, For providing data storage services for the server 103, the above-mentioned network includes but is not limited to: a wide area network, a metropolitan area network or a local area network, and the terminal 101 is not limited to a PC, a mobile phone, a tablet computer, and the like. The method for rendering a virtual scene in this embodiment of the present application may be executed by the server 103 , may also be executed by the terminal 101 , or may be executed jointly by the server 103 and the terminal 101 . Wherein, the terminal 101 may execute the rendering method of the virtual scene of the embodiment of the present application by a client installed on the terminal 101 .

FIG. 2 is a flowchart of an optional virtual scene rendering method according to an embodiment of the present application. As shown in FIG. 2 , the method may include the following steps:

Step S202, when rendering the virtual scene, obtain a rendering frame diagram corresponding to the virtual scene, wherein the rendering frame diagram records the rendering process information and rendering resource information corresponding to the virtual scene, and the rendering process information is used In order to instruct the rendering stage divided into rendering the virtual scene and the rendering substage divided by each of the rendering stages, the rendering resource information is used to indicate that each rendering substage is allowed to use the on-chip fragment cache of the graphics processor. The resource status of the corresponding rendering resource;

Step S204, creating a target rendering process corresponding to the virtual scene according to the rendering frame diagram, wherein the target rendering resource used in the target rendering process satisfies the resource state indicated by the rendering resource information;

Step S206, rendering the virtual scene according to the target rendering process.

Through the above steps S202 to S206, the rendering frame diagram records the resource states required to use the graphics processing unit (GPU) on-chip fragment cache and the divided rendering stages and sub-stages. When rendering the virtual scene, the rendering frame diagram creates Rendering the scene in the rendering process can ensure that the rendering process exerts the optimal performance of the hardware, achieves the technical effect of improving the rendering efficiency of the virtual scene, and solves the technical problem of low rendering efficiency of the virtual scene.

In the technical solution provided in step S202, the above-mentioned virtual scene may include, but is not limited to, a game scene, a virtual reality (VR) scene, an animation scene, a simulator scene, and the like. For example, a game scene is rendered in the Android system of a mobile phone, an animation scene is rendered in the Android system of a PC computer, and so on.

Optionally, in this embodiment, the rendering process information and rendering resource information corresponding to the virtual scene are recorded in the above-mentioned rendering frame graph, and the rendering process information is used to indicate the rendering stage (render pass) divided by the rendering of the virtual scene. ) and the rendering sub-stage (sub render pass) divided by each rendering stage, the rendering resource information is used to indicate that each rendering sub-stage is allowed to use the on-chip tile buffer (Tile Buffer) of the graphics processor (Graphics Processing Unit, GPU). The resource status of the corresponding rendering resource. The resource status of the rendering resources required to use the GPU's on-chip shard cache is marked in the rendering resource information, so that the created rendering process can call the GPU's on-chip shard cache, giving full play to the rendering performance of the GPU and improving rendering efficiency.

Optionally, in this embodiment, the rendering process information recorded in the rendering frame diagram indicates the rendering stage divided into rendering the virtual scene and the rendering substage divided by each rendering stage, and each rendering substage (sub render pass) ) may be a rendering pass in the traditional division method. For example, a traditional rendering process may include two render passes: Geometry render pass and Lighting render pass. In the above rendering frame graph (frame graph), The two render passes are recorded as two sub render passes: Geometry sub render pass and Lighting sub render pass. These two sub render passes form a render pass in the frame graph.

Optionally, in this embodiment, the rendering stage and the rendering sub-stage divided into the rendering virtual scene indicated by the rendering process information and each rendering stage may be, but are not limited to, according to allowing each rendering sub-stage to use graphics processing. According to the resource status of the rendering resources corresponding to the on-chip fragment cache of the graphics processor, the rendering stage that meets the resource status requirements of the rendering resources corresponding to the on-chip fragment cache of the graphics processor in the original rendering process can be used as the rendering sub-stage. The stages are merged into a new render stage. For example, since the above Geometry render pass and Lighting render pass can meet the resource status requirements of rendering resources corresponding to the on-chip shard cache using the graphics processor, the above Geometry render pass and Lighting render pass can be used as Geometry sub render pass and Lighting sub render passes are combined into one render pass.

Optionally, in this embodiment, the resource state of the rendering resource corresponding to the on-chip fragment cache that is allowed to use the graphics processor may include, but is not limited to, the size of the rendering target, the format of the rendering target, the loading state (load action), the storage State (store action) and temporary use state, etc. The loading state (load action) can include but is not limited to: load (loading), clear (clear the last content) and don't care (don't care about the previous content) and so on. The store action can include, but is not limited to, store (store content), clear (clear the last content), don't care (don't care about the previous content), and so on. The temporary usage state may include, but is not limited to, tile buffers.

In the technical solution provided in step S204, the target rendering resource used in the target rendering process corresponding to the virtual scene created according to the rendering frame diagram satisfies the resource state indicated by the rendering resource information, so that the target rendering process can give full play to the hardware The performance advantages it has, improve rendering speed and rendering efficiency.

In the technical solution provided in step S206, rendering the virtual scene according to the target rendering process is to use the created rendering resources to render the virtual scene according to the divided rendering stages and rendering sub-stages. During the rendering process, the slice cache of the GPU can be used, Thereby improving rendering efficiency.

As an optional embodiment, creating a target rendering process corresponding to the virtual scene according to the rendering frame diagram includes:

S11, creating the target rendering resource that satisfies the resource state for each rendering sub-stage according to the rendering resource information;

S12. Create the target rendering process between the target rendering resources according to the rendering process information.

Optionally, in this embodiment, the target rendering resources of each rendering sub-stage are first created, and then the target rendering resources of each rendering sub-stage are connected to obtain the target rendering process.

Optionally, in this embodiment, the target rendering resource created for each rendering sub-stage needs to satisfy the resource state indicated by the rendering resource information to ensure that it uses the GPU's fragment cache during the rendering process.

In an optional embodiment, a process of rendering a virtual scene using the GPU's Tile Buffer for the Vulkan renderer system of a mobile phone is provided. FIG. 3 is a schematic diagram of a rendering process of a virtual scene according to an optional embodiment of the present application. As shown in FIG. 3 , first, the rendering frame graphs (Frame Graphs) of different rendering systems are configured according to project requirements. For mobile games under the Vulkan renderer system of the mobile phone, the rendering frame diagram using the on-chip shard cache of the GPU of the mobile phone is configured under the Vulkan renderer system of the mobile phone. Then create graphics processor (GPU) resources according to the configured rendering frame diagram and configure the resource status so that the created resources can meet the requirements of using the on-chip shard cache of the mobile phone GPU, and then create a frame rendering process according to the configured rendering frame diagram. The created rendering process renders the virtual scene, thereby realizing the presentation of the game screen.

As an optional embodiment, creating the target rendering resource that satisfies the resource state for each rendering sub-stage according to the rendering resource information includes:

S21, constructing a first rendering target that satisfies the rendering target size and rendering target format indicated by the rendering resource information;

S22, configuring the loading state and storage state of the first rendering target to be the target loading state and the target storage state indicated by the rendering resource information, to obtain a second rendering target;

S23: Mark the graphics processor storage state of the second rendering target as the fragment cache state indicated by the rendering resource information, and obtain the target rendering resource.

Optionally, in this embodiment, the constructed rendering resource may include, but is not limited to, a rendering target (Render Target) that meets the requirements, and the requirements that the rendering target needs to meet may include, but are not limited to, the size of the rendering target, the format of the rendering target, and the graphics processing. That is, if you need to use the GPU's shard cache, you first need to divide the rendering process into rendering sub-stages, and secondly, you need to configure the size, format and GPU storage state of the Render Target to meet the requirements of calling the GPU's shard cache. The loading state and storage state of the render target can be configured according to the actual needs of the rendering process.

Optionally, in this embodiment, the rendering resources created through the above process can optimize the hardware environment of the rendering process, that is, the hardware will use the on-chip (On-Chip) cache (Tile Buffer) as much as possible, that is, minimize the hardware environment. Tile Buffer to memory (video memory), memory (video memory) to Tile Buffer read and write operations. Because there is a delay in the operation between the hardware Tile Buffer and the memory (video memory). Using the on-chip cache as much as possible can reduce this latency and improve rendering efficiency.

As an optional embodiment, acquiring the rendering frame diagram corresponding to the virtual scene includes:

S31, obtaining scene information of the virtual scene;

S32, acquiring target scene conditions satisfied by the scene information from multiple scene conditions, wherein the multiple scene conditions are in one-to-one correspondence with multiple rendering framework diagrams;

S33: Determine the rendering frame diagram corresponding to the target scene condition as the rendering frame diagram corresponding to the virtual scene.

Optionally, in this embodiment, different rendering frame graphs may be configured for different types of scenes, and the rendering frame graph corresponding to the scene condition satisfied by the current virtual scene is used as the rendering frame graph for rendering the current scene.

For example: FIG. 4 is a schematic diagram of constructing a rendering frame graph according to an embodiment of the present application. As shown in FIG. 4 , multiple rendering frame graphs Frame Graph are pre-created, and one rendering frame graph Frame Graph 1 includes three rendering frame graphs. Targets (Render Target 11, Render Target 12 and Render Target 13), from Render Target 11 to Render Target 12 are divided into a render sub pass Sub render pass 11, from Render Target 12 to Render Target 13 is divided into another render sub pass Stage Sub render pass 12. Another rendering frame graph Frame Graph 2 includes five render targets (Render Target 21, Render Target 22, Render Target 23, Render Target 24 and Render Target 25), from Render Target 21 to Render Target 22, Render Target 23 and Render respectively Target 24 is divided into a rendering sub-stage Sub render pass 21, respectively from Render Target 22, Render Target 23 and Render Target 24 to Render Target 25 are divided into another rendering sub-stage Sub render pass 22. Each rendering frame diagram corresponds to a scene condition, and virtual scenes that meet the scene conditions can be rendered using the corresponding rendering frame diagram. For example: the scene condition corresponding to Frame Graph 1 is that no lighting effect needs to be rendered, and the scene condition corresponding to Frame Graph 2 is that lighting effects need to be rendered, then if the virtual scene to be rendered needs to render lighting effects, you can use Frame Graph 2 for rendering, if The virtual scene to be rendered does not need to render lighting effects and can be rendered using Frame Graph 1.

As an optional embodiment, before acquiring the rendering frame diagram corresponding to the virtual scene, the method further includes:

S41, dividing the rendering process of the virtual scene into a rendering stage and a rendering sub-stage, and obtaining the rendering process information;

S42, configure the rendering target and rendering target information included in each rendering sub-stage, and obtain the rendering resource information, where the rendering target information includes the rendering target size, the rendering target format, the loading state, the storage state and the temporary use state , the temporary use state is used to indicate that each rendering sub-stage is allowed to use the on-chip fragment cache of the graphics processor;

S43, using the rendering process information and the rendering resource information to create the rendering frame diagram.

Optionally, in this embodiment, before rendering the virtual scene, a rendering frame diagram capable of exerting the optimal performance of the hardware may be created, but not limited to, according to project requirements.

Optionally, in this embodiment, the division process of the rendering stage and the rendering sub-stage may be, but is not limited to, configuring the rendering stage in the original rendering process as a rendering sub-stage according to the requirements of achieving an optimal hardware environment, and then configuring the rendering stage. The rendering sub-stages of the Render stage make up the rendering stage.

Optionally, in this embodiment, the rendering target is the Render Target, and the rendering target information includes: the rendering target size, the rendering target format and the temporary use state that can achieve the rendering target required by the optimal hardware environment, wherein the temporary use State is used to indicate the on-chip shard cache that allows each rendering substage to use the GPU's on-chip shard cache, as well as the load state and store state of the render target configured according to the project's needs.

As an optional embodiment, configuring the rendering target and rendering target information included in each rendering sub-stage includes:

S51, constructing rendering targets included in each rendering sub-stage;

S52, configuring the rendering target size and rendering target format of the rendering target to allow the use of the rendering target size and rendering target format of the on-chip fragment cache of the graphics processor;

S53, configuring the loading state and storage state of the rendering target to meet the loading state and storage state required by the virtual scene;

S54, marking the on-chip storage state of the graphics processor of the rendering target as a slice cache.

Optionally, in this embodiment, the render target size and the render target format are configured to allow the use of the render target size and render target format of the on-chip fragment cache of the graphics processor. That is, using the GPU's on-chip fragment cache requires the render target to meet certain size and format requirements.

Optionally, in this embodiment, the loading state and storage state of the rendering target may be determined by, but not limited to, the requirements of the virtual scene.

Optionally, in this embodiment, the way of marking the on-chip storage state of the graphics processor of the rendering target as the slice cache may include, but is not limited to, when allocating video memory for VulkanMobileRenderTarget, specifying the way of allocating video memory plus the bit of VK_MEMORY_PROPERTY_LAZILY_ALLOCATED_BIT. , so that the Android on-chip cache can be used to reduce the bandwidth.

As an optional embodiment, dividing the rendering process of the virtual scene into a rendering stage and a rendering sub-stage includes:

S61, configuring the geometric rendering stage in the rendering process of the virtual scene as a geometric rendering sub-stage, and configuring the lighting rendering stage as a lighting rendering sub-stage;

S62. Combine the geometry rendering sub-stage and the lighting rendering sub-stage into a rendering stage.

Optionally, in this embodiment, first, a rendering stage that can be configured as a rendering substage in the original rendering process is configured as a rendering substage, and then the configured rendering substages are combined into a rendering stage.

For example: configure the Geometry Pass as a Geometry SubPass, configure the Lighting Pass as a Lighting SubPass, and then configure the Geometry SubPass Combined with the Lighting SubPass into a render pass.

As an optional embodiment, configuring the rendering target and rendering target information included in each rendering sub-stage includes:

S71, configuring the rendering targets of the geometry rendering sub-stage to include a position rendering target, a normal rendering target, a reflectivity rendering target and a depth rendering target, and the rendering targets of the lighting rendering sub-stage include a lighting rendering target;

S72, mark the rendering target size of the position rendering target, the normal rendering target, the reflectivity rendering target, the depth rendering target and the lighting rendering target as a preset size, and mark the rendering target format as a preset size format;

S73, marking the loading status of the position rendering target, the normal rendering target, the reflectivity rendering target and the depth rendering target as clearing the last content, marking the storage status as not caring about the subsequent content, and loading the lighting rendering target The status is marked as not caring about the content after, and the storage status is marked as storage content;

S74: Mark the on-chip storage states of the position rendering target, the normal rendering target, the reflectivity rendering target, the depth rendering target, and the lighting rendering target as a slice cache.

Optionally, in this embodiment, the rendering targets of the geometry rendering sub-stage include a position rendering target (position), a normal rendering target (normal), an albedo rendering target (albedo), a depth rendering target (depth), and a lighting rendering target. The render targets of the sub-stage include Lighting.

Optionally, in this embodiment, the above-mentioned preset size and preset format are the size of the rendering target and the format of the rendering target required by using the GPU on-chip fragment cache.

Optionally, in this embodiment, the loading state and the storage state can be configured according to the requirements of the virtual scene, for example, the position rendering target (position), the normal rendering target (normal), the reflectance rendering target (albedo) and the The load state (load action) of the depth rendering target (depth) is marked as clearing the previous content (clear), the storage state (store action) is marked as do not care about the next content (don't care), and the lighting rendering target (Lighting) The load state (load action) is marked as don't care, and the store state (store action) is marked as store content (store).

Optionally, in this embodiment, the on-chip storage state of the graphics processor of the rendering target is marked as a slice cache, so that the rendering process can fully use the slice cache of the GPU. For example: the position, normal, albedo, depth, and lighting on-chip storage state of the graphics processor (GPU storage) state) is marked as a tile buffer.

The present application also provides an optional embodiment, which provides a process for building a rendering frame graph using Vulkan. FIG. 5 is a schematic diagram of a process of constructing a rendering frame graph based on Vulkan according to an optional embodiment of the present application. As shown in FIG. 5 , in this optional embodiment, the constructed rendering frame graph is capable of rendering deferred lighting ( deferred lighting) effect rendering frame diagram, first, Geometry RenderPass in the original rendering frame diagram constructed by the original rendering process renders the scene to the Render Target of position, normal, albedo, and depth respectively, and then passes the Lighting RenderPass to calculate the lighting to the Render Target of lighting superior. It is configured with two Render Passes (Geometry, Lighting) and uses five GPU Render Targets.

In this optional embodiment, Geometry and Lighting are combined into one Render Pass, which respectively becomes Sub Render Pass (ie Geometry Sub Pass and Lighting Sub Pass), and the states of the above five render targets are set so that the rendering process can Efficient use of GPU Tile Buffers. Configure the loading state (load action) of position, normal, albedo, and depth to clear (clear the last content), configure the storage state (store action) to don't care (don't care about the content afterward), and set the loading state of Lighting ( load action) is configured as don't care (don't care about the previous content), and the storage state (store action) is configured as store (stored content). And mark the GPU storage states of position, normal, albedo, depth and Lighting as tile buffers, so that the hardware performance of the GPU can be fully utilized to obtain the target rendering frame diagram.

It should be noted that, for the sake of simple description, the foregoing method embodiments are all expressed as a series of action combinations, but those skilled in the art should know that the present application is not limited by the described action sequence. Because in accordance with the present application, certain steps may be performed in other orders or concurrently. Secondly, those skilled in the art should also know that the embodiments described in the specification are all preferred embodiments, and the actions and modules involved are not necessarily required by the present application.

From the description of the above embodiments, those skilled in the art can clearly understand that the method according to the above embodiment can be implemented by means of software plus a necessary general hardware platform, and of course can also be implemented by hardware, but in many cases the former is better implementation. Based on this understanding, the technical solution of the present application can be embodied in the form of a software product in essence or in a part that contributes to the prior art, and the computer software product is stored in a storage medium (such as ROM/RAM, magnetic disk, CD-ROM), including several instructions to make a terminal device (which may be a mobile phone, a computer, a server, or a network device, etc.) execute the methods described in the various embodiments of this application.

According to another aspect of the embodiments of the present application, there is also provided a virtual scene rendering apparatus for implementing the above virtual scene rendering method. FIG. 6 is a schematic diagram of an optional virtual scene rendering apparatus according to an embodiment of the present application. As shown in FIG. 6 , the apparatus may include:

The obtaining module 62 is configured to obtain a rendering frame diagram corresponding to the virtual scene when rendering the virtual scene, wherein the rendering frame diagram records the rendering process information and rendering resource information corresponding to the virtual scene, and the rendering The process information is used to indicate the rendering stages divided into rendering the virtual scene and the rendering substages divided by each of the rendering stages, and the rendering resource information is used to indicate that each rendering substage is allowed to use the on-chip sub-stage of the graphics processor. The resource status of the rendering resource corresponding to the slice cache;

The first creation module 64 is configured to create a target rendering process corresponding to the virtual scene according to the rendering frame diagram, wherein the target rendering resource used in the target rendering process satisfies the resource state indicated by the rendering resource information ;

The rendering module 66 is configured to render the virtual scene according to the target rendering process.

It should be noted that the acquiring module 62 in this embodiment may be used to execute step S202 in this embodiment of the present application, and the first creating module 64 in this embodiment may be used to execute step S204 in this embodiment of the present application, the The rendering module 66 in the embodiment may be configured to perform step S206 in the embodiment of the present application.

It should be noted here that the examples and application scenarios implemented by the foregoing modules and corresponding steps are the same, but are not limited to the contents disclosed in the foregoing embodiments. It should be noted that, as a part of the device, the above modules may run in the hardware environment as shown in FIG. 1 , and may be implemented by software or hardware.

Through the above modules, the rendering frame diagram records the resource status required to use the graphics processing unit (GPU) on-chip fragment cache and the divided rendering stages and sub-stages. When rendering the virtual scene, a rendering process is created according to the rendering frame diagram to perform the scene. The rendering can ensure the optimal performance of the hardware in the rendering process, achieve the technical effect of improving the rendering efficiency of the virtual scene, and then solve the technical problem of low rendering efficiency of the virtual scene.

As an optional embodiment, the first creation module includes:

a first creation unit, configured to create the target rendering resource that satisfies the resource state for each rendering sub-stage according to the rendering resource information;

A second creating unit, configured to create the target rendering process between the target rendering resources according to the rendering process information.

As an optional embodiment, the first creation unit is used for:

constructing a first rendering target that satisfies the rendering target size and rendering target format indicated by the rendering resource information;

Configuring the loading state and storage state of the first rendering target as the target loading state and the target storage state indicated by the rendering resource information, to obtain a second rendering target;

Marking the graphics processor storage state of the second rendering target as the fragment cache state indicated by the rendering resource information to obtain the target rendering resource.

As an optional embodiment, the obtaining module includes:

a first obtaining unit, configured to obtain scene information of the virtual scene;

a second obtaining unit, configured to obtain target scene conditions satisfied by the scene information from a plurality of scene conditions, wherein the plurality of scene conditions correspond to a plurality of rendering framework diagrams one-to-one;

A determining unit, configured to determine the rendering frame diagram corresponding to the target scene condition as the rendering frame diagram corresponding to the virtual scene.

As an optional embodiment, the device further includes:

A dividing module is used to divide the rendering process of the virtual scene into a rendering stage and a rendering sub-stage before obtaining the rendering frame diagram corresponding to the virtual scene, and obtain the rendering process information;

A configuration module, configured to configure the rendering target and rendering target information included in each rendering sub-stage, and obtain the rendering resource information, wherein the rendering target information includes the rendering target size, rendering target format, loading state, storage state and a temporary use state, the temporary use state is used to indicate that each rendering sub-stage is allowed to use the on-chip fragment cache of the graphics processor;

A second creation module, configured to create the rendering frame diagram by using the rendering process information and the rendering resource information.

As an optional embodiment, the configuration module includes:

A building unit for building the rendering targets included in each rendering sub-stage;

a first configuration unit, configured to configure the rendering target size and rendering target format of the rendering target to allow the use of the rendering target size and rendering target format of the on-chip fragment cache of the graphics processor;

a second configuration unit, configured to configure the loading state and storage state of the rendering target to meet the loading state and storage state required by the virtual scene;

A first marking unit, configured to mark the on-chip storage state of the graphics processor of the rendering target as a slice cache.

As an optional embodiment, the dividing module is used for:

configuring the geometry rendering stage in the rendering process of the virtual scene as a geometry rendering sub-stage, and configuring the lighting rendering stage as a lighting rendering sub-stage;

The geometry rendering sub-stage and the lighting rendering sub-stage are combined into a rendering stage.

As an optional embodiment, the configuration module includes:

a third configuration unit, configured to configure the rendering targets of the geometry rendering sub-stage to include a position rendering target, a normal rendering target, a reflectance rendering target and a depth rendering target, and the rendering targets of the lighting rendering sub-stage include a lighting rendering target;

The fourth configuration unit is used to mark the rendering target size of the position rendering target, the normal rendering target, the reflectivity rendering target, the depth rendering target and the lighting rendering target as a preset size, and render The target format is marked as a preset format;

The second marking unit is used to mark the loading status of the position rendering target, the normal rendering target, the reflectivity rendering target and the depth rendering target as clearing the previous content, and marking the storage status as not caring about the later content, and marking the The loading state of the lighting rendering target is marked as don't care about the content after, and the storage state is marked as storage content;

a third marking unit, configured to mark the position rendering target, the normal rendering target, the reflectivity rendering target, the depth rendering target and the on-chip storage state of the lighting rendering target on-chip of the graphics processor as divided slice cache.

It should be noted here that the examples and application scenarios implemented by the foregoing modules and corresponding steps are the same, but are not limited to the contents disclosed in the foregoing embodiments. It should be noted that, as a part of the device, the above modules may run in the hardware environment as shown in FIG. 1 , and may be implemented by software or hardware, wherein the hardware environment includes a network environment.

According to another aspect of the embodiments of the present application, an electronic device for implementing the above virtual scene rendering method is also provided.

FIG. 7 is a structural block diagram of an electronic device according to an embodiment of the present application. As shown in FIG. 7 , the electronic device may include: one or more (only one is shown in the figure) a processor 701 , a memory 703 , and a transmission The device 705, as shown in FIG. 7, the electronic device may further include an input and output device 707.

The memory 703 may be used to store software programs and modules, such as program instructions/modules corresponding to the virtual scene rendering method and device in the embodiments of the present application, and the processor 701 runs the software programs and modules stored in the memory 703 to thereby Execute various functional applications and data processing, that is, realize the above-mentioned rendering method of the virtual scene. Memory 703 may include high-speed random access memory, and may also include non-volatile memory, such as one or more magnetic storage devices, flash memory, or other non-volatile solid-state memory. In some examples, the memory 703 may further include memory located remotely from the processor 701, and these remote memories may be connected to the electronic device through a network. Examples of such networks include, but are not limited to, the Internet, an intranet, a local area network, a mobile communication network, and combinations thereof.

The above-mentioned transmission device 705 is used for receiving or sending data via a network, and may also be used for data transmission between the processor and the memory. Specific examples of the above-mentioned networks may include wired networks and wireless networks. In one example, the transmission device 705 includes a network adapter (Network Interface Controller, NIC), which can be connected to other network devices and routers through a network cable so as to communicate with the Internet or a local area network. In one example, the transmission device 705 is a radio frequency (Radio Frequency, RF) module, which is used for wirelessly communicating with the Internet.

Specifically, the memory 703 is used to store application programs.

The processor 701 can call the application program stored in the memory 703 through the transmission device 705 to perform the following steps:

When rendering a virtual scene, a rendering frame diagram corresponding to the virtual scene is obtained, wherein the rendering frame diagram records the rendering process information and rendering resource information corresponding to the virtual scene, and the rendering process information is used to indicate rendering The rendering stage divided by the virtual scene and the rendering substage divided by each rendering stage, the rendering resource information is used to indicate that each rendering substage is allowed to use the rendering corresponding to the on-chip fragment cache of the graphics processor the resource status of the resource;

Create a target rendering process corresponding to the virtual scene according to the rendering frame diagram, wherein the target rendering resource used in the target rendering process satisfies the resource state indicated by the rendering resource information;

The virtual scene is rendered according to the target rendering process.

With the embodiments of the present application, a solution for rendering a virtual scene is provided. The rendering frame diagram records the resource status required to use the graphics processing unit (GPU) on-chip fragment cache as well as the divided rendering stages and sub-stages. When rendering a virtual scene, creating a rendering process based on the rendering frame diagram for scene rendering can ensure rendering. The process utilizes the optimal performance of the hardware to achieve the technical effect of improving the rendering efficiency of the virtual scene, thereby solving the technical problem of low rendering efficiency of the virtual scene.

Optionally, for specific examples in this embodiment, reference may be made to the examples described in the foregoing embodiments, and details are not described herein again in this embodiment.

Those of ordinary skill in the art can understand that the structure shown in FIG. 7 is only a schematic diagram, and the electronic device can be a smart phone (such as an Android phone, an iOS phone, etc.), a tablet computer, a handheld computer, and a mobile Internet Device (Mobile Internet Devices, MID) , PAD and other equipment. FIG. 7 does not limit the structure of the above electronic device. For example, the electronic device may also include more or fewer components than those shown in FIG. 7 (eg, network interface, display device, etc.), or have a different configuration than that shown in FIG. 7 .

Those of ordinary skill in the art can understand that all or part of the steps in the various methods of the above embodiments can be completed by instructing hardware related to the electronic device through a program, and the program can be stored in a computer-readable storage medium, and the storage medium can Including: flash disk, read-only memory (Read-Only Memory, ROM), random access device (Random Access Memory, RAM), magnetic disk or optical disk, etc.

Embodiments of the present application also provide a storage medium. Optionally, in this embodiment, the above-mentioned storage medium may be used to execute the program code of the rendering method of the virtual scene.

Optionally, in this embodiment, the foregoing storage medium may be located on at least one network device among multiple network devices in the network shown in the foregoing embodiment.

Optionally, in this embodiment, the storage medium is configured to store program codes for executing the following steps:

When rendering a virtual scene, a rendering frame diagram corresponding to the virtual scene is obtained, wherein the rendering frame diagram records the rendering process information and rendering resource information corresponding to the virtual scene, and the rendering process information is used to indicate rendering The rendering stage divided by the virtual scene and the rendering substage divided by each rendering stage, the rendering resource information is used to indicate that each rendering substage is allowed to use the rendering corresponding to the on-chip fragment cache of the graphics processor the resource status of the resource;

Create a target rendering process corresponding to the virtual scene according to the rendering frame diagram, wherein the target rendering resource used in the target rendering process satisfies the resource state indicated by the rendering resource information;

The virtual scene is rendered according to the target rendering process.

Optionally, for specific examples in this embodiment, reference may be made to the examples described in the foregoing embodiments, and details are not described herein again in this embodiment.

Optionally, in this embodiment, the above-mentioned storage medium may include but is not limited to: U disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), mobile hard disk, magnetic Various media that can store program codes, such as discs or optical discs.

The above-mentioned serial numbers of the embodiments of the present application are only for description, and do not represent the advantages or disadvantages of the embodiments.

If the integrated units in the above-mentioned embodiments are implemented in the form of software functional units and sold or used as independent products, they may be stored in the above-mentioned computer-readable storage medium. Based on this understanding, the technical solution of the present application can be embodied in the form of a software product in essence, or the part that contributes to the prior art, or all or part of the technical solution, and the computer software product is stored in a storage medium, Several instructions are included to cause one or more computer devices (which may be personal computers, servers, or network devices, etc.) to execute all or part of the steps of the methods described in the various embodiments of the present application.

In the above-mentioned embodiments of the present application, the description of each embodiment has its own emphasis. For parts that are not described in detail in a certain embodiment, reference may be made to related descriptions of other embodiments.

In the several embodiments provided in this application, it should be understood that the disclosed client may be implemented in other manners. The apparatus embodiments described above are only illustrative, for example, the division of the units is only a logical function division, and there may be other division methods in actual implementation, for example, multiple units or components may be combined or Integration into another system, or some features can be ignored, or not implemented. On the other hand, the shown or discussed mutual coupling or direct coupling or communication connection may be through some interfaces, indirect coupling or communication connection of units or modules, and may be in electrical or other forms.

The units described as separate components may or may not be physically separated, and components displayed as units may or may not be physical units, that is, may be located in one place, or may be distributed to multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution in this embodiment.

In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically alone, or two or more units may be integrated into one unit. The above-mentioned integrated units may be implemented in the form of hardware, or may be implemented in the form of software functional units.

The above are only the preferred embodiments of the present application. It should be pointed out that for those skilled in the art, without departing from the principles of the present application, several improvements and modifications can also be made. It should be regarded as the protection scope of this application.

Various component embodiments of the present invention may be implemented in hardware, or in software modules running on one or more processors, or in a combination thereof. Those skilled in the art should understand that a microprocessor or a digital signal processor (DSP) may be used in practice to implement some or all functions of some or all components of the virtual scene rendering apparatus according to the embodiment of the present invention. The present invention can also be implemented as a program/instruction (eg, computer program/instruction and computer program product) for an apparatus or apparatus for performing some or all of the methods described herein. Such programs/instructions implementing the present invention may be stored on a computer readable medium, or may exist in the form of one or more signals, such signals may be downloaded from an Internet website, or provided on a carrier signal, or in any form Available in other formats.

Computer-readable media includes both persistent and non-permanent, removable and non-removable media, and storage of information may be implemented by any method or technology. Information may be computer readable instructions, data structures, modules of programs, or other data. Examples of computer storage media include, but are not limited to, phase-change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read only memory (ROM), Electrically Erasable Programmable Read Only Memory (EEPROM), Flash Memory or other memory technology, Compact Disc Read Only Memory (CD-ROM), Digital Versatile Disc (DVD) or other optical storage, Magnetic tape cartridges, disk storage, quantum memory, graphene-based storage media or other magnetic storage devices or any other non-transmission media can be used to store information that can be accessed by computing devices.

FIG. 8 schematically shows a computer apparatus/equipment/system that can implement a method for rendering a virtual scene according to the present invention, the computer apparatus/equipment/system including a processor 810 and a computer-readable medium in the form of a memory 820 . Memory 820 is an example of a computer readable medium having storage space 830 for storing computer programs/instructions 831 . When the computer program/instruction 831 is executed by the processor 810, each step in the method for rendering a virtual scene described above can be implemented.

Figure 9 schematically shows a block diagram of a computer program product implementing the method according to the invention. The computer program product includes a computer program/instructions 910 that, when executed by a processor, such as the processor 810 shown in FIG. 8, can implement a virtual scene described above. The various steps in the rendering method.

Specific embodiments of this specification have been described above, and other embodiments are intended to be included within the scope of the appended claims. In some cases, the actions or steps recited in the claims can be performed in an order different from that in the embodiments and still achieve desirable results. Additionally, the processes depicted in the figures do not necessarily follow the specific order shown, or sequential order, to achieve desirable results. In certain embodiments, multitasking and parallel processing are also possible or advantageous.

It should also be noted that the terms "comprising", "comprising" or any other variation thereof are intended to encompass a non-exclusive inclusion such that a process, method, article or device comprising a series of elements includes not only those elements, but also Other elements not expressly listed, or which are inherent to such a process, method, article of manufacture, or apparatus are also included. Without further limitation, an element qualified by the phrase "comprising a..." does not preclude the presence of additional identical elements in the process, method, article of manufacture, or device that includes the element.

It should be understood that the above-mentioned embodiments are only for the purpose of illustrating the present invention and not for limiting the present invention. Those skilled in the art can also implement the present invention in other ways without departing from the basic spirit and characteristics of the present invention. The scope of the present invention should be determined by the appended claims, and any modifications, equivalent replacements, improvements, etc., made within the spirit and principles of one or more embodiments of this specification should be covered therein.

Claims (13)

1. A method for rendering a virtual scene, comprising:

   When rendering a virtual scene, a rendering frame diagram corresponding to the virtual scene is obtained, wherein the rendering frame diagram records the rendering process information and rendering resource information corresponding to the virtual scene, and the rendering process information is used to indicate rendering The rendering stage divided by the virtual scene and the rendering substage divided by each rendering stage, the rendering resource information is used to indicate that each rendering substage is allowed to use the rendering corresponding to the on-chip fragment cache of the graphics processor the resource status of the resource;

   Create a target rendering process corresponding to the virtual scene according to the rendering frame diagram, wherein the target rendering resource used in the target rendering process satisfies the resource state indicated by the rendering resource information;

   The virtual scene is rendered according to the target rendering process.
2. The method according to claim 1, wherein creating a target rendering process corresponding to the virtual scene according to the rendering frame diagram comprises:

   Create the target rendering resource that satisfies the resource state for each rendering sub-stage according to the rendering resource information;

   The target rendering process between the target rendering resources is created according to the rendering process information.
3. The method according to claim 2, wherein creating the target rendering resource that satisfies the resource state for each rendering sub-stage according to the rendering resource information comprises:

   constructing a first rendering target that satisfies the rendering target size and rendering target format indicated by the rendering resource information;

   Configuring the loading state and storage state of the first rendering target as the target loading state and the target storage state indicated by the rendering resource information, to obtain a second rendering target;

   Marking the graphics processor storage state of the second rendering target as the fragment cache state indicated by the rendering resource information to obtain the target rendering resource.
4. The method according to claim 1, wherein obtaining the rendering frame diagram corresponding to the virtual scene comprises:

   obtaining scene information of the virtual scene;

   Obtain the target scene conditions satisfied by the scene information from multiple scene conditions, wherein the multiple scene conditions are in one-to-one correspondence with multiple rendering framework diagrams;

   The rendering frame diagram corresponding to the target scene condition is determined as the rendering frame diagram corresponding to the virtual scene.
5. The method according to claim 1, wherein before acquiring the rendering frame diagram corresponding to the virtual scene, the method further comprises:

   Dividing the rendering process of the virtual scene into a rendering stage and a rendering sub-stage to obtain the rendering process information;

   Configure the rendering target and rendering target information included in each rendering sub-stage, and obtain the rendering resource information, wherein the rendering target information includes the rendering target size, rendering target format, loading state, storage state and temporary use state. The temporary use state is used to indicate that each rendering sub-stage is allowed to use the on-chip fragment cache of the graphics processor;

   The rendering frame diagram is created using the rendering process information and the rendering resource information.
6. The method according to claim 5, wherein configuring the rendering target and rendering target information included in each rendering sub-stage comprises:

   Build the render targets included in each rendering substage;

   configuring a render target size and a render target format of the render target to allow the use of a render target size and a render target format of the graphics processor's on-chip fragment cache;

   configuring the loading state and storage state of the rendering target to meet the loading state and storage state required by the virtual scene;

   The on-chip storage state of the graphics processor of the rendering target is marked as a slice cache.
7. The method according to claim 5, wherein dividing the rendering process of the virtual scene into a rendering stage and a rendering sub-stage comprises:

   configuring the geometry rendering stage in the rendering process of the virtual scene as a geometry rendering sub-stage, and configuring the lighting rendering stage as a lighting rendering sub-stage;

   The geometry rendering sub-stage and the lighting rendering sub-stage are combined into a rendering stage.
8. The method according to claim 7, wherein configuring the rendering target and rendering target information included in each rendering sub-stage comprises:

   The rendering targets configured in the geometry rendering sub-stage include position rendering targets, normal rendering targets, reflectivity rendering targets and depth rendering targets, and the rendering targets in the lighting rendering sub-stage include lighting rendering targets;

   Mark the rendering target size of the position rendering target, the normal rendering target, the reflectivity rendering target, the depth rendering target and the lighting rendering target as the preset size, and mark the rendering target format as the preset format ;

   Mark the loading status of the position rendering target, the normal rendering target, the reflectance rendering target and the depth rendering target as clearing the last content, mark the storage status as do not care about the next content, and mark the loading status of the lighting rendering target In order not to care about the later content, the storage status is marked as storage content;

   Mark the on-chip storage states of the position rendering target, the normal rendering target, the albedo rendering target, the depth rendering target and the graphics processor of the lighting rendering target as a slice cache.
9. A device for rendering a virtual scene, comprising:

   an acquisition module, configured to acquire a rendering frame diagram corresponding to the virtual scene when rendering the virtual scene, wherein the rendering frame diagram records the rendering process information and rendering resource information corresponding to the virtual scene, and the rendering process The information is used to indicate the rendering stage divided for rendering the virtual scene and the rendering substage divided by each of the rendering stages, and the rendering resource information is used to indicate that each rendering substage is allowed to use the on-chip slice of the graphics processor The resource status of the rendering resource corresponding to the cache;

   a first creation module, configured to create a target rendering process corresponding to the virtual scene according to the rendering frame diagram, wherein the target rendering resource used in the target rendering process satisfies the resource state indicated by the rendering resource information;

   A rendering module, configured to render the virtual scene according to the target rendering process.
10. An electronic device comprising a memory, a processor and a computer program stored on the memory and running on the processor, characterized in that the processor executes the above claims 1 to 8 through the computer program The method described in any one.
11. A computer device/device/system, comprising a memory, a processor, and a computer program/instruction stored on the memory, the processor implementing the computer program/instruction according to any one of claims 1-8 when the processor executes the computer program/instruction steps of the method.
12. A computer-readable medium having stored thereon computer programs/instructions which, when executed by a processor, implement the steps of the method according to any one of claims 1-8.
13. A computer program product comprising computer programs/instructions which, when executed by a processor, implement the steps of the method according to any one of claims 1-8.

Images