CN115526977A - Game picture rendering method and device - Google Patents

Abstract

The application provides a game picture rendering method and a game picture rendering device, wherein the method comprises the following steps: acquiring picture data to be rendered in a game; constructing a first light list of each first block by using a light eliminating algorithm based on a plurality of first blocks divided by a screen and light source data; extracting material information of the object from the rendering attribute information of the object; if the object is determined to be a first type object based on the material information of the object, rendering the object by adopting a forward rendering mode based on the first lamplight list of each first block and the depth information, the normal information and the material information of the object; and if the object is determined to be the second type object based on the material information of the object, caching rendering attribute information of the object into a plurality of geometric buffer areas, and rendering the object by adopting a delayed rendering mode based on the first lamplight list of each first block and the cached information in the plurality of geometric buffer areas. According to the scheme, the rendering effect of the game picture can be improved on the premise of giving consideration to the rendering performance.

Description

Game screen rendering method and device

technical field

The present application relates to the technical field of image processing, in particular to a game screen rendering method and device.

Background technique

With the continuous development of game technology, the types of games running on mobile terminals such as mobile phones are also increasing day by day.

For some game applications running on the mobile terminal, the mobile terminal needs to render the game screen of the game application and finally output it to the display screen of the mobile terminal. However, game screen rendering has high requirements on the video memory and other hardware of the mobile terminal, and the performance of the hardware such as the video memory of the mobile terminal is relatively low, which may not be able to meet the high-performance rendering requirements. The screen rendering effect appears.

Contents of the invention

The present application provides a game screen rendering method and device to improve the rendering effect of the game screen on the premise of taking into account the rendering performance.

On the one hand, the present application provides a game screen rendering method applied to a mobile terminal, including:

Obtaining picture data to be rendered in the game, the picture data including: light source data of light sources in the game picture and rendering attribute information of at least one non-transparent object;

Constructing a first light list for each of the first blocks based on a plurality of first blocks divided by the screen and the light source data, using a light culling algorithm;

extracting material information of the object from the rendering attribute information of the object;

If it is determined based on the material information of the object that the object is a first-type object, extract the depth information and normal line information of the object from the rendering attribute information of the object, and based on each of the first blocks The first light list and the depth information, normal information, and material information of the object, and render the object in a forward rendering manner;

If it is determined based on the material information of the object that the object is an object of the second type, cache the rendering attribute information of the object in multiple geometry buffers, and based on the first light list of each of the first blocks and the The information cached in the plurality of geometry buffers is used to render the object in a deferred rendering manner.

In a possible implementation manner, before constructing the first light list of each of the first blocks, the method further includes:

determining the type of graphics processor in the mobile terminal;

According to the light culling algorithm suitable for different types of graphics processors configured, determine the target light culling algorithm suitable for the graphics processor in the mobile terminal;

The plurality of first blocks divided based on the screen and the light source data are constructed using a light culling algorithm to construct a first light list for each of the first blocks, including:

Based on the plurality of first blocks divided by the screen and the light source data, the graphics processor of the mobile terminal utilizes the target light culling algorithm to construct a first light list for each of the first blocks.

In yet another possible implementation manner, the rendering of the object in a deferred rendering manner based on the first light list of each of the first blocks and the information cached in the plurality of geometry buffers includes:

Based on the object materials suitable for each of the multiple sets of deferred rendering codes, combined with the material information of the object, determine the target deferred rendering code applicable to the object, and the target deferred rendering code belongs to the multiple sets of deferred rendering codes;

Based on the first light list of each of the first blocks and the information cached in the plurality of geometry buffers, the target deferred rendering code is called to perform deferred rendering of the object.

In yet another possible implementation manner, the picture data further includes: volumetric fog data used for volumetric fog rendering corresponding to each pixel in the game picture;

After obtaining the picture data to be rendered in the game, it also includes:

Based on the plurality of second blocks divided by the screen and the light source data, a light culling algorithm is used to construct a second light list for each of the second blocks, and the area of the second block is larger than that of the first block. block area;

Based on the volume fog data of each pixel in the game screen, an initial volume texture image is generated, and each pixel in the initial volume texture image is associated with volume fog data;

Based on the initial texture image, the second light list and the light source data, determine a volumetric light effect of the screen.

In yet another possible implementation, it also includes:

Determine the volumetric fog color of the screen based on the volumetric fog data of each pixel in the game screen;

Overlays the volumetric fog color on top of the screen's volumetric light effect.

In yet another possible implementation manner, the picture data further includes: depth information and normal line information of the game picture;

Before determining the volumetric light effect of the screen, it also includes:

Constructing a plurality of depth maps with different resolutions based on the depth information of the game screen;

Combining the multiple depth maps and the normal information of the game screen, determine the spatial reflection effect of the screen;

Based on the depth information of the game screen, the ambient light shading effect of each pixel in the screen is determined.

In yet another possible implementation manner, the picture data further includes: sky data of the sky in the game picture and rendering attribute information of at least one transparent object;

The method also includes:

rendering the sky of the game screen based on the sky data;

The transparent object is rendered based on the rendering attribute information of the transparent object.

In yet another aspect, the present application also provides a game screen rendering device applied to a mobile terminal, including:

A data obtaining unit, configured to obtain picture data to be rendered in the game, the picture data including: light source data of light sources in the game picture and rendering attribute information of at least one non-transparent object;

The first construction unit is configured to construct a first light list for each of the first blocks based on a plurality of first blocks divided by the screen and the light source data by using a light culling algorithm;

a material extraction unit, configured to extract material information of the object from the rendering attribute information of the object;

The first object rendering unit is configured to extract the depth information and normal line information of the object from the rendering attribute information of the object if it is determined based on the material information of the object that the object is a first type object, based on The first light list of each of the first blocks and the depth information, normal information and material information of the object are used to render the object in a forward rendering manner;

The second object rendering unit is configured to cache the rendering attribute information of the object in a plurality of geometry buffers if it is determined that the object is a second type of object based on the material information of the object, and based on each of the first points The first light list of the block and the information cached in the plurality of geometry buffers are used to render the object in a deferred rendering manner.

In a possible implementation, it also includes:

a type determination unit, configured to determine the type of the graphics processor in the mobile terminal before the first construction unit constructs the first light list of each of the first blocks;

The culling algorithm determination unit is configured to determine the target light culling algorithm suitable for the graphics processor in the mobile terminal according to the light culling algorithm suitable for different types of graphics processors configured;

The first building unit includes:

The first construction subunit is configured to use the target light culling algorithm in the graphics processor of the mobile terminal to construct each of the first sub-blocks based on the plurality of first sub-blocks divided by the screen and the light source data. List of first lights for the block.

In yet another possible implementation manner, the second object rendering unit includes:

A code determining unit, configured to determine a target delayed rendering code applicable to the object based on the object material suitable for each of the multiple sets of delayed rendering codes, in combination with the material information of the object, and the target delayed rendering code belongs to the multiple sets of delayed rendering code;

The rendering code calling unit is configured to call the target deferred rendering code to perform deferred rendering of the object based on the first light list of each first block and the information cached in the plurality of geometry buffers.

As can be seen from the above, after the application obtains the image data to be rendered in the game, it will use the light culling algorithm to construct the light list of each block based on the multiple blocks divided by the screen and the light source data in the image data. On this basis, for a non-transparent object in the game screen to be rendered, if it is determined based on the material information of the object that the object is the first type of object suitable for forward rendering, the forward rendering method will be used to render the object in combination with the light list. Object; if the object is determined to be the second type of object suitable for deferred rendering based on the material information of the object, the object will be rendered in the deferred rendering mode combined with the light list, so as to realize the reasonable selection of different rendering methods according to the rendering requirements of different objects, and can Effectively guarantee the rendering effect of objects in the game screen; moreover, compared with only using block-based forward rendering or delayed rendering to render all objects, this application uses block-based forward rendering and delayed rendering in mobile terminals. The two rendering pipelines render different objects, effectively using the respective advantages of the two rendering methods, which can not only take into account the rendering performance, but also help ensure the rendering effect of the game screen.

Description of drawings

In order to more clearly illustrate the technical solutions in the embodiments of the present application, the accompanying drawings that need to be used in the description of the embodiments will be briefly introduced below. Obviously, the accompanying drawings in the following description are only the embodiments of the present application. For Those of ordinary skill in the art can also obtain other drawings based on the provided drawings without making creative efforts.

FIG. 1 shows a schematic flow chart of a game screen rendering method provided by an embodiment of the present application;

Fig. 2 shows another schematic flow chart of the game screen rendering method provided by the embodiment of the present application;

FIG. 3 shows a schematic diagram of the composition and structure of the game screen rendering device provided by the embodiment of the present application.

detailed description

The following will clearly and completely describe the technical solutions in the embodiments of the application with reference to the drawings in the embodiments of the application. Apparently, the described embodiments are only some of the embodiments of the application, not all of them. Based on the embodiments in this application, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the scope of protection of this application.

As shown in Figure 1, it shows a schematic flow chart of the game screen rendering method provided by the embodiment of the present application. The method of this embodiment is applied to a mobile terminal, and the mobile terminal can be a mobile phone or a tablet computer, etc., without limitation .

The method of this embodiment may include:

S101. Obtain image data to be rendered in the game.

It can be understood that the picture data to be rendered refers to the picture data of the game picture to be output. The picture data may include various data required for rendering a game picture.

For example, the picture data of the game picture may be the model data of the game model, and may also include relevant information of the game scene, etc., without limitation.

It can be understood that the game screen contains objects such as characters, animals or items in the game, so the screen data at least includes rendering attribute information of the objects in the game. The rendering attribute information of the object is the basic information required for rendering the object. For example, the rendering attribute information of the object may include some or all of the object's type, name, depth information, normal information, and material information. Add restrictions.

It can be understood that there are many factors to be considered in rendering non-transparent objects other than transparent objects in the game screen. Based on this, this embodiment mainly introduces the non-transparent objects in the game screen. Correspondingly, in this embodiment, the screen data at least includes rendering attribute information of at least one non-transparent object in the game screen. The rendering attribute information of the non-transparent object includes: material information of the object, such as material identification of the object and other relevant information that can characterize the material of the object. Of course, the rendering attribute information may also include other information mentioned above, without limitation.

In addition, the picture data also includes: light source data of the light sources in the game picture, such as information such as the number of light sources, the type and position of each light source, etc., without limitation.

Of course, the screen data also includes other information about the scene corresponding to the game screen, which will not be repeated here.

S102. Based on the plurality of first blocks divided by the screen and the light source data, a light culling algorithm is used to construct a first light list of each first block.

The partitions divided by the screen are a plurality of partitions (tiles) obtained by logically dividing the screen. Each block is also called a tile, which refers to each small block obtained by logically dividing the screen.

In this application, for the convenience of distinction, the block involved in rendering non-transparent objects in this embodiment is called the first block, and correspondingly, the light list constructed for the first block is called the first light list .

Wherein, the first light list of each first block may include light information of light sources that affect the first block, and the light information may be part or all of the light source data of the light sources.

It is understandable that using the light culling algorithm to construct the first light list of each first block can no longer blindly perform coloring and other processing on each light source (that is, light) in the rendering pass, and only need to traverse which effects on the game scene. Influenced lights, and superimpose the effects of these affected lights on each block, which can reduce the number of lights that need to be processed in the shading process and reduce the amount of data processing.

In this application, there are many possibilities for the light culling algorithm. For example, the light culling algorithm can be a Fine Prued Tiled Light (FPTL) algorithm, or a cluster-based light culling algorithm. Etc. No restrictions on this.

It can be understood that, compared with a Graphics Processing Unit (GPU), light culling and light list construction are completed in a central processing unit (CPU), and the degree of parallelization is relatively low, and the efficiency is relatively low. Based on this, in the present application, the running light culling algorithm may be executed in a graphics processing unit (Graphics Processing Unit, GPU) of the mobile terminal and a first light list of each first block may be constructed.

The inventors of this application found that in the process of building the light list, multiple threads and thread groups needed to build the buffer for the shader need to be considered as a parallel processor and GPU to process complex data Compatibility issues between computing capabilities.

The inventor further found through a lot of research that different GPUs are suitable for different lighting culling algorithms. By choosing a reasonable lighting culling algorithm, it is beneficial to reduce the incompatibility between mobile terminals for complex data calculations and parallel processors. question. On this basis, the present application determines suitable light culling algorithms for different types of GPUs through a large number of implementations.

For example, the GPU of manufacturer A is more suitable for the FPTL algorithm, while the GPU of manufacturer B may be more suitable for light culling based on the Cluster algorithm.

On this basis, the present application can first determine the type of graphics processor in the mobile terminal. Then, a target light culling algorithm suitable for the graphics processor in the mobile terminal is determined according to the suitable light culling algorithm for different types of configured graphics processors. Correspondingly, based on the plurality of first blocks divided by the screen and the light source data, the target light culling algorithm may be used in the GPU of the mobile terminal to construct a first light list of each first block.

S103. For each non-transparent object to be rendered, extract material information of the object from rendering attribute information of the object.

The material information of the object may include relevant information representing the material of the object, for example, the material information of the object may be a material identifier of the object, such as a unique identifier such as a name or number of the material of the object. Of course, the material information of the object may also include information such as material characteristics of the object, without limitation.

S104, if it is determined based on the material information of the object that the object is the first type of object, extract the depth information and normal line information of the object from the rendering attribute information of the object, based on the first light list of each first block and the depth of the object information, normal information, and material information, and use forward rendering to render the object.

In this application, it is considered that when the material of the object is different, the effect to be achieved and some special requirements for object rendering will also be different. Therefore, the suitable rendering methods for different objects are naturally different. Based on this, in order to take into account both hardware performance and rendering effect in this application, this application needs to reasonably determine the rendering method of the rendering object in combination with the material of the object. Different from existing rendering pipelines that only deploy a single rendering mode, in this application, rendering pipelines corresponding to two rendering modes, deferred rendering and forward rendering, can be used for parallel rendering.

On this basis, the present application can predetermine suitable rendering methods for objects of different materials. On this basis, for a non-transparent object to be rendered, the type of the object can be determined based on the material information of the object. Wherein, the first type object is an object suitable for forward rendering, and the second type object is an object suitable for delayed rendering.

If the material information of the object indicates that the object is a first-type object, forward rendering of the object may be performed based on the depth information, normal information, and material information of the object in combination with the first light list of each first block. It can be understood that the rendering of the first type of objects is essentially based on tile forward rendering, which is a rendering technique that combines forward rendering and tile-based light culling to reduce the number of lights in the coloring process. Through light culling, the lighting required for iterative calculation of each object can be reduced. Therefore, this rendering method can not only guarantee the rendering effect, but also improve performance.

It can be understood that after extracting the depth information and normal line information of the first type of object, the present application caches the depth information, normal line information and material information of the object in the buffer area associated with the game screen to be rendered, so that When the object needs to be rendered, forward rendering is performed based on this information.

S105, if it is determined based on the material information of the object that the object is a second type object, cache the rendering attribute information of the object in multiple geometry buffers, based on the first light list of each first block and cache in multiple geometry buffers information, the object is rendered in deferred rendering.

Wherein, different geometry buffers (Geometry Buffer, G-Buffer) store different types of rendering attribute information of the object.

For example, in a possible implementation, for the second type of object, the application can construct four geometry buffers, namely the first geometry buffer, the second geometry buffer, the third geometry buffer and the fourth geometry buffer buffer. The first geometry buffer cache contains: the base color and specular occlusion information of the object; the second geometry buffer caches the normal information and roughness information corresponding to the object. The metal information, rendering layer information, shadow mask information and material identification code information of the object are cached in the third geometry buffer; the baked diffuse lighting information or self-illumination color information of the object is cached in the fourth geometry buffer.

Wherein, the information cached in the four geometry buffer areas all belong to the rendering attribute information of the object.

It can be understood that, if the material information of the object indicates that the object is a second type object, the present application may be based on deferred rendering of the light list of each first tile. Since deferred rendering can effectively reduce lighting calculations, it can greatly improve the rendering performance of objects. Delayed rendering combined with tile light lists can further reduce lighting calculations, and only calculate for one block at a time, which can reduce invalid input and output. .

Based on this, for some objects that do not have high rendering requirements or do not require materials with special rendering requirements, this application uses deferred rendering instead of forward rendering for rendering, which is beneficial to improve rendering performance.

It can be understood that, for the second type of objects, the materials of different objects are also different, and the objects of different materials are suitable for the deferred rendering process. Based on this, in order to perform deferred rendering of objects more efficiently and reasonably, the present application may also pre-configure multiple sets of deferred rendering codes, and pre-configure at least one object material suitable for each of the multiple sets of deferred rendering codes.

On this basis, for each object belonging to the second type of object, the application can firstly determine the target deferred rendering code applicable to the object based on the object material suitable for each set of deferred rendering codes, combined with the material information of the object. The target deferred rendering code belongs to the multiple sets of deferred rendering codes. Correspondingly, based on the first light list of each first block and the information cached in multiple geometry buffers, the target deferred rendering code can be called to perform deferred rendering of the object.

As can be seen from the above, after the application obtains the image data to be rendered in the game, it will use the light culling algorithm to construct the light list of each block based on the multiple blocks divided by the screen and the light source data in the image data. On this basis, for a non-transparent object in the game screen to be rendered, if it is determined based on the material information of the object that the object is the first type of object suitable for forward rendering, the forward rendering method will be used to render the object in combination with the light list. Object; if the object is determined to be the second type of object suitable for deferred rendering based on the material information of the object, the object will be rendered in the deferred rendering mode combined with the light list, so as to realize the reasonable selection of different rendering methods according to the rendering requirements of different objects, and can Effectively guarantee the rendering effect of objects in the game screen; moreover, compared with only using block-based forward rendering or delayed rendering to render all objects, this application uses block-based forward rendering and delayed rendering in mobile terminals. The two rendering pipelines render different objects in parallel, effectively utilizing the respective advantages of the two rendering methods, so as to take into account rendering performance and improve the rendering effect of the game screen.

It is understandable that in addition to non-transparent objects, some transparent objects may also be involved in the game screen. Based on this, the rendering attribute information of the transparent object is also included in the picture data. Correspondingly, in this application, after rendering the non-transparent object, it may further include: rendering the transparent object based on the rendering attribute of the transparent object.

It is understandable that in addition to objects such as items and characters, the game screen also involves the rendering of some game scene environments such as the sky and the background.

Based on this, this application may also involve that the screen data may also include volumetric fog data required for volumetric fog rendering. Correspondingly, the rendering of game screens in this application may also include rendering such as volumetric fog effects on the screen. Further, the rendering of the game screen may also include the rendering of the spatial reflection effect of the screen and the ambient light occlusion effect.

The rendering of the game screen of the present application will be introduced below in conjunction with an implementation manner.

As shown in Figure 2, it shows another schematic flow chart of the game screen rendering method provided by the embodiment of the present application. The method of this embodiment may include:

S201. Obtain image data to be rendered in the game.

Wherein, the picture data includes light source data of light sources in the game picture, rendering attribute information of transparent objects and opaque objects in the game picture.

The picture data also includes: volumetric fog data for volumetric fog rendering corresponding to each pixel in the game picture, depth information, normal information of the game picture, and sky data of the sky in the game picture.

Among them, the volumetric fog data is related data required to render the volumetric fog to the game screen. The sky data refers to the relevant data required to complete the sky in the scene corresponding to the game screen, such as the size and number of white clouds in the sky, the color mode of the sky, etc., without limitation.

S202. Extract material information of the object from the rendering attribute information of the object.

S203, if the material information of the object indicates that the object belongs to the non-transparent first type object, extract the depth information and normal line information of the object from the rendering attribute information of the object, and cache the depth information, normal line information and material information of the object.

S204. If the material information of the object indicates that the object belongs to a non-transparent second type object, cache the rendering attribute information of the object in multiple geometry buffer areas.

It should be noted that, in this embodiment, after the material information of the object is extracted, it is described as an example to determine whether the object is a transparent object based on the material information of the object. However, it is also applicable to this embodiment if it is determined whether the object is a transparent object through other methods.

For the above steps S203 and S204, reference may be made to the relevant introduction of the previous embodiments, and details are not repeated here.

S205. Construct multiple depth maps with different resolutions based on the depth information of the game screen.

Wherein, the depth map constructed here may have many possibilities, which is not limited.

For example, in a possible implementation manner, at least one Hierarchical Z-buffer (HIZ) depth map is generated based on the depth information of the game screen.

In this embodiment, the purpose of constructing the depth map is to subsequently determine the spatial reflection effect and ambient light occlusion effect of the screen. If these two effects are not enabled in the game, step S205 may not be performed.

S206. Based on the plurality of first blocks divided by the screen and the light source data, a light culling algorithm is used to construct a first light list of each first block.

For this step S206, reference may be made to the relevant introduction of the previous embodiments, and details are not repeated here.

S207. Based on the plurality of second blocks divided by the screen and the light source data, use a light culling algorithm to construct a second light list for each of the second blocks.

Wherein, the area of the second block is larger than the area of the first block, or the size of the second block is larger than the size of the first block.

For example, the second segment may consist of four or more first segments. For example, the size of the first block may be 32*32 pixels, and the size of the second grid may be 64*64 pixels.

It can be understood that, in this step S207, except that the size of the second block is different from that of the first block, the process of constructing the second light list of each second block is the same as that of constructing the first light list of each first block. The process of a light list is similar, please refer to the previous related introduction for details, and will not repeat them here.

Optionally, the present application can also determine a plurality of three-dimensional units divided by the viewing frustum corresponding to the screen, each three-dimensional unit is a cluster (Cluster), on this basis, based on the light source data in the picture data, construct each three-dimensional The voxel light source list of the unit, which is used for subsequent determination of volumetric fog effects, etc.

S208. Generate an initial volumetric texture image based on the volumetric fog data of each pixel in the game screen.

Wherein, each pixel in the initial volume texture image is associated with volume fog data.

Each pixel in the initial volume texture image has a one-to-one relationship with each pixel in the game screen (or screen). Therefore, the application generates an initial volume texture image that can associate the volumetric fog data of each pixel in the game screen. into that initial volume texture image.

Wherein, the initial volume texture image is generated for subsequent volume fog effect rendering.

It can be understood that, in practical applications, it can be detected whether the volumetric light effect or the volumetric fog effect is enabled in the game. If the volumetric fog effect or the volumetric light effect is not enabled in the game, there is no need to perform step S208 and the subsequent determination of the volumetric light effect, etc. related operations.

The above steps S202 to S208 are for some basic preparations for subsequent rendering of objects, volumetric fog rendering, or screen space reflection. In practical applications, the order of the above steps can be unlimited.

S209. Combining the multiple depth maps and the normal information in the game screen, determine the spatial reflection effect of the screen.

Wherein, the spatial reflection effect of the screen may include the spatial reflection effect corresponding to each pixel point in the screen (that is, each pixel point corresponding to the game screen).

For example, multiple depth maps and the normal information of the game screen can be combined to perform ray stepping processing, and determine the color of the sample of light reflection on the screen, etc.

There may be many different algorithms for determining the spatial reflection effect of the screen, and there is no limitation on this.

For example, the space reflection effect of the screen may be determined based on a screen space reflection (Screen Space Reflection, SSR) algorithm, or the space reflection effect of the screen may be determined based on a screen space planar reflection (Screen Space Planar Reflections, SSPR) algorithm.

It can be understood that, if it is detected that the screen reflection effect is not enabled in the game, this step S209 may not be performed, but only when it is determined that the screen reflection effect is enabled in the game, this step S209 and the previous related operations of determining the depth map are performed .

S210. Based on the depth information of the game screen, determine the ambient light shading effect of each pixel in the screen.

Wherein, the ambient light occlusion effect represents the occlusion effect of the surrounding environment on the ambient light in the game screen.

In the present application, there may be many specific implementation manners for determining the ambient light shading effect of each pixel in the screen, which is not limited.

In order to make the game screen loaded with ambient light occlusion effects more realistic, the application can calculate the ambient light occlusion effects of each pixel in the screen based on the ground truth-based ambient light occlusion (Ground Truth-based Ambient Occlusion, GTAO) algorithm. Based on the Horizon Based Ambient Occlusion (HBAO) algorithm, GTAO adds Cosine Weight (Cosine-Weighted is an algorithm for sampling a spherical surface, which is often used in the field of sampling the incident direction during path tracing. ) for a more realistic ambient occlusion effect.

S211. Based on the initial texture image, the second light list and light source data, determine a volumetric light effect of the screen.

Volumetric light is a very commonly used lighting effect in games. It is mainly used to express the beam of light leaking from the light-transmitting part of the object when the light hits the occluded object. Because it gives people a strong sense of volume visually, it is called volume light.

In an optional manner, if it is confirmed that the volumetric light or volumetric fog effect is enabled in the game, then step S211 is performed; if the volumetric light or volumetric fog effect is not enabled in the game, this step S211 does not need to be performed.

S212. Based on the volumetric fog data of each pixel in the game screen, determine the volumetric fog color of the screen, and superimpose the volumetric fog color on the volumetric light effect of the screen.

It can be understood that the volumetric light effect does not reflect the fog color, and the volumetric fog color effect with the foggy color can be obtained by superimposing the volumetric fog color on the volumetric light effect.

Overlaying the volumetric fog color on the volumetric light effect is actually rendering the volumetric fog effect. The function of volumetric fog is to make the clouds and fog in the game present a more natural effect instead of a texture, making the texture of light and fog more realistic.

S213. For an object that is non-transparent and belongs to the first type of object, render the object in a forward rendering manner based on the first light list of each first block and the cached depth information, normal information, and material information of the object.

S214. For an object that is non-transparent and belongs to the second type of object, render the object in a deferred rendering manner based on the first light list of each first block and the information cached in multiple geometry buffers.

For the steps S213 and S214, reference may be made to the relevant introduction of the foregoing embodiments, and there is no limitation thereto.

It can be understood that the sequence of steps S213 and S214 is not limited. At the same time, the sequence of steps S213 and S214 and the preceding steps S209 to S212 is not limited to that shown in FIG. 2 . In practical applications, steps S13 and S214 may be executed first and then steps S209 to S214 are executed.

S215. Render the sky of the game screen based on the sky data.

It can be understood that in practical applications, the rendering of scenes other than objects in the game screen may also involve determining the color hierarchy map in the game screen, and the color hierarchy map is used for refraction and reflection to ensure Brightness is not lost, of course, other rendering processes may be involved, there is no limit to this.

S216. For the transparent object determined based on the material information of the object, render the transparent object based on the object data of the transparent object.

The specific rendering of the transparent object can be set as required, for example, conventional forward rendering can be used, and there is no limitation on this.

It can be understood that post-processing rendering may also be performed after step S216, and the above rendering results are finally loaded to present the game screen.

It can be understood that in the embodiment of the present application, the spatial reflection effect of the screen and the volumetric fog effect can be enabled or disabled in the game according to the needs, so as to flexibly configure the corresponding rendering pipeline, and display or not render the corresponding images according to actual needs. rendering effect.

Corresponding to the game screen rendering method of the present application, the present application also provides a game screen rendering device. As shown in FIG. 3 , it shows a schematic structural diagram of a game screen rendering device provided by an embodiment of the present application, and the device is applied to a mobile terminal. The device of this embodiment may include:

A data obtaining unit 301, configured to obtain picture data to be rendered in the game, the picture data including: light source data of light sources in the game picture and rendering attribute information of at least one non-transparent object;

The first construction unit 302 is configured to construct a first light list for each of the first blocks based on a plurality of first blocks divided by the screen and the light source data by using a light culling algorithm;

a material extraction unit 303, configured to extract material information of the object from the rendering attribute information of the object;

The first object rendering unit 304 is configured to extract the depth information and normal line information of the object from the rendering attribute information of the object if it is determined that the object is a first type object based on the material information of the object, Rendering the object in a forward rendering manner based on the first light list of each of the first blocks and the depth information, normal information, and material information of the object;

The second object rendering unit 305 is configured to cache the rendering attribute information of the object in multiple geometry buffers if it is determined based on the material information of the object that the object is a second type of object, based on each of the first The block first light list and the information cached in the plurality of geometry buffers are used to render the object in a deferred rendering manner.

In a possible implementation manner, the device also includes:

a type determination unit, configured to determine the type of the graphics processor in the mobile terminal before the first construction unit constructs the first light list of each of the first blocks;

The culling algorithm determination unit is configured to determine the target light culling algorithm suitable for the graphics processor in the mobile terminal according to the light culling algorithm suitable for different types of graphics processors configured;

The first building unit includes:

The first construction subunit is configured to use the target light culling algorithm in the graphics processor of the mobile terminal to construct each of the first sub-blocks based on the plurality of first sub-blocks divided by the screen and the light source data. List of first lights for the block.

In yet another possible implementation manner, the second object rendering unit includes:

A code determining unit, configured to determine a target delayed rendering code applicable to the object based on the object material suitable for each of the multiple sets of delayed rendering codes, in combination with the material information of the object, and the target delayed rendering code belongs to the multiple sets of delayed rendering code;

The rendering code calling unit is configured to call the target deferred rendering code to perform deferred rendering of the object based on the first light list of each first block and the information cached in the plurality of geometry buffers.

In yet another possible implementation manner, the picture data obtained by the data obtaining unit further includes: volumetric fog data used for volumetric fog rendering corresponding to each pixel in the game picture;

The unit also includes:

The second construction unit is configured to, after the data obtaining unit obtains the picture data to be rendered in the game, based on the plurality of second sub-blocks divided by the screen and the light source data, use a light culling algorithm to construct each of the second sub-blocks a second light list of blocks, the area of the second block is larger than the area of the first block;

A texture generating unit, configured to generate an initial volumetric texture image based on the volumetric fog data of each pixel in the game screen, where each pixel in the initial volumetric texture image is associated with volumetric fog data;

A volumetric light determining unit, configured to determine a volumetric light effect of the screen based on the initial texture image, the second light list, and the light source data.

Further, the device may also include:

A fog color determination unit, configured to determine the volumetric fog color of the screen based on the volumetric fog data of each pixel in the game screen;

A volumetric fog determining unit, configured to superimpose the volumetric fog color on the volumetric light effect of the screen.

In yet another possible implementation manner, the picture data obtained by the data obtaining unit further includes: depth information and normal line information of the game picture;

The unit also includes:

The depth map construction unit is used to construct multiple depth maps with different resolutions based on the depth information of the game screen before the volume light determination unit determines the volume light effect of the screen;

An emission determining unit, configured to combine the multiple depth maps and the normal information of the game screen to determine the spatial reflection effect of the screen;

The shading determination unit is configured to determine the ambient light shading effect of each pixel in the screen based on the depth information of the game screen.

Further, the picture data obtained by the data obtaining unit also includes: sky data of the sky in the game picture and rendering attribute information of at least one transparent object;

The unit also includes:

a sky rendering unit, configured to render the sky of the game screen based on the sky data;

A third object rendering unit, configured to render the transparent object based on the rendering attribute information of the transparent object.

It should be noted that each embodiment in this specification is described in a progressive manner, and each embodiment focuses on the difference from other embodiments. For the same and similar parts in each embodiment, refer to each other, that is, Can. At the same time, the features recorded in the various embodiments in this specification can be replaced or combined with each other, so that those skilled in the art can realize or use the present application. As for the device-type embodiments, since they are basically similar to the method embodiments, the description is relatively simple, and for related parts, please refer to part of the description of the method embodiments.

Finally, it should also be noted that in this text, relational terms such as first and second etc. are only used to distinguish one entity or operation from another, and do not necessarily require or imply that these entities or operations, any such actual relationship or order exists. Furthermore, the term "comprises", "comprises" or any other variation thereof is intended to cover a non-exclusive inclusion such that a process, method, article, or apparatus comprising a set of elements includes not only those elements, but also includes elements not expressly listed. other elements of or also include elements inherent in such a process, method, article, or device. Without further limitations, an element defined by the phrase "comprising a ..." does not preclude the presence of additional identical elements in the process, method, article, or apparatus that includes the element.

The above description of the disclosed embodiments is provided to enable any person skilled in the art to make or use the present application. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the general principles defined herein may be implemented in other embodiments without departing from the spirit or scope of the application. Therefore, the present application will not be limited to the embodiments shown herein, but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.

The above are only the preferred embodiments of the present application. It should be pointed out that for those of ordinary skill in the art, without departing from the principle of the application, some improvements and modifications can also be made, and these improvements and modifications should also be considered as For the scope of protection of this application.

Claims (10)

1. A game picture rendering method is applied to a mobile terminal and comprises the following steps:

obtaining picture data to be rendered in a game, wherein the picture data comprises: light source data of a light source and rendering attribute information of at least one non-transparent object in a game picture;

constructing a first light list of each first block by using a light eliminating algorithm based on a plurality of first blocks divided by a screen and the light source data;

extracting material information of the object from rendering attribute information of the object;

if the object is determined to be a first type object based on the material information of the object, extracting depth information and normal information of the object from rendering attribute information of the object, and rendering the object by adopting a forward rendering mode based on a first lamplight list of each first block and the depth information, the normal information and the material information of the object;

and if the object is determined to be a second type object based on the material information of the object, caching rendering attribute information of the object into a plurality of geometric buffer areas, and rendering the object by adopting a delayed rendering mode based on the first lamplight list of each first block and the cached information in the geometric buffer areas.

2. The method of claim 1, further comprising, prior to said constructing a first list of lights for each of said first segments:

determining the type of a graphics processor in the mobile terminal;

determining a target light eliminating algorithm suitable for the graphic processor in the mobile terminal according to the light eliminating algorithms suitable for the configured different types of graphic processors;

the method for constructing a first light list of each first block by using a light eliminating algorithm based on a plurality of first blocks divided by a screen and the light source data comprises the following steps:

and constructing a first light list of each first block by utilizing the target light eliminating algorithm in a graphic processor of the mobile terminal based on a plurality of first blocks divided by a screen and the light source data.

3. The method of claim 1, wherein rendering the object in a delayed rendering manner based on the first light list of each of the first partitions and the information cached in the plurality of geometric buffers comprises:

determining target delayed rendering codes applicable to the object based on object materials suitable for multiple sets of delayed rendering codes respectively and by combining material information of the object, wherein the target delayed rendering codes belong to the multiple sets of delayed rendering codes;

and calling the target delayed rendering code to execute delayed rendering of the object based on the first lamplight list of each first partition and the cached information in the plurality of geometric buffers.

4. The method of claim 1, wherein the picture data further comprises: volume fog data corresponding to each pixel point in the game picture and used for volume fog rendering;

after the obtaining of the picture data to be rendered in the game, the method further includes:

constructing a second light list of each second block by using a light eliminating algorithm based on a plurality of second blocks divided by a screen and the light source data, wherein the area of each second block is larger than that of each first block;

generating an initial volume texture image based on volume fog data of each pixel point in a game picture, wherein each pixel point in the initial volume texture image is associated with volume fog data;

determining a volumetric light effect of a screen based on the initial texture image, the second light list, and the light source data.

5. The method of claim 4, further comprising:

determining the volume fog color of the screen based on the volume fog data of each pixel point in the game picture;

superimposing the volume fog color on the volume light effect of the screen.

6. The method of claim 4, wherein the picture data further comprises: depth information and normal information of the game picture;

before the determining the volume light effect of the screen, the method further comprises:

constructing a plurality of depth maps with different resolutions based on the depth information of the game picture;

determining the spatial reflection effect of the screen by combining the multiple depth maps and the normal information of the game picture;

and determining the ambient light shielding effect of each pixel point in the screen based on the depth information of the game picture.

7. The method according to claim 1 or 4, wherein the picture data further comprises: sky data of the sky in the game picture and rendering attribute information of at least one transparent object;

the method further comprises the following steps:

rendering a sky of the game frame based on the sky data;

rendering the transparent object based on rendering attribute information of the transparent object.

8. A game picture rendering device applied to a mobile terminal includes:

a data obtaining unit, configured to obtain picture data to be rendered in a game, where the picture data includes: light source data of a light source and rendering attribute information of at least one non-transparent object in a game picture;

the first building unit is used for building a first light list of each first block by using a light eliminating algorithm based on a plurality of first blocks divided by a screen and the light source data;

a material extraction unit for extracting material information of the object from rendering attribute information of the object;

a first object rendering unit, configured to extract depth information and normal information of the object from rendering attribute information of the object if the object is determined to be a first type object based on material information of the object, and render the object in a forward rendering manner based on a first light list of each first partition and the depth information, normal information, and material information of the object;

and the second object rendering unit is used for caching rendering attribute information of the object into a plurality of geometric buffer areas if the object is determined to be a second type object based on the material information of the object, and rendering the object by adopting a delayed rendering mode based on the first lamplight list of each first block and the cached information in the geometric buffer areas.

9. The apparatus of claim 8, further comprising:

the type determining unit is used for determining the type of a graphic processor in the mobile terminal before the first building unit builds the first light list of each first block;

the removing algorithm determining unit is used for determining a target light removing algorithm suitable for the graphic processor in the mobile terminal according to the light removing algorithms suitable for the configured graphic processors of different types;

the first building element comprising:

and the first construction subunit is used for constructing a first light list of each first block by utilizing the target light eliminating algorithm in a graphic processor of the mobile terminal based on the plurality of first blocks divided by the screen and the light source data.

10. The apparatus of claim 8, wherein the second object rendering unit comprises:

the code determination unit is used for determining target delayed rendering codes applicable to the objects based on the object material suitable for each of a plurality of sets of delayed rendering codes and by combining the material information of the objects, wherein the target delayed rendering codes belong to the plurality of sets of delayed rendering codes;

and the rendering code calling unit is used for calling the target delayed rendering code to execute delayed rendering of the object based on the first lamplight list of each first partition and the information cached in the plurality of geometric buffer areas.

Images