WO2024109006A1

WO2024109006A1 - Light source elimination method and rendering engine

Info

Publication number: WO2024109006A1
Application number: PCT/CN2023/101625
Authority: WO
Inventors: 李洪珊
Original assignee: 华为云计算技术有限公司
Priority date: 2022-11-23
Filing date: 2023-06-21
Publication date: 2024-05-30
Also published as: CN118115644A

Abstract

Provided in the embodiments of the present application are a light source elimination method and a rendering engine, which are used for reducing the amount of computing for light source elimination. The method can be applied to a rendering application, which comprises a plurality of three-dimensional models and a plurality of light sources, wherein each of the plurality of three-dimensional models comprises a plurality of cache points. The method specifically comprises: respectively computing a plurality of illumination intensity values of a plurality of light sources at a target cache point, wherein a plurality of cache points comprise the target cache point, and a visual space corresponding to a first viewpoint comprises the target cache point; according to the plurality of illumination intensity values and an illumination intensity threshold, determining to specify a target light source from the plurality of light sources, and performing coloring computing on the target cache point on the basis of the at least one target light source, so as to obtain a rendering result corresponding to the first viewpoint.

Description

A light source culling method and rendering engine

CROSS-REFERENCE TO RELATED APPLICATIONS

This application claims priority to the Chinese patent application filed with the State Intellectual Property Office of China on November 23, 2022, with application number 202211480728.X and application name “A light source culling method and rendering engine”, the entire contents of which are incorporated by reference in this application.

Technical Field

The present application relates to the field of computer technology, and in particular to a light source culling method and a rendering engine.

Background technique

Rendering technology refers to the output of realistic images that simulate the same model and lighting conditions in the real world based on 3D model data (including object geometry, surface material, etc.) and light data (including light source position, color, intensity, etc.). Deferred rendering is a way to achieve rendering. In deferred rendering, a calculation is first performed to remove the faces of the 3D space that cannot be seen on the user's screen, and the face elements and vertex information that can be seen by the user are saved in a global buffer. Then, shading calculations are performed based on the information saved in the buffer. In this way, shading calculations are only performed on the information visible to the user, thereby reducing the amount of shading calculations in the rendering process.

Light source culling is a means to achieve delayed rendering. The current light source culling includes screen space-based light source culling and camera space-based light source culling. Screen space-based light source culling refers to dividing the screen space seen by the user into multiple two-dimensional grids of the same size, calculating the lighting result of each light source at each two-dimensional grid, and if the lighting result of the light source at the two-dimensional grid is less than the threshold, the influence of the light source on the two-dimensional grid is not calculated in the shading calculation stage. Camera space-based light source culling refers to dividing the calculated camera space into multiple three-dimensional grids of the same size, calculating the lighting result of each light source at each three-dimensional grid, and if the lighting result of the light source at the three-dimensional grid is less than the threshold, the influence of the light source on the three-dimensional grid is not calculated in the shading calculation stage. Both screen space and camera space are generated based on multiple perspectives, which requires calculating the light source culling result at each perspective, resulting in a large amount of light source culling calculation.

Summary of the invention

The embodiments of the present application provide a light source culling method and a rendering engine for sharing light source culling results among multiple perspectives, thereby reducing the amount of computation required for light source culling.

In a first aspect, an embodiment of the present application provides a light source culling method, which can be used for a rendering application, wherein the rendering application includes multiple three-dimensional models and multiple light sources, each of the multiple three-dimensional models includes multiple cache points, and the method includes: respectively calculating multiple light intensity values of the multiple light sources at a target cache point, the multiple cache points including the target cache point, and the visible space corresponding to the first viewpoint includes the target cache point; according to the multiple light intensity values and the light intensity threshold, determining to indicate a target light source from the multiple light sources, and based on the at least one target light source, performing shading calculation on the target cache point to obtain a rendering result corresponding to the first viewpoint.

In the above-mentioned embodiment of the present application, the light source culling calculation of the three-dimensional model is based on the granularity of the cache point, so that the light source culling results of the same cache point under different viewpoints can be shared, thereby eliminating the need to calculate the light source culling results of the same cache point under different viewpoints, thereby reducing the amount of light source culling calculations.

In a possible design, the visible space corresponding to the second viewpoint includes the target cache point, and the method may further include: performing shading calculation on the target cache point based on at least one target light source to obtain a rendering result corresponding to the second viewpoint. With this design, the light source culling result of the target cache point under the second viewpoint can share the light source culling result of the target cache point under the first viewpoint, and there is no need to calculate the light source culling result of the target cache point under the second viewpoint, which can reduce the amount of light source culling calculation.

In a possible design, after determining at least one target light source from the multiple light sources according to the multiple light intensity values and the light intensity threshold, the method may further include: storing the correspondence between the target cache point and the at least one target light source. In this way, the correspondence between the target cache point and the at least one target light source is stored in the memory, and the light source culling result of the target cache point can be obtained by reading the memory later, without repeatedly calculating the light source culling result of the target cache point.

In a possible design, the cache point is one or more of the following: a patch, a texel point, or a point in a point cloud. Setting the cache point to a patch, a texel point, or a point in a point cloud means that the rendering process is performed at the granularity of a patch, a texel point, or a point in a point cloud. Source culling can improve the accuracy of light source culling and reduce the problem of too much or too little light source culling.

In a possible design, the cache points are located on the surface of the three-dimensional model, and different three-dimensional models include different numbers of cache points.

In a possible design, the method may further include: providing a configuration interface, wherein the configuration interface is used to receive the light intensity threshold value set by the user, so that the user can input the light intensity threshold value by himself through the configuration interface, thereby improving adaptability.

In one possible design, the illumination intensity value of each target light source of the at least one target light source at the target cache point is greater than or equal to the illumination intensity threshold.

In a second aspect, an embodiment of the present application provides a rendering engine, which is used for rendering applications, wherein the rendering application includes multiple three-dimensional models and multiple light sources, each three-dimensional model includes multiple cache points, and the rendering engine includes a processing unit and a storage unit; the processing unit is used to obtain a target cache point from the storage unit, and respectively calculate multiple light intensity values of the multiple light sources at the target cache points, the multiple cache points include the target cache point, and the visible space corresponding to the first viewpoint includes the target cache point; according to the multiple light intensity values and the light intensity threshold, determine at least one target light source from the multiple light sources; and based on the at least one target light source, perform shading calculation on the target cache point to obtain a rendering result corresponding to the first viewpoint.

In a possible design, the visible space corresponding to the second viewpoint includes the target cache point, and the processing unit is further used to: perform shading calculation on the target cache point based on the at least one target light source to obtain a rendering result corresponding to the second viewpoint.

In a possible design, after determining at least one target light source from the multiple light sources according to the multiple light intensity values and the light intensity thresholds, the storage unit is further used to: store a corresponding relationship between the target cache point and the at least one target light source.

In one possible design, the cache point is one or more of the following: a patch, a texel point, or a point in a point cloud.

In a possible design, the rendering engine may further include a configuration interface, wherein the configuration interface is used to receive the light intensity threshold set by a user.

In a third aspect, an embodiment of the present application provides a computer program product comprising instructions, which, when executed by a computer device cluster, causes the computer device cluster to execute the method provided in the first aspect or any possible design of the first aspect.

In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium, comprising computer program instructions. When the computer program instructions are executed by a computing device cluster, the computing device cluster executes the method provided by the first aspect or any possible design of the first aspect.

In a fifth aspect, an embodiment of the present application provides a computing device cluster, comprising at least one computing device, each computing device comprising a processor and a memory; the processor of at least one computing device is used to execute instructions stored in the memory of at least one computing device, so that the computing device performs a method provided by the first aspect or any possible design of the first aspect.

In some possible designs, the computing device cluster includes a computing device, which includes a processor and a memory; the processor is used to execute instructions stored in the memory to run the rendering engine provided by the second aspect or any possible design of the second aspect, so that the computing device performs a method provided by the first aspect or any possible design of the first aspect.

In some possible designs, the computing device cluster includes at least two computing devices, each computing device includes a processor and a memory. The processors of the at least two computing devices are used to execute instructions stored in the memories of the at least two computing devices to run the rendering engine provided by the second aspect or any possible design of the second aspect, so that the computing device cluster performs the method provided by the first aspect or any possible design of the first aspect.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG1 is a schematic diagram of UV unfolding in an embodiment of the present application;

FIG2 is a schematic diagram of light source culling based on screen space in an embodiment of the present application;

FIG3 is a schematic diagram of light source culling based on camera space in an embodiment of the present application;

FIG4 is a schematic diagram of a rendering system in an embodiment of the present application;

FIG5 is a schematic diagram of a flow chart of a light source elimination method provided in an embodiment of the present application;

FIG6 is another schematic flow chart of a light source elimination method provided in an embodiment of the present application;

FIG7 is a schematic diagram of a light source elimination result provided in an embodiment of the present application;

FIG8 is a schematic diagram of a structure of a rendering engine provided in an embodiment of the present application;

FIG. 9 is a schematic diagram of a structure of a computing device provided in an embodiment of the present application.

Detailed ways

First, some terms and related technologies involved in the embodiments of the present application are explained so that those skilled in the art can easily understand them.

A 3D model is a polygonal representation of an object, usually displayed by a computer or other video device. The shapes of a 3D model can be various, for example, a sphere, a cone, a curved object, a flat object, an object with an irregular surface, etc. The displayed object can be a real-world entity or a fictional object. 3D models are often generated using specialized software such as 3D modeling tools, but they can also be generated by other methods. As a collection of data of points and other components, a 3D model can be generated manually or according to a certain algorithm.

The facets involved in the embodiments of the present application may also be referred to as meshes, which divide the surface of a three-dimensional model into countless tiny planes. These planes may be any polygons, and triangles and quadrilaterals are commonly used. The shapes of the facets of three-dimensional models with different shapes may also be different. For example, the shapes of the facets of a sphere and the facets of a curved object may be completely different. The size of the facets may be set as needed, and the higher the accuracy requirements for the rendered image, the smaller the size of the facets may be set. The position, shape or size of the facets in the three-dimensional model may be described by geometric parameters.

The texel points involved in the embodiments of the present application may also be referred to as texels, texture elements, etc., which are the smallest component units of each of the multiple two-dimensional planes when the surface of a three-dimensional model is mapped into multiple two-dimensional planes. For example, the surface of a three-dimensional model can be expanded by UV to obtain multiple two-dimensional planes, where U refers to the horizontal axis of the two-dimensional plane and V refers to the vertical axis of the two-dimensional plane. For example, as shown in Figure 1, the car seat in Figure 1 (a) is expanded by UV as shown in Figure 1 (b). The two-dimensional plane after such expansion can be called a texture, which is composed of texel points.

The point cloud involved in the embodiment of the present application is a data set obtained by mapping the surface of a three-dimensional model. A point in the point cloud is the smallest component unit in the point cloud.

It should be noted that the patches, texel points, and points in the point cloud involved in the embodiments of the present application are different expressions of the surface of the three-dimensional model. The embodiments of the present application do not limit the acquisition method and implementation method of the patches, texel points, and points in the point cloud.

The viewpoint involved in the embodiments of the present application can be understood as the position of the observer (such as a camera or human eye, etc.). The viewing angle involved in the embodiments of the present application can be understood as the angle at which the observer observes the virtual scene. It should be noted that the "viewpoint" and "viewing angle" in the embodiments of the present application can be used interchangeably.

The cache points involved in the embodiments of the present application may also be referred to as cache units or surface cache points, etc., which are located on the surface of the three-dimensional model and are used to store the calculation results in the rendering process, and the calculation results may include, for example, light source culling results, shading results, or light effect results. In the embodiments of the present application, the cache points are used to store light source culling results as an example. It should be understood that the number of cache points of different three-dimensional models may be different.

It should be noted that the generation of cache points involved in the embodiments of the present application is independent of viewpoints and viewing angles. Exemplarily, the cache point can be one or more of the following: a patch, a texel point, and a point in a point cloud. For example, if the cache point is a patch, then the patch can store the light source culling result of the patch, and then the light source culling result of the patch can be obtained through the patch. For another example, if the cache point is a texel point, then the texel point can store the light source culling result of the texel point, and then the light source culling result of the texel point can be obtained through the texel point. For another example, if the cache point is a point in a point cloud, then the point can store the light source culling result of the point, and then the light source culling result of the point can be obtained through the point.

It should be noted that the cache point is used to store the light source culling results, which can also be understood as a correspondence (or association) between the cache point and the light source culling results. In this way, the light source culling result of the cache point can be obtained through the cache point and the correspondence (or association) between the cache point and the light source culling results.

The embodiments of the present application involve one or more light sources. The light generated by the light source is irradiated onto a three-dimensional model. The light source may be a point light source, a line light source, or a surface light source, etc. After the light generated by the light source contacts the surface of the three-dimensional model, one of the following situations may occur at each contact point on the surface: refraction, reflection, or diffuse reflection. Then, the light enters the user's eyes.

Shading calculation refers to the calculation of the color of light from the light source along the light ray direction to the shading point, and then along the veiw ray direction to the camera during the rendering process, for the line of sight (veiw ray) direction and the light (light ray) direction.

In this application, at least one refers to one or more, and a plurality refers to two or more. In addition, it should be understood that in the description of this application, the words "first", "second", etc. are only used for the purpose of distinguishing descriptions, and cannot be understood as indicating or implying relative importance, nor can they be understood as indicating or implying an order. For example, the first viewpoint and the second viewpoint mentioned below are used to distinguish different viewpoints, and do not mean Indicates the order and priority of the two viewpoints.

In rendering technology, light source culling based on screen space and light source culling based on camera space are two common means to achieve delayed rendering, which can reduce the amount of calculation for shading calculation. FIG2 shows a schematic diagram of light source culling based on screen space. As shown in FIG2, the screen space is divided into multiple two-dimensional grids, and light source culling is performed with the two-dimensional grid as the granularity. On the one hand, the screen space lacks depth information, and different pixels in the same two-dimensional grid may be illuminated by different light sources. For example, the chair and the small room behind it in FIG2 may be illuminated by different light sources and the lighting results are different, which leads to errors in the light source culling results, which is not conducive to subsequent shading calculations; on the other hand, the screen space is a space generated based on multiple perspectives or multiple viewpoints. For each two-dimensional grid, the light source culling results under different perspectives or different viewpoints need to be calculated, and the amount of calculation for light source culling is large. FIG3 shows a schematic diagram of light source culling based on camera space. As shown in FIG3, the camera space is divided into multiple three-dimensional grids, and light source culling is performed with the three-dimensional grid as the granularity. Since the camera space is also a space generated based on multiple perspectives or multiple viewpoints, each three-dimensional grid also requires light source culling results under different perspectives or different viewpoints, and the amount of light source culling calculation is relatively large.

In view of this, an embodiment of the present application provides a light source culling method, in which light source culling is performed at a cache point as the granularity, so that the light source culling results at the same cache point under different viewing angles or different viewpoints can be shared, thereby eliminating the need to calculate the light source culling results at the same cache point under each viewing angle or each viewpoint, thereby reducing the amount of computational complexity of light source culling.

Next, the solution provided in the embodiment of the present application is described in detail in combination with the application scenario.

First, the rendering system applicable to the present application is described. Referring to Figure 4, Figure 4 is a schematic diagram of the structure of a rendering system involved in the present application. The rendering system of the present application is used to render a three-dimensional (or two-dimensional) model of a virtual scene by a rendering method to obtain a two-dimensional image, that is, a rendered image. The rendering system of the present application may include: one or more terminal devices 100, a network device 200, and a rendering platform 300. The rendering platform 300 can be deployed on a cloud server, but the embodiments of the present application are not limited thereto. The rendering platform 300 and the terminal device 100 are generally deployed in different data centers.

The terminal device 100 may be a device that needs to display rendered images in real time, for example, a virtual reality device (VR) for flight training, a computer for virtual games, a smart phone for a virtual mall, etc., which are not specifically limited here. The terminal device may be a high-configuration, high-performance device (for example, multi-core, high main frequency, large memory, etc.), or a low-configuration, low-performance device (for example, single-core, low main frequency, small memory, etc.). In a specific embodiment, the terminal device 100 may include hardware, an operating system, and a rendering application client.

The network device 200 is used to transmit data between the terminal device 100 and the rendering platform 300 through a communication network of any communication mechanism/communication standard. The communication network can be a wide area network, a local area network, a point-to-point connection, or any combination thereof.

The rendering platform 300 includes one or more rendering nodes (three rendering nodes are taken as an example in FIG. 4 ). The rendering platform 300 can be implemented by one or more computing devices. Multiple computing devices can constitute a computing device cluster. The functions of the rendering node can be implemented by one or more computing devices. The rendering node can include rendering hardware, virtualization services, rendering engines, and rendering application servers from bottom to top. Among them, the rendering hardware includes computing resources, storage resources, and network resources. The computing resources can adopt a heterogeneous computing architecture, for example, a central processing unit (CPU) + graphics processing unit (GPU) architecture, CPU + AI chip, CPU + GPU + AI chip architecture, etc., which are not specifically limited here. Storage resources may include storage devices such as memory and video memory. Network resources may include network cards, port resources, address resources, etc. Virtualization services virtualize the resources of rendering nodes into vCPUs, etc. through virtualization technology, and flexibly isolate independent resources according to user needs to run user applications. Generally, virtualization services may include virtual machine (VM) services and container services. VM and container may run rendering engines and rendering application servers. The rendering engine is used to implement rendering algorithms. The rendering application server is used to call the rendering engine to complete the rendering of the rendered image.

The rendering application client on the terminal device 100 and the rendering application server of the rendering platform 300 can be collectively referred to as a rendering application. Common rendering applications may include: game applications, VR applications, movie special effects, and animations, etc. The user inputs an operation instruction through the rendering application client, and the rendering application client sends the operation instruction to the rendering application server. The rendering application server calls the rendering engine to generate a rendering result, sends the rendering result to the rendering application client, and then the rendering application client converts the rendering result into an image and presents it to the user. In a possible implementation, the user can input a light intensity threshold through the rendering application client, and the rendering application client sends the light intensity threshold set by the user to the rendering application server. The rendering application server schedules the rendering engine and configures the light intensity threshold. The rendering engine performs light source culling according to the light intensity threshold, and generates a rendering result according to the light source culling, and sends the rendering result to the rendering application client, and then the rendering application client converts the rendering result into an image and presents it to the user.

In a specific implementation, the rendering application server and the rendering application client may be provided by a rendering application provider, and the rendering engine may be provided by a cloud service provider. For example, the rendering application may be a game application. The game developer of the game application installs the game application server on the rendering platform provided by the cloud service provider, and the game developer of the game application installs the game application client via the Internet. Provide it to users for download and install on their terminal devices. In addition, the cloud service provider also provides a rendering engine, which can provide computing power for the game application. In another specific implementation, the rendering application client, the rendering application server, and the rendering engine can all be provided by the cloud service provider.

In some embodiments, the rendering system may further include a management device (not shown in FIG. 4 ). The management device may be a device provided by a third party other than the user's terminal device and the rendering platform 300 of the cloud service provider. For example, the management device may be a device provided by a game developer. The game developer may manage the rendering application through the management device. It is understood that the management device may be disposed on the rendering platform 300 or outside the rendering platform 300, which is not specifically limited here.

Next, the light source culling method involved in the present application is described in detail. The light source culling method provided in the embodiment of the present application can be executed by the rendering platform 300, or by a rendering node in the rendering platform 300, or by a rendering engine in a rendering node. For ease of description, the illustrations of the various components in the rendering system will not be described in detail later.

See FIG5 for a flow chart of a light source elimination method provided in an embodiment of the present application.

S501, the rendering platform obtains relevant information of the rendering application. The rendering application includes one or more three-dimensional models, and one or more light sources. For ease of understanding, the embodiment of the present application takes multiple models and multiple light sources as an example. Each of the multiple three-dimensional models includes one or more cache points (hereinafter, multiple cache points are taken as an example). The relevant information of the rendering application may include light source parameters of multiple light sources and information of each three-dimensional model. The information of each three-dimensional model may, for example, include the situation of the cache points mapped by the three-dimensional model.

The cache points involved in the embodiments of the present application may be one or more of a patch, a texel point, and a point in a point cloud. When the cache point is a patch, the information of each three-dimensional model may include the patch division of the surface of the three-dimensional model, the patch number, the geometric parameters of the patch, etc. When the cache point is a texel point, the information of each three-dimensional model may include the texture mapping of the surface of the three-dimensional model, the texture map size, the texture coordinates, etc. When the cache point is a cloud in a point cloud, the information of each three-dimensional model may include the point cloud mapping of the surface of the three-dimensional model, the point cloud structure, the point cloud coordinates, etc.

In a possible implementation, the relevant information of the rendering application may be information sent by the terminal device to the rendering platform, or may be information sent by the management device to the rendering platform. FIG5 takes the example of the terminal device sending the relevant information of the rendering application to the rendering platform.

S502, the rendering platform respectively calculates multiple light intensity values of multiple light sources at target cache points. The multiple cache points include the target cache point.

For example, the rendering platform can initialize the surface cache of each of the multiple 3D models to obtain multiple cache points of each 3D model; for each 3D model, the rendering platform calculates multiple illumination intensity values of multiple light sources at the target cache points to be rendered. The number of target cache points can be understood as one or more.

In one possible implementation, the rendering platform can illuminate the target cache point with one or more light sources, and respectively calculate the illumination intensity values of the one or more light sources at the target cache point to reduce the amount of illumination intensity calculation. The embodiment of the present application takes the target cache point illuminated by multiple light sources as an example. For example, the rendering platform can establish a bitmap of the target cache point, and there is a corresponding relationship between the bitmap and the multiple light sources in the environment where the target cache point is located; the rendering platform determines the multiple light sources that illuminate the target cache point based on the bitmap, and respectively calculates the multiple illumination intensity values of the multiple light sources at the target cache point.

S503: The rendering platform determines at least one target light source from multiple light sources according to multiple light intensity values and light intensity thresholds.

The light intensity threshold may be predefined by the rendering system, such as a light intensity threshold determined by the rendering system based on historical rendering results. Alternatively, the light intensity threshold may be set by a user, such as a rendering system may include a configuration interface, which may be used to receive the light intensity threshold set by a user. Optionally, the terminal device may carry the light intensity threshold set by the user in the relevant information of the rendering application and send it to the rendering platform.

The rendering platform compares multiple illumination intensity values with the illumination intensity threshold respectively, and determines at least one target light source from the multiple light sources. The illumination intensity value of each target light source in the at least one target light source at the target cache point is greater than or equal to the illumination intensity threshold. For example, the rendering platform can traverse each light source, calculate the illumination intensity value of each light source at the target cache point, and compare the calculated illumination intensity value with the illumination intensity threshold. If the illumination intensity value is greater than or equal to the illumination intensity threshold, the value of the light source corresponding to the illumination intensity value on the bitmap is set to the first value (such as 1). If the illumination intensity value is less than the illumination intensity threshold, the value of the light source corresponding to the illumination intensity threshold on the bitmap is set to the second value (such as 0). After traversing multiple light sources of the rendering application (or traversing multiple light sources that illuminate the target cache point), the light source corresponding to the first value on the bitmap is the target light source.

In an embodiment of the present application, the light source culling result is based on the granularity of a cache point, and the generation of the cache point is independent of the viewpoint or viewing angle. For example, the cache point can be one or more of a patch, a texel point, or a point in a point cloud. Since the generation of the cache point is independent of the viewpoint or viewing angle, this means that the target light source whose light intensity value at the target cache point is greater than or equal to the light intensity threshold at different viewpoints or different viewing angles is the same, and multiple viewpoints or multiple viewing angles can share the light source culling result.

S504: The rendering platform performs shading calculation on the target cache point based on at least one target light source to obtain a rendering corresponding to the first viewpoint. The target cache point is included in the visible space corresponding to the first viewpoint.

In the shading calculation stage, the rendering platform can perform shading calculations on the target cache point based on at least one target light source, without considering the influence of light sources other than at least one target light source on the target cache point among the multiple light sources. For example, the rendering platform can shade the target cache point according to the light source corresponding to the first value on the bitmap of the target cache point. Taking multiple light sources including light source 1, light source 2, light source 3 and light source 4 as an example, the light intensity values of light source 1 and light source 2 are greater than or equal to the light intensity threshold, and the light intensity values of light source 3 and light source 4 are less than the light intensity threshold, as shown in Figure 6; the rendering platform can perform shading calculations on the target cache point based on light source 1 and light source 2.

In the embodiment of the present application, the rendering results of the same cache point at different viewpoints or different viewing angles may be the same or different, but the light source culling results of the same cache point at different viewpoints or different viewing angles are the same. In FIG5 , taking the first viewpoint as an example, the visual space corresponding to the first viewpoint includes the target cache point, and the rendering platform performs shading calculations on the target cache point based on at least one target light source to obtain the rendering result corresponding to the first viewpoint.

S505: The rendering platform stores a correspondence between a target cache point and at least one target light source.

For example, the rendering platform stores the correspondence between the target cache point and at least one target light source in a memory. The memory may include a volatile memory, such as a random access memory (RAM). The memory may also be a non-volatile memory, such as a read-only memory (ROM), a flash memory, a hard disk drive (HDD), or a solid state drive (SSD).

In some embodiments, the memory may be deployed outside the rendering platform or inside the rendering platform. For example, the memory may be deployed inside the rendering engine.

Exemplarily, the rendering platform can establish a light source rejection result table for multiple cache points corresponding to each three-dimensional model. The light source rejection result table may include the number of each cache point, and the number of one or more light sources whose illumination intensity threshold at each cache point is greater than or equal to the illumination intensity threshold. For example, the light source rejection result table can be shown in Table 1. It should be noted that the rendering platform can uniquely identify the cache point corresponding to the three-dimensional model by number or index, or can uniquely identify the cache point corresponding to the three-dimensional model by coordinates, parameters, etc., which is not limited in the embodiments of the present application.

Table 1

It should be noted that the execution order of S504 and S505 is only an example, and the embodiments of the present application are not limited thereto. For example, the rendering platform may first store the correspondence between the target cache point and at least one target light source, and then perform shading calculation on the target cache point based on the at least one target light source to obtain the rendering result corresponding to the first viewpoint; or, the rendering platform may also perform shading calculation on the target cache point based on the at least one target light source, and store the correspondence between the target cache point and the at least one target light source and the target cache point.

In the above embodiment, the rendering platform performs light source culling at the cache point granularity, so that the light source culling results at the same cache point under different viewing angles or different viewpoints can be shared, thereby eliminating the need to calculate the light source culling results at the same cache point under each viewing angle or each viewpoint, thereby reducing the amount of computation for light source culling.

Referring to Fig. 7, another schematic flow chart of a method for eliminating light sources provided in an embodiment of the present application is shown. As shown in Fig. 7, the method may include the following contents.

S701, the rendering platform receives a rendering request. The rendering request may come from a terminal device or a management device. FIG7 takes the rendering request coming from a terminal device as an example. The rendering request may include relevant information of the second viewpoint, which is used to request the rendering result of the second viewpoint. The relevant information of the second viewpoint may be, for example, the viewpoint direction of the second viewpoint, etc., and then the rendering platform may determine the second viewpoint of the user based on the relevant information of the second viewpoint. The rendering request may also include an identifier of the rendering application. The identifier of the rendering application uniquely identifies the rendering application in the rendering system. In some scenarios, when the rendering system includes only one rendering application, the identifier of the rendering application may not be carried in the rendering request.

S701 is an optional step, which is indicated by a dotted line in Figure 7. That is, the rendering platform may obtain the rendering result of the second viewpoint in response to the rendering request, in which case the first viewpoint and the second viewpoint may be the same or different; or the rendering platform may obtain the rendering result of the second viewpoint after obtaining the rendering result of the first viewpoint, so as to obtain the rendering result under different viewpoints, in which case the first viewpoint and the second viewpoint are different.

The visible space corresponding to the second viewpoint includes the target cache point in the process shown in FIG. 5 .

S702: The rendering platform obtains at least one target light source corresponding to the target cache point.

The rendering platform may obtain the light source culling result of the target cache point. For example, the rendering platform obtains at least one target light source corresponding to the target cache point by querying the light source culling result table. For example, the rendering platform may send a read request to the memory, the read request is used to read the light source culling result of the target cache point, and the memory responds to the read request and sends the at least one target light source corresponding to the target cache point to the rendering platform.

S703: The rendering platform performs shading calculation on the target cache point based on at least one target light source to obtain a rendering result of a second viewpoint.

In the embodiment shown in FIG7 , the rendering platform performs shading calculations on the target cache point based on at least one target light source obtained from the memory to obtain a rendering result of the second viewpoint. This allows the light source culling result of the target cache point under the first viewpoint to be shared, and there is no need to calculate the light source culling result of the target cache point under the second viewpoint, thereby reducing the amount of computational effort for light source culling.

Based on the same technical concept as the above method, an embodiment of the present application also provides a rendering engine. As shown in Figure 8, the rendering engine 800 is used for rendering applications, which include multiple three-dimensional models and multiple light sources, and each three-dimensional model includes multiple cache points; the rendering engine 800 includes a processing unit 801 and a storage unit 802.

Among them, the processing unit 801 can be used to obtain a target cache point from the storage unit 802, and respectively calculate multiple illumination intensity values of multiple light sources at the target cache point, where the multiple cache points include the target cache point, and the visible space corresponding to the first viewpoint includes the target cache point; determine at least one target light source from the multiple light sources based on the multiple illumination intensity values and the illumination intensity threshold; and perform shading calculation on the target cache point based on the at least one target light source to obtain a rendering result corresponding to the first viewpoint.

In a possible implementation, the visible space corresponding to the second viewpoint includes the target cache point, and the processing unit 801 is further used to: perform shading calculation on the target cache point based on the at least one target light source to obtain a rendering result corresponding to the second viewpoint.

In a possible implementation, after determining at least one target light source from the multiple light sources according to the multiple light intensity values and the light intensity thresholds, the storage unit 802 is further used to: store a correspondence between the target cache point and the at least one target light source.

In a possible implementation, the cache point is one or more of the following: a patch, a texel point, or a point in a point cloud.

In a possible implementation, the cache points are located on the surface of the three-dimensional model, and different three-dimensional models include different numbers of cache points.

In a possible implementation, the rendering engine 800 may further include a configuration interface 803 (indicated by a dotted line in FIG. 8 ), where the configuration interface 803 is used to receive the illumination intensity threshold set by a user.

In a possible implementation manner, a light intensity value of each target light source of the at least one target light source at the target cache point is greater than or equal to the light intensity threshold.

The present application also provides a computing device 900. As shown in FIG9 , the computing device 900 includes: a bus 902, a processor 904, and a memory 906. Optionally, the computing device 900 may also include a communication interface 908 (indicated by a dotted line in FIG9 ). The processor 904, the memory 906, and the communication interface 908 communicate through the bus 902. The computing device 900 may be a server or a terminal device. It should be understood that the present application does not limit the number of processors and memories in the computing device 900.

The bus 902 may be a peripheral component interconnect (PCI) bus or an extended industry standard architecture (EISA) bus, etc. The bus may be divided into an address bus, a data bus, a control bus, etc. For ease of representation, FIG. 9 is represented by only one line, but does not mean that there is only one bus or one type of bus. The bus 902 may include a path for transmitting information between various components of the computing device 900 (e.g., the memory 906, the processor 904, and the communication interface 908).

Processor 904 may include any one or more of a central processing unit (CPU), a graphics processing unit (GPU), a microprocessor (MP) or a digital signal processor (DSP).

In some possible implementations, the processor 904 may include one or more graphics processors. The processor 904 is configured to execute instructions stored in the memory 906 to implement the method described in the embodiment corresponding to FIG. 5 or FIG. 7 .

In some possible implementations, the processor 904 may include one or more central processing units and one or more graphics processing units. The processor 904 is configured to execute instructions stored in the memory 906 to implement the method described in the embodiment corresponding to FIG. 5 or FIG. 7 .

The memory 906 may include a volatile memory, such as a random access memory (RAM). The processor 904 may also include a non-volatile memory, such as a read-only memory (READ-ONLY MEMORY). ROM), flash memory, hard disk drive (HDD) or solid state drive (SSD). The memory 906 stores executable program code, and the processor 904 executes the executable program code to implement the method described in the embodiment corresponding to FIG. 5 or FIG. 7. Specifically, the memory 906 stores instructions for the rendering node to execute the method described in the embodiment corresponding to FIG. 5 or FIG. 7.

The communication interface 908 uses a transceiver module such as, but not limited to, a network interface card or a transceiver to implement communication between the computing device 900 and other devices or communication networks.

The embodiment of the present application also provides a computer-readable storage medium. The computer-readable storage medium can be any available medium that can be stored by a computing device or a data storage device such as a data center containing one or more available media. The available medium can be a magnetic medium (e.g., a floppy disk, a hard disk, a tape), an optical medium (e.g., a DVD), or a semiconductor medium (e.g., a solid-state hard disk). The computer-readable storage medium includes instructions that instruct the computing device to execute the method described in the embodiment corresponding to Figure 5 or Figure 7 above.

The present application also provides a computer program product including instructions. The computer program product may be software or a program product including instructions that can be run on a computing device or stored in any available medium. When the computer program product is run on at least one computer device, the at least one computer device executes the method described in the embodiment corresponding to FIG. 5 or FIG. 7 above.

Those skilled in the art will appreciate that the embodiments of the present application may be provided as methods, systems, or computer program products. Therefore, the present application may adopt the form of a complete hardware embodiment, a complete software embodiment, or an embodiment in combination with software and hardware. Moreover, the present application may adopt the form of a computer program product implemented in one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) that contain computer-usable program code.

The present application is described with reference to the flowchart and/or block diagram of the method, device (system) and computer program product according to the embodiment of the present application. It should be understood that each process and/or box in the flowchart and/or block diagram, and the combination of the process and/or box in the flowchart and/or block diagram can be realized by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor or other programmable data processing device to produce a machine, so that the instructions executed by the processor of the computer or other programmable data processing device produce a device for realizing the function specified in one process or multiple processes in the flowchart and/or one box or multiple boxes in the block diagram.

These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing device to work in a specific manner, so that the instructions stored in the computer-readable memory produce a manufactured product including an instruction device that implements the functions specified in one or more processes in the flowchart and/or one or more boxes in the block diagram.

These computer program instructions may also be loaded onto a computer or other programmable data processing device so that a series of operational steps are executed on the computer or other programmable device to produce a computer-implemented process, whereby the instructions executed on the computer or other programmable device provide steps for implementing the functions specified in one or more processes in the flowchart and/or one or more boxes in the block diagram.

Obviously, those skilled in the art can make various changes and modifications to the embodiments of the present application without departing from the scope of the embodiments of the present application. Thus, if these modifications and variations of the embodiments of the present application fall within the scope of the claims of the present application and their equivalents, the present application is also intended to include these modifications and variations.

Claims

A light source culling method, characterized in that the method is applied to a rendering application, the rendering application includes multiple three-dimensional models and multiple light sources, each three-dimensional model includes multiple cache points, and the method includes:

respectively calculating a plurality of illumination intensity values of the plurality of light sources at target cache points, the plurality of cache points including the target cache point, and the visible space corresponding to the first viewpoint including the target cache point;

determining at least one target light source from the plurality of light sources according to the plurality of light intensity values and the light intensity threshold;

Based on the at least one target light source, a shading calculation is performed on the target cache point to obtain a rendering result corresponding to the first viewpoint.
The method according to claim 1, characterized in that the visual space corresponding to the second viewpoint includes the target cache point, and the method further comprises:

Based on the at least one target light source, a shading calculation is performed on the target cache point to obtain a rendering result corresponding to the second viewpoint.
The method according to claim 1 or 2, characterized in that after determining at least one target light source from the multiple light sources according to the multiple light intensity values and the light intensity thresholds, the method further comprises:

The corresponding relationship between the target cache point and the at least one target light source is stored.
The method according to any one of claims 1 to 3, characterized in that the cache point is one or more of the following:

Patches, texel points, points in point clouds.
The method according to any one of claims 1 to 4 is characterized in that the cache points are located on the surface of the three-dimensional model, and different three-dimensional models include different numbers of cache points.
The method according to any one of claims 1 to 5, characterized in that the method further comprises:

A configuration interface is provided, wherein the configuration interface is used to receive the light intensity threshold set by a user.
The method according to any one of claims 1 to 6, characterized in that the light intensity value of each target light source of the at least one target light source at the target cache point is greater than or equal to the light intensity threshold.
A rendering engine, characterized in that the rendering engine is used for rendering applications, the rendering application includes multiple three-dimensional models and multiple light sources, each three-dimensional model includes multiple cache points, and the rendering engine includes a processing unit and a storage unit;

The processing unit is used to obtain a target cache point from the storage unit, and respectively calculate multiple illumination intensity values of the multiple light sources at the target cache points, where the multiple cache points include the target cache point, and the visible space corresponding to the first viewpoint includes the target cache point; determine at least one target light source from the multiple light sources according to the multiple illumination intensity values and the illumination intensity threshold; and perform shading calculation on the target cache point based on the at least one target light source to obtain a rendering result corresponding to the first viewpoint.
The rendering engine according to claim 8, wherein the visible space corresponding to the second viewpoint includes the target cache point, and the processing unit is further configured to:

Based on the at least one target light source, a shading calculation is performed on the target cache point to obtain a rendering result corresponding to the second viewpoint.
The rendering engine according to claim 8 or 9, characterized in that after determining at least one target light source from the multiple light sources according to the multiple light intensity values and the light intensity threshold, the storage unit is further used to:

The corresponding relationship between the target cache point and the at least one target light source is stored.
The rendering engine according to any one of claims 8 to 10, wherein the cache point is one or more of the following:

Patches, texel points, points in point clouds.
The rendering engine according to any one of claims 8 to 11, characterized in that the cache points are located on the surface of the three-dimensional model, and different three-dimensional models include different numbers of cache points.
The rendering engine according to any one of claims 8 to 12 is characterized in that the rendering engine also includes a configuration interface, and the configuration interface is used to receive the light intensity threshold set by a user.
The rendering engine according to any one of claims 8 to 13, characterized in that the light intensity value of each target light source of the at least one target light source at the target cache point is greater than or equal to the light intensity threshold.
A computer program product, characterized in that the computer program product comprises instructions, and when the instructions are executed by a computer device cluster, the computer device cluster executes the method according to any one of claims 1 to 7.
A computer-readable storage medium, characterized in that it includes computer program instructions. When the computer program instructions are executed by a computing device cluster, the computing device cluster executes the method as described in any one of claims 1 to 7.
A computing device cluster, characterized in that it includes at least one computing device, each computing device includes a processor and a memory;

The processor of the at least one computing device is configured to execute instructions stored in the memory of the at least one computing device, so that the computing device cluster executes the method according to any one of claims 1 to 7.