CN113469883B - Rendering method and device of dynamic resolution, electronic equipment and readable storage medium - Google Patents
Rendering method and device of dynamic resolution, electronic equipment and readable storage medium Download PDFInfo
- Publication number
- CN113469883B CN113469883B CN202110735362.5A CN202110735362A CN113469883B CN 113469883 B CN113469883 B CN 113469883B CN 202110735362 A CN202110735362 A CN 202110735362A CN 113469883 B CN113469883 B CN 113469883B
- Authority
- CN
- China
- Prior art keywords
- rendering
- resolution
- adjusted
- texture
- camera
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T3/00—Geometric image transformation in the plane of the image
- G06T3/40—Scaling the whole image or part thereof
- G06T3/4023—Decimation- or insertion-based scaling, e.g. pixel or line decimation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T13/00—Animation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/40—Analysis of texture
Abstract
The application discloses a rendering method and device of dynamic resolution, electronic equipment and a readable storage medium, relates to the technical field of computers, realizes resolution adjustment by sampling and rendering again on rendering textures, does not need to generate a rendering graph with a new size, avoids occupying a large amount of rendering resources, and achieves the purpose of saving resources. The method comprises the following steps: responding to a resolution adjustment instruction, and generating a target scaling ratio and a resolution to be adjusted; adjusting the rendering texture according to the resolution to be adjusted, and adjusting the size of a camera viewport of a scene camera of the animation scene according to the target zoom ratio; rendering the animation scene by using the adjusted camera viewport and the adjusted rendering texture to obtain a first rendering image; performing scaling sampling on the adjusted rendering texture to render the rendering texture back to a color buffer area, and rendering the color buffer area by using an interface camera of the animation scene to obtain a second rendering image; and superposing the second rendering map to the first rendering map to generate a target rendering map.
Description
Technical Field
The present application relates to the field of computer technologies, and in particular, to a dynamic resolution rendering method and apparatus, an electronic device, and a readable storage medium.
Background
With the continuous development of computer technology, terminal devices such as smart phones and tablet computers are gradually popularized, become an indispensable part of life, study and entertainment of people, and deeply affect the aspects of social life of people. At present, terminal devices are configured differently, and when a software application is developed, in order to ensure that the resolution is high enough when the software application runs on the terminal device and avoid blurs of characters, 2D pictures and the like displayed by the software application, the resolution of the software application needs to be continuously adjusted based on a software development tool.
In the related art, when the resolution of the software application is adjusted, the current frame rate of the software application needs to be determined, the resolution to be rendered is determined according to the current frame rate, a rendering graph with the size being consistent with the resolution to be rendered is generated, and the resolution adjustment is realized by using the rendering graph to render a page of the software application at the current frame rate.
In carrying out the present application, the applicant has found that the related art has at least the following problems:
the resolution adjustment realized by adopting the mode of continuously generating the rendering graph needs to continuously generate the rendering graph with a new size in the running process of the software application, so that a large amount of rendering resources are occupied, and the waste of the resources is caused.
Disclosure of Invention
In view of this, the present application provides a rendering method and apparatus for dynamic resolution, an electronic device and a readable storage medium, and mainly aims to solve the problem that a rendering map with a new size is continuously generated at present, and a large amount of rendering resources are occupied, which results in resource waste.
According to a first aspect of the present application, there is provided a method for rendering a dynamic resolution, the method comprising:
responding to a resolution adjustment instruction, and generating a target scaling ratio and a resolution to be adjusted according to the time information of a current frame and a historical frame of the animation scene;
adjusting the rendered texture according to the resolution to be adjusted, and adjusting the size of a camera viewport of a scene camera of the animation scene according to the target zoom ratio;
rendering the animation scene by using the adjusted camera viewport and the adjusted rendering texture to obtain a first rendering graph;
performing scaling sampling on the adjusted rendering texture to render the rendering texture back to a color buffer area, and rendering the color buffer area by using an interface camera of the animation scene to obtain a second rendering image;
and superposing the second rendering map to the first rendering map to generate a target rendering map which accords with the resolution to be adjusted.
Optionally, in response to the resolution adjustment instruction, before generating the target zoom ratio and the resolution to be adjusted according to the time information of the current frame and the historical frame of the animation scene, the method further includes:
detecting a current time point, and determining to receive the resolution adjustment instruction when the current time point is in accordance with an adjustment period; or the like, or, alternatively,
and when detecting that a resolution adjustment entrance is triggered, determining that the resolution adjustment instruction is received.
Optionally, the generating a target scaling ratio and a resolution to be adjusted according to the time information of the current frame and the historical frame of the animation scene includes:
reading the current frame time consumption of the current frame of the animation scene;
inquiring the time information of the historical frame, and carrying out average value calculation on the time information of the historical frame to obtain the average consumed time of the historical frame;
determining a preset expected frame rate, calculating a first ratio of the current frame time consumption to the average time consumption, and a second ratio of the first ratio to the preset expected frame rate, and taking the second ratio as the target scaling ratio;
reading the current resolution of the current frame, calculating a first product of the current resolution and the target scaling ratio, and taking the first product as the resolution to be adjusted.
Optionally, said resizing a camera viewport of a scene camera of the animated scene at the target zoom ratio comprises:
determining the scene camera mounted in the animation scene;
obtaining a texture size of the rendered texture, calculating a second product of the texture size and the target scaling ratio;
adjusting a length and a width of a camera viewport of the scene camera according to the second product.
Optionally, the scaling, sampling and rendering the adjusted rendering texture back to a color buffer area, and rendering the color buffer area by using an interface camera of the animation scene to obtain a second rendering map, including:
stretching the adjusted rendering texture according to the target scaling ratio to obtain a rendering texture to be sampled;
sampling the rendered texture to be sampled, and adding pixel points obtained by sampling to the color buffer area;
and performing interface rendering according to the data of the color buffer area by using the interface camera to obtain the second rendering image.
Optionally, the method further comprises:
determining a first axis of the first rendering map and a second axis of the second rendering map, and comparing the first axis with the second axis;
when the first axis and the second axis have deviation, the second rendering graph is zoomed and processed in position, and the first axis and the second axis are controlled to coincide.
Optionally, the method further comprises:
and if the animation scene is associated with a high dynamic range rendering effect, deleting the rendering texture in each frame of the target rendering graph rendered for the animation scene.
According to a second aspect of the present application, there is provided a dynamic resolution rendering apparatus, comprising:
the generating module is used for responding to a resolution adjusting instruction and generating a target scaling ratio and a resolution to be adjusted according to the time information of the current frame and the historical frame of the animation scene;
an adjusting module, configured to adjust a rendering texture according to the resolution to be adjusted, and adjust a size of a camera viewport of a scene camera of the animation scene according to the target zoom ratio;
a first rendering module, configured to render the animation scene by using the adjusted camera viewport and the adjusted rendering texture, so as to obtain a first rendering map;
the second rendering module is used for performing scaling sampling on the adjusted rendering textures and rendering the rendering textures back to a color buffer area, and rendering the color buffer area by using an interface camera of the animation scene to obtain a second rendering image;
and the superposition module is used for superposing the second rendering map to the first rendering map to generate a target rendering map which accords with the resolution to be adjusted.
Optionally, the apparatus further comprises:
the detection module is used for detecting the current time point and determining to receive the resolution adjustment instruction when the current time point is in accordance with the adjustment period; or, when the resolution adjustment entrance is triggered, determining that the resolution adjustment instruction is received.
Optionally, the generating module is configured to read a current frame time consumption of a current frame of the animation scene; inquiring the time information of the historical frame, and carrying out average value calculation on the time information of the historical frame to obtain the average consumed time of the historical frame; determining a preset expected frame rate, calculating a first ratio of the current frame time consumption to the average time consumption, and a second ratio of the first ratio to the preset expected frame rate, and taking the second ratio as the target scaling ratio; reading the current resolution of the current frame, calculating a first product of the current resolution and the target scaling ratio, and taking the first product as the resolution to be adjusted.
Optionally, the adjusting module is configured to determine the scene camera mounted in the animation scene; obtaining a texture size of the rendered texture, calculating a second product of the texture size and the target scaling ratio; adjusting a length and a width of a camera viewport of the scene camera according to the second product.
Optionally, the second rendering module is configured to stretch the adjusted rendering texture according to the target scaling ratio to obtain a rendering texture to be sampled; sampling the rendered texture to be sampled, and adding pixel points obtained by sampling to the color buffer area; and performing interface rendering according to the data of the color buffer area by using the interface camera to obtain the second rendering image.
Optionally, the second rendering module is further configured to determine a first axis of the first rendering map and a second axis of the second rendering map, and compare the first axis with the second axis; when the first axis and the second axis have deviation, the second rendering graph is zoomed and processed in position, and the first axis and the second axis are controlled to coincide.
Optionally, the deleting module is configured to delete the rendering texture in the target rendering map rendered for the animation scene in each frame if the animation scene is associated with a high dynamic range rendering effect.
According to a third aspect of the present application, there is provided an electronic device comprising a memory storing a computer program and a processor implementing the steps of the method of any of the first aspect when the computer program is executed.
According to a fourth aspect of the present application, there is provided a readable storage medium having stored thereon a computer program which, when executed by a processor, performs the steps of the method of any one of the above-mentioned first aspects.
By means of the technical scheme, the present application provides a method, an apparatus, an electronic device and a readable storage medium for rendering a dynamic resolution, which determine a target zoom ratio and a resolution to be adjusted according to time information of a current frame and a historical frame of an animation scene in a game, adjust a rendering texture according to the resolution to be adjusted, adjust a size of a camera view port of a scene camera of the animation scene according to the target zoom ratio, render the animation scene by using the adjusted camera view port and the adjusted rendering texture to obtain a first rendering map, perform zoom sampling on the adjusted rendering texture to render back to a color buffer area, render the color buffer area by using an interface camera of the animation scene to obtain a second rendering map, further superimpose the second rendering map on the first rendering map to generate a target rendering map conforming to the resolution to be adjusted, and implement dynamic resolution adjustment by performing sampling and rendering again on the rendering texture, and a rendering graph with a new size does not need to be generated, so that a large amount of rendering resources are avoided being occupied, and the purpose of saving resources is achieved.
The foregoing description is only an overview of the technical solutions of the present application, and the present application can be implemented according to the content of the description in order to make the technical means of the present application more clearly understood, and the following detailed description of the present application is given in order to make the above and other objects, features, and advantages of the present application more clearly understandable.
Drawings
Various other advantages and benefits will become apparent to those of ordinary skill in the art upon reading the following detailed description of the preferred embodiments. The drawings are only for purposes of illustrating the preferred embodiments and are not to be construed as limiting the application. Also, like reference numerals are used to refer to like parts throughout the drawings. In the drawings:
fig. 1 is a flowchart illustrating a rendering method of dynamic resolution according to an embodiment of the present application;
fig. 2 is a flowchart illustrating a rendering method of dynamic resolution according to an embodiment of the present application;
fig. 3A is a schematic structural diagram illustrating a rendering apparatus with dynamic resolution according to an embodiment of the present application;
fig. 3B is a schematic structural diagram illustrating a rendering apparatus with dynamic resolution according to an embodiment of the present application;
fig. 3C is a schematic structural diagram illustrating a rendering apparatus with dynamic resolution according to an embodiment of the present application;
fig. 4 shows a schematic device structure diagram of an electronic device according to an embodiment of the present application.
Detailed Description
Exemplary embodiments of the present application will be described in more detail below with reference to the accompanying drawings. While exemplary embodiments of the present application are shown in the drawings, it should be understood that the present application may be embodied in various forms and should not be limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the disclosure to those skilled in the art.
An embodiment of the present application provides a rendering method of a dynamic resolution, as shown in fig. 1, the method includes:
101. and responding to a resolution adjustment instruction, and generating a target scaling ratio and a resolution to be adjusted according to the time information of the current frame and the historical frame of the animation scene.
102. And adjusting the rendered texture according to the resolution to be adjusted, and adjusting the size of a camera viewport of a scene camera of the animation scene according to the target zoom ratio.
103. And rendering the animation scene by using the adjusted camera viewport and the adjusted rendering texture to obtain a first rendering image.
104. And performing zoom sampling on the adjusted rendering texture to render the rendering texture back to the color buffer area, and rendering the color buffer area by using an interface camera of the animation scene to obtain a second rendering image.
105. And overlapping the second rendering map to the first rendering map to generate a target rendering map which accords with the resolution to be adjusted.
The method provided by the embodiment of the application determines a target zoom ratio and a resolution to be adjusted according to time information of a current frame and a historical frame of an animation scene in a game, adjusts a rendering texture according to the resolution to be adjusted, adjusts the size of a camera view port of a scene camera of the animation scene according to the target zoom ratio, renders the animation scene by using the adjusted camera view port and the adjusted rendering texture to obtain a first rendering map, performs zoom sampling on the adjusted rendering texture to render back to a color buffer area, renders the color buffer area by using an interface camera of the animation scene to obtain a second rendering map, further superimposes the second rendering map on the first rendering map to generate a target rendering map which accords with the resolution to be adjusted, realizes dynamic resolution adjustment by performing sampling and rendering on the rendering texture again without generating a rendering map with a new size, and a large amount of rendering resources are avoided being occupied, and the purpose of saving resources is achieved.
An embodiment of the present application provides a rendering method of a dynamic resolution, as shown in fig. 2, the method includes:
201. and responding to a resolution adjustment instruction, and generating a target scaling ratio and a resolution to be adjusted according to the time information of the current frame and the historical frame of the animation scene.
In recent years, computer technology has been developed, and game development platforms have been developed for the convenience of developers to develop games. The game development platform is a platform for creating and operating real-time 3D (three-dimensional) interactive content, such as a Unity platform. The game development platform provides a complete set of perfect software solutions, can be used for creating, operating and rendering any real-time interactive 2D (2 Dimensions) and 3D content, and the support platforms comprise mobile phones, tablet computers, PCs (Personal computers), game hosts, augmented reality and virtual reality equipment and the like. A game development platform is provided with a corresponding Interface for setting game resolution, but the Interface can cause the change of the whole game resolution, so that the resolution of a User Interface (UI) is reduced, and characters and 2D pictures in a game are blurred and cannot be directly viewed. Therefore, in the process of game development and operation, new scene rendering graphs with different sizes need to be continuously generated according to the frame rate for front-end display, so that the adjustment of the resolution is realized.
However, the applicant recognizes that continuously generating new scene rendering maps during the process of adjusting the resolution occupies a large amount of rendering resources, and the rendering cost is high, which not only wastes resources, but also may affect the performance of the game. Therefore, the application provides a rendering method of dynamic resolution, determining a target zoom ratio and a resolution to be adjusted according to time information of a current frame and a historical frame of an animation scene in a game, adjusting a rendering texture according to the resolution to be adjusted, adjusting the size of a camera view port of a scene camera of the animation scene according to the target zoom ratio, rendering the animation scene by using the adjusted camera view port and the adjusted rendering texture to obtain a first rendering image, performing zoom sampling on the adjusted rendering texture to render back to a color buffer area, rendering the color buffer area by using an interface camera of the animation scene to obtain a second rendering image, further overlaying the second rendering image to the first rendering image to generate a target rendering image which meets the resolution to be adjusted, and realizing dynamic resolution adjustment by performing sampling and rendering on the rendering texture again, and a rendering graph with a new size does not need to be generated, so that a large amount of rendering resources are avoided being occupied, and the purpose of saving resources is achieved.
In the process of practical application, the game development platform is divided into two versions, one is a C # (C sharp, an object-oriented programming language) version, and the other is a C + + (a computer programming language) version. Version C is a solution implemented in the form of a component, namely, a dynamic resolution layer is mounted on the scene camera and the interface camera. However, this component mounting method is not suitable for the C + + version, so in order to ensure that the resolution is successfully dynamically adjusted in the C + + version, initialization and setting of the original rendering map are required. Specifically, when initialization is performed, a preset number of class attributes need to be determined, and the preset number of class attributes are added to the quality setting class. The preset number of class attributes are a maximum zoom value, a minimum zoom value and a preset expected frame rate, the initialization is that the engine layer of the game development platform expands three class attributes, namely, maxResolution (maximum zoom value), minResolution (minimum zoom value) and dynamicresolution targetframe (preset expected frame rate) in a QualitySettings class, and the C # layer calls the assignment of the three class attributes before the Enable (operable). In addition, in the initialization process, a scene camera which needs to perform dynamic resolution needs to be set and started on the C # layer, and generally, the interface camera is not turned on by default. After the initialization is finished, the scene camera is called, a default rendering texture is set for the scene camera, namely a built-in rendering texture is set for the scene camera, and the subsequent application of the default rendering texture is ensured.
It should be noted that, for one animation scene, a plurality of main cameras may be provided, and therefore, when a scene camera is called, a camera list is formed based on the plurality of main cameras, and the camera list is all used as the called scene camera, so that the scene camera is one or more than one main camera in the animation scene, and the purpose of supporting a plurality of 3D cameras is achieved.
Optionally, the rendering operation of the dynamic resolution in the embodiment of the present application may be triggered periodically or manually. Specifically, an adjustment period of the resolution may be set, for example, 0.5 second, and then the current time point is continuously detected, and when the current time point meets the adjustment period, it is determined that the resolution adjustment instruction is received, and the rendering of the dynamic resolution is started. Alternatively, when it is detected that the resolution adjustment entry is triggered, it may be determined that a resolution adjustment instruction is received, and the rendering of the dynamic resolution may be started. The present application does not specifically limit the manner in which the rendering of the dynamic resolution is triggered.
And responding to a resolution adjustment instruction, starting to generate a target scaling ratio and a resolution to be adjusted according to the time information of the current frame and the historical frame of the animation scene, and rendering the dynamic resolution according to the target scaling ratio and the resolution to be adjusted in the subsequent process. When the target scaling ratio is generated, it is necessary to first read the current frame time consumption (i.e., time. deltatime assignment) of the current frame of the animation scene, query the time information of the historical frame, and perform average calculation on the time information of the historical frame to obtain the average time consumption of the historical frame. Then, determining a preset expected frame rate, calculating a first ratio of the current frame time consumption to the average time consumption, and a second ratio of the first ratio to the preset expected frame rate, and taking the second ratio as a target scaling ratio. And after the target scaling ratio is generated, reading the current resolution of the current frame, calculating a first product of the current resolution and the target scaling ratio, and taking the first product as the resolution to be adjusted.
It should be noted that, if the process is performed based on the C + + version, a Statistics method may be registered in the initialization, and the Statistics method is called every frame, so that the calculation of the target scaling ratio and the resolution to be adjusted is completed every 0.5 seconds, so as to ensure the continuous update of the target scaling ratio.
202. And adjusting the rendered texture according to the resolution to be adjusted, and adjusting the size of a camera viewport of a scene camera of the animation scene according to the target zoom ratio.
In the embodiment of the application, after the target zoom ratio and the resolution to be adjusted are determined, rendering of the resolution is started again, rendering textures are adjusted according to the resolution to be adjusted, the size of a camera viewport of a scene camera of an animation scene is adjusted according to the target zoom ratio, and therefore the animation scene is rendered subsequently according to the adjusted camera viewport and the adjusted rendering textures. Since the game development platform is divided into two versions, different versions actually need to adjust the size of the camera view port in different ways.
For the C + + version, because the animation scene of the C + + version has the function of setting the scene camera, the scene camera mounted in the animation scene can be directly determined, the texture size of the rendered texture is obtained, the second product of the texture size and the target scaling ratio is calculated, and the length and the width of the camera viewport of the scene camera are adjusted according to the second product.
And aiming at the C # version, because a scene camera needs to be called for the animation scene of the C # version, the called scene camera is determined in the animation scene, the texture size of the rendered texture is obtained, a second product of the texture size and the target scaling ratio is calculated, and the length and the width of a camera viewport of the scene camera are adjusted according to the second product.
203. And rendering the animation scene by using the adjusted camera viewport and the adjusted rendering texture to obtain a first rendering image.
In the embodiment of the present application, in order to ensure that an interface rendering operation can have a rendering basis in the subsequent interface rendering process, after the camera viewport and the rendering texture are adjusted, the adjusted camera viewport and the adjusted rendering texture are required to be used for rendering an animation scene, so as to obtain a first rendering map, so that the size of the first rendering map not only meets a target zoom ratio, but also includes all contents in the animation scene.
204. And performing scaling sampling on the adjusted rendering texture to render the rendering texture back to the color buffer area, and rendering the color buffer area by using an interface camera of the animation scene to obtain a second rendering image.
In the embodiment of the application, after the first rendering is generated, considering that interface contents capable of interacting with a player, such as keys and a map, need to be displayed on a rendering provided for the player in a game, therefore, it is necessary to perform scaling sampling on an adjusted rendering texture and render the rendering texture back to a color buffer area, and an interface camera of an animation scene is used to render the color buffer area to obtain a second rendering, thereby ensuring that the rendering conforms to an actual game scene while realizing dynamic resolution rendering.
When the second rendering is generated, firstly, since the screen of the terminal device carried by the front end has a certain size, and the interface camera in the version such as C + + does not have the function of automatically adjusting and controlling the size, the currently obtained rendering texture is reduced, and then the normal size is displayed on the terminal device, the adjusted rendering texture is stretched according to the target scaling ratio to obtain the rendering texture to be sampled, so that the target rendering with the size matched with the preset terminal display size is subsequently displayed for the player at the front end. And then sampling the rendering texture to be sampled, adding the sampled pixel points to a color buffer area, and performing interface rendering according to the data of the color buffer area by using an interface camera to obtain a second rendering image.
When the interface rendering is performed according to the data of the color buffer area, different modes can be adopted for different versions:
for the C + + version, when stretching the adjusted rendering texture, the C # layer may call a blittdynamicresolution interface to reduce the size of the adjusted rendering texture of the resolution to be adjusted and sample the rendering texture of the Blit back to the normal size. Then, when rendering is started, the resolution to be adjusted can be set in the interface camera, a render rectangle is obtained, the size of the render rectangle is adjusted to be a second product, and the render rectangle is used as an adjusted camera view port, so that the region with the resolution to be adjusted is rendered, and the purpose of saving rendering cost is achieved.
And for the C # version, firstly, sampling rendering textures to be sampled, and adding pixel points obtained through sampling to a color buffer area. And then, performing interface rendering according to the data of the color buffer area by using an interface camera to obtain a second rendering image. In practical application, during rendering, rendering can be performed once before opaque rendering, so that colors in a to-be-sampled rendering texture are scaled, sampled and rendered back to a color buffer, and then a Shader (Shader) of an interface camera is set, thereby realizing the rendering processing and re-rendering of an animation scene.
205. And overlapping the second rendering map to the first rendering map to generate a target rendering map which accords with the resolution to be adjusted.
In the embodiment of the application, after the first rendering map and the second rendering map are generated, since the first rendering map indicates content in an animation scene and the second rendering map indicates content on an interface, the second rendering map is superimposed on the first rendering map, so that a target rendering map conforming to the resolution to be adjusted can be generated.
It should be noted that, in order to ensure the accuracy of the overlay and avoid the overlay from deviating, the process of scaling and shifting the rendering map may be performed as follows: and determining a first axis of the first rendering map and a second axis of the second rendering map, and comparing the first axis with the second axis. And when the first axis and the second axis have deviation, carrying out scaling and position processing on the second rendering graph, and controlling the first axis to coincide with the second axis. In addition, for the GrabPass (a type having a content capture and write function) effect, when a camera view port is set in an Interface camera, when an API (Application Program Interface) such as DX (data register) and Vulkan (cross-platform drawing Application Program Interface) is used, the built-in variable UNITY _ UV _ STARTS _ AT _ TOP has a problem that the captured texture is not located AT the same position on the scene model, and therefore, it is necessary to change RenderRectangle to the middle of the y-axis of the screen for compatibility. Furthermore, for some visual artifacts additionally set in the animation scene, the problem of incorrect UV coordinates also exists, and the UV needs to be adjusted in combination with a FrameDebugger.
In practical applications, if an animation scene is associated with a high dynamic range rendering effect, for example, a Bloom function is turned on, it is necessary to delete a rendering texture in a target rendering map that is rendered for the animation scene in each frame. For example, if the scene camera turns on bloom (special effect), the rendering graph needs to be cleaned every frame, and the color convolution of the HDR Texture is prevented from being displayed in the interface displayed at the front end. In addition, for the HDR function, if the HDR is turned on for the animation scene, the format of the rendering texture needs to be adjusted to a format matching the HDR function, so as to ensure compatibility of the format.
In summary, the present application provides different technical solutions for different versions:
for version C, the method is implemented in a component named as a dynamic resolution layer, and is hung on a scene camera and an interface camera. The interface camera obtains rendering textures rendered by the scene camera, sets the rendering textures as main textures, sets the resolution to be adjusted, and zooms and samples pixels in the rendering textures back to the color buffer area to achieve dynamic resolution rendering of the components under the 3D camera.
And aiming at the C + + version, setting a maximum zoom value, a minimum zoom value and a preset expected frame rate by a C # logic layer, calculating by an engine of a game platform according to the values to obtain a resolution to be adjusted under a current frame, setting a scene camera as an offset green (camera view port), adjusting the size of the camera view port according to the resolution to be adjusted to save the overhead during rendering, calling a BlitDynamicResolution interface before post-processing, and returning a target rendering image with the size meeting the preset terminal display size by the interface for display.
The method provided by the embodiment of the application determines a target zoom ratio and a resolution to be adjusted according to time information of a current frame and a historical frame of an animation scene in a game, adjusts a rendering texture according to the resolution to be adjusted, adjusts the size of a camera view port of a scene camera of the animation scene according to the target zoom ratio, renders the animation scene by using the adjusted camera view port and the adjusted rendering texture to obtain a first rendering map, performs zoom sampling on the adjusted rendering texture to render back to a color buffer area, renders the color buffer area by using an interface camera of the animation scene to obtain a second rendering map, further superimposes the second rendering map on the first rendering map to generate a target rendering map which accords with the resolution to be adjusted, realizes dynamic resolution adjustment by performing sampling and rendering on the rendering texture again without generating a rendering map with a new size, and a large amount of rendering resources are avoided being occupied, and the purpose of saving resources is achieved.
Further, as a specific implementation of the method shown in fig. 1, an embodiment of the present application provides a rendering apparatus with dynamic resolution, and as shown in fig. 3A, the apparatus includes: a generation module 301, an adjustment module 302, a first rendering module 303, a second rendering module 304 and a superposition module 305.
The generating module 301 is configured to generate a target scaling ratio and a resolution to be adjusted according to time information of a current frame and a historical frame of an animation scene in response to a resolution adjustment instruction;
the adjusting module 302 is configured to adjust the rendered texture according to the resolution to be adjusted, and adjust a size of a camera viewport of a scene camera of the animation scene according to the target zoom ratio;
the first rendering module 303 is configured to render the animation scene by using the adjusted camera viewport and the adjusted rendering texture, so as to obtain a first rendering map;
the second rendering module 304 is configured to perform scaling sampling on the adjusted rendering texture and render the adjusted rendering texture back to a color buffer, and render the color buffer by using an interface camera of the animation scene to obtain a second rendering map;
the superimposing module 305 is configured to superimpose the second rendering map onto the first rendering map, so as to generate a target rendering map that meets the resolution to be adjusted.
In a specific application scenario, as shown in fig. 3B, the apparatus further includes: a detection module 306.
The detecting module 306 is configured to detect a current time point, and determine that the resolution adjustment instruction is received when the current time point matches an adjustment period; or, when the resolution adjustment entrance is triggered, determining that the resolution adjustment instruction is received.
In a specific application scenario, the generating module 301 is configured to read a current frame time of a current frame of the animation scenario; inquiring the time information of the historical frame, and carrying out average value calculation on the time information of the historical frame to obtain the average consumed time of the historical frame; determining a preset expected frame rate, calculating a first ratio of the current frame time consumption to the average time consumption, and a second ratio of the first ratio to the preset expected frame rate, and taking the second ratio as the target scaling ratio; reading the current resolution of the current frame, calculating a first product of the current resolution and the target scaling ratio, and taking the first product as the resolution to be adjusted.
In a specific application scenario, the adjusting module 302 is configured to determine the scene camera mounted in the animation scene; obtaining a texture size of the rendered texture, calculating a second product of the texture size and the target scaling ratio; adjusting a length and a width of a camera viewport of the scene camera according to the second product.
In a specific application scenario, the second rendering module 304 is configured to stretch the adjusted rendering texture according to the target scaling ratio to obtain a rendering texture to be sampled; sampling the rendered texture to be sampled, and adding pixel points obtained by sampling to the color buffer area; and performing interface rendering according to the data of the color buffer area by using the interface camera to obtain the second rendering image.
In a specific application scenario, the second rendering module 304 is further configured to determine a first axis of the first rendering map and a second axis of the second rendering map, and compare the first axis with the second axis; when the first axis and the second axis have deviation, the second rendering graph is zoomed and processed in position, and the first axis and the second axis are controlled to coincide.
In a specific application scene, as shown in fig. 3C, the deleting module 307 is configured to delete the rendering texture in the target rendering map rendered for the animation scene in each frame if the animation scene is associated with a high dynamic range rendering effect.
The device provided by the embodiment of the application determines a target zoom ratio and a resolution to be adjusted according to time information of a current frame and a historical frame of an animation scene in a game, adjusts a rendering texture according to the resolution to be adjusted, adjusts the size of a camera view port of a scene camera of the animation scene according to the target zoom ratio, renders the animation scene by using the adjusted camera view port and the adjusted rendering texture to obtain a first rendering map, performs zoom sampling on the adjusted rendering texture to render back to a color buffer area, renders the color buffer area by using an interface camera of the animation scene to obtain a second rendering map, further superimposes the second rendering map on the first rendering map to generate a target rendering map which accords with the resolution to be adjusted, realizes dynamic resolution adjustment by performing sampling and rendering on the rendering texture again without generating a rendering map with a new size, and a large amount of rendering resources are avoided being occupied, and the purpose of saving resources is achieved.
It should be noted that other corresponding descriptions of the functional units related to the rendering apparatus with dynamic resolution provided in the embodiment of the present application may refer to the corresponding descriptions in fig. 1 and fig. 2, and are not repeated herein.
In an exemplary embodiment, referring to fig. 4, there is further provided a device including a communication bus, a processor, a memory, and a communication interface, and further including an input/output interface and a display device, wherein the functional units may communicate with each other through the bus. The memory stores a computer program, and the processor is configured to execute the program stored in the memory and execute the rendering method of dynamic resolution in the above embodiment.
A computer-readable storage medium, on which a computer program is stored which, when being executed by a processor, carries out the steps of the method for rendering with dynamic resolution.
Through the above description of the embodiments, those skilled in the art will clearly understand that the present application can be implemented by hardware, and also by software plus a necessary general hardware platform. Based on such understanding, the technical solution of the present application may be embodied in the form of a software product, which may be stored in a non-volatile storage medium (which may be a CD-ROM, a usb disk, a removable hard disk, etc.), and includes several instructions for enabling a computer device (which may be a personal computer, a server, or a network device, etc.) to execute the method according to the implementation scenarios of the present application.
Those skilled in the art will appreciate that the figures are merely schematic representations of one preferred implementation scenario and that the blocks or flow diagrams in the figures are not necessarily required to practice the present application.
Those skilled in the art will appreciate that the modules in the devices in the implementation scenario may be distributed in the devices in the implementation scenario according to the description of the implementation scenario, or may be located in one or more devices different from the present implementation scenario with corresponding changes. The modules of the implementation scenario may be combined into one module, or may be further split into a plurality of sub-modules.
The above application serial numbers are for description purposes only and do not represent the superiority or inferiority of the implementation scenarios.
The above disclosure is only a few specific implementation scenarios of the present application, but the present application is not limited thereto, and any variations that can be made by those skilled in the art are intended to fall within the scope of the present application.
Claims (9)
1. A method for rendering at a dynamic resolution, comprising:
responding to a resolution adjustment instruction, and generating a target scaling ratio and a resolution to be adjusted according to the time information of a current frame and a historical frame of the animation scene;
adjusting the rendered texture according to the resolution to be adjusted, and adjusting the size of a camera viewport of a scene camera of the animation scene according to the target zoom ratio;
rendering the animation scene by using the adjusted camera viewport and the adjusted rendering texture to obtain a first rendering graph;
performing scaling sampling on the adjusted rendering texture to render the rendering texture back to a color buffer area, and rendering the color buffer area by using an interface camera of the animation scene to obtain a second rendering image;
superposing the second rendering map to the first rendering map to generate a target rendering map which accords with the resolution to be adjusted;
wherein said resizing a camera viewport of a scene camera of the animated scene at the target zoom ratio comprises: determining the scene camera mounted in the animation scene; obtaining a texture size of the rendered texture, calculating a second product of the texture size and the target scaling ratio; adjusting a length and a width of a camera viewport of the scene camera according to the second product.
2. The method of claim 1, wherein in response to the resolution adjustment instruction, before generating the target scaling ratio and the resolution to be adjusted according to the time information of the current frame and the historical frame of the animation scene, the method further comprises:
detecting a current time point, and determining to receive the resolution adjustment instruction when the current time point is in accordance with an adjustment period; or the like, or, alternatively,
and when detecting that a resolution adjustment entrance is triggered, determining that the resolution adjustment instruction is received.
3. The method of claim 1, wherein generating the target scaling ratio and the resolution to be adjusted according to the time information of the current frame and the historical frame of the animation scene comprises:
reading the current frame time consumption of the current frame of the animation scene;
inquiring the time information of the historical frame, and carrying out average value calculation on the time information of the historical frame to obtain the average consumed time of the historical frame;
determining a preset expected frame rate, calculating a first ratio of the current frame time consumption to the average time consumption, and a second ratio of the first ratio to the preset expected frame rate, and taking the second ratio as the target scaling ratio;
reading the current resolution of the current frame, calculating a first product of the current resolution and the target scaling ratio, and taking the first product as the resolution to be adjusted.
4. The method of claim 1, wherein the scaling sampling of the adjusted rendering texture is performed to render the adjusted rendering texture back to a color buffer, and an interface camera of the animation scene is used to render the color buffer to obtain a second rendering map, comprising:
stretching the adjusted rendering texture according to the target scaling ratio to obtain a rendering texture to be sampled;
sampling the rendered texture to be sampled, and adding pixel points obtained by sampling to the color buffer area;
and performing interface rendering according to the data of the color buffer area by using the interface camera to obtain the second rendering image.
5. The method of claim 1, further comprising:
determining a first axis of the first rendering map and a second axis of the second rendering map, and comparing the first axis with the second axis;
when the first axis and the second axis have deviation, the second rendering graph is zoomed and processed in position, and the first axis and the second axis are controlled to coincide.
6. The method of claim 1, further comprising:
and if the animation scene is associated with a high dynamic range rendering effect, deleting the rendering texture in each frame of the target rendering graph rendered for the animation scene.
7. A dynamic resolution rendering apparatus, comprising:
the generating module is used for responding to a resolution adjusting instruction and generating a target scaling ratio and a resolution to be adjusted according to the time information of the current frame and the historical frame of the animation scene;
an adjusting module, configured to adjust a rendering texture according to the resolution to be adjusted, and adjust a size of a camera viewport of a scene camera of the animation scene according to the target zoom ratio;
a first rendering module, configured to render the animation scene by using the adjusted camera viewport and the adjusted rendering texture, so as to obtain a first rendering map;
the second rendering module is used for performing scaling sampling on the adjusted rendering textures and rendering the rendering textures back to a color buffer area, and rendering the color buffer area by using an interface camera of the animation scene to obtain a second rendering image;
the superposition module is used for superposing the second rendering map to the first rendering map to generate a target rendering map which accords with the resolution to be adjusted;
the adjusting module is specifically configured to determine the scene camera mounted in the animation scene; obtaining a texture size of the rendered texture, calculating a second product of the texture size and the target scaling ratio; adjusting a length and a width of a camera viewport of the scene camera according to the second product.
8. An electronic device comprising a memory and a processor, the memory storing a computer program, wherein the processor implements the steps of the method of any one of claims 1 to 6 when executing the computer program.
9. A readable storage medium, on which a computer program is stored, which, when being executed by a processor, carries out the steps of the method of any one of claims 1 to 6.
Priority Applications (3)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110735362.5A CN113469883B (en) | 2021-06-30 | 2021-06-30 | Rendering method and device of dynamic resolution, electronic equipment and readable storage medium |
| CN202210403276.9A CN114913067A (en) | 2021-06-30 | 2021-06-30 | Rendering method and device for dynamic resolution, electronic equipment and readable storage medium |
| PCT/CN2021/132538 WO2023273114A1 (en) | 2021-06-30 | 2021-11-23 | Dynamic resolution rendering method and apparatus, device, program, and readable medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110735362.5A CN113469883B (en) | 2021-06-30 | 2021-06-30 | Rendering method and device of dynamic resolution, electronic equipment and readable storage medium |
Related Child Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210403276.9A Division CN114913067A (en) | 2021-06-30 | 2021-06-30 | Rendering method and device for dynamic resolution, electronic equipment and readable storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113469883A CN113469883A (en) | 2021-10-01 |
| CN113469883B true CN113469883B (en) | 2022-05-06 |
Family
ID=77874410
Family Applications (2)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210403276.9A Pending CN114913067A (en) | 2021-06-30 | 2021-06-30 | Rendering method and device for dynamic resolution, electronic equipment and readable storage medium |
| CN202110735362.5A Active CN113469883B (en) | 2021-06-30 | 2021-06-30 | Rendering method and device of dynamic resolution, electronic equipment and readable storage medium |
Family Applications Before (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210403276.9A Pending CN114913067A (en) | 2021-06-30 | 2021-06-30 | Rendering method and device for dynamic resolution, electronic equipment and readable storage medium |
Country Status (2)
| Country | Link |
|---|---|
| CN (2) | CN114913067A (en) |
| WO (1) | WO2023273114A1 (en) |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114913067A (en) * | 2021-06-30 | 2022-08-16 | 完美世界(北京)软件科技发展有限公司 | Rendering method and device for dynamic resolution, electronic equipment and readable storage medium |
| CN113963110B (en) * | 2021-10-11 | 2022-10-25 | 北京百度网讯科技有限公司 | Texture map generation method and device, electronic equipment and storage medium |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107742317A (en) * | 2017-09-27 | 2018-02-27 | 杭州群核信息技术有限公司 | A kind of acquisition methods for rendering image, device, rendering system and storage medium |
| CN110393921A (en) * | 2019-08-08 | 2019-11-01 | 腾讯科技（深圳）有限公司 | Processing method, device, terminal, server and the storage medium of cloud game |
Family Cites Families (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US10311548B2 (en) * | 2017-09-05 | 2019-06-04 | Microsoft Technology Licensing, Llc | Scaling render targets to a higher rendering resolution to display higher quality video frames |
| CN108063938A (en) * | 2017-12-21 | 2018-05-22 | 深圳市得色科技有限公司 | The bore hole 3D imaging display methods and its system of a kind of game engine |
| US10776907B2 (en) * | 2018-10-24 | 2020-09-15 | Adobe Inc. | Dynamic image resolution adjustment for rendering changes to graphical content |
| US10825200B2 (en) * | 2019-01-30 | 2020-11-03 | Trivver, Inc. | Texture based pixel count determination |
| CN111918125B (en) * | 2019-05-09 | 2023-03-24 | 腾讯科技（深圳）有限公司 | Video playing method, device and system |
| CN111309430B (en) * | 2020-03-16 | 2021-12-10 | 广东趣炫网络股份有限公司 | Method and related device for automatically caching user interaction interface nodes |
| CN112184877B (en) * | 2020-09-30 | 2024-02-23 | 杭州电魂网络科技股份有限公司 | Method and system for rendering optimization of glow effect |
| CN113041617B (en) * | 2021-03-18 | 2022-07-26 | 深圳市腾讯网域计算机网络有限公司 | Game picture rendering method, device, equipment and storage medium |
| CN114913067A (en) * | 2021-06-30 | 2022-08-16 | 完美世界(北京)软件科技发展有限公司 | Rendering method and device for dynamic resolution, electronic equipment and readable storage medium |
-
2021
- 2021-06-30 CN CN202210403276.9A patent/CN114913067A/en active Pending
- 2021-06-30 CN CN202110735362.5A patent/CN113469883B/en active Active
- 2021-11-23 WO PCT/CN2021/132538 patent/WO2023273114A1/en unknown
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107742317A (en) * | 2017-09-27 | 2018-02-27 | 杭州群核信息技术有限公司 | A kind of acquisition methods for rendering image, device, rendering system and storage medium |
| CN110393921A (en) * | 2019-08-08 | 2019-11-01 | 腾讯科技（深圳）有限公司 | Processing method, device, terminal, server and the storage medium of cloud game |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113469883A (en) | 2021-10-01 |
| WO2023273114A1 (en) | 2023-01-05 |
| CN114913067A (en) | 2022-08-16 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107888845B (en) | Video image processing method and device and terminal | |
| US10311548B2 (en) | Scaling render targets to a higher rendering resolution to display higher quality video frames | |
| CN113469883B (en) | Rendering method and device of dynamic resolution, electronic equipment and readable storage medium | |
| AU2014402162B2 (en) | Method and apparatus for setting background of UI control, and terminal | |
| CN112652046B (en) | Game picture generation method, device, equipment and storage medium | |
| CN105389090B (en) | Method and device, mobile terminal and the computer terminal of game interaction interface display | |
| CN110968962B (en) | Three-dimensional display method and system based on cloud rendering at mobile terminal or large screen | |
| CN113225606B (en) | Video barrage processing method and device | |
| TW202016876A (en) | Method, apparatus and electronic device for image processing and storage medium thereof | |
| JP2010514011A (en) | Post-render graphics rotation | |
| CN107564085B (en) | Image warping processing method and device, computing equipment and computer storage medium | |
| CN108364324B (en) | Image data processing method and device and electronic terminal | |
| CN111939567A (en) | Game virtual scene transformation method and device and electronic terminal | |
| US20180253886A1 (en) | Texturing of a three-dimensional (3d) model by uv map in-painting | |
| CN107644451B (en) | Animation display method and device | |
| CN112070854A (en) | Image generation method, device, equipment and storage medium | |
| CN109658495B (en) | Rendering method and device for ambient light shielding effect and electronic equipment | |
| CN114428573B (en) | Special effect image processing method and device, electronic equipment and storage medium | |
| CN113393391B (en) | Image enhancement method, image enhancement device, electronic apparatus, and storage medium | |
| CN113256785B (en) | Image processing method, apparatus, device and medium | |
| CN112634444B (en) | Human body posture migration method and device based on three-dimensional information, storage medium and terminal | |
| CN115578540A (en) | Method, apparatus, device and storage medium for augmented reality | |
| CN114693894A (en) | Method, system and device for converting pictures into building blocks in virtual world | |
| CN114742970A (en) | Processing method of virtual three-dimensional model, nonvolatile storage medium and electronic device | |
| CN110874816B (en) | Image processing method, device, mobile terminal and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |