WO2023142434A1

WO2023142434A1 - Rendering engine testing method and apparatus, device, system, storage medium, computer program and computer program product

Info

Publication number: WO2023142434A1
Application number: PCT/CN2022/112298
Authority: WO
Inventors: 李春艳
Original assignee: 深圳市慧鲤科技有限公司
Priority date: 2022-01-27
Filing date: 2022-08-12
Publication date: 2023-08-03
Also published as: CN114445545A

Abstract

The present application provides a rendering engine testing method and apparatus, a device, a system, a storage medium, a computer program and a computer program product. The method comprises: obtaining a rendering performance parameter of a rendering engine, wherein the rendering performance parameter is obtained by using a testing device to operate the rendering engine to render a testing resource; and performing preset processing on the basis of the rendering performance parameter, wherein the preset processing is used for reflecting the performance of the rendering engine. According to the solution, the rendering engine is rendered to obtain the rendering performance parameter for processing, such that the rendering engine is tested, subjective feeling does not need to be carried out in the use process of the rendering engine, the performance of the rendering engine can be objectively reflected, and the performance evaluation of the rendering engine is more accurate.

Description

Rendering engine testing method and device, device, system, storage medium, computer program, computer program product

Cross References to Related Applications

This disclosure is based on the Chinese patent application with the application number 202210103074.2, the application date is January 27, 2022, and the application name is "a rendering engine testing method, device, equipment, system and medium", and requires the Chinese patent application The entire content of this Chinese patent application is hereby incorporated into this disclosure as a reference.

technical field

The present disclosure relates to the field of computer technology, in particular to a rendering engine testing method, device, system, storage medium, computer program, and computer program product.

Background technique

Augmented reality (Augmented Reality, AR) technology is a technology that integrates virtual information with the real world. It simulates virtual information such as text, images, spatial feature point models, music, and videos generated by computers and simulates them on user equipment. Displaying virtual information and real-time images of the real world, the two kinds of information complement each other to achieve "augmentation" of the real world.

In the application of visual display such as augmented reality, visual information such as images realized by rendering engine is displayed. Generally speaking, the rendering engine is integrated in the visual display application program, and the tester uses the visual display application program to observe the displayed virtual objects. , to judge the performance of the rendering engine based on subjective feelings.

Contents of the invention

The present disclosure at least provides a rendering engine testing method, device, device, system, storage medium, computer program, and computer program product.

An embodiment of the present disclosure provides a method for testing a rendering engine. The method includes: acquiring rendering performance parameters of the rendering engine, wherein the rendering performance parameters are obtained by using a test device to run the rendering engine to render test resources; Preset processing, wherein the preset processing is used to reflect the performance of the rendering engine.

An embodiment of the present disclosure provides a testing device for a rendering engine, including an acquisition module and a processing module. The acquisition module is configured to acquire the rendering performance parameters of the rendering engine, wherein the rendering performance parameters are obtained by using a test device to run the rendering engine to render test resources. The processing module is configured to perform preset processing based on the rendering performance parameter, wherein the preset processing is used to reflect the performance of the rendering engine.

An embodiment of the present disclosure provides a processing device, which includes a processor and a memory, where the memory is used to store program data, and the processor is used to execute the program data to implement any of the above methods.

An embodiment of the present disclosure provides a rendering engine testing system. The testing system includes a processing device and a testing device, wherein the testing device is used to run the rendering engine to render test resources to obtain rendering performance parameters, and the processing device is used to execute any of the above methods. .

An embodiment of the present disclosure provides a computer-readable storage medium. The computer-readable storage medium is used to store program data, and the program data can be executed to implement any of the above methods.

An embodiment of the present disclosure provides a computer program, the computer program includes computer readable code, and when the computer readable code is read and executed by a computer, a part or part of the method in any embodiment of the present disclosure is realized. All steps.

An embodiment of the present disclosure provides a computer program product, the computer program product includes a non-transitory computer-readable storage medium storing a computer program, and when the computer program is read and executed by a computer, any embodiment of the present disclosure is realized Some or all of the steps in the method.

In the above solution, the rendering performance parameters are obtained and processed by rendering the rendering engine, so as to realize the testing of the rendering engine. There is no need to feel subjectively during the use of the rendering engine, and it can objectively reflect the performance of the rendering engine. The performance evaluation of the engine is more accurate.

It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the disclosure. Other features and aspects of the present disclosure will become apparent from the following detailed description of exemplary embodiments with reference to the accompanying drawings.

Description of drawings

The accompanying drawings here are incorporated into the description and constitute a part of the present description. These drawings show embodiments consistent with the present disclosure, and are used together with the description to describe the technical solution of the present disclosure.

FIG. 1 is a first schematic flow diagram of a rendering engine testing method provided by an embodiment of the present disclosure;

FIG. 2 is a second schematic flow diagram of a rendering engine testing method provided by an embodiment of the present disclosure;

FIG. 3 is a third schematic flowchart of a rendering engine testing method provided by an embodiment of the present disclosure;

FIG. 4 is a schematic diagram of a preset evaluation strategy in a rendering engine testing method provided by an embodiment of the present disclosure;

FIG. 5 is a schematic diagram of recording test item scoring provided by an embodiment of the present disclosure;

FIG. 6 is a fourth schematic flowchart of a rendering engine testing method provided by an embodiment of the present disclosure;

FIG. 7 is a schematic framework diagram of a rendering engine testing device provided by an embodiment of the present disclosure;

FIG. 8 is a schematic framework diagram of a rendering engine testing system provided by an embodiment of the present disclosure;

FIG. 9 is a schematic framework diagram of a processing device provided by an embodiment of the present disclosure;

Fig. 10 is a schematic framework diagram of a computer-readable storage medium provided by an embodiment of the present disclosure.

Detailed ways

In order to make the purpose, technical solutions and effects of the present disclosure more clear and definite, the present disclosure will be further described in detail below with reference to the accompanying drawings and examples.

It can be understood that the disclosed method may include the methods provided by any one of the following method embodiments and any non-conflicting combination of the following method embodiments.

It can be understood that the rendering engine testing method in the present disclosure may be executed by a processing device, and the processing device may be any electronic device with processing capabilities, such as a mobile phone, a tablet computer, a computer, and the like. In the process of testing the rendering engine, the test device can run the rendering engine to render the test resources, and the test device can also be any device capable of running the rendering engine, and then the processing device executes the rendering engine test method of the present disclosure. step. The testing equipment can be the same equipment as the processing equipment, or it can be different.

Fig. 1 shows a schematic flowchart of a rendering engine testing method provided by an embodiment of the present disclosure. The method includes:

Step S110: Obtain the rendering performance parameters of the rendering engine.

It should be noted that the rendering engine in the present disclosure can be integrated into an application program, and the existing rendering engine is usually tested by integrating it into an application program and subjectively evaluating the rendering result by a tester. The test device in the embodiments of the present disclosure can run the rendering engine alone to render resources, so as to test the rendering engine alone, and can also test the application integrated with the rendering engine. Wherein, the rendering performance parameter is obtained by using the test device to run the rendering engine to render the test resource, and the rendering performance parameter can be used to evaluate the performance of the rendering engine. The test equipment may be the same equipment as the execution equipment of the test method, or different equipment from the execution equipment of the test method. After the test device runs the rendering engine to render the test resources, the rendering result will be displayed for the user to view. The user here can be but not limited to a tester. The rendering performance parameters can reflect the performance of the rendering engine through at least one of the following: Rendering result, rendering process. For example, the rendering performance parameters may include at least one of the time-consuming to obtain test resources, the time-consuming to render, the memory usage of the rendering process, the network resources consumed by obtaining test resources, and the maximum number of rendering resources, which may be used to reflect the rendering process. The performance parameter can also score the rendering effect, which can be used to reflect the rendering effect.

In the embodiments of the present disclosure, there may be multiple ways to generate the rendering performance parameters, and there may be multiple ways to obtain the rendering performance parameters accordingly. For example, the rendering performance parameter may be obtained by the test device running the test tool, based on the process of rendering the test resource by the rendering engine, or it may be obtained after the test device renders the test resource by the rendering engine, the test device or The processing device obtains the content input by the user.

Step S120: Perform preset processing based on rendering performance parameters.

Wherein, the rendering performance parameter can be used to reflect the performance of the rendering engine, and the preset processing of the rendering performance parameter can reflect the performance of the rendering engine. Wherein, the preset processing may be at least one of displaying the rendering performance parameters and performing performance analysis on the rendering performance parameters.

In addition, this disclosure decouples the rendering engine from other modules of the application. Compared with using the integrated application to test the performance of the rendering engine in the application, only testing the rendering engine can reduce the number of other modules of the application. The impact on rendering can accurately determine the performance of the rendering engine itself, and help to locate and analyze the problems obtained in the test; in addition, by executing the test method of the rendering engine before the rendering engine is integrated in the application, the performance of the rendering engine can be reduced. Low probability of the rendering engine being integrated into the application, thereby reducing the impact of poor performance of the rendering engine on the application.

FIG. 2 shows a second schematic flowchart of a rendering engine testing method provided by an embodiment of the present disclosure.

In some embodiments, in this embodiment, the rendering engine can be used to be integrated in an enhanced display application as an example for illustration. The resource refers to the object rendered by the rendering engine, which may be some Virtual objects can be divided into dynamic models and static models; among them, the dynamic model refers to the model that can interact with the user, and the interaction with the user means that the device can respond to the user's operation on the dynamic model and display the corresponding information of the dynamic model. dynamic actions; static models refer to models that cannot interact with users, both dynamic models and static models can change with the environment, for example, a flower cannot interact with users, but it can change with the wind And jiggle. In addition, different resources require different rendering capabilities, and the rendering performance parameters obtained by rendering different resources with the same rendering engine may also be different. In order to conduct a comprehensive test on the rendering engine, you can preset different rendering capabilities according to the required Multiple different difficulty levels, each difficulty level can include multiple test resources. It can be understood that in the present disclosure, different difficulty levels can be set for the dynamic model and the static model, and only the dynamic model of the difficulty level or the static model of the difficulty level can be included in the same level, or all models can be combined Set the difficulty level so that both dynamic and static models may be included in the same level. For example, three difficulty levels are set for the dynamic model and the static model respectively. For the model, the difficulty level can be reflected in the number of patches and the number of rendering batches. Different difficulty levels correspond to dynamic models with different numbers of patches and different batches of rendering. and static models, six levels of test resources can be obtained.

The work of the rendering engine is affected by the device. Because the performance of different devices is different, even if the same rendering engine is used to render the same resource, the rendering process and rendering results on different devices may be different. In order to conduct a comprehensive test on the rendering engine, multiple terminal devices may be pre-selected in the present disclosure as test devices, and each test device renders all test resources separately in sequence, and the test engine only renders one test resource at the same time.

In an application scenario, the terminal device is a mobile phone, and the mobile phone category can be divided according to the two dimensions of high performance, medium performance, and low performance, and the operating system. For each category, at least one device of this category is selected as a test equipment, which means that the test equipment can cover all pre-defined mobile phone categories. For example, a total of 3 mobile phones with high, medium and low performance running on the Apple system are selected, and a total of 3 mobile phones with high, medium and low performance running on the Android system are respectively selected, and a total of 6 terminal devices are used as test equipment, and the test The devices cover all pre-designated mobile phone categories, and the terminal device selected during the actual test can be any device capable of running the rendering engine, not limited to the mobile phone in this example. In addition, the category division and the number of test equipment are only examples, and the user may perform category division and test equipment selection according to actual needs. Through the control of the above variables, it is possible to test the rendering performance parameters that the rendering engine can obtain on mobile phones with different performances, and to obtain the rendering performance parameters of the rendering engine on mobile phones running different systems, so that the performance of the rendering engine can be evaluated. Make a more comprehensive judgment.

Generally speaking, after the device obtains the resources and meets the preset conditions, it can use the rendering engine to render the resources. The preset conditions here can be the triggering conditions for rendering. It is divided into four steps: decompression, parsing, construction and drawing. In some embodiments, in order to test the extreme performance of the rendering engine, in the process of testing the rendering engine, in addition to using the rendering engine to render each test resource, the test device can also perform a stress test on the rendering engine , so as to determine the maximum number of resources that can be rendered at the same time under the premise of taking into account the rendering effect.

In addition, in order to compare the performance of different rendering engines, you can also choose different rendering engines, run all rendering engines one by one on each test device, use each rendering engine to render all test resources in turn, and get each Rendering performance parameters of a rendering engine.

In an application scenario, the test equipment can obtain static models and skeletal animation models in a standard format, use the estimated illuminance value and color value of the illumination corresponding to the current test environment as the ambient illuminance and ambient light color, and use the rendering engine to render the test resources In addition, the rendering performance parameters of the test engine, such as rendering resolution and running frame rate, can be obtained through common frame capture tools such as Arm or Qualcomm, etc. The rendering performance parameters can be used to reflect the loading of static models and dynamic models , animation update and rendering result.

As shown in Figure 2, the test methods include:

Step S210: Obtain the rendering performance parameters of the rendering engine.

In the embodiments of the present disclosure, the rendering performance parameters include at least one of time-consuming to acquire test resources, time-consuming to render, memory usage of the rendering process, network resources consumed by acquiring test resources, and the maximum number of rendering resources.

In some embodiments, the test resource can be preset in the test device, so that the test device obtains the test resource, and there is no need to take the time spent in obtaining the test resource and the network resources consumed in obtaining the test resource as rendering performance parameters. In some embodiments, the test device needs to download test resources through the network. The downloading process is also the process of obtaining test resources, and the time spent on obtaining test resources and the network resources consumed by obtaining test resources can be obtained. These two can be used as rendering performance parameters. .

The above rendering performance parameters are generated by the test device during the rendering process. In some embodiments, in addition to the rendering engine, the test device can also run a test tool, which can be used to determine when the rendering engine performs rendering. For rendering performance parameters, the above-mentioned testing tool may be the aforementioned frame-cutting tool. In an application scenario, the test device downloads test resources through the network, and the rendering performance parameters include the time-consuming to obtain test resources, the time-consuming to render, the memory usage of the rendering process, the network resources consumed by obtaining test resources, and the maximum number of rendering resources. Among them, The network resources consumed by obtaining test resources can be the traffic consumed during downloading, the time spent obtaining test resources can be the download time, and the rendering time can be divided into decompression time-consuming, parsing time-consuming, construction time-consuming and drawing time-consuming according to the rendering process When , the maximum number of rendering resources is the number of test resources that the rendering engine can process in parallel. In the embodiment of the present disclosure, the maximum number of rendering resources is obtained in the process of testing the extreme performance of the rendering engine, and the maximum number of rendering resources refers to the fact that the rendering engine can process in parallel while taking into account the basic rendering effect The maximum number of test resources. For example, the test device may use a rendering engine to render a certain test resource, and the rendering engine may render multiple resources at the same time, and the multiple resources may be the same resource or different resources. Due to the limited rendering capability of the rendering engine, when the number of parallel processing resources increases, the rendering engine will compress the model after the drawing step, so that the rendering effect of each model will be affected to a certain extent. When the number of parallel rendering resources When the number increases, the rendering effect of each resource will gradually decrease, and the number of resources processed in parallel by the rendering engine will be gradually increased until the situation of freezing occurs; the number of resources that can be processed in parallel in the critical situation that does not cause freezing in this disclosure can be It is considered to be the maximum number of rendering resources. Generally speaking, compressing the model to 30fps (Frames Per Second, the number of frames transmitted per second) is a critical condition that can take into account the basic rendering effect. If it is lower than 30fps, obvious freezes may occur. In the test, in order to stress test the test engine, the test equipment can gradually increase the number of test resources that can be rendered in parallel, and obtain the maximum number of test resources that can be processed in parallel when the rendering effect does not cause lag. That is, the maximum number of rendering resources.

The disclosed processing device obtains the rendering performance parameters of the rendering engine to obtain several sets of rendering performance parameters. Each set of rendering performance parameters is obtained by using a test device to run a rendering engine to render a test resource. Each set of rendering performance parameters may include the above Obtaining at least one of the time consumption of test resources, the time consumption of rendering, the memory usage of the rendering process, the acquisition of network resources consumed by the test resources, and the maximum number of rendering resources.

It should be noted that by using the rendering engine, test equipment, and test resources as variables, each rendering engine is run sequentially on each test equipment, and multiple sets of rendering performance parameters obtained by using each rendering engine to sequentially render all test resources ; Wherein, the number of multiple sets of rendering performance parameters is the product of the number of test devices, the number of rendering engines and the number of test resources. The content included in the multiple sets of rendering performance parameters may be corresponding, so that the rendering performance parameters can be compared, for example, all include rendering time consumption and memory usage of the rendering process.

For step S210, reference may also be made to the relevant description of the foregoing step S110, and the foregoing step S120 may be implemented through steps S220 to S240.

Step S220: Select at least one set of rendering performance parameters as target performance parameters.

In the embodiment of the present disclosure, the device may select a target performance parameter from multiple sets of rendering performance parameters according to a certain policy.

In some embodiments, in response to the user's selection operation on at least one of the test device, the rendering engine, and the test resource category, the rendering performance parameter related to the user's selection is used as the target performance parameter. For example, rendering engines include A and B, and the user selects rendering engine B, then all rendering performance parameters related to rendering engine B are taken as a set of target performance parameters. Wherein, each test resource can be used as a test resource category, or each level of test resources can be used as a test resource category.

In the present disclosure, through one selection, several sets of rendering performance parameters can be obtained as a set of target performance parameters. In some embodiments, multiple selections can also be performed to obtain multiple sets of target performance parameters.

Step S230: Perform comparative analysis on each group of target performance parameters, and obtain performance analysis results of the rendering engine corresponding to the target performance parameters.

In the embodiment of the present disclosure, the comparative analysis in step S230 may be the comparative analysis within the same group of target performance parameters, or the comparative analysis between different groups of target performance parameters.

For a set of target performance parameters, one of its test device, rendering engine and test resource class may be the same. Then, the comparative analysis of a group of target performance parameters can start from the two variables with different rendering performance parameters in the group, or directly compare and analyze, or compare and analyze the rendering performance parameters after statistics . Still taking the above-mentioned user selection as rendering engine B as an example, this group of target performance parameters includes a total of 6 groups obtained by using rendering engine B to render test resources a, b, and c on test equipment 1 and test equipment 2 respectively. Rendering performance parameters. If all the rendering performance parameters corresponding to the same type of test resources are counted separately, it can reflect the rendering performance of rendering engine B on different types of test resources; if all the rendering performance parameters corresponding to different test devices are counted separately, then it can be Reflects the rendering performance of rendering engine B on different test devices. Taking the test device selected by the user as an example, the set of target performance parameters includes a total of 6 sets of rendering performance parameters obtained by rendering test resources a, b, and c on test device 1 using rendering engine A and rendering engine B respectively. Then, it is also possible to directly compare the rendering performance parameters of different rendering engines on the same test device for the same test resource, so that the performance of the two test engines can be compared. In addition, all the rendering performance parameters of the rendering engine B can be counted and compared with the rendering engine A, which can also reflect the performance of both.

It should be noted that the number of test devices, the number of rendering engines, and the number of test resource categories in the above examples are all simplified examples. In addition, the above example summary takes one test resource as one category for analysis. In some embodiments, A level of test resources can be described as a category, then a level may include multiple test resources, so that the rendering performance parameters corresponding to all test resources in the same level can be counted first, and then further comparative analysis can be performed .

Through the above comparative analysis, the performance of the rendering engine can be reflected from multiple dimensions, for example, the performance of the same rendering engine on different devices or the rendering performance of different levels of test resources, and it can also reflect the performance of different rendering engines on the same The performance on the device, etc., can fully reflect the performance of the tested rendering engine, so that users can strengthen the rendering engine based on the performance reflected by the test.

Step S240: Display each group of target performance parameters.

In the embodiment of the present disclosure, step S240 may be to display a group of target performance parameters, or to display multiple groups of target performance parameters at the same time. Parameters are displayed in the form of graphs, etc.

In some embodiments, after the performance analysis result is obtained, the performance analysis result may also be displayed for the user to view, so that the user can understand the performance of the rendering engine according to the performance analysis result.

It can be understood that at least one of step S230 and step S240 may be selected for execution, and the present disclosure does not limit the execution order of step S230 and step S240.

In the above solution, the rendering performance parameters are obtained and processed by rendering the rendering engine, so as to realize the testing of the rendering engine. There is no need to feel subjectively during the use of the rendering engine, and it can objectively reflect the performance of the rendering engine. The performance evaluation of the engine is more accurate; in addition, the rendering performance parameters can reflect the relevant performance of the rendering engine during the rendering process, and the comparison, analysis and display of the rendering performance parameters can more comprehensively reflect the performance of the rendering engine from multiple dimensions.

FIG. 3 shows a third schematic flowchart of a rendering engine testing method provided by an embodiment of the present disclosure.

In the embodiment of the present disclosure, the rendering performance parameter is used as an example to describe the rendering effect score. In this embodiment, the test equipment, test resource category, and rendering engine are used as three variables for testing. related content in the example. In the test process that needs to evaluate the rendering effect, the rendering performance parameters are based on the rendering results obtained by running the rendering engine on the test equipment to render the test resources. It is understandable that since the rendering engine is used to integrate in augmented reality applications, the device will display the rendering results in the real-time real-world environment images collected by the device. In order to make the rendering results closer to reality, the rendering engine usually performs During rendering, information such as ambient lighting and ambient light color will be collected in real time for rendering. In order to conduct a comprehensive test on the performance of the rendering engine, it can be analyzed in combination with environmental factors that affect the rendering effect.

In an application scenario, the three factors of light and shade, indoor point light source and outdoor parallel natural light, and presence or absence of occlusion can be used as environmental factors that affect the rendering effect. Among them, the presence or absence of occlusion can be determined by the number of moving objects in the environment And embodied. Combining these three factors, eight different test environments can be constructed. In addition, in order to reduce the impact of test environment fluctuations, the rendering engine does not use real-time acquisition of external environment information for rendering, but predetermines each test environment. The ambient lighting conditions of the environment are used when the test device runs the rendering engine for rendering. The ambient lighting conditions may include ambient light intensity and ambient light color, etc.

Generally speaking, the model can be fixed in different positions in some scenes. When the user passes by, the model can be viewed through the application of augmented reality. The user can perform different operations on the test equipment to view the model in different ways. After the rendering engine finishes rendering the model, the rendering result can also be adjusted accordingly in response to the user's operations on the device when viewing the model, which can reflect the update of the animation of the rendering engine. In order to conduct a comprehensive test on the performance of the rendering engine, it can also be analyzed in combination with the operation of the device by the user.

In an application scenario, when evaluating the rendering effect, the way of observing the rendering result may be at least one of standing still, performing a preset movement, and being at a corner, and performing a preset movement may be rotation, normal speed Move, quick start stop, etc. The observation method can be realized by the tester operating the test equipment. If the user rotates to observe, then the rendering engine can rotate according to the user to display the rendering results of different angles of the model. If the observation is at a corner, the model can be seen after the corner The rendering engine displays the rendering results. Quick start and stop can be manifested as a change from a position where the model cannot be observed to a position where the model can be observed. For example, if the device is placed from horizontal to vertical, then the rendering engine can display the rendering results according to the corresponding positional relationship .

The above test environment and observation methods can be used to construct different test conditions. For each rendering engine, use each test device to run the rendering engine to render each test resource, and evaluate the rendering effect under each test condition , so as to obtain the rendering effect score corresponding to the rendering engine, test equipment and test resources as a rendering performance parameter, reflecting the performance of the rendering engine. As shown in Figure 3, the method includes:

Step S310: Evaluate the rendering effect of the test device using the rendering engine to render the test resource according to the preset evaluation strategy, and obtain a rendering effect score.

In step S310, it may include obtaining test scores corresponding to at least one test condition, using the test scores corresponding to at least one test condition as rendering effect scores, or analyzing and processing the test scores corresponding to at least one test condition to obtain the rendering Performance rating. Wherein, at least one of the following corresponding to different test conditions is different: at least one of the test environment and the tester's operation on the test equipment.

It should be noted that a test score is performed on the rendering results obtained by using one rendering engine, one test device, one test resource and one test condition. If there is only one test condition, then the test score under the test condition can be As the rendering effect scores corresponding to the current rendering engine, test equipment and test resources, if there are multiple test conditions, the test scores corresponding to the multiple test conditions can be analyzed and processed, such as averaging, etc., to obtain the current rendering engine, Rendering effect scores corresponding to test equipment and test resources.

Step S320: Obtain the user effect score input by the user, and obtain the rendering effect score based on the user effect score.

The user effect score is obtained by the evaluators based on the preset evaluation strategy to evaluate the rendering effect of the test resource rendered by the test device running the rendering engine. There can be multiple evaluators. For the same rendering engine, this rendering engine is run on different test devices to render all test runs. Each evaluator scores all test resources under different test conditions. . In some embodiments, the evaluators can go to the points where the test resources are placed in different test environments, and perform different operations on the test equipment. The test equipment runs the rendering engine to render the test resources and display the rendering results. Rendering effects under a test condition are scored to obtain a user effect score under the test condition. The number of scores for each evaluator may be the product of the number of rendering engines, the number of test devices, the number of test resources, and the number of test conditions. Count the scores of the same evaluator, rendering engine, test equipment, and test resource under different test conditions, and obtain the user effect score corresponding to the evaluator, rendering engine, test equipment, and test resource.

In the embodiment of the present disclosure, obtaining the rendering effect score based on the user effect score may be obtained by fusing multiple user effect scores evaluated by multiple evaluators to obtain the rendering effect score. That is, the same rendering engine, test equipment, test resources, and user effect scores of different evaluators are fused to obtain the rendering effect scores corresponding to the rendering engine, test equipment, and test resources.

It should be noted that the processing device may select one of step S310 and step S320 to execute to obtain a rendering effect score, that is to say, the evaluation of the rendering effect may be performed by the processing device or by an evaluator.

Fig. 4 shows a schematic diagram of a preset evaluation strategy in a rendering engine testing method provided by an embodiment of the present disclosure. A preset evaluation strategy for scoring static models is shown in Figure 4, in which several rendering criteria are given, such as pointing, jitter, offset, and lighting of test resources. Since the dynamic model can interact with the user, the rendering standard of the dynamic model can exclude dithering and offset. Then, for each test condition, the rendering performed under the test condition is evaluated from at least one rendering standard to obtain a test score. In some embodiments, a score is obtained based on each rendering standard, and the test score may be the average score of all rendering standards.

Fig. 5 shows a schematic diagram of recording test item scores provided by an embodiment of the present disclosure. Figure 5 includes different test conditions, including normal light, shopping malls or outdoors, no pedestrians or few pedestrians, dark light, outdoors or shopping malls, no pedestrians or few pedestrians; each condition has different test items, Including: Observing AR objects when the mobile phone is stationary, observing AR objects while moving the mobile phone left and right, observing AR objects while walking at a normal speed, observing AR objects after quickly starting and stopping, and observing AR objects after turning; to show the number of test items for readability. Combined with the scoring criteria in the preset evaluation strategy schematic diagram in Figure 4, the user can record the scores of each test item under different test conditions in the table in Figure 5, so as to obtain the user effect score under this test condition.

Step S330: Use the rendering effect score as a rendering performance parameter.

After the above steps, a rendering engine, a test resource, and a test device are obtained corresponding to a rendering effect score. After the rendering effect score is used as the rendering performance parameter, the following step S340 can be performed to obtain the rendering performance parameter of the rendering engine; and step S350 is used to preset the rendering performance parameter, and the related processing involved in step S340 and step S350 can refer to the aforementioned implementation The relevant content of the rendering performance parameter processing in the example.

The present disclosure compares and analyzes the rendering effect scores of the rendering engines from different dimensions, which can fully reflect the rendering effects of the rendering engines, thereby reflecting the performance of the rendering engines.

In the above solution, the rendering performance parameters are obtained and processed by rendering the rendering engine, so as to realize the testing of the rendering engine. There is no need to feel subjectively during the use of the rendering engine, and it can objectively reflect the performance of the rendering engine. The performance evaluation of the engine is more accurate, and the rendering performance parameters can reflect the relevant performance of the rendering results of the rendering engine, and the comparison, analysis and display of the rendering performance parameters can more comprehensively reflect the performance of the rendering engine from multiple dimensions.

FIG. 6 shows a fourth schematic flowchart of a rendering engine testing method provided by an embodiment of the present disclosure. The method includes:

Step S510: Obtain at least one test resource.

At least one test resource includes a first number of static models and a second number of dynamic models.

Step S520: Run at least one rendering engine to render each test resource.

It should be noted that each test device will run all test engines, and each test engine will render all test resources. For related descriptions, please refer to relevant content about test devices in the foregoing embodiments.

Step S530: Send the test resources to at least one test device, and each test device runs at least one rendering engine to render the test resources.

It should be noted that the processing device can select one of step S520 and step S530 to execute, and if step S520 is selected, it means that the processing device is also used as a testing device. Before executing step S520 or step S530, the method also includes packaging the test resources into a format supported by the rendering engine, and if there are multiple rendering engines, then packaging the test resources into a format supported by each rendering engine for the corresponding rendering engine to perform Rendering works.

Step S540: Obtain the rendering performance parameters of the rendering engine.

Step S540 is to obtain the rendering performance parameters of the rendering engine from the test device. The test devices corresponding to step S520 and step S530 are different devices. For the relevant content of step S540 and step S550, please refer to the content in the foregoing embodiments.

Step S550: Perform preset processing based on rendering performance parameters.

In the above solution, by processing the rendering performance parameters obtained by rendering the rendering engine, compared with the existing method of judging the performance of the rendering engine based on the user's subjective perception of the rendering results, reflecting the performance of the rendering engine through parameters is more efficient. be objective and accurate.

Fig. 7 shows a schematic framework diagram of a rendering engine testing device provided by an embodiment of the present disclosure.

In the embodiment of the present disclosure, the testing device 60 of the rendering engine includes an acquisition module 61 and a processing module 62, wherein the acquisition module 61 is configured to acquire the rendering performance parameters of the rendering engine, wherein the rendering performance parameters are obtained by using the test equipment to run the rendering engine. The test resource is rendered. The processing module 62 is configured to perform preset processing based on the rendering performance parameter, wherein the preset processing is used to reflect the performance of the rendering engine.

In some embodiments, the rendering performance parameters include at least one of time-consuming acquisition of test resources, time-consuming rendering, memory usage of the rendering process, network resources consumed by acquiring test resources, and the maximum number of rendering resources. The maximum number of rendering resources is The rendering engine is able to process the number of test resources in parallel.

In some embodiments, the preset processing includes at least one of displaying the rendering performance parameters and performing performance analysis on the rendering performance parameters.

In some embodiments, the acquisition module 61 is configured to acquire several sets of rendering performance parameters, each set of rendering performance parameters is obtained by using a test device to run a rendering engine to render a test resource, different sets of rendering performance parameters corresponding to the test At least one of the device, the rendering engine, and the test resource is different; the processing module 62 is configured to select at least one set of rendering performance parameters as the target performance parameter, and perform at least one of the following: display each set of target performance parameters; The parameters are compared and analyzed to obtain the performance analysis results of the rendering engine corresponding to the target performance parameters; wherein at least one of the test equipment, rendering engine and test resource category corresponding to at least one set of target performance parameters is the same.

In some embodiments, each test resource serves as a test resource category, or each level of test resources serves as a test resource category.

In some embodiments, the processing module 62 is configured to use the rendering performance parameter related to the user's selection as the target performance parameter in response to the user's selection operation on at least one of the test device, rendering engine and test resource category.

In some embodiments, the testing device 60 of the rendering engine may further include an evaluation module and a determination module, the evaluation module is configured to evaluate the rendering effect of the test device using the rendering engine to render test resources according to a preset evaluation strategy, and obtain a rendering effect score; Or, obtain the user effect score input by the user, and obtain the rendering effect score based on the user effect score input by the user, wherein the user effect score is the evaluation of the rendering effect of the test resource rendered by the test device running the rendering engine by the evaluator according to the preset evaluation strategy Obtained; determines that the module is configured to use the rendering performance score as a rendering performance parameter.

In some embodiments, the evaluation module is configured to obtain test scores respectively corresponding to at least one test condition, wherein at least one of the following corresponding to different test conditions is different: at least one of the test environment and the tester's operation of the test equipment; The test scores corresponding to the at least one test condition are used as the rendering effect scores, or the test scores corresponding to the at least one test condition are analyzed and processed to obtain the rendering effect scores.

In some embodiments, the evaluation module is configured to fuse multiple user effect scores evaluated by multiple evaluators to obtain a rendering effect score.

In some embodiments, the test environment is determined by at least one of light, location and the number of moving objects in the scene, and the operation of the tester on the test equipment includes making the test equipment stationary, performing preset movements, and at least one of the objects located in the corner. One; the evaluation module is configured to, for each test condition, evaluate the rendering performed under the test condition from at least one rendering standard to obtain a test score, at least one rendering standard includes the pointing, jitter, offset and at least one of illumination.

In some embodiments, the rendering engine testing device 60 may further include a rendering module configured to acquire at least one test resource before acquiring the rendering performance parameters of the rendering engine; respectively run at least one rendering engine to render each test resource; Alternatively, the test resources are respectively sent to at least one test device, and each test device runs at least one rendering engine to render the test resources.

In some embodiments, at least one test resource includes a first number of static models and a second number of dynamic models; at least one test resource is divided into several levels of test resources, and different levels of test resources require different rendering capabilities; respectively At least one rendering engine is run to render each test resource, or the rendering module is configured to package the test resources into a format supported by the rendering engine before sending the test resources to at least one test device respectively.

In some embodiments, at least one of the following is included: the rendering engine is tested before the rendering engine is integrated into the application program; the rendering engine is used to be integrated into the augmented reality application program.

Fig. 8 shows a schematic framework diagram of a rendering engine testing system provided by an embodiment of the present disclosure.

In the disclosed implementation, the rendering engine testing system 70 includes a processing device 71 and a testing device 72, and the processing device 71 and the testing device 72 can communicate with each other. Wherein, the processing device 71 is configured to execute the relevant steps of any one of the above method embodiments, and the testing device 72 is configured to run the rendering engine to render the test resources to obtain the rendering performance parameters.

Fig. 9 shows a schematic diagram of a frame of a processing device provided by an embodiment of the present disclosure.

In the embodiment of the present disclosure, the processing device 80 includes a memory 81 and a processor 82 , wherein the memory 81 is coupled to the processor 82 . In some embodiments, various components of the processing device 80 may be coupled together through a bus, or the processor 82 of the processing device 80 may be connected to other components one by one. The processing device 80 may be any device with processing capabilities, such as a computer, a tablet computer, a mobile phone, and the like.

The memory 81 is used to store program data executed by the processor 82 and data during processing by the processor 82 . For example, testing resources, rendering engines, etc. Wherein, the memory 81 includes a volatile storage part or a non-volatile storage part for storing the above-mentioned program data.

The processor 82 controls the operation of the processing device 80, and the processor 82 may also be called a CPU (Central Processing Unit, central processing unit). The processor 82 may be an integrated circuit chip with signal processing capability. The processor 82 can also be a general-purpose processor, a digital signal processor (Digital Signal Processing, DSP), an application specific integrated circuit (Application Specific Integrated Circuit, ASIC), a field programmable gate array (Field Programmable Gate Array, FPGA) or other possible Program logic devices, discrete gate or transistor logic devices, discrete hardware components. A general-purpose processor may be a microprocessor, or the processor may be any conventional processor, and the like. In addition, the processor 82 may be jointly implemented by multiple circuit chips.

The processor 82 is used to execute instructions by calling the program data stored in the memory 81 to implement any of the above-mentioned testing methods of the rendering engine.

Fig. 10 shows a schematic diagram of a computer-readable storage medium provided by an embodiment of the present disclosure.

In the embodiment of the present disclosure, the computer-readable storage medium 90 stores program data 91 executable by the processor, and the program data can be executed to implement any of the above-mentioned testing methods for the rendering engine.

The computer readable storage medium 90 can be a volatile storage medium or a nonvolatile storage medium, and can be a U disk, a removable hard disk, a read-only memory (Read-Only Memory, ROM), a random access memory (Random Access Memory, RAM), disk or optical disc, etc. can store the program data, or it can also be a server that stores the program data, and the server can send the stored program data to other devices for operation, or it can also run the storage program data.

In some embodiments, the computer-readable storage medium 90 may also be the memory 81 as shown in FIG. 9 .

Some embodiments of the present disclosure relate to the field of augmented reality. By acquiring the image information of the target object in the real environment, and then using various visual correlation algorithms to detect or identify the relevant features, states, and attributes of the target object, so as to obtain and apply Matching AR effect combining virtual and reality. Exemplarily, the target object may involve faces, limbs, gestures, actions, etc. related to the human body, or markers and markers related to objects, or sand tables, display areas or display items related to venues or places. Vision-related algorithms can involve visual localization, real-time localization and map construction or concurrent localization and localization (Simultaneous Localization And Mapping, SLAM), 3D reconstruction, image registration, background segmentation, object key point extraction and tracking, object pose or depth detection etc. Applications can not only involve interactive scenes such as tours, navigation, explanations, reconstructions, virtual effect overlays and display related to real scenes or objects, but can also involve special effects processing related to people, such as makeup beautification, body beautification, special effect display, virtual model Display and other interactive scenes.

The relevant features, states and attributes of the target object can be detected or identified through the convolutional neural network. The above-mentioned convolutional neural network is a network model obtained by performing model training based on a deep learning framework.

In some embodiments, the functions or modules included in the apparatus provided by the embodiments of the present disclosure can be used to execute the methods described in the above method embodiments, and the implementation can refer to the descriptions of the above method embodiments.

In some embodiments, the computer program product can be realized by hardware, software or a combination thereof. In an optional embodiment, the computer program product is embodied as a computer storage medium, and in another optional embodiment, the computer program product is embodied as a software product, such as a software development kit (Software Development Kit, SDK) etc. wait.

The above descriptions of the various embodiments tend to emphasize the differences between the various embodiments, and the same or similar points can be referred to each other.

The above is only the implementation of the present disclosure, and does not limit the patent scope of the present disclosure. Any equivalent structure or equivalent process conversion made by using the contents of this disclosure and the accompanying drawings, or directly or indirectly used in other related technologies fields, are equally included in the patent protection scope of the present disclosure.

Claims

A method for testing a rendering engine, comprising:

Acquiring rendering performance parameters of a rendering engine, wherein the rendering performance parameters are obtained by using a test device to run the rendering engine to render test resources;

Preset processing is performed based on the rendering performance parameter, wherein the preset processing is used to reflect the performance of the rendering engine.
The method according to claim 1, wherein the rendering performance parameters include obtaining the time-consuming of the test resource, rendering time, memory usage of the rendering process, obtaining network resources consumed by the test resource, and the maximum number of rendering resources In at least one of the above, the maximum number of rendering resources is the number of test resources that the rendering engine can process in parallel.
The method according to claim 1 or 2, wherein the preset processing includes at least one of displaying the rendering performance parameters and performing performance analysis on the rendering performance parameters.
The method according to claim 3, wherein said acquiring the rendering performance parameters of the rendering engine comprises:

Obtain several sets of rendering performance parameters, each set of rendering performance parameters is obtained by using a test device to run a rendering engine to render a test resource, and different sets of rendering performance parameters correspond to the At least one of the test device, the rendering engine, and the test resource is different;

The preset processing based on the rendering performance parameters includes:

Selecting at least one set of rendering performance parameters as target performance parameters, and performing at least one of the following: displaying each set of target performance parameters; performing comparative analysis on each set of target performance parameters to obtain the corresponding The performance analysis result of the rendering engine; wherein, at least one of the test equipment, rendering engine and test resource category corresponding to the at least one set of target performance parameters is the same.
The method according to claim 4, wherein each of the test resources is used as a test resource category, or each level of test resources is used as a test resource category.
The method according to claim 4 or 5, wherein said selecting at least one set of said rendering performance parameters as target performance parameters comprises:

In response to a user's selection operation on at least one of the test device, rendering engine, and test resource category, the rendering performance parameter related to the user's selection is used as the target performance parameter.
The method according to any one of claims 1 to 6, wherein the method further comprises:

According to a preset evaluation strategy, evaluate the effect of the test device using the rendering engine to render the test resource to obtain a rendering effect score; or obtain a user effect score input by the user, and based on the user effect score input by the user Obtaining the rendering effect score, wherein the user effect score is obtained by an evaluator evaluating the rendering effect of the test resource rendered by the test device running a rendering engine according to the preset evaluation strategy;

The rendering effect score is used as the rendering performance parameter.
The method according to claim 7, wherein, according to the preset evaluation strategy, evaluating the effect of the test device using the rendering engine to render the test resource to obtain a rendering effect score, comprising:

Acquiring test scores corresponding to at least one test condition, wherein at least one of the following corresponding to different test conditions is different: at least one of the test environment and the operation of the tester on the test equipment;

The test scores corresponding to the at least one test condition are used as the rendering effect scores, or the test scores corresponding to the at least one test condition are analyzed and processed to obtain the rendering effect scores.
The method according to claim 7 or 8, wherein the obtaining the rendering effect score based on the user effect score input by the user comprises:

The rendering effect score is obtained by fusing multiple user effect scores evaluated by multiple evaluators.
The method according to claim 8 or 9, wherein the test environment is determined by at least one of light, place and the number of moving objects in the scene, and the tester's operation of the test equipment includes making the the test device is at least one of stationary, performing a preset motion, and positioned on a bend;

The acquisition of test scores corresponding to at least one test condition includes:

For each of the test conditions, evaluate the rendering performed under the test conditions from at least one rendering standard to obtain the test score; the at least one rendering standard includes the direction of the rendered test resource, At least one of dithering, offsetting and lighting.
The method according to any one of claims 1 to 10, wherein, before the acquisition of the rendering performance parameters of the rendering engine, the method further comprises:

Get at least one test resource;

Run at least one rendering engine to render each of the test resources; or, send the test resources to at least one test device, each of the test devices runs at least one rendering engine to render the test resources to render.
The method of claim 11, wherein the at least one test resource includes a first number of static models and a second number of dynamic models;

The at least one test resource is divided into several levels of the test resources, and different levels of test resources require different rendering capabilities;

Before running at least one rendering engine to render each of the test resources, or sending the test resources to at least one test device, the method further includes:

Pack the test resources into a format supported by the rendering engine.
The method according to any one of claims 1 to 12, wherein at least one of the following is included: the testing method of the rendering engine is executed before the rendering engine is integrated into an application program;

The rendering engine is intended to be integrated in augmented reality applications.
A test device for a rendering engine, comprising:

An acquisition module configured to acquire rendering performance parameters of a rendering engine, wherein the rendering performance parameters are obtained by using a test device to run the rendering engine to render test resources;

A processing module configured to perform preset processing based on the rendering performance parameter, wherein the preset processing is used to reflect the performance of the rendering engine.
The device according to claim 14, wherein the acquisition module is configured to acquire several sets of rendering performance parameters, and each set of rendering performance parameters is performed by using a test device to run a rendering engine to a test resources obtained by rendering, different sets of rendering performance parameters correspond to at least one of the test equipment, the rendering engine, and the test resources;

The processing configuration is configured to select at least one set of rendering performance parameters as target performance parameters, and perform at least one of the following: displaying each set of target performance parameters; performing comparative analysis on each set of target performance parameters, A performance analysis result of the rendering engine corresponding to the target performance parameter is obtained; wherein at least one of the test device, rendering engine and test resource category corresponding to the at least one set of target performance parameters is the same.
The apparatus according to claim 15, wherein each test resource is used as a test resource category, or each level of test resources is used as a test resource category; The selection operation of at least one of the engine and the test resource category uses the rendering performance parameter related to the user's selection as the target performance parameter.
The device according to claim 15 or 16, wherein the device further comprises:

The evaluation module is configured to evaluate the effect of the test device rendering the test resource by using the rendering engine according to a preset evaluation strategy to obtain a rendering effect score; or obtain a user effect score input by the user, based on the user The input user effect score is obtained to obtain the rendering effect score, wherein the user effect score is obtained by an evaluator evaluating the effect of rendering the test resource by the rendering engine running on the test device according to the preset evaluation strategy ;

A determining module configured to use the rendering effect score as the rendering performance parameter.
The device according to claim 17, wherein the evaluation module is configured to obtain test scores corresponding to at least one test condition, wherein at least one of the following corresponding to different test conditions is different: the test environment, the tester's evaluation of the At least one of the operations of the test device; using the test scores corresponding to the at least one test condition as the rendering effect scores, or analyzing and processing the test scores corresponding to the at least one test condition to obtain the Rendering rating.
The device according to claim 17 or 18, wherein the evaluation module is configured to fuse multiple user effect scores evaluated by multiple evaluators to obtain the rendering effect score.
The device according to claim 18 or 19, wherein the test environment is determined by at least one of light, location and the number of moving objects in the scene, and the operation of the tester on the test equipment includes making the the test device is at least one of stationary, performing a preset motion, and positioned on a bend;

The evaluation module is configured to, for each of the test conditions, respectively evaluate the rendering performed under the test conditions from at least one rendering standard to obtain the test score; the at least one rendering standard includes rendering At least one of orientation, jitter, offset and illumination of the test resource.
The device according to any one of claims 14 to 20, wherein the device further comprises:

The rendering module is configured to obtain at least one test resource before obtaining the rendering performance parameters of the rendering engine; respectively run at least one of the rendering engines to render each of the test resources; or send the test resources to at least A test device, each of which runs at least one rendering engine to render the test resources.
The apparatus according to claim 21, wherein said at least one test resource comprises a first number of static models and a second number of dynamic models; said at least one test resource is divided into several levels of said test resources, different levels of The rendering capabilities required by the test resources are different; the rendering module is configured to package the test resources into a format supported by the rendering engine before sending the test resources to at least one test device respectively.
A processing device, the device comprising a processor and a memory, the memory is used to store program data, and the processor is used to execute the program data to implement the method according to any one of claims 1-13.
A test system for a rendering engine, the test system includes a processing device and a test device, wherein the test device is used to run the rendering engine to render test resources to obtain rendering performance parameters, and the processing device is used to perform such as The method of any one of claims 1-13.
A computer-readable storage medium, the computer-readable storage medium is used to store program data, and the program data can be executed to implement the method according to any one of claims 1-13.
A computer program comprising computer readable codes, in case the computer readable codes run on the device, the processor in the device executes to implement the method according to any one of claims 1 to 13.
A computer program product configured to store computer-readable instructions that, when executed, cause a computer to perform the method of any one of claims 1-13.