CN117251355A

CN117251355A - Performance test method, device, equipment, computer readable storage medium and product

Info

Publication number: CN117251355A
Application number: CN202210657498.3A
Authority: CN
Inventors: 舒立武; 张兴华; 杨阳
Original assignee: Beijing Zitiao Network Technology Co Ltd
Current assignee: Beijing Zitiao Network Technology Co Ltd
Priority date: 2022-06-10
Filing date: 2022-06-10
Publication date: 2023-12-19

Abstract

The embodiment of the disclosure provides a performance test method, a device, equipment, a computer readable storage medium and a product, wherein the method comprises the following steps: acquiring a performance test request, wherein the performance test request comprises a target application identifier and a performance type to be tested; installing the target application into a preset sandbox environment according to the performance test request and the target application identifier; triggering the target application through a preset test case; and in the running process of the target application, acquiring target performance data of the performance type to be tested corresponding to the target application by adopting a hook function corresponding to the performance type to be tested. Therefore, the acquisition of the front-end display performance data and the bottom performance data of the target application can be realized. In addition, the performance data can be acquired through the hook function, the performance data with fine granularity can be acquired, the frame-dividing calculation of the performance data is not needed by manpower, the accuracy of the acquired performance data is improved, the participation of manpower is not needed, and the acquisition efficiency of the performance data is improved.

Description

Performance test method, device, equipment, computer readable storage medium and product

Technical Field

The embodiment of the disclosure relates to the technical field of computers, in particular to a performance testing method, a performance testing device, performance testing equipment, a computer readable storage medium and a computer readable storage medium product.

Background

With the improvement of the hardware performance of the terminal equipment and the continuous progress of the artificial intelligence technology, more and more Application programs (APP) run on the terminal equipment are also running. In order to improve the application program and further provide better quality service to the user, test operations need to be performed on the application program to obtain performance data of the application program.

The existing test method generally uses a camera to record or record the jump video of a screen in the operation process by using the user click operation simulated by UI automation tool when the application program runs. And calculating the time corresponding to the skip operation by carrying out frame number of the start point and the end point of framing on the skip video.

However, by adopting the method, only the performance data of the UI change can be acquired, but the acquisition of the performance data of the bottom layer of the application program cannot be realized. In addition, the UI performance data is obtained through framing operation, so that only time-consuming data in the whole process can be obtained, time consuming in each middle stage cannot be obtained, and the accuracy of the obtained performance data is low. Furthermore, since the UI automation tool can only acquire the performance index related to the UI change, the index not related to the UI change cannot be acquired, for example: performance indexes such as DB data reading, network request time consumption, hardware operation time consumption and the like. Resulting in an inability to fully test the performance of the application.

Disclosure of Invention

The embodiment of the disclosure provides a performance test method, a performance test device, performance test equipment, a computer-readable storage medium and a computer-readable storage medium product, which are used for solving the technical problems that the type of data acquired by the existing performance data acquisition method is single and the accuracy of the acquired performance data is low.

In a first aspect, an embodiment of the present disclosure provides a performance testing method, including:

acquiring a performance test request, wherein the performance test request comprises a target application identifier and a performance type to be tested;

according to the performance test request, installing the target application into a preset sandbox environment according to the target application identifier;

triggering the target application through a preset test case;

and acquiring target performance data of the performance type to be tested corresponding to the target application by adopting a hook function corresponding to the performance type to be tested in the running process of the target application.

In a second aspect, embodiments of the present disclosure provide a performance testing apparatus, including:

the device comprises an acquisition module, a performance test module and a test module, wherein the acquisition module is used for acquiring a performance test request, and the performance test request comprises a target application identifier and a performance type to be tested;

The installation module is used for installing the target application into a preset sandbox environment according to the performance test request and the target application identifier;

the triggering module is used for triggering the target application through a preset test case;

and the processing module is used for acquiring target performance data of the performance type to be tested corresponding to the target application by adopting a hook function corresponding to the performance type to be tested in the running process of the target application.

In a third aspect, an embodiment of the present disclosure provides an electronic device, including: a processor and a memory;

the memory stores computer-executable instructions;

the processor executes computer-executable instructions stored by the memory to cause the at least one processor to perform the performance test method as described above in the first aspect and the various possible designs of the first aspect.

In a fourth aspect, embodiments of the present disclosure provide a computer-readable storage medium having stored therein computer-executable instructions which, when executed by a processor, implement the performance test method as described above in the first aspect and the various possible designs of the first aspect.

In a fifth aspect, embodiments of the present disclosure provide a computer program product comprising a computer program which, when executed by a processor, implements the performance test method according to the first aspect and the various possible designs of the first aspect.

According to the performance testing method, the device, the equipment, the computer readable storage medium and the product, when the performance testing request is acquired, the target application which is required to be subjected to performance testing is installed in the preset sandbox environment, and based on the sandbox environment, performance data of various different performance types to be tested of the target application can be acquired through the hook function. Further, logic of different hook functions can be set for different performance types to be tested, and after triggering operation is performed on the target application through a preset test case, the hook function corresponding to the performance type to be tested can be used for performing acquisition operation of target performance data on the target application. Therefore, the acquisition of the front-end display performance data and the bottom performance data of the target application can be realized. In addition, the performance data can be acquired through the hook function, the performance data with fine granularity can be acquired, the frame-dividing calculation of the performance data is not needed by manpower, the accuracy of the acquired performance data is improved, the participation of manpower is not needed, and the acquisition efficiency of the performance data is improved.

Drawings

In order to more clearly illustrate the embodiments of the present disclosure or the solutions in the prior art, a brief description will be given below of the drawings that are needed in the embodiments or the description of the prior art, it being obvious that the drawings in the following description are some embodiments of the present disclosure, and that other drawings may be obtained from these drawings without inventive effort to a person of ordinary skill in the art.

FIG. 1 is a schematic diagram of a system architecture upon which the present disclosure is based;

FIG. 2 is a flow chart of a performance testing method according to an embodiment of the disclosure;

FIG. 3 is a schematic flow chart provided in another embodiment of the present disclosure;

FIG. 4 is a flow chart of a performance testing method according to another embodiment of the present disclosure;

FIG. 5 is a schematic structural diagram of a performance testing apparatus according to an embodiment of the present disclosure;

fig. 6 is a schematic structural diagram of an electronic device according to an embodiment of the disclosure.

Detailed Description

For the purposes of making the objects, technical solutions and advantages of the embodiments of the present disclosure more apparent, the technical solutions of the embodiments of the present disclosure will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present disclosure, and it is apparent that the described embodiments are some embodiments of the present disclosure, but not all embodiments. All other embodiments, which can be made by one of ordinary skill in the art without inventive effort, based on the embodiments in this disclosure are intended to be within the scope of this disclosure.

Aiming at the technical problems that the acquired data type is single and the acquired performance data accuracy is low in the existing performance data acquisition method, the disclosure provides a performance test method, a performance test device, performance test equipment, a computer readable storage medium and a computer readable storage medium product.

It should be noted that the present disclosure provides a performance testing method, apparatus, device, computer readable storage medium and product, which can be used in a scenario of performing performance testing on various application software.

In the process of solving the technical problems, the inventor finds through research that in order to realize full-automatic acquisition of multi-frequency, multi-application and multi-dimensional data without human intervention, a target application can be installed in a sandbox environment, and hook functions with different logics can be constructed according to different types of performance data. The acquisition of performance data is performed using a hook function corresponding to the type.

Fig. 1 is a schematic diagram of a system architecture based on the present disclosure, as shown in fig. 1, where the system architecture based on the present disclosure at least includes: the terminal device 11 and the server 12, wherein, the server 12 can be provided with a performance testing device which can be written by languages such as C/C++, java, shell or Python; the terminal device 11 may be, for example, a desktop computer, a tablet computer, etc.

The server 12 may obtain a performance test request sent by the terminal device 11, install the target application 13 into a preset sandbox environment 14 according to the performance test request, and collect target performance data of a performance type to be tested corresponding to the target application through a hook function corresponding to the performance type to be tested.

Fig. 2 is a flow chart of a performance testing method according to an embodiment of the disclosure, as shown in fig. 2, the method includes:

step 201, a performance test request is obtained, wherein the performance test request includes a target application identifier and a performance type to be tested.

The execution body of the embodiment is a performance testing device, and the performance testing device can be coupled to a server. The server can be in communication connection with the terminal equipment, so that information interaction with the terminal equipment can be performed.

In this embodiment, in order to ensure that an application program can provide a better service to a user, before the application program is online, a test operation needs to be performed on the application program to obtain performance data of the application program. Specifically, the user may perform a test operation on a performance index in the target application according to an actual requirement, where the performance index includes, but is not limited to, a performance index displayed on the front end interface and a performance index of the bottom layer, and the user may be a developer. In order to accurately acquire the performance data, the performance data can be further divided into a plurality of different performance types, so that the performance data of the different performance types can be acquired.

In order to implement a performance test operation on a target application, a user may initiate a performance test request on a terminal device. Accordingly, the performance test device may obtain the performance test request, where the performance test request includes the target application identifier and the performance type to be tested.

It should be noted that the target application may be a first target application that can obtain the code and a second target application that cannot obtain the code.

And 202, installing the target application into a preset sandbox environment according to the performance test request and the target application identifier.

In this embodiment, in the actual application, the bottom code corresponding to all the target applications to be tested cannot be obtained. Therefore, for the target application incapable of acquiring the underlying code, in order to achieve the acquisition of performance data, the target application may be installed into a preset sandboxed environment.

In the Android system operation mechanism, an application program is firstly installed in a terminal device through a system service, and the application program can be operated on the Android terminal device. The sandbox provides a virtual environment capable of being installed, uninstalled, started and operated, the virtual environment proxies the interactive interface between the application program and the system, and the application program can normally operate only by placing the application program in the sandbox environment without being installed on the terminal equipment. The application program is run in the sandbox, the running effect is almost consistent with the running of the application program on the terminal equipment, and the relevant running data of the application program can be analyzed in the sandbox by using a hook mode.

And 203, triggering the target application through a preset test case.

In this embodiment, in order to implement a performance test operation on a target application, an automated test case may be preconfigured, where the test case may simulate a trigger operation of a user on the target application, and continuously trigger the target application to obtain performance data of the target application in multiple trigger operations.

And 204, acquiring target performance data of the performance type to be tested corresponding to the target application by adopting a hook function corresponding to the performance type to be tested in the running process of the target application.

In this embodiment, by installing the target program in a sandbox environment, the relevant operation data of the application program can be analyzed using the hook method. Different logic hook functions are set for different performance types to be tested, so that in the performance test process, different logic hook functions can be selected for different performance types to be tested to acquire performance data.

Specifically, after the triggering operation is performed on the target application through the preset test case, the hook function corresponding to the performance type to be tested can be adopted to perform the target performance data acquisition operation on the target application, so as to obtain the target performance data of the performance type to be tested corresponding to the target application.

It should be noted that, by adopting the hook function to acquire the performance data, the performance data of the bottom layer and the front end interface of the target application can be acquired, and more various performance data can be acquired, which provides a basis for optimizing the target application.

According to the performance testing method, when the performance testing request is obtained, the target application which is required to be subjected to performance testing at present is installed in the preset sandbox environment, and based on the sandbox environment, performance data of various different performance types to be tested of the target application can be obtained through the hook function. Further, logic of different hook functions can be set for different performance types to be tested, and after triggering operation is performed on the target application through a preset test case, the hook function corresponding to the performance type to be tested can be used for performing acquisition operation of target performance data on the target application. Therefore, the acquisition of the front-end display performance data and the bottom performance data of the target application can be realized, the performance data corresponding to more performance indexes can be acquired, and the comprehensiveness of the performance test of the target application is improved. In addition, the performance data can be acquired through the hook function, the performance data with fine granularity can be acquired, the frame-dividing calculation of the performance data is not needed by manpower, the accuracy of the acquired performance data is improved, the participation of manpower is not needed, and the acquisition efficiency of the performance data is improved.

Further, based on any of the above embodiments, step 202 includes:

and detecting whether the target application has an updated version in each application acquisition channel according to a preset time period or in response to a query request triggered by a user.

If yes, acquiring the target application of the updated version, and installing the target application of the updated version into a preset sandbox environment.

If not, the currently acquired target application is installed in a preset sandbox environment.

In this embodiment, when performing performance test on a target application, in order to ensure that the test is accurate and effective, it is first required to ensure that the target application is the latest version of application. Therefore, it is possible to detect whether or not the target application has an updated version in each application acquisition channel in accordance with a preset time period. Alternatively, it may be detected whether an updated version exists for the target application in each application acquisition channel in response to a user-triggered query request. If the updated version exists, the updated version of the target application can be downloaded, and the updated version of the target application is installed in a preset sandbox environment. Otherwise, the currently acquired target application is characterized as the application of the latest version, so that the currently acquired target application can be installed in a preset sandbox environment.

According to the performance test method provided by the embodiment, the latest version of the target application is acquired and installed before performance test, so that the acquired performance data of the latest version of the target application can be ensured, and the accuracy of the acquired performance data is improved.

FIG. 3 is a schematic flow chart provided in another embodiment of the disclosure, where, on the basis of any one of the above embodiments, the performance test request further includes an identifier of a method to be tested; as shown in fig. 3, before step 204, the method further includes:

step 301, generating hook function logic corresponding to the performance type to be tested according to the performance type to be tested.

Step 302, adding an identifier of the to-be-tested method to a preset position in the hook function logic to obtain a hook function, wherein the hook function can acquire performance data corresponding to a performance type to be tested of the to-be-tested method during operation.

In this embodiment, before the performance test is obtained by using the hook function, the logic of the hook method may be written in the sandbox according to the method to be tested and the performance type to be tested. Specifically, hook function logic corresponding to the performance type to be tested may be generated according to the performance type to be tested. And adding the identifier of the to-be-tested method in a preset position in the hook function logic to obtain a hook function, so that the hook function can acquire performance data corresponding to the to-be-tested performance type of the to-be-tested method during operation.

For example, the performance type to be tested may be a time-consuming type, a hook function may be inserted before the method to be tested is run, and a hook function may be inserted after the method to be tested is run, so as to determine the start running time and the end running time of the method to be tested, thereby realizing the time-consuming calculation of the method to be tested.

According to the performance testing method, the logic of the hook function is written in the sandbox, so that the hook function can acquire performance data corresponding to the performance type to be tested of the performance testing method during operation, and acquisition of various different performance data is achieved.

Further, on the basis of any one of the above embodiments, the performance types to be tested include a time-consuming performance type; the performance test request also comprises an identifier of a method to be tested;

step 204 includes:

and determining the starting operation time and the ending operation time corresponding to the method to be tested identifier through the hook function corresponding to the time consuming performance type.

And determining time-consuming performance data corresponding to the method to be tested according to the difference between the starting operation time and the ending operation time.

In this embodiment, the performance types to be tested include time-consuming performance types. The time-consuming performance type can be specifically time-consuming data corresponding to any method, function or interface jump. In order to accurately acquire the performance data of the method, the performance test request also comprises the identification of the method to be tested.

After the target application is triggered by the preset test case, a hook function corresponding to the time-consuming performance type can be adopted to determine the starting running time and the ending running time corresponding to the method to be tested identifier. And calculating a difference value between the starting operation time and the ending operation time, and determining the time difference value as time-consuming performance data corresponding to the method to be tested.

For example, the time required for the request corresponding to the target application may be obtained, the time required for initiating the request and the time required for ending the request may be determined, the difference between the time required for initiating the request and the time required for ending the request is calculated, and the time difference is determined as the time required for the request corresponding to the target application.

According to the performance testing method, the hook function corresponding to the time-consuming performance type is adopted to determine the starting operation time and the ending operation time corresponding to the method to be tested identifier, and the time-consuming performance data corresponding to the method to be tested is determined according to the difference between the starting operation time and the ending operation time, so that accurate acquisition of the time-consuming performance data under various scenes can be achieved. The comprehensiveness of the target application performance test can be further improved through the acquisition of the time-consuming performance data of the bottom layer.

Further, on the basis of any one of the above embodiments, the performance types to be tested include a consumption performance type; the performance test request also comprises an identifier of a method to be tested;

step 204 includes:

and determining a first memory corresponding to the method to be tested identifier when the method to be tested starts to operate through a hook function corresponding to the memory variation performance type, and determining a second memory corresponding to the method to be tested when the method to be tested ends to operate.

And determining consumption performance data corresponding to the method to be tested according to the memory difference value between the second memory and the first memory.

In this embodiment, the performance type to be measured includes a consumption performance type. The time-consuming performance type may be specifically any performance data related to memory consumption, such as memory expansion data and CPU consumption data. In order to accurately acquire the performance data of the method, the performance test request also comprises the identification of the method to be tested.

After the target application is triggered by the preset test case, a hook function corresponding to the memory change performance type can be adopted to determine a first memory corresponding to the start of the operation of the method to be tested corresponding to the identification of the method to be tested, and determine a second memory corresponding to the end of the operation of the method to be tested. And calculating a memory difference value between the second memory and the first memory, and determining the memory difference value as consumption performance data corresponding to the method to be tested.

For example, to obtain the memory consumption performance data, before the method to be tested is run, a first whole memory may be determined, after the method to be tested is run, a second whole memory may be determined, and a difference between the second whole memory and the first whole memory is determined as the memory consumption performance data.

According to the performance test method provided by the embodiment, the first memory corresponding to the to-be-tested method identifier when the to-be-tested method starts to operate is determined by adopting the hook function corresponding to the memory change performance type, the second memory corresponding to the to-be-tested method when the to-be-tested method ends to operate is determined, and the consumption performance data corresponding to the to-be-tested method is determined according to the memory difference between the second memory and the first memory, so that accurate acquisition of the consumption performance data in various scenes can be realized. The comprehensiveness of the target application performance test can be further improved through the acquisition of the consumption performance data of the bottom layer.

Further, on the basis of any one of the above embodiments, the performance types to be measured include a frame rate variation performance type; the performance test request also comprises an identifier of a method to be tested;

step 204 includes:

and determining the drawing times of the method to be tested corresponding to the mark of the method to be tested in a preset time interval through a hook function corresponding to the frame rate change performance type.

And determining frame rate change performance data corresponding to the method to be tested according to the drawing times corresponding to the method to be tested in a preset time interval.

In this embodiment, the performance type to be measured includes a frame rate variation performance type. In order to accurately acquire the performance data of the method, the performance test request also comprises the identification of the method to be tested.

After the target application is triggered by the preset test case, the number of drawing times of the method to be tested corresponding to the method to be tested, which corresponds to the method identifier to be tested, in the preset time interval can be determined by adopting a hook function corresponding to the frame rate change performance type. And then the frame rate change performance data corresponding to the method to be tested can be determined according to the drawing times.

According to the performance test method provided by the embodiment, the number of drawing times of the to-be-tested method corresponding to the to-be-tested method identifier in the preset time interval is determined by adopting the hook function corresponding to the frame rate change performance type, and the frame rate change performance data corresponding to the to-be-tested method is determined according to the number of drawing times, so that the frame rate change performance data under various scenes can be accurately acquired. The comprehensiveness of the target application performance test can be further improved through the acquisition of the frame rate change performance type of the bottom layer.

FIG. 4 is a flow chart of a performance testing method according to another embodiment of the disclosure, which further includes, after step 204, on the basis of any of the above embodiments

And step 401, generating a performance report according to the target performance data.

And step 402, performing performance optimization operation on the target application according to the performance report.

In this embodiment, after the target performance data corresponding to the target application is obtained, performance optimization operation may be performed on the target application according to the target performance data. Specifically, a performance report may be generated from the target performance data. The performance report may include performance data corresponding to a plurality of performance indicators corresponding to the target application. Furthermore, to enable a user to more intuitively understand the performance of the target application, the performance report may specifically be a performance report including different types of visualization icons.

And determining the performance index required to be optimized for the target application according to the performance report, so that performance optimization operation can be performed on the target application.

According to the performance testing method, after the target performance data corresponding to the target application are obtained, performance optimization operation is performed on the target application according to the target performance data, so that the performance of the target application can be improved, and the target application can provide higher-quality service for users.

Further, based on any of the above embodiments, step 402 includes:

and comparing the performance report of the target application of the current version with the performance report of the target application of the historical version, and determining a method to be optimized of the target application of the current version relative to the target application of the historical version.

And carrying out optimization operation on the method to be optimized corresponding to the target application.

In this embodiment, in order to implement the performance optimization operation on the target application, a lateral comparison operation may be performed between the performance report of the target application of the current version and the performance report of the target application of the historical version, so as to determine a point at which the target application of the current version is degraded with respect to the target application of the historical version. Thus, the method to be optimized, which needs to be improved, can be accurately determined. And carrying out targeted optimization operation on the method to be optimized corresponding to the target application.

According to the performance test method provided by the embodiment, the performance report of the target application of the current version and the performance report of the target application of the historical version are subjected to transverse comparison operation, so that the defect of the current version can be accurately determined, the method with the defect can be subjected to optimization operation in a targeted manner, and the efficiency and the accuracy of performance optimization are improved.

Further, based on any of the above embodiments, step 402 includes:

and comparing the performance report of the target application with performance reports of other preset applications, and determining that the other applications exceed the target performance of the target application, wherein the other applications are similar to the target application.

And performing performance optimization operation on the target application according to the target performance and the method corresponding to the target performance.

In this embodiment, in order to implement the performance optimization operation for the target application, the performance report of the target application may be longitudinally compared with the performance reports of other preset applications. Wherein the other applications are applications similar to the target application. The performance report of other applications may be preset or may be obtained through the test of the method, which is not limited in this disclosure. Target performance is determined for other applications that are better than the target application. And performing performance optimization operation on the target application according to the target performance and the method corresponding to the target performance.

According to the performance test method, the performance report of the target application is longitudinally compared with the performance reports of other preset applications, so that an optimization direction can be provided for the target application, the target application is subjected to targeted optimization operation, and the performance optimization efficiency and accuracy are improved.

Fig. 5 is a schematic structural diagram of a performance testing apparatus according to an embodiment of the disclosure, as shown in fig. 5, the apparatus includes: the device comprises an acquisition module 51, an installation module 52, a trigger module 53 and a processing module 54. The obtaining module 51 is configured to obtain a performance test request, where the performance test request includes a target application identifier and a performance type to be tested. And the installation module 52 is configured to install the target application into a preset sandbox environment according to the performance test request and the target application identifier. And the triggering module 53 is configured to trigger the target application through a preset test case. And the processing module 54 is configured to collect, during the running process of the target application, target performance data of a performance type to be tested corresponding to the target application by using a hook function corresponding to the performance type to be tested.

Further, on the basis of any one of the above embodiments, the mounting module is configured to: and detecting whether the target application has an updated version in each application acquisition channel according to a preset time period or in response to a query request triggered by a user. If yes, acquiring the target application of the updated version, and installing the target application of the updated version into a preset sandbox environment. If not, the currently acquired target application is installed in a preset sandbox environment.

Further, on the basis of any one of the above embodiments, the performance test request further includes an identifier of the method to be tested. The apparatus further comprises: and the generating module is used for generating hook function logic corresponding to the performance type to be detected according to the performance type to be detected. The adding module is used for adding the identification of the method to be tested at a preset position in the hook function logic to obtain a hook function, and the hook function can acquire performance data corresponding to the performance type to be tested of the method to be tested when in operation.

Further, on the basis of any one of the above embodiments, the performance types to be tested include time-consuming performance types. The performance test request also comprises an identifier of the method to be tested. The processing module is used for:

and determining the starting operation time and the ending operation time corresponding to the method to be tested identifier through the hook function corresponding to the time consuming performance type. And determining time-consuming performance data corresponding to the method to be tested according to the difference between the starting operation time and the ending operation time.

Further, on the basis of any one of the above embodiments, the performance types to be measured include a consumption performance type. The performance test request also comprises an identifier of the method to be tested. The processing module is used for: and determining a first memory corresponding to the method to be tested identifier when the method to be tested starts to operate through a hook function corresponding to the memory variation performance type, and determining a second memory corresponding to the method to be tested when the method to be tested ends to operate. And determining consumption performance data corresponding to the method to be tested according to the memory difference value between the second memory and the first memory.

Further, on the basis of any one of the above embodiments, the performance types to be measured include a frame rate variation performance type. The performance test request also comprises an identifier of the method to be tested. The processing module is used for: and determining the drawing times of the method to be tested corresponding to the mark of the method to be tested in a preset time interval through a hook function corresponding to the frame rate change performance type. And determining frame rate change performance data corresponding to the method to be tested according to the drawing times corresponding to the method to be tested in a preset time interval.

Further, on the basis of any one of the foregoing embodiments, the apparatus further includes: and the report generation module is used for generating a performance report according to the target performance data. And the performance optimization module is used for performing performance optimization operation on the target application according to the performance report.

Further, on the basis of any one of the above embodiments, the performance optimization module is configured to: and comparing the performance report of the target application of the current version with the performance report of the target application of the historical version, and determining a method to be optimized of the target application of the current version relative to the target application of the historical version. And carrying out optimization operation on the method to be optimized corresponding to the target application.

Further, on the basis of any one of the above embodiments, the performance optimization module is configured to: and comparing the performance report of the target application with performance reports of other preset applications, and determining that the other applications exceed the target performance of the target application, wherein the other applications are similar to the target application. And performing performance optimization operation on the target application according to the target performance and the method corresponding to the target performance.

The device provided in this embodiment may be used to execute the technical solution of the foregoing method embodiment, and its implementation principle and technical effects are similar, and this embodiment will not be described herein again.

In order to achieve the above embodiments, the embodiments of the present disclosure further provide an electronic device, including: a processor and a memory.

The memory stores computer-executable instructions;

the processor executing computer-executable instructions stored in the memory causes the processor to perform the performance test method as described in any of the embodiments above.

Fig. 6 is a schematic structural diagram of an electronic device according to an embodiment of the disclosure, and as shown in fig. 6, the electronic device 600 may be a terminal device or a server. The terminal device may include, but is not limited to, a mobile terminal such as a mobile phone, a notebook computer, a digital broadcast receiver, a personal digital assistant (Personal Digital Assistant, PDA for short), a tablet (Portable Android Device, PAD for short), a portable multimedia player (Portable Media Player, PMP for short), an in-vehicle terminal (e.g., an in-vehicle navigation terminal), and the like, and a fixed terminal such as a digital TV, a desktop computer, and the like. The electronic device shown in fig. 6 is merely an example and should not be construed to limit the functionality and scope of use of the disclosed embodiments.

As shown in fig. 6, the electronic apparatus 600 may include a processing device (e.g., a central processing unit, a graphics processor, etc.) 601 that may perform various appropriate actions and processes according to a program stored in a Read Only Memory (ROM) 602 or a program loaded from a storage device 608 into a random access Memory (Random Access Memory, RAM) 603. In the RAM 603, various programs and data required for the operation of the electronic apparatus 600 are also stored. The processing device 601, the ROM 602, and the RAM 603 are connected to each other through a bus 604. An input/output (I/O) interface 605 is also connected to bus 604.

In general, the following devices may be connected to the I/O interface 605: input devices 606 including, for example, a touch screen, touchpad, keyboard, mouse, camera, microphone, accelerometer, gyroscope, and the like; an output device 607 including, for example, a liquid crystal display (Liquid Crystal Display, LCD for short), a speaker, a vibrator, and the like; storage 608 including, for example, magnetic tape, hard disk, etc.; and a communication device 609. The communication means 609 may allow the electronic device 600 to communicate with other devices wirelessly or by wire to exchange data. While fig. 6 shows an electronic device 600 having various means, it is to be understood that not all of the illustrated means are required to be implemented or provided. More or fewer devices may be implemented or provided instead.

In particular, according to embodiments of the present disclosure, the processes described above with reference to flowcharts may be implemented as computer software programs. For example, embodiments of the present disclosure include a computer program product comprising a computer program embodied on a computer readable medium, the computer program comprising program code for performing the method shown in the flowcharts. In such an embodiment, the computer program may be downloaded and installed from a network via communication means 609, or from storage means 608, or from ROM 602. The above-described functions defined in the methods of the embodiments of the present disclosure are performed when the computer program is executed by the processing device 601.

Still another embodiment of the present disclosure further provides a computer-readable storage medium having stored therein computer-executable instructions that, when executed by a processor, implement a performance test method as in any one of the above embodiments.

Yet another embodiment of the present disclosure also provides a computer program product comprising a computer program which, when executed by a processor, implements a method of performance testing as described in any of the embodiments above.

It should be noted that the computer readable medium described in the present disclosure may be a computer readable signal medium or a computer readable storage medium, or any combination of the two. The computer readable storage medium can be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or a combination of any of the foregoing. More specific examples of the computer-readable storage medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the context of this disclosure, a computer-readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. In the present disclosure, however, the computer-readable signal medium may include a data signal propagated in baseband or as part of a carrier wave, with the computer-readable program code embodied therein. Such a propagated data signal may take any of a variety of forms, including, but not limited to, electro-magnetic, optical, or any suitable combination of the foregoing. A computer readable signal medium may also be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device. Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to: electrical wires, fiber optic cables, RF (radio frequency), and the like, or any suitable combination of the foregoing.

The computer readable medium may be contained in the electronic device; or may exist alone without being incorporated into the electronic device.

The computer-readable medium carries one or more programs which, when executed by the electronic device, cause the electronic device to perform the methods shown in the above-described embodiments.

Computer program code for carrying out operations of the present disclosure may be written in one or more programming languages, including an object oriented programming language such as Java, smalltalk, C ++ and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any kind of network, including a local area network (Local Area Network, LAN for short) or a wide area network (Wide Area Network, WAN for short), or it may be connected to an external computer (e.g., connected via the internet using an internet service provider).

The flowcharts and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.

The units involved in the embodiments of the present disclosure may be implemented by means of software, or may be implemented by means of hardware. The name of the unit does not in any way constitute a limitation of the unit itself, for example the first acquisition unit may also be described as "unit acquiring at least two internet protocol addresses".

The functions described above herein may be performed, at least in part, by one or more hardware logic components. For example, without limitation, exemplary types of hardware logic components that may be used include: a Field Programmable Gate Array (FPGA), an Application Specific Integrated Circuit (ASIC), an Application Specific Standard Product (ASSP), a system on a chip (SOC), a Complex Programmable Logic Device (CPLD), and the like.

In the context of this disclosure, a machine-readable medium may be a tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. The machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. The machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing. More specific examples of a machine-readable storage medium would include an electrical connection based on one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

In a first aspect, according to one or more embodiments of the present disclosure, there is provided a performance testing method, including:

triggering the target application through a preset test case;

According to one or more embodiments of the present disclosure, the installing the target application into a preset sandboxed environment according to the performance test request includes:

detecting whether the target application has an updated version in each application acquisition channel according to a preset time period or in response to a query request triggered by a user;

if yes, acquiring the target application of the updated version, and installing the target application of the updated version into a preset sandbox environment;

According to one or more embodiments of the present disclosure, the performance test request further includes an identifier of the method to be tested;

before the hook function corresponding to the performance type to be tested is adopted to collect the target performance data of the performance type to be tested corresponding to the target application, the method further comprises the following steps:

generating hook function logic corresponding to the performance type to be tested according to the performance type to be tested;

and adding the mark of the to-be-tested method in the preset position in the hook function logic to obtain a hook function, wherein the hook function can acquire performance data corresponding to the to-be-tested performance type of the to-be-tested method in operation.

According to one or more embodiments of the present disclosure, the performance types under test include time-consuming performance types; the performance test request also comprises an identifier of a method to be tested;

the acquiring the target performance data of the performance type to be tested corresponding to the target application by adopting the hook function corresponding to the performance type to be tested comprises the following steps:

determining the starting operation time and the ending operation time corresponding to the method to be tested identifier through a hook function corresponding to the time consuming performance type;

According to one or more embodiments of the present disclosure, the performance type under test includes a consumption performance type; the performance test request also comprises an identifier of a method to be tested;

determining a first memory corresponding to the method to be tested identifier when the method to be tested starts to operate through a hook function corresponding to the memory variation performance type, and determining a second memory corresponding to the method to be tested when the method to be tested ends to operate;

According to one or more embodiments of the present disclosure, the performance type under test includes a frame rate variation performance type; the performance test request also comprises an identifier of a method to be tested;

determining the drawing times of the method to be tested corresponding to the mark of the method to be tested in a preset time interval through a hook function corresponding to the frame rate variation performance type;

According to one or more embodiments of the present disclosure, after the target performance data of the performance type to be measured corresponding to the target application is collected by using a hook function corresponding to the performance type to be measured during the running process of the target application, the method further includes:

generating a performance report according to the target performance data;

and performing performance optimization operation on the target application according to the performance report.

According to one or more embodiments of the present disclosure, the performing a performance optimization operation on the target application according to the performance report includes:

comparing the performance report of the target application of the current version with the performance report of the target application of the historical version, and determining a method to be optimized of the target application of the current version relative to the target application of the historical version;

Comparing the performance report of the target application with performance reports of other preset applications, and determining that the other applications exceed the target performance of the target application, wherein the other applications are similar applications to the target application;

In a second aspect, according to one or more embodiments of the present disclosure, there is provided a performance testing apparatus comprising:

According to one or more embodiments of the present disclosure, the mounting module is for:

the apparatus further comprises:

the generating module is used for generating hook function logic corresponding to the performance type to be detected according to the performance type to be detected;

the adding module is used for adding the identification of the method to be tested at a preset position in the hook function logic to obtain a hook function, and the hook function can acquire performance data corresponding to the performance type to be tested of the method to be tested when in operation.

the processing module is used for:

According to one or more embodiments of the present disclosure, the apparatus further comprises:

a report generation module for generating a performance report from the target performance data;

and the performance optimization module is used for performing performance optimization operation on the target application according to the performance report.

According to one or more embodiments of the present disclosure, the performance optimization module is configured to:

In a third aspect, according to one or more embodiments of the present disclosure, there is provided an electronic device comprising: at least one processor and memory;

the memory stores computer-executable instructions;

the at least one processor executes the computer-executable instructions stored by the memory to cause the at least one processor to perform the performance testing method as described above in the first aspect and the various possible designs of the first aspect.

In a fourth aspect, according to one or more embodiments of the present disclosure, there is provided a computer-readable storage medium having stored therein computer-executable instructions which, when executed by a processor, implement the performance test method as described above in the first aspect and the various possible designs of the first aspect.

In a fifth aspect, according to one or more embodiments of the present disclosure, there is provided a computer program product comprising a computer program which, when executed by a processor, implements the performance test method according to the first aspect and the various possible designs of the first aspect as described above

The foregoing description is only of the preferred embodiments of the present disclosure and description of the principles of the technology being employed. It will be appreciated by persons skilled in the art that the scope of the disclosure referred to in this disclosure is not limited to the specific combinations of features described above, but also covers other embodiments which may be formed by any combination of features described above or equivalents thereof without departing from the spirit of the disclosure. Such as those described above, are mutually substituted with the technical features having similar functions disclosed in the present disclosure (but not limited thereto).

Moreover, although operations are depicted in a particular order, this should not be understood as requiring that such operations be performed in the particular order shown or in sequential order. In certain circumstances, multitasking and parallel processing may be advantageous. Likewise, while several specific implementation details are included in the above discussion, these should not be construed as limiting the scope of the present disclosure. Certain features that are described in the context of separate embodiments can also be implemented in combination in a single embodiment. Conversely, various features that are described in the context of a single embodiment can also be implemented in multiple embodiments separately or in any suitable subcombination.

Although the subject matter has been described in language specific to structural features and/or methodological acts, it is to be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or acts described above. Rather, the specific features and acts described above are example forms of implementing the claims.

Claims

1. A performance testing method, comprising:

triggering the target application through a preset test case;

2. The method of claim 1, wherein installing the target application into a preset sandboxed environment according to the performance test request comprises:

3. The method of claim 1, wherein the performance test request further includes an identification of the method under test;

4. The method of claim 1, wherein the performance type under test comprises a time-consuming performance type; the performance test request also comprises an identifier of a method to be tested;

5. The method of claim 1, wherein the performance type under test comprises a consumption performance type; the performance test request also comprises an identifier of a method to be tested;

6. The method of claim 1, wherein the performance type under test comprises a frame rate change performance type; the performance test request also comprises an identifier of a method to be tested;

7. The method according to any one of claims 1-6, wherein, during the running of the target application, after collecting target performance data of the performance type to be tested corresponding to the target application using a hook function corresponding to the performance type to be tested, the method further comprises:

generating a performance report according to the target performance data;

8. The method of claim 7, wherein said performing a performance optimization operation on said target application based on said performance report comprises:

9. The method of claim 7, wherein said performing a performance optimization operation on said target application based on said performance report comprises:

10. A performance testing apparatus, comprising:

11. An electronic device, comprising: a processor and a memory;

the memory stores computer-executable instructions;

the processor executing computer-executable instructions stored in the memory, causing the processor to perform the performance testing method of any one of claims 1 to 9.

12. A computer readable storage medium having stored therein computer executable instructions which, when executed by a processor, implement the performance test method of any one of claims 1 to 9.

13. A computer program product comprising a computer program which, when executed by a processor, implements the method of performance testing according to any one of claims 1 to 9.