CN110442499B

CN110442499B - Method and device for testing and improving page response performance and terminal equipment

Info

Publication number: CN110442499B
Application number: CN201910621106.6A
Authority: CN
Inventors: 唐小路; 郭小溪; 温元良; 乔瑞凯; 冯博; 张洋
Original assignee: Advanced New Technologies Co Ltd
Current assignee: Advanced New Technologies Co Ltd; Advantageous New Technologies Co Ltd
Priority date: 2019-07-10
Filing date: 2019-07-10
Publication date: 2023-08-04
Anticipated expiration: 2039-07-10
Also published as: CN110442499A

Abstract

The invention discloses a method for testing page response performance, a method for improving page response performance, a device for testing page response performance and terminal equipment. The method for testing the page response performance comprises the following steps: acquiring a screen recording of page response, extracting page features from frame pages of last frames of the screen recording, and determining a response frame page from the screen recording according to the extracted page features so as to calculate time consumed by the page response according to the moment when the response frame page appears.

Description

Method and device for testing and improving page response performance and terminal equipment

Technical Field

The present invention relates to computer technology, and more particularly, to a method of testing page response performance, a method of improving page response performance, an apparatus for testing page response performance, and a terminal device.

Background

With the rapid development of the mobile internet and the rapid popularization of intelligent devices worldwide, users have become more and more accustomed to realizing communication, shopping, payment and entertainment functions through various Applications (APP).

The response speed of the application page is related to the network environment in which the intelligent device is located, the performance of the intelligent device and the design of the application itself. Generally, the response speed of a processor, a memory and an operating system of the intelligent device to an application page is directly affected, and the starting mode of the application, the rendering complexity of the page, the interface control level and the like may also be affected on the response speed of the application page.

The basic expectation of the user for the application is that the application is smooth to use, if the response speed of the application is slow, the user cannot meet the user expectation, the user can be caused to evaluate the intelligent device or the application poorly, and even the user can be caused to replace the intelligent device or uninstall the application.

Therefore, the response speed of the application page is a very important evaluation index, and it is necessary to provide a scheme for testing the response performance of the page with high efficiency.

Disclosure of Invention

It is an object of the present invention to provide a solution for testing page response performance with high efficiency.

According to a first aspect of the present invention, there is provided a method of testing page response performance, comprising the steps of:

acquiring a screen recording of a page response, wherein the page response is caused by an event of operating a first control, and the screen recording comprises a process from the event of operating the first control to the end of the page response;

extracting page features from a frame page of the last frame or frames of the frame sequence of the screen recording;

determining a response frame page from the frame sequence according to the page characteristics;

and calculating the time consumed by page response according to the time of the event of operating the first control and the time of the page of the response frame.

Optionally or more optionally, the determining a response frame page from the frame sequence according to the page feature includes:

determining a comparison mode according to the page characteristics;

and comparing and analyzing the frame pages of the frame sequence according to the comparison method to determine the response frame pages.

Optionally or more optionally, the method further comprises: acquiring equipment information of equipment where the page response is located, and determining whether the server or the equipment performs the comparison analysis according to the equipment information and the comparison method;

the device information includes any one or any combination of the following: system running memory, system load, available memory, CPU core number, CPU frequency, GPU performance parameters, power, device model.

Optionally or more optionally, the page features include any one or any combination of the following: degree of solid, dynamic area, control distribution.

Optionally or more optionally, the page feature comprises a dynamic region;

the determining a response frame page from the frame sequence according to the page features comprises:

determining a first part of a frame page of the frame sequence, wherein the first part of the frame page is a part corresponding to the dynamic region;

A response frame page is determined by comparing other portions of the frame pages of the sequence of frames.

Optionally or more optionally, the page feature includes a degree of solid color;

and if the solid degree is greater than a preset threshold value, determining a response frame page by comparing pixels of the frame pages of the frame sequence.

Optionally or more optionally, the page features include a control distribution;

and determining a response frame page by comparing the control distribution of the frame pages of the frame sequence.

Optionally or more optionally, the acquiring the screen of the page response includes:

monitoring whether the first control is operated, and if so, starting a screen recording; or, responding to an instruction for starting screen recording, and starting the screen recording;

and responding to an instruction for ending the screen recording, and ending the screen recording.

Optionally or more optionally, the method further comprises:

timing the screen recording, and triggering the instruction for ending the screen recording after the screen recording time reaches a preset first time threshold; or alternatively, the process may be performed,

monitoring a system log of the equipment where the page response is located, determining whether to end screen recording according to the system log, and triggering the instruction for ending screen recording if the screen recording is determined to be ended; or alternatively, the process may be performed,

And monitoring whether a second control appears, and triggering the instruction for ending the screen recording if the second control appears.

According to a second aspect of the present invention, there is provided a method of improving page response performance, comprising a method of testing page response performance according to any of the preceding claims, further comprising:

if the time spent by the page response is greater than a preset second time threshold, any one or any combination of the following operations are executed:

prompting a user to check the network environment;

prompting a user to clean equipment garbage;

prompting a user to close the inactive application or directly close the inactive application;

prompting a user to set the application to which the page response belongs to a very simple page mode or directly set the application to which the page response belongs to the very simple page mode.

According to a third aspect of the present invention there is provided an apparatus for testing page response performance, comprising:

the acquisition module is used for acquiring a screen recording of page response, wherein the page response is caused by an event of operating the first control, and the screen recording comprises a process from the event of operating the first control to the end of the page response;

the extraction module is used for extracting page characteristics from a frame page of the last frame or frames of the frame sequence of the screen recording;

The determining module is used for determining a response frame page from the frame sequence according to the page characteristics;

and the calculation module is used for calculating the time consumed by page response according to the time of the event of operating the first control and the time of the page occurrence of the response frame.

Optionally or preferably, the determining a response frame page from the frame sequence according to the page feature includes:

determining a comparison mode according to the page characteristics;

Optionally or preferably, the page features include any one or any combination of the following: degree of solid, dynamic area, control distribution.

Optionally or preferably, the page feature comprises a dynamic region;

Optionally or preferably, the page feature comprises a degree of solid color;

Optionally or preferably, the page features include a control distribution;

Optionally or preferably, the acquiring module includes:

the screen recording starting module is used for monitoring whether the first control is operated or not, and starting screen recording if the first control is operated; or, the method is used for responding to an instruction for starting screen recording and starting the screen recording;

and the screen recording ending module is used for responding to the screen recording ending instruction and ending the screen recording.

Optionally or preferably, the acquiring module further comprises a triggering module;

the triggering module is used for timing the screen recording, and triggering the instruction for ending the screen recording after the screen recording time reaches a preset first time threshold; or alternatively, the process may be performed,

the triggering module is used for monitoring a system log of the equipment where the page response is located, determining whether to end screen recording according to the system log, and triggering the instruction for ending screen recording if the screen recording is determined to be ended; or alternatively, the process may be performed,

And the triggering module is used for monitoring whether the second control appears, and triggering the instruction for ending the screen recording if the second control appears.

According to a fourth aspect of the present invention, there is provided a terminal device, including an apparatus for testing page response performance as any one of the foregoing, further including:

the performance enhancing module is configured to perform any one or any combination of the following operations if the time spent by the page response is greater than a preset second time threshold:

prompting a user to check the network environment;

prompting a user to clean equipment garbage;

According to a fifth aspect of the present invention there is provided an apparatus for testing page response performance comprising a memory and a processor;

the memory stores a computer program which when executed by the processor implements the method of testing page response performance of any of the preceding claims.

According to a sixth aspect of the present invention, there is provided a terminal device comprising a memory, a processor, and a display screen;

The memory stores a computer program which when executed by the processor implements a method of testing page response performance as claimed in any preceding claim, and implements the method of:

prompting a user to check the network environment;

prompting a user to clean equipment garbage;

Based on the scheme for testing the page response performance provided by the embodiment of the invention, the time of the page of the response frame can be automatically confirmed according to the page characteristics of the last frames of the page response, and the time consumed by the page response is further determined. The scheme for testing the response performance of the page provided by the embodiment of the invention can automatically confirm the occurrence time of the response frame page, and improves the testing efficiency.

Other features of the present invention and its advantages will become apparent from the following detailed description of exemplary embodiments of the invention, which proceeds with reference to the accompanying drawings.

Drawings

The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments of the invention and together with the description, serve to explain the principles of the invention.

FIG. 1 is a block diagram of an application system provided by an embodiment of the present invention;

FIG. 2 is a flow chart of a method for testing page response performance provided by an embodiment of the present invention;

FIG. 3 is a schematic diagram of a final state frame page provided by an embodiment of the present invention;

FIG. 4 is a schematic diagram of a final state frame page provided by an embodiment of the present invention;

FIG. 5 is a schematic diagram of a final state frame page provided by an embodiment of the present invention;

FIG. 6 is a flowchart of a method for improving page response performance provided by an embodiment of the present invention;

FIG. 7 is a schematic diagram of a testing apparatus according to an embodiment of the present invention;

FIG. 8 is a schematic diagram of an acquisition module according to an embodiment of the present invention;

fig. 9 is a schematic diagram of a terminal device provided in an embodiment of the present invention;

FIG. 10 is a schematic diagram of a testing apparatus provided by an embodiment of the present invention;

fig. 11 is a schematic diagram of a terminal device provided in an embodiment of the present invention.

Detailed Description

Various exemplary embodiments of the present invention will now be described in detail with reference to the accompanying drawings. It should be noted that: the relative arrangement of the components and steps, numerical expressions and numerical values set forth in these embodiments do not limit the scope of the present invention unless it is specifically stated otherwise.

The following description of at least one exemplary embodiment is merely exemplary in nature and is in no way intended to limit the invention, its application, or uses.

Techniques, methods, and apparatus known to one of ordinary skill in the relevant art may not be discussed in detail, but are intended to be part of the specification where appropriate.

In all examples shown and discussed herein, any specific values should be construed as merely illustrative, and not a limitation. Thus, other examples of exemplary embodiments may have different values.

It should be noted that: like reference numerals and letters denote like items in the following figures, and thus once an item is defined in one figure, no further discussion thereof is necessary in subsequent figures.

< application System >

Fig. 1 is a block diagram of an application system provided in an embodiment of the present invention. As shown in fig. 1, the system includes an application server 101, a network 102, and a terminal device 103. The application server 101 and the terminal device 103 are communicatively connected through a network 102. The terminal device 103 may be one or more, and a plurality of terminal devices 103 are shown in the figure. Of course, the application server 101 may also be directly connected to the terminal device 103 in communication.

Configuration of the application server 101 may include, but is not limited to, a processor 1011, a memory 1012, an interface device 1013, a communication device 1014, an input device 1015, an output device 1016. The processor 1011 may include, but is not limited to, a central processing unit CPU, a microprocessor MCU, and the like. The memory 1012 may include, but is not limited to, ROM (read Only memory), RAM (random Access memory), nonvolatile memory such as a hard disk, and the like. Interface device 1013 may include, but is not limited to, a USB interface, a serial interface, a parallel interface, and the like. The communication means 1014 can be, for example, wired or wireless communication, and specifically can include WiFi communication, bluetooth communication, 2G/3G/4G/5G communication, and the like. Input devices 1015 include, but are not limited to, a keyboard, mouse, touch screen, microphone, and the like. Output devices 1016 include, but are not limited to, a display screen, speakers, etc. The configuration of the application server 101 may include only some of the above-described devices.

The terminal device 103 may be, for example, an electronic device with an intelligent operating system (e.g., android, IOS, windows, linux, etc.) installed, including but not limited to a laptop, desktop, cell phone, tablet, etc. The configuration of the terminal equipment 103 includes, but is not limited to, a processor 1031, a memory 1032, an interface device 1033, a communication device 1034, a GPU (Graphics Processing Unit, image processor) 1035, a display device 1036, an input device 1037, a speaker 1038, a microphone 1039, and a camera 1030. The processor 1031 includes, but is not limited to, a central processing unit CPU, a microprocessor MCU, and the like. The memory 1032 includes, but is not limited to, ROM (read only memory), RAM (random access memory), nonvolatile memory such as a hard disk, and the like. The interface device 1033 includes, but is not limited to, a USB interface, a serial interface, a parallel interface, and the like. The communication device 1034 can be capable of wired or wireless communication, and specifically can include WiFi communication, bluetooth communication, 2G/3G/4G/5G communication, and the like, for example. The GPU 1035 is used for processing images. The display device 1036 includes, but is not limited to, a liquid crystal screen, a touch screen, and the like. Input devices 1037 include, but are not limited to, a keyboard, mouse, touch screen, and the like. The configuration of the terminal device 103 may also include only some of the above-described means.

In the embodiment of the present invention, a user may operate an Application (APP) carried by the terminal device 103, and the terminal device 103 runs the application to implement a function required by the user. The application server 101 provides background support for the application, and interaction with the application server 101 may be required during the running of the application by the terminal device 103.

The user may operate the application carried by the terminal device 103 through a control. A control here refers to an object in which a user can input instructions or data. The controls may be physical or virtual. The physical controls may be, for example, physical buttons, a keyboard, a mouse, a microphone, a joystick, etc., and the virtual controls may be, for example, application icons, virtual buttons, a virtual keyboard, a virtual mouse, a text box, an input window, a progress bar, a scroll bar, etc., presented on the display screen of the terminal device 103. User manipulation of the control may cause a change in the displayed page of the terminal device 103, a process which may be referred to as a page response.

The terminal device 103 may have a screen recording function, i.e. the terminal device 103 may record the content presented on its own screen.

The application system shown in fig. 1 is merely illustrative and is in no way meant to limit the invention, its application or use. It will be appreciated by those skilled in the art that although a number of means of the application server 101 and the terminal device 103 have been described above, the present invention may relate to only some of these. For example, the application server 101 may involve only a processor, a memory, and a communication means, and the terminal device 103 may involve only a processor, a memory, a communication means, a display screen, and a speaker. Those skilled in the art can devise instructions in accordance with the disclosed aspects of the present invention. How the instructions control the processor to operate is well known in the art and will not be described in detail here.

< method of testing Page response Performance >

FIG. 2 is a flow chart of a method for testing page response performance provided by an embodiment of the present invention. The method for testing page response performance provided by the embodiment of the present invention may be a test of page response performance of an application carried by the terminal device 103, or a test of page response performance of software carried by other electronic devices, which is not limited by the embodiment of the present invention.

The following describes a method for testing page response performance of the terminal device 103, taking the terminal device 103 as an example, including the following steps:

202. and acquiring a screen recording of a page response, wherein the page response is caused by an event of operating the first control, and the screen recording comprises a process from the occurrence of the event of operating the first control to the end of the page response.

204. And extracting page characteristics from the frame page of the last frame or frames of the frame sequence of the screen recording.

206. And determining a response frame page from the frame sequence of the recording screen according to the extracted page characteristics.

208. And calculating the time consumed by page response according to the time of the event of operating the first control and the time of the page occurrence of the response frame.

Any of steps 202, 204, 206, and 208 may be performed by the terminal device 103, or may be performed by a testing apparatus (e.g., the application server 101 or other cloud server as a testing apparatus) separate from the terminal device 103.

Based on the method for testing the page response performance provided by the embodiment of the invention, the time of the page of the response frame can be automatically confirmed according to the page characteristics of the last frames of the page response, and the time consumed by the page response is further determined. The method for testing the page response performance provided by the embodiment of the invention can automatically confirm the occurrence time of the response frame page, thereby improving the test efficiency. According to the method for testing the page response performance, which is provided by the embodiment of the invention, the response frame page is confirmed according to the page characteristics of the last frames of the page response, so that the test result can more embody the visual feeling of the user on the page response.

The following describes the steps in detail:

In a specific example, the act of starting the recording may be performed by step 2022 or step 2024:

2022. responding to an instruction for starting screen recording, and starting the screen recording; the event that operates the first control occurs after the start of the recording.

In step 2022, an instruction to start recording is issued by the user operating at the terminal device 103. For example, a "screen recording" button is provided on the interface of the terminal device 103, and the user can issue an instruction to start screen recording by clicking the "screen recording" button on the touch screen of the terminal device 103, so as to start screen recording. Or, a test program is preset, and the test program sends out an instruction for starting screen recording so as to start the screen recording.

The screen recording is started before the event of operating the first control occurs, so that the fact that the event of operating the first control occurs can be recorded by the screen recording, and the process from the event of operating the first control to the end of page response is ensured to be included in the screen recording.

2024. Monitoring whether the first control is operated, and if the first control is operated, starting the screen recording.

In step 2024, the first control of the terminal device 103 may be operated by the user. For example, the first control is an application icon, and the user clicks the application icon on the touch screen of the terminal device 103 to open the main page of the application. And monitoring the application icon, and starting a screen recording when the application icon is clicked. Or, a test program is preset, and the test program operates the first control to start the screen recording.

It should be noted that the test program mentioned in the foregoing step 2022 or step 2024, and the test program mentioned later may be provided in the terminal apparatus 103, or may be provided in a test device separate from the terminal apparatus 103. If provided in a testing device separate from the terminal device 103, communication between the testing device and the terminal device 103 is possible. The testing device may be, for example, the aforementioned application server 101 or other cloud server.

The screen recording in the embodiment of the present invention may be obtained by recording the screen of the terminal device 103. Or may be obtained by photographing the screen of the terminal device 103 under the control of a test program by an imaging device separate from the terminal device 103. The camera device may be integrated in the test device, for example. The recording codec, resolution, bit rate and frame number used for the recording may be preset.

In a specific example, ending the recording may be accomplished by step 2026:

2026. and responding to an instruction for ending the screen recording, and ending the screen recording.

In step 2026, the terminal device 103 may be operated by the user to issue an instruction to end the screen recording, thereby ending the screen recording.

Or the test program counts the time of the screen recording when the screen recording starts, and when the screen recording time reaches a preset first time threshold, the instruction of ending the screen recording is triggered. The user may empirically set a first time threshold, for example, the user may estimate the time required for the page response based on a history of page responses, and set the first time threshold based on this time. The first time threshold is to be able to cover the process of ending the response.

Or, the test program monitors the system log of the terminal device 103, determines whether to end the screen recording according to the system log, and triggers an instruction for ending the screen recording if the screen recording is determined to end. When the page response is finished, the system of the terminal device 103 generates a system log corresponding to the page response, and after the test program monitors the system log corresponding to the page response, the test program determines that the screen recording can be finished and triggers an instruction for finishing the screen recording.

Or monitoring whether the second control appears by the test program, and triggering an instruction for ending the screen recording if the second control appears. The second control is a control on the page presented by the terminal device 103 after the page response is completed. When the second control appears, the page response is finished, and an instruction for ending the screen recording is triggered.

Or the mechanical arm simulates the operation of a user, so that the operation of the first control, the operation of starting screen recording and the operation of ending screen recording are realized.

After the screen recording is acquired, the frame sequence is analyzed from the screen recording. In a specific example, the screen may be uniformly framed according to a preset frame rate to obtain a frame sequence.

In one embodiment, the page features are extracted from the frame pages of the last N frames of the sequence of frames of the screen, N being a positive integer. Or extracting page characteristics from the frame pages of the last M frames of the frame sequence of the screen recording, wherein the proportion of the M frames to the total frame number of the frame sequence of the screen recording is a preset proportion, and M is a positive integer. In a specific example, the proportion of M frames to the total number of frames of the frame sequence of the recording is about 10%.

When extracting the page features from the frame pages of the last multiframe of the frame sequence of the screen recording, the extracted page features may be the page features of all or most of the multiframes.

The page features may include any one or any combination of the following: degree of solid, dynamic area, control distribution.

For convenience of description, the frame page of the last frame or frames of the frame sequence of the screen recording of step 204 will be referred to as "final frame page" hereinafter.

The dynamic region of a page refers to the region of the page that changes over time. The page feature of "dynamic region" is described with reference to fig. 3: the final state frame pages include a frame page 501, a frame page 502, and a frame page 503 in time order. As can be seen in fig. 3, in frame page 501, region 11 is used to display advertisement 1 and region 12 is used to display advertisement 2. In the following frame page 502, region 11 is used to display advertisement 3 and region 13 is used to display advertisement 4. In the more later frame page 503, region 11 is used to display advertisement 5 and region 13 is used to display advertisement 6. Advertisement 1, advertisement 3, advertisement 5 are different advertisements, advertisement 2, advertisement 4, advertisement 6 are different advertisements. This means that the areas 11 and 12 are dynamic areas, whose contents presented change over time.

In one embodiment, the dynamic region may include a carousel region. For any dynamic area, if the dynamic area alternately displays a plurality of preset contents, the dynamic area is a carousel area.

The solid degree of a page refers to the concentration degree of colors in the page. See FIG. 4 for an illustration of the page feature "solid degree": the final frame page 504 includes the color block 21 and the color block 22, the part of the frame page 504 except the color block 21 and the color block 22 is another color and occupies most of the area, and the degree of the solid color of the frame page 504 can be obtained by calculating the ratio of the area of the part except the color block 21 and the color block 22 to the total area of the frame page 504. In another embodiment, the final frame page may be converted into a gray scale map, to obtain a gray scale value of each pixel, and the concentration degree of the gray scale values of the pixels is calculated and used as the solid degree of the final frame page. Those skilled in the art may calculate the degree of solid color of a page in a number of ways, and embodiments of the present invention are not limited in this regard.

The control distribution of the page may include one or more of the control elements of position, shape, size, number of controls. The page feature of "control distribution" is described with reference to fig. 5: the final state frame page 505 includes 4 controls, namely a rectangular control 31, a special-shaped control 32, a round control 33 and a round control 34.

In one embodiment, determining a response frame page from a sequence of frames of a recording based on the extracted page features includes:

2062. and determining a comparison mode according to the extracted page characteristics.

2064. And carrying out comparison analysis on the frame pages of the frame sequence according to the determined comparison mode so as to determine response frame pages.

In steps 2062 and 2064, a suitable comparison method is selected according to the page characteristics of the last frames of the page response, and obviously, the comparison method selected in this way is more suitable for the page response, so that the test result can more embody the intuitive feeling of the user on the page response.

In step 2064, the frame pages of the frame sequence are subjected to a comparison analysis to determine response frame pages, which may be performed by way of clustering. For example, the frame pages are clustered along the time sequence of the occurrence of the frame pages in a clustering mode, so that the frame sequence is segmented into at least two sub-sequences according to the front-to-back sequence, frames in the same sub-sequence are more similar, and the first frame of the last sub-sequence is used as a response frame page.

In step 2064, the frame pages of the sequence of frames are subjected to a comparison analysis to determine response frame pages, which may be determined based on the similarity between the frame pages. For example, a frame is selected that has a similarity to the final state frame page that reaches a first similarity threshold and that has a similarity to the frame page of its previous frame that is less than a second similarity threshold. When the selected frames are a plurality of frames, selecting a first frame in the plurality of frames as a response frame page; when the selected frame is one, the frame is a response frame page. In a specific example, the first similarity threshold may be 60% and the second similarity threshold may be 90%.

In another specific example, in step 2064, the frame sequence may be first decimated and then the response frame page determined. For example, a frame is extracted every D frames in the frame sequence, the extracted frame forms a new frame sequence, and the frame page of the new frame sequence is subjected to the above comparative analysis to obtain a suspected response frame. D frames from the D frame before to the D frame after the suspected response frame of the original frame sequence form another frame sequence, the contrast analysis is carried out on the other frame sequence again, and the response frame page is determined from the other frame sequence. The method for processing the first extracted frame and then determining the response frame can reduce the calculated amount and accelerate the processing speed.

In step 2064, the comparison element (e.g., the element on which the clustering basis, e.g., the element on which the similarity comparison basis is performed) on the frame page of the frame sequence based on the determined comparison method is set according to the page characteristics of the final frame page. Further explanation of steps 206, 2062, 2064 will be provided below using the final state frame page shown in FIGS. 3-5 as an example.

Referring to fig. 3, the final state frame page includes a dynamic region. The determining a response frame page from the frame sequence of the recording according to the extracted page characteristics comprises the following steps: determining a first part of a frame page of a frame sequence, wherein the first part of the frame page is a part corresponding to the dynamic region; the response frame page is determined by comparing other portions of the frame page of the frame sequence.

That is, when the dynamic region is included in the final-state frame page, a portion of the frame page corresponding to the dynamic region may be cut off, and the response frame page may be determined using the remaining page portion after the cut off.

Corresponding to step 2062 and step 2064, the selected comparison method will first perform the step of intercepting the dynamic region, and then use the intercepted residual page portion to perform comparison analysis to determine the response frame page.

Referring to fig. 4, if the solid degree of the final frame page is greater than the set solid degree threshold, it is determined that the final frame page belongs to the solid page. If the final state frame page belongs to a solid color page, a response frame page is determined by comparing pixels of the frame pages of the frame sequence. The pure chromaticity threshold is, for example, 70%.

In one example, comparing pixels of frame pages of a sequence of frames to determine a response frame page may be by converting the frame page to a grayscale page and comparing the grayscale values of the pixels to determine the response frame page.

In one example, comparing pixels of frame pages of a sequence of frames determines a response frame page, which may be determined by comparing color components of the pixels.

Corresponding to step 2062 and step 2064, the selected comparison is to determine the response frame page by comparing the gray values or color components of the pixels of the analysis frame page.

Referring to FIG. 5, the page features of the final state frame page include a control distribution. The determining a response frame page from the frame sequence of the recording according to the extracted page characteristics comprises the following steps: and determining a response frame page by comparing the control distribution of the frame pages of the frame sequence.

Specifically, when one or more controls are included in the final state frame page, the response frame page may be determined by comparing the distribution of the controls of the frame page, for example, comparing the positions, shapes, sizes, and numbers of the controls of the frame page.

Corresponding to step 2062 and step 2064, the selected comparison is to compare the control distribution of the analysis frame page to determine the response frame page.

In another specific example, the page features of the final state frame page may include a variety of page features. For example: the page features of the final state frame page include both dynamic regions and control distributions. When determining the response frame page, firstly, intercepting out the part of the frame page corresponding to the dynamic region. Then, the response frame page is determined by comparing the control distribution of the rest part after the frame page is intercepted.

In another specific example, the page features of the final state frame page include both dynamic regions and degrees of solid. When determining the response frame page, firstly, intercepting out the part of the frame page corresponding to the dynamic region. Then, if the final state frame page belongs to the solid color page, the response frame page is determined by comparing the pixels of the remaining portion after the frame page is truncated.

In another specific example, the page features of the final state frame page include both dynamic regions, degrees of solid, and control distributions. When determining the response frame page, firstly, intercepting out the part of the frame page corresponding to the dynamic region. Then, if the final state frame page belongs to the solid color page, the response frame page is determined by comparing the pixels of the remaining portion after the frame page is truncated. If the final state frame page does not belong to the solid color page and has a control, determining a response frame page by comparing the control distribution conditions of the rest part after the frame page is intercepted. Or if the number of the controls in the final state frame page is larger than a certain number, whether the final state frame page is solid or not is not considered, and the response frame page is determined directly by comparing the control distribution conditions of the rest part after the frame page is intercepted.

In addition, it may be determined whether step 2064 is performed by the device in which the page response is located or by a testing device (e.g., application server 101 or other cloud server) separate from the device in which the page response is located, based on the device information of the device in which the page response is located and the comparison method determined in step 2062, which is step 2064. If step 2064 is performed by the cloud server, the record or frame sequence, and the version number of the determined comparison mode, need to be uploaded to the cloud server. If step 2064 is performed by the device in which the page response is located, the comparison method needs to be configured in the device, for example, the cloud server issues the algorithm corresponding to the comparison method to the device.

In a specific example, device information of the terminal device 103 is acquired. The device information includes any one or any combination of the following: system running memory, system load, available memory, CPU core number, CPU frequency, GPU performance parameters, power, device model. These pieces of information of the terminal device 103 have an influence on the page response speed.

Whether step 2064 is performed by the terminal device 103 or step 2064 is performed by the application server 101 is determined based on the device information of the terminal device 103 and the comparison method determined in step 2062.

The worse the ability of the terminal device 103 itself to respond to the page, the more complex the determined comparison mode, the more prone step 2064 is performed by the cloud server. Otherwise, the method is used for controlling the flow rate of the liquid. The more the terminal device 103 itself has a capability to respond to the page, the simpler the determined comparison is, and step 2064 may be performed by the terminal device 103.

208. And calculating the time consumed by page response according to the time of the event of operating the first control and the time of the page occurrence of the response frame. Specifically, subtracting the time of occurrence of the event of operating the first control from the time of occurrence of the page of the response frame obtains the time consumed by the page response.

In the embodiment of the invention, the time of occurrence of the event of the first control can be acquired in various modes. For example, the first control may be monitored, and a time when an event that operates the first control occurs after the first control is operated is obtained. For example, the test program may obtain, from an application interface corresponding to the first control, a time at which an event that operates the first control occurred. For example, the test program may determine the time of occurrence of the event of the first control by means of a system layer callback, a monitoring hardware layer log, a monitoring system log, and the like. And will not be described in detail here.

< method of improving Page response Property >

Referring to fig. 6, a method for improving page response performance provided by an embodiment of the present invention is described, including the following steps:

210. If the time spent by the page response is greater than the preset second time threshold, the time spent by the page response is too much, which may be beyond the allowable range of the user, and an operation for improving the page response performance needs to be performed. The operations include any one or any combination of the following:

prompting a user to check the network environment;

prompting a user to clean equipment garbage;

By using the method, the page response performance of the terminal equipment 103 can be improved.

< means for testing Page response Performance >

Fig. 7 is a schematic diagram of a testing apparatus 600 according to an embodiment of the present invention, where the testing apparatus 600 is used for testing page response performance, and the testing apparatus 600 includes the following modules:

the obtaining module 601 is configured to obtain a screen recording of a page response, where the page response is caused by an event that operates the first control, and the screen recording includes a process from when the event that operates the first control occurs to when the page response ends.

An extracting module 602, configured to extract a page feature from a frame page of the last one or more frames of the frame sequence of the screen.

The determining module 603 is configured to determine a response frame page from the frame sequence of the recording according to the extracted page feature.

The calculating module 604 is configured to calculate a time consumed for page response according to a time when the event for operating the first control occurs and a time when the page of the response frame occurs. .

Based on the device for testing the page response performance provided by the embodiment of the invention, the moment of the page of the response frame can be automatically confirmed according to the page characteristics of the last frames of the page response, and the time consumed by the page response is further determined. The device for testing the page response performance provided by the embodiment of the invention can automatically confirm the occurrence time of the response frame page, and improves the testing efficiency. According to the device for testing page response performance, which is provided by the embodiment of the invention, the response frame page is confirmed according to the page characteristics of the last frames of page response, so that the test result can more embody the visual feeling of a user on the page response.

Fig. 8 is a schematic diagram of an acquisition module 601 provided by an embodiment of the present invention, where the acquisition module 601 includes a screen recording start module 6011, a trigger module 6013, and a screen recording end module 6012.

The screen recording starting module 6011 is configured to monitor whether the first control is operated, and if the first control is operated, start screen recording. Or, the screen recording starting module 6011 is configured to start screen recording in response to an instruction for starting screen recording.

The screen recording end module 6012 is configured to terminate the screen recording in response to an instruction for ending the screen recording.

And the triggering module 6013 is used for timing the screen recording, and triggering an instruction for ending the screen recording after the screen recording time reaches a preset first time threshold. Or alternatively, the process may be performed,

and the triggering module 6013 is used for monitoring the system log of the equipment where the page response is located, determining whether to end the screen recording according to the system log, and triggering an instruction for ending the screen recording if the screen recording is determined to be ended. Or alternatively, the process may be performed,

and the triggering module 6013 is used for monitoring whether the second control appears, and triggering an instruction for ending the screen recording if the second control appears.

< terminal device >

A terminal device 700 provided by an embodiment of the present invention is described with reference to fig. 9, where the terminal device 700 includes the following modules:

The calculating module 604 is configured to calculate a time consumed for page response according to a time when the event for operating the first control occurs and a time when the page of the response frame occurs.

The performance enhancing module 605 is configured to perform an operation that can be used to enhance the performance of the page response if the time spent for the page response is greater than a preset second time threshold. The operations include any one or any combination of the following:

prompting a user to check the network environment;

prompting a user to clean equipment garbage;

With the above manner, the page response performance of the terminal device 700 can be improved.

< means for testing Page response Performance >

Fig. 10 is a schematic diagram of a test apparatus 800 according to an embodiment of the present invention, where the test apparatus 800 is used for testing page response performance, and the test apparatus 800 includes a memory 802 and a processor 801.

The memory 802 stores a computer program which, when executed by the processor 801, implements the aforementioned method of testing page response performance.

< terminal device >

Fig. 11 is a schematic diagram of a terminal device 900 according to an embodiment of the present invention, where the terminal device 900 is configured to include a memory 902, a processor 901, and a display 903.

The memory 902 stores a computer program which, when executed by the processor 901, implements the aforementioned method of testing page response performance.

Further, the computer program when executed by the processor 901 also implements the following method:

if the time spent by the page response is greater than a preset second time threshold, any one or any combination of the following operations are performed:

prompting a user to check the network environment;

prompting a user to clean equipment garbage;

By the above manner, the page response performance of the terminal device 900 can be improved.

The embodiment of the present invention also provides a computer readable medium having a computer program stored thereon, which when executed by a processor implements the method of testing page response performance in the above embodiment, or the method of improving page response performance in the above embodiment.

In this specification, each embodiment is described in a progressive manner, and identical and similar parts of each embodiment are all referred to each other, and each embodiment mainly describes differences from other embodiments. In particular, for the apparatus, device embodiments, since they are substantially similar to the method embodiments, the description is relatively simple, as relevant to see the section description of the method embodiments.

The foregoing describes specific embodiments of the present disclosure. Other embodiments are within the scope of the following claims. In some cases, the actions or steps recited in the claims can be performed in a different order than in the embodiments and still achieve desirable results. In addition, the processes depicted in the accompanying figures do not necessarily require the particular order shown, or sequential order, to achieve desirable results. In some embodiments, multitasking and parallel processing are also possible or may be advantageous.

The present invention may be a system, method, and/or computer program product. The computer program product may include a computer readable storage medium having computer readable program instructions embodied thereon for causing a processor to implement aspects of the present invention.

The computer readable storage medium may be a tangible device that can hold and store instructions for use by an instruction execution device. The computer readable storage medium may be, for example, but not limited to, an electronic storage device, a magnetic storage device, an optical storage device, an electromagnetic storage device, a semiconductor storage device, or any suitable combination of the foregoing. More specific examples (a non-exhaustive list) of the computer-readable storage medium would include the following: portable computer disks, hard disks, random Access Memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), static Random Access Memory (SRAM), portable compact disk read-only memory (CD-ROM), digital Versatile Disks (DVD), memory sticks, floppy disks, mechanical coding devices, punch cards or in-groove structures such as punch cards or grooves having instructions stored thereon, and any suitable combination of the foregoing. Computer-readable storage media, as used herein, are not to be construed as transitory signals per se, such as radio waves or other freely propagating electromagnetic waves, electromagnetic waves propagating through waveguides or other transmission media (e.g., optical pulses through fiber optic cables), or electrical signals transmitted through wires.

The computer readable program instructions described herein may be downloaded from a computer readable storage medium to a respective computing/processing device or to an external computer or external storage device over a network, such as the internet, a local area network, a wide area network, and/or a wireless network. The network may include copper transmission cables, fiber optic transmissions, wireless transmissions, routers, firewalls, switches, gateway computers and/or edge servers. The network interface card or network interface in each computing/processing device receives computer readable program instructions from the network and forwards the computer readable program instructions for storage in a computer readable storage medium in the respective computing/processing device.

Computer program instructions for carrying out operations of the present invention may be assembly instructions, instruction Set Architecture (ISA) instructions, machine-related instructions, microcode, firmware instructions, state setting data, or source or object code written in any combination of one or more programming languages, including an object oriented programming language such as Smalltalk, c++ or the like and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The computer readable program instructions may be executed entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any kind of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or may be connected to an external computer (for example, through the Internet using an Internet service provider). In some embodiments, aspects of the present invention are implemented by personalizing electronic circuitry, such as programmable logic circuitry, field Programmable Gate Arrays (FPGAs), or Programmable Logic Arrays (PLAs), with state information for computer readable program instructions, which can execute the computer readable program instructions.

Various aspects of the present invention are described herein with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems) and computer program products according to embodiments of the invention. It will be understood that each block of the flowchart illustrations and/or block diagrams, and combinations of blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer-readable program instructions.

These computer readable program instructions may be provided to a processor of a general purpose computer, special purpose computer, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions/acts specified in the flowchart and/or block diagram block or blocks. These computer readable program instructions may also be stored in a computer readable storage medium that can direct a computer, programmable data processing apparatus, and/or other devices to function in a particular manner, such that the computer readable medium having the instructions stored therein includes an article of manufacture including instructions which implement the function/act specified in the flowchart and/or block diagram block or blocks.

The computer readable program instructions may also be loaded onto a computer, other programmable data processing apparatus, or other devices to cause a series of operational steps to be performed on the computer, other programmable apparatus or other devices to produce a computer implemented process such that the instructions which execute on the computer, other programmable apparatus or other devices implement the functions/acts specified in the flowchart and/or block diagram block or blocks.

The flowcharts and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present invention. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of instructions, which comprises one or more executable instructions for implementing the specified logical function(s). In some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions. It is well known to those skilled in the art that implementation by hardware, implementation by software, and implementation by a combination of software and hardware are all equivalent.

The foregoing description of embodiments of the invention has been presented for purposes of illustration and description, and is not intended to be exhaustive or limited to the embodiments disclosed. Many modifications and variations will be apparent to those of ordinary skill in the art without departing from the scope of the various embodiments described. The terminology used herein was chosen in order to best explain the principles of the embodiments, the practical application, or the technical improvement of the technology in the marketplace, or to enable others of ordinary skill in the art to understand the embodiments disclosed herein. The scope of the invention is defined by the appended claims.

Claims

1. A method of testing page response performance, comprising the steps of:

extracting page features from a frame page of the last frame or frames of the frame sequence of the screen recording, wherein the page features simultaneously comprise: the degree of solid color, dynamic area, and control distribution;

Calculating the time consumed by page response according to the time of the event of operating the first control and the time of the page occurrence of the response frame,

wherein the determining a response frame page from the frame sequence according to the page feature comprises:

firstly, intercepting a part of a frame page corresponding to a dynamic area, then, if a final state frame page belongs to a solid color page, determining a response frame page by comparing pixels of the rest part after the interception of the frame page, if the final state frame page does not belong to the solid color page and has controls, determining the response frame page by comparing the control distribution situation of the rest part after the interception of the frame page, or, if the number of the controls of the final state frame page is greater than a certain number, determining the response frame page by directly comparing the control distribution situation of the rest part after the interception of the frame page without considering whether the final state frame page is solid color.

2. The method of claim 1, further comprising: acquiring equipment information of equipment where the page response is located, and determining whether the equipment information and the comparison method are used for carrying out the comparison analysis by a server or the equipment;

3. The method of claim 1, the obtaining a screen of page response, comprising:

4. A method according to claim 3, further comprising:

5. A method of improving page response performance comprising the method of testing page response performance of any of claims 1-4, further comprising:

prompting a user to check the network environment;

Prompting a user to clean equipment garbage;

6. An apparatus for testing page response performance, comprising:

the extracting module is used for extracting page features from the frame pages of the last frame or frames of the frame sequence of the screen recording, wherein the page features simultaneously comprise: the degree of solid color, dynamic area, and control distribution;

a calculating module, configured to calculate time spent for page response according to the time when the event for operating the first control occurs and the time when the page of the response frame occurs,

7. The apparatus of claim 6, the acquisition module comprising:

8. The apparatus of claim 7, the acquisition module further comprising a trigger module;

9. A terminal device comprising the apparatus of any of claims 6-8, further comprising:

prompting a user to check the network environment;

prompting a user to clean equipment garbage;

10. An apparatus for testing page response performance includes a memory and a processor;

the memory stores a computer program which, when executed by the processor, implements the method of any one of claims 1, 3-4.

11. A terminal device includes a memory, a processor, and a display screen;

the memory stores a computer program which, when executed by the processor, implements the method of any one of claims 1,3-4, and implements the method of:

prompting a user to check the network environment;

prompting a user to clean equipment garbage;