CN105204981A

CN105204981A - Application performance test method and device

Info

Publication number: CN105204981A
Application number: CN201410232622.7A
Authority: CN
Inventors: 王同窗; 孙瑞川; 平航磊; 蒋建华; 赵芳芳
Original assignee: Beijing Qihoo Technology Co Ltd; Qizhi Software Beijing Co Ltd
Current assignee: Beijing Qihoo Technology Co Ltd; Qizhi Software Beijing Co Ltd
Priority date: 2014-05-28
Filing date: 2014-05-28
Publication date: 2015-12-30

Abstract

The invention discloses an application performance test method and device. The method comprises the steps that mobile equipment performance information and collection time of the performance information are obtained when a tested application is operated on mobile equipment; user historical operation information and occurrence time of historical operations are obtained when the tested application is operated on the mobile equipment; the variable situations of application performance of the tested application along with the collection time, the user historical operation information and the occurrence time of the historical operations are determined according to the mobile equipment performance information, the collection time, the user historical operation information and the occurrence time of the historical operations; the variable situations of the application performance of the tested application are output.

Description

Application performance test method and apparatus

Technical field

The present invention relates to Performance Testing Technology, particularly relate to a kind of application performance test method and corresponding application performance test device.

Background technology

Application (also can be called application program) needs to carry out performance test usually, before formally being come into operation in the application of developing for the mobile device such as mobile phone or panel computer, needs to test the performance of application.

Existing the method that application performance in mobile device is tested to be generally: run tested application in a mobile device, and in the operational process of tested application, the performance information of mobile device is repeatedly obtained according to predetermined time interval, afterwards, by carrying out all properties information of the mobile device got in a period of time analyzing the performance obtaining tested application.

Inventor is realizing finding in process of the present invention, and the kind of application and quantity are day by day various, and the requirement of user to application also day by day improves, and this impels application should have more excellent performance as much as possible, to promote its market competitiveness; In order to make application have more excellent performance, this needs applying the performance test that more becomes more meticulous, with improvement application targetedly; But the tested application performance utilizing existing application performance test method to obtain well can not meet current application testing demand.

Summary of the invention

In view of the above problems, the present invention is proposed to provide a kind of application performance test method and apparatus overcoming the problems referred to above or solve the problem at least in part.

According to one aspect of the present invention, provide a kind of application performance test method, comprising: obtain the tested acquisition time being applied in mobile device performance information and described performance information in mobile device operational process; Obtain and be testedly applied in user's historical operation information and historical operation time of origin in mobile device operational process; The situation of change of the application performance of described tested application with described acquisition time, described user's historical operation information and described historical operation time of origin is determined according to described mobile device performance information, described acquisition time, described user's historical operation information and described historical operation time of origin; Export the situation of change of the application performance of described tested application.

According to a further aspect in the invention, provide a kind of application performance test device, comprising: performance monitoring module, be suitable for obtaining the tested acquisition time being applied in mobile device performance information and described performance information in mobile device operational process; Operation monitoring module, is suitable for obtaining and is testedly applied in user's historical operation information and historical operation time of origin in mobile device operational process; Determine performance module, be suitable for determining the situation of change of the application performance of described tested application with described acquisition time, described user's historical operation information and described historical operation time of origin according to described mobile device performance information, described acquisition time, described user's historical operation information and described historical operation time of origin; Output performance module, is suitable for the situation of change of the application performance exporting described tested application.

Application performance test method of the present invention and device are applied in mobile device performance information and acquisition time in mobile device operational process by acquisition is tested, can know the impact of the operation of tested application on mobile device performance; Testedly user's historical operation information and historical operation time of origin in mobile device operational process is applied in by obtaining, the impact of user's historical operation on mobile device performance can be known with associating of historical operation time of origin by acquisition time, like this, clearly can know the concrete reason that tested application performance fluctuates and make the operation of tested application produce abnormal concrete operations etc.; Thus the present invention can meet current application testing demand preferably, is conducive to the lifting of application performance.

Above-mentioned explanation is only the general introduction of technical solution of the present invention, in order to technological means of the present invention can be better understood, and can be implemented according to the content of instructions, and can become apparent, below especially exemplified by the specific embodiment of the present invention to allow above and other objects of the present invention, feature and advantage.

Accompanying drawing explanation

By reading hereafter detailed description of the preferred embodiment, various other advantage and benefit will become cheer and bright for those of ordinary skill in the art.Figure of description only for illustrating the object of preferred implementation, and does not think limitation of the present invention.And in whole accompanying drawing, represent identical parts by identical reference symbol.In the accompanying drawings:

Fig. 1 shows the application performance test method flow diagram according to the embodiment of the present invention one;

What Fig. 2 showed the embodiment of the present invention one takies for mobile device CPU the broken line graph that number percent and user's historical operation information generate;

Fig. 3 shows the broken line graph of having taken up room for mobile device internal memory of the embodiment of the present invention one and the generation of user's historical operation information;

Fig. 4 shows the broken line graph generated for mobile device battery electric quantity and user's historical operation information of the embodiment of the present invention one;

Fig. 5 shows the broken line graph generated for mobile device network traffics and user's historical operation information of the embodiment of the present invention one;

Fig. 6 show the embodiment of the present invention one take number percent for mobile device CPU, mobile device internal memory takes up room, mobile device battery electric quantity, mobile device network traffics and user's historical operation information generate a broken line graph;

Fig. 7 show the embodiment of the present invention one take number percent for mobile device CPU, mobile device internal memory takes up room, mobile device battery electric quantity, mobile device network traffics and user's historical operation information generate another broken line graph;

Fig. 8 shows the application performance test device schematic diagram according to the embodiment of the present invention two.

Embodiment

Below with reference to accompanying drawings exemplary embodiment of the present disclosure is described in more detail.Although show exemplary embodiment of the present disclosure in accompanying drawing, however should be appreciated that can realize the disclosure in a variety of manners and not should limit by the embodiment set forth here.On the contrary, provide these embodiments to be in order to more thoroughly the disclosure can be understood, and complete for the scope of the present disclosure can be conveyed to those skilled in the art.

Embodiment one, application performance test method.Below in conjunction with Fig. 1, the method for the present embodiment is described in detail.

In Fig. 1, S100, obtain the tested acquisition time being applied in mobile device performance information and mobile device performance information in mobile device operational process.

Concrete, the main body of the acquisition mobile device performance information in the present embodiment and the acquisition time of mobile device performance information should be application performance test equipment; Here application performance test equipment can for running the mobile device of tested application, also can be other equipment independent of the mobile device running tested application, such as, other equipment above-mentioned can be and equipment such as operation the mobile device wireless connections of tested application or the server of wired connection etc.

When application performance test equipment is the mobile device running tested application, this mobile device (the application performance test program etc. as installed in this mobile device) can in the operational process of tested application, according to the time interval timing acquiring mobile device performance information preset, and the mobile device performance information collected and acquisition time this locality are stored in mobile device performance logs, afterwards, mobile device (as application performance test program) can when needs carry out applied performance analysis, the tested acquisition time being applied in mobile device performance information and mobile device performance information in mobile device operational process is obtained easily from its local mobile device performance logs stored.

Be with when running other equipment that the mobile device of tested application is connected as server at application performance test equipment, mobile device (the application performance test program etc. as installed in this mobile device) can in the operational process of tested application, its performance information is periodically gathered according to the time interval preset, and the mobile device performance information collected and acquisition time this locality are stored in mobile device performance logs, afterwards, mobile device performance logs can be uploaded to server by mobile device (as application performance test program); Such as, the mobile device performance logs that this locality stores is uploaded to server on one's own initiative by mobile device (as application performance test program) after tested application end of run; Again such as, no matter whether tested application is at operation or whether end of run, and its local mobile device performance logs stored, after receiving the mobile device performance test information upload request that server transmission comes, is uploaded to server by mobile device; Like this, server when needs carry out applied performance analysis, can obtain the tested acquisition time being applied in mobile device performance information and mobile device performance information in mobile device operational process easily from the mobile device performance logs that it receives.

Above-mentioned mobile device performance information includes multiple performance index of mobile device usually, and the performance index that mobile device performance information specifically comprises can be determined according to the actual testing requirement of application; Such as, mobile device performance information can specifically comprise: any one or any two or any three or all etc. in mobile device cpu usage, mobile device internal memory service condition, mobile device network traffics and mobile device battery service condition.

Above-mentioned mobile device cpu usage can be specially: mobile device CPU usage (namely mobile device takies number percent) or mobile device CPU idleness (i.e. mobile device CPU idle percentages), and mobile device CPU usage can be specially the occupancy of tested application to mobile device CPU; Above-mentioned mobile device internal memory service condition can be specially: mobile device memory usage (i.e. mobile device EMS memory occupation number percent) or mobile device internal memory idleness (i.e. mobile device internal memory idle percentages) or mobile device internal memory have taken up room size or mobile device internal memory free space size, and mobile device memory usage can be specially the occupancy of tested application to mobile device internal memory, the mobile device internal memory size that taken up room can be specially the take up room size of tested application to mobile device internal memory; Above-mentioned mobile device network traffics can be specially tested application consumed network traffics: and mobile device network traffics can be any one or two in Wi-Fi data traffic and 2G/3G/4G data traffic; That is, mobile device in the present embodiment can distinguish the type of its current network flow, thus the mobile device network traffics in mobile device performance logs clearly can indicate mobile device current institute consumption network flow is Wi-Fi data traffic, or 2G/3G/4G data traffic; Above-mentioned mobile device battery service condition can be specially mobile device battery electric quantity (i.e. the dump energy of mobile device battery), and mobile device battery electric quantity can use cell voltage to represent.

The mobile device performance information collected and corresponding acquisition time this locality to gather the tested mobile device performance information be applied in mobile device operational process, and are stored in mobile device performance logs by the performance monitoring module in application performance test program that mobile device can utilize its inside to install.Performance monitoring module can gather the tested mobile device performance information be applied in mobile device operational process by calling corresponding API (ApplicationProgrammingInterface, application programming interface) in mobile device operation system.Above-mentioned application performance test program can as be installed in mobile device certain application part of functions, as application performance test program can as an optimizational function of the optimization great master installed in mobile device.

The collection of the present embodiment is tested is applied in mobile device performance information in mobile device operational process and one of local storing mobile device capability information and acquisition time concrete example is: application performance test program is after the time interval preset arrives, SystemProperties.java in call operation system obtains current mobile device CPU usage, ActivityManager.java in call operation system obtains current mobile device internal memory and to have taken up room size, ConnectivityManager.java in call operation system obtains current mobile device network traffics, BatteryManager.java in call operation system obtains current mobile device battery electric quantity, above-mentioned four call operation can be carried out under normal conditions simultaneously, application performance test program is when performing above-mentioned call operation or receive the current mobile device CPU usage that operating system returns, current mobile device internal memory has taken up room size, when current mobile device network traffics and current mobile device battery electric quantity, obtain the current time (namely beating timestamp to mobile device performance information) of mobile device, then, application performance test program is by current mobile device CPU usage, current mobile device memory usage, current mobile device network traffics, the current time of current mobile device battery electric quantity and mobile device is stored in mobile device performance logs as a record.The API that the present embodiment can utilize the operating system of mobile device to provide to obtain the current time of mobile device, as the current time utilizing the System.currentTimeMillis () in operating system to obtain mobile device.

Mobile device performance information daily record in the present embodiment can be the file of txt form, also can be the file of extended formatting; And the daily record of mobile device performance information can be stored in the SD card of mobile device.

S110, obtain and be testedly applied in user's historical operation information and historical operation time of origin in mobile device operational process.

Concrete, the acquisition user historical operation information in the present embodiment and the main body of historical operation time of origin should be application performance test equipment equally; In like manner, application performance test equipment in the present embodiment can for running the mobile device of tested application, also can be other equipment independent of the mobile device running tested application, such as, other equipment above-mentioned can be and equipment such as operation the mobile device wireless connections of tested application or the server of wired connection etc.

It should be noted that, the main body obtaining user's historical operation information and historical operation time of origin is same main body with the main body of the acquisition time of above-mentioned acquisition mobile device performance information and mobile device performance information usually; In addition, although S100 and S110 is two steps with serial number, but, execution sequence restriction uninevitable in actual applications between S100 and S110, these two steps should perform usually simultaneously, can certainly successively perform, but, within the whole time period of test, part mobile device performance information and certain customers' historical operation information preferably should be had to obtain simultaneously.

When application performance test equipment is the mobile device running tested application, this mobile device (the application performance test program etc. as installed in this mobile device) can in the operational process of tested application, the operation of Real-Time Monitoring user (operation of user here typically refers to the operation of the user that the test logic that designs for application performance test is simulated), and monitor user perform operate accordingly time, obtain the current time of mobile device, and the operation information corresponding to the operation user monitored performed and above-mentioned current time are stored in the daily record of user's historical operation as user's historical operation information and historical operation time of origin this locality, thus mobile device is when needs carry out applied performance analysis, can obtains from its local user's historical operation daily record stored easily and testedly be applied in user's historical operation information and historical operation time of origin in mobile device operational process.

Be with when running other equipment that the mobile device of tested application is connected as server at application performance test equipment, mobile device (the application performance test program etc. as installed in this mobile device) can in the operational process of tested application, the operation of Real-Time Monitoring user (operation of user here typically refers to the operation of the user that the test logic that designs for application performance test is simulated), and monitor user perform operate accordingly time, obtain the current time (namely beating timestamp to user's historical operation information) of mobile device, and the operation information of operation correspondence user performed and above-mentioned current time are stored in the daily record of user's historical operation as user's historical operation information and historical operation time of origin this locality, afterwards, the daily record of user's historical operation can be uploaded to server by mobile device, such as, user's historical operation daily record that this locality stores is uploaded to server on one's own initiative by mobile device after tested application end of run, again such as, its local user's historical operation daily record stored, after receiving the next mobile device performance test information upload request of server transmission, is uploaded to server by mobile device, like this, server, when needs carry out applied performance analysis, can obtain easily and testedly be applied in user's historical operation information and historical operation time of origin in mobile device operational process from user's historical operation daily record that it receives.Same, the API that the present embodiment can utilize the operating system of mobile device to provide to obtain the current time of mobile device, as the current time utilizing the System.currentTimeMillis () in operating system to obtain mobile device.

Mobile device performance information daily record in above-mentioned S100 and the user's historical operation daily record in S110 should upload onto the server usually simultaneously, such as, the mobile device performance information daily record of this locality storage and the daily record of user's historical operation upload onto the server on one's own initiative by mobile device after tested application end of run simultaneously; Again such as, mobile device is after receiving the next mobile device performance test information upload request of server transmission, and the mobile device performance information daily record store this locality and the daily record of user's historical operation upload onto the server simultaneously.Above-mentioned two daily records can upload onto the server by arranging Upload () function in application performance test program by the present embodiment.In addition, mobile device can empty the record in the daily record of mobile device performance information and the daily record of user's historical operation of successfully having uploaded.

The daily record of above-mentioned user's historical operation includes the user's historical operation information corresponding to multiple operation (comprising the operation of the user that test logic is simulated) that user performs usually, and the multiple operation that user performs can specifically comprise: click, slip and incoming event etc.The present embodiment is the particular content of operation that performs of limited subscriber not.

Mobile device can utilize the operation monitoring module in its inner application performance test program of installing testedly to be applied in user's historical operation information in mobile device operational process and operation time of origin to obtain, and the user's historical operation information got and corresponding operation time of origin this locality is stored in the daily record of user's historical operation.Application performance test program can obtain UI (UserInterface, the user interface) control in the also tested application of identification usually, and calls the corresponding UI control in tested application according to corresponding test logic, to test tested application.Application performance test program is when calling the corresponding UI control of tested application, and corresponding UI control information and current time of calling can be recorded in the daily record of user's historical operation as user's historical operation information and operation time of origin by the operation monitoring module in application performance test program.

Application performance test program in the present embodiment can be the application program developed on the basis of Robotium.Robotium is a UI automated test frame based on Android platform, the API (as Solo.java) utilizing Robotium to provide can carry out the operation of identification and the UI to tested application in several ways to the UI control of tested application, if clicking operation, length are by operation or slide etc.

Mobile device gathers the tested user's operation information be applied in mobile device operational process, and local store the concrete example of user's operation information and operation time of origin one for: application performance test program after operation by can know to operating system inquiry tested application all UI controls (as application performance test program by utilize the Robotium of operating system the API that provides can inquire about all UI controls knowing tested application), then, the test logic that application performance test program can pre-set according to it calls corresponding UI control, make tested application for the current corresponding UI control called perform corresponding operation (as application performance test program by utilize the Robotium of operating system the API that provides tested application can be made to perform operation corresponding to UI control), thus the present embodiment carries out performance test to the practical operation of tested application to tested application by imitating user, application performance test program is when calling corresponding UI control and make tested application execution operate accordingly, operation monitoring module in application performance test program can record operation information corresponding to this UI control, and obtain the current time (be this UI control and increase corresponding timestamp) of mobile device simultaneously, then, operation information corresponding for UI control and current time are stored in the daily record of user's historical operation as a record by operation monitoring module.The daily record of above-mentioned user's historical operation can be the file of txt form, also can be the file of extended formatting.

S120, determine the situation of change of the application performance of tested application with acquisition time, user's historical operation information and historical operation time of origin according to above-mentioned mobile device performance information, acquisition time, user's historical operation information and historical operation time of origin.

Concrete, the application performance of the tested application of the present embodiment can embody with the form of broken line graph with the situation of change of acquisition time, user's historical operation information and historical operation time of origin; Certainly, this situation of change also can adopt other forms to embody, as histogram, statistical form or text etc.

Because the acquisition time in the present embodiment and historical operation time of origin can fit within same time shaft completely, therefore, the mobile device performance information in the present embodiment and user's historical operation information can associate based on the time in time shaft.

The present embodiment can first utilize mobile device performance information and acquisition time to form broken line graph or histogram or statistical form etc., then, recycling historical operation time of origin, is marked at the corresponding position in broken line graph or histogram or statistical form by corresponding user's historical operation information.

The present embodiment, when the mobile device performance information obtained includes multiple performance index, can determine the situation of change of each performance index with acquisition time, user's historical operation information and historical operation time of origin respectively, a concrete example, mobile device cpu usage is comprised at the mobile device performance information obtained, mobile device internal memory service condition, in the practical application scene of mobile device network traffics and mobile device battery service condition, the present embodiment can read out the number percent that all tested application consume CPU from the daily record of mobile device performance information, tested application consumes the number percent of internal memory, the network traffics that tested application consumes, mobile device battery electric quantity and acquisition time corresponding to each information, and utilize all tested application read out to consume the number percent of CPU, tested application consumes the number percent of internal memory, the network traffics that tested application consumes, mobile device battery electric quantity and acquisition time corresponding to each information generate four broken lines, these four broken lines should be arranged in four different coordinate systems usually, same coordinate system can certainly be arranged in, no matter four broken line is arranged in same coordinate system, be still arranged in four different coordinate systems, the horizontal ordinate of coordinate system all represents acquisition time, and the ordinate of coordinate system all represents the concrete quantized values of performance index, then, all user's historical operation information and historical operation time of origin is read from the daily record of user's historical operation, determine the position of each historical operation time of origin horizontal ordinate in a coordinate system, and mark corresponding user historical operation information in the position of broken line or historical operation time of origin at abscissa positions place in historical operation time of origin correspondence, the present embodiment can mark based on the character express that user's historical operation information is corresponding, also can mark based on the identifier etc. that user's historical operation information is corresponding.

The present embodiment can utilize existing drawing plug-in unit to draw above-mentioned broken line graph, and as the data of reading are supplied to drawing plug-in unit according to the mode preset, thus the Plotting data that drawing plug-in unit can receive according to it goes out above-mentioned broken line graph.

S130, export the situation of change of the application performance of tested application.

Concrete, the application performance test equipment of the present embodiment can show the situation of change (as shown above-mentioned broken line graph) of application performance with acquisition time, user's historical operation information and historical operation time of origin of tested application by its display screen, also can by this situation of change of printer output (as printed statistical form), certainly, the present embodiment can also export this situation of change by other means.

The present embodiment exports in the practical application scene of the situation of change of the application performance of tested application at employing display screen, various ways show tags user's historical operation information in a coordinate system can be adopted, during as some place of certain in the mouse-pointing broken line of application performance test equipment (or touch position is certain some place in broken line), the character express that user's historical operation information near this point is corresponding or identifier are having to explicitly shown, and character express corresponding to the user's historical operation information being positioned at other positions or identifier are in hiding display state, for another example, in the mouse-pointing broken line of application performance test equipment certain some place (or touch position is certain some place in broken line) time, be marked at character express corresponding to all user's historical operation information in this broken line or identifier is all having to explicitly shown.

In addition, when many broken lines (as four broken lines) are arranged in same coordinate system, ordinate can demonstrate the unit scales corresponding to four broken lines respectively, shows unit scales corresponding to four broken lines as utilized four ordinates; Certainly, the present embodiment also can adopt other modes to show four unit scales corresponding to broken line, such as, in the mouse-pointing of application performance test equipment a certain bar broken line certain some place (or touch position is certain some place in a certain bar broken line) time, the unit scales value of the ordinate of this coordinate system should show the unit scales value corresponding to this broken line; And when not pointing to any point place (or touch position is not any point place in any broken line) in any broken line at the mouse of application performance test equipment, the unit scales value of the ordinate of this coordinate system can unit scales value corresponding to a certain bar broken line that presets.

Below in conjunction with accompanying drawing 2-7, the present embodiment practical application is described.The mobile device CPU that the present embodiment collects in tested application operational process takies number percent, mobile device internal memory takes up room, mobile device battery electric quantity and mobile device network traffics and user's historical operation information of monitoring as described in Table 1.

Table 1

It should be noted that for above-mentioned table 1, in monitoring user operation process, user operation may affect one lasting period, therefore, operation time of origin corresponding to user's historical operation information may corresponding multiple acquisition time, such as, the impact that the operation of " inputting user name " of monitoring at the 1st second produces is a time-continuing process, so, can think that the multiple mobile device performance informations collected before next historical operation occurs are all corresponding with " inputting user name " this user's historical operation information.

The present embodiment is when utilizing four coordinate systems to show the particular content in above-mentioned table 1, and four broken line graphs generated as shown in Figure 2-5.Concrete, the present embodiment utilize the mobile device CPU in acquisition time, historical operation time of origin and above-mentioned table 1 to take broken line graph that number percent and user's historical operation information generate as shown in Figure 2, abscissa representing time in Fig. 2, unit is second (s), ordinate represents that CPU takies number percent, and unit is percentages; The broken line graph that the present embodiment utilizes the mobile device internal memory in acquisition time, historical operation time of origin and above-mentioned table 1 to take up room and user's historical operation information generates as shown in Figure 3, abscissa representing time in Fig. 3, unit is second, ordinate represents EMS memory occupation space size, unit is MB (MByte, million); The broken line graph that the present embodiment utilizes the mobile device battery electric quantity in acquisition time, historical operation time of origin and above-mentioned table 1 and user's historical operation information to generate as shown in Figure 4, abscissa representing time in Fig. 4, unit is second, ordinate represents cell voltage, and unit is Mv (millivolt); The broken line graph that the present embodiment utilizes the mobile device network traffics in acquisition time, historical operation time of origin and above-mentioned table 1 and user's historical operation information to generate as shown in Figure 5, abscissa representing time in Fig. 5, unit is second, and ordinate represents mobile device network traffics, and unit is KB.

The present embodiment is when utilizing a coordinate system to show the particular content in above-mentioned table 1, and the broken line graph generated as shown in fig. 6-7.Concrete, the broken line graph that the present embodiment utilizes that the mobile device CPU in acquisition time, historical operation time of origin and above-mentioned table 1 takies number percent, mobile device internal memory takes up room, mobile device battery electric quantity, mobile device network traffics and user's historical operation information generate as shown in Figure 6 and Figure 7, abscissa representing time in Fig. 6 and Fig. 7, unit is second, and ordinate can indicate CPU respectively and take number percent, EMS memory occupation space size, cell voltage, mobile device network traffics.

Embodiment two, application performance test device.Below in conjunction with Fig. 8, the device of the present embodiment is described in detail.

Application performance test device in Fig. 8 can be arranged in the mobile device running tested application, also can be arranged at the equipment such as the server of the mobile device wireless connections or wired connection that run tested application, can also a part be arranged in the mobile device running tested application, another part be arranged at the equipment such as the server of the mobile device wireless connections or wired connection that run tested application.

The application performance test device of the present embodiment mainly comprises: performance monitoring module 200, operation monitoring module 210, determine performance module 220 and output performance module 230.

Performance monitoring module 200 can be arranged in mobile device completely, also can be arranged in server completely, partly can also be arranged at part in mobile device and be arranged in server.Performance monitoring module 200 is mainly suitable for obtaining the tested acquisition time being applied in mobile device performance information and mobile device performance information in mobile device operational process.

Concrete, when performance monitoring module 200 is arranged at the mobile device running tested application completely, performance monitoring module 200 can in the operational process of tested application, according to the time interval timing acquiring mobile device performance information preset, and the mobile device performance information collected and acquisition time this locality are stored in mobile device performance logs, afterwards, determine that performance module 220 can when needs carry out applied performance analysis, the tested acquisition time being applied in mobile device performance information and mobile device performance information in mobile device operational process is obtained easily from the mobile device performance logs that mobile device this locality stores.

When performance monitoring module 200 is arranged at other equipment of being connected with the mobile device running tested application completely as server, mobile device (the application performance test program etc. as installed in this mobile device) can in the operational process of tested application, its performance information is periodically gathered according to the time interval preset, and the mobile device performance information collected and acquisition time this locality are stored in mobile device performance logs, afterwards, mobile device performance logs can be uploaded to server by mobile device (as application performance test program), from the information that server receives, mobile device performance information and acquisition time is got to make performance monitoring module 200, as performance monitoring module 200 sends mobile device performance test information upload request by server to mobile device, mobile device is after receiving the next mobile device performance test information upload request of server transmission, its local mobile device performance logs stored is uploaded to server, make performance monitoring module 200 successfully get mobile device performance information and acquisition time, and mobile device performance logs this locality that server can receive by performance monitoring module 200 is stored in server, like this, determinacy energy module 220 in server, when needs carry out applied performance analysis, can obtain the tested acquisition time being applied in mobile device performance information and mobile device performance information in mobile device operational process easily from the mobile device performance logs that this locality stores.

Be arranged in mobile device in performance monitoring module 200 part, when part is arranged at other equipment of being connected with the mobile device running tested application as server, performance monitoring module 200 be arranged at part in mobile device (following be called first module) in the operational process of tested application, its performance information is periodically gathered according to the time interval preset, and the mobile device performance information collected and acquisition time this locality are stored in mobile device performance logs, afterwards, mobile device performance logs can be uploaded to server by first module, from the information that server receives, mobile device performance information and acquisition time is got to make the part in server (following be called second unit) that is arranged at of performance monitoring module 200, as second unit sends mobile device performance test information upload request by server to mobile device, first module is after mobile device receives the next mobile device performance test information upload request of server transmission, the mobile device performance logs that mobile device this locality stores is uploaded to server, make second unit successfully get mobile device performance information and acquisition time, and mobile device performance logs this locality that server can receive by second unit is stored in server, like this, be arranged at determinacy energy module 220 in server when needs carry out applied performance analysis, the tested acquisition time being applied in mobile device performance information and mobile device performance information in mobile device operational process can be obtained easily from the mobile device performance logs that this locality stores.

The mobile device performance information of the present embodiment includes multiple performance index of mobile device usually, and the performance index that mobile device performance information specifically comprises can be determined according to the actual testing requirement of application; Such as, mobile device performance information can specifically comprise: any one or any two or any three or all in mobile device cpu usage, mobile device internal memory service condition, mobile device network traffics and mobile device battery service condition.

Performance monitoring module 200 can gather the tested mobile device performance information be applied in mobile device operational process by corresponding API (ApplicationProgrammingInterface, application programming interface) in the operating system of calling mobile device.

The performance monitoring module 200 of the present embodiment gathers and is testedly applied in mobile device performance information in mobile device operational process and one of local storing mobile device capability information and acquisition time concrete example is: performance monitoring module 200 is after the time interval preset arrives, SystemProperties.java in call operation system obtains current mobile device CPU usage, ActivityManager.java in call operation system obtains current mobile device memory usage, ConnectivityManager.java in call operation system obtains current mobile device network traffics, BatteryManager.java in call operation system obtains current mobile device battery electric quantity, above-mentioned four call operation can be carried out under normal conditions simultaneously, performance monitoring module 200 is when performing above-mentioned call operation or receive the current mobile device CPU usage that operating system returns, current mobile device memory usage, when current mobile device network traffics and current mobile device battery electric quantity, obtain the current time (namely beating timestamp to mobile device performance information) of mobile device, then, performance monitoring module 200 is by current mobile device CPU usage, current mobile device memory usage, current mobile device network traffics, the current time of current mobile device battery electric quantity and mobile device is stored in mobile device performance logs as a record.The API that the performance monitoring module 200 of the present embodiment can utilize the operating system of mobile device to provide to obtain the current time of mobile device, as the current time utilizing the System.currentTimeMillis () in operating system to obtain mobile device.

Operation monitoring module 210 can be arranged in mobile device completely, also can be arranged in server completely, partly can also be arranged at part in mobile device and be arranged in server.Operation monitoring module 210 is mainly suitable for obtaining and is testedly applied in user's historical operation information and historical operation time of origin in mobile device operational process.

Concrete, when operation monitoring module 210 is arranged at the mobile device running tested application completely, operation monitoring module 210 can in the operational process of tested application, the operation of Real-Time Monitoring user (operation of user here typically refers to the operation of the user that the test logic that designs for application performance test is simulated), and monitor user perform operate accordingly time, obtain the current time of mobile device, and the operation information corresponding to the operation user monitored performed and above-mentioned current time are stored in the daily record of user's historical operation as user's historical operation information and historical operation time of origin this locality, thus determine that performance module 220 is when needs carry out applied performance analysis, can obtain from user's historical operation daily record that mobile device this locality stores easily and testedly be applied in user's historical operation information and historical operation time of origin in mobile device operational process.

When operation monitoring module 210 is arranged at other equipment of being connected with the mobile device running tested application completely as server, operation monitoring module 210 can be applied in the operational process of mobile device tested, the operation of Real-Time Monitoring user (operation of user here typically refers to the operation of the user that the test logic that designs for application performance test is simulated), and monitor user perform operate accordingly time, operation monitoring module 210 obtains the current time (namely beating timestamp to user's historical operation information) of mobile device, and the operation information of operation correspondence user performed and above-mentioned current time are stored in the daily record of user's historical operation as user's historical operation information and historical operation time of origin this locality, afterwards, the daily record of user's historical operation can be uploaded to server by operation monitoring module 210, as user's historical operation daily record that this locality stores is uploaded to server on one's own initiative by operation monitoring module 210 after tested application end of run, for another example, user's historical operation daily record that mobile device this locality stores, after mobile device receives the next mobile device performance test information upload request of server transmission, is uploaded to server by operation monitoring module 210, like this, be arranged at determinacy energy module 220 in server when needs carry out applied performance analysis, can receive from server and obtain the local user's historical operation daily record stored easily and be testedly applied in user's historical operation information and historical operation time of origin in mobile device operational process.Same, the API that operation monitoring module 210 in the present embodiment can utilize the operating system of mobile device to provide to obtain the current time of mobile device, as operation monitoring module 210 utilizes the System.currentTimeMillis () in operating system to obtain the current time of mobile device.

Be arranged in mobile device in operation monitoring module 210 part, when part is arranged at other equipment of being connected with the mobile device running tested application as server, operation monitoring module 210 be arranged at part in mobile device (following be called Unit the 3rd) in the operational process of tested application, the operation of Real-Time Monitoring user (operation of user here typically refers to the operation of the user that the test logic that designs for application performance test is simulated), and monitor user perform operate accordingly time, Unit the 3rd obtains the current time (namely beating timestamp to user's historical operation information) of mobile device, and the operation information of operation correspondence user performed and above-mentioned current time are stored in the daily record of user's historical operation as user's historical operation information and historical operation time of origin this locality, afterwards, the daily record of user's historical operation can be uploaded to server by Unit the 3rd, from the information that server receives, user's historical operation information and historical operation time of origin is got to make the part in server (following be called Unit the 4th) that is arranged at of operation monitoring module 210, as Unit the 4th sends mobile device performance test information upload request by server to mobile device, Unit the 3rd is after mobile device receives the next mobile device performance test information upload request of server transmission, user's historical operation daily record that mobile device this locality stores is uploaded to server, make Unit the 4th successfully obtain user's historical operation information and historical operation time of origin, and user's historical operation daily record this locality that server can receive by Unit the 4th is stored in server, like this, be arranged at determinacy energy module 220 in server when needs carry out applied performance analysis, can obtain from user's historical operation daily record that server this locality stores easily and testedly be applied in user's historical operation information and historical operation time of origin in mobile device operational process.

Mobile device performance information daily record in the present embodiment and the daily record of user's historical operation should upload onto the server usually simultaneously, such as, the mobile device performance information daily record of this locality storage and the daily record of user's historical operation upload onto the server on one's own initiative by performance monitoring module 200 and/or operation monitoring module 210 after tested application end of run simultaneously; Again such as, performance monitoring module 200 and/or operation monitoring module 210 are after mobile device receives the next mobile device performance test information upload request of server transmission, and the mobile device performance information daily record store this locality and the daily record of user's historical operation upload onto the server simultaneously.Above-mentioned two daily records can upload onto the server by utilizing Upload () function by the performance monitoring module 200 of the present embodiment and/or operation monitoring module 210.In addition, performance monitoring module 200 and/or operation monitoring module 210 can empty the record in the daily record of mobile device performance information and the daily record of user's historical operation of successfully having uploaded.

Application performance test program can obtain the UI control in the also tested application of identification usually, and calls the corresponding UI control in tested application according to corresponding test logic, to test tested application.Application performance test program is when calling the corresponding UI control of tested application, and corresponding UI control information and current time of calling can be recorded in the daily record of user's historical operation as user's historical operation information and operation time of origin by operation monitoring module 210.

Operation monitoring module 210 gathers the tested user's operation information be applied in mobile device operational process, and local store the concrete example of user's operation information and operation time of origin one for: application performance test program after operation by can know to operating system inquiry tested application all UI controls (as application performance test program by utilize the Robotium of operating system the API that provides can inquire about all UI controls knowing tested application), then, the test logic that application performance test program can pre-set according to it calls corresponding UI control, make tested application for the current corresponding UI control called perform corresponding operation (as application performance test program by utilize the Robotium of operating system the API that provides tested application can be made to perform operation corresponding to UI control), thus by imitating user, to tested application, performance test is carried out to the practical operation of tested application, application performance test program is when calling corresponding UI control and make tested application execution operate accordingly, operation monitoring module 210 can record operation information corresponding to this UI control, and obtain the current time (be this UI control and increase corresponding timestamp) of mobile device simultaneously, then, operation information corresponding for UI control and current time are stored in the daily record of user's historical operation as a record by operation monitoring module 210.The daily record of above-mentioned user's historical operation can be the file of txt form, also can be the file of extended formatting.

Determine that performance module 220 can be arranged in mobile device completely, also can be arranged in server completely.Determine that mobile device performance information, acquisition time, user's historical operation information and historical operation time of origin that performance module 220 is mainly suitable for obtaining according to above-mentioned performance monitoring module 200 and operation monitoring module 210 determine the situation of change of the application performance of tested application with acquisition time, user's historical operation information and historical operation time of origin.

Determine that performance module 220 can first utilize mobile device performance information and acquisition time to form broken line graph or histogram or statistical form etc., then, recycling historical operation time of origin, is marked at the corresponding position in broken line graph or histogram or statistical form by corresponding user's historical operation information.

When the mobile device performance information obtained includes multiple performance index, determine that performance module 220 can determine the situation of change of each performance index with acquisition time, user's historical operation information and historical operation time of origin respectively, a concrete example, mobile device cpu usage is comprised at the mobile device performance information obtained, mobile device internal memory service condition, in the practical application scene of mobile device network traffics and mobile device battery service condition, determine that performance module 220 can read out the number percent that all tested application consume CPU from the daily record of mobile device performance information, tested application consumes the number percent of internal memory, the network traffics that tested application consumes, mobile device battery electric quantity and acquisition time corresponding to each information, and utilize all tested application read out to consume the number percent of CPU, tested application consumes the number percent of internal memory, the network traffics that tested application consumes, mobile device battery electric quantity and acquisition time corresponding to each information generate four broken lines, these four broken lines should be arranged in four different coordinate systems usually, same coordinate system can certainly be arranged in, no matter four broken line is arranged in same coordinate system, be still arranged in four different coordinate systems, the horizontal ordinate of coordinate system all represents acquisition time, and the ordinate of coordinate system all represents the concrete quantized values of performance index, then, determine that performance module 220 reads all user's historical operation information and historical operation time of origin from the daily record of user's historical operation, determine the position of each historical operation time of origin horizontal ordinate in a coordinate system, and mark corresponding user historical operation information in the position of broken line or historical operation time of origin at abscissa positions place in historical operation time of origin correspondence, determine that performance module 220 can mark based on the character express that user's historical operation information is corresponding, also can mark based on the identifier etc. that user's historical operation information is corresponding.

Determine that performance module 220 can utilize existing drawing plug-in unit to draw above-mentioned broken line graph, as determined, the data of reading are supplied to drawing plug-in unit according to the mode preset by performance module 220, thus the Plotting data that drawing plug-in unit can receive according to it goes out above-mentioned broken line graph.

Output performance module 230 can be arranged in mobile device completely, also can be arranged in server completely.Output performance module 230 is mainly suitable for exporting the above-mentioned situation of change determining the application performance of the tested application that performance module 220 is determined.

Concrete, output performance module 230 can show the situation of change (as shown above-mentioned broken line graph) of application performance with acquisition time, user's historical operation information and historical operation time of origin of tested application by the display screen of application performance test equipment, also can by this situation of change of printer output (as printed statistical form), certainly, the present embodiment can also export this situation of change by other means.

Output performance module 230 exports in the practical application scene of the situation of change of the application performance of tested application at employing display screen, various ways show tags user's historical operation information in a coordinate system can be adopted, during as some place of certain in the mouse-pointing broken line of application performance test equipment (or touch position is certain some place in broken line), output performance module 230 makes character express corresponding to the user's historical operation information near this point or identifier having to explicitly be shown, and character express corresponding to the user's historical operation information making to be positioned at other positions or identifier are in hiding display state, for another example, in the mouse-pointing broken line of application performance test equipment certain some place (or touch position is certain some place in broken line) time, output performance module 230 makes to be marked at character express corresponding to all user's historical operation information in this broken line or identifier is all having to explicitly shown.

In addition, when many broken lines (as four broken lines) are arranged in same coordinate system, output performance module 230 can make ordinate demonstrate unit scales corresponding to four broken lines respectively, as output performance module 230 utilizes four ordinates to show unit scales corresponding to four broken lines; Certainly, output performance module 230 also can adopt other modes to show four unit scales corresponding to broken line, such as, in the mouse-pointing of application performance test equipment a certain bar broken line certain some place (or touch position is certain some place in a certain bar broken line) time, output performance module 230 makes the unit scales value of the ordinate of this coordinate system should show unit scales value corresponding to this broken line; And when not pointing to any point place (or touch position is not any point place in any broken line) in any broken line at the mouse of application performance test equipment, output performance module 230 makes the unit scales value of the ordinate of this coordinate system can unit scales value corresponding to a certain bar broken line that presets.

A1, a kind of application performance test method, the method comprises:

Obtain the tested acquisition time being applied in mobile device performance information and described performance information in mobile device operational process;

Obtain and be testedly applied in user's historical operation information and historical operation time of origin in mobile device operational process;

The situation of change of the application performance of described tested application with described acquisition time, described user's historical operation information and described historical operation time of origin is determined according to described mobile device performance information, described acquisition time, described user's historical operation information and described historical operation time of origin;

Export the situation of change of the application performance of described tested application.

A2, application performance test method as described in A1, wherein, described mobile device performance information comprises: at least one in mobile device cpu usage, mobile device internal memory service condition, mobile device network traffics and mobile device battery service condition.

A3, application performance test method as described in A2, wherein, described mobile device network traffics comprise: at least one in Wi-Fi data traffic and 2G/3G/4G data traffic.

A4, application performance test method as described in A1 or A2 or A3, wherein, the tested acquisition time being applied in mobile device performance information and described performance information in mobile device operational process of described acquisition comprises:

Receive the mobile device performance logs that mobile device is uploaded, and obtain described mobile device performance information and described acquisition time from described mobile device performance logs;

Wherein, the generating mode of described mobile device performance logs comprises: be testedly applied in mobile device operational process, described mobile device timing acquiring mobile device performance information, and the mobile device performance information collected and acquisition time are stored in described mobile device performance logs.

A5, application performance test method as described in A1 or A2 or A3, wherein, described acquisition is tested to be applied in user's historical operation information and historical operation time of origin in mobile device operational process and to comprise:

Receive user's historical operation daily record that mobile device is uploaded, and obtain described user's historical operation information and historical operation time of origin from the daily record of described user's historical operation;

Wherein, the generating mode of described user's historical operation daily record comprises: be testedly applied in mobile device operational process, mobile device monitor user ' operates, and the user's operation information monitored and operation time of origin information is stored in described mobile device performance logs as user's historical operation information and historical operation time of origin.

A6, application performance test method as described in A1 or A2 or A3, wherein, the situation of change of the application performance of the described tested application of described output comprises:

The situation of change of the application performance of described tested application is exported with the form of broken line graph;

Wherein, the horizontal ordinate of described broken line graph represents described acquisition time, and the ordinate of described broken line graph represents described mobile device performance information, and the broken line in described broken line graph has corresponding user's historical operation information at corresponding historical operation time of origin place mark.

A7, application performance test method as described in A6, wherein, comprise at described mobile device performance information: in the application scenarios of mobile device cpu usage, mobile device internal memory service condition, mobile device network traffics and mobile device battery service condition, described broken line graph comprises: mobile device cpu usage broken line graph, mobile device internal memory service condition broken line graph, mobile device network traffics broken line graph and mobile device battery service condition broken line graph.

B8, a kind of application performance test device, this device comprises:

Performance monitoring module, is suitable for obtaining the tested acquisition time being applied in mobile device performance information and described performance information in mobile device operational process;

Operation monitoring module, is suitable for obtaining and is testedly applied in user's historical operation information and historical operation time of origin in mobile device operational process;

Determine performance module, be suitable for determining the situation of change of the application performance of described tested application with described acquisition time, described user's historical operation information and described historical operation time of origin according to described mobile device performance information, described acquisition time, described user's historical operation information and described historical operation time of origin;

Output performance module, is suitable for the situation of change of the application performance exporting described tested application.

B9, application performance test device as described in B8, wherein, described mobile device performance information comprises: at least one in mobile device cpu usage, mobile device internal memory service condition, mobile device network traffics and mobile device battery service condition.

B10, application performance test device as described in B9, wherein, described mobile device network traffics comprise: at least one in Wi-Fi data traffic and 2G/3G/4G data traffic.

B11, application performance test device as described in B8 or B9 or B10, wherein, described performance monitoring module is specifically suitable for: receive the mobile device performance logs that mobile device is uploaded, and obtain described mobile device performance information and described acquisition time from described mobile device performance logs;

B12, application performance test device as described in B8 or B9 or B10, wherein, described operation monitoring module is specifically suitable for: receive user's historical operation daily record that mobile device is uploaded, and obtain described user's historical operation information and historical operation time of origin from the daily record of described user's historical operation;

B13, application performance test device as described in B8 or B9 or B10, wherein, described output performance module is specifically suitable for: the situation of change exporting the application performance of described tested application with the form of broken line graph;

B14, application performance test device as described in B13, wherein, comprise at described mobile device performance information: in the application scenarios of mobile device cpu usage, mobile device internal memory service condition, mobile device network traffics and mobile device battery service condition, described broken line graph comprises: mobile device cpu usage broken line graph, mobile device internal memory service condition broken line graph, mobile device network traffics broken line graph and mobile device battery service condition broken line graph.

Intrinsic not relevant to any certain computer, virtual system or miscellaneous equipment with display at this algorithm provided.Various general-purpose system also can with use based on together with this teaching.According to specific descriptions above, the structure constructed required by this type systematic is apparent.In addition, the present invention is not also for any certain programmed language.It should be understood that and various programming language can be utilized to realize content of the present invention described here, and the description done language-specific is above to disclose preferred forms of the present invention.

In instructions provided herein, describe a large amount of detail.But can understand, embodiments of the invention can be put into practice when not having these details.In some instances, be not shown specifically known method, structure and technology, so that not fuzzy understanding of this description.

Similarly, be to be understood that, in order to simplify the disclosure and to help to understand in each inventive aspect one or more, in the description above to exemplary embodiment of the present invention, each feature of the present invention is grouped together in single embodiment, figure or the description to it sometimes.But, the method for the disclosure should be construed to the following intention of reflection: namely the present invention for required protection requires feature more more than the feature clearly recorded in each claim.Or rather, as claims below reflect, all features of disclosed single embodiment before inventive aspect is to be less than.Therefore, the claims following embodiment are incorporated to this embodiment thus clearly, and wherein each claim itself is as independent embodiment of the present invention.

Those skilled in the art are appreciated that and adaptively can change the module in the equipment in embodiment and they are arranged in one or more equipment different from this embodiment.Module in embodiment or unit or assembly can be combined into a module or unit or assembly, and multiple submodule or subelement or sub-component can be put them in addition.Except at least some in such feature and/or process or unit be mutually repel except, any combination can be adopted to combine all processes of all features disclosed in this instructions (comprising adjoint claim, summary and accompanying drawing) and so disclosed any method or equipment or unit.Unless expressly stated otherwise, each feature disclosed in this instructions (comprising adjoint claim, summary and accompanying drawing) can by providing identical, alternative features that is equivalent or similar object replaces.

In addition, those skilled in the art can understand, although embodiments more described herein to comprise in other embodiment some included feature instead of further feature, the combination of the feature of different embodiment means and to be within scope of the present invention and to form different embodiments.Such as, in the following claims, the one of any of embodiment required for protection can use with arbitrary array mode.

All parts embodiment of the present invention with hardware implementing, or can realize with the software module run on one or more processor, or realizes with their combination.It will be understood by those of skill in the art that the some or all functions that microprocessor or digital signal processor (DSP) can be used in practice to realize according to the some or all parts in the application performance test device of the embodiment of the present invention.The present invention can also be embodied as part or all equipment for performing method as described herein or device program (such as, computer program and computer program).Realizing program of the present invention and can store on a computer-readable medium like this, or the form of one or more signal can be had.Such signal can be downloaded from internet website and obtain, or provides on carrier signal, or provides with any other form.

It should be noted, above-described embodiment is that the present invention will be described, instead of limits the invention, and those skilled in the art can design alternative embodiment when not departing from the scope of claims.In the claims, any reference symbol between bracket should be configured to limitations on claims.Word " comprises " not to be got rid of existence and does not arrange element in the claims or step.Word "a" or "an" before being positioned at element is not got rid of and be there is multiple such element.The present invention can by means of including the hardware of some different elements and realizing by means of the computing machine of suitably programming.In the unit claim listing some devices, several in these devices can be carry out imbody by same hardware branch.Word first, second and third-class use do not represent any order, can be title by these word explanations.

Claims

1. an application performance test method, the method comprises:

2. application performance test method as claimed in claim 1, wherein, described mobile device performance information comprises: at least one in mobile device cpu usage, mobile device internal memory service condition, mobile device network traffics and mobile device battery service condition.

3. application performance test method as claimed in claim 2, wherein, described mobile device network traffics comprise: at least one in Wi-Fi data traffic and 2G/3G/4G data traffic.

4. the application performance test method as described in claim 1 or 2 or 3, wherein, the tested acquisition time being applied in mobile device performance information and described performance information in mobile device operational process of described acquisition comprises:

5. the application performance test method as described in claim 1 or 2 or 3, wherein, described acquisition is tested to be applied in user's historical operation information and historical operation time of origin in mobile device operational process and to comprise:

6. the application performance test method as described in claim 1 or 2 or 3, wherein, the situation of change of the application performance of the described tested application of described output comprises:

7. application performance test method as claimed in claim 6, wherein, comprise at described mobile device performance information: in the application scenarios of mobile device cpu usage, mobile device internal memory service condition, mobile device network traffics and mobile device battery service condition, described broken line graph comprises: mobile device cpu usage broken line graph, mobile device internal memory service condition broken line graph, mobile device network traffics broken line graph and mobile device battery service condition broken line graph.

8. an application performance test device, this device comprises:

9. application performance test device as claimed in claim 8, wherein, described mobile device performance information comprises: at least one in mobile device cpu usage, mobile device internal memory service condition, mobile device network traffics and mobile device battery service condition.

10. application performance test device as claimed in claim 9, wherein, described mobile device network traffics comprise: at least one in Wi-Fi data traffic and 2G/3G/4G data traffic.