CN104035869A - Application evaluation method, terminal, and server - Google Patents
Application evaluation method, terminal, and server Download PDFInfo
- Publication number
- CN104035869A CN104035869A CN201410279618.6A CN201410279618A CN104035869A CN 104035869 A CN104035869 A CN 104035869A CN 201410279618 A CN201410279618 A CN 201410279618A CN 104035869 A CN104035869 A CN 104035869A
- Authority
- CN
- China
- Prior art keywords
- terminal
- test file
- test
- application
- service end
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Abstract
The invention provides an application evaluation method, a terminal, and a server. The application evaluation method includes the steps: the terminal acquires a test file of a specified application; the terminal executes the test file to test the specified application so as to obtain test data; the terminal reports the test data of the specified application to the server so that the server acquires evaluation results for the specified application according to the test data. Automatic testing execution and data collection for the specified application can be achieved via a third-party evaluation system composed of the terminal and the server, so that uniform testing execution scheduling, data aggregation and evaluation analysis are achieved. The third-party evaluation system is used for evaluation, so that the method is independent and objective as compared with the prior method in which evaluation is completely based on logs recorded by the application itself; the test data obtained, such as response time, are more accurate and comprehensive; accordingly, evaluation results based on the test data are higher in accuracy.
Description
Technical field
The application relates to application testing technical field, relates in particular to a kind of evaluating method, terminal and server of application.
Background technology
Along with the arrival in mobile Internet epoch, various application are used by user more and more widely, become gradually the key element of people's daily life.The angle that how to stand in real user use goes evaluation and test application to guarantee its stability, seems particularly important.
At present mainly contain two kinds of modes for the evaluating method of a lot of application, be respectively the evaluation and test in simulation evaluation and test and the user's use procedure in R&D process.
Wherein, the simulation evaluation and test in R&D process is in the performance history of application, by environment for use and the scene of simulation application, application is evaluated and tested, and the method cannot accurately be inferred the state being applied in real user use procedure.Evaluating method in user's use procedure is user in the time using this application, application self record User operation log, and the User operation log that application developer returns by application carries out data analysis, completes the evaluation and test to this application.
But, although being the use procedure based on real user, the evaluation result of the method produces, but, due to the data analysis process daily record based on application self record completely, lack independence and objectivity, and application daily record to application also there is error in the response in use procedure and record, so still accuracy is lower for the evaluation result that this evaluating method obtains.
Summary of the invention
For solving the problems of the technologies described above, the embodiment of the present application provides a kind of evaluating method, terminal and server of application, the accuracy that can improve evaluation result.Technical scheme is as follows:
The evaluating method that a kind of application is provided, comprising:
Terminal is obtained the test file of specifying application;
Described terminal is carried out described test file described appointment application is tested, and obtains test data;
Described terminal reports the test data of described appointment application to service end, so that described service end obtains the evaluation result to described appointment application according to described test data.
Further, described terminal is obtained the test file of specifying application, comprising:
Described terminal sends test file update request to described service end, at least comprises the identification information of described terminal and the identification information of described appointment application in described test file update request;
Described terminal receives the up-to-date test file information of the described appointment application of described service end transmission;
Whether the current test file information that the more local described appointment of described terminal is applied is consistent with the up-to-date test file information that described service end sends;
If inconsistent, described terminal sends download request to described service end;
Described terminal receives the up-to-date test file of the described appointment application of described service end transmission.
Further, described terminal is obtained the test file of specifying application, comprising:
Described terminal sends test file request to described service end, at least comprises the identification information of described terminal and the current test file information of described appointment application in described test file update request;
When the current test file information of the described appointment application sending in the up-to-date test file information of the more local described appointment application of described service end and described terminal is inconsistent, described terminal receives the up-to-date test file that described appointment that described service end sends is applied.
Further, described terminal is carried out described test file described appointment application is tested, and obtains test data, comprising:
Described terminal is caught the resource consumption data of described appointment application by monitoring the operation of described appointment application.
Further, described terminal is carried out described test file described appointment application is tested, and obtains test data, comprising:
Described terminal records respectively stamp reference time under two association statuss that described appointment is applied in business, obtains the response time.
Further, described terminal records respectively stamp reference time under two association statuss that described appointment is applied in business, obtains the response time, comprising:
Described terminal records the first reference time stamp of described appointment when being applied in business and triggering;
Whether the displaying contents that described terminal comparison is caught from interface is consistent with expection content;
If consistent, described terminal record that described business responds second reference time stamp;
The response time of described terminal using the mistiming that stab described the second reference time and stab described the first reference time as described business.
The evaluating method that a kind of application is also provided, comprising:
Service end sends the test file of specifying application to terminal;
Described service end receives the test data of described terminal to report, and described test data is carried out described test file by described terminal described appointment application is tested to rear acquisition;
Described service end obtains the evaluation result to described appointment application according to described test data.
Further, before described service end sends the test file of specifying application to terminal, also comprise:
Described service end receives the test file update request that described terminal sends, and at least comprises the identification information of described terminal and the identification information of described appointment application in described test file update request;
Described service end sends the up-to-date test file information of described appointment application to described terminal;
When the up-to-date test file information that sends in the current test file information of the described appointment application of described terminal this locality and described service end is inconsistent, described service end receives the download request of described terminal transmission;
Described service end sends the test file of specifying application to terminal, comprising:
Described service end sends the up-to-date test file of described appointment application to described terminal.
Further, before described service end sends the test file of specifying application to terminal, also comprise:
Described service end receives the test file update request that described terminal sends, and at least comprises the identification information of described terminal and the current test file information of described appointment application in described test file update request;
Whether the current test file information of the described appointment application that the up-to-date test file information of the more local described appointment application of described service end sends with described terminal is consistent;
Described service end sends the test file of specifying application to terminal, comprising:
When described up-to-date test file information and described current test file information are when inconsistent, described service end sends the up-to-date test file of specifying application to terminal.
A kind of terminal is also provided, comprises:
File acquisition unit, for obtaining the test file of specifying application;
Test cell, tests described appointment application for carrying out described test file, obtains test data;
Data report unit, for report the test data of described appointment application to service end, so that described service end obtains the evaluation result to described appointment application according to described test data.
Further, described file acquisition unit comprises:
The first update request unit, for sending test file update request to described service end, at least comprises the identification information of described terminal and the identification information of described appointment application in described test file update request;
Information receiving unit, the up-to-date test file information of applying for receiving the described appointment of described service end transmission;
Information comparing unit, whether consistent with the up-to-date test file information that described service end sends for the current test file information of more local described appointment application;
Download request unit, while being inconsistent, sends download request to described service end for the comparative result obtaining when information comparing unit;
The first file receiving element, the up-to-date test file of applying for receiving the described appointment of described service end transmission.
Further, described file acquisition unit comprises:
The second update request unit, for sending test file update request to described service end, at least comprises the identification information of described terminal and the current test file information of described appointment application in described test file update request;
The second file receiving element, when inconsistent for the current test file information of the described appointment application that sends in the up-to-date test file information of the more local described appointment application of described service end and described terminal, receive the up-to-date test file that described appointment that described service end sends is applied.
Further, described test cell, specifically for catching the resource consumption data of described appointment application by the operation of monitoring described appointment application.
Further, described test cell, is applied in stamp reference time under two association statuss of business specifically for recording respectively described appointment, obtain the response time.
Further, described test cell comprises:
The first record cell, for recording described appointment first reference time stamp when being applied in business and triggering;
Content comparing unit, whether consistent with expection content for the displaying contents of relatively catching from interface;
The second record cell, when being consistent when the comparative result of described content comparing unit, record that described business responds second reference time stamp;
Time calculating unit, for the response time using the mistiming that stab described the second reference time and stab described the first reference time as described business.
A kind of server is also provided, comprises:
File transmitting element, for sending the test file of specifying application to terminal;
Data receiver unit, for receiving the test data of described terminal to report, described test data is carried out described test file by described terminal described appointment application is tested to rear acquisition;
Evaluation and test unit, for obtaining the evaluation result to described appointment application according to described test data.
Further, also comprise:
The first request reception unit, before sending the test file of specifying application at described file transmitting element to terminal, receive the test file update request that described terminal sends, in described test file update request, at least comprise the identification information of described terminal and the identification information of described appointment application;
Information transmitting unit, for sending the up-to-date test file information of described appointment application to described terminal;
The second request reception unit, when inconsistent for the up-to-date test file information that sends in the current test file information of the described appointment application of described terminal this locality and described service end, receives the download request of described terminal transmission;
Described file transmitting element, specifically for sending the up-to-date test file of described appointment application to described terminal.
Further, also comprise:
The 3rd request reception unit, before sending the test file of specifying application at described file transmitting element to terminal, receive the test file update request that described terminal sends, in described test file update request, at least comprise the identification information of described terminal and the current test file information of described appointment application;
Information comparing unit, whether the current test file information of the described appointment application sending with described terminal for the up-to-date test file information of more local described appointment application is consistent;
Described file transmitting element, specifically for when described up-to-date test file information and described current test file information are when inconsistent, sends the up-to-date test file of specifying application to terminal.
The embodiment of the present invention at least has following beneficial effect:
The embodiment of the present application is carried out automatic test execution and data acquisition by the third party's evaluating system being formed by terminal and service end to specifying to apply, and has realized United Dispatching, convergence and the evaluation and test analysis of test execution.The method adopts third party's evaluating system to evaluate and test, with respect to the evaluating method of the complete daily record based on application self record in prior art, there is independence and objectivity, the such as response times of the test data of its acquisition etc. are also more accurately with comprehensive, therefore the evaluation result accuracy, obtaining based on this test data is higher.
Brief description of the drawings
In order to be illustrated more clearly in the embodiment of the present application or technical scheme of the prior art, to the accompanying drawing of required use in embodiment or description of the Prior Art be briefly described below, apparently, the accompanying drawing the following describes is only some embodiment that record in the application, for those of ordinary skill in the art, do not paying under the prerequisite of creative work, can also obtain according to these accompanying drawings other accompanying drawing.
Fig. 1 is the evaluating method process flow diagram of a kind of application in the embodiment of the present invention;
Fig. 2 is the method flow diagram that obtains the service response time in the embodiment of the present invention;
Fig. 3 is the evaluating method process flow diagram of another kind of application in the embodiment of the present invention;
Fig. 4 is the configuration diagram of service end in the embodiment of the present invention;
Fig. 5 is the mutual schematic diagram between service end and each terminal in the embodiment of the present invention;
Fig. 6 is the method flow diagram that in the embodiment of the present invention, a kind of terminal is obtained the test file of specifying application from service end;
Fig. 7 is the method flow diagram that in the embodiment of the present invention, another kind of terminal is obtained the test file of specifying application from service end;
Fig. 8 is the structural representation of a kind of terminal in the embodiment of the present invention;
Fig. 9 is the structural representation of a kind of file acquisition unit in the embodiment of the present invention;
Figure 10 is the structural representation of another kind of file acquisition unit in the embodiment of the present invention;
Figure 11 is the structural representation of a kind of test cell in the embodiment of the present invention;
Figure 12 is the structural representation of a kind of server in the embodiment of the present invention;
Figure 13 is the structural representation of another kind of server in the embodiment of the present invention;
Figure 14 is the structural representation of another kind of server in the embodiment of the present invention;
Figure 15 is the structural representation of a kind of third party's evaluating system in the embodiment of the present invention.
Embodiment
In order to make those skilled in the art person understand better the technical scheme in the application, below in conjunction with the accompanying drawing in the embodiment of the present application, technical scheme in the embodiment of the present application is clearly and completely described, obviously, described embodiment is only some embodiments of the present application, instead of whole embodiment.Based on the embodiment in the application, those of ordinary skill in the art are not making the every other embodiment obtaining under creative work prerequisite, all should belong to the scope of the application's protection.
For the above-mentioned purpose, the feature and advantage that make the application can become apparent more, below in conjunction with the drawings and specific embodiments, the application is described in further detail.
Referring to Fig. 1, it is the evaluating method process flow diagram of a kind of application of the embodiment of the present invention.
The present embodiment describes taking terminal as executive agent, and this evaluating method can comprise:
Step 101, terminal is obtained the test file of specifying application.
This terminal, as mobile phone, mobile phone test instrument and service end can be installed and carry out alternately to determine the test file of specifying application, this test file can be preset in this terminal after terminal and service end are mutual, also can be that transverse and longitudinal section is before carrying out test, first get from service end, concrete as the description of subsequent embodiment.
Wherein, the test file of appointment application can comprise the data to specifying the test of application needs, test script, and service end is pressed the configuration file of the terminal test instrument of the generations such as heterogeneous networks, region, type, user type, IMEI number etc.Configuration file is XML form, and interface that can control terminal by configuration file presents and operating right.
This terminal can be carried out next step by the test file of carrying out specifying application, realizes the function of test configurations, test execution, performance monitoring, data upload.
Step 102, terminal is carried out test file to specifying application to test, and obtains test data.
First terminal can carry out test configurations obtaining after the test file of specifying application, and this test configurations can comprise that the reading of configuration file, resource load and script is resolved.In configuration file, there are the information such as tested application (also specifying application) and test script version number, content measurement, read the configuration file issuing by terminal, reach the flexible control to measurability and content measurement; Resource file can comprise bag name, the audio frequency of test needs etc. of specifying application, by loading resource, to ensure the realization of automatic testing process; The test script content that terminal sets service end is resolved, to ensure the normal execution of automatic test.
After having configured, terminal starts to carry out test file tests, and obtains test data.In an instantiation, this test process can comprise following content:
First, test starting, starts the appointment application of Embedded test process, for the automatic test in later stage is given security.This step realizes test starting by startInstrumentation method, and specific implementation code is as follows:
ComponentName?cn＝new?ComponentName(yourPackageName,
"android.test.InstrumentationTestRunner")；
Bundle?bundle＝new?Bundle()；
bundle.putString("class",yourTestClassName#testMethod)；
context.startInstrumentation(cn,null,bundle)；
Wherein,
YourPackageName: referring to the bag name of Apk application, is that application is installed to the unique identification in mobile phone;
YourTestClassName: be used to specify certain test class in use test script;
TestMethod: be used to specify certain method in test class.
For the test of Android (Android) application, the android.test framework that can adopt Android platform to provide, in this frame foundation, pass through Instrumentation analoglike operational applications interface simultaneously, realize the UI interface operation to specifying application, use the effect of specifying application thereby reach Reality simulation user.
But the actual android.test that uses realizes in automatic test course and can find, search control, operational controls and catch control state very inconvenient, affect greatly automatic test development efficiency.For improving script development efficiency, encapsulate based on android.test, a set of complete automated test frame iflyUItest_framework is provided.This framework improves by OO mode, has optimized to catch that control, state are asserted and the processing of result record, and the function of automatically catching error log and sectional drawing is provided, and has improved the efficiency of test script exploitation and test result analysis.
In this automated test frame iflyUItest_framework, each scene is by the automatic test mode of data-driven, the scene with same operation step is abstracted into identical code logic and completes test process, this mode has ensured that data and service logic are separated, and can allow the configuration of test data more flexible.
Pass through said process, terminal can be caught the multiple test data of specifying application, for example, CPU usage, internal memory use amount, network traffic, the resource consumption data such as power consumption, terminal device environmental data, the response time of appointment applied business, user obtains number of success and the request number of times etc. of specifying application service result.
In one example, terminal can be specified by monitoring the operation of application, obtains the CPU usage of specifying application, internal memory use amount, network traffic, the resource consumption data such as power consumption.
Meanwhile, terminal device environmental data can be used as the important supplement part to specifying applied performance analysis, and these data are made up of equipment Foundations information and equipment multidate information.Equipment Foundations information comprises mobile phone brand and model, cpu number and frequency, memory size, free memory, and equipment multidate information comprises network type, IP address, signal intensity, geographic position etc.
In another example, terminal can specify the service response time of application to analyze the performance of business scenario by catching, the success ratio of carrying out by scene service is analyzed its stability, analyzes concrete error reason by the abnormal sectional drawing under error result and daily record data simultaneously.Concrete, terminal can record respectively stamp reference time under two association statuss of specifying the business that is applied in, and then the response time of the business of acquisition.
Wherein obtain the process of service response time, as shown in Figure 2, can comprise:
Step 201, stab the first reference time when terminal record specifies the business that is applied in to trigger.
For example, when, as clicked in the button of this business of setting out, logging timestamp T1 is as stabbing for the first reference time.
Step 202, whether the displaying contents that terminal comparison is caught from interface is consistent with expection content.
Terminal is caught displaying contents from interface, whether the content of then relatively catching is consistent with expection content, if consistent, execution step 203, if inconsistent, record relevant daily record, and catch the content of this interface display, form sectional drawing, be then transferred to service end analysis by the unification of binary stream mode.
Step 203, stab the second reference time that terminal record traffic responds.
If in upper step, comparative result is consistent, stab the second reference time that the time stamp T 2 while recording the content of this interface appearance expection responds as business.
Step 204, the response time of terminal using the mistiming that stab the second reference time and stab the first reference time as this business.
Be response time T=T2-T1.
The computing method of this response time are compared and are applied that self is accurate by the response time of log recording in prior art, in prior art, application can only be recorded the time that clicks program response from accepting user, but the response time of the true perception of user is actually the time presenting to interface from clicking end, and this has wherein lacked the interface render time of program.Based on this, the interface producing when service condition changes when we take to catch presents the mode that changes recording responses stamp reference time, guarantees that the response time of calculating more meets user's true perception.
Terminal, obtaining after above-mentioned one or more test datas, can perform step 103.
Step 103, terminal reports the test data of specifying application to service end, so that service end obtains the evaluation result to specifying application according to test data.
After terminal test completes, integrating various data, form test data set, is data stream by data set ciphered compressed, initiates post request to service extremity piece.Terminal can adopt the test log of http agreement to service end transmission json form, in this test log, can comprise aforementioned one or more test data, such as terminal device environmental data, specify the business correctness data such as application resource consumption data and service response time.
Service end receives after the test data of specifying application, by flume, convergence is stored, and can, according to test data to specifying application to evaluate and test, generate evaluation result.Meanwhile, the result that whether receives test data is returned to terminal by service end.Test client in terminal is uploaded the daily record of failure in this locality storage, in the time that appearance is abnormal, data are saved to this locality, during for lower secondary data passback, handles together.
The embodiment of the present application is carried out automatic test execution and data acquisition by the third party's evaluating system being formed by terminal and service end to specifying to apply, and has realized United Dispatching, convergence and the evaluation and test analysis of test execution.The method adopts third party's evaluating system to evaluate and test, with respect to the evaluating method of the complete daily record based on application self record in prior art, there is independence and objectivity, the such as response times of the test data of its acquisition etc. are also more accurately with comprehensive, therefore the evaluation result accuracy, obtaining based on this test data is higher.
And this evaluation and test process is analog subscriber operational applications on various real user terminals, data are more true and reliable, and by amendment test script, realized service analogue and evaluation and test to various different application; The method can objectively record application response time and capturing function is abnormal, more comprehensively the resource consumption of record application and the ambient condition of place equipment.
Referring to Fig. 3, it is the evaluating method process flow diagram of the another kind of application of the embodiment of the present invention.
The present embodiment describes taking service end as executive agent, and this evaluating method can comprise:
Step 301, service end sends the test file of specifying application to terminal.
In the present embodiment, the design of server architecture can meet highly reliable, large storage, strong fault tolerance, the easily requirement of expansion of Data Collection, and meets the requirement of the flexible manipulation to terminal execution test process, the displaying directly perceived to evaluation result.For the service end that meets the demands can adopt the Hadoop platform of increasing income and the framework of LAMP (Linux+Apache+MySQL+PHP) server combination, as shown in Figure 4, service end adopts in Fig. 1 the long-range Flume data of convergence-level to collect assembly to carry out test and the monitor data that convergence terminal side produces, then the data of the Json form of specification are stored in Hadoop distributed file system (HDFS), by periodically move MapReduce program on Hadoop, data are carried out depositing MySQL database in after pre-service, analysis and supervising the network (WEB) server are evaluated and tested analysis by the data in reading database to test result.In addition, after tool management person logins successfully by the page, the result that can check analyze, also can manage end side very easily.
Before service end sends the test file of specifying application to terminal, first, service end is carried out test configurations to the appointment application of end side.Service end can be by heterogeneous networks, region, type, user type, IMEI number generating configuration file.Configuration file is XML form, interface and operating right that can control terminal by configuration file.Keeper can upload to comprise and specify the test data of application and the test resource file of test script to service end.
As shown in Figure 5, service end is according to configuration file and test data, test scripts etc. form after test file, can timing test file be issued to terminal, also can be to have or not new test file by terminal compartment to service end inquiry, just send download request if had, by service end, up-to-date test file is issued to terminal, thereby can carry out flexible configuration to client utility.
Step 302, the test data that service end receiving terminal reports, this test data is carried out test file to specifying application to test rear acquisition by terminal.
Terminal is carried out test according to the method step described in abovementioned steps 102～103 after the test file obtaining specifying application, obtains test data, and is uploaded to service end.
As shown in Figure 5, service end, except different terminals side is carried out to issuing of test file, can also specify the test of application to carry out traffic control to each end side.Service end affects the operation of test by two kinds of modes, and the one, carry out operation dispatching by the configuration file of test execution, the 2nd, carry out operation dispatching by the mode of message push.Keeper can service end for network, region and type not in the same way test subscriber issue, push configuration file and the message of different content, thereby realize test flexibly, test as required.Service end can also be carried out monitoring to end side.The test data set that service end is also collected by statistics, analysis is carried out the test execution situation of monitor terminal side.
Step 303, service end obtains the evaluation result to specifying application according to test data.
Service end is obtaining after test data and can evaluate and test specifying to apply according to this test data.This process that obtains evaluation result according to test data can adopt existing evaluation metrics and evaluating method, also can self-defining evaluation metrics.
Evaluation result can comprise:
(1) success ratio: refer to that user obtains the number of success of application service result and user and initiate the ratio of operation requests sum.
The meaning of success ratio is to measure user and successfully uses the probability of applying a certain business function, can reflect that application product provides accuracy and the reliability of service.
(2) response time: the business (being tested business) that refers to certain appointment application is successfully sent instruction the time interval correctly presenting to business result from user.
The stand-by period when meaning of service response time is that measuring user uses certain business, can reflect that application product provides the speed situation of service.
(3) resource consumption.Mainly comprise CPU usage, internal memory use amount, network traffic, power consumption etc.The meaning of resource consumption is to measure APP hardware resource consumption during use, for contrasting with like product, can be reflected in the requirement in the situation of function, terminal hardware being configured.
For correspondence is used as out objective evaluation and test, need carry out statistical study to the test data of collecting.Statistical study type mainly comprises the statistical study to test execution, the statistical study to success ratio, the statistical study to the response time, the statistical study to resource consumption, statistical study to abnormal data, and comparative analysis, correlation analysis, Analysis of key influential factors and regretional analysis etc. to data are also provided simultaneously.For example:
(1) statistical study to test execution.Service end provides by region, network, type, user type, period statistical test implementation status; Provide by the number that Adds User IMEI number statistics active users every day, every day.
(2) the evaluation and test analysis to function result.Service end provides overall success ratio; Provide by time, region, network, type, specific software version, testing tool version, testing tool resource version and carry out classified statistics success ratio; Service end is also in chronological sequence sequentially added up continuously to single test scene in addition, and the test result of the multiple function points in a corresponding test data file is added up by time shaft.
(3) the evaluation and test analysis to the response time.Service end provides makes entirety statistics to the transaction response time; Provide by time, region, network, type, specific software version, testing tool version, testing tool resource version, Transaction name and carry out classified statistics, statistic can be selected minimum value, maximal value, intermediate value, average, upper quartile, lower quartile, hundredths, variance flexibly.Provide the statistics by time shaft for the continuous transaction time stamp of the single test scene of certain mobile phone in addition.
(4) statistics of resource consumption.Service end can be added up the CPU usage of specifying application, internal memory use amount, network traffics, the indexs such as power consumption.
(5) abnormal data analysis.For the lower business of success ratio, service end can be checked wrong sectional drawing, can push the wrong error code statistical analysis, analyzes and causes the key influence factor that success ratio is lower.For the business that the response time is grown, can find out 10% the slowest data of response time and distribute, provide association analysis report.
(6) other analysis demands comprise comparative analysis, correlation analysis, Analysis of key influential factors, regretional analysis.
Comparative analysis is by by different angles, data being divided into groups, and by comparing case line chart and the distribution density figure of response time, contrasts stability and the reliability of business under varying environment.
Correlation analysis provides the analytical approach of finding out incidence relation for numeric type data, and service end provides two kinds of algorithms to carry out correlation analysis, and the one, can provide by calculating covariance and related coefficient the relativity measurement of two attributes; Another kind is the method based on data grids, calculates the maximum information coefficient MIC of two variablees.If variable is to x, y existence function relation,, in the time that sample number increases, MIC must trend towards 1; If variable is to x, y is independent mutually under statistical significance, and, in the time that sample number increases, MIC is tending towards 0.By judge the whether relevant of data with grid, the method has generality, and no matter how data distribute, and is not limited to specific correlation function type, and this determination methods is all effective.
Analysis of key influential factors is analyzed with NB Algorithm in data mining for nonumeric type data acquisition, in the time of the Analysis of key influential factors to the response time, first by the size of response time, the response time is classified, then more stable to the classification of response time row by judging which attribute, the attribute that False Rate is less is exactly the key influence factor that affects the response time.
Regretional analysis provides for numeric type data, uses various functions to carry out matching, carries out the prediction of response time, and provides degree of confidence.
Above analytical approach detailed process can similarly to the prior art, repeat herein no longer one by one.
In the present embodiment, issue test file by service end, end side is carried out test, is recorded and upload relevant test data, and then has realized the unified of service end and analyzed.The unification that the method has realized test file as required issues the United Dispatching with testing apparatus, and intensive data analysis, searches correlationship and influence factor between data, makes evaluation result more comprehensively objective.
In another embodiment of the present invention, the process that terminal is obtained the test file of specifying application from service end can as shown in Figure 6, comprise:
Step 601, terminal sends test file update request to service end, at least comprises the identification information of terminal and specify the identification information of applying in this test file update request.
Terminal is initiated post request by http agreement to service end, at least comprises the identification information of terminal and specify the identification information of applying in this request.
Step 602, service end sends up-to-date test file information to terminal.
Service end receives after request, in this terminal return service end, specify the up-to-date test file information of applying, this up-to-date test file information can be specifically up-to-date resource version information, can comprise total version number of sub-version number, Resource Desc, download url, field and the resource set of each child resource etc.
Step 603, whether the current test file information that the more local appointment of terminal is applied is consistent with the up-to-date test file information that service end sends.
If consistent, terminal is directly carried out follow-up test step, if inconsistent, execution step 604.
In addition, terminal can send update request for the multiple application to this locality in batches, and receiving after the up-to-date test file information of each application that service end sends, screening obtains needing the Resources list of down loading updating, then according to this list download step of seeking unity of action.
Step 604, terminal sends download request to service end.
Step 605, service end sends the up-to-date test file of specifying application to terminal.
Service end is received after download request, returns to the byte stream of corresponding document.Terminal is synchronized to this locality by new resource version number after all file updates that need upgrade are completed.
In another embodiment of the present invention, the process that terminal is obtained the test file of specifying application from service end can also as shown in Figure 7, comprise:
Step 701, terminal sends test file update request to service end, at least comprises the identification information of terminal and specify the current test file information of applying in test file update request.
The difference of this step and abovementioned steps 601 is, has comprised the current test file information of specifying application in this test file update request, for example, specifies the version number of the current test file of application.
Step 702, whether the current test file information of the appointment application that the up-to-date test file information of the more local appointment application of service end sends with terminal is consistent.
Whether the up-to-date test file information of appointment application that service end is more local and the current test file information of the appointment application of terminal transmission is consistent, if consistent, comparative result returned to terminal, and terminal is directly carried out test.If inconsistent, perform step 703.
Step 703, service end sends the up-to-date test file of specifying application to terminal.
All can obtain the up-to-date test file of the appointment application of service end by above-mentioned two kinds of mode terminals.
In the various embodiments described above, terminal can be the equipment such as mobile phone; Specifying application can be arbitrary Android (Android) application, can be also other application; Terminal can be by being arranged on the client in terminal, as mobile phone test instrument is carried out in the time carrying out above-mentioned action.
Be more than the description to the application's embodiment of the method, below the device of realizing said method be introduced.
Referring to Fig. 8, it is the structural representation of a kind of terminal of the embodiment of the present application.
This terminal can comprise:
File acquisition unit 801, for obtaining the test file of specifying application;
Test cell 802, tests described appointment application for carrying out described test file, obtains test data;
Data report unit 803, for report the test data of described appointment application to service end, so that described service end obtains the evaluation result to described appointment application according to described test data.
In the present embodiment, third party's evaluating system that terminal forms by said units and service end, to specifying application to carry out automatic test execution and data acquisition, has been realized United Dispatching, convergence and the evaluation and test analysis of test execution.This terminal adopts third party's evaluating system to evaluate and test, with respect to the evaluating method of the complete daily record based on application self record in prior art, there is independence and objectivity, the such as response times of the test data of its acquisition etc. are also more accurately with comprehensive, therefore the evaluation result accuracy, obtaining based on this test data is higher.
In another embodiment of the present invention, as shown in Figure 9, this file acquiring unit 801 can further comprise:
The first update request unit 901, for sending test file update request to described service end, at least comprises the identification information of described terminal and the identification information of described appointment application in described test file update request;
Information receiving unit 902, the up-to-date test file information of applying for receiving the described appointment of described service end transmission;
Information comparing unit 903, whether consistent with the up-to-date test file information that described service end sends for the current test file information of more local described appointment application;
Download request unit 904, while being inconsistent, sends download request to described service end for the comparative result obtaining when information comparing unit;
The first file receiving element 905, the up-to-date test file of applying for receiving the described appointment of described service end transmission.
In another embodiment, as shown in figure 10, file acquisition unit 801 can comprise:
The second update request unit 1001, for sending test file update request to described service end, at least comprises the identification information of described terminal and the current test file information of described appointment application in described test file update request;
The second file receiving element 1002, when inconsistent for the current test file information of the described appointment application that sends in the up-to-date test file information of the more local described appointment application of described service end and described terminal, receive the up-to-date test file that described appointment that described service end sends is applied.
In another embodiment, test cell 802, specifically can be for catching the resource consumption data of described appointment application by the operation of monitoring described appointment application.
In another embodiment, test cell 802, specifically can also be used for recording respectively stamp reference time under two association statuss that described appointment is applied in business, obtains the response time.Specifically as shown in figure 11, this test cell 802 specifically can comprise:
The first record cell 1101, for recording described appointment first reference time stamp when being applied in business and triggering;
Content comparing unit 1102, whether consistent with expection content for the displaying contents of relatively catching from interface;
The second record cell 1103, when being consistent when the comparative result of described content comparing unit, record that described business responds second reference time stamp;
Time calculating unit 1104, for the response time using the mistiming that stab described the second reference time and stab described the first reference time as described business.
Referring to Figure 12, it is the structural representation of a kind of server of the embodiment of the present invention.
This server can comprise:
File transmitting element 1201, for sending the test file of specifying application to terminal;
Data receiver unit 1202, for receiving the test data of described terminal to report, described test data is carried out described test file by described terminal described appointment application is tested to rear acquisition;
Evaluation and test unit 1203, for obtaining the evaluation result to described appointment application according to described test data.
This server issues test file by said units, and end side is carried out test, recorded and upload relevant test data, and then has realized the unified of service end and analyzed.The unification that this server has been realized test file as required issues the United Dispatching with testing apparatus, and intensive data analysis, searches correlationship and influence factor between data, makes evaluation result more comprehensively objective.
In another embodiment, as shown in figure 13, this server, except comprising above-mentioned file transmitting element 1201, data receiver unit 1202, evaluation and test unit 1203, can also comprise:
The first request reception unit 1301, before sending the test file of specifying application at described file transmitting element 1201 to terminal, receive the test file update request that described terminal sends, in described test file update request, at least comprise the identification information of described terminal and the identification information of described appointment application;
Information transmitting unit 1302, for sending the up-to-date test file information of described appointment application to described terminal;
The second request reception unit 1303, when inconsistent for the up-to-date test file information that sends in the current test file information of the described appointment application of described terminal this locality and described service end, receives the download request of described terminal transmission;
In this embodiment, file transmitting element 1201, specifically for sending the up-to-date test file of described appointment application to described terminal.
In another embodiment, as shown in figure 14, this server, except comprising above-mentioned file transmitting element 1201, data receiver unit 1202, evaluation and test unit 1203, can also comprise:
The 3rd request reception unit 1401, before sending the test file of specifying application at described file transmitting element 1201 to terminal, receive the test file update request that described terminal sends, in described test file update request, at least comprise the identification information of described terminal and the current test file information of described appointment application;
Information comparing unit 1402, whether the current test file information of the described appointment application sending with described terminal for the up-to-date test file information of more local described appointment application is consistent;
Wherein, file transmitting element 1201, specifically for when described up-to-date test file information and described current test file information are when inconsistent, sends the up-to-date test file of specifying application to terminal.
As shown in figure 15, the embodiment of the present invention also provides a kind of third party's evaluating system, and this system can comprise terminal 1501 and server 1502,
Wherein, this terminal 1501, for obtaining the test file of specifying application; Carry out described test file described appointment application is tested, obtain test data; Report the test data of described appointment application to server 1502;
This server 1502, for sending the test file of specifying application to terminal 1501; Receive the test data that described terminal 1501 reports; Obtain the evaluation result to described appointment application according to described test data.
In each device and system, the specific implementation process of each unit please refer to the corresponding description of preceding method embodiment above, repeats no more herein.
For convenience of description, while describing above device, being divided into various unit with function describes respectively.Certainly, in the time implementing the application, the function of each unit can be realized in same or multiple software and/or hardware.
As seen through the above description of the embodiments, those skilled in the art can be well understood to the mode that the application can add essential general hardware platform by software and realizes.Based on such understanding, the part that the application's technical scheme contributes to prior art in essence in other words can embody with the form of software product, this computer software product can be stored in storage medium, as ROM/RAM, magnetic disc, CD etc., comprise that some instructions (can be personal computers in order to make a computer equipment, server, or the network equipment etc.) carry out the method described in some part of each embodiment of the application or embodiment.
Each embodiment in this instructions all adopts the mode of going forward one by one to describe, between each embodiment identical similar part mutually referring to, what each embodiment stressed is and the difference of other embodiment.Especially,, for system embodiment, because it is substantially similar in appearance to embodiment of the method, so describe fairly simplely, relevant part is referring to the part explanation of embodiment of the method.System embodiment described above is only schematic, the wherein said unit as separating component explanation can or can not be also physically to separate, the parts that show as unit can be or can not be also physical locations, can be positioned at a place, or also can be distributed in multiple network element.Can select according to the actual needs some or all of module wherein to realize the object of the present embodiment scheme.Those of ordinary skill in the art, in the situation that not paying creative work, are appreciated that and implement.
The application can be used in numerous general or special purpose computingasystem environment or configuration.For example: personal computer, server computer, handheld device or portable set, laptop device, multicomputer system, system based on microprocessor, set top box, programmable consumer-elcetronics devices, network PC, small-size computer, mainframe computer, the distributed computing environment that comprises above any system or equipment etc.
The application can describe in the general context of computer executable instructions, for example program module.Usually, program module comprises and carries out particular task or realize routine, program, object, assembly, data structure of particular abstract data type etc.Also can in distributed computing environment, put into practice the application, in these distributed computing environment, be executed the task by the teleprocessing equipment being connected by communication network.In distributed computing environment, program module can be arranged in the local and remote computer-readable storage medium including memory device.
The above is only the application's embodiment; it should be pointed out that for those skilled in the art, do not departing under the prerequisite of the application's principle; can also make some improvements and modifications, these improvements and modifications also should be considered as the application's protection domain.
Claims (18)
1. an evaluating method for application, is characterized in that, comprising:
Terminal is obtained the test file of specifying application;
Described terminal is carried out described test file described appointment application is tested, and obtains test data;
Described terminal reports the test data of described appointment application to service end, so that described service end obtains the evaluation result to described appointment application according to described test data.
2. method according to claim 1, is characterized in that, described terminal is obtained the test file of specifying application, comprising:
Described terminal sends test file update request to described service end, at least comprises the identification information of described terminal and the identification information of described appointment application in described test file update request;
Described terminal receives the up-to-date test file information of the described appointment application of described service end transmission;
Whether the current test file information that the more local described appointment of described terminal is applied is consistent with the up-to-date test file information that described service end sends;
If inconsistent, described terminal sends download request to described service end;
Described terminal receives the up-to-date test file of the described appointment application of described service end transmission.
3. method according to claim 1, is characterized in that, described terminal is obtained the test file of specifying application, comprising:
Described terminal sends test file request to described service end, at least comprises the identification information of described terminal and the current test file information of described appointment application in described test file update request;
When the current test file information of the described appointment application sending in the up-to-date test file information of the more local described appointment application of described service end and described terminal is inconsistent, described terminal receives the up-to-date test file that described appointment that described service end sends is applied.
4. according to the method described in any one in claims 1 to 3, it is characterized in that, described terminal is carried out described test file described appointment application is tested, and obtains test data, comprising:
Described terminal is caught the resource consumption data of described appointment application by monitoring the operation of described appointment application.
5. according to the method described in any one in claims 1 to 3, it is characterized in that, described terminal is carried out described test file described appointment application is tested, and obtains test data, comprising:
Described terminal records respectively stamp reference time under two association statuss that described appointment is applied in business, obtains the response time.
6. method according to claim 5, is characterized in that, described terminal records respectively stamp reference time under two association statuss that described appointment is applied in business, obtains the response time, comprising:
Described terminal records the first reference time stamp of described appointment when being applied in business and triggering;
Whether the displaying contents that described terminal comparison is caught from interface is consistent with expection content;
If consistent, described terminal record that described business responds second reference time stamp;
The response time of described terminal using the mistiming that stab described the second reference time and stab described the first reference time as described business.
7. an evaluating method for application, is characterized in that, comprising:
Service end sends the test file of specifying application to terminal;
Described service end receives the test data of described terminal to report, and described test data is carried out described test file by described terminal described appointment application is tested to rear acquisition;
Described service end obtains the evaluation result to described appointment application according to described test data.
8. method according to claim 7, is characterized in that, before described service end sends the test file of specifying application to terminal, also comprises:
Described service end receives the test file update request that described terminal sends, and at least comprises the identification information of described terminal and the identification information of described appointment application in described test file update request;
Described service end sends the up-to-date test file information of described appointment application to described terminal;
When the up-to-date test file information that sends in the current test file information of the described appointment application of described terminal this locality and described service end is inconsistent, described service end receives the download request of described terminal transmission;
Described service end sends the test file of specifying application to terminal, comprising:
Described service end sends the up-to-date test file of described appointment application to described terminal.
9. method according to claim 7, is characterized in that, before described service end sends the test file of specifying application to terminal, also comprises:
Described service end receives the test file update request that described terminal sends, and at least comprises the identification information of described terminal and the current test file information of described appointment application in described test file update request;
Whether the current test file information of the described appointment application that the up-to-date test file information of the more local described appointment application of described service end sends with described terminal is consistent;
Described service end sends the test file of specifying application to terminal, comprising:
When described up-to-date test file information and described current test file information are when inconsistent, described service end sends the up-to-date test file of specifying application to terminal.
10. a terminal, is characterized in that, comprising:
File acquisition unit, for obtaining the test file of specifying application;
Test cell, tests described appointment application for carrying out described test file, obtains test data;
Data report unit, for report the test data of described appointment application to service end, so that described service end obtains the evaluation result to described appointment application according to described test data.
11. terminals according to claim 10, is characterized in that, described file acquisition unit comprises:
The first update request unit, for sending test file update request to described service end, at least comprises the identification information of described terminal and the identification information of described appointment application in described test file update request;
Information receiving unit, the up-to-date test file information of applying for receiving the described appointment of described service end transmission;
Information comparing unit, whether consistent with the up-to-date test file information that described service end sends for the current test file information of more local described appointment application;
Download request unit, while being inconsistent, sends download request to described service end for the comparative result obtaining when information comparing unit;
The first file receiving element, the up-to-date test file of applying for receiving the described appointment of described service end transmission.
12. terminals according to claim 10, is characterized in that, described file acquisition unit comprises:
The second update request unit, for sending test file update request to described service end, at least comprises the identification information of described terminal and the current test file information of described appointment application in described test file update request;
The second file receiving element, when inconsistent for the current test file information of the described appointment application that sends in the up-to-date test file information of the more local described appointment application of described service end and described terminal, receive the up-to-date test file that described appointment that described service end sends is applied.
13. according to claim 10 to the terminal described in any one in 12, it is characterized in that,
Described test cell, specifically for catching the resource consumption data of described appointment application by the operation of monitoring described appointment application.
14. according to claim 10 to the terminal described in any one in 12, it is characterized in that,
Described test cell, is applied in stamp reference time under two association statuss of business specifically for recording respectively described appointment, obtain the response time.
15. terminals according to claim 14, is characterized in that, described test cell comprises:
The first record cell, for recording described appointment first reference time stamp when being applied in business and triggering;
Content comparing unit, whether consistent with expection content for the displaying contents of relatively catching from interface;
The second record cell, when being consistent when the comparative result of described content comparing unit, record that described business responds second reference time stamp;
Time calculating unit, for the response time using the mistiming that stab described the second reference time and stab described the first reference time as described business.
16. 1 kinds of servers, is characterized in that, comprising:
File transmitting element, for sending the test file of specifying application to terminal;
Data receiver unit, for receiving the test data of described terminal to report, described test data is carried out described test file by described terminal described appointment application is tested to rear acquisition;
Evaluation and test unit, for obtaining the evaluation result to described appointment application according to described test data.
17. servers according to claim 16, is characterized in that, also comprise:
The first request reception unit, before sending the test file of specifying application at described file transmitting element to terminal, receive the test file update request that described terminal sends, in described test file update request, at least comprise the identification information of described terminal and the identification information of described appointment application;
Information transmitting unit, for sending the up-to-date test file information of described appointment application to described terminal;
The second request reception unit, when inconsistent for the up-to-date test file information that sends in the current test file information of the described appointment application of described terminal this locality and described service end, receives the download request of described terminal transmission;
Described file transmitting element, specifically for sending the up-to-date test file of described appointment application to described terminal.
18. servers according to claim 16, is characterized in that, also comprise:
The 3rd request reception unit, before sending the test file of specifying application at described file transmitting element to terminal, receive the test file update request that described terminal sends, in described test file update request, at least comprise the identification information of described terminal and the current test file information of described appointment application;
Information comparing unit, whether the current test file information of the described appointment application sending with described terminal for the up-to-date test file information of more local described appointment application is consistent;
Described file transmitting element, specifically for when described up-to-date test file information and described current test file information are when inconsistent, sends the up-to-date test file of specifying application to terminal.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410279618.6A CN104035869A (en) | 2014-06-19 | 2014-06-19 | Application evaluation method, terminal, and server |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410279618.6A CN104035869A (en) | 2014-06-19 | 2014-06-19 | Application evaluation method, terminal, and server |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN104035869A true CN104035869A (en) | 2014-09-10 |
Family
ID=51466642
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201410279618.6A Pending CN104035869A (en) | 2014-06-19 | 2014-06-19 | Application evaluation method, terminal, and server |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN104035869A (en) |
Cited By (23)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104461898A (en) * | 2014-12-19 | 2015-03-25 | 北京奇虎科技有限公司 | Application testing method, center control server, test terminal and system |
| CN104811695A (en) * | 2015-04-17 | 2015-07-29 | 北京奇艺世纪科技有限公司 | Testing method and device for set top box device |
| CN105740138A (en) * | 2014-12-08 | 2016-07-06 | 阿里巴巴集团控股有限公司 | Test method, test device and test system of application |
| CN106909499A (en) * | 2015-12-22 | 2017-06-30 | 阿里巴巴集团控股有限公司 | Method of testing and device |
| CN107040574A (en) * | 2016-11-17 | 2017-08-11 | 阿里巴巴集团控股有限公司 | A kind of sectional drawing, data processing method and equipment |
| CN107305511A (en) * | 2016-04-18 | 2017-10-31 | 展讯通信（上海）有限公司 | The mobile terminal test method and system of shared terminal test instrumentation |
| CN107342897A (en) * | 2017-07-06 | 2017-11-10 | 广州优视网络科技有限公司 | application testing method, device, user terminal and system |
| CN107566148A (en) * | 2016-07-01 | 2018-01-09 | 北京京东尚科信息技术有限公司 | Analysis method, system, device and the terminal of terminal applies operation data |
| CN107656870A (en) * | 2017-09-27 | 2018-02-02 | 四川久远银海软件股份有限公司 | Using adjustment method and device |
| CN108076034A (en) * | 2016-11-11 | 2018-05-25 | 北京嘀嘀无限科技发展有限公司 | The method, apparatus and system of encryption and decryption data |
| CN108228441A (en) * | 2016-12-14 | 2018-06-29 | 北京金山云网络技术有限公司 | A kind of generation method, device and the report of accessment and test of application program report of accessment and test |
| CN108243025A (en) * | 2016-12-23 | 2018-07-03 | 大唐移动通信设备有限公司 | A kind of network test server-side, network test terminal and test method |
| CN108399123A (en) * | 2018-01-12 | 2018-08-14 | 五八同城信息技术有限公司 | Method for testing software, device, terminal and storage medium |
| CN109032916A (en) * | 2017-06-08 | 2018-12-18 | 阿里巴巴集团控股有限公司 | The method, apparatus and system that functional module in application program is evaluated and tested |
| CN109359032A (en) * | 2018-09-05 | 2019-02-19 | Oppo（重庆）智能科技有限公司 | Test data collection method, device, system and electronic equipment |
| CN109857649A (en) * | 2019-01-14 | 2019-06-07 | 珠海金山网络游戏科技有限公司 | A kind of resource testing method and system |
| CN109976997A (en) * | 2017-12-28 | 2019-07-05 | 北京京东尚科信息技术有限公司 | Test method and device |
| CN109981406A (en) * | 2019-03-22 | 2019-07-05 | 北京达佳互联信息技术有限公司 | Test method, device, system and computer readable storage medium |
| CN110297749A (en) * | 2018-03-22 | 2019-10-01 | 福建天泉教育科技有限公司 | A kind of method and terminal for testing new function |
| CN110908905A (en) * | 2019-11-15 | 2020-03-24 | 北京博睿宏远数据科技股份有限公司 | Method, device, equipment and medium for measuring transaction speed of security dealer APP |
| CN113778843A (en) * | 2020-08-28 | 2021-12-10 | 北京同邦卓益科技有限公司 | Application program testing method and device, electronic equipment and readable storage medium |
| CN114040189A (en) * | 2021-09-30 | 2022-02-11 | 北京欧珀通信有限公司 | Multimedia test method, device, storage medium and electronic equipment |
| CN115617695A (en) * | 2022-12-05 | 2023-01-17 | 天津卓朗昆仑云软件技术有限公司 | Automatic testing method and system |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101521899A (en) * | 2009-03-31 | 2009-09-02 | 大连海事大学 | System and method for on-computer test of mobile applications |
| CN102479152A (en) * | 2010-11-26 | 2012-05-30 | 腾讯科技（深圳）有限公司 | Method and device for obtaining tool automatic test results on basis of Android platform |
| CN102662836A (en) * | 2012-03-28 | 2012-09-12 | 易云捷讯科技（北京）有限公司 | Evaluation system and method for virtual machine |
| CN103377406A (en) * | 2012-04-25 | 2013-10-30 | 富泰华工业（深圳）有限公司 | System and method for managing test files |
| CN103428036A (en) * | 2012-05-14 | 2013-12-04 | 腾讯科技（深圳）有限公司 | Method and device for testing response time |
| CN103455403A (en) * | 2013-08-26 | 2013-12-18 | 百度在线网络技术（北京）有限公司 | Testing method and device |
| CN103729266A (en) * | 2013-12-30 | 2014-04-16 | 安徽科大讯飞信息科技股份有限公司 | Method and system for dial testing of terminal and cloud terminal |
-
2014
- 2014-06-19 CN CN201410279618.6A patent/CN104035869A/en active Pending
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101521899A (en) * | 2009-03-31 | 2009-09-02 | 大连海事大学 | System and method for on-computer test of mobile applications |
| CN102479152A (en) * | 2010-11-26 | 2012-05-30 | 腾讯科技（深圳）有限公司 | Method and device for obtaining tool automatic test results on basis of Android platform |
| CN102662836A (en) * | 2012-03-28 | 2012-09-12 | 易云捷讯科技（北京）有限公司 | Evaluation system and method for virtual machine |
| CN103377406A (en) * | 2012-04-25 | 2013-10-30 | 富泰华工业（深圳）有限公司 | System and method for managing test files |
| CN103428036A (en) * | 2012-05-14 | 2013-12-04 | 腾讯科技（深圳）有限公司 | Method and device for testing response time |
| CN103455403A (en) * | 2013-08-26 | 2013-12-18 | 百度在线网络技术（北京）有限公司 | Testing method and device |
| CN103729266A (en) * | 2013-12-30 | 2014-04-16 | 安徽科大讯飞信息科技股份有限公司 | Method and system for dial testing of terminal and cloud terminal |
Cited By (28)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105740138A (en) * | 2014-12-08 | 2016-07-06 | 阿里巴巴集团控股有限公司 | Test method, test device and test system of application |
| CN105740138B (en) * | 2014-12-08 | 2018-12-21 | 阿里巴巴集团控股有限公司 | Test method, test device and the test macro of application |
| CN104461898A (en) * | 2014-12-19 | 2015-03-25 | 北京奇虎科技有限公司 | Application testing method, center control server, test terminal and system |
| CN104811695A (en) * | 2015-04-17 | 2015-07-29 | 北京奇艺世纪科技有限公司 | Testing method and device for set top box device |
| CN104811695B (en) * | 2015-04-17 | 2017-10-10 | 北京奇艺世纪科技有限公司 | The method of testing and device of a kind of set-top box device |
| CN106909499A (en) * | 2015-12-22 | 2017-06-30 | 阿里巴巴集团控股有限公司 | Method of testing and device |
| CN107305511A (en) * | 2016-04-18 | 2017-10-31 | 展讯通信（上海）有限公司 | The mobile terminal test method and system of shared terminal test instrumentation |
| CN107566148A (en) * | 2016-07-01 | 2018-01-09 | 北京京东尚科信息技术有限公司 | Analysis method, system, device and the terminal of terminal applies operation data |
| CN107566148B (en) * | 2016-07-01 | 2021-08-03 | 北京京东尚科信息技术有限公司 | Method, system and device for analyzing terminal application operation data and terminal |
| CN108076034A (en) * | 2016-11-11 | 2018-05-25 | 北京嘀嘀无限科技发展有限公司 | The method, apparatus and system of encryption and decryption data |
| CN107040574A (en) * | 2016-11-17 | 2017-08-11 | 阿里巴巴集团控股有限公司 | A kind of sectional drawing, data processing method and equipment |
| CN108228441A (en) * | 2016-12-14 | 2018-06-29 | 北京金山云网络技术有限公司 | A kind of generation method, device and the report of accessment and test of application program report of accessment and test |
| CN108243025A (en) * | 2016-12-23 | 2018-07-03 | 大唐移动通信设备有限公司 | A kind of network test server-side, network test terminal and test method |
| CN109032916A (en) * | 2017-06-08 | 2018-12-18 | 阿里巴巴集团控股有限公司 | The method, apparatus and system that functional module in application program is evaluated and tested |
| CN107342897A (en) * | 2017-07-06 | 2017-11-10 | 广州优视网络科技有限公司 | application testing method, device, user terminal and system |
| CN107656870A (en) * | 2017-09-27 | 2018-02-02 | 四川久远银海软件股份有限公司 | Using adjustment method and device |
| CN109976997A (en) * | 2017-12-28 | 2019-07-05 | 北京京东尚科信息技术有限公司 | Test method and device |
| CN108399123A (en) * | 2018-01-12 | 2018-08-14 | 五八同城信息技术有限公司 | Method for testing software, device, terminal and storage medium |
| CN110297749B (en) * | 2018-03-22 | 2022-12-13 | 福建天泉教育科技有限公司 | Method and terminal for testing new function |
| CN110297749A (en) * | 2018-03-22 | 2019-10-01 | 福建天泉教育科技有限公司 | A kind of method and terminal for testing new function |
| CN109359032A (en) * | 2018-09-05 | 2019-02-19 | Oppo（重庆）智能科技有限公司 | Test data collection method, device, system and electronic equipment |
| CN109857649A (en) * | 2019-01-14 | 2019-06-07 | 珠海金山网络游戏科技有限公司 | A kind of resource testing method and system |
| CN109981406A (en) * | 2019-03-22 | 2019-07-05 | 北京达佳互联信息技术有限公司 | Test method, device, system and computer readable storage medium |
| CN110908905A (en) * | 2019-11-15 | 2020-03-24 | 北京博睿宏远数据科技股份有限公司 | Method, device, equipment and medium for measuring transaction speed of security dealer APP |
| CN113778843A (en) * | 2020-08-28 | 2021-12-10 | 北京同邦卓益科技有限公司 | Application program testing method and device, electronic equipment and readable storage medium |
| CN113778843B (en) * | 2020-08-28 | 2024-04-16 | 北京同邦卓益科技有限公司 | Application program testing method and device, electronic equipment and readable storage medium |
| CN114040189A (en) * | 2021-09-30 | 2022-02-11 | 北京欧珀通信有限公司 | Multimedia test method, device, storage medium and electronic equipment |
| CN115617695A (en) * | 2022-12-05 | 2023-01-17 | 天津卓朗昆仑云软件技术有限公司 | Automatic testing method and system |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN104035869A (en) | Application evaluation method, terminal, and server | |
| US9697104B2 (en) | End-to end tracing and logging | |
| Chen et al. | CauseInfer: Automated end-to-end performance diagnosis with hierarchical causality graph in cloud environment | |
| Sun et al. | Non-intrusive anomaly detection with streaming performance metrics and logs for DevOps in public clouds: a case study in AWS | |
| US10339039B2 (en) | Virtual service interface | |
| US10360140B2 (en) | Production sampling for determining code coverage | |
| US20150220423A1 (en) | Transactional boundaries for virtual model generation | |
| CN109408351A (en) | A kind of method and apparatus of AI environment measuring and deep learning environment automatic deployment | |
| EP4113308A1 (en) | Enhanced application performance framework | |
| CN107168844B (en) | Performance monitoring method and device | |
| CN112650688A (en) | Automated regression testing method, associated device and computer program product | |
| Sebastio et al. | Characterizing machines lifecycle in google data centers | |
| US20170024305A1 (en) | Client application profiling | |
| CN113360376A (en) | Buried point testing method and device | |
| CN115705190A (en) | Method and device for determining dependence degree | |
| US20080072321A1 (en) | System and method for automating network intrusion training | |
| CN114546814A (en) | Recording playback method, recording playback device and storage medium | |
| Liu et al. | Response time evaluation of mobile applications combining network protocol analysis and information fusion | |
| KR101039874B1 (en) | System for integration platform of information communication | |
| Guo et al. | MobileSens: A framework of behavior logger on Andriod mobile device | |
| US10498616B1 (en) | System and method for implementing a client performance capture tool | |
| Oppermann et al. | Anomaly Detection Approaches for Secure Cloud Reference Architectures in Legal Metrology. | |
| Bovenzi et al. | Towards identifying OS-level anomalies to detect application software failures | |
| Nguyen et al. | Benchmarking in virtual desktops for end-to-end performance traceability | |
| Klitgaard et al. | Resilience-focused monitoring framework for edge systems |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20140910 |
|
| RJ01 | Rejection of invention patent application after publication |