WO2019019356A1 - 应用程序测试方法、装置、计算机设备和存储介质 - Google Patents
应用程序测试方法、装置、计算机设备和存储介质 Download PDFInfo
- Publication number
- WO2019019356A1 WO2019019356A1 PCT/CN2017/104176 CN2017104176W WO2019019356A1 WO 2019019356 A1 WO2019019356 A1 WO 2019019356A1 CN 2017104176 W CN2017104176 W CN 2017104176W WO 2019019356 A1 WO2019019356 A1 WO 2019019356A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- evaluation
- application
- evaluation item
- test result
- test
- Prior art date
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/36—Preventing errors by testing or debugging software
- G06F11/3668—Software testing
- G06F11/3672—Test management
- G06F11/3688—Test management for test execution, e.g. scheduling of test suites
Definitions
- the present application relates to the field of testing, and more particularly to application testing methods, apparatus, computer equipment, and storage media.
- testing an application is usually done by the tester manually running the application on the device and then clicking the corresponding function button for testing. Or the tester can write a test script according to the requirements, click to start the test, and wait for the test to complete, then click to view the test results.
- the inventors of the present application found that the prior art has the following problems: the existing test method relies on the manual operation of the tester, the test time is long, and the manual record and the summary test are required. As a result, the test is inefficient.
- an application testing method, apparatus, computer device, and storage medium are provided.
- An application testing method that includes:
- the application test result is output according to the evaluation type test result.
- An application testing device comprising:
- a test request receiving unit configured to receive an application test request
- a testing unit configured to test the application according to a preset evaluation item, and obtain an evaluation item test result corresponding to the evaluation item
- An evaluation type test result generating unit configured to generate an evaluation type test type test result according to the evaluation item test result and the evaluation type corresponding to the evaluation item;
- the test result output unit is configured to output an application test result according to the evaluation type test result.
- a computer apparatus comprising a memory and a processor, the memory storing computer readable instructions, the computer readable instructions being executed by the processor such that the processor performs the following steps:
- the application is tested according to a preset evaluation item, and the evaluation item test result corresponding to the evaluation item is obtained;
- the application test result is output according to the evaluation type test result.
- One or more non-transitory readable storage mediums storing computer readable instructions, when executed by one or more processors, cause the one or more processors to perform the following steps:
- the application is tested according to a preset evaluation item, and the evaluation item test result corresponding to the evaluation item is obtained;
- the application test result is output according to the evaluation type test result.
- FIG. 1 is a block diagram showing the internal structure of a computer device in an embodiment
- FIG. 2 is a flow chart of an application testing method in an embodiment
- FIG. 3 is a flowchart of testing an application according to a preset evaluation item in an embodiment, and obtaining a test result of the evaluation item corresponding to the evaluation item;
- FIG. 4 is a flow chart of outputting an application test result according to the evaluation type test result in an embodiment
- FIG. 5 is a flowchart of testing an application according to a preset evaluation item in an embodiment, and obtaining a test result of the evaluation item corresponding to the evaluation item;
- FIG. 6 is a structural block diagram of an application testing device in an embodiment
- Figure 7 is a block diagram showing the structure of a test unit in an embodiment
- FIG. 8 is a structural block diagram of a test result output unit in an embodiment
- Figure 9 is a block diagram showing the structure of a test unit in one embodiment.
- FIG. 1 is a schematic diagram showing the internal structure of a computer device in an embodiment.
- the computer device includes a processor, a non-volatile storage medium, a memory, and a network interface connected by a system bus.
- the non-volatile storage medium of the computer device stores an operating system, a database, and computer readable instructions that, when executed by the processor, cause the processor to implement an application testing method.
- the processor of the computer device is used to provide computing and control capabilities to support the operation of the entire computer device.
- Computer readable instructions may be stored in the memory of the computer device, the computer readable instructions being executable by the processor to cause the processor to perform an application testing method.
- the network interface of the computer device is used for communication.
- FIG. 1 is only a block diagram of a part of the structure related to the solution of the present application, and does not constitute a limitation of the computer device to which the solution of the present application is applied.
- the specific computer device may It includes more or fewer components than those shown in the figures, or some components are combined, or have different component arrangements.
- the computer device may be a smartphone, a tablet, a laptop, a desktop computer, a server, etc., but is not limited thereto.
- an application testing method is provided.
- the application testing method may be applied to the foregoing computer device, and specifically includes the following steps:
- Step 202 Receive an application test request.
- An application is installed on the computer device, and when it is required to test the application, an application test request sent through the computer device or other terminal is received.
- the computer device can first install the application and then test.
- the application test request carries an installation package of the application.
- the application is installed on the computer device to install the application, and then the test is performed.
- Step 204 Test the application according to the preset evaluation item, and obtain the test result corresponding to the evaluation item of the evaluation item;
- the evaluation item is required to be tested in the application, and the test result is obtained.
- Test items such as the average CPU usage of the application, memory leaks, average memory consumption, and more.
- the evaluation item that needs to be tested is preset in the computer device. When the computer device receives the application test request, the preset evaluation item is executed to execute the test script corresponding to the evaluation item, and the application is tested to obtain the evaluation item corresponding to the evaluation item. Test Results.
- the evaluation item test result can be a test output parameter directly obtained when testing the evaluation item, for example, the average CPU usage is 20%, the memory leak is yes, and the average memory consumption is 150M.
- the evaluation item test result may also be a result obtained by evaluating the test output parameter according to a preset rule, such as a score corresponding to the test output parameter of the evaluation item, and a test output parameter corresponding to the evaluation item. Grade and so on.
- the test order of the evaluation items may also be set, so that the computer device executes the test script in the order to perform the test, and avoids conflicts when the test scripts between the evaluation items are tested.
- Step 206 Generate an evaluation type test result according to the evaluation item test result and the evaluation type corresponding to the evaluated item;
- the evaluation item corresponding to each evaluation type is preset. Therefore, after the evaluation result of the evaluation item is obtained, the test result of the evaluation item belonging to the same evaluation type may be performed according to the evaluation type corresponding to the evaluation item. Summary, generate evaluation type test results.
- the number of evaluation types and their corresponding evaluation items can be set according to requirements.
- the evaluation type test result can be a collection of the test item test results, for example, a summary of the test item test results belonging to one evaluation type in the form of a table.
- the evaluation type test result can also be a total calculation result obtained by summarizing the evaluation item results. For example, when the evaluation result of the evaluation item is a score, the evaluation item results are summed to obtain the evaluation type score.
- the evaluation type of the application includes one or any combination of performance testing, security testing, stability testing, and compatibility testing.
- the evaluation items corresponding to the four evaluation types may be preset, and after obtaining the evaluation item results, the test results of the four evaluation types of the performance test, the security test, the stability test, and the compatibility test are separately obtained.
- Performance testing refers to testing the application's temporal and spatial characteristics. For example, it may include testing response time for various operations in the application, and system resources in the user application scenario. The use of the test, etc. for testing.
- Corresponding evaluation items can include average CPU usage, average memory consumption, per minute traffic consumption, memory leaks, memory jitter, boot time, and package size.
- Security testing includes testing for security issues such as software permissions, data security, and communications security.
- Corresponding evaluation items may include billing risk, limit of number of passwords entered, privacy risk level, and the like.
- Stability testing refers to testing the interactivity of an application or the response under abnormal conditions. Interactivity testing involves testing the application's operation in the event of an application such as an incoming call, text message, or low battery.
- the anomaly test refers to running the application in the event of a network failure, power outage, or server exception.
- Situation process test For example, whether multiple programs run simultaneously affects normal functions, whether the normal function is affected when the application is switched when the network is running, and whether the plug-in charger affects normal functions when the application is running.
- Compatibility testing can include internal compatibility testing and external compatibility testing. For example, test whether the application is compatible with other mainstream applications, verify whether the data is properly used under various network connections, whether it is compatible with various devices, or whether the behaviors are consistent under each system.
- Step 208 Output an application test result according to the evaluation type test result.
- the application test result may be generated according to the evaluation type test result, and stored or displayed for the user to view.
- the application test result may be a collection of evaluation type test results, or may be a total result obtained by a summary calculation based on the evaluation type test result. Of course, it can also be a combination of the above two results.
- the score of each evaluation type test result can be displayed. It is also possible to sum the scores for each evaluation type and obtain the total score to output the total score. Of course, it is also possible to output both the evaluation type score and the total score.
- FIG. 3 shows, in one embodiment, when the evaluation item test result includes the evaluation item score, step S204 tests the application according to the preset evaluation item, and obtains the step of the evaluation item corresponding to the evaluation item.
- the flow chart may specifically include the following steps:
- the evaluation items are preset, and each evaluation item corresponds to a test script to be executed. For example, you can set the evaluation items to be tested as per minute traffic consumption, memory leaks, memory jitter, and data encryption level. Therefore, you can get test scripts for each minute of traffic consumption, memory leaks, memory jitter, and data encryption levels.
- the program is tested, and the output test output parameter can be 512 kb per minute, memory leak, no memory jitter, etc., and the data encryption level is level 2.
- test output parameters may be represented by specific characters, but in the computer readable instructions, other identifiers may also be used for identification by using presets.
- the traffic consumption per minute is 512 kb
- there is a memory leak there is a memory leak
- no memory jitter
- the data encryption level is 2, which can be identified as 512, 0, 1, and 2 in sequence, as long as the corresponding test result can be obtained according to the identifier.
- test output parameter is scored according to the scoring rule corresponding to the evaluation item, and the evaluation item score corresponding to the evaluation item is obtained.
- the scoring rules corresponding to each evaluation item are set in advance, and then the test output parameters are scored according to the scoring rules, thereby obtaining each evaluation item score.
- the set scoring rule may be that the scoring weight corresponding to the evaluation item is positively correlated with the level of the evaluation item in the evaluation type, and the score corresponding to the evaluation item is positively correlated with the index of the test output parameter or the level of the indicator interval. That is, if the evaluation item has a high level in the evaluation type, the score weight is also high, and the level of the indicator interval is high, and the corresponding score is also high.
- the level of the evaluation item can be determined according to actual needs.
- traffic consumption per minute, memory jitter, memory leaks, and installation package size are performance test items, and traffic consumption per minute, memory jitter, memory leaks, and package size are at the level of performance testing. If they are reduced, their corresponding weights are 0.125, 0.1, 0.09, and 0.06, and the evaluation items account for 12.5, 10, 9, and 6 in the performance evaluation.
- the value of the flow consumption per minute is small, the level is high, the score is high; the level of no memory leak is higher than the level of memory leak, the score is high; the level of no memory jitter is higher than the level of memory jitter. High, the score is high, the installation package size is small, the level is high, and the score is high.
- the output test parameters are 512 kb per minute, with memory leaks, no memory jitter, and an installation package size of 40 M.
- the scores of the evaluation items are 8 points, 0 points, 9 points, and 4 points, respectively.
- the evaluation type test result when the evaluation item test result includes the evaluation item score, the evaluation type test result In the case of the evaluation type of the score, the step S206 is to generate the evaluation type of the evaluation type according to the evaluation result of the evaluation item and the evaluation type corresponding to the evaluation item, and the step of including the evaluation item belonging to the same evaluation type according to the evaluation type of the evaluation item. The summation calculation is performed to obtain the evaluation type score.
- the scores of the evaluation items belonging to the performance test evaluation type can be obtained, and the weighted sum is obtained to obtain the performance test score.
- the scores of the evaluation items belonging to the security test evaluation type perform weighted summation, and obtain the security test score.
- the scores of the evaluation items belonging to the stability test evaluation type perform weighted summation, and obtain stability test scores.
- scores of the evaluation items belonging to the compatibility test evaluation type perform weighted summation, and obtain compatibility test scores.
- FIG. 4 is a flowchart of an implementation of outputting an application test result according to the evaluation type test result in step S208, where the evaluation type test result includes an evaluation type score, and specifically includes the following steps:
- S402. Perform weighted summation according to the evaluation type score and the weight corresponding to the evaluation type, and obtain a comprehensive score of the application;
- the weight corresponding to the evaluation type can be preset according to the actual. For example, the corresponding weight can be set according to the importance of the evaluation type.
- the scores of each evaluation type are weighted and summed with their corresponding weights to obtain a total comprehensive score.
- the evaluation types include performance testing, security testing, stability testing, and compatibility testing.
- the scores are 80, 60, 100, and 90, respectively, and performance testing, security testing, stability testing, and compatibility.
- the application test result includes a comprehensive score, or the application test result includes a comprehensive score and a review type score.
- the evaluation type includes performance test, security test, stability test, and compatibility test
- the scores are 80 points, 60 points, 100 points, 90 points
- the comprehensive score is 77, which can be on the client.
- the overall score for the show is 77 points. It is also possible to display information with a performance score of 80, a security test of 60, a stability test of 100, and a compatibility of 90, while displaying a comprehensive score of 77.
- the application test results can be presented graphically to give the user an intuitive understanding of the test results.
- the application test result may further include an application test comparison result. Therefore, in the application test method, the following steps may also be included: comparing the application test result with other program test results to obtain the application Test the comparison results.
- test results of other applications may be stored in the test result library.
- the computer device compares the application test results with other program test results in the test result library to obtain the application comparison result.
- the application test comparison results can be a ranking of the application test results. For example, fifth place, top 30%, etc. It can be understood that the above test result library can be stored in a computer device or can be stored on other devices.
- application test results can be compared to program test results of the same program type, the same program type referring to the same industry or domain, or the primary function being the same. For example, Tencent Music and Netease Music are the same program type.
- the application quality can be analyzed based on the application test comparison results, and the analysis results and/or quality improvement recommendations can be output. For example, if you find that the rating of a certain evaluation type of the application is low, you can find the evaluation item with low score in the evaluation type, and then display the test result of the evaluation item and suggestions on how to improve it on the client.
- FIG. 5 shows an implementation flowchart of the evaluation item corresponding to the evaluation item when the evaluation item includes the startup time of the application, and the step S204 tests the application according to the preset evaluation item. , can include the following steps:
- S502 Send an application startup instruction, so that the application starts to be started
- an application startup instruction is sent to start the application.
- the screenshot of the application when the application starts, the screenshot of the application may be performed multiple times by using a screenshot tool such as a Minicap screenshot tool.
- the time of each screenshot can be set according to actual needs. It can be understood that in order to obtain the startup time more accurately, the interval of each screenshot is as small as possible within a certain range.
- adjacent screenshot pages are respectively compared, and the similarity between adjacent screenshot pages is obtained. Compare the first screenshot page with the second screenshot page, compare the second screenshot page with the third screenshot page, and compare the third screenshot page with the fourth screenshot page. and many more.
- the preset threshold can be set according to the actual situation. Similarity indicates the degree of similarity of the screenshot page. The greater the similarity, the more the image is like. The smaller the similarity, the less the picture is.
- the test of the application startup time is performed by judging whether the main program process of the application appears in the CPU.
- the inventor of the present application found that when the main program process appears in the CPU, the application often stays on the startup page, so the startup time obtained by the existing startup time acquisition method is shorter than the actual startup time. Therefore, you can continue to take screenshots from the time the application starts, while Compare the similarity between the two screenshots before and after. If the similarity between the two images is less than the preset threshold, it means that the two pictures are different.
- the previous screenshot page is the startup page, and the latter one is the task page, that is, the startup page has been displayed, and the application enters the task page. Therefore, the application startup is completed. Therefore, the time difference between the time of the next screenshot page and the application startup time can be used as the startup time of the application.
- the application starts at 12:58:58, the first and the similarity to the second screenshot page, the second and the third screenshot page, the third and the third
- the similarity of the four screenshot pages, the similarity between the fourth and the fifth screenshot page, and the comparison between the fifth screenshot page and the sixth screenshot page are 0.9, 0.85, 0.91, 0.81, and 0.3.
- the preset threshold is 0.6.
- the fifth screenshot page is compared with the sixth screenshot page, the similarity is less than the preset threshold.
- the screenshot time of the sixth screenshot page is considered to be the application startup completion time. If the screenshot time of the screenshot page of Chapter 6 is 12:59:35, the application start time is the time difference of 12:59:35 and 12:58:58, which is 37 seconds.
- an application testing device is provided.
- the application testing device may be integrated into the foregoing computer device, and may specifically include a test request receiving unit 602, a testing unit 604, and an evaluation type.
- a test request receiving unit 602 configured to receive an application test request
- the testing unit 604 is configured to test the application according to the preset evaluation item, and obtain the evaluation item test result corresponding to the evaluation item;
- the evaluation type test result generating unit 606 is configured to generate an evaluation type test type test result according to the evaluation item test result and the evaluation type corresponding to the evaluated item;
- the test result output unit 608 is configured to output an application test result according to the evaluation type test result.
- FIG. 7 illustrates a structural block diagram of the test unit 604, which may include a parameter acquisition module 702 and an evaluation item score acquisition module 704, in an embodiment, when the evaluation item test result includes the evaluation item score.
- the parameter obtaining module 702 is configured to test the application according to the preset evaluation item, and obtain an evaluation. Test output parameter of the item;
- the evaluation item score obtaining module 704 is configured to score the test output parameter according to the scoring rule corresponding to the evaluation item, and obtain the evaluation item score corresponding to the evaluation item;
- the evaluation type test result generation unit 606 is specifically configured to: evaluate the evaluation type belonging to the same evaluation type according to the evaluation type of the evaluation item. The item score is summed and the evaluation type score is obtained.
- FIG. 8 is a block diagram showing the structure of the test result output unit 608 when the evaluation type test result includes the evaluation type score, and may include a comprehensive score acquisition module 802 and a test result output module 804.
- the comprehensive score obtaining module 802 is configured to perform weighted summation according to the evaluation type score and the weight corresponding to the evaluation type, and obtain a comprehensive score of the application;
- the test result output module 804 is configured to output an application test result.
- Application test results include a comprehensive score, or application test results include a comprehensive score and a review type score.
- FIG. 9 shows a structural block diagram of the testing unit 604 when the evaluation item includes the startup time of the application in an embodiment, which may include an instruction sending unit 902, a screenshot unit 904, a similarity acquiring unit 906, and a startup duration acquiring unit 908. :
- An instruction sending unit 902 configured to send an application startup instruction, so that the application starts to be started
- the screenshot unit 904 is configured to perform multiple screenshots on the page of the application
- the similarity obtaining unit 906 is configured to acquire the similarity between the previous screenshot page and the subsequent screenshot page;
- the startup time acquisition unit 908 is configured to use the time difference between the time of the next screenshot page and the start time of the application as the startup time of the application if the similarity is less than the preset threshold.
- the application test results may also include application test comparison results
- the application testing device may further include a comparison result generating unit for comparing the application test result with other program test results to obtain an application test comparison result.
- the various modules in the application testing device described above may be implemented in whole or in part by software, hardware, and combinations thereof.
- the network interface may be an Ethernet card or a wireless network card.
- the above modules may be embedded in the hardware in the processor or in the memory in the server, or may be stored in the memory in the server, so that the processor calls the corresponding operations of the above modules.
- the processor can be a central processing unit (CPU), a microprocessor, a microcontroller, or the like.
- a computer device is proposed.
- the internal structure of the computer device may correspond to the structure as shown in FIG. 1, that is, the computer device may be a server or a terminal, and the computer device includes a memory and a processor.
- the evaluation item test result includes the evaluation item score
- the evaluation type test result includes the evaluation type score
- the processor performs the test according to the preset evaluation item, and obtains the evaluation item corresponding to the evaluation item.
- the result comprises: testing the application according to the preset evaluation item, obtaining the test output parameter of the evaluation item; and scoring the test output parameter according to the scoring rule corresponding to the evaluation item, and obtaining the evaluation item corresponding to the evaluation item, wherein
- the scoring rule is that the scoring weight corresponding to the evaluation item is positively correlated with the level of the evaluation item in the evaluation type, and the score corresponding to the evaluation item is positively correlated with the level of the indicator or the indicator interval to which the test output parameter belongs; the test performed by the processor according to the evaluation item
- the result and the evaluation type corresponding to the evaluation item generate the evaluation type of the evaluation type test result.
- the evaluation type includes one of performance testing, security testing, stability testing, and compatibility testing, or any combination thereof.
- the processor performs an application test based on the evaluation type test result output.
- the test result includes: performing weighted summation according to the evaluation type score and the weight corresponding to the evaluation type to obtain a comprehensive score of the application; outputting the application test result; wherein, the application test result includes the comprehensive score, or, the application test
- the results include a comprehensive score and a review type score.
- the application test result further includes an application test comparison result
- the processor performs the following steps when executing the computer readable instruction: comparing the application test result with other program test results to obtain an application test comparison result .
- the evaluation item includes an application startup time
- the step performed by the processor to output the application test result according to the evaluation type test result includes: sending an application startup instruction to enable the application to start startup;
- the page of the program performs multiple screenshots; obtains the similarity between the previous screenshot page and the subsequent screenshot page; if the similarity is less than the preset threshold, the time difference between the time of the next screenshot page and the time when the application starts to be started is applied as an application.
- the startup time of the program includes: sending an application startup instruction to enable the application to start startup;
- the page of the program performs multiple screenshots; obtains the similarity between the previous screenshot page and the subsequent screenshot page; if the similarity is less than the preset threshold, the time difference between the time of the next screenshot page and the time when the application starts to be started is applied as an application.
- the startup time of the program includes: sending an application startup instruction to enable the application to start startup;
- the page of the program performs multiple screenshots; obtains the similarity between the previous screenshot page and the subsequent
- a storage medium storing computer readable instructions, when executed by one or more processors, causes one or more processors to perform the following steps: receiving an application test Request; test the application according to the preset evaluation item, and obtain the evaluation result of the evaluation item corresponding to the evaluation item; generate the evaluation type test result according to the evaluation item test result and the evaluation type corresponding to the evaluation item; test according to the evaluation type The result is output application test results.
- the evaluation item test result includes the evaluation item score
- the evaluation type test result includes the evaluation type score
- the processor performs the test according to the preset evaluation item when the processor executes the computer readable instruction, and obtains the evaluation.
- the step of the test item corresponding to the item includes: testing the application according to the preset evaluation item, obtaining the test output parameter of the evaluation item; and scoring the test output parameter according to the scoring rule corresponding to the evaluation item, and obtaining the corresponding item of the evaluation item.
- the evaluation item score wherein the scoring rule is that the score weight corresponding to the evaluation item is positively correlated with the level of the evaluation item in the evaluation type, and the score corresponding to the evaluation item is positively correlated with the level of the indicator or the indicator interval to which the test output parameter belongs;
- the processor executes The step of generating the evaluation type of the evaluation type according to the evaluation result of the evaluation item and the evaluation type corresponding to the evaluated item performed by the computer readable instruction comprises: searching for the evaluation item score belonging to the same evaluation type according to the evaluation type of the evaluation item And calculations, get evaluation type reviews .
- the evaluation type includes one of performance testing, security testing, stability testing, and compatibility testing, or any combination thereof.
- the step of outputting the application test result according to the evaluation type test result performed by the processor when executing the computer readable instruction comprises: weighting and summing according to the evaluation type score and the weight corresponding to the evaluation type, and obtaining the application Comprehensive score; output application test results; where the application test results include a comprehensive score, or the application test results include a comprehensive score and a review type score.
- the application test result further includes an application test comparison result
- the processor performs the following steps when executing the computer readable instruction: comparing the application test result with other program test results to obtain an application test comparison result .
- the evaluation item includes an application startup time
- the step performed by the processor to output the application test result according to the evaluation type test result includes: sending an application startup instruction to enable the application to start startup;
- the page of the program performs multiple screenshots; obtains the similarity between the previous screenshot page and the subsequent screenshot page; if the similarity is less than the preset threshold, the time difference between the time of the next screenshot page and the time when the application starts to be started is applied as an application.
- the startup time of the program includes: sending an application startup instruction to enable the application to start startup;
- the page of the program performs multiple screenshots; obtains the similarity between the previous screenshot page and the subsequent screenshot page; if the similarity is less than the preset threshold, the time difference between the time of the next screenshot page and the time when the application starts to be started is applied as an application.
- the startup time of the program includes: sending an application startup instruction to enable the application to start startup;
- the page of the program performs multiple screenshots; obtains the similarity between the previous screenshot page and the subsequent
- the storage medium may be a non-volatile storage medium such as a magnetic disk, an optical disk, or a read-only memory (ROM).
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Computer Hardware Design (AREA)
- Quality & Reliability (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Debugging And Monitoring (AREA)
Abstract
Description
Claims (20)
- 一种应用程序测试方法,所述方法包括:接收应用程序测试请求;根据预设的评测项对所述应用程序进行测试,并获取所述评测项对应的评测项测试结果;根据所述评测项测试结果以及所述评测项对应的评测类型生成评测类型的评测类型测试结果;及根据所述评测类型测试结果输出应用程序测试结果。
- 如权利要求1所述的方法,其特征在于,所述评测项测试结果包括评测项评分,所述评测类型测试结果包括评测类型评分,所述根据预设的评测项对所述应用程序进行测试,并获取所述评测项对应的评测项测试结果的步骤包括:根据预设的评测项对所述应用程序进行测试,获取所述评测项的测试输出参数;根据所述评测项对应的评分规则对所述测试输出参数进行评分,得到所述评测项对应的评测项评分,其中,所述评分规则为评测项对应的评分权重与评测项在评测类型中的级别正相关,评测项对应的评分与测试输出参数所属的指标或者指标区间的级别正相关;所述根据所述评测项测试结果以及所评测项对应的评测类型生成评测类型的评测类型测试结果的步骤包括:根据所述评测项的评测类型对属于同一评测类型的所述评测项分数进行求和计算,得到评测类型评分。
- 如权利要求2所述的方法,其特征在于,所述评测类型包括性能测试、安全性测试、稳定性测试和兼容性测试的其中之一或其任意组合。
- 如权利要求2所述的方法,其特征在于,所述根据所述评测类型测试结果输出应用程序测试结果的步骤包括:根据所述评测类型评分以及所述评测类型对应的权值进行加权求和,得到所述应用程序的综合评分;输出所述应用程序测试结果;其中,所述应用程序测试结果包括所述综合评分,或者,所述应用程序测试结果包括所述综合评分以及所述评测类型评分。
- 如权利要求1~4任一权利要求所述的方法,其特征在于,所述评测项包括所述应用程序的启动时间,所述根据预设的评测项对所述应用程序进行测试,并获取所述评测项对应的评测项测试结果的步骤包括:发送应用程序启动指令,以使所述应用程序开始进行启动;对所述应用程序的页面进行多次截图;获取前一次截图页面和后一次截图页面的相似度;若所述相似度小于预设阈值,将所述后一次截图页面的时间与所述应用程序开始进行启动的时间的时间差,作为所述应用程序的启动时长。
- 一种应用程序测试装置,包括:测试请求接收单元,用于接收应用程序测试请求;测试单元,用于根据预设的评测项对所述应用程序进行测试,并获取所述评测项对应的评测项测试结果;评测类型测试结果生成单元,用于根据所述评测项测试结果以及所述评测项对应的评测类型生成评测类型的评测类型测试结果;及测试结果输出单元,用于根据所述评测类型测试结果输出应用程序测试结果。
- 如权利要求6所述的装置,其特征在于,所述评测项测试结果包括评测项评分,所述评测类型测试结果包括评测类型评分,所述测试单元包括:参数获取模块,用于根据预设的评测项对所述应用程序进行测试,获取所述评测项的测试输出参数;评测项评分获取模块,用于根据所述评测项对应的评分规则对所述测试输出参数进行评分,得到所述评测项对应的评测项评分,其中,所述评分规则为评测项对应的评分权重与评测项在评测类型中的级别正相关,评测项对应的评分与测试输出参数所属的指标或者指标区间的级别正相关;所述评测类型测试结果生成单元用于:根据所述评测项的评测类型对属于同一评测类型的所述评测项分数进行求和计算,得到评测类型评分。
- 如权利要求7所述的装置,其特征在于,所述评测类型包括性能测试、安全性测试、稳定性测试和兼容性测试的其中之一或其任意组合。
- 如权利要求7所述的装置,其特征在于,所述根据所述评测类型测试结果输出应用程序测试结果的步骤包括:综合评分获取模块,用于根据所述评测类型评分以及所述评测类型对应的权值进行加权求和,得到所述应用程序的综合评分;测试结果输出模块,用于输出所述应用程序测试结果;其中,所述应用程序测试结果包括所述综合评分,或者,所述应用程序测试结果包括所述综合评分以及所述评测类型评分。
- 如权利要求6~9任一权利要求所述的装置,其特征在于,所述评测项包括所述应用程序的启动时间,所述根据预设的评测项对所述应用程序进行测试,并获取所述评测项对应的评测项测试结果的步骤包括:指令发送单元,用于发送应用程序启动指令,以使所述应用程序开始进行启动;截图单元,用于对所述应用程序的页面进行多次截图;相似度获取单元,用于获取前一次截图页面和后一次截图页面的相似度;启动时长获取单元,用于若所述相似度小于预设阈值,将所述后一次截图页面的时间与所述应用程序开始进行启动的时间的时间差,作为所述应用程序的启动时长。
- 一种计算机设备,包括存储器和处理器,所述存储器中存储有计算机可读指令,所述计算机可读指令被所述处理器执行时,使得所述处理器执行以下步骤:接收应用程序测试请求;根据预设的评测项对所述应用程序进行测试,并获取所述评测项对应的评 测项测试结果;根据所述评测项测试结果以及所述评测项对应的评测类型生成评测类型的评测类型测试结果;及根据所述评测类型测试结果输出应用程序测试结果。
- 如权利要求11所述的计算机设备,其特征在于,所述评测项测试结果包括评测项评分,所述评测类型测试结果包括评测类型评分,所述处理器所执行的所述根据预设的评测项对所述应用程序进行测试,并获取所述评测项对应的评测项测试结果,包括:根据预设的评测项对所述应用程序进行测试,获取所述评测项的测试输出参数;根据所述评测项对应的评分规则对所述测试输出参数进行评分,得到所述评测项对应的评测项评分,其中,所述评分规则为评测项对应的评分权重与评测项在评测类型中的级别正相关,评测项对应的评分与测试输出参数所属的指标或者指标区间的级别正相关;所述根据所述评测项测试结果以及所评测项对应的评测类型生成评测类型的评测类型测试结果的步骤包括:根据所述评测项的评测类型对属于同一评测类型的所述评测项分数进行求和计算,得到评测类型评分。
- 如权利要求12所述的计算机设备,其特征在于,所述评测类型包括性能测试、安全性测试、稳定性测试和兼容性测试的其中之一或其任意组合。
- 如权利要求12所述的计算机设备,其特征在于,所述处理器所执行的所述根据所述评测类型测试结果输出应用程序测试结果,包括:根据所述评测类型评分以及所述评测类型对应的权值进行加权求和,得到所述应用程序的综合评分;输出所述应用程序测试结果;其中,所述应用程序测试结果包括所述综合评分,或者,所述应用程序测试结果包括所述综合评分以及所述评测类型评分。
- 如权利要求11~14任一权利要求所述的计算机设备,其特征在于,所 述评测项包括所述应用程序的启动时间,所述处理器所执行的所述根据预设的评测项对所述应用程序进行测试,并获取所述评测项对应的评测项测试结果,包括:发送应用程序启动指令,以使所述应用程序开始进行启动;对所述应用程序的页面进行多次截图;获取前一次截图页面和后一次截图页面的相似度;若所述相似度小于预设阈值,将所述后一次截图页面的时间与所述应用程序开始进行启动的时间的时间差,作为所述应用程序的启动时长。
- 一个或多个存储有计算机可读指令的非易失性可读存储介质,所述计算机可读指令被一个或多个处理器执行时,使得所述一个或多个处理器执行以下步骤:接收应用程序测试请求;根据预设的评测项对所述应用程序进行测试,并获取所述评测项对应的评测项测试结果;根据所述评测项测试结果以及所述评测项对应的评测类型生成评测类型的评测类型测试结果;及根据所述评测类型测试结果输出应用程序测试结果。
- 如权利要求16所述的存储介质,其特征在于,所述评测项测试结果包括评测项评分,所述评测类型测试结果包括评测类型评分,所述处理器所执行的所述根据预设的评测项对所述应用程序进行测试,并获取所述评测项对应的评测项测试结果,包括:根据预设的评测项对所述应用程序进行测试,获取所述评测项的测试输出参数;根据所述评测项对应的评分规则对所述测试输出参数进行评分,得到所述评测项对应的评测项评分,其中,所述评分规则为评测项对应的评分权重与评测项在评测类型中的级别正相关,评测项对应的评分与测试输出参数所属的指标或者指标区间的级别正相关;所述根据所述评测项测试结果以及所评测项对应的评测类型生成评测类型的评测类型测试结果的步骤包括:根据所述评测项的评测类型对属于同一评测类型的所述评测项分数进行求和计算,得到评测类型评分。
- 如权利要求17所述的存储介质,其特征在于,所述评测类型包括性能测试、安全性测试、稳定性测试和兼容性测试的其中之一或其任意组合。
- 如权利要求17所述的存储介质,其特征在于,所述处理器所执行的所述根据所述评测类型测试结果输出应用程序测试结果,包括:根据所述评测类型评分以及所述评测类型对应的权值进行加权求和,得到所述应用程序的综合评分;输出所述应用程序测试结果;其中,所述应用程序测试结果包括所述综合评分,或者,所述应用程序测试结果包括所述综合评分以及所述评测类型评分。
- 如权利要求16~19任一权利要求所述的存储介质,其特征在于,所述评测项包括所述应用程序的启动时间,所述处理器所执行的所述根据预设的评测项对所述应用程序进行测试,并获取所述评测项对应的评测项测试结果,包括:发送应用程序启动指令,以使所述应用程序开始进行启动;对所述应用程序的页面进行多次截图;获取前一次截图页面和后一次截图页面的相似度;若所述相似度小于预设阈值,将所述后一次截图页面的时间与所述应用程序开始进行启动的时间的时间差,作为所述应用程序的启动时长。
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201710612994.6 | 2017-07-25 | ||
CN201710612994.6A CN107688533B (zh) | 2017-07-25 | 2017-07-25 | 应用程序测试方法、装置、计算机设备和存储介质 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2019019356A1 true WO2019019356A1 (zh) | 2019-01-31 |
Family
ID=61152975
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/CN2017/104176 WO2019019356A1 (zh) | 2017-07-25 | 2017-09-29 | 应用程序测试方法、装置、计算机设备和存储介质 |
Country Status (2)
Country | Link |
---|---|
CN (1) | CN107688533B (zh) |
WO (1) | WO2019019356A1 (zh) |
Families Citing this family (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN108763329A (zh) * | 2018-05-08 | 2018-11-06 | 中国电子产品可靠性与环境试验研究所((工业和信息化部电子第五研究所)(中国赛宝实验室)) | 语音交互系统智商水平的评测方法、装置以及计算机设备 |
CN110505352B (zh) * | 2018-05-17 | 2021-09-24 | 腾讯科技(深圳)有限公司 | 通话质量测试方法、系统、计算机设备和计算机存储介质 |
CN109240934B (zh) * | 2018-09-29 | 2023-05-26 | 中国平安人寿保险股份有限公司 | 应用程序性能测试方法、装置、及计算机可读存储介质 |
CN111325367B (zh) * | 2018-12-13 | 2023-04-07 | 英业达科技有限公司 | 测试时间预测系统及其方法 |
CN109803046A (zh) * | 2018-12-28 | 2019-05-24 | 惠州Tcl移动通信有限公司 | 智能终端性能测试的方法、智能终端及存储装置 |
CN113742243B (zh) * | 2021-09-17 | 2024-03-01 | 京东科技信息技术有限公司 | 应用评测方法、装置、电子设备和计算机可读介质 |
Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN102902625A (zh) * | 2012-11-14 | 2013-01-30 | 北京奇虎科技有限公司 | 软件性能测试系统和方法 |
CN103425574A (zh) * | 2012-05-25 | 2013-12-04 | 腾讯科技(深圳)有限公司 | 一种测试应用程序的方法及装置 |
CN103577313A (zh) * | 2012-07-27 | 2014-02-12 | 腾讯科技(深圳)有限公司 | 一种移动终端应用程序测试方法及装置 |
CN104123221A (zh) * | 2013-04-28 | 2014-10-29 | 腾讯科技(深圳)有限公司 | 响应时间的测试方法及装置 |
CN104484273A (zh) * | 2014-12-19 | 2015-04-01 | 广州博冠信息科技有限公司 | 应用程序的测试方法、设备及系统 |
CN106897059A (zh) * | 2017-01-23 | 2017-06-27 | 中国电力科学研究院 | 一种智能电网调度控制系统软件质量评价平台及评价方法 |
Family Cites Families (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN102043707B (zh) * | 2009-10-16 | 2014-12-31 | 腾讯科技(深圳)有限公司 | 嵌入式应用的性能测试方法、嵌入式终端设备及网络系统 |
CN102043709A (zh) * | 2009-10-22 | 2011-05-04 | 上海杉达学院 | 软件测试系统 |
CN102043711A (zh) * | 2009-10-22 | 2011-05-04 | 上海杉达学院 | 软件系统辅助测试装置 |
US8892493B2 (en) * | 2010-12-17 | 2014-11-18 | Microsoft Corporation | Compatibility testing using traces, linear temporal rules, and behavioral models |
CN102646066B (zh) * | 2012-02-22 | 2013-12-18 | 腾讯科技(深圳)有限公司 | 一种开机时间的获取方法及装置 |
CN103312851B (zh) * | 2013-05-31 | 2015-05-13 | 南京大学 | 一种智能手机应用交互界面程序可用性测试方法 |
CN103678132A (zh) * | 2013-12-18 | 2014-03-26 | 中国科学院深圳先进技术研究院 | 一种应用软件云测试系统 |
CN105045714A (zh) * | 2015-07-25 | 2015-11-11 | 北京金山安全软件有限公司 | 一种应用软件启动时长的测试方法、装置及终端 |
-
2017
- 2017-07-25 CN CN201710612994.6A patent/CN107688533B/zh active Active
- 2017-09-29 WO PCT/CN2017/104176 patent/WO2019019356A1/zh active Application Filing
Patent Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN103425574A (zh) * | 2012-05-25 | 2013-12-04 | 腾讯科技(深圳)有限公司 | 一种测试应用程序的方法及装置 |
CN103577313A (zh) * | 2012-07-27 | 2014-02-12 | 腾讯科技(深圳)有限公司 | 一种移动终端应用程序测试方法及装置 |
CN102902625A (zh) * | 2012-11-14 | 2013-01-30 | 北京奇虎科技有限公司 | 软件性能测试系统和方法 |
CN104123221A (zh) * | 2013-04-28 | 2014-10-29 | 腾讯科技(深圳)有限公司 | 响应时间的测试方法及装置 |
CN104484273A (zh) * | 2014-12-19 | 2015-04-01 | 广州博冠信息科技有限公司 | 应用程序的测试方法、设备及系统 |
CN106897059A (zh) * | 2017-01-23 | 2017-06-27 | 中国电力科学研究院 | 一种智能电网调度控制系统软件质量评价平台及评价方法 |
Also Published As
Publication number | Publication date |
---|---|
CN107688533B (zh) | 2020-12-29 |
CN107688533A (zh) | 2018-02-13 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
WO2019019356A1 (zh) | 应用程序测试方法、装置、计算机设备和存储介质 | |
US11050551B2 (en) | Secure verification of conditions of a contract using a set of verification tools | |
CN107273280B (zh) | 一种日志处理方法、装置、电子设备和存储介质 | |
WO2018120722A1 (zh) | 异步接口测试方法、终端、设备、系统及存储介质 | |
US10740411B2 (en) | Determining repeat website users via browser uniqueness tracking | |
US11762979B2 (en) | Management of login information affected by a data breach | |
CN109684188B (zh) | 测试方法和装置 | |
WO2019200792A1 (zh) | 会话消息质检方法及装置 | |
WO2018103402A1 (zh) | 无线保真Wi-Fi扫描方法及相关产品 | |
WO2023103390A1 (zh) | 任务处理方法、任务处理装置、电子设备以及存储介质 | |
CN107193747B (zh) | 代码测试方法、装置和计算机设备 | |
CN108667840A (zh) | 注入漏洞检测方法及装置 | |
US20140237568A1 (en) | Unique identification for an information handling system | |
CN113535577B (zh) | 基于知识图谱的应用测试方法、装置、电子设备和介质 | |
US20150067139A1 (en) | Agentless monitoring of computer systems | |
CN109032911B (zh) | 用于移动设备的帧率检测方法、装置及电子设备 | |
WO2022132408A1 (en) | Systems and methods for visual anomaly detection in a multi-display system | |
US20190236269A1 (en) | Detecting third party software elements | |
CN113362173A (zh) | 防重机制验证方法、验证系统、电子设备及存储介质 | |
WO2015039585A1 (en) | Method and device for testing software reliability | |
US11662927B2 (en) | Redirecting access requests between access engines of respective disk management devices | |
CN112379967B (zh) | 模拟器检测方法、装置、设备及介质 | |
US20180074930A1 (en) | System and method for dynamic adjustment of logging | |
WO2020233093A1 (zh) | 关联图谱生成方法、装置、计算机设备和存储介质 | |
CN113760835B (zh) | 日志管理方法、中台系统、电子设备和存储介质 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 17919013 Country of ref document: EP Kind code of ref document: A1 |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 17919013 Country of ref document: EP Kind code of ref document: A1 |
|
32PN | Ep: public notification in the ep bulletin as address of the adressee cannot be established |
Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 28.05.2020) |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 17919013 Country of ref document: EP Kind code of ref document: A1 |