WO2019056720A1 - Automated test case management method and apparatus, device, and storage medium - Google Patents

Automated test case management method and apparatus, device, and storage medium Download PDF

Info

Publication number
WO2019056720A1
WO2019056720A1 PCT/CN2018/080432 CN2018080432W WO2019056720A1 WO 2019056720 A1 WO2019056720 A1 WO 2019056720A1 CN 2018080432 W CN2018080432 W CN 2018080432W WO 2019056720 A1 WO2019056720 A1 WO 2019056720A1
Authority
WO
WIPO (PCT)
Prior art keywords
test case
test
mapping table
automatic regression
backup
Prior art date
Application number
PCT/CN2018/080432
Other languages
French (fr)
Chinese (zh)
Inventor
伍朗
伍振亮
Original Assignee
平安科技(深圳)有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 平安科技(深圳)有限公司 filed Critical 平安科技(深圳)有限公司
Publication of WO2019056720A1 publication Critical patent/WO2019056720A1/en

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00Error detection; Error correction; Monitoring
    • G06F11/36Preventing errors by testing or debugging software
    • G06F11/3668Software testing
    • G06F11/3672Test management
    • G06F11/3684Test management for test design, e.g. generating new test cases
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00Error detection; Error correction; Monitoring
    • G06F11/36Preventing errors by testing or debugging software
    • G06F11/3668Software testing
    • G06F11/3672Test management
    • G06F11/3688Test management for test execution, e.g. scheduling of test suites

Definitions

  • the present application relates to the field of software automated testing technologies, and in particular, to an automated test case management method, apparatus, device, and storage medium.
  • Automated testing of software is a process of turning manual test behavior into a machine that automatically performs tests. Usually, after the test case is designed and passed the review, the tester performs the test step by step according to the procedure described in the test case, and compares the actual result with the expected result. In this process, in order to save manpower, time or hardware resources, and improve test efficiency, automated testing was introduced.
  • regression testing In the process of developing automated test cases, regression testing is required. Among them, the regression test means that after the old code is modified, the test is re-tested to confirm that the modification does not introduce a new error or cause other code to generate an error.
  • the embodiment of the present application provides a method, device, device and storage medium for automated test case management, which can improve the speed of developing an automated test case and perform effective regression test at the same time.
  • the first aspect of the present application provides an automated test case management method, including:
  • mapping table in the database according to the test case, each step in the mapping table being each step of the test case script;
  • the second aspect of the present application provides an automated test case management apparatus, where the automated test case management apparatus includes:
  • mapping table obtaining module configured to establish a mapping table in the database according to the test case, each action in the mapping table is performed in each step of the test case script;
  • An automatic regression test module configured to modify the test case by modifying a row of the mapping table, and perform an automatic regression test on the modified mapping table, and save the modified mapping table by using the automatic regression test If the automatic regression test is not passed, the modified mapping table is not saved.
  • a third aspect of the present application provides a terminal device including a memory, a processor, and computer readable instructions stored in the memory and executable on the processor, the processor executing the computer readable instructions Implement the following steps:
  • mapping table in the database according to the test case, each step in the mapping table being each step of the test case script;
  • Modifying the test case by modifying the row of the mapping table, performing an automatic regression test on the modified mapping table, and determining whether the modified mapping table passes the automatic regression test;
  • a fourth aspect of the present application provides one or more non-transitory readable storage mediums storing computer readable instructions, the computer readable instructions being executed by one or more processors such that the one or more processes Perform the following steps:
  • mapping table in the database according to the test case, each step in the mapping table being each step of the test case script;
  • Modifying the test case by modifying the row of the mapping table, performing an automatic regression test on the modified mapping table, and determining whether the modified mapping table passes the automatic regression test;
  • the beneficial effects of the automated test case management method, apparatus, device and storage medium provided by the embodiments of the present application are: developing test cases by establishing a mapping table, and performing automatic regression test on new test cases during the development process, thereby improving automation Test case development and regression testing efficiency.
  • Embodiment 1 is a flowchart of an automated test case management method provided by Embodiment 1 of the present application;
  • FIG. 3 is another flowchart of an automated test case management method provided by Embodiment 1 of the present application.
  • FIG. 5 is a schematic structural diagram of an automated test case management apparatus provided in Embodiment 3 of the present application.
  • FIG. 6 is another schematic structural diagram of an automated test case management apparatus provided in Embodiment 3 of the present application.
  • FIG. 7 is a schematic structural diagram of a terminal device according to another embodiment of the present application.
  • FIG. 1 is a flowchart of an automated test case management method provided by an embodiment of the present application.
  • step S10 a mapping table is established according to the test cases in the database, and each step of the behavior test case script in the table is mapped.
  • the database is a collection of all test cases, the original developed test cases and newly developed test cases are stored in the database, as the development progress database has been updated.
  • the mapping table is a table established for the test case to be developed, and has a mapping relationship with the test case to be developed, and the modification of the test case can be implemented by modifying the mapping table, without directly modifying the test case.
  • mapping table can be used to encapsulate the functions of the test case itself. The developer only needs to modify the defined function without paying attention to the function itself, making the script easier to develop and maintain.
  • the table is set in the database, and the test case includes a plurality of script units, and each row of the table is specified to display a name stored in the database by the script unit, and the column of the table displays the content included in the script unit, and each script unit is stored.
  • the ID in the database corresponds to the row on the table, and then the operation type and the control number contained in the script unit corresponding to each row are displayed in the column of the table in turn, and the obtained table is the mapping table, wherein each script unit corresponds to In a way of processing.
  • Step S20 Modify the test case by modifying the row of the mapping table, and perform an automatic regression test on the modified mapping table.
  • step S20 specifically includes:
  • step S201 the original test case is backed up.
  • the original test case is backed up.
  • Step S202 generating a backup test case.
  • step S203 the mapping table is modified.
  • Step S204 generating a cache test case.
  • the cache test case is generated according to the mapping table, and compared with the previously generated backup test case.
  • the regression test refers to a process of re-verifying the program with the test case after the code is modified.
  • the automatic regression test is adopted in the technical solution. Among them, the automatic regression test refers to a comparison between the number of times of checking errors and the detection time in the cache test case and the backup test case regression test.
  • step S30 it is determined whether the modified mapping table passes the automatic regression test.
  • step S301 the number of check errors and the detection time of the cache test case are compared with the backup test case.
  • the cache test case and the backup test case are respectively run for regression test, and the data of the number of check errors and the time of detection are obtained, and the two sets of data are compared.
  • step S302 when the number of check errors of the cache test case is greater than the backup test case and the detection time of the cache test case is less than the backup test case, it is regarded as passing the automatic regression test.
  • the error detection rate and detection efficiency of the cache test case are better than the backup test case.
  • Step S303 when the number of check errors of the cache test case is less than the backup test case or the test time of the cache test case is greater than the backup test case, it is deemed not to pass the automatic regression test.
  • the cache test case is not more advanced than the backup test case.
  • step S40 when the cache test case passes the automatic regression test, the modified mapping table is saved.
  • the modified map table is saved, the test case is updated, and the test case database is updated to complete a stage development of the original test case.
  • the map table is not saved, the original test case is restored, the original database is maintained, and the next round of development and testing is performed.
  • the beneficial effects of the embodiment of the present application are: developing the original test case by establishing a mapping table, and modifying and then passing the automatic regression test. If the new test case is superior to the original test case, the new test case is saved and the database is updated simultaneously. , restore the original test case, carry out the next round of development and testing, accelerate the development of automated test cases, and improve the efficiency of regression testing.
  • a plurality of new test cases that can pass the automatic regression test can be generated for one original test case, and then a subset is established in the database to save the new test cases.
  • Bayesian classification can be prioritized, so that the target of new software defects can be found more quickly and with fewer test cases, and the regression test can be improved. s efficiency.
  • the method processing flow of the embodiment of the present application includes four modules of historical data preprocessing, classification mining training set construction, classification mining training and prediction, and test case prioritization.
  • the historical data preprocessing module is responsible for collecting and extracting test result execution results of different versions and historical data of module changes, and converting into test case execution result data matrix and module change data matrix of different versions required for subsequent processing.
  • the classification mining training set building module uses the test case execution result data matrix and the module change data matrix under different versions to establish a training set required for the classification mining training for each test case.
  • the classification mining training and prediction module uses different classification mining models, training based on the training set of each test case, and using the post-training model to predict the execution results of the test cases in the new version.
  • the test case prioritization sorting module prioritizes all test cases based on the predicted execution results, prioritizing the execution of the preceding test cases.
  • FIG. 4 shows the implementation steps of each module described above:
  • the data preprocessing module includes two parts: test data preprocessing and module change data preprocessing, namely steps S402 and S403, and the processing flow thereof includes:
  • the first step is to determine the version number n of the test case execution result matrix and the number of test cases m.
  • Rij has three values: 0 means the test passes; 1 means the test fails; null (null) means that the test case ti has not been executed in version vj.
  • All elements rij in the matrix are initialized to null first, and then the elements rij in the matrix are assigned according to the execution result of the test case ti on the version vj.
  • the process of pre-processing the version change data includes:
  • the sample version is used as a reference standard for version changes.
  • the sample version can be selected to follow the following standards:
  • the first version should be a stable version, the function and structure are complete, and the second version should contain all of the software system System. Module, the third sample version should be the version with the least chance of test case execution error, the most stable version.
  • ⁇ jk has two values: 0 means that the version vj is compared with the sample version v0, and no change occurs on the module Modk; 1 means that the version vj is changed on the module Modk relative to the sample version v0.
  • Step S404 the classification mining training set is constructed, that is, the classification mining training set building module, and the processing flow thereof comprises:
  • the training set builds the assumptions associated with the test case based on the module change: each test case ti has different degrees of detection capability for different module defects, and the new defect is introduced due to a change in some modules in the new version; When the module changes, some test cases will be more sensitive, that is, their defect detection capability will be higher than other test cases, so the module changes are related to the execution results of the test cases, which can be analyzed and determined by classification mining.
  • a classification mining training set is constructed for each test case. Given the test case ti in the test case set T, considering each version vj of the use case ti, the change information ⁇ jk of each module Modk in the version vj and the use case ti The result rij is merged into a data vector in the version vj: ⁇ j1, ⁇ j2, ..., ⁇ jn, rij>; then the use case ti is merged into a matrix in each version of the data vector to form the training set Trainseti of the use case ti.
  • the training set Trainseti [ ⁇ , Ri] is a matrix of n' ⁇ (l + 1). Where ⁇ (n',l) is taken from the module change data matrix ⁇ (n,l), regardless of the version of the unexecuted use case ti; Ri is an n' ⁇ 1 vector, which is the test case execution result matrix R(m,n) The transposition of the i-th row in the middle row indicates the execution result of the test case ti in the n versions, and the version of the unused use case ti is also not considered.
  • a training set consists of a set of records, each of which is divided into an attribute (Attribute) and a class label (Class Label), and the class label corresponds to the classification result.
  • One row of the training set is used as a record.
  • the change of the first l column, that is, the l module, is used as the attribute, and the last column is the execution result rij as the class tag.
  • Step S405 training and predicting the result, that is, the classification mining training and prediction module, the processing flow of which includes:
  • HNB and AODE Two Bayesian classification models, HNB and AODE, are selected in the classification mining training and prediction part.
  • AODE is a semi-simple Bayesian technique. Compared with the naive Bayesian technique, AODE reduces the mutual independence of attributes and can effectively improve the accuracy of classification results in practical applications.
  • HNB is another Bayesian technique that combines the advantages of a simple Bayesian model with a Bayesian network model, while overcoming the property independent assumptions of the simple Bayesian model and the shortcomings of Bayesian network structure learning.
  • HNB Since HNB does not need to set any parameters, it is initialized by default when loading HNB.
  • freq which is an integer, indicating that a combination of at least freq times occurs. Normally, 1 can be used; if the training set is large, the value of freq can be increased appropriately to reduce the influence of accidental combination.
  • the corresponding training set Trainseti is loaded for training.
  • the training set is large, the maximum number of training steps and the maximum training time can be set.
  • the new version change information set ⁇ new ⁇ 1, new, ⁇ 2, new, ..., ⁇ l, new ⁇ represents the module change vector in the new version.
  • This value is a floating point value (between 0 and 1), which means that the test case ti can find the new version.
  • the probability of a software defect is a floating point value (between 0 and 1), which means that the test case ti can find the new version.
  • Step S406 the test case sorting, that is, the test case prioritization sorting module, the processing flow includes:
  • Two Bayesian classification mining models of HNB and AODE are used to predict respectively.
  • the time to consider the regression test phase is limited. Let the total time of the regression test be timemax, and select the first m' test cases that can be completed within timemax to form the final regression test case set.
  • the beneficial effects of the embodiments of the present application are: by performing historical data preprocessing, classification mining training set construction, classification mining training, and prediction and test case prioritization sorting on the new test case training set, the test cases are optimized, thereby realizing Quickly and more discover the goal of new versions of software defects with fewer test cases, speed up the development of automated test cases, and improve the efficiency of regression testing.
  • FIG. 5 illustrates an automated test case management device 40 provided by another embodiment of the present application.
  • the automated test case management device 40 includes a mapping table obtaining module 401 and an automatic regression testing module 402 .
  • mapping table obtaining module 401 configured to establish a mapping table in the database according to the test case, each step of the test case script in the mapping table;
  • the automatic regression test module 402 is configured to modify the test case by modifying a row of the mapping table, perform an automatic regression test on the modified mapping table, and determine whether the modified mapping table passes the automatic regression test. If the automatic regression test is passed, the modified mapping table is saved, and if the automatic regression test is not passed, the modified mapping table is not saved.
  • the automatic regression test module 402 includes:
  • the number of check errors of the cache test case is less than the backup test case or the cache test case is greater than the backup test case, it is deemed not to pass the automatic regression test and does not save the modified mapping table. .
  • the automated test case management apparatus 40 further includes:
  • the prioritization module 403 is configured to prioritize test cases that are tested by the automatic regression test. Specifically, select two classification mining models, Bayesian classification HNB and AODE, and use corresponding training sets for each test case. Model training is performed to prioritize test cases based on the combined results of the model predictions.
  • test case management device provides a mapping table, and the automatic test of the new test case is automatically performed during the development process, thereby improving the automatic test case development and the regression test.
  • Another embodiment of the present application provides one or more non-volatile readable storage media storing computer readable instructions that, when executed by one or more processors, cause one or more processors
  • the method for implementing the automated test case management in the above embodiments is implemented. To avoid repetition, details are not described herein again.
  • the computer readable instructions are executed by one or more processors, causing one or more processors to perform the functions of the modules/units in the automated test case management device in the above embodiments, to avoid repetition, no further details are provided herein. .
  • Fig. 7 is a schematic diagram of a terminal device in this embodiment.
  • terminal device 60 includes a processor 61, a memory 62, and computer readable instructions 63 stored in memory 62 and operative on processor 61.
  • the processor 61 executes the computer readable instructions 63 to implement various steps of an automated test case management method of the above-described embodiments, such as steps S10, S20, and S30 shown in FIG.
  • the processor 61 executes the computer readable instructions 63
  • the functions of each module/unit of the automated test case management device in the above embodiments are implemented, for example, the mapping table obtaining module 401, the automatic regression testing module 402, and the priority shown in FIG.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Hardware Design (AREA)
  • Quality & Reliability (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Debugging And Monitoring (AREA)

Abstract

The present application relates to the field of software automated test technology, and provides an automated test case management method and apparatus, a device, and a storage medium. The automated test case management method comprises: establishing a mapping table in a database according to test cases, each row of the mapping table indicating each step of a test case script; modifying the test cases by modifying the row of the mapping table, and performing automated regression test on the modified mapping table; if the automated regression test is passed, saving the modified mapping table; if the automated regression test is not passed, not saving the modified mapping table. According to the present application, test cases are developed by establishing a mapping table, and furthermore, in a development process, automated regression test is performed on new test cases, thereby improving the efficiency of automated test case development and regression test.

Description

自动化测试用例管理方法、装置、设备及存储介质Automated test case management method, device, device and storage medium
本专利申请以2017年9月21日提交的申请号为201710857308.1,名称为“自动化测试用例管理方法、装置、设备及存储介质”的中国发明专利申请为基础,并要求其优先权。This patent application is based on the Chinese invention patent application filed on September 21, 2017, with the application number of 201710857308.1, entitled "Automated Test Case Management Method, Apparatus, Equipment and Storage Medium", and requires its priority.
技术领域Technical field
本申请涉及软件自动化测试技术领域,特别涉及到一种自动化测试用例管理方法、装置、设备及存储介质。The present application relates to the field of software automated testing technologies, and in particular, to an automated test case management method, apparatus, device, and storage medium.
背景技术Background technique
软件的自动化测试是将人工测试行为转化为机器自动执行测试的一种过程。通常,在设计了测试用例并通过评审之后,由测试人员根据测试用例中描述的规程一步步执行测试,将得到的实际结果与期望结果进行比较。在此过程中,为了节省人力、时间或硬件资源,提高测试效率,引入了自动化测试。Automated testing of software is a process of turning manual test behavior into a machine that automatically performs tests. Usually, after the test case is designed and passed the review, the tester performs the test step by step according to the procedure described in the test case, and compares the actual result with the expected result. In this process, in order to save manpower, time or hardware resources, and improve test efficiency, automated testing was introduced.
在自动化测试用例开发的过程中,需要进行回归测试。其中,回归测试是指修改了旧代码后,重新进行测试以确认修改没有引入新的错误或导致其他代码产生错误。In the process of developing automated test cases, regression testing is required. Among them, the regression test means that after the old code is modified, the test is re-tested to confirm that the modification does not introduce a new error or cause other code to generate an error.
目前,软件开发的速度越来越快,为了跟上软件开发的速度,必须进一步提高开发自动化测试用例的速度并同时进行有效的回归测试。At present, the speed of software development is getting faster and faster. In order to keep up with the speed of software development, it is necessary to further improve the speed of developing automated test cases and conduct effective regression tests at the same time.
发明内容Summary of the invention
本申请实施例提供一种自动化测试用例管理的方法、装置、设备及存储介质,可以提高开发自动化测试用例的速度并同时进行有效的回归测试。The embodiment of the present application provides a method, device, device and storage medium for automated test case management, which can improve the speed of developing an automated test case and perform effective regression test at the same time.
本申请是这样实现的:This application is implemented as follows:
本申请第一方面提供一种自动化测试用例管理方法,包括:The first aspect of the present application provides an automated test case management method, including:
根据测试用例在数据库中建立映射表格,所述映射表格中的每一行为所述测试用例脚本的每一个步骤;Establishing a mapping table in the database according to the test case, each step in the mapping table being each step of the test case script;
通过修改所述映射表格的行以对所述测试用例进行修改,对修改后的映射表格进行自动回归测试;Modifying the test case by modifying the row of the mapping table, and performing an automatic regression test on the modified mapping table;
若通过所述自动回归测试,则保存修改后的映射表格;If the automatic regression test is passed, the modified mapping table is saved;
若不通过所述自动回归测试,则不保存修改后的映射表格。If the automatic regression test is not passed, the modified mapping table is not saved.
本申请第二方面提供一种自动化测试用例管理装置,所述自动化测试用例管理装置包括:The second aspect of the present application provides an automated test case management apparatus, where the automated test case management apparatus includes:
映射表格获取模块,用于根据测试用例在数据库中建立映射表格,所述映射表格中的每一行为所述测试用例脚本的每一个步骤;a mapping table obtaining module, configured to establish a mapping table in the database according to the test case, each action in the mapping table is performed in each step of the test case script;
自动回归测试模块,用于通过修改所述映射表格的行以对所述测试用例进行修改,对修改后的映射表格进行自动回归测试,若通过所述自动回归测试,则保存修改后的映射表格,若不通过所述自动回归测试,则不保存修改后的映射表格。An automatic regression test module, configured to modify the test case by modifying a row of the mapping table, and perform an automatic regression test on the modified mapping table, and save the modified mapping table by using the automatic regression test If the automatic regression test is not passed, the modified mapping table is not saved.
本申请第三方面提供一种终端设备,包括存储器、处理器以及存储在所述存储器中并可在所述处理器上运行的计算机可读指令,所述处理器执行所述计算机可读指令时实现如下步骤:A third aspect of the present application provides a terminal device including a memory, a processor, and computer readable instructions stored in the memory and executable on the processor, the processor executing the computer readable instructions Implement the following steps:
根据测试用例在数据库中建立映射表格,所述映射表格中的每一行为所述测试用例脚本的每一个步骤;Establishing a mapping table in the database according to the test case, each step in the mapping table being each step of the test case script;
通过修改所述映射表格的行以对所述测试用例进行修改,对修改后的映射表格进行自动回归测试,判断修改后的映射表格是否通过所述自动回归测试;Modifying the test case by modifying the row of the mapping table, performing an automatic regression test on the modified mapping table, and determining whether the modified mapping table passes the automatic regression test;
若通过所述自动回归测试,则保存修改后的映射表格;If the automatic regression test is passed, the modified mapping table is saved;
若不通过所述自动回归测试,则不保存修改后的映射表格。If the automatic regression test is not passed, the modified mapping table is not saved.
本申请第四方面提供一个或多个存储有计算机可读指令的非易失性可读存 储介质,所述计算机可读指令被一个或多个处理器执行时,使得所述一个或多个处理器执行如下步骤:A fourth aspect of the present application provides one or more non-transitory readable storage mediums storing computer readable instructions, the computer readable instructions being executed by one or more processors such that the one or more processes Perform the following steps:
根据测试用例在数据库中建立映射表格,所述映射表格中的每一行为所述测试用例脚本的每一个步骤;Establishing a mapping table in the database according to the test case, each step in the mapping table being each step of the test case script;
通过修改所述映射表格的行以对所述测试用例进行修改,对修改后的映射表格进行自动回归测试,判断修改后的映射表格是否通过所述自动回归测试;Modifying the test case by modifying the row of the mapping table, performing an automatic regression test on the modified mapping table, and determining whether the modified mapping table passes the automatic regression test;
若通过所述自动回归测试,则保存修改后的映射表格;If the automatic regression test is passed, the modified mapping table is saved;
若不通过所述自动回归测试,则不保存修改后的映射表格。If the automatic regression test is not passed, the modified mapping table is not saved.
本申请实施例提供的自动化测试用例管理方法、装置、设备及存储介质的有益效果是:通过建立映射表格对测试用例进行开发,同时开发过程中对新的测试用例进行自动回归测试,提高了自动化测试用例开发和回归测试的效率。The beneficial effects of the automated test case management method, apparatus, device and storage medium provided by the embodiments of the present application are: developing test cases by establishing a mapping table, and performing automatic regression test on new test cases during the development process, thereby improving automation Test case development and regression testing efficiency.
附图说明DRAWINGS
为了更清楚地说明本申请实施例中的技术方案,下面将对实施例或现有技术描述中所需要使用的附图作简单地介绍,显而易见地,下面描述中的附图仅仅是本申请的一些实施例,对于本领域普通技术人员来讲,在不付出创造性劳动性的前提下,还可以根据这些附图获得其他的附图。In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings used in the embodiments or the prior art description will be briefly described below. Obviously, the drawings in the following description are only the present application. For some embodiments, other drawings may be obtained from those of ordinary skill in the art without departing from the drawings.
图1是本申请实施例一提供的自动化测试用例管理方法的流程图;1 is a flowchart of an automated test case management method provided by Embodiment 1 of the present application;
图2是本申请实施例一提供的自动化测试用例管理方法的另一流程图;2 is another flowchart of an automated test case management method provided by Embodiment 1 of the present application;
图3是本申请实施例一提供的自动化测试用例管理方法的另一流程图;3 is another flowchart of an automated test case management method provided by Embodiment 1 of the present application;
图4是本申请实施例二提供的自动化测试用例管理方法的流程图;4 is a flowchart of an automated test case management method provided by Embodiment 2 of the present application;
图5是本申请实施例三提供的自动化测试用例管理装置的结构示意图;5 is a schematic structural diagram of an automated test case management apparatus provided in Embodiment 3 of the present application;
图6是本申请实施例三提供的自动化测试用例管理装置的另一结构示意图;6 is another schematic structural diagram of an automated test case management apparatus provided in Embodiment 3 of the present application;
图7是本申请另一个实施例提供的终端设备的结构示意图。FIG. 7 is a schematic structural diagram of a terminal device according to another embodiment of the present application.
具体实施方式Detailed ways
为了使本申请的目的、技术方案及优点更加清楚明白,以下结合附图及实施例,对本申请进行进一步详细说明。应当理解,此处所描述的具体实施例仅仅用以解释本申请,并不用于限定本申请。In order to make the objects, technical solutions, and advantages of the present application more comprehensible, the present application will be further described in detail below with reference to the accompanying drawings and embodiments. It is understood that the specific embodiments described herein are merely illustrative of the application and are not intended to be limiting.
实施例一Embodiment 1
请参考图1,其示出了本申请实施例提供的自动化测试用例管理方法的流程图。Please refer to FIG. 1 , which is a flowchart of an automated test case management method provided by an embodiment of the present application.
步骤S10,根据数据库中的测试用例建立映射表格,映射表格中的每一行为测试用例脚本的每一个步骤。In step S10, a mapping table is established according to the test cases in the database, and each step of the behavior test case script in the table is mapped.
其中,数据库为所有测试用例的集合,原来开发的测试用例和新开发的测试用例都存放在该数据库中,随着开发的进度数据库一直保持着更新的状态。Among them, the database is a collection of all test cases, the original developed test cases and newly developed test cases are stored in the database, as the development progress database has been updated.
在自动化测试用例开发的过程中,若直接对测试用例进行修改,则需要对测试用例本身进行文本级的操作。由于测试用例中有大量的编程语言,直接修改需要对编程语言进行修改,对编程能力要求很强,而且效率不高;一旦开发的过程中出现问题,则可能导致修改没有保存,或丢失重要的进度,需要从头检查和重新开发,而建立映射表格对测试用例进行修改,则可以解决这些问题,使测试用例开发的速度大大提升。In the process of developing automated test cases, if you directly modify the test cases, you need to perform text-level operations on the test cases themselves. Because there are a large number of programming languages in the test cases, direct modification requires modification of the programming language. The programming ability is very strong and the efficiency is not high. Once there is a problem in the development process, the modification may not be saved, or the important ones may be lost. The progress needs to be checked and re-developed from the beginning, and the mapping table is modified to test the test cases, which can solve these problems and greatly improve the speed of test case development.
映射表格为针对待开发的测试用例建立的表格,与待开发测试用例存在映射的关系,可以通过修改映射表格实现对测试用例的修改,而不需要直接对测试用例进行修改。The mapping table is a table established for the test case to be developed, and has a mapping relationship with the test case to be developed, and the modification of the test case can be implemented by modifying the mapping table, without directly modifying the test case.
建立映射表格可以对测试用例本身的函数进行封装,开发人员只需要对定义好的函数进行修改而不用关注函数的本身,使脚本更易于开发和维护。The mapping table can be used to encapsulate the functions of the test case itself. The developer only needs to modify the defined function without paying attention to the function itself, making the script easier to develop and maintain.
具体的,在数据库中设置表格,测试用例包括多个脚本单元,规定表格的每一行对应显示脚本单元在数据库中存储的名称,表格的列显示脚本单元所包含的内容,将每一脚本单元存储于数据库中的ID对应为表格上的行,然后依次将每一行对应的脚本单元所包含的操作类型和控件编号显示于表格的列内,得到的表格即为映射表格,其中每一脚本单元对应于一处理方式。Specifically, the table is set in the database, and the test case includes a plurality of script units, and each row of the table is specified to display a name stored in the database by the script unit, and the column of the table displays the content included in the script unit, and each script unit is stored. The ID in the database corresponds to the row on the table, and then the operation type and the control number contained in the script unit corresponding to each row are displayed in the column of the table in turn, and the obtained table is the mapping table, wherein each script unit corresponds to In a way of processing.
对测试用例进行编辑选择待编辑的测试脚本,点击编辑,根据待编辑的测试脚本及预先设置的表格生成映射表格,其中操作类型包括点击、长按、拖拽、按键、延时以及检查点等。可以选择映射表格的任一行,调用数据库,根据选择的行对应的ID在数据库中查找与该脚本单元对应的数据行,选择任一操作并执行,如删除某一步骤。Edit the test case Select the test script to be edited, click Edit, and generate a mapping table according to the test script to be edited and the preset table. The operation types include click, long press, drag and drop, button, delay, checkpoint, etc. . You can select any row of the mapping table, call the database, find the data row corresponding to the script unit in the database according to the ID corresponding to the selected row, select any operation and execute, such as deleting a certain step.
步骤S20,通过修改所述映射表格的行以对所述测试用例进行修改,对修改后的映射表格进行自动回归测试。Step S20: Modify the test case by modifying the row of the mapping table, and perform an automatic regression test on the modified mapping table.
作为一种实施方式,在自动回归测试之前,会生成备份测试用例和缓存测试用例,如图2所示,步骤S20具体包括:As an implementation manner, before the automatic regression test, a backup test case and a cache test case are generated. As shown in FIG. 2, step S20 specifically includes:
步骤S201,对原测试用例进行备份。In step S201, the original test case is backed up.
当对原测试用例进行修改时,对原测试用例进行备份。When the original test case is modified, the original test case is backed up.
步骤S202,生成备份测试用例。Step S202, generating a backup test case.
生成备份测试用例,以便与后面的缓存测试用例进行比较。Generate backup test cases for comparison with later cached test cases.
步骤S203,对映射表格进行修改。In step S203, the mapping table is modified.
开始对原测试用例进行进一步的开发。Begin further development of the original test case.
步骤S204,生成缓存测试用例。Step S204, generating a cache test case.
对原测试用例进行完一个阶段的开发之后,根据映射表格生成缓存测试用例,与之前生成的备份测试用例进行比较。After completing the development of the original test case, the cache test case is generated according to the mapping table, and compared with the previously generated backup test case.
为了验证开发的结果,开发人员要对修改后的测试用例进行回归测试,回归测试是指在代码修改以后用测试用例对程序进行一个重新验证的过程,本技术方案中采用自动回归测试。其中,自动回归测试是指对缓存测试用例与备份测试用例回归测试中检查错误的次数和检测时间进行一个比较。In order to verify the results of the development, the developer should perform a regression test on the modified test case. The regression test refers to a process of re-verifying the program with the test case after the code is modified. The automatic regression test is adopted in the technical solution. Among them, the automatic regression test refers to a comparison between the number of times of checking errors and the detection time in the cache test case and the backup test case regression test.
步骤S30,判断修改后的映射表格是否通过所述自动回归测试。In step S30, it is determined whether the modified mapping table passes the automatic regression test.
判断修改后的映射表格是否通过所述自动回归测试,具体步骤如图3所示,包括:Determining whether the modified mapping table passes the automatic regression test, and the specific steps are as shown in FIG. 3, including:
步骤S301,将缓存测试用例的检查错误次数和检测时间与备份测试用例进 行比较。In step S301, the number of check errors and the detection time of the cache test case are compared with the backup test case.
即分别运行缓存测试用例和备份测试用例进行回归测试,获取检查错误次数和检测时间的数据,将这两组数据进行比较。That is, the cache test case and the backup test case are respectively run for regression test, and the data of the number of check errors and the time of detection are obtained, and the two sets of data are compared.
步骤S302,当缓存测试用例的检查错误次数大于备份测试用例且缓存测试用例的检测时间小于备份测试用例,则视为通过自动回归测试。In step S302, when the number of check errors of the cache test case is greater than the backup test case and the detection time of the cache test case is less than the backup test case, it is regarded as passing the automatic regression test.
即判断为缓存测试用例的检错率和检测效率要优于备份测试用例。That is to say, the error detection rate and detection efficiency of the cache test case are better than the backup test case.
步骤S303,当缓存测试用例的检查错误次数小于备份测试用例或者缓存测试用例的检测时间大于备份测试用例,则视为不通过自动回归测试。Step S303, when the number of check errors of the cache test case is less than the backup test case or the test time of the cache test case is greater than the backup test case, it is deemed not to pass the automatic regression test.
即判断为缓存测试用例并不比备份测试用例更先进。That is to say, the cache test case is not more advanced than the backup test case.
通过以上步骤,可以判断出修改后的映射表格是否比备份测试用例更先进,从而判断修改后的映射表格是否通过自动回归测试。Through the above steps, it can be determined whether the modified mapping table is more advanced than the backup test case, thereby determining whether the modified mapping table passes the automatic regression test.
步骤S40,当缓存测试用例通过自动回归测试时,保存修改后的映射表格。In step S40, when the cache test case passes the automatic regression test, the modified mapping table is saved.
如果缓存测试用例通过自动回归测试,则对修改后的映射表格进行保存,同时更新测试用例,并更新测试用例的数据库,完成对原测试用例的一个阶段开发。If the cache test case passes the automatic regression test, the modified map table is saved, the test case is updated, and the test case database is updated to complete a stage development of the original test case.
如果缓存测试用例不通过自动回归测试,则不保存映射表格,同时恢复原测试用例,维持原数据库,进入下一轮的开发和测试。If the cache test case does not pass the automatic regression test, the map table is not saved, the original test case is restored, the original database is maintained, and the next round of development and testing is performed.
本申请实施例的有益效果是:通过建立映射表格对原测试用例进行开发,修改后通过自动回归测试,如果新测试用例优于原测试用例,则对新测试用例进行保存,同时更新数据库,反之,则恢复原测试用例,进行下一轮的开发和测试,使自动化测试用例的开发速度加快,并且提高了回归测试的效率。The beneficial effects of the embodiment of the present application are: developing the original test case by establishing a mapping table, and modifying and then passing the automatic regression test. If the new test case is superior to the original test case, the new test case is saved and the database is updated simultaneously. , restore the original test case, carry out the next round of development and testing, accelerate the development of automated test cases, and improve the efficiency of regression testing.
实施例二Embodiment 2
在实施例一中,可以对一个原测试用例生成多个可以通过自动回归测试的新测试用例,然后在数据库中建立一个子集保存这些新测试用例。In the first embodiment, a plurality of new test cases that can pass the automatic regression test can be generated for one original test case, and then a subset is established in the database to save the new test cases.
为了对这些新测试用例进行优中选优,可以对其进行贝叶斯的分类完成优 先化排序,从而实现以较少的测试用例数量更快更多地发现新版本软件缺陷的目标,提高回归测试的效率。In order to optimize these new test cases, Bayesian classification can be prioritized, so that the target of new software defects can be found more quickly and with fewer test cases, and the regression test can be improved. s efficiency.
本申请实施例的方法处理流程包含历史数据预处理、分类挖掘训练集构建、分类挖掘训练和预测、测试用例优先化排序四个模块。The method processing flow of the embodiment of the present application includes four modules of historical data preprocessing, classification mining training set construction, classification mining training and prediction, and test case prioritization.
历史数据预处理模块,负责收集和提取不同版本下测试用例执行结果,以及模块变更的历史数据,转化成后续处理所需的不同版本下测试用例执行结果数据矩阵和模块变更数据矩阵。The historical data preprocessing module is responsible for collecting and extracting test result execution results of different versions and historical data of module changes, and converting into test case execution result data matrix and module change data matrix of different versions required for subsequent processing.
分类挖掘训练集构建模块,利用不同版本下测试用例执行结果数据矩阵和模块变更数据矩阵,为每个测试用例建立分类挖掘训练时所需的训练集。The classification mining training set building module uses the test case execution result data matrix and the module change data matrix under different versions to establish a training set required for the classification mining training for each test case.
分类挖掘训练和预测模块,采用不同的分类挖掘模型,基于每个测试用例的训练集进行训练,采用训练后模型预测测试用例在新版本中的执行结果。The classification mining training and prediction module uses different classification mining models, training based on the training set of each test case, and using the post-training model to predict the execution results of the test cases in the new version.
测试用例优先化排序模块,根据预测的执行结果,对所有测试用例进行优先化排序,优先执行排在前面的测试用例。The test case prioritization sorting module prioritizes all test cases based on the predicted execution results, prioritizing the execution of the preceding test cases.
请参考图4,其示出了上述每个模块的实施步骤:Please refer to FIG. 4, which shows the implementation steps of each module described above:
数据预处理模块,包含测试数据预处理和模块变更数据预处理两个部分,即步骤S402和S403,其处理流程包括:The data preprocessing module includes two parts: test data preprocessing and module change data preprocessing, namely steps S402 and S403, and the processing flow thereof includes:
首先收集并组织各个版本下测试用例的执行结果信息。第一步先确定测试用例执行结果矩阵的版本数n和测试用例数m。令软件系统的版本数量为n,版本集合V={v1,v2,...,vn};共有m个相异的测试用例,测试用例集T={t1,t2,...,tm}。然后建立测试用例执行结果矩阵R(m,n)=[rij]m×n,其中rrj为矩阵元素,表示测试用例ti在版本vj上的执行结果。First, collect and organize the execution result information of the test cases under each version. The first step is to determine the version number n of the test case execution result matrix and the number of test cases m. Let the number of versions of the software system be n, the version set V={v1, v2,..., vn}; there are m different test cases, test case set T={t1, t2,...,tm} . Then, a test case execution result matrix R(m,n)=[rij]m×n is established, where rrj is a matrix element, indicating the execution result of the test case ti on the version vj.
rij共有三个取值:0表示测试通过;1表示测试未通过;null(空值)表示在版本vj中测试用例ti未被执行过。Rij has three values: 0 means the test passes; 1 means the test fails; null (null) means that the test case ti has not been executed in version vj.
矩阵中所有元素rij先初始化为null,然后根据测试用例ti在版本vj上的执行结果对矩阵中各元素rij进行赋值。All elements rij in the matrix are initialized to null first, and then the elements rij in the matrix are assigned according to the execution result of the test case ti on the version vj.
其中,版本变更数据预处理的流程包括:The process of pre-processing the version change data includes:
首先确定软件系统包含的模块数量,令软件系统包含l个模块(模块的划分标准根据软件系统特征和测试覆盖粒度来定义,如将Java程序的一个对象定义为一个模块),于是软件系统System={Mod1,Mod2,...,Modl}。First determine the number of modules included in the software system, so that the software system contains 1 module (the module's partitioning criteria are defined according to the software system characteristics and test coverage granularity, such as defining an object of the Java program as a module), so the software system System= {Mod1, Mod2,...,Modl}.
接下来需要确定样例版本v0。样例版本用来作为版本变更的参照标准,选取样例版本可遵循以下标准:第一样例版本应该是一个的稳定版本,功能和结构完整,第二样例版本应该包含软件系统System的所有模块,第三样例版本应该是测试用例执行出错几率最小的版本,即质量最稳定的版本。Next you need to determine the sample version v0. The sample version is used as a reference standard for version changes. The sample version can be selected to follow the following standards: The first version should be a stable version, the function and structure are complete, and the second version should contain all of the software system System. Module, the third sample version should be the version with the least chance of test case execution error, the most stable version.
基于样例版本v0,以模块为单位构建版本变更矩阵Δ(n,l)=[δjk]n×l,其中变更矩阵元素δjk表示版本vj跟样例版本v0相比较在模块Modk上是否发生变更。Based on the sample version v0, the version change matrix Δ(n,l)=[δjk]n×l is constructed in units of modules, wherein the change matrix element δjk indicates whether the version vj is changed on the module Modk compared to the sample version v0. .
δjk有两个取值:0表示版本vj跟样例版本v0相比较,在模块Modk上未发生变更;1表示版本vj在模块Modk上相对样例版本v0有变更。Δjk has two values: 0 means that the version vj is compared with the sample version v0, and no change occurs on the module Modk; 1 means that the version vj is changed on the module Modk relative to the sample version v0.
步骤S404步骤,分类挖掘训练集构建,即分类挖掘训练集构建模块,其处理流程包括:Step S404, the classification mining training set is constructed, that is, the classification mining training set building module, and the processing flow thereof comprises:
训练集构建基于模块变更跟测试用例相关联的假设:每个测试用例ti对于不同模块缺陷具有不同程度的检测能力,而新缺陷是由于新版本中某些模块中发生变更引入的;在某个模块发生变更时,一些测试用例会更敏感,即其缺陷检测能力将高于其他测试用例,于是模块变更同测试用例的执行结果具有关联性,可通过分类挖掘予以分析和测定。The training set builds the assumptions associated with the test case based on the module change: each test case ti has different degrees of detection capability for different module defects, and the new defect is introduced due to a change in some modules in the new version; When the module changes, some test cases will be more sensitive, that is, their defect detection capability will be higher than other test cases, so the module changes are related to the execution results of the test cases, which can be analyzed and determined by classification mining.
为每个测试用例构建分类挖掘训练集,给定测试用例集T中的测试用例ti,考虑执行过用例ti的每个版本vj,将版本vj中每个模块Modk的变更信息δjk和该用例ti在版本vj执行结果rij合并成一个数据向量:<δj1,δj2,...,δjn,rij>;然后将用例ti在各版本的数据向量合并成矩阵,构成用例ti的训练集Trainseti。A classification mining training set is constructed for each test case. Given the test case ti in the test case set T, considering each version vj of the use case ti, the change information δjk of each module Modk in the version vj and the use case ti The result rij is merged into a data vector in the version vj: <δj1, δj2, ..., δjn, rij>; then the use case ti is merged into a matrix in each version of the data vector to form the training set Trainseti of the use case ti.
对测试用例ti,训练集Trainseti=[Δ,Ri],是一个n’×(l+1)的矩阵。其中Δ(n’,l)取自模块变更数据矩阵Δ(n,l),不考虑未执行用例ti的版本; Ri是一个n’×1向量,是测试用例执行结果矩阵R(m,n)中第i行的转置,表示测试用例ti在n个版本中的执行结果,同样不考虑未执行用例ti的版本。For the test case ti, the training set Trainseti = [Δ, Ri] is a matrix of n' × (l + 1). Where Δ(n',l) is taken from the module change data matrix Δ(n,l), regardless of the version of the unexecuted use case ti; Ri is an n'×1 vector, which is the test case execution result matrix R(m,n) The transposition of the i-th row in the middle row indicates the execution result of the test case ti in the n versions, and the version of the unused use case ti is also not considered.
在分类挖掘中,训练集由一组记录(Record)组成,每个记录分成属性(Attribute)和类标签(Class Label),类标签对应分类结果。训练集的一行作为一个记录,前l列即l个模块的变更情况作为属性,最后一列既执行结果rij作为类标签。In classification mining, a training set consists of a set of records, each of which is divided into an attribute (Attribute) and a class label (Class Label), and the class label corresponds to the classification result. One row of the training set is used as a record. The change of the first l column, that is, the l module, is used as the attribute, and the last column is the execution result rij as the class tag.
步骤S405,训练并预测结果,即分类挖掘训练和预测模块,其处理流程包括:Step S405, training and predicting the result, that is, the classification mining training and prediction module, the processing flow of which includes:
在分类挖掘训练和预测部分选用HNB和AODE这两个贝叶斯分类模型。AODE是一种半朴素贝叶斯技术,同朴素贝叶斯技术相比,降低了属性间相互独立性要求,能够在实际应用中有效提高分类结果的准确性。HNB是另一种贝叶斯技术,结合简单贝叶斯模型和贝叶斯网络模型的优点,同时克服了简单贝叶斯模型的属性独立假设以及贝叶斯网络结构学习耗时的缺点。Two Bayesian classification models, HNB and AODE, are selected in the classification mining training and prediction part. AODE is a semi-simple Bayesian technique. Compared with the naive Bayesian technique, AODE reduces the mutual independence of attributes and can effectively improve the accuracy of classification results in practical applications. HNB is another Bayesian technique that combines the advantages of a simple Bayesian model with a Bayesian network model, while overcoming the property independent assumptions of the simple Bayesian model and the shortcomings of Bayesian network structure learning.
分别载入这两个模型并进行初始化。由于HNB不需要设置任何参数,因此在载入HNB时以默认方式初始化。对于AODE,需要设置最小频度freq,该参数为整数,表示出现至少freq次的组合予以考虑。正常情况取1即可;若训练集较大,也可适当增加freq的值,减少偶然组合的影响。Load the two models separately and initialize them. Since HNB does not need to set any parameters, it is initialized by default when loading HNB. For AODE, you need to set the minimum frequency freq, which is an integer, indicating that a combination of at least freq times occurs. Normally, 1 can be used; if the training set is large, the value of freq can be increased appropriately to reduce the influence of accidental combination.
对每个测试用例ti,载入对应的训练集Trainseti进行训练。当训练集较大时,可设置最大训练步数和最大训练时间。For each test case ti, the corresponding training set Trainseti is loaded for training. When the training set is large, the maximum number of training steps and the maximum training time can be set.
准备好新版本的模块变更信息,以训练集相同的格式要求填入检验集Testseti=[Δnew,θi]。其中新版本变更信息集合Δnew={δ1,new,δ2,new,...,δl,new},代表新版本中的模块变更向量。Prepare the new version of the module change information and fill in the test set Testseti=[Δnew,θi] with the same format requirements of the training set. The new version change information set Δnew={δ1, new, δ2, new, ..., δl, new} represents the module change vector in the new version.
将检验集代入上一个步骤训练好的分类挖掘模型,预测出测试用例ti在新版本的执行结果θi,这个值是浮点值(处于0和1之间),代表测试用例ti能够发现新版本中软件缺陷的概率。Substitute the test set into the trained classification mining model in the previous step, and predict the execution result θi of the test case ti in the new version. This value is a floating point value (between 0 and 1), which means that the test case ti can find the new version. The probability of a software defect.
综合所有测试用例的预测结果,分类挖掘训练和预测模块最终输出是一个 三元组集合Prof={<ti,θi,type>|ti∈t,0<θi≤1,1≤i≤m,type∈{HNB,AODE}},其中ti为测试用例;type是选用的分类模型;概率θi表示测试用例ti能够发现新版本软件缺陷的概率,θi越高表示测试用例ti的价值越高,越值得优先测试。Combining the prediction results of all test cases, the final output of the classification mining training and prediction module is a triple set Prof={<ti, θi, type>|ti∈t, 0<θi≤1,1≤i≤m,type ∈{HNB,AODE}}, where ti is the test case; type is the selected classification model; probability θi indicates the probability that the test case ti can find the new version of the software defect, and the higher the θi, the higher the value of the test case ti, the more worthwhile Priority test.
步骤S406,测试用例排序,即测试用例优先化排序模块,其处理流程包括:Step S406, the test case sorting, that is, the test case prioritization sorting module, the processing flow includes:
采用HNB和AODE两个贝叶斯分类挖掘模型分别预测,首先取测试用例ti对应的Prof集合中两个三元组,将其中的两个θi求和取平均值,得到测试用例ti发现新版本软件缺陷的最终预测概率pi。根据每个测试用例发现软件缺陷的最终概率pi对所有测试用例进行排序。考虑回归测试阶段的时间是有限的,令回归测试的总时间为timemax,选取在timemax内能够完成的前m’个测试用例构成最终的回归测试用例集。Two Bayesian classification mining models of HNB and AODE are used to predict respectively. First, two ternaries in the Prof set corresponding to the test case ti are taken, and the two θi sums are averaged to obtain a new version of the test case ti. The final predicted probability pi of the software defect. All test cases are sorted by finding the final probability pi of the software defect for each test case. The time to consider the regression test phase is limited. Let the total time of the regression test be timemax, and select the first m' test cases that can be completed within timemax to form the final regression test case set.
本申请实施例的有益效果是:通过对新测试用例训练集进行历史数据预处理、分类挖掘训练集构建、分类挖掘训练和预测和测试用例优先化排序的处理,对测试用例进行优选,从而实现以较少的测试用例数量更快更多地发现新版本软件缺陷的目标,加快了自动化测试用例的开发速度,提高了回归测试的效率。The beneficial effects of the embodiments of the present application are: by performing historical data preprocessing, classification mining training set construction, classification mining training, and prediction and test case prioritization sorting on the new test case training set, the test cases are optimized, thereby realizing Quickly and more discover the goal of new versions of software defects with fewer test cases, speed up the development of automated test cases, and improve the efficiency of regression testing.
实施例三Embodiment 3
请参考图5,其示出了本申请另一种实施例提供的一种自动化测试用例管理装置40,所述自动化测试用例管理装置40包括:映射表格获取模块401和自动回归测试模块402。Please refer to FIG. 5 , which illustrates an automated test case management device 40 provided by another embodiment of the present application. The automated test case management device 40 includes a mapping table obtaining module 401 and an automatic regression testing module 402 .
映射表格获取模块401,用于根据测试用例在数据库中建立映射表格,所述映射表格中的每一行为所述测试用例脚本的每一个步骤;a mapping table obtaining module 401, configured to establish a mapping table in the database according to the test case, each step of the test case script in the mapping table;
自动回归测试模块402,用于通过修改所述映射表格的行以对所述测试用例进行修改,对修改后的映射表格进行自动回归测试,判断修改后的映射表格是否通过所述自动回归测试,若通过所述自动回归测试,则保存修改后的映射表格,若不通过所述自动回归测试,则不保存修改后的映射表格。The automatic regression test module 402 is configured to modify the test case by modifying a row of the mapping table, perform an automatic regression test on the modified mapping table, and determine whether the modified mapping table passes the automatic regression test. If the automatic regression test is passed, the modified mapping table is saved, and if the automatic regression test is not passed, the modified mapping table is not saved.
具体的,自动回归测试模块402包括:Specifically, the automatic regression test module 402 includes:
对原测试用例进行备份生成备份测试用例,并根据修改后的映射表格生成缓存测试用例;Backing up the original test case to generate a backup test case, and generating a cache test case according to the modified mapping table;
对所述缓存测试用例和所述备份测试用例分别进行检查错误次数和检测时间的测试;Testing the cache test case and the backup test case separately for checking the number of errors and detecting time;
若所述缓存测试用例的检查错误次数大于所述备份测试用例且所述缓存测试用例的检测时间少于所述备份测试用例,则视为通过所述自动回归测试并保存修改后的映射表格;If the number of check errors of the cache test case is greater than the backup test case and the detection time of the cache test case is less than the backup test case, it is considered to pass the automatic regression test and save the modified mapping table;
若所述缓存测试用例的检查错误次数小于所述备份测试用例或所述缓存测试用例的检测时间大于所述备份测试用例,则视为不通过所述自动回归测试并不保存修改后的映射表格。If the number of check errors of the cache test case is less than the backup test case or the cache test case is greater than the backup test case, it is deemed not to pass the automatic regression test and does not save the modified mapping table. .
请参考图6,作为一种实施方式,所述自动化测试用例管理装置40还包括:Referring to FIG. 6, as an implementation manner, the automated test case management apparatus 40 further includes:
优先级排序模块403,用于对通过所述自动回归测试的测试用例进行优先级排序,具体的,选择贝叶斯分类HNB和AODE两个分类挖掘模型,对每个测试用例采用对应的训练集进行模型训练,根据模型预测的综合结果,对测试用例进行优先化排序。The prioritization module 403 is configured to prioritize test cases that are tested by the automatic regression test. Specifically, select two classification mining models, Bayesian classification HNB and AODE, and use corresponding training sets for each test case. Model training is performed to prioritize test cases based on the combined results of the model predictions.
上述装置中模块的具体工作过程,可以参考前述方法实施例中的对应过程,在此不再赘述。For the specific working process of the module in the foregoing device, refer to the corresponding process in the foregoing method embodiment, and details are not described herein again.
本申请实施例提供的自动化测试用例管理装置的有益效果是,通过建立映射表格对测试用例进行开发,同时开发过程中对新的测试用例进行自动回归测试,提高了自动化测试用例开发和回归测试的效率The beneficial effects of the automated test case management device provided by the embodiment of the present application are that the test case is developed by establishing a mapping table, and the automatic test of the new test case is automatically performed during the development process, thereby improving the automatic test case development and the regression test. effectiveness
本申请另一种实施例提供一个或多个存储有计算机可读指令的非易失性可读存储介质,该计算机可读指令被一个或多个处理器执行时,使得一个或多个处理器执行实现上述实施例中的自动化测试用例管理方法,为避免重复,这里不再赘述。或者,该计算机可读指令被一个或多个处理器执行时,使得一个或 多个处理器执行上述实施例中自动化测试用例管理装置中各模块/单元的功能,为避免重复,这里不再赘述。Another embodiment of the present application provides one or more non-volatile readable storage media storing computer readable instructions that, when executed by one or more processors, cause one or more processors The method for implementing the automated test case management in the above embodiments is implemented. To avoid repetition, details are not described herein again. Alternatively, when the computer readable instructions are executed by one or more processors, causing one or more processors to perform the functions of the modules/units in the automated test case management device in the above embodiments, to avoid repetition, no further details are provided herein. .
图7是本实施例中终端设备的示意图。如图7所示,终端设备60包括处理器61、存储器62以及存储在存储器62中并可在处理器61上运行的计算机可读指令63。处理器61执行计算机可读指令63时实现上述实施例中一种自动化测试用例管理方法的各个步骤,例如图1所示的步骤S10、S20和S30。或者,处理器61执行计算机可读指令63时实现上述实施例中一种自动化测试用例管理装置各模块/单元的功能,例如图6所示映射表格获取模块401、自动回归测试模块402、优先级排序模块403的功能。Fig. 7 is a schematic diagram of a terminal device in this embodiment. As shown in FIG. 7, terminal device 60 includes a processor 61, a memory 62, and computer readable instructions 63 stored in memory 62 and operative on processor 61. The processor 61 executes the computer readable instructions 63 to implement various steps of an automated test case management method of the above-described embodiments, such as steps S10, S20, and S30 shown in FIG. Alternatively, when the processor 61 executes the computer readable instructions 63, the functions of each module/unit of the automated test case management device in the above embodiments are implemented, for example, the mapping table obtaining module 401, the automatic regression testing module 402, and the priority shown in FIG. The function of the sorting module 403.
所属领域的技术人员可以清楚地了解到,为了描述的方便和简洁,仅以上述各功能单元、模块的划分进行举例说明,实际应用中,可以根据需要而将上述功能分配由不同的功能单元、模块完成,即将所述装置的内部结构划分成不同的功能单元或模块,以完成以上描述的全部或者部分功能。It will be clearly understood by those skilled in the art that, for convenience and brevity of description, only the division of each functional unit and module described above is exemplified. In practical applications, the above functions may be assigned to different functional units according to needs. The module is completed by dividing the internal structure of the device into different functional units or modules to perform all or part of the functions described above.
以上所述实施例仅用以说明本申请的技术方案,而非对其限制;尽管参照前述实施例对本申请进行了详细的说明,本领域的普通技术人员应当理解:其依然可以对前述各实施例所记载的技术方案进行修改,或者对其中部分技术特征进行等同替换;而这些修改或者替换,并不使相应技术方案的本质脱离本申请各实施例技术方案的精神和范围,均应包含在本申请的保护范围之内。The above-mentioned embodiments are only used to explain the technical solutions of the present application, and are not limited thereto; although the present application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that they can still implement the foregoing embodiments. The technical solutions described in the examples are modified or equivalently replaced with some of the technical features; and the modifications or substitutions do not deviate from the spirit and scope of the technical solutions of the embodiments of the present application, and should be included in Within the scope of protection of this application.

Claims (20)

  1. 一种自动化测试用例管理方法,其特征在于,所述自动化测试用例管理方法包括:An automated test case management method, characterized in that the automated test case management method comprises:
    根据测试用例在数据库中建立映射表格,所述映射表格中的每一行为所述测试用例脚本的每一个步骤;Establishing a mapping table in the database according to the test case, each step in the mapping table being each step of the test case script;
    通过修改所述映射表格的行以对所述测试用例进行修改,对修改后的映射表格进行自动回归测试,判断修改后的映射表格是否通过所述自动回归测试;Modifying the test case by modifying the row of the mapping table, performing an automatic regression test on the modified mapping table, and determining whether the modified mapping table passes the automatic regression test;
    若通过所述自动回归测试,则保存修改后的映射表格;If the automatic regression test is passed, the modified mapping table is saved;
    若不通过所述自动回归测试,则不保存修改后的映射表格。If the automatic regression test is not passed, the modified mapping table is not saved.
  2. 根据权利要求1所述的自动化用例管理方法,其特征在于,通过修改所述映射表格的行以对所述测试用例进行修改,包括:The automated use case management method according to claim 1, wherein the modification of the test case is performed by modifying a row of the mapping table, including:
    对原测试用例进行备份生成备份测试用例,并根据修改后的映射表格生成缓存测试用例。Back up the original test case to generate a backup test case, and generate a cache test case based on the modified map form.
  3. 根据权利要求2所述的自动化用例管理方法,其特征在于,对修改后的映射表格进行自动回归测试,若通过所述自动回归测试,则保存修改后的映射表格;若不通过所述自动回归测试,则不保存修改后的映射表格,包括:The automated use case management method according to claim 2, wherein the modified mapping table is subjected to an automatic regression test, and if the automatic regression test is passed, the modified mapping table is saved; if the automatic regression is not passed Test, the modified mapping table is not saved, including:
    对所述缓存测试用例和所述备份测试用例分别进行检查错误次数和检测时间的测试;Testing the cache test case and the backup test case separately for checking the number of errors and detecting time;
    若所述缓存测试用例的检查错误次数大于所述备份测试用例且所述缓存测试用例的检测时间少于所述备份测试用例,则视为通过所述自动回归测试并保存修改后的映射表格;If the number of check errors of the cache test case is greater than the backup test case and the detection time of the cache test case is less than the backup test case, it is considered to pass the automatic regression test and save the modified mapping table;
    若所述缓存测试用例的检查错误次数小于所述备份测试用例或所述缓存测试用例的检测时间大于所述备份测试用例,则视为不通过所述自动回归测试并不保存修改后的映射表格。If the number of check errors of the cache test case is less than the backup test case or the cache test case is greater than the backup test case, it is deemed not to pass the automatic regression test and does not save the modified mapping table. .
  4. 根据权利要求3所述的自动化用例管理方法,其特征在于,在所述若所 述缓存测试用例的检查错误次数大于所述备份测试用例且所述缓存测试用例的检测时间少于所述备份测试用例,则视为通过所述自动回归测试并保存修改后的映射表格的步骤之后,所述自动化用例管理方法还包括:The automated use case management method according to claim 3, wherein the number of check errors in the cache test case is greater than the backup test case and the detection time of the cache test case is less than the backup test The use case is regarded as the step of testing and saving the modified mapping table by the automatic regression test, and the automatic use case management method further includes:
    对通过所述自动回归测试的测试用例进行优先级排序。The test cases passed the automatic regression test are prioritized.
  5. 根据权利要求4所述的自动化用例管理方法,其特征在于,所述对通过所述自动回归测试的测试用例进行优先级排序,包括:The automated use case management method according to claim 4, wherein the prioritizing the test cases by the automatic regression test comprises:
    选择贝叶斯分类HNB和AODE两个分类挖掘模型,对每个测试用例采用对应的训练集进行模型训练,根据模型预测的综合结果对测试用例进行优先化排序。Bayesian classification HNB and AODE two classification mining models are selected. Each test case is trained by using the corresponding training set, and the test cases are prioritized according to the comprehensive results predicted by the model.
  6. 一种自动化测试用例管理装置,其特征在于,所述自动化测试用例管理装置包括:An automated test case management device, wherein the automated test case management device comprises:
    映射表格获取模块,用于根据测试用例在数据库中建立映射表格,所述映射表格中的每一行为所述测试用例脚本的每一个步骤;a mapping table obtaining module, configured to establish a mapping table in the database according to the test case, each action in the mapping table is performed in each step of the test case script;
    自动回归测试模块,用于通过修改所述映射表格的行以对所述测试用例进行修改,对修改后的映射表格进行自动回归测试,判断修改后的映射表格是否通过所述自动回归测试,若通过所述自动回归测试,则保存修改后的映射表格,若不通过所述自动回归测试,则不保存修改后的映射表格。An automatic regression test module, configured to modify the test case by modifying a row of the mapping table, perform an automatic regression test on the modified mapping table, and determine whether the modified mapping table passes the automatic regression test, if Through the automatic regression test, the modified mapping table is saved, and if the automatic regression test is not passed, the modified mapping table is not saved.
  7. 如权利要求6所述的自动化测试用例管理装置,其特征在于,所述自动回归测试模块还用于:The automated test case management apparatus according to claim 6, wherein the automatic regression test module is further configured to:
    对原测试用例进行备份生成备份测试用例,并根据修改后的映射表格生成缓存测试用例。Back up the original test case to generate a backup test case, and generate a cache test case based on the modified map form.
  8. 如权利要求7所述的自动化测试用例管理装置,其特征在于,所述自动回归测试模块还用于:The automated test case management apparatus according to claim 7, wherein the automatic regression test module is further configured to:
    对所述缓存测试用例和所述备份测试用例分别进行检查错误次数和检测时间的测试;Testing the cache test case and the backup test case separately for checking the number of errors and detecting time;
    若所述缓存测试用例的检查错误次数大于所述备份测试用例且所述缓存测试用例的检测时间少于所述备份测试用例,则视为通过所述自动回归测试并保 存修改后的映射表格;If the number of check errors of the cache test case is greater than the backup test case and the detection time of the cache test case is less than the backup test case, it is deemed to pass the automatic regression test and save the modified mapping table;
    若所述缓存测试用例的检查错误次数小于所述备份测试用例或所述缓存测试用例的检测时间大于所述备份测试用例,则视为不通过所述自动回归测试并不保存修改后的映射表格。If the number of check errors of the cache test case is less than the backup test case or the cache test case is greater than the backup test case, it is deemed not to pass the automatic regression test and does not save the modified mapping table. .
  9. 如权利要求8所述的自动化测试用例管理装置,其特征在于,所述自动化测试用例管理装置还包括优先级排序模块;The automated test case management apparatus according to claim 8, wherein said automated test case management device further comprises a prioritization module;
    所述优先级排序模块,用于对通过所述自动回归测试的测试用例进行优先级排序。The prioritization module is configured to prioritize test cases that pass the automatic regression test.
  10. 如权利要求9所述的自动化测试用例管理装置,其特征在于,所述优先级排序模块还用于:The automated test case management apparatus according to claim 9, wherein the prioritization module is further configured to:
    选择贝叶斯分类HNB和AODE两个分类挖掘模型,对每个测试用例采用对应的训练集进行模型训练,根据模型预测的综合结果对测试用例进行优先化排序。Bayesian classification HNB and AODE two classification mining models are selected. Each test case is trained by using the corresponding training set, and the test cases are prioritized according to the comprehensive results predicted by the model.
  11. 一种终端设备,包括存储器、处理器以及存储在所述存储器中并可在所述处理器上运行的计算机可读指令,其特征在于,所述处理器执行所述计算机可读指令时实现如下步骤:A terminal device comprising a memory, a processor, and computer readable instructions stored in the memory and operable on the processor, wherein the processor executes the computer readable instructions as follows step:
    根据测试用例在数据库中建立映射表格,所述映射表格中的每一行为所述测试用例脚本的每一个步骤;Establishing a mapping table in the database according to the test case, each step in the mapping table being each step of the test case script;
    通过修改所述映射表格的行以对所述测试用例进行修改,对修改后的映射表格进行自动回归测试,判断修改后的映射表格是否通过所述自动回归测试;Modifying the test case by modifying the row of the mapping table, performing an automatic regression test on the modified mapping table, and determining whether the modified mapping table passes the automatic regression test;
    若通过所述自动回归测试,则保存修改后的映射表格;If the automatic regression test is passed, the modified mapping table is saved;
    若不通过所述自动回归测试,则不保存修改后的映射表格。If the automatic regression test is not passed, the modified mapping table is not saved.
  12. 如权利要求11所述的终端设备,其特征在于,所述通过修改所述映射表格的行以对所述测试用例进行修改,包括:The terminal device according to claim 11, wherein the modifying the test case by modifying a row of the mapping table comprises:
    对原测试用例进行备份生成备份测试用例,并根据修改后的映射表格生成缓存测试用例。Back up the original test case to generate a backup test case, and generate a cache test case based on the modified map form.
  13. 如权利要求12所述的终端设备,其特征在于,所述对修改后的映射表 格进行自动回归测试,若通过所述自动回归测试,则保存修改后的映射表格;若不通过所述自动回归测试,则不保存修改后的映射表格,包括:The terminal device according to claim 12, wherein the modified mapping table is subjected to an automatic regression test, and if the automatic regression test is performed, the modified mapping table is saved; if the automatic regression is not passed Test, the modified mapping table is not saved, including:
    对所述缓存测试用例和所述备份测试用例分别进行检查错误次数和检测时间的测试;Testing the cache test case and the backup test case separately for checking the number of errors and detecting time;
    若所述缓存测试用例的检查错误次数大于所述备份测试用例且所述缓存测试用例的检测时间少于所述备份测试用例,则视为通过所述自动回归测试并保存修改后的映射表格;If the number of check errors of the cache test case is greater than the backup test case and the detection time of the cache test case is less than the backup test case, it is considered to pass the automatic regression test and save the modified mapping table;
    若所述缓存测试用例的检查错误次数小于所述备份测试用例或所述缓存测试用例的检测时间大于所述备份测试用例,则视为不通过所述自动回归测试并不保存修改后的映射表格。If the number of check errors of the cache test case is less than the backup test case or the cache test case is greater than the backup test case, it is deemed not to pass the automatic regression test and does not save the modified mapping table. .
  14. 如权利要求13所述的终端设备,其特征在于,在所述若所述缓存测试用例的检查错误次数大于所述备份测试用例且所述缓存测试用例的检测时间少于所述备份测试用例,则视为通过所述自动回归测试并保存修改后的映射表格步骤之后,所述处理器执行所述计算机可读指令时还实现如下步骤:The terminal device according to claim 13, wherein in the case that the number of check errors of the cache test case is greater than the backup test case and the detection time of the cache test case is less than the backup test case, After the step of performing the automatic regression test and saving the modified mapping table, the processor further implements the following steps when the computer readable instructions are executed:
    对通过所述自动回归测试的测试用例进行优先级排序。The test cases passed the automatic regression test are prioritized.
  15. 如权利要求14所述的终端设备,其特征在于,所述对通过所述自动回归测试的测试用例进行优先级排序,包括:The terminal device according to claim 14, wherein said prioritizing test cases by said automatic regression test comprises:
    选择贝叶斯分类HNB和AODE两个分类挖掘模型,对每个测试用例采用对应的训练集进行模型训练,根据模型预测的综合结果对测试用例进行优先化排序。Bayesian classification HNB and AODE two classification mining models are selected. Each test case is trained by using the corresponding training set, and the test cases are prioritized according to the comprehensive results predicted by the model.
  16. 一个或多个存储有计算机可读指令的非易失性可读存储介质,其特征在于,所述计算机可读指令被一个或多个处理器执行时,使得所述一个或多个处理器执行如下步骤:One or more non-transitory readable storage mediums storing computer readable instructions, wherein when the computer readable instructions are executed by one or more processors, cause the one or more processors to execute The following steps:
    根据测试用例在数据库中建立映射表格,所述映射表格中的每一行为所述测试用例脚本的每一个步骤;Establishing a mapping table in the database according to the test case, each step in the mapping table being each step of the test case script;
    通过修改所述映射表格的行以对所述测试用例进行修改,对修改后的映射表格进行自动回归测试,判断修改后的映射表格是否通过所述自动回归测试;Modifying the test case by modifying the row of the mapping table, performing an automatic regression test on the modified mapping table, and determining whether the modified mapping table passes the automatic regression test;
    若通过所述自动回归测试,则保存修改后的映射表格;If the automatic regression test is passed, the modified mapping table is saved;
    若不通过所述自动回归测试,则不保存修改后的映射表格。If the automatic regression test is not passed, the modified mapping table is not saved.
  17. 如权利要求16所述的非易失性可读存储介质,其特征在于,所述通过修改所述映射表格的行以对所述测试用例进行修改,包括:The non-volatile readable storage medium of claim 16, wherein the modifying the test case by modifying a row of the mapping table comprises:
    对原测试用例进行备份生成备份测试用例,并根据修改后的映射表格生成缓存测试用例。Back up the original test case to generate a backup test case, and generate a cache test case based on the modified map form.
  18. 如权利要求17所述的非易失性可读存储介质,其特征在于,所述对修改后的映射表格进行自动回归测试,若通过所述自动回归测试,则保存修改后的映射表格;若不通过所述自动回归测试,则不保存修改后的映射表格,包括:The non-volatile readable storage medium of claim 17, wherein the modified mapping table is subjected to an automatic regression test, and if the automatic regression test is performed, the modified mapping table is saved; If the automatic regression test is not passed, the modified mapping table is not saved, including:
    对所述缓存测试用例和所述备份测试用例分别进行检查错误次数和检测时间的测试;Testing the cache test case and the backup test case separately for checking the number of errors and detecting time;
    若所述缓存测试用例的检查错误次数大于所述备份测试用例且所述缓存测试用例的检测时间少于所述备份测试用例,则视为通过所述自动回归测试并保存修改后的映射表格;If the number of check errors of the cache test case is greater than the backup test case and the detection time of the cache test case is less than the backup test case, it is considered to pass the automatic regression test and save the modified mapping table;
    若所述缓存测试用例的检查错误次数小于所述备份测试用例或所述缓存测试用例的检测时间大于所述备份测试用例,则视为不通过所述自动回归测试并不保存修改后的映射表格。If the number of check errors of the cache test case is less than the backup test case or the cache test case is greater than the backup test case, it is deemed not to pass the automatic regression test and does not save the modified mapping table. .
  19. 如权利要求18所述的非易失性可读存储介质,其特征在于,在所述若所述缓存测试用例的检查错误次数大于所述备份测试用例且所述缓存测试用例的检测时间少于所述备份测试用例,则视为通过所述自动回归测试并保存修改后的映射表格步骤之后,所述计算机可读指令被一个或多个处理器执行时,使得所述一个或多个处理器还执行如下步骤:The non-volatile readable storage medium according to claim 18, wherein said detection time of said cache test case is greater than said backup test case and said cache test case has a detection time less than The backup test case is considered to be caused by the automatic regression test and after saving the modified mapping table step, the computer readable instructions being executed by one or more processors, such that the one or more processors Also perform the following steps:
    对通过所述自动回归测试的测试用例进行优先级排序。The test cases passed the automatic regression test are prioritized.
  20. 如权利要求19所述的非易失性可读存储介质,其特征在于,所述对通过所述自动回归测试的测试用例进行优先级排序,包括:The non-volatile readable storage medium of claim 19, wherein the prioritizing the test cases passed the automatic regression test comprises:
    选择贝叶斯分类HNB和AODE两个分类挖掘模型,对每个测试用例采用对应 的训练集进行模型训练,根据模型预测的综合结果对测试用例进行优先化排序。Bayesian classification HNB and AODE two classification mining models are selected. Each test case is trained by using the corresponding training set, and the test cases are prioritized according to the comprehensive results predicted by the model.
PCT/CN2018/080432 2017-09-21 2018-03-26 Automated test case management method and apparatus, device, and storage medium WO2019056720A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201710857308.1A CN108268373A (en) 2017-09-21 2017-09-21 Automatic test cases management method, device, equipment and storage medium
CN201710857308.1 2017-09-21

Publications (1)

Publication Number Publication Date
WO2019056720A1 true WO2019056720A1 (en) 2019-03-28

Family

ID=62771788

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2018/080432 WO2019056720A1 (en) 2017-09-21 2018-03-26 Automated test case management method and apparatus, device, and storage medium

Country Status (2)

Country Link
CN (1) CN108268373A (en)
WO (1) WO2019056720A1 (en)

Families Citing this family (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110737573B (en) * 2018-07-18 2023-02-17 北京奇虎科技有限公司 Method and device for automatically testing user interface UI
CN109165170B (en) * 2018-10-16 2022-03-11 杭州安恒信息技术股份有限公司 Method and system for automatic request test
CN109582578B (en) * 2018-11-29 2022-04-05 泰康保险集团股份有限公司 System, method, computer readable medium and electronic device for software test case
CN112256555A (en) * 2020-09-11 2021-01-22 上海汇付数据服务有限公司 Automatic test case management system and test case execution state conversion method
CN112148614B (en) * 2020-09-29 2024-04-16 中国银行股份有限公司 Regression testing method and device
CN112181835B (en) * 2020-09-29 2024-04-26 中国平安人寿保险股份有限公司 Automatic test method, device, computer equipment and storage medium
CN112363928B (en) * 2020-11-10 2023-08-22 网易(杭州)网络有限公司 Processing method and device of test case, processor and electronic device
CN112527655B (en) * 2020-12-16 2024-06-25 平安银行股份有限公司 Software version quality abnormality detection method and device, electronic equipment and storage medium
CN112860492B (en) * 2021-03-29 2024-03-26 中信银行股份有限公司 Automatic regression testing method and system suitable for core system

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN201402459Y (en) * 2008-12-25 2010-02-10 深圳市同洲电子股份有限公司 Test case management device
CN101908020A (en) * 2010-08-27 2010-12-08 南京大学 Method for prioritizing test cases based on classified excavation and version change
CN102156784A (en) * 2011-04-18 2011-08-17 烽火通信科技股份有限公司 Verifying environment patterned chip verifying method and device
CN104156342A (en) * 2014-08-01 2014-11-19 福建星网视易信息系统有限公司 Method and device for converting Excel format testing case into XML (extensive markup language) format
US9009538B2 (en) * 2011-12-08 2015-04-14 International Business Machines Corporation Analysis of tests of software programs based on classification of failed test cases
CN104820636A (en) * 2015-04-09 2015-08-05 北京轩宇信息技术有限公司 Ant colony algorithm based parallel test case sequence generation method

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102567193B (en) * 2010-12-09 2015-02-11 北京新媒传信科技有限公司 Method and system for converting test case to automated testing script
CN103631590B (en) * 2013-11-29 2017-04-05 广东明创软件科技有限公司 The edit methods of automatic test script
CN106598869A (en) * 2016-12-26 2017-04-26 北京京东金融科技控股有限公司 Method and device for realizing automatic software testing and electronic equipment

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN201402459Y (en) * 2008-12-25 2010-02-10 深圳市同洲电子股份有限公司 Test case management device
CN101908020A (en) * 2010-08-27 2010-12-08 南京大学 Method for prioritizing test cases based on classified excavation and version change
CN102156784A (en) * 2011-04-18 2011-08-17 烽火通信科技股份有限公司 Verifying environment patterned chip verifying method and device
US9009538B2 (en) * 2011-12-08 2015-04-14 International Business Machines Corporation Analysis of tests of software programs based on classification of failed test cases
CN104156342A (en) * 2014-08-01 2014-11-19 福建星网视易信息系统有限公司 Method and device for converting Excel format testing case into XML (extensive markup language) format
CN104820636A (en) * 2015-04-09 2015-08-05 北京轩宇信息技术有限公司 Ant colony algorithm based parallel test case sequence generation method

Also Published As

Publication number Publication date
CN108268373A (en) 2018-07-10

Similar Documents

Publication Publication Date Title
WO2019056720A1 (en) Automated test case management method and apparatus, device, and storage medium
US20190108001A1 (en) Correction of code errors using machine learning
CN107506300B (en) User interface testing method, device, server and storage medium
US20180239692A1 (en) Electronic technology resource evaluation system
US10089109B2 (en) System and method for evaluating human resources in a software development environment
WO2020151344A1 (en) Software development and testing method for sub-iterations and related devices
US9483384B2 (en) Generation of software test code
US8856749B2 (en) Multi-path brokered test automation execution
CN107451062B (en) User interface traversal test method, device, server and storage medium
US20210263837A1 (en) Real time fault localization using combinatorial test design techniques and test case priority selection
CN111897727A (en) Software testing method and device, computer equipment and storage medium
CN105279092A (en) Software testing method and apparatus
CN111198811A (en) Page automatic test method and device, electronic equipment and storage medium
CN113505895A (en) Machine learning engine service system, model training method and configuration method
CN112379913B (en) Software optimization method, device, equipment and storage medium based on risk identification
US20210026756A1 (en) Deriving software application dependency trees for white-box testing
CN113535577B (en) Application testing method and device based on knowledge graph, electronic equipment and medium
US12001823B2 (en) Systems and methods for building and deploying machine learning applications
CN114764296A (en) Machine learning model training method and device, electronic equipment and storage medium
CN107092671B (en) Method and equipment for managing meta information
CN113094095B (en) Agile development progress determining method and device
CN115033434A (en) Kernel performance theoretical value calculation method and device and storage medium
JP2023000907A (en) Source code correction support device and source code correction support method
US20210263838A1 (en) Assignment of test case priorities based on combinatorial test design model analysis
CN116149978A (en) Service interface testing method and device, electronic equipment and storage medium

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 18858460

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 23.09.2020)

122 Ep: pct application non-entry in european phase

Ref document number: 18858460

Country of ref document: EP

Kind code of ref document: A1