CN102214139A - Automatic test performance control and debugging method facing distributed system - Google Patents
Automatic test performance control and debugging method facing distributed system Download PDFInfo
- Publication number
- CN102214139A CN102214139A CN2011101464476A CN201110146447A CN102214139A CN 102214139 A CN102214139 A CN 102214139A CN 2011101464476 A CN2011101464476 A CN 2011101464476A CN 201110146447 A CN201110146447 A CN 201110146447A CN 102214139 A CN102214139 A CN 102214139A
- Authority
- CN
- China
- Prior art keywords
- test
- test case
- execution
- case
- resources
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Landscapes
- Debugging And Monitoring (AREA)
Abstract
The invention aims at a test of a function test case and provides an automatic test performance control and debugging method facing a distributed system. The method comprises the following steps of: classifying a large quantity of test cases in a newly established test task according to priority levels at first; then performing the test cases in the same priority level sequentially according to the priority levels from high to low; grouping the test cases in the same priority level according to the types of performing nodes of the test cases; and performing the groups of test cases in parallel, wherein each performing node performs the test cases in the group in parallel until all the test cases in the group are performed. By the method, a large quantity of test cases are automatically performed on the distributed system under test; furthermore, the total performing time is shortened and the resource average utilization rate of the system under test is increased.
Description
Technical field
The invention belongs to the software automated testing field, specifically is a kind of execution control and dispatching method towards the distributed system automatic test.
Background technology
In recent years, software size constantly enlarges, and complexity constantly increases, and software quality and reliability are subjected to increasing attention.At present, software testing technology is direct, the most effective means that guarantee software quality.But for safe harshness softwares such as some Aerospace Control softwares, Large-size Arms and Equipments softwares, because its size of code is generally 1,000,000 line number magnitudes, systemic-function is very complicated, therefore test case quantity is huge, test job is very consuming time, and can carry out repeatedly regression test for the system software of the above-mentioned type, only rely on the manual testing can expend too many human and material resources.Because use-case designs fully in the regression test, the result of test expectation also can expect fully, this just makes and replaces manually-operated by software, finishes the input to tested system, and the software automated testing that output is tested is become possibility.If regression test is moved automatically, can allow the tester from the test activity of loaded down with trivial details and repetition, free, improve testing efficiency, shorten the regression test time.
Though automatic test is more faster than the manual testing, when test case quantity is huge, carry out once complete test sometimes even will spend time a couple of days, cause test period long.Therefore in the robotization implementation to the substantive test use-case, utilizing a kind of rational test case operation dispatching method, is very necessary with the further shortening test duration.Because execution time the unknown of test case, and the partial test use-case needs a plurality of main frames when carrying out simultaneously, so common method for scheduling task is inapplicable to the operation dispatching of test case, simultaneously because the difference of system under test (SUT), be difficult to find out a kind of general, high-efficiency automatic test execution dispatching method.
The present invention is directed to following distributed system: the network topology structure of system is fixed, and has the multiclass XM in the system, and each class comprises a plurality of XM again, is isomorphism between the of a sort XM, is isomery between the inhomogeneity XM.Each test case at this distributed system design is all only carried out on a class XM of appointment, but may or carry out on a plurality of XM simultaneously in single XM.Because between the of a sort XM is isomorphism, implementation effect equivalence on these test cases any one in a class XM of determining, therefore the XM of test case is unfixed, should they be distributed on the different XM according to certain strategy when carrying out these test cases and carry out.Test case robotization on the main frame of disposing tested software is carried out, and this main frame is called the XM of test case.
Execution at the substantive test use-case of above-mentioned distributed system, simple relying on used automated test tool, can not realize robotization fully, also have a lot of steps to need manual or finish by automated test frame such as STAF, when such as implementation of test cases, be assigned to and carry out on the tested main frame of any platform etc.In existing technology, no matter finish or automated test frame by manual, choosing of the execution sequence of test case and test case XM all must be that the tester manually sets, so not only increased tester's workload, if the execution sequence to test case is misorient, perhaps the XM of test case is chosen improperly, following problem can occur:
(1) the partial test use-case may just begin to carry out after tested software is just finished initialization, when carrying out, need use the partial test use-case execution result of other test case, if the unreasonable meeting of the execution sequence between test case causes the part use-case can't not carry out because of executive condition does not satisfy;
(2) improper if the XM of test case is chosen, can cause the test case executed on the part XM to finish, still carry out long test case of single execution time on the part XM in addition, thereby increasing total execution time of all test cases.
(3) improper if the XM of test case is chosen, can cause on the part XM no use-case to be carried out promptly being in the idle time longer, cause the utilization factor of test resource not high.
Summary of the invention
The present invention is directed to the needs that exist in the automatic test of above-mentioned distributed system and manually set the execution sequence of test case and the problem of test case XM, a kind of execution control and dispatching method of the automatic test towards distributed system are provided, have been primarily aimed at the test of functional test use-case.
The execution control and the dispatching method of a kind of automatic test towards distributed system of the present invention specifically may further comprise the steps:
Step 3, get all the highest test cases of unenforced test case chained list medium priority, divide into groups according to the XM classification, the test case that to carry out on same class XM is divided into one group, and each is organized test case and carries out on the XM of corresponding classification concurrently.
Step 4, judge whether to execute all test cases, if not, change step 3 and carry out, if, execution in step five.
The execution priority of the test case described in the step 1 is exactly the priority value of the test case classification that is divided into of this test case.The classification of described test case comprises 6 classes, be followed successively by from high to low according to priority: just entered the test case of carrying out under the original state at system under test (SUT), carry out the test case of adding operation, the test case of operation is checked in execution, the test case of executive editor's operation is carried out the test case of deletion action and is carried out the test case of operation of resetting.
The test case of respectively organizing described in the step 3 is carried out on the XM of corresponding classification concurrently, concrete each group test case implementation is: (1) to all test cases in this group earlier as required XM numbers from how to few rank order, again to having the test case of identical XM number, at first will all be the test case carried out for the first time to come all expection execution time be not before 0 the test case, be not that 0 test case is according to the expection rank order of execution time from growing to lacking to all expection execution time then; For having identical XM number and all being the test case of carrying out for the first time, the relative order between them is at random; (2) whether the executive condition of judging unenforced test case successively satisfies, if satisfy,, and carry out this test case for this test case is distributed XM and carried out the extra resource that needs, judge next test case then, then directly do not judge next test case if do not satisfy; Repeating in the XM of this judgement leisureless corresponding classification in system under test (SUT) or this group all test cases has all judged and has finished; (3) monitor the executing state of all test cases of carrying out,, judge in this group test case whether unenforced test case is arranged, carry out if go to (2), if do not carry out next step if monitoring any one test case is finished; (4) wait for that current all test cases of carrying out are finished, the expection execution time of all test cases was preserved the execution result of test case in more should organizing in the new database.
Advantage of the present invention and good effect are:
(1) the present invention has realized the execution control and scheduling to test case, by the order implementation of test cases that according to priority reduces, has reduced in the test case and has not satisfied the possibility that causes test case to carry out because of executive condition; Its execution sequence is sorted by node number, the expection execution time of carrying out needs according to test case, reduced because of the last possibility of carrying out the total execution time that increases many test cases of long test case of single execution time, reduced total execution time of a plurality of test cases.
(2) use test use-case operation dispatching method of the present invention is distributed to test case on all XM and carries out, and has reduced XM and has been in the time of idle condition, thereby improved the average utilization of system resource.
(3) the present invention carries out the implementation of test cases of control agent startup automated test tool by the control of automatic test control end, realized the robotization execution of distributed software system test case, the tester submits to test assignment to need not to participate in afterwards the implementation of test case, has simplified tester's work.
Description of drawings
Fig. 1 is the execution control of automatic test of the present invention and the overall flow figure of dispatching method;
Fig. 2 is that one group of test case of same priority of the present invention is carried out control and scheduling flow figure;
Fig. 3 is a single test case flowchart of the present invention;
Fig. 4 is a test assignment file synoptic diagram of the present invention.
Embodiment
The present invention is described in further detail below in conjunction with drawings and Examples.
The test case of a kind of distributed automatization test of the present invention is carried out control and dispatching method, as shown in Figure 1, is made up of following steps:
Step 1: the tester in the page that adds test case, imports the essential information of all test cases of this test assignment then in the newly-built test assignment of automatic test control end.
Described automatic test control end be deployed in the system under test (SUT) separate host in, the approach that provides the tester to submit test assignment to, and be responsible for to realize execution control and scheduling to test case.
Described test case is that the tester writes software programming by the test case of standard and obtains, and then write or record the script file of test case correspondence by existing automated test tool, test case and corresponding script file have all been deposited in the database, can be obtained by the numbering inquiry of test case.Database is also stored the information such as execution result of all test cases in this test assignment except the script file of storage test case and correspondence.
Described test assignment is made up of a plurality of test cases, the essential information that only comprises each test case in the test assignment, the essential information of each test case comprises: the numbering of test case, the expection execution time of test case, the execution priority of test case, test case is carried out needed XM classification and XM number, other resources that need when test case is carried out.The tester is the above information of input test use-case on the automatic test control end, has promptly realized test case is added in the test assignment.
The expection execution time of described test case is to predict according to the time of carrying out before this test case, because automatic test is mainly used in the regression test, this moment environment of system under test (SUT) and software version basic fixed, therefore each time of carrying out of test case also more stable, predict that this execution time is more accurately according to the execution time before this test case.The information of the expection execution time of described test case by corresponding test case in the accessing database obtains.If test case is to carry out for the first time, it is 0 that its expection execution time then is set.
The expection execution time of concrete test case is obtained by following formula:
Wherein, ET
n, ET
N-1The n time and the expection execution time of (n-1) inferior execution representing test case respectively, RT
N-1, RT
1Represent respectively (n-1) of test case inferior with the actual execution time of carrying out for the 1st time, carry out the first time of test case expection execution time ET
1Be 0.
The execution priority of described test case can define according to the action in the main operational steps of test case.Generally speaking, the test case of system under test (SUT) can be divided into following a few class according to the action in its main operational steps: just entered the test case of carrying out under the original state at system under test (SUT), carry out the test case of adding operation, the test case of operation is checked in execution, the test case of executive editor's operation, carry out the test case of deletion action and carry out the test case of (reset) operation of resetting, the priority of each class testing use-case is identical, more than the priority value of all kinds of test cases be respectively: 200,300,400,500,600,700, it is low more to be worth big more expression priority.The user is when adding test case in test assignment, the classification according under the selected test case of the action in the main operational steps of test case can obtain the execution priority of this test case.When test case can be divided into the multiclass test case according to the action in the main operational steps, it should be chosen to be the minimum class testing use-case of multiclass test case medium priority.
XM classification that described test case is required and XM number have illustrated the number of the idle XM of the specified class that this test case need take when carrying out.In the software automated testing, each XM is taken up an official post and one constantly can only be carried out a test case at most, so XM has only two kinds of user modes: idle and busy, if having test case to carry out on the XM, then user mode is for busy, if be not the free time.
Other resources that need when described test case is carried out refer to also may need the test resource that uses except XM when test case is carried out, these test resources may be the test resources of entity, as certain equipment, also may be certain virtual resource, as identity of the user of system under test (SUT) etc.The information of these resources that need when test case is carried out can be used for explaining the execution mutex relation between the test case, for example if exist two test cases all need carry out with the identity of " administrator ", but arbitrary moment only allows to exist the user of " administrator " identity in the system under test (SUT), just can be expressed as: these two test cases are carried out other resource names that need and are " administrator ", this number of resources that needs is 1, but only there is 1 " administrator " resource in the system under test (SUT), then these two test cases can not be carried out simultaneously, promptly exist between these two test cases and carry out mutex relation.
Step 2: the automatic test control end is the information of each test case in the read test task successively, adds test case in unenforced test case chained list.Test assignment can be with the formal description of XML file, and this XML file is to add in the process of test case the user to be generated by the automatic test control end.
Illustrate robotization of the present invention below and carry out control and dispatching method.The ID of this test assignment is 100, and test assignment is made up of 8 test cases, and the ID of test case is 1001～1008, and wherein preceding 7 test cases are all carried out on the category-A XM, and use-case 1008 is carried out on the category-B XM.Test case the 1001, the 1002nd, the test case of carrying out under the system initialization state, test case 1003～1008 belong to carries out the test case of adding operation.The expection execution time of test case 1001 is 5s, and the XM number that needs is 1; Test case 1002 is to carry out for the first time, and the XM number that needs is 1; The expection execution time of test case 1003 is 15s, and the XM number that needs is 3; The expection execution time of test case 1004 is 15s, and the XM number that needs is 1; Test case 1005 is to carry out for the first time, and the XM number that needs is 2; Test case 1006 is to carry out for the first time, and the XM number that needs is 1; The expection execution time of test case 1007 is 5s, and the XM number that needs is 1; Test case 1008 is to carry out for the first time, and the category-B XM number that needs is 1.
The XML file description form of test assignment as shown in Figure 4, the implication of each element is as follows in the file:
(1)＜and task〉element: be root element, represent a test assignment, an attribute " id " is arranged, be used in this test assignment of the unique retrieval of database.＜task〉element comprises 2 daughter element:＜resources element and＜uces element, these 2 elements are formed the second layer label of this XML.
(2)＜resources element: represent the test resource information that will use in this test assignment implementation to contain two daughter element:＜nodes element and＜other_resources element, all are the 3rd layer of label of this XML.
(3)＜and uces〉element: represent all test case information that this test assignment comprises, this element contains one or more daughter element＜uc 〉,＜uc〉element is the 3rd layer of label of this XML.
(4)＜and nodes〉element: represent the XM information that this test assignment can be used, comprise one or more daughter element＜node,＜node〉element is the 4th layer of label of this XML.
(5)＜and other_resources〉element: represent the information of other test resources that this test assignment will be used, comprise 0 or a plurality of daughter element＜resource,＜resource〉element is the 4th layer of label of this XML.
(6)＜and node〉element: represent an XM, this yuan have 2 attributes, and attribute " category " is used to represent the classification under this XM, and attribute " ip " is used to represent the ip address of this XM.Hypothesis can be carried out this test assignment in the embodiment of the invention on 3 category-A nodes and 1 category-B node, so 4＜node is arranged〉element.
(7)＜and resource〉element: represent certain other test resources, 2 attributes " name " and " num " are arranged, represent the number of the title and the resource of this resource respectively.In embodiments of the present invention, a kind of other test resources are only arranged, be virtual resource, represent a kind of " administrator " identity, supposing that system under test (SUT) can only be carried out at any one time is no more than 1 the test case of carrying out with " administrator " identity, and then " num " property value of this resource is 1.
(8)＜and uc〉element: represent a test case, an attribute " id " is arranged, be used in this test case of the unique retrieval of database, this value is exactly the numbering of described test case.＜uc〉element comprises 3 daughter element:＜time element,＜priority element and＜uc_resources element, these elements are the 4th layer of labels of this XML.
(9)＜and time〉element: the expection execution time of expression test case is to predict according to the execution time before the test case; If test case is to carry out for the first time, then do not predict this execution time, at this moment＜and time〉value of element is 0.
(10)＜and priority〉element: the execution priority of expression test case, value herein are that the classification according to user's selected test case when writing use-case generates, the corresponding priority value of a class testing use-case, it is low more to be worth big more expression priority.
(11)＜and uc_resources〉element: the test resource that the expression test case needs when carrying out comprises one＜uc_node〉element and 0 or a plurality of＜uc_other_resource〉element, these elements are formed the layer 5 label of this XML.
(12)＜and uc_node〉element: the expression test case is carried out the XM information that needs, this yuan have 2 attributes, attribute " category " is represented the classification of the XM of this test case, and attribute " num " expression use-case is carried out the number of such required XM.
(13)＜and uc_other_resource〉element: other resource informations of representing these test case execution needs.Need other resource when having only use-case 1004 and use-case 1006 to carry out in the embodiment of the invention, resource name is " administrator ", and number of resources is 1.
Step 3: get not all the highest test cases of implementation of test cases chained list medium priority, to of the classification grouping of these test cases according to XM, the test case of carrying out on same category node is formed one group, not test case executed in parallel on different classes of node on the same group.
Test case execution flow process of executed in parallel on different classes of node is not consistent on the same group.As shown in Figure 2, below the implementation of one group of test case is wherein described in detail:
The 1st step: all test cases in this group are sorted, with test case according to the interstitial content that carry out to need from many to few rank order, to having the test case of the node number that identical execution needs, remove the outer test case of carrying out for the first time of all test cases and from growing to lacking, sort according to the expection execution time of test case.
For needing the identical test case of XM number, and the test case of expection execution time the unknown (carry out for the first time) comes before the known test case of all expection execution time, described expection execution time the unknown is meant that this test case carries out for the first time, and the expection execution time that is set up is 0; And needing this part test case that the node number is identical, the execution time is all unknown for execution, the relative order between them is at random.
The 2nd step: all test cases that satisfy executive condition are distributed XM, and XM is carried out these test cases concurrently.
Described executive condition refers to the number of the required all kinds of test resources of test case all can not be greater than the number of such idling-resource in the current system under test (SUT), and wherein each class testing resource comprises the node of execution needs and other resource.Whether the executive condition of judging each test case from unenforced test case in order satisfies, if satisfy, distributes to the corresponding resource of this test case, judges next test case then, does not then directly judge next test case if do not satisfy.Repeat abovely to judge in system under test (SUT) that all test cases have all been judged in no idle XM or this group and finish, carry out the 3rd then and go on foot.For each test case of Resources allocation, each XM executed in parallel is distributed the test case of coming.Described Resources allocation comprises allocation for test use-case XM and other required test resources, and the state that the test resource that is assigned with is set is for busy.Since among the present invention at the effect on XM arbitrarily, carried out of the test case of system under test (SUT) be of equal value, so be the one or more XM of picked at random from the XM of current free time when allocation for test use-case XM, the XM number of choosing is this use-case and carries out needed node number.
Carry out single test case flow process as shown in Figure 3 in the 2nd step, be described in detail as follows:
(1). the execution control agent of automatic test control end on each XM of this test case sends this test case and carry out required test script file on this XM, and described test script file can obtain from database according to the numbering of test case.
(2). the execution control agent of automatic test control end on each XM of this test case sends the order that begins to carry out script, each carry out control agent receive this order after, start automated test tool and carry out script file, this automated test tool is the automated test tool that the tester write or recorded the script file of test case.
(3). the automatic test control end is monitored the script executing result that the execution control agent on each XM is beamed back, judge whether this test case is carried out overtime, if do not have, show that this test case runs succeeded, the automatic test control end receives and preserves the script executing result on all XM of this test case, and this test case is finished.Described script executing result is carried out in the process of script file by automated test tool to generate, and can be resolved, show the tester by this automated test tool.。
(4). if the execution of test case is overtime, it is unusual to show that this test case is carried out appearance, the execution control agent of automatic test control end this moment on each XM of this test case sends the instruction that stops script executing, and the execution result that this test case is set is that this test case is finished unusually.
The described execution control agent that is deployed on the XM is responsible for receiving robotization and is carried out script file, the fill order that control end is sent, start automated test tool and carry out script, send execution result etc. to the automatic test control end, carry out between control agent and the automatic test execution control end and carry out message communicating by LAN (Local Area Network).Test case is carried out time-out time and can be provided with as the case may be at the automatic test control end by the tester.Concrete time-out time can be set to 1 times to the 3 times time of the historical maximum execution time carried out to test case in system under test (SUT), can be different to the execution time-out time that different systems under test (SUT) is provided with, for example, in certain system under test (SUT), this test case maximum execution time needs about 60s, and it is time-out time that 120s then can be set.
The 3rd step: monitor the executing state of all test cases of carrying out,, judge in this group test case whether unenforced test case is arranged, if went to for the 2nd step, if do not go to for the 4th step if monitoring arbitrary test case is finished.
Begin from carrying out first test case that all test cases are finished to the test assignment, the automatic test control end is being monitored the executing state of all test cases of carrying out in real time.Whenever monitoring a test case is finished (comprise and running succeeded with unusual), the state that upgrades the used XM of this test case is for idle, if run succeeded then according to complete time of test case and carry out the start time, obtain this actual execution time of this test case, can obtain this test case expection execution time of next time in conjunction with the current expection execution time then.
The 4th step: wait for and monitor being finished up to current all test cases of carrying out, then all test cases are finished in this group.
If all test cases are finished in this group, then can according to formula (1) more should group in the new database in expection execution time of all test cases, then in test assignment next time if select in this test case once more, the expection execution time of this test case can directly obtain from data.
After the test case of all groups of this priority all is finished, carry out next step.
The test case that embodiment of the invention medium priority is the highest is use-case 1001 and use-case 1002, and these 2 test cases are all carried out on the category-A node, belong to same group.Because these 2 test cases all satisfy executive condition, therefore carry out simultaneously, the XM of use-case can be from 3 XM of category-A picked at random.
Step 4: judge whether to execute all test cases, if not, change step 3 and carry out, if, execution in step five.
Step 5: this test assignment is finished, and the execution result of the test case of test assignment is shown to the user checks, so that detect the problem that exists in the system under test (SUT).
Execute the use-case 1001 and the use-case 1002 of a priority,, then carry out all test cases of next priority owing to still have unenforced test case in the test assignment.Because all remaining test case priority are identical, then execute these test cases after this test assignment be finished.
Unenforced test case is divided into 2 groups according to the XM classification, on the category-A node, carries out for one group, comprise use-case 1003～1007, form by use-case 1008 for one group, on the category-B node, carry out.According to method of the present invention, the execution flow process of one group of test case carrying out on the category-A node is as follows:
(1) earlier to test case 1003～1007 carry out according to use-case the node number that needs from how to less, the expection execution time sorts from grow lack and sorts then, after sorting:＜1003,1005,1006,1004,1007.
(2) use-case 1003 satisfies executive condition, to there not being idle XM after its Resources allocation, so carry out use-case 1003.
(3) use-case 1003 is finished, and upgrades the next time of use-case and expects the execution time.This moment, 3 category-A XM were all idle, and use- case 1005,1006 all satisfies executive condition, to carrying out simultaneously after its Resources allocation.Owing to need 1 " administrator " resource when use-case 1006 is carried out, therefore leisureless " administrator " resource in the system in 1006 implementations.
(4) because all the unknowns of the execution time of use- case 1005,1006, so ensuing use-case execution sequence is indefinite: if use-case 1006 executes earlier, this moment, the executive condition of use-case 1004 was met, and then then carried out use-case 1004, then once there being idle XM to carry out use-case 1007; If use-case 1005 executes earlier, the free time goes out 2 XM, but owing to leisureless " administrator " resource in the system, causes use-case 1004 executive conditions not satisfy, and judges that then the executive condition of use-case 1007 satisfies, and therefore carries out use-case 1007.Use-case 1004 must wait until that use-case 1006 is finished, and just can carry out on any platform in idle XM.
Because the test case of carrying out two groups on A, category-B node is an executed in parallel, execute one group of test case carrying out on the category-A node, judge whether one group of test case on the category-B node is finished, if be finished, then the test case of all groups of this priority is finished, and will expect that the execution time deposits in the database next time of test case.Do not had unenforced test case in the test assignment this moment, so this test assignment is finished.
Claims (8)
1. execution control and dispatching method towards the automatic test of distributed system is characterized in that this method specifically may further comprise the steps:
Step 1, tester be in the newly-built test assignment of automatic test control end, and the essential information of each test case in the input test task, submits this test assignment then to; Described automatic test control end be deployed in the system under test (SUT) separate host in; The essential information of described test case comprises: the XM classification of the numbering of test case, expection execution time, execution priority, needs and XM number and test case are carried out other resources of needs; Described test case is carried out other resources that need, and is meant that test case needs actual resource and the virtual resource that uses when carrying out except XM;
Step 2, automatic test control end be the essential information of each test case in the read test task successively, and test case is added in the unenforced test case chained list;
Step 3, get all the highest test cases of unenforced test case chained list medium priority, divide into groups according to the XM classification, the test case that to carry out on same class XM is divided into one group, and each is organized test case and carries out on the XM of corresponding classification concurrently;
Step 4, judge whether to execute all test cases, if not, change step 3 and carry out, if, execution in step five;
Step 5, the execution result of these all test cases of test assignment is shown to the user checks, finish this test assignment.
2. the execution control and the dispatching method of a kind of automatic test towards distributed system according to claim 1, it is characterized in that, the numbering of described test case is used for the script file in test case and this test case correspondence of the unique retrieval and inquisition reference numeral of database.
3. the execution control and the dispatching method of a kind of automatic test towards distributed system according to claim 1 is characterized in that, the described expection execution time, obtain by following formula:
Wherein, ET
n, ET
N-1The n time and the expection execution time of (n-1) inferior execution representing test case respectively, RT
N-1, RT
1Represent respectively (n-1) of test case inferior with the actual execution time of carrying out for the 1st time, carry out the first time of test case expection execution time ET
1Be set to 0.
4. the execution control and the dispatching method of a kind of automatic test towards distributed system according to claim 1, it is characterized in that, the execution priority of described test case, concrete determine that method is: judge the classification of this test case according to the action in the main operational steps of this test case, then the priority value of such test case is made as the execution priority of this test case; The classification of described test case comprises 6 classes, be followed successively by from high to low according to priority: just entered the test case of carrying out under the original state at system under test (SUT), carry out the test case of adding operation, the test case of operation is checked in execution, the test case of executive editor's operation is carried out the test case of deletion action and is carried out the test case of operation of resetting.
5. the execution control and the dispatching method of a kind of automatic test towards distributed system according to claim 4, it is characterized in that, described test case, when being divided into the multiclass test case, the execution priority of this test case priority value according to the minimum class testing use-case of the priority that is divided into is provided with according to the action in the main operational steps.
6. the execution control and the dispatching method of a kind of automatic test towards distributed system according to claim 1 is characterized in that, described test assignment adopts the XML file description, specifically comprises following element:
Be used to represent the root element＜task of a test assignment 〉, comprise two daughter element＜resources 〉,＜uces〉and an attribute that is used in unique this test assignment of retrieval of database;
Element＜resources〉be used for the test resource of representing that this test assignment implementation will be used, contain two daughter element:＜nodes〉element and＜other_resources element,＜nodes〉element is used for representing the XM information that this test assignment of system under test (SUT) can usefulness, each XM that can use is with element＜node〉expression;
Element＜node〉have two attributes: represent the attribute of the classification that XM is affiliated and the attribute of the expression XM network address;＜other_resources〉element is used to represent the information of all other test resources that will use of this test assignment, comprise the daughter element＜resource that is used for representing a kind of other test resources more than 0 or 1 〉, each daughter element＜resource〉have two attributes: represent the attribute of this resource name and the attribute of this number of resources of expression;
Element＜uces〉be used to all test case information of representing that this test assignment comprises, this element contains 1 above daughter element＜uc 〉, each daughter element＜uc〉test case of expression,＜uc〉element comprises: an attribute that is used in the unique retrieval test case of database, element＜time of the expection execution time of an expression test case 〉, element＜the priority of execution priority of an expression test case 〉, and expression test case is carried out the element＜uc_resources of needed test resource 〉; Described element＜uc_resources〉comprise one and be used to represent that test case carries out the element＜uc_node of the XM information of needs, and the element＜uc_other_resource that is used to represent other resources of test case execution needs more than 0 or 1; Described＜uc_node〉element has two attributes: the attribute of the XM classification that expression needs and expression test case are carried out the attribute of required XM number.
7. the execution control and the dispatching method of a kind of automatic test towards distributed system according to claim 1, it is characterized in that, the test case of respectively organizing described in the step 3 is carried out on the XM of corresponding classification concurrently, wherein the detailed process that is performed of every group of test case is identical, specifically:
The 1st step: to all test cases in this group earlier as required XM numbers from many to few rank order, again to having the test case of identical XM number, at first will all be the test case carried out for the first time to come all expection execution time be not before 0 the test case, be not that 0 test case is according to the expection rank order of execution time from growing to lacking to all expection execution time then; For having identical XM number and all being the test case of carrying out for the first time, the relative order between them is at random;
The 2nd step: whether the executive condition of judging unenforced test case successively satisfies, if satisfy,, and carry out this test case for this test case is distributed XM and carried out other resources that need, judge next test case then, then directly do not judge next test case if do not satisfy; Repeat in the XM of this judgement leisureless corresponding classification in system under test (SUT) or this group all test cases and all judged and finish, carried out for the 3rd step then; Described executive condition refers to that the XM number of test case needs and other number of resources of carrying out needs all can not be greater than the numbers of corresponding idling-resource in the current system under test (SUT);
The 3rd step: monitor the executing state of all test cases of carrying out,, judge in this group test case whether unenforced test case is arranged, carry out if went to for the 2nd step, if do not carry out next step if monitoring any one test case is finished;
The 4th step: wait for that current all test cases of carrying out are finished, the expection execution time of all test cases in more should organizing in the new database.
8. the execution control and the dispatching method of a kind of automatic test towards distributed system according to claim 7 is characterized in that, the detailed process of the single test case of the 2nd described execution of step is as follows:
Step a, the execution control agent of automatic test control end on each XM of this test case send this test case and want the execution script file on this XM;
Step b, the automatic test control end execution control agent on each XM of this test case sends the order begin to carry out script, after each is carried out control agent and receives order, starts automated test tool and carries out the corresponding script file;
Step c, automatic test control end are monitored and are respectively carried out the execution result that control agent is beamed back, and judge whether this test case is carried out overtime, if do not have, the automatic test control end receives and preserves all execution results of this test case, and this test case is finished; If overtime, execution in step d then;
Steps d, the automatic test control end execution control agent on each XM of this test case sends the instruction that stops script executing, and the execution result that this test case is set finishes the execution of this test case for unusual.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2011101464476A CN102214139B (en) | 2011-06-01 | 2011-06-01 | Automatic test performance control and debugging method facing distributed system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2011101464476A CN102214139B (en) | 2011-06-01 | 2011-06-01 | Automatic test performance control and debugging method facing distributed system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN102214139A true CN102214139A (en) | 2011-10-12 |
| CN102214139B CN102214139B (en) | 2013-11-27 |
Family
ID=44745458
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN2011101464476A Expired - Fee Related CN102214139B (en) | 2011-06-01 | 2011-06-01 | Automatic test performance control and debugging method facing distributed system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN102214139B (en) |
Cited By (62)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102495804A (en) * | 2011-12-27 | 2012-06-13 | 创新科存储技术（深圳）有限公司 | Automatic software testing method |
| CN102902591A (en) * | 2012-09-04 | 2013-01-30 | 深圳市宏电技术股份有限公司 | Task execution method of not long on-line terminal and not long on-line terminal |
| CN103051500A (en) * | 2013-01-04 | 2013-04-17 | 北京邮电大学 | Test method and system of service network system |
| CN103294494A (en) * | 2012-02-29 | 2013-09-11 | 中兴通讯股份有限公司 | Automatic deployment method and system of virtual system |
| CN103530231A (en) * | 2013-10-12 | 2014-01-22 | 北京京东尚科信息技术有限公司 | Application program testing method and system based on service process control |
| CN104426715A (en) * | 2013-09-03 | 2015-03-18 | 北京信威通信技术股份有限公司 | Distributed testing tool control method |
| CN104978269A (en) * | 2015-06-30 | 2015-10-14 | 四川九洲电器集团有限责任公司 | Automatic testing method |
| CN104978258A (en) * | 2014-04-01 | 2015-10-14 | 中国银联股份有限公司 | Software automation test method and system |
| CN105117345A (en) * | 2015-09-23 | 2015-12-02 | 网易（杭州）网络有限公司 | Interface testing method and device for application program |
| CN105138461A (en) * | 2015-09-23 | 2015-12-09 | 网易（杭州）网络有限公司 | Interface testing method and device for application program |
| CN105446876A (en) * | 2015-11-03 | 2016-03-30 | 北京京东尚科信息技术有限公司 | Service dimension based automatic testing method, apparatus and system |
| CN105487970A (en) * | 2014-10-13 | 2016-04-13 | 中国移动通信集团公司 | Interface display method and apparatus |
| CN105573902A (en) * | 2014-10-10 | 2016-05-11 | 阿里巴巴集团控股有限公司 | Application testing method and system |
| CN105930260A (en) * | 2015-12-23 | 2016-09-07 | 中国银联股份有限公司 | Method and apparatus for testing system availability |
| WO2016188170A1 (en) * | 2015-10-22 | 2016-12-01 | 中兴通讯股份有限公司 | Test method and device, apparatus and computer storage medium |
| CN106294037A (en) * | 2015-05-25 | 2017-01-04 | 中兴通讯股份有限公司 | Strike-machine method of testing and device |
| CN106469113A (en) * | 2015-08-18 | 2017-03-01 | 腾讯科技（深圳）有限公司 | Applied program testing method and system |
| CN106603789A (en) * | 2016-12-12 | 2017-04-26 | 青岛海信移动通信技术股份有限公司 | Method and system to increase equipment testing efficiency |
| CN106649111A (en) * | 2016-12-17 | 2017-05-10 | 广州酷狗计算机科技有限公司 | Method and device for running test cases |
| CN106708715A (en) * | 2015-07-13 | 2017-05-24 | 阿里巴巴集团控股有限公司 | Automatic test method and device |
| CN106873957A (en) * | 2016-06-23 | 2017-06-20 | 阿里巴巴集团控股有限公司 | The processing method and equipment of a kind of operation flow |
| CN106991044A (en) * | 2017-03-22 | 2017-07-28 | 记忆科技(深圳)有限公司 | A kind of test case scheduling and distribution method suitable for distributed test system |
| CN107066380A (en) * | 2017-02-23 | 2017-08-18 | 青岛海信电器股份有限公司 | The authentication method and device of a kind of application comprising redundancy feature |
| CN107179985A (en) * | 2016-03-09 | 2017-09-19 | 阿里巴巴集团控股有限公司 | Execution method and apparatus for automating use-case |
| CN107194115A (en) * | 2017-06-16 | 2017-09-22 | 北京得瑞领新科技有限公司 | A kind of mass circuit emulation method and system |
| CN107197241A (en) * | 2017-05-08 | 2017-09-22 | 聚好看科技股份有限公司 | Time-out time dynamic setting method and device in TV applications test |
| CN107273249A (en) * | 2016-04-06 | 2017-10-20 | 龙芯中科技术有限公司 | Motherboard test method, processor and main board testing system |
| CN107291542A (en) * | 2017-06-27 | 2017-10-24 | 北京优特捷信息技术有限公司 | A kind of intelligence performs the method and device of retrieval tasks |
| CN107291621A (en) * | 2017-07-07 | 2017-10-24 | 恒生电子股份有限公司 | Processing method, processing unit, medium and the electronic equipment of test case |
| CN107451063A (en) * | 2017-08-14 | 2017-12-08 | 凌云天博光电科技股份有限公司 | A kind of script method of testing and device |
| CN108038013A (en) * | 2017-11-30 | 2018-05-15 | 海尔优家智能科技（北京）有限公司 | Distributed performance test method and device and computer-readable recording medium |
| CN108153661A (en) * | 2016-12-05 | 2018-06-12 | 腾讯科技（深圳）有限公司 | The method and apparatus of implementation of test cases |
| CN108268366A (en) * | 2016-12-30 | 2018-07-10 | 腾讯科技（深圳）有限公司 | Test example executing method and device |
| CN108459966A (en) * | 2018-03-21 | 2018-08-28 | 东软集团股份有限公司 | Dispatching method, device, equipment and the computer readable storage medium of test suite |
| CN108563562A (en) * | 2018-03-22 | 2018-09-21 | 平安科技（深圳）有限公司 | Test method, device, computer equipment and the storage medium of distributed system |
| CN108628730A (en) * | 2017-03-15 | 2018-10-09 | 阿里巴巴集团控股有限公司 | Method for testing software, device and system and electronic equipment |
| CN108664381A (en) * | 2017-03-27 | 2018-10-16 | 腾讯科技（深圳）有限公司 | test method and device |
| CN108805381A (en) * | 2017-05-03 | 2018-11-13 | 和硕联合科技股份有限公司 | Configuration unit, detection system and detection method |
| CN108829546A (en) * | 2018-06-21 | 2018-11-16 | 中国人民解放军战略支援部队信息工程大学 | timeout mechanism control method and device |
| CN108932196A (en) * | 2018-06-27 | 2018-12-04 | 郑州云海信息技术有限公司 | A kind of parallel automated testing method, system, equipment and readable storage medium storing program for executing |
| CN108984418A (en) * | 2018-08-22 | 2018-12-11 | 中国平安人寿保险股份有限公司 | Software testing management method, device, electronic equipment and storage medium |
| CN109002398A (en) * | 2018-07-26 | 2018-12-14 | 郑州云海信息技术有限公司 | A kind of Auto-matching formula server software test terminal |
| CN109086212A (en) * | 2018-09-04 | 2018-12-25 | 郑州云海信息技术有限公司 | A kind of method of equilibrium automatic test runing time |
| CN109117359A (en) * | 2017-06-22 | 2019-01-01 | 深圳市中兴微电子技术有限公司 | Serialize test method and device |
| CN109299009A (en) * | 2018-09-25 | 2019-02-01 | 金蝶软件（中国）有限公司 | Data test method, apparatus, computer equipment and storage medium |
| CN109597733A (en) * | 2018-12-04 | 2019-04-09 | 航天恒星科技有限公司 | A kind of multifunctional efficient dynamic chip verifying emulation mode and equipment |
| CN109684197A (en) * | 2018-11-12 | 2019-04-26 | 北京时代民芯科技有限公司 | Embedded SPARC processor-oriented multi-tool cooperative operation debugging system |
| CN109726124A (en) * | 2018-12-20 | 2019-05-07 | 北京爱奇艺科技有限公司 | Test macro, test method, managing device, test device and calculating equipment |
| CN110083535A (en) * | 2019-04-22 | 2019-08-02 | 网宿科技股份有限公司 | A kind of method for testing software and device |
| CN110162466A (en) * | 2019-04-19 | 2019-08-23 | 平安国际智慧城市科技股份有限公司 | Automatic test approach, device, computer equipment and storage medium |
| CN110162481A (en) * | 2019-05-31 | 2019-08-23 | 北京星网锐捷网络技术有限公司 | A kind of method for testing software, device, equipment and storage medium |
| CN110362469A (en) * | 2019-05-28 | 2019-10-22 | 中国平安人寿保险股份有限公司 | Based on modular testing use-case control method, device, terminal and storage medium |
| CN111104320A (en) * | 2019-12-15 | 2020-05-05 | 浪潮电子信息产业股份有限公司 | Test method, device, equipment and medium |
| CN112035309A (en) * | 2020-09-07 | 2020-12-04 | 深圳市亿道信息股份有限公司 | Automatic testing method, server and automatic testing system for intelligent terminal function |
| CN112069082A (en) * | 2020-09-29 | 2020-12-11 | 智慧互通科技有限公司 | Automatic testing method and system |
| CN112214400A (en) * | 2020-09-17 | 2021-01-12 | 浙江数链科技有限公司 | Automatic testing method and device, electronic equipment and readable storage medium |
| CN112231223A (en) * | 2020-10-27 | 2021-01-15 | 南京林洋电力科技有限公司 | Distributed automatic software testing method and system based on MQTT |
| CN112732556A (en) * | 2020-12-29 | 2021-04-30 | 北京浪潮数据技术有限公司 | Automatic testing method, device, equipment and storage medium for distributed system |
| CN113127335A (en) * | 2020-01-16 | 2021-07-16 | 北京京东振世信息技术有限公司 | System testing method and device |
| CN113535560A (en) * | 2021-07-14 | 2021-10-22 | 杭州网易云音乐科技有限公司 | Test execution method and device, storage medium and computing equipment |
| CN114116449A (en) * | 2021-10-25 | 2022-03-01 | 合众新能源汽车有限公司 | Automatic test case parameterization method and device and electronic equipment |
| CN114706773A (en) * | 2022-03-29 | 2022-07-05 | 网宿科技股份有限公司 | Automated testing method, automated testing equipment and readable storage medium |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5371883A (en) * | 1993-03-26 | 1994-12-06 | International Business Machines Corporation | Method of testing programs in a distributed environment |
| JP2001175499A (en) * | 1999-12-15 | 2001-06-29 | Nec Corp | Distributed debugging device and debugging method and recording medium with control program |
| CN101227350A (en) * | 2008-02-03 | 2008-07-23 | 中兴通讯股份有限公司 | System for parallel executing automatization test based on priority level scheduling and method thereof |
-
2011
- 2011-06-01 CN CN2011101464476A patent/CN102214139B/en not_active Expired - Fee Related
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5371883A (en) * | 1993-03-26 | 1994-12-06 | International Business Machines Corporation | Method of testing programs in a distributed environment |
| JP2001175499A (en) * | 1999-12-15 | 2001-06-29 | Nec Corp | Distributed debugging device and debugging method and recording medium with control program |
| CN101227350A (en) * | 2008-02-03 | 2008-07-23 | 中兴通讯股份有限公司 | System for parallel executing automatization test based on priority level scheduling and method thereof |
Non-Patent Citations (1)
| Title |
|---|
| 吴安怡等: "《模型驱动的分布式测试执行自动化研究与实现》", 《计算机工程与应用》, vol. 43, no. 10, 31 December 2007 (2007-12-31), pages 101 - 104 * |
Cited By (90)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102495804A (en) * | 2011-12-27 | 2012-06-13 | 创新科存储技术（深圳）有限公司 | Automatic software testing method |
| CN103294494A (en) * | 2012-02-29 | 2013-09-11 | 中兴通讯股份有限公司 | Automatic deployment method and system of virtual system |
| CN103294494B (en) * | 2012-02-29 | 2018-07-03 | 中兴通讯股份有限公司 | A kind of method and system of virtual system automatically dispose |
| CN102902591A (en) * | 2012-09-04 | 2013-01-30 | 深圳市宏电技术股份有限公司 | Task execution method of not long on-line terminal and not long on-line terminal |
| CN103051500B (en) * | 2013-01-04 | 2015-09-09 | 北京邮电大学 | A kind of method of testing of service network system and system |
| CN103051500A (en) * | 2013-01-04 | 2013-04-17 | 北京邮电大学 | Test method and system of service network system |
| CN104426715A (en) * | 2013-09-03 | 2015-03-18 | 北京信威通信技术股份有限公司 | Distributed testing tool control method |
| CN104426715B (en) * | 2013-09-03 | 2018-03-09 | 北京信威通信技术股份有限公司 | A kind of distributed testing tool control method |
| CN103530231B (en) * | 2013-10-12 | 2017-02-22 | 北京京东尚科信息技术有限公司 | Application program testing method and system based on service process control |
| CN103530231A (en) * | 2013-10-12 | 2014-01-22 | 北京京东尚科信息技术有限公司 | Application program testing method and system based on service process control |
| CN104978258A (en) * | 2014-04-01 | 2015-10-14 | 中国银联股份有限公司 | Software automation test method and system |
| CN104978258B (en) * | 2014-04-01 | 2018-03-23 | 中国银联股份有限公司 | Automatic software test method and system |
| CN105573902B (en) * | 2014-10-10 | 2018-07-03 | 阿里巴巴集团控股有限公司 | The test method and system of a kind of application program |
| CN105573902A (en) * | 2014-10-10 | 2016-05-11 | 阿里巴巴集团控股有限公司 | Application testing method and system |
| CN105487970B (en) * | 2014-10-13 | 2019-01-08 | 中国移动通信集团公司 | A kind of method for showing interface and device |
| CN105487970A (en) * | 2014-10-13 | 2016-04-13 | 中国移动通信集团公司 | Interface display method and apparatus |
| CN106294037A (en) * | 2015-05-25 | 2017-01-04 | 中兴通讯股份有限公司 | Strike-machine method of testing and device |
| CN104978269A (en) * | 2015-06-30 | 2015-10-14 | 四川九洲电器集团有限责任公司 | Automatic testing method |
| CN106708715A (en) * | 2015-07-13 | 2017-05-24 | 阿里巴巴集团控股有限公司 | Automatic test method and device |
| CN106469113A (en) * | 2015-08-18 | 2017-03-01 | 腾讯科技（深圳）有限公司 | Applied program testing method and system |
| CN106469113B (en) * | 2015-08-18 | 2023-08-08 | 腾讯科技（深圳）有限公司 | Application program testing method and system |
| CN105138461A (en) * | 2015-09-23 | 2015-12-09 | 网易（杭州）网络有限公司 | Interface testing method and device for application program |
| CN105117345A (en) * | 2015-09-23 | 2015-12-02 | 网易（杭州）网络有限公司 | Interface testing method and device for application program |
| CN105138461B (en) * | 2015-09-23 | 2018-01-26 | 网易（杭州）网络有限公司 | The interface test method and device of a kind of application program |
| CN105117345B (en) * | 2015-09-23 | 2017-12-19 | 网易（杭州）网络有限公司 | The interface test method and device of a kind of application program |
| WO2016188170A1 (en) * | 2015-10-22 | 2016-12-01 | 中兴通讯股份有限公司 | Test method and device, apparatus and computer storage medium |
| CN105446876A (en) * | 2015-11-03 | 2016-03-30 | 北京京东尚科信息技术有限公司 | Service dimension based automatic testing method, apparatus and system |
| CN105446876B (en) * | 2015-11-03 | 2020-12-22 | 北京京东尚科信息技术有限公司 | Automatic testing method, device, system, electronic equipment and readable storage medium |
| CN105930260B (en) * | 2015-12-23 | 2018-12-28 | 中国银联股份有限公司 | A kind of system availability test method and device |
| CN105930260A (en) * | 2015-12-23 | 2016-09-07 | 中国银联股份有限公司 | Method and apparatus for testing system availability |
| CN107179985A (en) * | 2016-03-09 | 2017-09-19 | 阿里巴巴集团控股有限公司 | Execution method and apparatus for automating use-case |
| CN107273249A (en) * | 2016-04-06 | 2017-10-20 | 龙芯中科技术有限公司 | Motherboard test method, processor and main board testing system |
| CN107273249B (en) * | 2016-04-06 | 2021-01-26 | 龙芯中科技术股份有限公司 | Mainboard test method, processor and mainboard test system |
| CN106873957A (en) * | 2016-06-23 | 2017-06-20 | 阿里巴巴集团控股有限公司 | The processing method and equipment of a kind of operation flow |
| CN108153661A (en) * | 2016-12-05 | 2018-06-12 | 腾讯科技（深圳）有限公司 | The method and apparatus of implementation of test cases |
| CN106603789A (en) * | 2016-12-12 | 2017-04-26 | 青岛海信移动通信技术股份有限公司 | Method and system to increase equipment testing efficiency |
| CN106649111A (en) * | 2016-12-17 | 2017-05-10 | 广州酷狗计算机科技有限公司 | Method and device for running test cases |
| CN108268366A (en) * | 2016-12-30 | 2018-07-10 | 腾讯科技（深圳）有限公司 | Test example executing method and device |
| CN107066380A (en) * | 2017-02-23 | 2017-08-18 | 青岛海信电器股份有限公司 | The authentication method and device of a kind of application comprising redundancy feature |
| CN108628730A (en) * | 2017-03-15 | 2018-10-09 | 阿里巴巴集团控股有限公司 | Method for testing software, device and system and electronic equipment |
| CN106991044A (en) * | 2017-03-22 | 2017-07-28 | 记忆科技(深圳)有限公司 | A kind of test case scheduling and distribution method suitable for distributed test system |
| CN108664381A (en) * | 2017-03-27 | 2018-10-16 | 腾讯科技（深圳）有限公司 | test method and device |
| CN108664381B (en) * | 2017-03-27 | 2021-04-06 | 腾讯科技（深圳）有限公司 | Test method and device |
| CN108805381B (en) * | 2017-05-03 | 2021-08-20 | 和硕联合科技股份有限公司 | Configuration unit, detection system and detection method |
| CN108805381A (en) * | 2017-05-03 | 2018-11-13 | 和硕联合科技股份有限公司 | Configuration unit, detection system and detection method |
| CN107197241A (en) * | 2017-05-08 | 2017-09-22 | 聚好看科技股份有限公司 | Time-out time dynamic setting method and device in TV applications test |
| WO2018228528A1 (en) * | 2017-06-16 | 2018-12-20 | 北京紫光得瑞科技有限公司 | Batch circuit simulation method and system |
| CN107194115A (en) * | 2017-06-16 | 2017-09-22 | 北京得瑞领新科技有限公司 | A kind of mass circuit emulation method and system |
| CN107194115B (en) * | 2017-06-16 | 2018-06-29 | 北京得瑞领新科技有限公司 | A kind of mass circuit emulation method and system |
| CN109117359A (en) * | 2017-06-22 | 2019-01-01 | 深圳市中兴微电子技术有限公司 | Serialize test method and device |
| CN107291542B (en) * | 2017-06-27 | 2020-09-15 | 北京优特捷信息技术有限公司 | Method and device for intelligently executing retrieval task |
| CN107291542A (en) * | 2017-06-27 | 2017-10-24 | 北京优特捷信息技术有限公司 | A kind of intelligence performs the method and device of retrieval tasks |
| CN107291621A (en) * | 2017-07-07 | 2017-10-24 | 恒生电子股份有限公司 | Processing method, processing unit, medium and the electronic equipment of test case |
| CN107451063B (en) * | 2017-08-14 | 2021-04-27 | 凌云天博光电科技股份有限公司 | Script testing method and device |
| CN107451063A (en) * | 2017-08-14 | 2017-12-08 | 凌云天博光电科技股份有限公司 | A kind of script method of testing and device |
| CN108038013B (en) * | 2017-11-30 | 2021-07-16 | 海尔优家智能科技（北京）有限公司 | Distributed performance test method and device and computer readable storage medium |
| CN108038013A (en) * | 2017-11-30 | 2018-05-15 | 海尔优家智能科技（北京）有限公司 | Distributed performance test method and device and computer-readable recording medium |
| CN108459966A (en) * | 2018-03-21 | 2018-08-28 | 东软集团股份有限公司 | Dispatching method, device, equipment and the computer readable storage medium of test suite |
| CN108459966B (en) * | 2018-03-21 | 2021-11-16 | 东软集团股份有限公司 | Method, device and equipment for scheduling test components and computer readable storage medium |
| CN108563562A (en) * | 2018-03-22 | 2018-09-21 | 平安科技（深圳）有限公司 | Test method, device, computer equipment and the storage medium of distributed system |
| CN108829546B (en) * | 2018-06-21 | 2021-06-18 | 中国人民解放军战略支援部队信息工程大学 | Timeout mechanism control method and device |
| CN108829546A (en) * | 2018-06-21 | 2018-11-16 | 中国人民解放军战略支援部队信息工程大学 | timeout mechanism control method and device |
| CN108932196A (en) * | 2018-06-27 | 2018-12-04 | 郑州云海信息技术有限公司 | A kind of parallel automated testing method, system, equipment and readable storage medium storing program for executing |
| CN109002398A (en) * | 2018-07-26 | 2018-12-14 | 郑州云海信息技术有限公司 | A kind of Auto-matching formula server software test terminal |
| CN108984418A (en) * | 2018-08-22 | 2018-12-11 | 中国平安人寿保险股份有限公司 | Software testing management method, device, electronic equipment and storage medium |
| CN108984418B (en) * | 2018-08-22 | 2023-04-11 | 中国平安人寿保险股份有限公司 | Software test management method and device, electronic equipment and storage medium |
| CN109086212A (en) * | 2018-09-04 | 2018-12-25 | 郑州云海信息技术有限公司 | A kind of method of equilibrium automatic test runing time |
| CN109299009A (en) * | 2018-09-25 | 2019-02-01 | 金蝶软件（中国）有限公司 | Data test method, apparatus, computer equipment and storage medium |
| CN109684197B (en) * | 2018-11-12 | 2022-05-13 | 北京时代民芯科技有限公司 | Multi-tool collaborative operation debugging system for embedded SPARC processor |
| CN109684197A (en) * | 2018-11-12 | 2019-04-26 | 北京时代民芯科技有限公司 | Embedded SPARC processor-oriented multi-tool cooperative operation debugging system |
| CN109597733A (en) * | 2018-12-04 | 2019-04-09 | 航天恒星科技有限公司 | A kind of multifunctional efficient dynamic chip verifying emulation mode and equipment |
| CN109597733B (en) * | 2018-12-04 | 2022-08-09 | 航天恒星科技有限公司 | Multifunctional efficient dynamic chip verification simulation method and equipment |
| CN109726124A (en) * | 2018-12-20 | 2019-05-07 | 北京爱奇艺科技有限公司 | Test macro, test method, managing device, test device and calculating equipment |
| CN109726124B (en) * | 2018-12-20 | 2023-06-02 | 北京爱奇艺科技有限公司 | Test system, test method, management device, test device and computing equipment |
| CN110162466A (en) * | 2019-04-19 | 2019-08-23 | 平安国际智慧城市科技股份有限公司 | Automatic test approach, device, computer equipment and storage medium |
| CN110083535A (en) * | 2019-04-22 | 2019-08-02 | 网宿科技股份有限公司 | A kind of method for testing software and device |
| CN110362469A (en) * | 2019-05-28 | 2019-10-22 | 中国平安人寿保险股份有限公司 | Based on modular testing use-case control method, device, terminal and storage medium |
| CN110162481A (en) * | 2019-05-31 | 2019-08-23 | 北京星网锐捷网络技术有限公司 | A kind of method for testing software, device, equipment and storage medium |
| CN111104320A (en) * | 2019-12-15 | 2020-05-05 | 浪潮电子信息产业股份有限公司 | Test method, device, equipment and medium |
| CN113127335A (en) * | 2020-01-16 | 2021-07-16 | 北京京东振世信息技术有限公司 | System testing method and device |
| CN112035309A (en) * | 2020-09-07 | 2020-12-04 | 深圳市亿道信息股份有限公司 | Automatic testing method, server and automatic testing system for intelligent terminal function |
| CN112035309B (en) * | 2020-09-07 | 2024-04-09 | 深圳市亿道信息股份有限公司 | Automatic testing method, server and automatic testing system for intelligent terminal function |
| CN112214400A (en) * | 2020-09-17 | 2021-01-12 | 浙江数链科技有限公司 | Automatic testing method and device, electronic equipment and readable storage medium |
| CN112069082A (en) * | 2020-09-29 | 2020-12-11 | 智慧互通科技有限公司 | Automatic testing method and system |
| CN112231223A (en) * | 2020-10-27 | 2021-01-15 | 南京林洋电力科技有限公司 | Distributed automatic software testing method and system based on MQTT |
| CN112732556A (en) * | 2020-12-29 | 2021-04-30 | 北京浪潮数据技术有限公司 | Automatic testing method, device, equipment and storage medium for distributed system |
| CN113535560A (en) * | 2021-07-14 | 2021-10-22 | 杭州网易云音乐科技有限公司 | Test execution method and device, storage medium and computing equipment |
| CN114116449A (en) * | 2021-10-25 | 2022-03-01 | 合众新能源汽车有限公司 | Automatic test case parameterization method and device and electronic equipment |
| CN114116449B (en) * | 2021-10-25 | 2024-05-07 | 合众新能源汽车股份有限公司 | Parameterization method and device for automatic test case and electronic equipment |
| CN114706773A (en) * | 2022-03-29 | 2022-07-05 | 网宿科技股份有限公司 | Automated testing method, automated testing equipment and readable storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN102214139B (en) | 2013-11-27 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN102214139B (en) | Automatic test performance control and debugging method facing distributed system | |
| Chen et al. | Workflowsim: A toolkit for simulating scientific workflows in distributed environments | |
| CN106095677B (en) | The RESTful Webservice automatic interface testing methods realized based on Robot Framework | |
| CN103176895B (en) | A kind of regression testing method and system | |
| CN102567203B (en) | A kind of method and system of test distributed file system performance | |
| Verma et al. | Play it again, simmr! | |
| CN102222042B (en) | Automatic software testing method based on cloud computing | |
| CN102868573B (en) | Method and device for Web service load cloud test | |
| EP2572294B1 (en) | System and method for sql performance assurance services | |
| CN110162471A (en) | A kind of method for testing pressure and system based on container cloud | |
| CN105095059B (en) | A kind of method and apparatus of automatic test | |
| CN111125444A (en) | Big data task scheduling management method, device, equipment and storage medium | |
| CN109344056B (en) | Test method and test device | |
| CN102012845B (en) | Method for improving utilization rate of automatic testing resources | |
| CN110740079A (en) | full link benchmark test system for distributed scheduling system | |
| CN110362315A (en) | Software systems dispatching method and device based on DAG | |
| US20120060146A1 (en) | Automatic Application Tuning | |
| CN109597764A (en) | A kind of test method and relevant apparatus of catalogue quota | |
| CN108932196A (en) | A kind of parallel automated testing method, system, equipment and readable storage medium storing program for executing | |
| Feljan et al. | Task allocation optimization for multicore embedded systems | |
| CN111897725B (en) | Automatic test method, medium, equipment and system for middle platform service | |
| CN103810258A (en) | Data aggregation scheduling method based on data warehouse | |
| CN112148616A (en) | Performance test management platform | |
| Liu et al. | Agent-based online quality measurement approach in cloud computing environment | |
| CN112527584A (en) | Software efficiency improving method and system based on script compiling and data acquisition |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20131127 Termination date: 20200601 |