CN104298589B - A kind of performance test methods and equipment - Google Patents

A kind of performance test methods and equipment Download PDF

Info

Publication number
CN104298589B
CN104298589B CN201310298145.XA CN201310298145A CN104298589B CN 104298589 B CN104298589 B CN 104298589B CN 201310298145 A CN201310298145 A CN 201310298145A CN 104298589 B CN104298589 B CN 104298589B
Authority
CN
China
Prior art keywords
performance test
code
test part
application software
measured
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
CN201310298145.XA
Other languages
Chinese (zh)
Other versions
CN104298589A (en
Inventor
袁翠
许晓
胡刚
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Alibaba Group Holding Ltd
Original Assignee
Alibaba Group Holding Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Alibaba Group Holding Ltd filed Critical Alibaba Group Holding Ltd
Priority to CN201310298145.XA priority Critical patent/CN104298589B/en
Publication of CN104298589A publication Critical patent/CN104298589A/en
Application granted granted Critical
Publication of CN104298589B publication Critical patent/CN104298589B/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Landscapes

  • Debugging And Monitoring (AREA)
  • Stored Programmes (AREA)

Abstract

This application discloses a kind of performance test methods and equipment, main contents include:Performance test part is created by being directed to each application software in advance, so that when needing trunk code and branch code to application software to carry out performance test respectively, performance test part can be directly invoked to build test scene, when the performance test part of selection will not cause environmental warfare to the performance test part being currently running, the test scene built using the performance test part of selection carries out pressure survey to the trunk code and branch code of application software, without manual creation test environment, the testing efficiency to application software and the accuracy of application software performance test can be effectively improved.

Description

A kind of performance test methods and equipment
Technical field
The present invention relates to field of computer technology, more particularly to a kind of performance test methods and equipment.
Background technology
After applied software development, the software code of application software on-line running, user will can log in Website server Website server simultaneously uses the application service that is provided of software code of operation.With " check product details " in shopping website this Application software(Subsequently it is referred to as application software A)Exemplified by, application software A software code is transported in the server of shopping website OK, after user logs in the server, the input interface on the page can be passed through(Such as " details " button on the page)Call the application Software A, to obtain the application service for checking a certain product details.
, it is necessary to constantly create or change some applications to realize business work(in the development process of major applications software Can, therefore, version control information can be included in the code of application software mostly, one can be recorded in the code change of application software Individual version number, all it is that the more commonly used Version Control of industry is soft for minute book time code change process, SVN, git, cvs etc. Part.
The code of application software, which becomes, further includes two aspects, one be application software the change of trunk code, another is The branch code change of application software.The branch code refers to the code disposed during applied software development, the trunk Code refers to that branch code is reached the standard grade and is applied to the code that true environment is disposed.When application software needs the change behaviour such as modify When making, it is necessary first to the change of respective code is carried out in branch code, then the branch code after change is reached the standard grade application again To trunk code, the corresponding change of trunk code is realized.In fact, may be to trunk code after being changed to trunk code Performance adversely affect, therefore, branch code is reached the standard grade be applied to trunk code before, it is necessary to assess branch code Which kind of influence change can cause to the performance of trunk code.
At present, performance impact of the change of branch code to trunk code can be assessed by the way of test, i.e.,:For The trunk code simulation running environment not changed, the performance of the trunk code under the running environment is tested, obtain SPEC mark According to;Identical running environment is simulated for the branch code after change again, performance of the test branch code under the running environment, is obtained Contrast test data are obtained, the results of property tested twice are compared, the change for assessing branch code can be to trunk code band Which kind of performance impact carried out.
The specific practice of above-mentioned test mode is as shown in figure 1, mainly include below scheme:
The first step:After the branch code of application software is changed, assess whether to need to carry out performance test.
Specifically assessing foundation can be:Branch's generation after this content alteration to branch code is relatively more or updates When code operationally occurs abnormal, it is believed that need to carry out performance test processes.
Second step:Manual creation test scene.
In this step, the function that need to be tested according to application software to be measured, is respectively created test scene, such as application software A Function 1 and the performance of function 2 need to test, to create two test scenes for function 1 and function 2 respectively.
By taking the test scene for function 1 as an example, the establishment process to the test scene includes following operation:
The test script of calling function 1 is firstly generated, is then the running configuration operation ambient parameter of function 1, such as Testing time, test pressure(Parallel trigger quantity)Etc. parameter, to create the test scene for function 1.
3rd step:The branch code of application software to be measured and trunk code are pressed under the test scene of establishment respectively Survey.
In this step, the branch code of application software to be measured is the branch code after the application software last update.
4th step:Survey result will be pressed to be compared twice, determine performance impact of the change to trunk code of branch code Degree.
Above-mentioned performance test methods can reflect that the renewal to application software is operated to application software to a certain extent Performance caused by influence degree, still, manual creation test scene need take a substantial amount of time, if a test process It is related to 3 test scenes, then needs that 3 test scenes are respectively created to the test process of trunk code and branch code respectively, 6 test scenes are created altogether, in the case of annual tens thousand of renewals operation, for renewal operation will be according to upper every time State mode and be directed to trunk code and branch code manual creation test scene respectively, testing efficiency can be caused low, and it is this every Also easily there is error in the mode of secondary manual creation test scene, causes the accuracy of test to be affected.
The content of the invention
The embodiment of the present application provides a kind of performance test methods and equipment, to solve in the prior art to exist to application The trunk code of software and the performance test efficiency of branch code are low and the problem of accuracy is relatively low.
The embodiment of the present application provides a kind of performance test methods, and methods described includes:
The performance test part associated with application software to be measured is chosen from performance test storehouse, is included in the performance test part Test script and running environment parameter;
Detect in the performance test part being currently running with the presence or absence of the application software and the performance of the selection of association The application software of test block association has the first detection performance test block of common factor;
If being not present, trunk code and branch of the performance test part chosen to the application software to be measured are utilized Code carries out pressure survey respectively;Otherwise, after waiting the first detection performance test block end of run, the performance of selection is recycled to survey Test specimen carries out pressure survey respectively to the trunk code and branch code of the application software to be measured;
By comparing the performance surveyed result to the pressure of trunk code and branch code and determine the application software to be measured.
From the above as can be seen that due to creating the survey of performance test part structural behavior by being directed to each application software in advance Try storehouse so that when needing trunk code and branch code to application software to carry out performance test respectively, directly basis can treat The testing requirement for surveying application software chooses performance test part to build test scene from performance test storehouse, is surveyed in the performance of selection Test specimen the performance test part being currently running will not be caused association application software in terms of environmental warfare when, utilize selection The performance test part structure test scene pressure survey is carried out to the trunk code and branch code of application software, without hand It is dynamic to create test environment, the testing efficiency to application software and the accuracy of application software performance test can be effectively improved.
Preferably, trunk code and branch generation of the performance test part chosen to the application software to be measured are being utilized Before code division does not carry out pressure survey, methods described also includes:
It is determined that data source and the performance test part of selection corresponding to the performance test part chosen to the data source according to Bad weighted value;
When the performance that corresponding data source and the selection in the performance test part for detecting to be currently running be present is surveyed When data source corresponding to test specimen has the second detection performance test block of common factor, performance test part and the second detection property chosen are judged Whether the weighted value sum that energy test block is relied on the data source of common factor is more than given threshold, if so, then waiting the second inspection After surveying performance test part end of run, the performance test part of selection is recycled to the trunk code of the application software to be measured Pressure survey is carried out respectively with branch code;Otherwise, using the performance test part of selection to the trunk of the application software to be measured Code and branch code carry out pressure survey respectively.
Because the performance test part in selection will not cause corresponding data source to the performance test part being currently running Pressure survey is carried out during the environmental warfare of aspect again, the insignificant operation that environmental warfare is brought can be reduced.
Preferably, trunk code and branch generation of the performance test part chosen to the application software to be measured are being utilized Before code division does not carry out pressure survey, methods described also includes:
The trunk code and branch code of the application software to be measured are detected, determine the trunk code and branch's generation Code being capable of normal operation.
By being detected before pressing survey to the trunk code of application software to be measured and the availability of branch code, nothing can be reduced The pressure of meaning surveys operation.
Preferably, there is the triggered time in the running environment parameter that the performance test part includes;
Before the performance test part associated with application software to be measured is chosen from performance test storehouse, methods described is also wrapped Include:
It is determined that reach the triggered time.
Operation pressure is used as by the triggered time and surveys the condition operated, performance that may be present can be detected according to the actual requirements Problem is high without manual intervention, operability.
The embodiment of the present application also provides a kind of performance test methods, and methods described includes:
The performance test part associated with application software to be measured is chosen from performance test storehouse, and determines the performance chosen The weighted value that data source corresponding to test block and the performance test part of selection are relied on the data source, in the performance test part Include test script and running environment parameter;
Detect in the performance test part being currently running and surveyed with the presence or absence of corresponding data source and the performance of the selection Data source corresponding to test specimen has the detection performance test block of common factor;
If being not present, trunk code and branch of the performance test part chosen to the application software to be measured are utilized Code carries out pressure survey respectively;If in the presence of judging the institute of the performance test part chosen and the performance test part that detects to common factor Whether the weighted value sum for stating data source dependence is more than given threshold;
If being more than given threshold, after waiting the detection performance test block end of run detected, the institute of selection is recycled State performance test part and pressure survey is carried out respectively to the trunk code and branch code of the application software to be measured;Otherwise, selection is utilized The performance test part pressure survey is carried out respectively to the trunk code and branch code of the application software to be measured.
From the above as can be seen that due to creating the survey of performance test part structural behavior by being directed to each application software in advance Try storehouse so that when needing trunk code and branch code to application software to carry out performance test respectively, directly basis can treat The testing requirement for surveying application software chooses performance test part to build test scene from performance test storehouse, is surveyed in the performance of selection Test specimen the performance test part being currently running will not be caused corresponding to environmental warfare in terms of data source when, utilize selection The test scene of the performance test part structure carries out pressure survey to the trunk code and branch code of application software, without manual Test environment is created, the testing efficiency to application software and the accuracy of application software performance test can be effectively improved.
The embodiment of the present application also provides a kind of performance test apparatus, and the equipment includes:
Test block chooses module, for choosing the performance test part associated with application software to be measured from performance test storehouse, Test script and running environment parameter are included in the performance test part;
First environment detection module, for detecting in the performance test part being currently running with the presence or absence of the application of association Software has the first detection performance test block of common factor with the application software that the performance test part of the selection associates;
Pressure surveys module, for determining that the first detection performance test block is not present in the first environment detection module When, the trunk code and branch code of the application software to be measured are pressed respectively using the performance test part of selection Survey;Otherwise, after waiting the first detection performance test block end of run, the performance test part of selection is recycled to described to be measured The trunk code and branch code of application software carry out pressure survey respectively;
Performance determining module, for by compare to the pressure of trunk code and branch code survey result determine it is described it is to be measured should With the performance of software.
From said system as can be seen that due to creating the survey of performance test part structural behavior by being directed to each application software in advance Try storehouse so that when needing trunk code and branch code to application software to carry out performance test respectively, directly basis can treat The testing requirement for surveying application software chooses performance test part to build test scene from performance test storehouse, is surveyed in the performance of selection Test specimen the performance test part being currently running will not be caused association application software in terms of environmental warfare when, utilize selection The performance test part structure test scene pressure survey is carried out to the trunk code and branch code of application software, without hand It is dynamic to create test environment, the testing efficiency to application software and the accuracy of application software performance test can be effectively improved.
Preferably, the equipment also includes:
Second environment detection module, for determining data source and the property of selection corresponding to the performance test part of selection The weighted value that energy test block is relied on the data source, it is corresponding several when existing in the performance test part for detecting to be currently running When having the second detection performance test block of common factor according to source data source corresponding with the performance test part of the selection, judge what is chosen Whether performance test part and the second detection performance test block are more than setting to the weighted value sum that the data source of common factor relies on Threshold value;
Pressure surveys module, is additionally operable to when the second environment detection module determines that weighted value sum is more than given threshold, etc. After the second detection performance test block end of run, the performance test part of selection is recycled to the application software to be measured Trunk code and branch code carry out pressure survey respectively;Otherwise, it is soft to the application to be measured using the performance test part of selection The trunk code and branch code of part carry out pressure survey respectively.
Because the performance test part in selection will not cause corresponding data source to the performance test part being currently running Pressure survey is carried out during the environmental warfare of aspect again, the insignificant operation that environmental warfare is brought can be reduced.
Preferably, the equipment also includes:
Detecting module, detected for the trunk code to the application software to be measured and branch code, determine the master Whether dry code and branch code being capable of normal operations.
By being detected before pressing survey to the trunk code of application software to be measured and the availability of branch code, nothing can be reduced The pressure of meaning surveys operation.
Preferably, there is the triggered time in the running environment parameter that the performance test part includes;
The test block chooses module, when reaching the triggered time specifically for determination, is chosen from performance test storehouse The performance test part associated with application software to be measured.
Operation pressure is used as by the triggered time and surveys the condition operated, performance that may be present can be detected according to the actual requirements Problem is high without manual intervention, operability.
The embodiment of the present application also provides a kind of performance test apparatus, and the equipment includes:
Test block chooses module, for choosing the performance test part associated with application software to be measured from performance test storehouse, Test script and running environment parameter are included in the performance test part;
Context detection module, for determining that data source corresponding to the performance test part of selection and the performance of selection are surveyed The weighted value that test specimen is relied on the data source, when corresponding data source in the performance test part for detecting to be currently running being present When data source corresponding with the performance test part of the selection has the performance test part of common factor, judge choose performance test part and Whether the weighted value sum that the performance test part detected is relied on the data source of common factor is more than given threshold;
Pressure surveys module, for when the context detection module determines that weighted value sum is more than given threshold, waiting to be detected After the performance test part end of run gone out, the performance test part of selection is recycled to the trunk generation of the application software to be measured Code and branch code carry out pressure survey respectively;Otherwise, using the performance test part of selection to the master of the application software to be measured Dry code and branch code carry out pressure survey respectively;
Performance determining module, for by compare to the pressure of trunk code and branch code survey result determine it is described it is to be measured should With the performance of software.
From said system as can be seen that due to creating the survey of performance test part structural behavior by being directed to each application software in advance Try storehouse so that when needing trunk code and branch code to application software to carry out performance test respectively, directly basis can treat The testing requirement for surveying application software chooses performance test part to build test scene from performance test storehouse, is surveyed in the performance of selection Test specimen the performance test part being currently running will not be caused corresponding to environmental warfare in terms of data source when, utilize selection The test scene of the performance test part structure carries out pressure survey to the trunk code and branch code of application software, without manual Test environment is created, the testing efficiency to application software and the accuracy of application software performance test can be effectively improved.
Brief description of the drawings
Fig. 1 is that the trunk code of application software and the testing process of branch code performance impact are illustrated in background technology Figure;
Fig. 2 is the schematic diagram of performance test block in the embodiment of the present application one;
Fig. 3(a)And Fig. 3(b)For in the embodiment of the present application two to the trunk code and branch code progressive of application software The method and step schematic diagram that can be tested;
Fig. 4 is the structural representation of performance test apparatus in the embodiment of the present application three;
Fig. 5 is the structural representation of performance test apparatus in the embodiment of the present application four.
Embodiment
In the scheme of the embodiment of the present application, performance test part, the performance test are created for each application software in advance Contained in part and test script required when pressure is surveyed and running environment parameter are carried out to application software, needed to application software When trunk code and branch code are tested, performance test part can be directly chosen to build test scene, and detect selection Whether performance test part can cause environmental warfare to the performance test part being currently running, if can be to being currently running Performance test part causes environmental warfare, then after waiting the performance test part end of run for causing environmental warfare, recycles selection The performance test part carries out pressure survey to the trunk code and branch code of application software(The performance test part chosen and conflict Performance test part between serially run);If environmental warfare will not be caused to the performance test part being currently running, directly Connect and pressure survey is carried out to the trunk code and branch code of application software using the performance test part of selection(The performance chosen Run parallel between test block and the performance test part being currently running), and result is surveyed according to pressure twice and obtained to the application The performance pressure of software surveys result.
Due to, without manual creation test environment, but directly invoking the performance created in the scheme of the embodiment of the present application Test block builds test scene, can effectively improve to the accurate of the testing efficiency of application software and application software performance test Property, meanwhile, between the performance test part of calling and the performance test part being currently running carry out environmental warfare detection, can prevent by Conflict between performance test part causes insignificant performance pressure to survey operation.
It should be noted that the embodiment of the present application is carried out with the trunk code to application software to be measured and branch code It is described exemplified by performance test, but the scheme of the embodiment of the present application is also not necessarily limited to parallel to the trunk of multiple application software to be measured Code and branch code performance are tested, identical for the test mode of each application software to be measured.
The scheme of the application is described in detail with reference to specific embodiment.
Embodiment one:
The embodiment of the present application one describes a kind of scheme for creating performance test part, and performance test is being carried out to application software Perform, comprise the following steps before:
The first step:Resource is distributed for the performance test part of establishment.
In this step, it can be that performance test part to be created distributes resource, such as distribute memory space for performance test part Deng.
Second step:Generated in the performance test part of establishment between the performance test part and its targeted application software Incidence relation.
Because performance test part creates for a certain application software, therefore, can establish the performance test part with should should With the incidence relation between software, i.e.,:The mark of application software of the record with incidence relation in performance test part.
On the one hand, a performance test block can provide service for the performance test of at least one application software, therefore, one Performance test part can establish incidence relation with least one application software;On the other hand, the test environment of an application software needs Built by least one performance test part, therefore, an application software can be established with least one performance test part to be associated System.
3rd step:Test script and running environment of the generation for the application software of association in the performance test part of establishment Parameter.
By taking " checking product details " this application software A as an example, the test script of establishment is " calling application software A, is initiated Check the request of product details ", i.e. generation pressure surveys request, if the path for calling application software A is www.aliexpress.com, The pressure then generated surveys request to call www.aliexpress.com.
The running environment parameter of establishment may include that pressure surveys the time(Such as 15 minutes), concurrent user number(As 10 users are parallel The request of product details is checked in initiation)Deng.
4th step:The triggered time is generated in the performance test part of establishment.
This step is to create the preferred steps of performance test part, and the triggered time can be considered the operation of the performance test part Time, i.e.,:The trigger condition of the application software performance test associated with the performance test part, upon activation between when reaching, the property Can test block can automatic running, build test environment for application software, the performance of application software tested.
Such as:If the triggered time is 8:00 and 20:00, represent whenever 8:00 or 20:During 00 arrival, it can automatically be invoked at and work as The preceding moment has the trunk code of the application software of incidence relation, and compiles automatically and build test environment, utilizes test script Pressure survey is carried out to the trunk code of calling with running environment parameter.
For another example creating test period, using test period as the triggered time, whenever reaching test period, test block is certainly Dynamic operation.It is this with test period(Such as one day)For the way in triggered time, it can check that the same day is done more to branch code Change the performance that whether have impact on trunk code, reduce the difficulty of code check, faster detect that performance that may be present is asked Topic, meet the quick characteristic of rapid build iterative development, and it is high without manual intervention, operability.Meanwhile performance test process It is not limited to branch code to reach the standard grade as after trunk code, but is applied in the change stage of each branch code, realizes quick Early warning.
5th step:It is data source and the performance test part corresponding to the performance test part configuration of establishment to the data source Rely on weighted value.
The data source includes but is not limited to database, cache file etc., and a performance test block can configure at least one Data source corresponding to individual, a data source may also be configured to the data source of at least one performance test part.Transported in performance test part , it is necessary to read corresponding data from corresponding data source during row.
For each data source corresponding to performance test block, dependence weight of the performance test part to the data source is respectively configured Value, the dependence weighted value represent performance test block to the degree of dependence of data source, and weighted value is higher, and performance test part is to data The dependence in source is higher.Such as:Corresponding two data sources of performance test part A, respectively data source 1 and data source 2, wherein, performance Dependence weighted values of the test block A to data source 1 is 0.5, and the dependence weighted value to data source 2 is 0.2.Assuming that weighted value maximum can 0.5 is configured to, represents that data source 1 can only be monopolized by performance test part A;Data source 2 when being taken by performance test part A, if Dependence weighted value of other performance test parts to data source 2 is not more than 0.3, then data source 2 can also be surveyed by other performances simultaneously Test specimen takes.
Five steps create the obtained content schematic diagram of performance test part as shown in Fig. 2 wherein more than, test script (Survey is such as pressed to ask)With running environment parameter(Such as press and survey time, concurrent user number)It is the key element for press survey process;During triggering Between as optional parameters be triggering pressure survey condition, when run for specified performance test block;Performance test part and application are soft The incidence relation of part shows which application software performance test part belongs to, so as to carry out performance survey to a certain application software Suitable performance test part is chosen during examination;The dependence weighted value table of corresponding data source and the performance test part to the data source Show the data source relied on during the operation of performance test part and the degree of dependence to data source.
The present embodiment one not to more than second and third, the sequencings of four, five steps be defined, can be in any order Perform aforementioned four step and generate corresponding parameter, or perform aforementioned four step parallel and generate corresponding parameter.
After creating performance test part using the scheme of above-described embodiment one, multiple performance test parts may make up performance test Storehouse.When needing trunk code and branch code to a certain application software to test, performance test can be chosen automatically first Part, then the trunk code and branch code for application software perform the performance test part of selection automatically, finally automatically analyze Pressure surveys result, completes the performance comparision process of the trunk code and branch code to application software, specific practice is referring to embodiment Two.
Embodiment two:
Such as Fig. 3(a)And Fig. 3(b)It is shown, it is that the trunk code and branch code of application software are carried out in the present embodiment two The method and step schematic diagram of performance test, is mainly included the following steps that:
Step 101:The performance test part associated with application software to be measured is chosen from performance test storehouse.
The application that there is incidence relation with the performance test part is contained in the performance test part created in embodiment one The mark of software, therefore, the performance test part for including the application software mark to be measured, choosing can be chosen from performance test storehouse The performance test part of taking-up is the performance test part associated with application software to be measured.
Assuming that the performance test part chosen in this step 101 is the performance test part shown in Fig. 2, then can be in performance test The triggered time of part(8:00 and 20:00)During arrival, subsequent step is performed automatically, i.e.,:The triggered time of performance test part is made For the trigger condition of performance test.
The scheme of the present embodiment can not also be using the triggered time as the trigger condition of performance test, and is made with manual triggering For the trigger condition of performance test, i.e.,:After this step 101 has been performed, no matter whether the triggered time reaches, it can all trigger manually Continue executing with subsequent step.
Step 102:Check the application software in the performance test part being currently running with the presence or absence of association and the choosing The application software of the performance test part association taken has the first detection performance test block of common factor.
This step 102 is performance test part to selection carries out environmental warfare between the performance test part that is currently running The step of detection, due to each related application software of performance test part, therefore, once the association of multiple performance test parts Application software has common factor, then this multiple performance test part can not perform parallel, can only serially perform.
In view of this, the application software that this step 102 associates to the performance test part currently run detects, it is determined that being It is no the performance test part for having common factor with the application software of the performance test part of selection to be present.
If being not present, represent do not have related answer between the performance test part chosen and the performance test part being currently running With the conflict of software.
If in the presence of the performance test part that the application software that the performance test part with the selection associates has common factor is referred to as For the first detection performance test block, the performance test part of selection is with affiliated first detection performance test block in the application software associated On have conflict, must not run parallel, after needing to wait for the first detection performance test block end of run, could run choose property Can test block.
It should be noted that in the performance test part currently run, may there are at least one performance test part and selection Performance test part has conflict in the application software of association, it is possible at least one first detection performance test block be present.
Such as:The application software of the performance test part association of selection is application software A and application software B, is currently transported The application software of capable performance test block association is application software A, the application of the performance test part association of another operation Software is application software B, then the performance test part chosen conflicts with the two performance test parts.
Step 103:It is determined that data source and the performance test part are to the data corresponding to the performance test part chosen The weighted value that source relies on.
Step 104:Detect in the performance test part being currently running with the presence or absence of corresponding data source and the selection Performance test part corresponding to data source have the second detection performance test block of common factor, if in the presence of performing step 105;Otherwise, Perform step 107.
This step 104 and to carrying out environment punching between the performance test part of selection and the performance test part being currently running The step of prominent detection, because each performance test part has corresponding data source, therefore, once corresponding to multiple performance test parts Data source has common factor, and the weighted value sum that this multiple performance test part is relied on the data source of common factor is more than given threshold, table Service can not be provided for this multiple performance test part simultaneously by showing the data source of common factor, and therefore, this multiple performance test part is can not All perform parallel.
In view of this, this step 104 detects to data source corresponding to the performance test part that currently runs, it is determined whether There is the performance test part of common factor in the presence of the data source of the performance test part with selection.
If being not present, represent there is no data source between the performance test part chosen and the performance test part being currently running Conflict.
If in the presence of the performance test part that the corresponding data source of performance test part with the selection has common factor is referred to as Second detection performance test block, now, although the second detection performance test block will take identical with the performance test part chosen Data source, but because performance test part is different to the degree of dependence of data source, therefore, can't determine that the second detection performance is tested Part conflicts with whether the performance test part chosen has in data source, also needs further to detect.
Step 105:It is determined that the performance test part and the second detection performance test block chosen to the data source of common factor according to Whether bad weighted value sum is more than given threshold, if so, then performing step 106;Otherwise, step 107 is performed.
The weighted value that the performance test part of selection and the second detection performance test block are relied on the data source of common factor it With expression performance test block and the second detection performance test block to the summation of the data source degree of dependence of common factor, set if being more than When determining threshold value, then performance test part and the second detection performance test block have conflict in data source, must not run parallel;If less In given threshold, then performance test part and the second detection performance test block do not conflict in data source, can run parallel.
Step 106:If the testing result of step 102 is the first detection performance test block be present, the first detection property is waited After energy test block and the second detection performance test block all end of runs, the performance test part of selection is recycled to described to be measured The trunk code and branch code of application software carry out pressure survey respectively;
If the testing result of step 102 is that the first detection performance test block is not present, the second detection performance is waited to test After part end of run, the performance test part of selection is recycled to the trunk code and branch code of the application software to be measured Pressure survey is carried out respectively.
Step 107:If the testing result of step 102 is the first detection performance test block be present, the first detection property is waited After test block end of run, can recycle the performance test part of selection to the trunk code of the application software to be measured and point Branch code carries out pressure survey respectively.
If the testing result of step 102 is that the first detection performance test block is not present, the property chosen directly is utilized Energy test block carries out pressure survey respectively to the trunk code and branch code of the application software to be measured.
In the specific implementation procedure of the present embodiment two, after step 101 have chosen a performance test block, it will first can select The performance test part taken is put into etc. in pending queue and ranked, and calls performance test part in queue successively and according to above-mentioned The mode of step 102 to step 107 determines whether the performance test part that operation is called, until the performance test part of all queuings is all It is finished.
In the scheme of the present embodiment two, carry out pressing the branch code of survey and trunk code to refer to:It is to be measured at current time The newest branch code of application software and trunk code.
Test environment is built automatically using the performance test part of selection, and by the trunk code of application software to be measured and branch Code carries out pressure survey under the test scene, and obtained pressure twice is surveyed result and is compared, and determines the change pair of branch code The performance impact of trunk code.
The pressure surveys result and includes but is not limited to herein below:
Trunk code release number, average response duration, completion number of transactions per second(TPS), error rate.
In the scheme of the present embodiment two, enter between performance test part to selection and the performance test part being currently running The detection of environmental warfare is twice gone, has been once the collision detection of associated application software, another time is rushing for corresponding data source Prominent detection, the scheme of the present embodiment is also not necessarily limited to the collision detection of advanced row data source, then is associated the conflict of application software Detection, or the scheme that collision detection twice performs parallel.Certainly, the collision detection twice in the present embodiment two can also be independent Perform.
Step 108:Compare and result is surveyed to the pressure of trunk code and branch code, determine the property of the application software to be measured Energy.
The comparison of result is surveyed by pressing twice, which kind of performance shadow assesses the change of branch code can carry out to trunk code band Ring.Result is surveyed by pressure exemplified by average response duration, if the result difference of pressure survey twice is larger, to show the change of branch code to master Dry code, which is brought, to be significantly affected.
Preferably, in the scheme of the present embodiment two, it is contemplated that the stability of branch code is not so good as trunk code, to dividing After branch code is changed, if the unstability of branch code causes branch code to be not normally functioning, even if according to implementation The scheme of example two is tested, and it presses survey result also necessarily false, both wastes test resource, can not obtain again preferably Pressure survey result, therefore, before step 106 and step 107 perform, need to the trunk code of the application software to be measured and point Branch code is detected, and determines that the trunk code and branch code being capable of normal operations.Here to the trunk of application software to be measured The operation that code and branch code are detected can perform in any time before step 106 and step 107, it is preferable that It can be finished in step 105, be performed again after test environment automatic deployment is good.If there is the master of application software to be measured in result of detection Dry code and/or branch code are not normally functioning, then terminate the scheme of the present embodiment two.
Specifically, the operation detected to the trunk code and branch code of application software to be measured is:
Due to application software to be measured the storage of trunk code and branch code in the application server, therefore, can be to corresponding Application server send probe requests thereby, the probe requests thereby can be the forms such as HTTP, TELNET, NETSTAT detection please Ask, and the probe response returned according to application server determines the trunk code of the application software to be measured in application server and divided Whether branch code can use.Here the pressure generated when probe requests thereby in embodiment one with creating performance test part surveys the content of request It is identical, before invocation performance test block carries out performance test to the trunk code and branch code of application software to be measured, utilize Probe requests thereby determines that the trunk code of application software to be measured and branch code can use.
The probe response includes but is not limited to following two situations:
Situation one:Probe response returns to status information, if the content of probe response is HTTP_CODE=200, according to state Information determines whether the trunk code of application software to be measured and branch code can use.
Situation two:Probe response returned text information, such as Aliexpress text messages, if the text message returned is to visit Survey the text message that request is specified, it is determined that the trunk code and branch code of application software to be measured can use.
Embodiment three:
As shown in figure 4, for the structural representation of performance test apparatus in the present embodiment three, the equipment includes:Test block Choose module 11, first environment detection module 12, pressure and survey module 13 and performance determining module 14, wherein:
Test block chooses module 11 and is used to choose the performance test part associated with application software to be measured from performance test storehouse, Test script and running environment parameter are included in the performance test part;
First environment detection module 12 is used to detect answering with the presence or absence of association in the performance test part being currently running There is the first detection performance test block of common factor with the application software that the performance test part of the selection associates with software;
Pressure surveys module 13 and is used to determine that first detection performance, which is not present, tests in the first environment detection module 12 During part, the trunk code and branch code of the application software to be measured are pressed respectively using the performance test part of selection Survey;Otherwise, after waiting the first detection performance test block end of run, the performance test part of selection is recycled to described to be measured The trunk code and branch code of application software carry out pressure survey respectively;
Performance determining module 14 be used for by compare to the pressure of trunk code and branch code survey result determine it is described to be measured The performance of application software.
, can also be right in the scheme of the present embodiment above is the process that the environmental warfare to the application software of association is detected The environmental warfare of data source is detected.
The equipment also includes second environment detection module 15, for determining number corresponding to the performance test part of selection The weighted value relied on according to the performance test part in source and selection the data source, when the performance test for detecting to be currently running The second detection performance that corresponding data source data source corresponding with the performance test part of the selection in part be present has common factor is surveyed During test specimen, the weighted value that the performance test part of selection and the second detection performance test block are relied on the data source of common factor is judged Whether sum is more than given threshold;
Pressure is surveyed module 13 and is additionally operable to when the second environment detection module 15 determines that weighted value sum is more than given threshold, After waiting the second detection performance test block end of run, the performance test part of selection is recycled to the application software to be measured Trunk code and branch code carry out pressure survey respectively;Otherwise, using the performance test part of selection to the application to be measured The trunk code and branch code of software carry out pressure survey respectively.
The equipment also includes detecting module 16, enters for the trunk code to the application software to be measured and branch code Row detection, determines whether the trunk code and branch code being capable of normal operations.
There is the triggered time in the running environment parameter that the performance test part includes;It is specific that the test block chooses module 11 During for determining to reach the triggered time, the performance test part associated with application software to be measured is chosen from performance test storehouse.
The environmental warfare that the present embodiment three describes to the application software of association detects, and soft to the application of association The environmental warfare of part and data source is detected, can also be only to the environment of data source in the performance test apparatus of the present embodiment four Conflict is detected, and is illustrated in detail below:
Example IV:
As shown in figure 5, for the structural representation of performance test apparatus in the present embodiment four, the equipment includes:Test block Choose module 21, context detection module 22, pressure and survey module 23 and performance determining module 24, wherein:
Test block chooses module 21 and is used to choose the performance test part associated with application software to be measured from performance test storehouse, Test script and running environment parameter are included in the performance test part;
Context detection module 22 is used to determine data source and the performance of selection corresponding to the performance test part of selection The weighted value that test block is relied on the data source, when corresponding data in the performance test part for detecting to be currently running being present When source data source corresponding with the performance test part of the selection has the performance test part of common factor, the performance test part chosen is judged Whether the weighted value sum relied on the performance test part detected the data source of common factor is more than given threshold;
Pressure surveys module 23 and is used to, when the context detection module 22 determines that weighted value sum is more than given threshold, wait to be checked After the performance test part end of run measured, the performance test part of selection is recycled to the trunk of the application software to be measured Code and branch code carry out pressure survey respectively;Otherwise, using the performance test part of selection to the application software to be measured Trunk code and branch code carry out pressure survey respectively;
Performance determining module 24 be used for by compare to the pressure of trunk code and branch code survey result determine it is described to be measured The performance of application software.
The equipment also includes detecting module 25, enters for the trunk code to the application software to be measured and branch code Row detection, determines whether the trunk code and branch code being capable of normal operations.
Using the scheme of each embodiment of the application, following effect can obtain:
1), improve testing efficiency.The scheme of the embodiment of the present application is by creating performance test part, fixed performance test wrapper Border, without carrying out manual creation test environment during test every time, improve testing efficiency.Meanwhile by being introduced into performance test part Triggered time, timing or periodically the trunk code of application software can be tested, without manpower intervention, it is not required that Whether manual evaluation, which needs, is tested.
2), stable test environment.In the scheme of the embodiment of the present application, because test environment is by being pre-created Performance test part is built, and the attribute such as test script and running environment parameter in performance test part is constant, is built Test environment is a metastable test environment, and therefore, pressure surveys result and has more reference significance, will not be by real net Network topological environmental or the interference of flowing of access change.
3), avoid environmental warfare.In the scheme of the embodiment of the present application, detected by increasing environmental warfare so that rely on Identical environment(Application software such as association has common factor, corresponding data source to have common factor and degree of dependence height)Performance test part string Row operation, the error rate of detection can be reduced;Meanwhile by increase to the trunk code and branch code of application software to be measured whether Available detecting function, can further reduce detection error rate, reduce environmental warfare and trunk code, branch code it is unavailable Caused failure.It is demonstrated experimentally that the scheme of the present embodiment two, rate of false alarm can be reduced to 20%.
It should be understood by those skilled in the art that, embodiments herein can be provided as method, system or computer program Product.Therefore, the application can use the reality in terms of complete hardware embodiment, complete software embodiment or combination software and hardware Apply the form of example.Moreover, the application can use the computer for wherein including computer usable program code in one or more Usable storage medium(Including but not limited to magnetic disk storage, CD-ROM, optical memory etc.)The computer program production of upper implementation The form of product.
The application is with reference to method, the equipment according to the embodiment of the present application(System)And the flow of computer program product Figure and/or block diagram describe.It should be understood that can be by every first-class in computer program instructions implementation process figure and/or block diagram Journey and/or the flow in square frame and flow chart and/or block diagram and/or the combination of square frame.These computer programs can be provided The processors of all-purpose computer, special-purpose computer, Embedded Processor or other programmable data processing devices is instructed to produce A raw machine so that produced by the instruction of computer or the computing device of other programmable data processing devices for real The device for the function of being specified in present one flow of flow chart or one square frame of multiple flows and/or block diagram or multiple square frames.
These computer program instructions, which may be alternatively stored in, can guide computer or other programmable data processing devices with spy Determine in the computer-readable memory that mode works so that the instruction being stored in the computer-readable memory, which produces, to be included referring to Make the manufacture of device, the command device realize in one flow of flow chart or multiple flows and/or one square frame of block diagram or The function of being specified in multiple square frames.
These computer program instructions can be also loaded into computer or other programmable data processing devices so that counted Series of operation steps is performed on calculation machine or other programmable devices to produce computer implemented processing, so as in computer or The instruction performed on other programmable devices is provided for realizing in one flow of flow chart or multiple flows and/or block diagram one The step of function of being specified in individual square frame or multiple square frames.
In a typical configuration, the computer equipment includes one or more processors (CPU), input/output Interface, network interface and internal memory.Internal memory may include the volatile memory in computer-readable medium, random access memory The form such as device (RAM) and/or Nonvolatile memory, such as read-only storage (ROM) or flash memory (flash RAM).Internal memory is to calculate The example of machine computer-readable recording medium.Computer-readable medium includes permanent and non-permanent, removable and non-removable media can be with Realize that information stores by any method or technique.Information can be computer-readable instruction, data structure, the module of program or Other data.The example of the storage medium of computer includes, but are not limited to phase transition internal memory (PRAM), static RAM (SRAM), dynamic random access memory (DRAM), other kinds of random access memory (RAM), read-only storage (ROM), Electrically Erasable Read Only Memory (EEPROM), fast flash memory bank or other memory techniques, read-only optical disc are read-only Memory (CD-ROM), digital versatile disc (DVD) or other optical storages, magnetic cassette tape, tape magnetic rigid disk storage or Other magnetic storage apparatus or any other non-transmission medium, the information that can be accessed by a computing device available for storage.According to Herein defines, and computer-readable medium does not include the computer readable media (transitory media) of non-standing, such as The data-signal and carrier wave of modulation.
Although having been described for the preferred embodiment of the application, those skilled in the art once know basic creation Property concept, then can make other change and modification to these embodiments.So appended claims be intended to be construed to include it is excellent Select embodiment and fall into having altered and changing for the application scope.
Obviously, those skilled in the art can carry out the essence of various changes and modification without departing from the application to the application God and scope.So, if these modifications and variations of the application belong to the scope of the application claim and its equivalent technologies Within, then the application is also intended to comprising including these changes and modification.

Claims (10)

1. a kind of performance test methods, it is characterised in that methods described includes:
The performance test part associated with application software to be measured is chosen from performance test storehouse, test is included in the performance test part Script and running environment parameter;
Detect and whether there is the first detection performance test block in the performance test part being currently running, the test of the first detection performance The application software that part and the performance test part of the selection are respectively associated has common factor;
If being not present, trunk code and branch code using the performance test part chosen to the application software to be measured Pressure survey is carried out respectively;Otherwise, after waiting the first detection performance test block end of run, the performance test part of selection is recycled Pressure survey is carried out respectively to the trunk code and branch code of the application software to be measured, wherein, the branch code refers to described The code disposed during applied software development to be measured, the trunk code refer to that branch code is reached the standard grade and are applied to true environment institute The code of deployment;
By comparing the performance surveyed result to the pressure of trunk code and branch code and determine the application software to be measured.
2. performance test methods as claimed in claim 1, it is characterised in that in the performance test part using selection to institute State the trunk code of application software to be measured and before branch code carries out pressure survey respectively, methods described also includes:
It is determined that what data source and the performance test part of selection corresponding to the performance test part chosen were relied on the data source Weighted value;
When the second detection performance test block in the performance test part for detecting to be currently running be present, the second detection performance is surveyed Corresponding data source has common factor respectively for test specimen and the performance test part of the selection, judges performance test part and the second inspection chosen Survey whether the weighted value sum that performance test part is relied on the data source of common factor is more than given threshold, if so, then waiting the After two detection performance test block end of runs, the performance test part of selection is recycled to the trunk of the application software to be measured Code and branch code carry out pressure survey respectively;Otherwise, using the performance test part of selection to the application software to be measured Trunk code and branch code carry out pressure survey respectively.
3. performance test methods as claimed in claim 1 or 2, it is characterised in that utilizing the performance test part chosen Before trunk code and branch code to the application software to be measured carry out pressure survey respectively, methods described also includes:
The trunk code and branch code of the application software to be measured are detected, determine the trunk code and branch code energy Enough normal operations.
4. performance test methods as claimed in claim 1, it is characterised in that the running environment ginseng that the performance test part includes There is the triggered time in number;
Before the performance test part associated with application software to be measured is chosen from performance test storehouse, methods described also includes:
It is determined that reach the triggered time.
5. a kind of performance test methods, it is characterised in that methods described includes:
The performance test part associated with application software to be measured is chosen from performance test storehouse, and determines the performance test chosen The weighted value that data source corresponding to part and the performance test part of selection are relied on the data source, include in the performance test part Test script and running environment parameter;
Detect and whether there is detection performance test block in the performance test part that is currently running, detection performance test block and described Corresponding data source has common factor to the performance test part of selection respectively;
If being not present, trunk code and branch code using the performance test part chosen to the application software to be measured Pressure survey is carried out respectively;If in the presence of judging the number of the performance test part chosen and the performance test part that detects to common factor Whether the weighted value sum relied on according to source is more than given threshold, wherein, the branch code refers to applied software development mistake to be measured The code disposed in journey, the trunk code refer to that branch code is reached the standard grade and are applied to the code that true environment is disposed;
If being more than given threshold, after waiting the detection performance test block end of run detected, the property of selection is recycled Energy test block carries out pressure survey respectively to the trunk code and branch code of the application software to be measured;Otherwise, the institute of selection is utilized State performance test part and pressure survey is carried out respectively to the trunk code and branch code of the application software to be measured.
6. a kind of performance test apparatus, it is characterised in that the equipment includes:
Test block chooses module, described for choosing the performance test part associated with application software to be measured from performance test storehouse Test script and running environment parameter are included in performance test part;
First environment detection module, surveyed for detecting in the performance test part being currently running with the presence or absence of the first detection performance The application software that the performance test part of test specimen, the first detection performance test block and the selection is respectively associated has common factor;
Pressure surveys module, sharp for when the first environment detection module determines that the first detection performance test block is not present Pressure survey is carried out respectively to the trunk code and branch code of the application software to be measured with the performance test part of selection;It is no Then, after waiting the first detection performance test block end of run, the performance test part of selection is recycled to the application to be measured The trunk code and branch code of software carry out pressure survey respectively, wherein, the branch code refers to applied software development mistake to be measured The code disposed in journey, the trunk code refer to that branch code is reached the standard grade and are applied to the code that true environment is disposed;
Performance determining module, for determining that the application to be measured is soft to the pressure of trunk code and branch code survey result by comparing The performance of part.
7. performance test apparatus as claimed in claim 6, it is characterised in that the equipment also includes:
Second environment detection module, for determining that data source corresponding to the performance test part of selection and the performance of selection are surveyed The weighted value that test specimen is relied on the data source, when the second detection performance in the performance test part for detecting to be currently running being present During test block, corresponding data source has common factor to the performance test part of the second detection performance test block and the selection respectively, judges Whether the weighted value sum that the performance test part of selection and the second detection performance test block are relied on the data source of common factor is big In given threshold;
Pressure surveys module, is additionally operable to when the second environment detection module determines that weighted value sum is more than given threshold, wait the After two detection performance test block end of runs, the performance test part of selection is recycled to the trunk of the application software to be measured Code and branch code carry out pressure survey respectively;Otherwise, using the performance test part of selection to the application software to be measured Trunk code and branch code carry out pressure survey respectively.
8. performance test apparatus as claimed in claims 6 or 7, it is characterised in that the equipment also includes:
Detecting module, detected for the trunk code to the application software to be measured and branch code, determine trunk generation Whether code and branch code being capable of normal operations.
9. performance test apparatus as claimed in claim 6, it is characterised in that the running environment ginseng that the performance test part includes There is the triggered time in number;
The test block chooses module, when reaching the triggered time specifically for determination, chooses and treats from performance test storehouse Survey the performance test part of application software association.
10. a kind of performance test apparatus, it is characterised in that the equipment includes:
Test block chooses module, described for choosing the performance test part associated with application software to be measured from performance test storehouse Test script and running environment parameter are included in performance test part;
Context detection module, for determining data source and the performance test part of selection corresponding to the performance test part of selection The weighted value relied on the data source, judge the number of the performance test part chosen and the performance test part detected to common factor Whether the weighted value sum relied on according to source is more than given threshold, and the performance test part detected is that the performance being currently running is surveyed Performance test part present in test specimen, and number corresponding to the performance test part and the performance test part difference of the selection detected There is common factor according to source;
Pressure surveys module, for when the context detection module determines that weighted value sum is more than given threshold, waiting what is detected After performance test part end of run, recycle the performance test part of selection to the trunk code of the application software to be measured and Branch code carries out pressure survey respectively;Otherwise, using the performance test part of selection to trunk generation of the application software to be measured Code and branch code carry out pressure survey respectively, wherein, the branch code refers to the generation disposed during applied software development to be measured Code, the trunk code refer to that branch code is reached the standard grade and are applied to the code that true environment is disposed;
Performance determining module, for determining that the application to be measured is soft to the pressure of trunk code and branch code survey result by comparing The performance of part.
CN201310298145.XA 2013-07-16 2013-07-16 A kind of performance test methods and equipment Expired - Fee Related CN104298589B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201310298145.XA CN104298589B (en) 2013-07-16 2013-07-16 A kind of performance test methods and equipment

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201310298145.XA CN104298589B (en) 2013-07-16 2013-07-16 A kind of performance test methods and equipment

Publications (2)

Publication Number Publication Date
CN104298589A CN104298589A (en) 2015-01-21
CN104298589B true CN104298589B (en) 2018-01-16

Family

ID=52318324

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201310298145.XA Expired - Fee Related CN104298589B (en) 2013-07-16 2013-07-16 A kind of performance test methods and equipment

Country Status (1)

Country Link
CN (1) CN104298589B (en)

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104809059B (en) * 2015-04-01 2018-02-02 百度在线网络技术(北京)有限公司 Using the detection method and device for index of reaching the standard grade
CN109960645B (en) * 2017-12-22 2022-10-18 迈普通信技术股份有限公司 Script test method and device and script test system
CN108845950A (en) * 2018-08-03 2018-11-20 平安科技(深圳)有限公司 Test device, the method for test and storage medium
CN111949505B (en) * 2019-05-14 2024-05-14 阿里云计算有限公司 Test method, device and equipment
CN113778842A (en) * 2020-08-25 2021-12-10 北京沃东天骏信息技术有限公司 Fault-tolerant test method and device, electronic equipment and storage medium

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1877543A (en) * 2005-06-06 2006-12-13 华为技术有限公司 Data-driven automatic testing system and method
CN102023861A (en) * 2010-12-08 2011-04-20 中兴通讯股份有限公司 Method and system for generating test script and test suite
CN102075384A (en) * 2010-12-20 2011-05-25 创新科存储技术有限公司 Performance test system and method

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20050188275A1 (en) * 2004-02-03 2005-08-25 Maly John W. Systems and methods for error tracking and recovery in an expectation-based memory agent checker

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1877543A (en) * 2005-06-06 2006-12-13 华为技术有限公司 Data-driven automatic testing system and method
CN102023861A (en) * 2010-12-08 2011-04-20 中兴通讯股份有限公司 Method and system for generating test script and test suite
CN102075384A (en) * 2010-12-20 2011-05-25 创新科存储技术有限公司 Performance test system and method

Also Published As

Publication number Publication date
CN104298589A (en) 2015-01-21

Similar Documents

Publication Publication Date Title
CN104182333B (en) A kind of performance test methods and equipment
CN107480039B (en) Small file read-write performance test method and device for distributed storage system
CN110618924B (en) Link pressure testing method of web application system
CN104298589B (en) A kind of performance test methods and equipment
CN112181804B (en) Parameter verification method, device and storage medium
CN109542789B (en) Code coverage rate statistical method and device
US20110258609A1 (en) Method and system for software defect reporting
JP2017514218A (en) Running third-party applications
CN110874315B (en) Test method, test device, electronic equipment and storage medium
CN110992992A (en) Hard disk test method, device and storage medium
CN105389256A (en) Unit testing method and system
CN110007921B (en) Code publishing method and device
CN107168844B (en) Performance monitoring method and device
CN109062769B (en) Method, device and equipment for predicting IT system performance risk trend
CN106095688A (en) A kind of software performance testing method and device
CA2811617C (en) Commit sensitive tests
CN107220165A (en) The method and apparatus of pressure test on a kind of artificial line
US9501390B1 (en) Enhancing automated mobile application testing
US20230040564A1 (en) Learning Causal Relationships
CN109558315A (en) The determination method, device and equipment of test scope
CN111221721A (en) Automatic recording and executing method and device for unit test cases
CN109656825A (en) The method and device of fine arts resource processing, electronic equipment, storage medium
CN113282504A (en) Incremental code coverage rate detection method and service development method and device
CN112015658A (en) Method and device for generating software integration test case
CN105701002A (en) Test based execution path recording method and apparatus

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20180116