CN104182333B - A kind of performance test methods and equipment - Google Patents
A kind of performance test methods and equipment Download PDFInfo
- Publication number
- CN104182333B CN104182333B CN201310195624.9A CN201310195624A CN104182333B CN 104182333 B CN104182333 B CN 104182333B CN 201310195624 A CN201310195624 A CN 201310195624A CN 104182333 B CN104182333 B CN 104182333B
- Authority
- CN
- China
- Prior art keywords
- application software
- performance test
- performance
- pressure
- measured
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000011056 performance test Methods 0.000 title claims abstract description 138
- 238000000034 method Methods 0.000 title claims abstract description 30
- 238000012360 testing method Methods 0.000 claims abstract description 73
- 230000001960 triggered effect Effects 0.000 claims description 15
- 235000013399 edible fruits Nutrition 0.000 claims description 3
- 241000208340 Araliaceae Species 0.000 claims 1
- 235000005035 Panax pseudoginseng ssp. pseudoginseng Nutrition 0.000 claims 1
- 235000003140 Panax quinquefolius Nutrition 0.000 claims 1
- 235000008434 ginseng Nutrition 0.000 claims 1
- 230000004044 response Effects 0.000 description 18
- 230000006870 function Effects 0.000 description 17
- 230000008859 change Effects 0.000 description 14
- 238000010586 diagram Methods 0.000 description 13
- 230000008569 process Effects 0.000 description 9
- 238000003860 storage Methods 0.000 description 9
- 238000004590 computer program Methods 0.000 description 7
- 238000012545 processing Methods 0.000 description 5
- 230000007547 defect Effects 0.000 description 4
- 238000005516 engineering process Methods 0.000 description 4
- 238000012986 modification Methods 0.000 description 4
- 230000004048 modification Effects 0.000 description 4
- 230000003287 optical effect Effects 0.000 description 3
- 230000032683 aging Effects 0.000 description 2
- 230000000052 comparative effect Effects 0.000 description 2
- 230000007423 decrease Effects 0.000 description 2
- 230000018109 developmental process Effects 0.000 description 2
- 238000012544 monitoring process Methods 0.000 description 2
- 238000003825 pressing Methods 0.000 description 2
- 230000002159 abnormal effect Effects 0.000 description 1
- 230000004913 activation Effects 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 230000007812 deficiency Effects 0.000 description 1
- 238000012217 deletion Methods 0.000 description 1
- 230000037430 deletion Effects 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 230000007613 environmental effect Effects 0.000 description 1
- 238000011156 evaluation Methods 0.000 description 1
- 230000000977 initiatory effect Effects 0.000 description 1
- 230000014759 maintenance of location Effects 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 230000002265 prevention Effects 0.000 description 1
- 238000012163 sequencing technique Methods 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
- 230000007704 transition Effects 0.000 description 1
Abstract
This application discloses a kind of performance test methods and equipment, main contents include：In advance performance test part is created for each application software, contained in the performance test part and test script required when pressure is surveyed and running environment parameter are carried out to application software, when needing to test application software, performance test part can be directly invoked to build test scene and carry out pressure survey to application software, without manual creation test environment, the testing efficiency to application software can be effectively improved, in the case of application software renewal frequency height, also the performance of application software can be tested in time using the scheme of the embodiment of the present application, avoid due to the problem of performance test delay causes application software operation exception.
Description
Technical field
The present invention relates to field of computer technology, more particularly to a kind of performance test methods and equipment.
Background technology
After applied software development, the software code of application software on-line running, user will can log in Website server
Website server simultaneously uses the application service that is provided of software code of operation.With " check product details " in shopping website this
Application software（Subsequently it is referred to as application software A）Exemplified by, application software A software code is transported in the server of shopping website
OK, after user logs in the server, the input interface on the page can be passed through（Such as " details " button on the page）Call the application
Software A, to obtain the application service for checking a certain product details.
After applied software development operation, still need to constantly safeguard the application software, update, such as：Increase application
Function, the existing function of change application software or deletion existing function of application software of software etc., to the dimension of application software
Shield, renewal are the realizations of more newly arriving by the software code to application software.Still with " checking product details ", this is applied soft
Exemplified by part A, " population ages of purchase product " this function is provided a user in order to increase, " can will buy crowd's year of product
The software code of this sub- application of age " is distributed in application software A software code, and the application software A's after being updated is soft
Part code.During the software code of the application software A in the server of shopping website after operation renewal, user runs application software
" population ages of purchase product " this content during A, can be checked in product details.
In fact, in large-scale business website, the software code of several application software is run in Website server,
For any application software, its renewal frequency is very high, or even can reach the renewal frequency of annual tens thousand of times.So
The software code change that high-frequency renewal is likely to application software is larger, therefore the performance of application software need to be surveyed
Examination, judge that performing sub caused using the performance to application software issued when which renewal operates significantly affects.
At present, the performance test mode to application software mainly has following two：
Mode one：
Monitored in real time by the performance of the application software to being run in server, to judge to each of the application software
Whether secondary renewal causes influence to the performance of application software.For example, application software A overhead is monitored in real time,
When significant change occurs for the overhead for monitoring out application software A, it is determined that the last renewal operation pair to application software A
Application software A performance causes influence.
Mode one can more easily realize the performance test to application software, still, because application software is true
In the environment of when running, the change of its performance can be influenceed by the change of network topology environment or flowing of access, that is to say, that
When the performance for monitoring out application software is affected, it is not necessarily to caused by the renewal process of application software, therefore, utilizes
The monitored results that mode one obtains are inaccurate.
Mode two：
By the software code dry run environment for the application software after renewal every time, to test this to application software
Renewal operation whether influence is caused on the performance of application software, specific practice is as shown in figure 1, mainly include below scheme：
The first step：After renewal operation is performed to the software code of application software, assess whether to need to carry out performance test.
Typically by application software, the software code of on-line running is referred to as trunk code to industry in server, in this step
In, can be to the trunk generation after renewal after the software code for performing the son application issued during renewal operation is integrated into trunk code
Code is assessed, and judges whether to need to carry out performance test to the trunk code after renewal.
Specifically assessing foundation can be：Trunk generation after this content update to trunk code is relatively more or updates
When code operationally occurs abnormal, it is believed that need to carry out performance test processes.
Second step：Manual creation test scene.
In this step, the function that need to be tested according to application software to be measured, is respectively created test scene, such as application software A
Function 1 and the performance of function 2 need to test, to create two test scenes for function 1 and function 2 respectively.
By taking the test scene for function 1 as an example, the establishment process to the test scene includes following operation：
The test script of calling function 1 is firstly generated, is then the running configuration operation ambient parameter of function 1, such as
Testing time, test pressure（Parallel trigger quantity）Etc. parameter, to create the test scene for function 1.
3rd step：The trunk code of application software to be measured is subjected to pressure survey under the test scene of establishment.
In this step, the trunk code of application software to be measured is the trunk code after the application software last update.
4th step：This pressure is surveyed into result compared with the history run result counted, determines this to application software
Renewal operation whether its performance is impacted, and report test result.
Mode two can reflect that the renewal operation to application software causes to the performance of application software to a certain extent
Influence degree, still, manual creation test scene needs to take a substantial amount of time, particularly in annual tens thousand of renewals operation
In the case of, for every time renewal operation will manual creation test environment, testing efficiency can be caused low, the software after renewal
Code can not be tested its performance impact immediately after running on line, in fact it could happen that application software performance is operated shadow by renewal
Ring it is excessive and the problem of alarm.
The content of the invention
The embodiment of the present application provides a kind of performance test methods and equipment, to solve in the prior art to exist to application
The problem of testing efficiency of software is low.
A kind of performance test methods, methods described include：
The performance test part associated with application software to be measured is chosen from performance test storehouse, is included in the performance test part
Test script and running environment parameter；
Pressure survey is carried out to the trunk code of the application software to be measured using the performance test part of selection；
Pressure is surveyed into result compared with given threshold, determines the performance of the application software to be measured.
A kind of performance test apparatus, the equipment include：
Test block chooses module, for choosing the performance test part associated with application software to be measured from performance test storehouse,
Test script and running environment parameter are included in the performance test part；
Pressure surveys module, for being carried out using the performance test part chosen to the trunk code of the application software to be measured
Pressure is surveyed；
Performance determining module, for pressure to be surveyed into result compared with given threshold, determine the application software to be measured
Performance.
The application has the beneficial effect that：
In the scheme of the embodiment of the present application, performance test part is created by being directed to each application software in advance so that needing
When testing application software, performance test part can be directly invoked to build test scene and application software is pressed
Survey, without manual creation test environment, the testing efficiency to application software can be effectively improved.
Brief description of the drawings
Fig. 1 is that the renewal in background technology to application software operates the testing process schematic diagram for causing performance impact；
Fig. 2 is the schematic diagram of performance test block in the embodiment of the present application one；
Fig. 3 is the method and step schematic diagram for carrying out performance test in the embodiment of the present application two to application software；
Fig. 4, which is that performance is accumulative in the embodiment of the present application two, influences schematic diagram；
Fig. 5, which is that performance is accumulative in the embodiment of the present application two, to be influenceed and baseline results comparison schematic diagram；
Fig. 6 is the structural representation of performance test apparatus in the embodiment of the present application three.
Embodiment
In the scheme of the embodiment of the present application, performance test part, the performance test are created for each application software in advance
Contained in part and test script required when pressure is surveyed and running environment parameter are carried out to application software, needing to enter application software
During row test, performance test part can be directly invoked to build test scene and carry out pressure survey to application software, obtained to the application
The performance test results of software.
Due to, without manual creation test environment, but directly invoking the performance created in the scheme of the embodiment of the present application
Test block builds test scene, can effectively improve the testing efficiency to application software, high even in application software renewal frequency
In the case of, the performance of application software can also be tested in time, avoided due to performance using the scheme of the embodiment of the present application
The problem of test delay causes application software operation exception.
It should be noted that the embodiment of the present application is retouched exemplified by carrying out performance test to an application software to be measured
State, but the scheme of the embodiment of the present application is also not necessarily limited to parallel test the performance of multiple application software to be measured, for each
The test mode of application software to be measured is identical.
The scheme of the application is described in detail with reference to specific embodiment.
Embodiment one：
The embodiment of the present application one describes a kind of scheme for creating performance test part, and performance test is being carried out to application software
Perform, comprise the following steps before：
The first step：Resource is distributed for the performance test part of establishment.
In this step, it can be that performance test part to be created distributes resource, such as distribute memory space for performance test part
Deng.
Second step：Generated in the performance test part of establishment between the performance test part and its targeted application software
Incidence relation.
Because performance test part creates for a certain application software, therefore, can establish the performance test part with should should
With the incidence relation between software, i.e.,：The mark of application software of the record with incidence relation in performance test part.
On the one hand, a performance test block can provide service for the performance test of at least one application software, therefore, one
Performance test part can establish incidence relation with least one application software；On the other hand, the test environment of an application software needs
Built by least one performance test part, therefore, an application software can be established with least one performance test part to be associated
System.
3rd step：Test script and running environment of the generation for the application software of association in the performance test part of establishment
Parameter.
By taking " checking product details " this application software A as an example, the test script of establishment is " calling application software A, is initiated
Check the request of product details ", i.e. generation pressure surveys request, if the path for calling application software A is www.aliexpress.com,
The pressure then generated surveys request to call www.aliexpress.com.
The running environment parameter of establishment may include that pressure surveys the time（Such as 15 minutes）, concurrent user number（As 10 users are parallel
The request of product details is checked in initiation）Deng.
4th step：The triggered time is generated in the performance test part of establishment.
This step is to create the preferred steps of performance test part, and the triggered time can be considered the operation of the performance test part
Time, i.e.,：The trigger condition of the application software performance test associated with the performance test part, upon activation between when reaching, the property
Can test block can automatic running, build test environment for application software, the performance of application software tested.
Such as：If the triggered time is 8:00 and 20:00, represent whenever 8:00 or 20:During 00 arrival, it can automatically be invoked at and work as
The preceding moment has the trunk code of the application software of incidence relation, and compiles automatically and build test environment, utilizes test script
Pressure survey is carried out to the trunk code of calling with running environment parameter.
Four steps create the obtained content schematic diagram of performance test part as shown in Fig. 2 wherein more than, test script
（Survey is such as pressed to ask）With running environment parameter（Such as press and survey time, concurrent user number）It is the key element for press survey process；During triggering
Between as optional parameters be triggering pressure survey condition, when run for specified performance test block；Performance test part and application are soft
The incidence relation of part shows which application software performance test part belongs to, so as to carry out performance survey to a certain application software
Suitable performance test part is chosen during examination.
The present embodiment one not to more than second and third, the sequencing of four steps be defined, can perform in any order
Above three step simultaneously generates corresponding parameter, or performs above three step parallel and generate corresponding parameter.
After creating performance test part using the scheme of above-described embodiment one, multiple performance test parts form performance test library.
When needing to test the performance of a certain application software, performance test part can be chosen automatically first, then perform choosing automatically
The performance test part taken, finally automatically analyzes test result, completes the performance test process to application software, specific practice referring to
Embodiment two.
Embodiment two：
As shown in figure 3, for the method and step schematic diagram of performance test, main bag are carried out in the present embodiment two to application software
Include following steps：
Step 101：The performance test part associated with application software to be measured is chosen from performance test storehouse.
The application that there is incidence relation with the performance test part is contained in the performance test part created in embodiment one
The mark of software, therefore, the performance test part for including the application software mark to be measured, choosing can be chosen from performance test storehouse
The performance test part of taking-up is the performance test part associated with application software to be measured.
Assuming that the performance test part chosen in this step 101 is the performance test part shown in Fig. 2, then can be in performance test
The triggered time of part（8:00 and 20:00）During arrival, subsequent step is performed automatically, i.e.,：The triggered time of performance test part is made
For the trigger condition of performance test.
The scheme of the present embodiment can not also be using the triggered time as the trigger condition of performance test, and is made with manual triggering
For the trigger condition of performance test, i.e.,：After this step 101 has been performed, no matter whether the triggered time reaches, it can all trigger manually
Continue executing with subsequent step.
Step 102：Pressure survey is carried out to the trunk code of the application software to be measured using the performance test part of selection.
In this step 102, carry out pressing the trunk code of survey to refer to：In the trunk that current time application software to be measured is newest
Code.
After the newest trunk code of application software to be measured is obtained, test wrapper is built automatically using the performance test part of selection
Border, and the trunk code of application software to be measured is subjected to pressure survey under the test scene, obtain this and be directed to the application to be measured
The pressure of software surveys result.
For example, application software A to be measured trunk code is carried out with the test scene that the performance test part shown in Fig. 2 is built
When pressure is surveyed, 10 requests for checking product details are initiated to www.aliexpress.com paths parallel, after continuing 15 minutes, are obtained
Result is surveyed to the pressure to application software A to be measured.
The pressure surveys result and includes but is not limited to herein below：
Trunk code release number, average response duration, completion number of transactions per second（TPS）, error rate.
Step 103：Pressure is surveyed into result compared with given threshold, determines the performance of the application software to be measured.
Different according to the content that pressure survey result includes, the content being compared in this step 103 is also different, is surveyed below with pressing
As a result it is trunk code release number, average response duration, illustrates exemplified by TPS.
Specific executive mode in this step 103 includes but is not limited to following two modes：
Mode one：This pressure is surveyed into result compared with default baseline results, result and baseline knot are surveyed in this pressure
When the difference satisfaction first of fruit imposes a condition, determine that the performance of application software to be measured is affected.
The baseline results refer to the performance reference value of application software, are often referred to application software under special scenes（Such as perseverance
Fixed number of concurrent, constant duration）Performance indications, the theoretic performance of the application software can be reflected.Baseline results bag
Include but be not limited to average response duration, TPS, error rate.
Described first imposes a condition for reflecting whether the difference that this pressure surveys result and baseline results is larger, if difference
It is larger, it is determined that this pressure surveys result and the difference of baseline results meets that first imposes a condition.Result and baseline knot are surveyed according to pressure
The content of fruit is different, described first impose a condition it is also different.For example, if the content that pressure is surveyed in result and baseline results is rung to be average
Duration is answered, then the difference for the average response duration that this pressure surveys result and baseline results is more than setting value（Such as 10%）When, it is believed that meet
First imposes a condition.
Assuming that table 1 is the baseline results of application software to be measured, table 2 carries out the pressure after pressure survey to application software to be measured for this
Survey result.
| Performance test part title | Average response duration（ms） | TPS | Maximum deviation |
| 123 | 85.0 | 116.0 | 10% |
Table 1
| Performance test part title | Average response duration（ms） | TPS | Trunk code release number |
| 123 | 88.0 | 110.0 | 225578 |
Table 2
For the content in Tables 1 and 2, this pressure can be surveyed to the average response duration in result and putting down in baseline results
Equal response time is compared, and, the TPS that this pressure is surveyed in result is compared with the TPS in baseline results.If appoint
The deviation of one comparative result is excessive, and such as larger than 10%, then it is assumed that the performance of application software to be measured is affected, can be according to this pressure
The version number of trunk code used in survey determines the renewal done recently to the application software, and reports renewal defect.
, therefore, can be according to used in being surveyed this pressure because each renewal of trunk code can all record a version number
The version number of trunk code determines the renewal done recently to the application software.SVN Version Control sides can be used in the present embodiment
Formula, certainly, the present embodiment are also not necessarily limited to other Version Control modes, such as git, cvs.
Land use systems one can effectively prevent performance gradual change, because：
The renewal process of the trunk code of application software has more new content few but updates frequently characteristic, every time more new capital
It is to be carried out around small function point, therefore, although renewal is simultaneously little to the performance impact of application software every time, with more
New number is continuously increased, and the performance impact of application software is also constantly increasing, until there is performance bottleneck.Such as shown in Fig. 4,
T1~T4 times are updated to application software A trunk code respectively, and application software A trunk code is updated every time
When, application software A performance can decline 3%, although renewal is smaller to application software A performance impact every time, 4 times are more
Application software A accumulative hydraulic performance decline is caused to reach 12% after new.
In mode one, the pressure obtained every time is surveyed into result compared with baseline results, can be exceeded in the performance of gradual change
During the maximum deviation set in baseline results, it is believed that the performance of application software is affected, and reports renewal defect.Such as Fig. 5 institutes
Show, it is assumed that a length of 80ms during average response in baseline results, after 4 renewal operations shown in Fig. 4, renewal operation every time
The average response duration of application software will be caused to increase, after 3 times renewal operation, though the average response duration of application software
So increase but owe the average response time having more than in baseline results, after the 4th renewal, during the average response of application software
The long average response time exceeded in baseline results, and difference is more than 10%, it is therefore contemplated that the performance of application software is affected,
And report renewal defect.
Mode two：This pressure is surveyed into result with the last survey of pressure after the pressure survey result that carries out the application software to be measured to enter
Row compares, and when the difference satisfaction second that pressure twice surveys result imposes a condition, determines that the performance of application software is affected.
Described second imposes a condition for reflecting whether the difference of the result of pressure survey twice is larger, if difference is larger, really
This fixed pressure surveys result and presses the difference for surveying result to meet that second imposes a condition with last.It is different that the content of result is surveyed according to pressure,
Described second impose a condition it is also different.For example, if the content that pressure surveys result is average response duration, pressure surveys the flat of result twice
The difference of equal response time is more than setting value（Such as 10%）When, it is believed that meet that second imposes a condition.
Assuming that table 3 carries out the pressure after pressure survey to application software to be measured for the last time surveys result.
| Performance test part title | Average response duration（ms） | TPS | Trunk code release number |
| 123 | 87.0 | 113.0 | 225577 |
Table 3
For the content in table 2 and table 3, the average response duration that pressure is surveyed in result twice can be compared, and, will
The TPS that pressure is surveyed in result twice is compared.If the deviation of any comparative result is excessive, such as larger than 10%, then it is assumed that to be measured to answer
It is affected, the version number of trunk code can be determined according to used in being surveyed this pressure recently to this using soft with the performance of software
The renewal that part is done, and report renewal defect.
Land use systems two can effectively ensure the whether affected real-time of performance, because：
Baseline results are usually changeless, and therefore, the situation of aging easily occur in baseline results.And the last time obtains
Pressure survey result and be continuous execution with performance test process and real-time update, therefore, the performance that Land use systems two obtain
Influenceing result has higher real-time.
Preferably, the scheme of the present embodiment is also not necessarily limited to the scheme for being combined together mode one and mode two, i.e.,：First
Whether the performance of a pair of application software to be measured of Land use systems, which is affected, is judged；Do not determine to treat in the result of Land use systems one
The performance of application software is surveyed when being affected, mode two is continued with and whether the performance of application software to be measured is affected progress
Judge.
The scheme that mode one and mode two are combined together can prevent performance gradual change simultaneously and whether improve performance by shadow
Loud real-time, meanwhile, it also according to mode one and the result of determination of the association schemes of mode two, can accurately know the property of application software
Can variation tendency, constantly correct baseline results using the performance change trend, the problem of avoiding baseline results aging.
Embodiment three：
As shown in fig. 6, for the structural representation of performance test apparatus in the present embodiment three, the equipment includes：Test block
Module 11, pressure survey module 12 and performance determining module 13 are chosen, wherein：
Test block chooses module 11 and is used to choose the performance test part associated with application software to be measured from performance test storehouse,
Test script and running environment parameter are included in the performance test part；Pressure is surveyed module 12 and is used to be surveyed using the performance chosen
Test specimen carries out pressure survey to the trunk code of the application software to be measured；Performance determining module 13 is used to pressure surveying result and setting threshold
Value is compared, and determines the performance of the application software to be measured.
Test block chooses module, is associated specifically for also including to have with the performance test part in the performance test part
During the mark of the application software of relation, the performance test for including the application software mark to be measured is chosen from performance test storehouse
Part.
The equipment also includes trigger module 14, tactile for having in the running environment parameter that is included in the performance test part
When sending out the time, it is determined that the pressure is triggered when reaching the triggered time surveys module 12.
Performance determining module 13 can determine the performance of the application software to be measured by two ways：
1st, the pressure survey result that performance determining module 13 is specifically used for obtaining after this pressure is surveyed is entered with default baseline results
Row compares, and when the difference satisfaction first of this pressure survey result and baseline results imposes a condition, determines the property of application software to be measured
It can be affected.
2nd, the pressure that performance determining module 13 is specifically used for obtaining after this pressure is surveyed surveys result with the last time to described to be measured
Application software carries out the survey of the pressure after pressure survey result and is compared, when the difference satisfaction second that pressure twice surveys result imposes a condition,
Determine that the performance of application software to be measured is affected.
Using the scheme of each embodiment of the application, following effect can obtain：
1）, improve testing efficiency.The scheme of the embodiment of the present application is by creating performance test part, fixed performance test wrapper
Border, without carrying out manual creation test environment during test every time, improve testing efficiency.Meanwhile by being introduced into performance test part
Triggered time, can timing the trunk code of application software is tested, without manpower intervention, it is not required that manual evaluation
Whether need to be tested.
2）, stable test environment.In the scheme of the embodiment of the present application, because test environment is by being pre-created
Performance test part is built, and the attribute such as test script and running environment parameter in performance test part is constant, is built
Test environment is a metastable test environment, and therefore, pressure surveys result and has more reference significance, will not be by real net
Network topological environmental or the interference of flowing of access change.
3）, prevention gradual change performance issue.In the scheme of the embodiment of the present application, by setting baseline results, to prevent
Performance deficiency gradual change problem that may be present, accumulative performance change will be showed by the comparison with baseline results.
It should be understood by those skilled in the art that, embodiments herein can be provided as method, system or computer program
Product.Therefore, the application can use the reality in terms of complete hardware embodiment, complete software embodiment or combination software and hardware
Apply the form of example.Moreover, the application can use the computer for wherein including computer usable program code in one or more
Usable storage medium（Including but not limited to magnetic disk storage, CD-ROM, optical memory etc.）The computer program production of upper implementation
The form of product.
The application is with reference to method, the equipment according to the embodiment of the present application（System）And the flow of computer program product
Figure and/or block diagram describe.It should be understood that can be by every first-class in computer program instructions implementation process figure and/or block diagram
Journey and/or the flow in square frame and flow chart and/or block diagram and/or the combination of square frame.These computer programs can be provided
The processors of all-purpose computer, special-purpose computer, Embedded Processor or other programmable data processing devices is instructed to produce
A raw machine so that produced by the instruction of computer or the computing device of other programmable data processing devices for real
The device for the function of being specified in present one flow of flow chart or one square frame of multiple flows and/or block diagram or multiple square frames.
These computer program instructions, which may be alternatively stored in, can guide computer or other programmable data processing devices with spy
Determine in the computer-readable memory that mode works so that the instruction being stored in the computer-readable memory, which produces, to be included referring to
Make the manufacture of device, the command device realize in one flow of flow chart or multiple flows and/or one square frame of block diagram or
The function of being specified in multiple square frames.
These computer program instructions can be also loaded into computer or other programmable data processing devices so that counted
Series of operation steps is performed on calculation machine or other programmable devices to produce computer implemented processing, so as in computer or
The instruction performed on other programmable devices is provided for realizing in one flow of flow chart or multiple flows and/or block diagram one
The step of function of being specified in individual square frame or multiple square frames.
In a typical configuration, the computer equipment includes one or more processors (CPU), input/output
Interface, network interface and internal memory.Internal memory may include the volatile memory in computer-readable medium, random access memory
The form such as device (RAM) and/or Nonvolatile memory, such as read-only storage (ROM) or flash memory (flash RAM).Internal memory is to calculate
The example of machine computer-readable recording medium.Computer-readable medium includes permanent and non-permanent, removable and non-removable media can be with
Realize that information stores by any method or technique.Information can be computer-readable instruction, data structure, the module of program or
Other data.The example of the storage medium of computer includes, but are not limited to phase transition internal memory (PRAM), static RAM
(SRAM), dynamic random access memory (DRAM), other kinds of random access memory (RAM), read-only storage
(ROM), Electrically Erasable Read Only Memory (EEPROM), fast flash memory bank or other memory techniques, read-only optical disc are read-only
Memory (CD-ROM), digital versatile disc (DVD) or other optical storages, magnetic cassette tape, tape magnetic rigid disk storage or
Other magnetic storage apparatus or any other non-transmission medium, the information that can be accessed by a computing device available for storage.According to
Herein defines, and computer-readable medium does not include the computer readable media (transitory media) of non-standing, such as
The data-signal and carrier wave of modulation.
Although having been described for the preferred embodiment of the application, those skilled in the art once know basic creation
Property concept, then can make other change and modification to these embodiments.So appended claims be intended to be construed to include it is excellent
Select embodiment and fall into having altered and changing for the application scope.
Obviously, those skilled in the art can carry out the essence of various changes and modification without departing from the application to the application
God and scope.So, if these modifications and variations of the application belong to the scope of the application claim and its equivalent technologies
Within, then the application is also intended to comprising including these changes and modification.
Claims (10)
1. a kind of performance test methods, it is characterised in that methods described includes：
Incidence relation between the application software that generation and the performance test part are directed in the performance test part being pre-created；
The performance test part that there is the incidence relation with application software to be measured, the performance test are chosen from performance test storehouse
Storehouse includes multiple performance test parts, and test script and running environment parameter are included in the performance test part；
Pressure survey is carried out to the trunk code of the application software to be measured using the performance test part of selection；
Pressure is surveyed into result compared with given threshold, determines the performance of the application software to be measured.
2. performance test methods as claimed in claim 1, it is characterised in that also included and the performance in the performance test part
Test block has the mark of the application software of incidence relation；
The performance test part associated with application software to be measured is chosen from performance test storehouse, is specifically included：
The performance test part for including the application software mark to be measured is chosen from performance test storehouse.
3. performance test methods as claimed in claim 1, it is characterised in that the running environment ginseng that the performance test part includes
There is the triggered time in number；
Before carrying out pressure survey to the trunk code of application software to be measured using the performance test part of selection, methods described also includes：
It is determined that reach the triggered time.
4. the performance test methods as described in claims 1 to 3 is any, it is characterised in that pressure is surveyed into result and entered with given threshold
Row compares, and determines the performance of the application software to be measured, specifically includes：
The pressure obtained after this pressure is surveyed surveys result compared with default baseline results, and result and baseline knot are surveyed in this pressure
When the difference satisfaction first of fruit imposes a condition, determine that the performance of application software to be measured is affected.
5. the performance test methods as described in claims 1 to 3 is any, it is characterised in that pressure is surveyed into result and entered with given threshold
Row compares, and determines the performance of the application software to be measured, specifically includes：
The pressure obtained after this pressure survey is surveyed into result the survey result of the pressure after pressure survey is carried out to the application software to be measured with last
It is compared, when the difference satisfaction second that pressure twice surveys result imposes a condition, determines the performance of application software to be measured by shadow
Ring.
6. a kind of performance test apparatus, it is characterised in that generation and the performance test in the performance test part being pre-created
Incidence relation between the application software that part is directed to；The equipment includes：
Test block chooses module, for choosing the performance for having the incidence relation with application software to be measured from performance test storehouse
Test block, the performance test storehouse include multiple performance test parts, test script and operation ring are included in the performance test part
Border parameter；
Pressure surveys module, for being pressed using the performance test part of selection the trunk code of the application software to be measured
Survey；
Performance determining module, for pressure to be surveyed into result compared with given threshold, determine the performance of the application software to be measured.
7. performance test apparatus as claimed in claim 6, it is characterised in that
Test block chooses module, has incidence relation with the performance test part specifically for also being included in the performance test part
Application software mark when, the performance test part for including the application software to be measured mark is chosen from performance test storehouse.
8. performance test apparatus as claimed in claim 6, it is characterised in that the equipment also includes：
Trigger module, during for having the triggered time in the running environment parameter that is included in the performance test part, it is determined that reaching institute
The pressure is triggered when stating the triggered time and surveys module.
9. the performance test apparatus as described in claim 6~8 is any, it is characterised in that
Performance determining module, result is surveyed compared with default baseline results specifically for the pressure obtained after this pressure is surveyed,
When the difference satisfaction first of this pressure survey result and baseline results imposes a condition, determine the performance of application software to be measured by shadow
Ring.
10. the performance test apparatus as described in claim 6~8 is any, it is characterised in that
Performance determining module, result is surveyed with the last time to the application software to be measured specifically for the pressure obtained after this pressure is surveyed
Carry out the survey of the pressure after pressure survey result to be compared, when the difference satisfaction second that pressure twice surveys result imposes a condition, determine to be measured
The performance of application software is affected.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310195624.9A CN104182333B (en) | 2013-05-23 | 2013-05-23 | A kind of performance test methods and equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310195624.9A CN104182333B (en) | 2013-05-23 | 2013-05-23 | A kind of performance test methods and equipment |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN104182333A CN104182333A (en) | 2014-12-03 |
| CN104182333B true CN104182333B (en) | 2018-03-09 |
Family
ID=51963399
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201310195624.9A Active CN104182333B (en) | 2013-05-23 | 2013-05-23 | A kind of performance test methods and equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN104182333B (en) |
Families Citing this family (20)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105764070A (en) * | 2014-12-15 | 2016-07-13 | 华为技术有限公司 | Scene map training and wireless network testing methods and device |
| CN104579825A (en) * | 2014-12-18 | 2015-04-29 | 百度在线网络技术（北京）有限公司 | Method and device for monitoring server of application in real time and computer equipment |
| CN104778123B (en) * | 2015-03-30 | 2017-08-25 | 微梦创科网络科技（中国）有限公司 | A kind of method and device of detecting system performance |
| CN106201856A (en) * | 2015-05-04 | 2016-12-07 | 阿里巴巴集团控股有限公司 | A kind of multi version performance test methods and device |
| CN105224432B (en) * | 2015-11-11 | 2018-03-23 | 中国建设银行股份有限公司 | A kind of performance test method for parameter configuration, device, forcing press and system |
| CN106802856B (en) * | 2015-11-26 | 2020-02-04 | 腾讯科技（深圳）有限公司 | Performance testing method of game application program, server and game application client |
| CN105512041B (en) * | 2015-12-23 | 2018-09-25 | 北京金山安全软件有限公司 | Method and device for testing application program performance and electronic equipment |
| CN107153601B (en) * | 2016-03-02 | 2021-04-09 | 阿里巴巴集团控股有限公司 | Unit performance test method and device |
| CN107220171A (en) * | 2016-03-22 | 2017-09-29 | 阿里巴巴集团控股有限公司 | The method of testing and device of a kind of virtual machine |
| CN107480040A (en) * | 2016-06-08 | 2017-12-15 | 阿里巴巴集团控股有限公司 | Workflow stability test method and apparatus |
| CN106776337A (en) * | 2016-12-29 | 2017-05-31 | 北京金山安全软件有限公司 | Performance analysis method and device and electronic equipment |
| CN108874637A (en) * | 2017-05-09 | 2018-11-23 | 北京京东尚科信息技术有限公司 | A kind of method of pressure test, system, electronic equipment and readable storage medium storing program for executing |
| WO2018227548A1 (en) * | 2017-06-16 | 2018-12-20 | Alibaba Group Holding Limited | Analyzing performance impact of system update |
| CN108255715B (en) * | 2018-01-08 | 2021-02-09 | 平安普惠企业管理有限公司 | Test result processing method and terminal equipment |
| CN110716830B (en) * | 2018-07-12 | 2023-04-18 | 中移（杭州）信息技术有限公司 | Pressure measuring machine selection method and device, electronic equipment and storage medium |
| CN111104304A (en) * | 2018-10-25 | 2020-05-05 | 武汉斗鱼网络科技有限公司 | Multi-task scene performance testing method, storage medium, electronic device and system |
| CN109669874A (en) * | 2018-12-28 | 2019-04-23 | 广州君海网络科技有限公司 | A kind of game services end pressure test platform and test method |
| CN110780990A (en) * | 2019-09-12 | 2020-02-11 | 中移（杭州）信息技术有限公司 | Performance detection method, performance detection device, server and storage medium |
| CN110514980A (en) * | 2019-09-20 | 2019-11-29 | 上海华力微电子有限公司 | The generation method and device of wafer-level test scheme |
| CN111400186B (en) * | 2020-03-19 | 2023-05-05 | 时时同云科技(成都)有限责任公司 | Performance test method and system |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101576846A (en) * | 2008-05-09 | 2009-11-11 | 北京世纪拓远软件科技发展有限公司 | Method for testing software performance |
| CN102075384A (en) * | 2010-12-20 | 2011-05-25 | 创新科存储技术有限公司 | Performance test system and method |
Family Cites Families (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1987819A (en) * | 2005-12-21 | 2007-06-27 | 三星电子株式会社 | Selective test method and test apparatus thereof |
| CN101174240B (en) * | 2006-11-03 | 2011-04-06 | 凌阳科技股份有限公司 | Software testing management method and system thereof |
| CN101373446B (en) * | 2007-08-24 | 2011-05-04 | 英业达股份有限公司 | Method for testing pressure of file system |
| CN101625658B (en) * | 2009-08-04 | 2011-01-12 | 卓望信息技术(北京)有限公司西城分公司 | Method for testing software system performance |
| CN101727390A (en) * | 2009-12-28 | 2010-06-09 | 金蝶软件（中国）有限公司 | Method and device for debugging performance test scripts |
-
2013
- 2013-05-23 CN CN201310195624.9A patent/CN104182333B/en active Active
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101576846A (en) * | 2008-05-09 | 2009-11-11 | 北京世纪拓远软件科技发展有限公司 | Method for testing software performance |
| CN102075384A (en) * | 2010-12-20 | 2011-05-25 | 创新科存储技术有限公司 | Performance test system and method |
Also Published As
| Publication number | Publication date |
|---|---|
| CN104182333A (en) | 2014-12-03 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN104182333B (en) | A kind of performance test methods and equipment | |
| US20220171687A1 (en) | Monitoring performance of computing systems | |
| US11829287B2 (en) | Customizing computer performance tests | |
| US9626272B2 (en) | Prediction of impact of workload migration | |
| EP3757793A1 (en) | Machine-assisted quality assurance and software improvement | |
| CN108463973A (en) | Fingerprint recognition basic reason is analyzed in cellular system | |
| CN107688899A (en) | Business process monitoring method and device | |
| CN112181804B (en) | Parameter verification method, device and storage medium | |
| US20170153963A1 (en) | Method and System for Pre-Deployment Performance Estimation of Input-Output Intensive Workloads | |
| EP3178004B1 (en) | Recovering usability of cloud based service from system failure | |
| CN106933709A (en) | A kind of method of testing and device | |
| US8725461B2 (en) | Inferring effects of configuration on performance | |
| US20200097579A1 (en) | Detecting anomalous transactions in computer log files | |
| TWI734746B (en) | Method and device for simulating online pressure test | |
| CN104298589B (en) | A kind of performance test methods and equipment | |
| CN103049374B (en) | Automatic testing method and device | |
| CN113641526A (en) | Alarm root cause positioning method and device, electronic equipment and computer storage medium | |
| CN106843111B (en) | The accurate source tracing method of hydrocarbon production system alarm signal root primordium and device | |
| CA2811617A1 (en) | Commit sensitive tests | |
| US20160036670A1 (en) | Detection of outage in cloud based service using synthetic measurements and anonymized usage data | |
| EP4066115A1 (en) | System and method for anomaly detection and root cause automation using shrunk dynamic call graphs | |
| CN105701002B (en) | A kind of recording method and device of the execution route based on test | |
| CN110782276A (en) | Access shunting policy interference judgment method and device and electronic equipment | |
| CN110427312A (en) | A kind of method, equipment and the storage medium of test database performance | |
| CN105630666B (en) | Software quality improvement method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20240221 Address after: Singapore Patentee after: Alibaba Singapore Holdings Ltd. Country or region after: Singapore Address before: Cayman Islands Grand Cayman capital building, a four storey No. 847 mailbox Patentee before: ALIBABA GROUP HOLDING Ltd. Country or region before: Cayman Islands |
|
| TR01 | Transfer of patent right |