CN104298589A - Performance test method and performance test equipment - Google Patents
Performance test method and performance test equipment Download PDFInfo
- Publication number
- CN104298589A CN104298589A CN201310298145.XA CN201310298145A CN104298589A CN 104298589 A CN104298589 A CN 104298589A CN 201310298145 A CN201310298145 A CN 201310298145A CN 104298589 A CN104298589 A CN 104298589A
- Authority
- CN
- China
- Prior art keywords
- performance test
- test part
- application software
- code
- measured
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Landscapes
- Stored Programmes (AREA)
- Debugging And Monitoring (AREA)
Abstract
The invention discloses a performance test method and performance test equipment. Main contents are as follows: a performance test piece is created for each piece of application software in advance, so that when performance test is respectively carried out on a main code and a branch code of the application software, the performance test piece can be directly transferred to build a test scene; when the selected performance test piece cannot cause environmental warfare to the current running performance test piece, the test scene built by the selected performance test piece is utilized to carry out pressure measurement on the main code and the branch code of the application software, and manual creation of the test environment is not required, so that the test efficiency of the application software and accuracy of the performance test of the application software are effectively improved.
Description
Technical field
The present invention relates to field of computer technology, particularly relate to a kind of performance test methods and equipment.
Background technology
After applied software development, the software code of application software will in Website server on-line running, user can Website login server use the application service that the software code run provides.For this application software of " checking product details " in shopping website (follow-up be referred to as application software A), the software code of application software A runs in the server of shopping website, after user logs in this server, this application software A is called, to obtain the application service checking a certain product details by the input interface (" details " button as on the page) on the page.
In the performance history of major applications software, need constantly to create or revise some should be used for realizing business function, therefore, mostly version control information can be comprised in the code of application software, a version number can be recorded when the code of application software changes, change process for recording this code, SVN, git, cvs etc. are the Version Control software that industry is relatively commonly used.
The code of application software changes and comprises two aspects, and one is that the trunk code of application software changes, and another is that the branch code of application software changes.Described branch code refers to the code disposed in applied software development process, and described trunk code refers to that branch code is reached the standard grade and is applied to the code that true environment disposes.When application software need to modify wait alter operation time, first need the change carrying out respective code in branch code, and then the branch code after change reached the standard grade and is applied to trunk code, realize the corresponding change of trunk code.In fact, adverse effect may be caused to the performance of trunk code after trunk code is changed, therefore, before being reached the standard grade by branch code and being applied to trunk code, need the change assessing branch code which kind of can cause affect on the performance of trunk code.
At present, the mode of test can be adopted to assess the change of branch code to the performance impact of trunk code, that is: the trunk code dry run environment for not changing, tests the performance of trunk code under this running environment, obtains benchmark test data; Again for the branch code after change simulates identical running environment, the performance of test branch code under this running environment, obtain contrast test data, the results of property of twice test compared, which kind of performance impact the change of assessment branch code can bring to trunk code.
The specific practice of above-mentioned test mode as shown in Figure 1, mainly comprises following flow process:
The first step: after changing the branch code of application software, assesses the need of carrying out performance test.
Concrete assessment is according to being: when many to the content alteration of branch code when this or after upgrading branch code operationally occurs abnormal, can think and need to carry out performance test processes.
Second step: manual creation test scene.
In this step, according to the function that application software to be measured need be tested, create test scene respectively, as the function 1 of application software A and the performance need test of function 2, two test scenes will be created for function 1 and function 2 respectively.
For the test scene for function 1, following operation is comprised to the constructive process of this test scene:
First generating the test script of calling function 1, is then the operational process configuration operation environmental parameter of function 1, as parameters such as test duration, test pressures (parallel trigger quantity), to create the test scene for function 1.
3rd step: the branch code of application software to be measured and trunk code are carried out pressure respectively under the test scene created and surveys.
In this step, the branch code of application software to be measured is the branch code after this application software last update.
4th step: twice pressure is surveyed result and compares, determine the performance impact degree of the change of branch code to trunk code.
Above-mentioned performance test methods can reflect the influence degree caused the performance of renewal rewards theory to application software of application software to a certain extent, but, manual creation test scene needs the time of at substantial, if one time test process relates to 3 test scenes, then need to create 3 test scenes respectively to the test process of trunk code and branch code respectively, altogether to create 6 test scenes, when annual tens thousand of renewal rewards theory, all will in the manner described above respectively for trunk code and branch code manual creation test scene for each renewal rewards theory, testing efficiency can be caused low, and also easily there is error in the mode of this each manual creation test scene, the accuracy of testing is caused to be affected.
Summary of the invention
The embodiment of the present application provides a kind of performance test methods and equipment, exists the trunk code of application software and the performance test inefficiency of branch code and the lower problem of accuracy in order to solve in prior art.
The embodiment of the present application provides a kind of performance test methods, and described method comprises:
From performance test storehouse, choose the performance test part associated with application software to be measured, in described performance test part, comprise test script and running environment parameter;
Detect the first detection perform test block that application software that the application software that whether there is association in the current performance test part run associates with the described performance test part chosen has common factor;
If do not exist, then utilize the described performance test part chosen to carry out pressure respectively to the trunk code of described application software to be measured and branch code and survey; Otherwise, after waiting for the first detection perform test block end of run, recycle the described performance test part chosen and pressure survey carried out respectively to the trunk code of described application software to be measured and branch code;
By relatively surveying to the pressure of trunk code and branch code the performance that result determines described application software to be measured.
As can be seen from said method, owing to passing through to create performance test part structural behavior test library for each application software in advance, make when needing to carry out performance test respectively to the trunk code of application software and branch code, directly can choose performance test part according to the testing requirement of application software to be measured from performance test storehouse and build test scene, during environmental warfare in the performance test part chosen can not cause association application software to the current performance test part run, the test scene utilizing the described performance test part chosen to build carries out pressure to the trunk code of application software and branch code and surveys, and without the need to manual creation test environment, effectively can improve the accuracy of testing efficiency to application software and application software performance test.
Preferably, utilizing before the described performance test part chosen carries out pressure survey respectively to the trunk code of described application software to be measured and branch code, described method also comprises:
Determine the data source that the described performance test part chosen is corresponding and the weighted value that the performance test part chosen relies on this data source;
When detecting in the current performance test part run that there is the corresponding data source data source corresponding with the described performance test part chosen has the second detection perform test block of common factor, whether the performance test part that judgement is chosen and the second detection perform test block are greater than setting threshold value to the weighted value sum that the described data source of occuring simultaneously relies on, if, after then waiting for the second detection perform test block end of run, recycle the described performance test part chosen and pressure survey is carried out respectively to the trunk code of described application software to be measured and branch code; Otherwise, utilize the described performance test part chosen to carry out pressure respectively to the trunk code of described application software to be measured and branch code and survey.
Carry out pressure survey again owing to can not cause the current performance test part run at the performance test part chosen during the environmental warfare in corresponding data source, the insignificant operation that environmental warfare brings can be reduced.
Preferably, utilizing before the described performance test part chosen carries out pressure survey respectively to the trunk code of described application software to be measured and branch code, described method also comprises:
The trunk code of described application software to be measured and branch code are detected, determines that this trunk code and branch code can normally run.
Before being surveyed by pressure, the trunk code of application software to be measured and the availability of branch code are detected, insignificant pressure can be reduced and survey operation.
Preferably, the triggered time is had in the running environment parameter that described performance test part comprises;
Before choose the performance test part associated with application software to be measured from performance test storehouse, described method also comprises:
Determine to arrive the described triggered time.
Survey as running pressure the condition operated by the triggered time, can detect the performance issue that may exist according to the actual requirements, without the need to manual intervention, operability is high.
The embodiment of the present application also provides a kind of performance test methods, and described method comprises:
The performance test part associated with application software to be measured is chosen from performance test storehouse, and determine the data source that the described performance test part chosen is corresponding and the weighted value that the performance test part chosen relies on this data source, comprise test script and running environment parameter in described performance test part;
Detect in the current performance test part run and whether there is the detection perform test block that the corresponding data source data source corresponding with the described performance test part chosen has common factor;
If do not exist, then utilize the described performance test part chosen to carry out pressure respectively to the trunk code of described application software to be measured and branch code and survey; If exist, then judge whether the performance test part chosen and the performance test part detected are greater than setting threshold value to the weighted value sum that the described data source of occuring simultaneously relies on;
If be greater than setting threshold value, then after waiting for the detection perform test block end of run detected, recycle the described performance test part chosen and pressure survey is carried out respectively to the trunk code of described application software to be measured and branch code; Otherwise, utilize the described performance test part chosen to carry out pressure respectively to the trunk code of described application software to be measured and branch code and survey.
As can be seen from said method, owing to passing through to create performance test part structural behavior test library for each application software in advance, make when needing to carry out performance test respectively to the trunk code of application software and branch code, directly can choose performance test part according to the testing requirement of application software to be measured from performance test storehouse and build test scene, when the performance test part chosen can not cause the environmental warfare in corresponding data source to the current performance test part run, the test scene utilizing the described performance test part chosen to build carries out pressure to the trunk code of application software and branch code and surveys, and without the need to manual creation test environment, effectively can improve the accuracy of testing efficiency to application software and application software performance test.
The embodiment of the present application also provides a kind of performance test apparatus, and described equipment comprises:
Test block chooses module, for choosing the performance test part associated with application software to be measured from performance test storehouse, comprises test script and running environment parameter in described performance test part;
First environment detection module, the application software associated with the described performance test part chosen for detecting the application software that whether there is association in the current performance test part run has the first detection perform test block of common factor;
Pressure surveys module, for when described first environment detection module determines to there is not described first detection perform test block, utilizes the described performance test part chosen to carry out pressure respectively to the trunk code of described application software to be measured and branch code and surveys; Otherwise, after waiting for the first detection perform test block end of run, recycle the described performance test part chosen and pressure survey carried out respectively to the trunk code of described application software to be measured and branch code;
Performance determination module, for by relatively surveying to the pressure of trunk code and branch code the performance that result determines described application software to be measured.
As can be seen from said system, owing to passing through to create performance test part structural behavior test library for each application software in advance, make when needing to carry out performance test respectively to the trunk code of application software and branch code, directly can choose performance test part according to the testing requirement of application software to be measured from performance test storehouse and build test scene, during environmental warfare in the performance test part chosen can not cause association application software to the current performance test part run, the test scene utilizing the described performance test part chosen to build carries out pressure to the trunk code of application software and branch code and surveys, and without the need to manual creation test environment, effectively can improve the accuracy of testing efficiency to application software and application software performance test.
Preferably, described equipment also comprises:
Second environment detection module, for determining the data source that the described performance test part chosen is corresponding and the weighted value that the performance test part chosen relies on this data source, when detecting in the current performance test part run that there is the corresponding data source data source corresponding with the described performance test part chosen has the second detection perform test block of common factor, judge whether the performance test part chosen and the weighted value sum of the second detection perform test block to the described data source dependence of occuring simultaneously are greater than setting threshold value;
Pressure surveys module, time also for being greater than setting threshold value in described second environment detection module determination weighted value sum, after waiting for the second detection perform test block end of run, recycle the described performance test part chosen and pressure survey is carried out respectively to the trunk code of described application software to be measured and branch code; Otherwise, utilize the described performance test part chosen to carry out pressure respectively to the trunk code of described application software to be measured and branch code and survey.
Carry out pressure survey again owing to can not cause the current performance test part run at the performance test part chosen during the environmental warfare in corresponding data source, the insignificant operation that environmental warfare brings can be reduced.
Preferably, described equipment also comprises:
Detecting module, for detecting the trunk code of described application software to be measured and branch code, determines whether this trunk code and branch code can normally run.
Before being surveyed by pressure, the trunk code of application software to be measured and the availability of branch code are detected, insignificant pressure can be reduced and survey operation.
Preferably, the triggered time is had in the running environment parameter that described performance test part comprises;
Described test block chooses module, during specifically for determining to arrive the described triggered time, chooses the performance test part associated with application software to be measured from performance test storehouse.
Survey as running pressure the condition operated by the triggered time, can detect the performance issue that may exist according to the actual requirements, without the need to manual intervention, operability is high.
The embodiment of the present application also provides a kind of performance test apparatus, and described equipment comprises:
Test block chooses module, for choosing the performance test part associated with application software to be measured from performance test storehouse, comprises test script and running environment parameter in described performance test part;
Context detection module, for determining the data source that the described performance test part chosen is corresponding and the weighted value that the performance test part chosen relies on this data source, when detecting in the current performance test part run that there is the corresponding data source data source corresponding with the described performance test part chosen has a performance test part of common factor, judge whether the performance test part chosen and the weighted value sum of performance test part to the described data source dependence of occuring simultaneously detected are greater than setting threshold value;
Pressure surveys module, during for being greater than setting threshold value in described context detection module determination weighted value sum, after waiting for the performance test part end of run detected, recycle the described performance test part chosen and pressure survey is carried out respectively to the trunk code of described application software to be measured and branch code; Otherwise, utilize the described performance test part chosen to carry out pressure respectively to the trunk code of described application software to be measured and branch code and survey;
Performance determination module, for by relatively surveying to the pressure of trunk code and branch code the performance that result determines described application software to be measured.
As can be seen from said system, owing to passing through to create performance test part structural behavior test library for each application software in advance, make when needing to carry out performance test respectively to the trunk code of application software and branch code, directly can choose performance test part according to the testing requirement of application software to be measured from performance test storehouse and build test scene, when the performance test part chosen can not cause the environmental warfare in corresponding data source to the current performance test part run, the test scene utilizing the described performance test part chosen to build carries out pressure to the trunk code of application software and branch code and surveys, and without the need to manual creation test environment, effectively can improve the accuracy of testing efficiency to application software and application software performance test.
Accompanying drawing explanation
Fig. 1 is to the trunk code of application software and the testing process schematic diagram of branch code performance impact in background technology;
Fig. 2 is the schematic diagram of performance test block in the embodiment of the present application one;
Fig. 3 (a) and Fig. 3 (b) is for carrying out the method step schematic diagram of performance test to the trunk code of application software and branch code in the embodiment of the present application two;
Fig. 4 is the structural representation of performance test apparatus in the embodiment of the present application three;
Fig. 5 is the structural representation of performance test apparatus in the embodiment of the present application four.
Embodiment
In the scheme of the embodiment of the present application, performance test part is created in advance for each application software, contain in described performance test part and required test script and running environment parameter when pressure is surveyed are carried out to application software, when needing to test the trunk code of application software and branch code, directly can choose performance test part to build test scene, and whether the performance test part that detection is chosen can cause environmental warfare to the current performance test part run, if environmental warfare can be caused to the current performance test part run, then wait for after causing the performance test part end of run of environmental warfare, recycle the described performance test part chosen and pressure survey (between the performance test part namely chosen and the performance test part conflicted, serial runs) is carried out to the trunk code of application software and branch code, if environmental warfare can not be caused to the current performance test part run, then directly utilize the described performance test part chosen to carry out pressure to the trunk code of application software and branch code and survey (parallel running between the performance test part namely chosen and the current performance test part run), and obtain surveying result to the performance pressure of this application software according to twice pressure survey result.
Due in the scheme of the embodiment of the present application without the need to manual creation test environment, but directly call the performance test part that created to build test scene, effectively can improve the accuracy of testing efficiency to application software and application software performance test, simultaneously, carry out environmental warfare detection between the performance test part called and the current performance test part run, the conflict between can preventing due to performance test part causes insignificant performance to be pressed surveying operation.
It should be noted that, the embodiment of the present application is described to carry out performance test to the trunk code of an application software to be measured and branch code, but the scheme of the embodiment of the present application is also not limited to the parallel trunk code to multiple application software to be measured and branch code performance is tested, and the test mode for each application software to be measured is identical.
Be described in detail below in conjunction with the scheme of specific embodiment to the application.
Embodiment one:
The embodiment of the present application one describes a kind of scheme creating performance test part, performed, comprised the following steps before carrying out performance test to application software:
The first step: be the performance test part Resources allocation created.
In this step, can be performance test part Resources allocation to be created, as being performance test part memory allocated space etc.
Second step: create performance test part in generate this performance test part and its for application software between incidence relation.
Because performance test part creates for a certain application software, therefore, can set up the incidence relation between this performance test part and this application software, that is: in performance test part, record has the mark of the application software of incidence relation.
On the one hand, the performance test that performance test block can be at least one application software provides service, and therefore, a performance test block can be associated with at least one application software relation; On the other hand, the test environment of an application software need be built by least one performance test part, and therefore, an application software can be associated with at least one performance test part relation.
3rd step: generate the test script for the application software of association and running environment parameter in the performance test part created.
For " checking product details " this application software A, the test script created is " calling application software A; initiate the request checking product details ", namely generate pressure and survey request, if the path of calling application software A is www.aliexpress.com, then the pressure generated surveys request for calling www.aliexpress.com.
The running environment parameter created can comprise pressure survey time (as 15 minutes), concurrent user number (initiating to check the request of product details as 10 users walk abreast) etc.
4th step: generate the triggered time in the performance test part created.
This step is the preferred steps creating performance test part, the described triggered time can be considered working time of this performance test part, that is: the trigger condition of the application software performance test associated with this performance test part, when arriving upon activation, this performance test part can run automatically, for application software builds test environment, the performance of application software is tested.
Such as: if the triggered time is 8:00 and 20:00, represent when 8:00 or 20:00 arrives, the trunk code of the application software of incidence relation can be had by Automatically invoked at current time, and automatic compiling build test environment, utilize test script and running environment parameter to carry out pressure to the trunk code called and survey.
Again such as, create test period, take test period as the triggered time, when test period arrives, test block runs automatically.This way that is the triggered time with test period (as one day), can check whether the same day have impact on the performance of trunk code to the change that branch code does, reduce the difficulty of code check, detect the performance issue that may exist faster, meet the quick characteristic of rapid build iterative development, and without the need to manual intervention, operability is high.Meanwhile, performance test process is not limited to after branch code reaches the standard grade and become trunk code, but is applied in the change stage of each branch code, realizes quick early warning.
5th step: the data source corresponding for the performance test part configuration created and this performance test part are to the dependence weighted value of this data source.
Described data source includes but not limited to database, cache file etc., and a performance test block can configure the data source of at least one correspondence, and a data source also can be configured to the data source of at least one performance test part.When performance test part runs, need to read corresponding data from the data source of correspondence.
For each data source that performance test block is corresponding, configure performance test block respectively to the dependence weighted value of this data source, described dependence weighted value represents the degree of dependence of performance test block to data source, and weighted value is higher, and the dependence of performance test part to data source is higher.Such as: corresponding two data sources of performance test part A, be respectively data source 1 and data source 2, wherein, the dependence weighted value of performance test part A to data source 1 is 0.5, is 0.2 to the dependence weighted value of data source 2.Suppose that weighted value is maximum and can be configured to 0.5, represent that data source 1 can only be monopolized by performance test part A; Data source 2 is when being taken by performance test part A, if the dependence weighted value of other performance test parts to data source 2 is not more than 0.3, then data source 2 can also be taken by other performance test parts simultaneously.
Create the content schematic diagram of the performance test part obtained as shown in Figure 2 by above five steps, wherein, test script (as pressure surveys request) and running environment parameter (as pressure survey time, concurrent user number) are the key elements of carrying out pressing survey process; Triggered time is the condition triggering pressure survey as optional parameter, is used to specify performance test part and when runs; The incidence relation of performance test part and application software shows which application software performance test part belongs to, thus can choose suitable performance test part when carrying out performance test to a certain application software; Corresponding data source and the dependence weighted value of this performance test part to this data source represent the data source that performance test block relies on when running and the degree of dependence to data source.
The present embodiment one not to above second and third, four, the sequencing of five steps limits, above-mentioned four steps can be performed in any order and generate corresponding parameter, or above-mentioned four steps of executed in parallel generate corresponding parameter.
After utilizing the scheme of above-described embodiment one to create performance test part, multiple performance test part constructibility energy test library.When needing to test the trunk code of a certain application software and branch code, can first automatically choose performance test part, then automatically perform for the trunk code of application software and branch code the performance test part chosen, last automatic analysis pressure surveys result, complete the Performance comparision process of trunk code to application software and branch code, specific practice is see embodiment two.
Embodiment two:
As shown in Fig. 3 (a) He Fig. 3 (b), for carrying out the method step schematic diagram of performance test in the present embodiment two to the trunk code of application software and branch code, mainly comprise the following steps:
Step 101: choose the performance test part associated with application software to be measured from performance test storehouse.
The mark with this performance test part with the application software of incidence relation is contained in the performance test part created in embodiment one, therefore, can choose the performance test part comprising described application software mark to be measured from performance test storehouse, the performance test part selected is the performance test part associated with application software to be measured.
Suppose that the performance test part chosen in this step 101 is the performance test part shown in Fig. 2, then can when the triggered time of performance test part, (8:00 and 20:00) arrives, automatically perform subsequent step, that is: using the trigger condition of the triggered time of performance test part as performance test.
The scheme of the present embodiment also can not using the triggered time as the trigger condition of performance test, and using manual triggers as the trigger condition of performance test, that is: after executing this step 101, no matter whether the triggered time arrives, all can manual triggers continue to perform subsequent step.
Step 102: check that application software that the application software that whether there is association in the current performance test part run associates with the described performance test part chosen has the first detection perform test block of common factor.
This step 102 is the steps to carrying out environmental warfare detection between the performance test part chosen and the current performance test part run, due to the related application software of each performance test part, therefore, once the application software of multiple performance test part association has common factor, then this multiple performance test part cannot executed in parallel, can only serial perform.
In view of this, this step 102 detects the application software that the performance test part of current operation associates, and determines whether there is the performance test part having common factor with the application software of the performance test part chosen.
If do not exist, represent that the performance test part chosen does not have conflicting of related application software with between the current performance test part run.
If exist, then the performance test part of common factor there is is to be referred to as the first detection perform test block the application software associated with the described performance test part chosen, the performance test part chosen has conflict with affiliated first detection perform test block in the application software associated, must not parallel running, after need waiting for described first detection perform test block end of run, the performance test part chosen could be run.
It should be noted that in the performance test part of current operation, at least one performance test part may be had in the application software associated, to have conflict with the performance test part chosen, namely may there is at least one first detection perform test block.
Such as: the application software of the performance test part association chosen is application software A and application software B, the application software of the current performance test block association run is application software A, the application software of the performance test part association that another runs is application software B, then the performance test part chosen and this two performance test blocks conflict.
Step 103: determine the data source that the described performance test part chosen is corresponding and the weighted value that this performance test part relies on this data source.
Step 104: detect in the current performance test part run and whether there is the second detection perform test block that the corresponding data source data source corresponding with the described performance test part chosen has common factor, if exist, then perform step 105; Otherwise, perform step 107.
This step 104 is also the step to carrying out environmental warfare detection between the performance test part chosen and the current performance test part run, because each performance test part has corresponding data source, therefore, once data source corresponding to multiple performance test part has common factor, and this multiple performance test part is greater than setting threshold value to the weighted value sum that the data source of occuring simultaneously relies on, represent that the data source of occuring simultaneously cannot simultaneously for this multiple performance test part provides service, therefore, this multiple performance test part cannot whole executed in parallel.
In view of this, this step 104 data source corresponding to the performance test part of current operation detects, and determines whether there is the performance test part having common factor with the data source of the performance test part chosen.
If do not exist, represent that the performance test part chosen does not have conflicting of data source with between the current performance test part run.
If exist, then the performance test part of common factor there is to be referred to as the second detection perform test block the data source corresponding with the described performance test part chosen, now, although the second detection perform test block will take identical data source with the performance test part chosen, but because performance test part is different to the degree of dependence of data source, therefore, can't determine whether the second detection perform test block has with the performance test part chosen in data source and conflict, also need further detection.
Step 105: determine whether the performance test part chosen and the second detection perform test block are greater than setting threshold value to the weighted value sum that the described data source of occuring simultaneously relies on, and if so, then perform step 106; Otherwise, perform step 107.
To the weighted value sum that the described data source of occuring simultaneously relies on, the performance test part chosen and the second detection perform test block represent that performance test block and the second detection perform test block are to the summation of the described data source degree of dependence of occuring simultaneously, if when being greater than setting threshold value, then performance test part and the second detection perform test block have conflict in data source, must not parallel running; If be not more than setting threshold value, then performance test part and the second detection perform test block not conflict in data source, can parallel running.
Step 106: if the testing result of step 102 is existence first detection perform test blocks, then wait for the first detection perform test block and the second detection perform test block all after end of run, recycle the described performance test part chosen and pressure survey is carried out respectively to the trunk code of described application software to be measured and branch code;
If the testing result of step 102 there is not the first detection perform test block, then after waiting for the second detection perform test block end of run, recycle the described performance test part chosen and pressure survey is carried out respectively to the trunk code of described application software to be measured and branch code.
Step 107: if the testing result of step 102 is existence first detection perform test blocks, after then waiting for the first detection perform test block end of run, recycle the described performance test part chosen and pressure survey is carried out respectively to the trunk code of described application software to be measured and branch code.
If the testing result of step 102 there is not the first detection perform test block, then directly utilize the described performance test part chosen to carry out pressure respectively to the trunk code of described application software to be measured and branch code and survey.
In the concrete implementation of the present embodiment two, after step 101 have chosen a performance test block, first the performance test part chosen to be put into etc. pending queue to rank, call the performance test part in queue successively and determine whether according to the mode of above-mentioned steps 102 to step 107 to run the performance test part called, until the performance test part of all queuings is all finished.
In the scheme of the present embodiment two, carry out pressing the branch code surveyed and trunk code to refer to: at the up-to-date branch code of current time application software to be measured and trunk code.
The performance test part chosen is utilized automatically to build test environment, and the trunk code of application software to be measured and branch code are carried out under described test scene pressure survey, twice pressure obtained is surveyed result and is compared, and determines the performance impact of the change of branch code to trunk code.
Described pressure is surveyed result and is included but not limited to following content:
Trunk code release number, average response duration, per secondly complete number of transactions (TPS), error rate.
In the scheme of the present embodiment two, the detection of twice environmental warfare has been carried out between the performance test part chosen and the current performance test part run, it is once the collision detection of associated application software, another time is the collision detection of corresponding data source, the scheme of the present embodiment is also not limited to the collision detection of advanced row data source, carry out the collision detection of associated application software again, or the scheme of twice collision detection executed in parallel.Certainly, twice collision detection in the present embodiment two also can independently perform.
Step 108: relatively result is surveyed to the pressure of trunk code and branch code, determine the performance of described application software to be measured.
By the comparison of twice pressure survey result, which kind of performance impact the change of assessment branch code can bring to trunk code.Survey result for average response duration to press, if twice pressure surveys result difference comparatively greatly, show that the change of branch code brings obvious impact to trunk code.
Preferably, in the scheme of the present embodiment two, consider that the stability of branch code is not as trunk code, after branch code is changed, if the instability of branch code causes branch code normally not run, even if test according to the scheme of embodiment two, it is also necessarily false that its pressure surveys result, both test resource was wasted, pressure preferably cannot be obtained again and survey result, therefore, before step 106 and step 107 perform, need detect the trunk code of described application software to be measured and branch code, determine that this trunk code and branch code can normally run.Here the operation that trunk code and the branch code of application software to be measured detect can be performed any time before step 106 and step 107, preferably, can be finished in step 105, perform again after test environment automatic deployment is good.If result of detection occurs that the trunk code of application software to be measured and/or branch code can not normally run, then terminate the scheme of the present embodiment two.
Particularly, what detect the trunk code of application software to be measured and branch code is operating as:
Because the trunk code of application software to be measured and branch code store in the application server, therefore, probe requests thereby can be sent to corresponding application server, described probe requests thereby can be the probe requests thereby of the forms such as HTTP, TELNET, NETSTAT, and whether the trunk code of application software to be measured in the probe response determination application server returned according to application server and branch code can be used.Here it is identical that probe requests thereby and the pressure generated when creating performance test part in embodiment one survey the content of asking, before invocation performance test block carries out performance test to the trunk code of application software to be measured and branch code, the trunk code of application software to be measured and branch code can be used to utilize probe requests thereby to determine.
Described probe response comprises but is not limited to following two kinds of situations:
Situation one: probe response return state information, the content as probe response is HTTP_CODE=200, determines whether the trunk code of application software to be measured and branch code can be used according to status information.
Situation two: probe response returned text information, as Aliexpress text message, if the text message that the text message returned is probe requests thereby specifies, then determines that the trunk code of application software to be measured and branch code can be used.
Embodiment three:
As shown in Figure 4, be the structural representation of performance test apparatus in the present embodiment three, described equipment comprises: test block chooses module 11, first environment detection module 12, pressure survey module 13 and performance determination module 14, wherein:
Test block chooses module 11 for choosing the performance test part associated with application software to be measured from performance test storehouse, comprises test script and running environment parameter in described performance test part;
First environment detection module 12 has the first detection perform test block of common factor for the application software detecting the application software that whether there is association in the current performance test part run and associate with the described performance test part chosen;
Pressure surveys module 13 for when described first environment detection module 12 determines to there is not described first detection perform test block, utilizes the described performance test part chosen to carry out pressure respectively to the trunk code of described application software to be measured and branch code and surveys; Otherwise, after waiting for the first detection perform test block end of run, recycle the described performance test part chosen and pressure survey carried out respectively to the trunk code of described application software to be measured and branch code;
Performance determination module 14 is for by relatively surveying to the pressure of trunk code and branch code the performance that result determines described application software to be measured.
Be more than the process that the environmental warfare of the application software of association is detected, also can detect the environmental warfare of data source in the scheme of the present embodiment.
Described equipment also comprises second environment detection module 15, for determining the data source that the described performance test part chosen is corresponding and the weighted value that the performance test part chosen relies on this data source, when detecting in the current performance test part run that there is the corresponding data source data source corresponding with the described performance test part chosen has the second detection perform test block of common factor, judge whether the performance test part chosen and the weighted value sum of the second detection perform test block to the described data source dependence of occuring simultaneously are greater than setting threshold value;
When pressure surveys module 13 also for determining that at described second environment detection module 15 weighted value sum is greater than setting threshold value, after waiting for the second detection perform test block end of run, recycle the described performance test part chosen and pressure survey is carried out respectively to the trunk code of described application software to be measured and branch code; Otherwise, utilize the described performance test part chosen to carry out pressure respectively to the trunk code of described application software to be measured and branch code and survey.
Described equipment also comprises detecting module 16, for detecting the trunk code of described application software to be measured and branch code, determines whether this trunk code and branch code can normally run.
The triggered time is had in the running environment parameter that described performance test part comprises; When described test block chooses module 11 specifically for determining to arrive the described triggered time, from performance test storehouse, choose the performance test part associated with application software to be measured.
The present embodiment three describes and detects the environmental warfare of the application software of association, and the application software of association and the environmental warfare of data source are detected, also only can detect the environmental warfare of data source in the performance test apparatus of the present embodiment four, explain detailedly below:
Embodiment four:
As shown in Figure 5, be the structural representation of performance test apparatus in the present embodiment four, described equipment comprises: test block chooses module 21, context detection module 22, pressure survey module 23 and performance determination module 24, wherein:
Test block chooses module 21 for choosing the performance test part associated with application software to be measured from performance test storehouse, comprises test script and running environment parameter in described performance test part;
Context detection module 22 is for determining the data source that the described performance test part chosen is corresponding and the weighted value that the performance test part chosen relies on this data source, when detecting in the current performance test part run that there is the corresponding data source data source corresponding with the described performance test part chosen has a performance test part of common factor, judge whether the performance test part chosen and the weighted value sum of performance test part to the described data source dependence of occuring simultaneously detected are greater than setting threshold value;
When pressure surveys module 23 for determining that at described context detection module 22 weighted value sum is greater than setting threshold value, after waiting for the performance test part end of run detected, recycle the described performance test part chosen and pressure survey is carried out respectively to the trunk code of described application software to be measured and branch code; Otherwise, utilize the described performance test part chosen to carry out pressure respectively to the trunk code of described application software to be measured and branch code and survey;
Performance determination module 24 is for by relatively surveying to the pressure of trunk code and branch code the performance that result determines described application software to be measured.
Described equipment also comprises detecting module 25, for detecting the trunk code of described application software to be measured and branch code, determines whether this trunk code and branch code can normally run.
Utilize the scheme of each embodiment of the application, following effect can be obtained:
1), testing efficiency is improved.The scheme of the embodiment of the present application is by creating performance test part, and fixed performance test environment, during without the need to testing at every turn, manual creation test environment, improves testing efficiency.Meanwhile, by introducing the triggered time in performance test part, regularly or periodically can test the trunk code of application software, and without the need to manpower intervention, also not needing manual evaluation the need of testing.
2), stable test environment.In the scheme of the embodiment of the present application, because test environment is that performance test part by being pre-created is built, and the attribute such as test script and running environment parameter in performance test part is constant, the test environment built is a metastable test environment, therefore, pressure is surveyed result and is had more reference significance, can not be subject to the interference of real network topology environment or flowing of access change.
3), environmental warfare is avoided.In the scheme of the embodiment of the present application, detecting by increasing environmental warfare, the performance test part serial relying on equivalent environment (application software as association has common factor, corresponding data source has common factor and degree of dependence is high) being run, the error rate of detection can be reduced; Meanwhile, by increase to the trunk code of application software to be measured and branch code whether can detecting function, detection error rate can be reduced further, reduce the unavailable failure caused of environmental warfare and trunk code, branch code.Experiment proves, the scheme of the present embodiment two, rate of false alarm can be reduced to 20%.
Those skilled in the art should understand, the embodiment of the application can be provided as method, system or computer program.Therefore, the application can adopt the form of complete hardware embodiment, completely software implementation or the embodiment in conjunction with software and hardware aspect.And the application can adopt in one or more form wherein including the upper computer program implemented of computer-usable storage medium (including but not limited to magnetic disk memory, CD-ROM, optical memory etc.) of computer usable program code.
The application describes with reference to according to the process flow diagram of the method for the embodiment of the present application, equipment (system) and computer program and/or block scheme.Should understand can by the combination of the flow process in each flow process in computer program instructions realization flow figure and/or block scheme and/or square frame and process flow diagram and/or block scheme and/or square frame.These computer program instructions can being provided to the processor of multi-purpose computer, special purpose computer, Embedded Processor or other programmable data processing device to produce a machine, making the instruction performed by the processor of computing machine or other programmable data processing device produce device for realizing the function of specifying in process flow diagram flow process or multiple flow process and/or block scheme square frame or multiple square frame.
These computer program instructions also can be stored in can in the computer-readable memory that works in a specific way of vectoring computer or other programmable data processing device, the instruction making to be stored in this computer-readable memory produces the manufacture comprising command device, and this command device realizes the function of specifying in process flow diagram flow process or multiple flow process and/or block scheme square frame or multiple square frame.
These computer program instructions also can be loaded in computing machine or other programmable data processing device, make on computing machine or other programmable devices, to perform sequence of operations step to produce computer implemented process, thus the instruction performed on computing machine or other programmable devices is provided for the step realizing the function of specifying in process flow diagram flow process or multiple flow process and/or block scheme square frame or multiple square frame.
In one typically configuration, described computer equipment comprises one or more processor (CPU), input/output interface, network interface and internal memory.Internal memory may comprise the volatile memory in computer-readable medium, and the forms such as random access memory (RAM) and/or Nonvolatile memory, as ROM (read-only memory) (ROM) or flash memory (flash RAM).Internal memory is the example of computer-readable medium.Computer-readable medium comprises permanent and impermanency, removable and non-removable media can be stored to realize information by any method or technology.Information can be computer-readable instruction, data structure, the module of program or other data.The example of the storage medium of computing machine comprises, but be not limited to phase transition internal memory (PRAM), static RAM (SRAM), dynamic RAM (DRAM), the random access memory (RAM) of other types, ROM (read-only memory) (ROM), Electrically Erasable Read Only Memory (EEPROM), fast flash memory bank or other memory techniques, read-only optical disc ROM (read-only memory) (CD-ROM), digital versatile disc (DVD) or other optical memory, magnetic magnetic tape cassette, tape magnetic rigid disk stores or other magnetic storage apparatus or any other non-transmitting medium, can be used for storing the information can accessed by computing equipment.According to defining herein, computer-readable medium does not comprise the computer readable media (transitory media) of non-standing, as data-signal and the carrier wave of modulation.
Although described the preferred embodiment of the application, those skilled in the art once obtain the basic creative concept of cicada, then can make other change and amendment to these embodiments.So claims are intended to be interpreted as comprising preferred embodiment and falling into all changes and the amendment of the application's scope.
Obviously, those skilled in the art can carry out various change and modification to the application and not depart from the spirit and scope of the application.Like this, if these amendments of the application and modification belong within the scope of the application's claim and equivalent technologies thereof, then the application is also intended to comprise these change and modification.
Claims (10)
1. a performance test methods, is characterized in that, described method comprises:
From performance test storehouse, choose the performance test part associated with application software to be measured, in described performance test part, comprise test script and running environment parameter;
Detect the first detection perform test block that application software that the application software that whether there is association in the current performance test part run associates with the described performance test part chosen has common factor;
If do not exist, then utilize the described performance test part chosen to carry out pressure respectively to the trunk code of described application software to be measured and branch code and survey; Otherwise, after waiting for the first detection perform test block end of run, recycle the described performance test part chosen and pressure survey carried out respectively to the trunk code of described application software to be measured and branch code;
By relatively surveying to the pressure of trunk code and branch code the performance that result determines described application software to be measured.
2. performance test methods as claimed in claim 1, is characterized in that, utilizing before the described performance test part chosen carries out pressure survey respectively to the trunk code of described application software to be measured and branch code, described method also comprises:
Determine the data source that the described performance test part chosen is corresponding and the weighted value that the performance test part chosen relies on this data source;
When detecting in the current performance test part run that there is the corresponding data source data source corresponding with the described performance test part chosen has the second detection perform test block of common factor, whether the performance test part that judgement is chosen and the second detection perform test block are greater than setting threshold value to the weighted value sum that the described data source of occuring simultaneously relies on, if, after then waiting for the second detection perform test block end of run, recycle the described performance test part chosen and pressure survey is carried out respectively to the trunk code of described application software to be measured and branch code; Otherwise, utilize the described performance test part chosen to carry out pressure respectively to the trunk code of described application software to be measured and branch code and survey.
3. performance test methods as claimed in claim 1 or 2, is characterized in that, utilizing before the described performance test part chosen carries out pressure survey respectively to the trunk code of described application software to be measured and branch code, described method also comprises:
The trunk code of described application software to be measured and branch code are detected, determines that this trunk code and branch code can normally run.
4. performance test methods as claimed in claim 1, is characterized in that there is the triggered time in the running environment parameter that described performance test part comprises;
Before choose the performance test part associated with application software to be measured from performance test storehouse, described method also comprises:
Determine to arrive the described triggered time.
5. a performance test methods, is characterized in that, described method comprises:
The performance test part associated with application software to be measured is chosen from performance test storehouse, and determine the data source that the described performance test part chosen is corresponding and the weighted value that the performance test part chosen relies on this data source, comprise test script and running environment parameter in described performance test part;
Detect in the current performance test part run and whether there is the detection perform test block that the corresponding data source data source corresponding with the described performance test part chosen has common factor;
If do not exist, then utilize the described performance test part chosen to carry out pressure respectively to the trunk code of described application software to be measured and branch code and survey; If exist, then judge whether the performance test part chosen and the performance test part detected are greater than setting threshold value to the weighted value sum that the described data source of occuring simultaneously relies on;
If be greater than setting threshold value, then after waiting for the detection perform test block end of run detected, recycle the described performance test part chosen and pressure survey is carried out respectively to the trunk code of described application software to be measured and branch code; Otherwise, utilize the described performance test part chosen to carry out pressure respectively to the trunk code of described application software to be measured and branch code and survey.
6. a performance test apparatus, is characterized in that, described equipment comprises:
Test block chooses module, for choosing the performance test part associated with application software to be measured from performance test storehouse, comprises test script and running environment parameter in described performance test part;
First environment detection module, the application software associated with the described performance test part chosen for detecting the application software that whether there is association in the current performance test part run has the first detection perform test block of common factor;
Pressure surveys module, for when described first environment detection module determines to there is not described first detection perform test block, utilizes the described performance test part chosen to carry out pressure respectively to the trunk code of described application software to be measured and branch code and surveys; Otherwise, after waiting for the first detection perform test block end of run, recycle the described performance test part chosen and pressure survey carried out respectively to the trunk code of described application software to be measured and branch code;
Performance determination module, for by relatively surveying to the pressure of trunk code and branch code the performance that result determines described application software to be measured.
7. performance test apparatus as claimed in claim 6, it is characterized in that, described equipment also comprises:
Second environment detection module, for determining the data source that the described performance test part chosen is corresponding and the weighted value that the performance test part chosen relies on this data source, when detecting in the current performance test part run that there is the corresponding data source data source corresponding with the described performance test part chosen has the second detection perform test block of common factor, judge whether the performance test part chosen and the weighted value sum of the second detection perform test block to the described data source dependence of occuring simultaneously are greater than setting threshold value;
Pressure surveys module, time also for being greater than setting threshold value in described second environment detection module determination weighted value sum, after waiting for the second detection perform test block end of run, recycle the described performance test part chosen and pressure survey is carried out respectively to the trunk code of described application software to be measured and branch code; Otherwise, utilize the described performance test part chosen to carry out pressure respectively to the trunk code of described application software to be measured and branch code and survey.
8. performance test apparatus as claimed in claims 6 or 7, it is characterized in that, described equipment also comprises:
Detecting module, for detecting the trunk code of described application software to be measured and branch code, determines whether this trunk code and branch code can normally run.
9. performance test apparatus as claimed in claim 6, is characterized in that there is the triggered time in the running environment parameter that described performance test part comprises;
Described test block chooses module, during specifically for determining to arrive the described triggered time, chooses the performance test part associated with application software to be measured from performance test storehouse.
10. a performance test apparatus, is characterized in that, described equipment comprises:
Test block chooses module, for choosing the performance test part associated with application software to be measured from performance test storehouse, comprises test script and running environment parameter in described performance test part;
Context detection module, for determining the data source that the described performance test part chosen is corresponding and the weighted value that the performance test part chosen relies on this data source, when detecting in the current performance test part run that there is the corresponding data source data source corresponding with the described performance test part chosen has a performance test part of common factor, judge whether the performance test part chosen and the weighted value sum of performance test part to the described data source dependence of occuring simultaneously detected are greater than setting threshold value;
Pressure surveys module, during for being greater than setting threshold value in described context detection module determination weighted value sum, after waiting for the performance test part end of run detected, recycle the described performance test part chosen and pressure survey is carried out respectively to the trunk code of described application software to be measured and branch code; Otherwise, utilize the described performance test part chosen to carry out pressure respectively to the trunk code of described application software to be measured and branch code and survey;
Performance determination module, for by relatively surveying to the pressure of trunk code and branch code the performance that result determines described application software to be measured.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310298145.XA CN104298589B (en) | 2013-07-16 | 2013-07-16 | A kind of performance test methods and equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310298145.XA CN104298589B (en) | 2013-07-16 | 2013-07-16 | A kind of performance test methods and equipment |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN104298589A true CN104298589A (en) | 2015-01-21 |
| CN104298589B CN104298589B (en) | 2018-01-16 |
Family
ID=52318324
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201310298145.XA Active CN104298589B (en) | 2013-07-16 | 2013-07-16 | A kind of performance test methods and equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN104298589B (en) |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104809059A (en) * | 2015-04-01 | 2015-07-29 | 百度在线网络技术（北京）有限公司 | Application online index detection method and device |
| CN108845950A (en) * | 2018-08-03 | 2018-11-20 | 平安科技（深圳）有限公司 | Test device, the method for test and storage medium |
| CN109960645A (en) * | 2017-12-22 | 2019-07-02 | 迈普通信技术股份有限公司 | Script testing method, device and script test macro |
| CN111949505A (en) * | 2019-05-14 | 2020-11-17 | 阿里巴巴集团控股有限公司 | Test method, device and equipment |
| CN113778842A (en) * | 2020-08-25 | 2021-12-10 | 北京沃东天骏信息技术有限公司 | Fault-tolerant test method and device, electronic equipment and storage medium |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20050188275A1 (en) * | 2004-02-03 | 2005-08-25 | Maly John W. | Systems and methods for error tracking and recovery in an expectation-based memory agent checker |
| CN1877543A (en) * | 2005-06-06 | 2006-12-13 | 华为技术有限公司 | Data-driven automatic testing system and method |
| CN102023861A (en) * | 2010-12-08 | 2011-04-20 | 中兴通讯股份有限公司 | Method and system for generating test script and test suite |
| CN102075384A (en) * | 2010-12-20 | 2011-05-25 | 创新科存储技术有限公司 | Performance test system and method |
-
2013
- 2013-07-16 CN CN201310298145.XA patent/CN104298589B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20050188275A1 (en) * | 2004-02-03 | 2005-08-25 | Maly John W. | Systems and methods for error tracking and recovery in an expectation-based memory agent checker |
| CN1877543A (en) * | 2005-06-06 | 2006-12-13 | 华为技术有限公司 | Data-driven automatic testing system and method |
| CN102023861A (en) * | 2010-12-08 | 2011-04-20 | 中兴通讯股份有限公司 | Method and system for generating test script and test suite |
| CN102075384A (en) * | 2010-12-20 | 2011-05-25 | 创新科存储技术有限公司 | Performance test system and method |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104809059A (en) * | 2015-04-01 | 2015-07-29 | 百度在线网络技术（北京）有限公司 | Application online index detection method and device |
| CN104809059B (en) * | 2015-04-01 | 2018-02-02 | 百度在线网络技术（北京）有限公司 | Using the detection method and device for index of reaching the standard grade |
| CN109960645A (en) * | 2017-12-22 | 2019-07-02 | 迈普通信技术股份有限公司 | Script testing method, device and script test macro |
| CN108845950A (en) * | 2018-08-03 | 2018-11-20 | 平安科技（深圳）有限公司 | Test device, the method for test and storage medium |
| CN111949505A (en) * | 2019-05-14 | 2020-11-17 | 阿里巴巴集团控股有限公司 | Test method, device and equipment |
| CN111949505B (en) * | 2019-05-14 | 2024-05-14 | 阿里云计算有限公司 | Test method, device and equipment |
| CN113778842A (en) * | 2020-08-25 | 2021-12-10 | 北京沃东天骏信息技术有限公司 | Fault-tolerant test method and device, electronic equipment and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN104298589B (en) | 2018-01-16 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN104182333A (en) | Performance testing method and equipment | |
| CN106487603B (en) | Response testing method and device | |
| CN106294113B (en) | creation method and device based on programmable test service | |
| JP2017514218A (en) | Running third-party applications | |
| CN104298589A (en) | Performance test method and performance test equipment | |
| CA2811617C (en) | Commit sensitive tests | |
| CN111124870A (en) | Interface testing method and device | |
| US11100233B2 (en) | Optimizing operating system vulnerability analysis | |
| CN110334012B (en) | Risk assessment method and device | |
| CN104572289A (en) | Virtualization-based server configuration measurement processing method and device | |
| CN104252413A (en) | Automatic script generation method, device and system | |
| US11521017B2 (en) | Confident peak-aware response time estimation by exploiting telemetry data from different system configurations | |
| US11017874B2 (en) | Data and memory reorganization | |
| US20200226025A1 (en) | System reboot maintenance | |
| CN112559313A (en) | Test case setting method and device, storage medium and electronic equipment | |
| CN109656825A (en) | The method and device of fine arts resource processing, electronic equipment, storage medium | |
| CN104239199A (en) | Virtual robot generation method, automatic test method and related device | |
| CN114756293A (en) | Service processing method, device, computer equipment and storage medium | |
| CN114942878A (en) | Automatic performance testing method for internet application and related equipment | |
| CN109062789B (en) | Continuous integration method, device and equipment and readable storage medium | |
| CN112905449A (en) | Target test method, device, equipment and storage medium | |
| CN111158873A (en) | System state machine implementation method and device, storage medium and processor | |
| CN111078574A (en) | Method and device for generating influence analysis report | |
| CN112559444A (en) | SQL (structured query language) file migration method and device, storage medium and equipment | |
| CN110874317B (en) | Method for generating and using test cases, server and terminal thereof |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |