CN104809058B - A kind of method and device of the concurrent quantity of the dynamic dispatching in test execution - Google Patents

A kind of method and device of the concurrent quantity of the dynamic dispatching in test execution Download PDF

Info

Publication number
CN104809058B
CN104809058B CN201510130667.8A CN201510130667A CN104809058B CN 104809058 B CN104809058 B CN 104809058B CN 201510130667 A CN201510130667 A CN 201510130667A CN 104809058 B CN104809058 B CN 104809058B
Authority
CN
China
Prior art keywords
subprocess
value
user
sub
shared drive
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201510130667.8A
Other languages
Chinese (zh)
Other versions
CN104809058A (en
Inventor
崔峥
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Alibaba Cloud Computing Ltd
Original Assignee
Alibaba Group Holding Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Alibaba Group Holding Ltd filed Critical Alibaba Group Holding Ltd
Priority to CN201510130667.8A priority Critical patent/CN104809058B/en
Publication of CN104809058A publication Critical patent/CN104809058A/en
Application granted granted Critical
Publication of CN104809058B publication Critical patent/CN104809058B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Landscapes

  • Debugging And Monitoring (AREA)
  • Medical Treatment And Welfare Office Work (AREA)

Abstract

This application provides a kind of method and devices of the concurrent quantity of the dynamic dispatching in test execution, can dynamically change the execution of process.The method includes:Host process receives operation requests;The in vivo performance variable value of host process structure in shared drive is arranged to represent the value of the operation requests by host process, and notification signal is sent to subprocess;After subprocess receives the notification signal, by judging the in vivo performance variable value of host process structure in the shared drive, corresponding operation is performed.The application is based on multi-process multithreading, pass through the method and device, it can be according to the operation requests of user, by changing the in vivo performance variable value of host process structure, the dynamic execution for changing process, controls the execution state of each group of process, realizes the conversion between several process status, so as to enrich test scene, complicated test curve can also be made accordingly.

Description

A kind of method and device of the concurrent quantity of the dynamic dispatching in test execution
Present patent application is the applying date on June 17th, 2011, Application No. 201110163953.6, entitled A kind of divisional application of the Chinese invention patent application of " dispatching method and device of test execution ".
Technical field
This application involves measuring technologies, and more particularly in performance test, a kind of dynamic dispatching in test execution is simultaneously Send out the method and device of quantity.
Background technology
Software test is exactly to carry out function and performance test to product according to testing scheme and flow using testing tool, very To writing different testing tools as needed, design and maintenance test system, the problem of being likely to occur to testing scheme, carry out Analysis and assessment., it is necessary to track failure after implementation of test cases, demand is suitble to the product for ensuring exploitation.
Performance test in software test is negative by a variety of normal, peak values of testing tool simulation and exception of automation Carrier strip part is tested come the property indices to system.In performance test, surveyed including concurrency performance test, fatigue strength Examination, big data quantity test and velocity test etc., wherein concurrency performance test is emphasis.
The process of concurrency performance test is the process of a load testing and pressure test, that is, gradually increases load, until The bottleneck of system or the performance point that cannot be received determine system by comprehensive analysis transaction index of performance and monitoring resource index The process of system concurrency performance.
At present, in concurrency performance test, the scheduling of concurrent request is just fixed when execution performance at the beginning is tested , after user has input the number of concurrent to be generated, system just goes generation concurrent according to this fixed value.But practical application In, system can be there are many different situations, for example, certain system is in night zero point, it is desirable that reach the lowest point for the number of concurrent of test, And at 9 points in the morning and at ten two points at noon, and number of concurrent is required to reach two peak periods, but above-mentioned dispatching method is entire The generation of number of concurrent is fixed that can not simulate this test case of the system in test process.
Therefore, in the test of existing concurrency performance, above-mentioned this concurrent scheduling method can not simulate complicated checkout area Scape causes test result to be not enough to illustrate test scene problem encountered, in some instances it may even be possible to test be caused to go wrong.
The content of the invention
This application provides a kind of method and device of the concurrent quantity of the dynamic dispatching in test execution, in solving to test The problem of number of concurrent is fixed.
This application discloses a kind of method of the concurrent quantity of the dynamic dispatching in test execution, including:
Host process receives the operation requests of user;For generating multiple subprocess, each subprocess is used to generate host process Multiple sub-line journeys;
The in vivo performance variable value of host process structure in shared drive is arranged to represent the value of the operation requests by host process, Notification signal is sent to subprocess;
Subprocess is when receiving the notification signal, by judging the in vivo behaviour of host process structure in the shared drive Make variate-value, perform corresponding operation;
Wherein, when the operation requests of user is stop, suspending or recover the request of subprocess execution, what subprocess performed Corresponding operating includes:
The in vivo performance variable value of the subprocess structure in shared drive is arranged to represent the operation requests by subprocess Value;
Then the method further includes:
Each sub-line journey Xun Huan of subprocess performs test code;
Sub-line journey is before each Xun Huan performs, by judging that the affiliated in vivo operation of subprocess structure becomes in shared drive Magnitude performs corresponding operation;Corresponding operation includes:It continues to execute test or does not perform to be directly entered and cycle next time, Or directly exit the subprocess.
Preferably, when the operation requests of user are the request of compulsory withdrawal test execution, the corresponding behaviour of subprocess execution Work includes:
Subprocess exits process operation.
Preferably, when the operation requests of user is stop the request of all subprocess execution:
The corresponding operating that each subprocess performs includes:Subprocess is by the in vivo operation of subprocess structure in shared drive Variate-value is arranged to represent the value for stopping performing;
The corresponding operating that each sub-line journey of each subprocess performs includes:Sub-line journey is gone to when cycling next time, is sentenced The affiliated in vivo performance variable value of subprocess structure is arranged to represent the value for stopping performing in disconnected shared drive, then exits Xun Huan behaviour Make;
The corresponding operating that each subprocess performs further includes:Subprocess waits until that each sub-line journey of the subprocess exits and follows After ring operation, analyze the test data of the subprocess and generate test report.
Preferably, when the operation requests of user is suspend the request of all subprocess execution:
The corresponding operating that each subprocess performs includes:Subprocess is by the in vivo operation of subprocess structure in shared drive Variate-value is arranged to represent the value that pause performs;
The corresponding operating that each sub-line journey of each subprocess performs includes:Sub-line journey is gone to when cycling next time, is sentenced The affiliated in vivo performance variable value of subprocess structure is arranged to represent the value that pause performs in disconnected shared drive, then stopping execution should Secondary circulate operation, and jump into and cycle next time.
Preferably, when the operation requests of user is recover the request of all subprocess execution:
The corresponding operating that each subprocess performs includes:Subprocess is by the in vivo operation of subprocess structure in shared drive Variate-value is arranged to represent the value continued to execute;
The corresponding operating that each sub-line journey of each subprocess performs includes:Sub-line journey is gone to when cycling next time, is sentenced The affiliated in vivo performance variable value of subprocess structure is arranged to represent the value continued to execute in disconnected shared drive, then continues to execute and follow Ring operates.
Preferably, when the request that the operation requests of user perform for selectivity pause part subprocess,
It further includes:Each subprocess structure in host process traversal shared drive, according to the in vivo operation of subprocess structure Variate-value judges whether subprocess is carrying out, and the subprocess being carrying out mark is issued user;
Host process receives the subprocess mark that user selects pause, and the in vivo operation of host process structure in shared drive is become Magnitude is arranged to represent the value that selectivity pause part subprocess performs, and the subprocess of right rear line selection pause sends notice Signal;
The corresponding operating that the user selects the subprocess of pause to perform includes:Subprocess is by the subprocess in shared drive The in vivo performance variable value of structure is arranged to represent the value that pause performs;
The corresponding operating that the user selects each sub-line journey of the subprocess of pause to perform includes:Sub-line journey is gone to down During one cycle, judge that the affiliated in vivo performance variable value of subprocess structure is arranged to represent what pause performed in shared drive Value, then stop performing this circulate operation, and jump into and cycle next time.
Preferably, when the request that the operation requests of user perform for selective recovery part subprocess,
It further includes:Each subprocess structure in host process traversal shared drive, according to the in vivo operation of subprocess structure Variate-value judges whether subprocess suspends execution, and the subprocess mark for suspending execution is issued user;
Host process receives user and selects the subprocess recovered mark, and the in vivo operation of host process structure in shared drive is become Magnitude is arranged to represent the value that selective recovery part subprocess performs, and the subprocess that right rear line selection recovers sends notice Signal;
The corresponding operating that the user selects the subprocess recovered to perform includes:Subprocess is by the subprocess in shared drive The in vivo performance variable value of structure is arranged to represent the value continued to execute;
The corresponding operating that the user selects each sub-line journey of the subprocess recovered to perform includes:Sub-line journey is gone to down During one cycle, judge that the affiliated in vivo performance variable value of subprocess structure is arranged to represent what is continued to execute in shared drive Value, then continue to execute circulate operation.
Preferably, before the host process receives the operation requests of user, further include:
Host process receives the scheduling control signal that user sends, and returns to actions menu to user;
Host process receives the option of operation that user selects in the actions menu, each operation choosing in the actions menu The corresponding operation requests of item.
Disclosed herein as well is one kind in test execution the concurrent quantity device of dynamic dispatching, including:
User interaction unit receives the operation requests of user for host process;Host process is for generating multiple subprocess, often A subprocess is used to generate multiple sub-line journeys;
The in vivo performance variable value of host process structure in shared drive is arranged to by host process scheduling unit for host process The value of the operation requests is represented, notification signal is sent to subprocess;
Subprocess scheduling unit, for subprocess when receiving the notification signal, by judging the shared drive The middle in vivo performance variable value of host process structure performs corresponding operation;
Wherein, when the operation requests of user is stop, suspending or recover the request of subprocess execution:
The subprocess scheduling unit is used for subprocess by the in vivo performance variable value of the subprocess structure in shared drive It is arranged to represent the value of the operation requests;
Then described device further includes:
Sub-line journey scheduling unit performs test code for each sub-line journey Xun Huan of subprocess;Sub-line journey is being followed every time Before ring performs, by judging the affiliated in vivo performance variable value of subprocess structure in shared drive, corresponding operation is performed;Phase The operation answered includes:It continues to execute to test not performing either to be directly entered and cycles or directly exit the subprocess next time.
Preferably, when the operation requests of user are the request of compulsory withdrawal test execution, the subprocess scheduling unit Including:
Compulsory withdrawal subelement exits process operation for subprocess.
Preferably, when the operation requests of user is stop the request of all subprocess execution:
The subprocess scheduling unit includes:Process stops subelement, and following corresponding behaviour is performed for each subprocess Make:The in vivo performance variable value of the subprocess structure in shared drive is arranged to represent the value for stopping performing by subprocess;
The sub-line journey scheduling unit includes:Thread stops subelement, is performed for each sub-line journey of each subprocess Following corresponding operating:Sub-line journey is gone to when cycling next time, judges the affiliated in vivo behaviour of subprocess structure in shared drive It is arranged to represent the value for stopping performing as variate-value, then exits circulate operation;
The subprocess scheduling unit further includes:Report generation subelement waits until each of the subprocess for subprocess After sub-line journey all exits circulate operation, analyze the test data of the subprocess and generate test report.
Preferably, when the operation requests of user is suspend the request of all subprocess execution:
The subprocess scheduling unit includes:Process suspension subelement performs following corresponding behaviour for each subprocess Make:The in vivo performance variable value of the subprocess structure in shared drive is arranged to represent the value of pause execution by subprocess;
The sub-line journey scheduling unit includes:Thread suspends subelement, is performed for each sub-line journey of each subprocess Following corresponding operating:Sub-line journey is gone to when cycling next time, judges the affiliated in vivo behaviour of subprocess structure in shared drive It is arranged to represent the value of pause execution as variate-value, then stops performing this circulate operation, and jump into and cycle next time.
Preferably, when the operation requests of user is recover the request of all subprocess execution:
The subprocess scheduling unit includes:Process resumption subelement performs following corresponding behaviour for each subprocess Make:The in vivo performance variable value of the subprocess structure in shared drive is arranged to represent the value continued to execute by subprocess;
The sub-line journey scheduling unit includes:Thread recovers subelement, is performed for each sub-line journey of each subprocess Following corresponding operating:Sub-line journey is gone to when cycling next time, judges the affiliated in vivo behaviour of subprocess structure in shared drive It is arranged to represent the value continued to execute as variate-value, then continues to execute circulate operation.
Preferably, when the request that the operation requests of user perform for selectivity pause part subprocess:
The user interaction unit is additionally operable to each subprocess structure in host process traversal shared drive, according to subprocess The in vivo performance variable value of structure judges whether subprocess is carrying out, and the subprocess being carrying out mark is issued user;
The host process scheduling unit receives user for host process and the subprocess of pause is selected to identify, will be in shared drive The in vivo performance variable value of host process structure is arranged to represent the value that selectivity pause part subprocess performs, right rear line choosing The subprocess for selecting pause sends notification signal;
The subprocess scheduling unit includes:Process selection suspends subelement, and the son of pause is selected for the user Process performs following corresponding operating:The in vivo performance variable value of the subprocess structure in shared drive is arranged to generation by subprocess The value that table pause performs;
The sub-line journey scheduling unit includes:Thread-selective suspends subelement, for the subprocess of the selection pause Each sub-line journey perform following corresponding operating:Sub-line journey is gone to when cycling next time, judges affiliated son in shared drive The in vivo performance variable value of process structure is arranged to represent the value that pause performs, then stops performing this circulate operation, and jump into It cycles next time.
Preferably, when the request that the operation requests of user perform for selective recovery part subprocess:
The user interaction unit is additionally operable to each subprocess structure in host process traversal shared drive, according to subprocess The in vivo performance variable value of structure judges whether subprocess suspends execution, and the subprocess mark for suspending execution is issued user;
The host process scheduling unit receives user for host process and selects the subprocess recovered mark, will be in shared drive The in vivo performance variable value of host process structure is arranged to represent the value that selective recovery part subprocess performs, right rear line choosing The subprocess for selecting recovery sends notification signal;
The subprocess scheduling unit includes:Process selection recovers subelement, the son for selecting to recover for the user Process performs following corresponding operating:The in vivo performance variable value of the subprocess structure in shared drive is arranged to generation by subprocess The value that table continues to execute;
The sub-line journey scheduling unit includes:Thread-selective recovers subelement, the son for selecting to recover for the user Each sub-line journey of process performs following corresponding operating:Sub-line journey is gone to when cycling next time, judges institute in shared drive Belong to the in vivo performance variable value of subprocess structure to be arranged to represent the value continued to execute, then continue to execute circulate operation.
Preferably, the user interaction unit is additionally operable to before the operation requests that host process receives user, receives user's hair The scheduling control signal come, and actions menu is returned to user, the option of operation that user selects in the actions menu is received, Wherein each option of operation corresponds to an operation requests.
The embodiment of the present application includes advantages below:
First, the embodiment of the present application proposes a kind of dispatching method of the test execution based on multi-process multithreading, in performance During test, host process receives the operation requests of user, then becomes the in vivo operation of host process structure in shared drive Magnitude is arranged to represent the value of the operation requests, then sends notification signal to subprocess, and subprocess receives the notification signal Afterwards, by judging the in vivo performance variable value of host process structure in the shared drive, corresponding operation is performed.By described Method, by changing the in vivo performance variable value of host process structure, can dynamically change process according to the operation requests of user Execution, control the execution state of each group of process, realize the conversion between several process status, so as to enrich checkout area Scape can also make complicated test curve accordingly.
Moreover, in the embodiment of the present application host process to subprocess send notification signal when, no matter which kind of operation requests, send out Same signal is sent, because the signal plays the role of notifying subprocess, there is no represent specifically which kind of operation requests, therefore make Workable semaphore can be saved with a kind of information, and is not only restricted to the semaphore quantity of operating system, is suitble to various It is applied in real system.
Secondly, the embodiment of the present application can also realize the interaction between user and process, as user since certain demand is thought When changing process, signal can be sent to host process, by the feedback of host process, select the process to be changed.Thus can make There are one the process interacted between user and process, so as to change the execution state of these processes, process generation is adjusted Strategy and frequency meet the various demands of user.
Again, the embodiment of the present application in the case of open test implementation procedure, can investigate the performance of system under test (SUT) Problem.For example, in pressure test implementation procedure, a certain moment finds that system under test (SUT) has memory to overflow situation, passes through the application The generation of pressure can be suspended, then gone to investigate the overflow problem by developer, observe when pressure is suspended overflow whether after Continuous or contraction, by constantly recovering and suspending, reduces and raises pressure, do not interrupting entire performance test implementation procedure In the case of, the investigation of completion system under test (SUT) problem.
Certainly, any product for implementing the application is not necessarily required to reach all the above advantage simultaneously.
Description of the drawings
Fig. 1 is a kind of method flow diagram of concurrent quantity of the dynamic dispatching in test execution of the embodiment of the present application;
Fig. 2 is a kind of method flow diagram of concurrent quantity of the dynamic dispatching in test execution of the application preferred embodiment;
Fig. 3 be a kind of concurrent quantity of the dynamic dispatching in test execution of the application preferred embodiment method in host process Flow chart;
Fig. 4 is a kind of method sub-process of concurrent quantity of the dynamic dispatching in test execution of the application preferred embodiment Flow chart;
Fig. 5 is a kind of method sub-process of concurrent quantity of the dynamic dispatching in test execution of the application preferred embodiment The flow chart of sub-line journey;
Fig. 6 is a kind of structure drawing of device of concurrent quantity of the dynamic dispatching in test execution of the embodiment of the present application.
Specific embodiment
It is below in conjunction with the accompanying drawings and specific real to enable the above-mentioned purpose of the application, feature and advantage more obvious understandable Mode is applied to be described in further detail the application.
In order to dynamically change the concurrent quantity in test process, this application provides a kind of dispatching parties of test execution Method, for during performance test, by the interaction between user and process, the dynamic execution for changing process to control The execution state of each group of process.The application is primarily adapted for use in various concurrency performance tests.
Present context is described in detail below by embodiment.
Reference Fig. 1 is a kind of method flow diagram of concurrent quantity of the dynamic dispatching in test execution of the embodiment of the present application.
In the present embodiment, it is used be multi-process multithreading implementation procedure, the multithreading multi-process refers to When running concurrent operations, host process generates multiple subprocess, and each subprocess generates multiple sub-line journeys again.Moreover, it is main into During journey initializes, region of memory that the process that can generate is shared, in measuring executing process, all process and its sub-line Journey can access shared drive region, and therefrom read variable.
The method is mainly used for dynamically changing in measuring executing process the execution of process, comprises the following steps:
Step 101, host process receives the operation requests of user;
In the implementation procedure of performance test, interaction can be realized between user and process, host process can pass through certain Mode receives the operation requests of user.
In the present embodiment, it is a kind of preferably, when Performance Test System performs, if user wishes to carry out certain Operation can send a signal to host process, after host process receives the signal, return to one operable dish of user Single, user selects a certain option of operation in the menu and inputs to host process.It is asked since each option of operation corresponds to an operation It asks, therefore user selects a certain option of operation and inputs to host process, that is, sending an operation requests to host process.By This is as it can be seen that user can select corresponding operation, control test mode according to the demand of oneself.
Step 102, the in vivo performance variable value of host process structure in shared drive is arranged to represent the operation by host process The value of request sends notification signal to subprocess;
Host process after operation requests are received, can by the in vivo performance variable value of host process structure in shared drive, if The value for representing the operation requests is set to, then notification signal is sent to the subprocess being carrying out.
In the present embodiment, preferably, for host process when receiving option operations, can will represent the operation please for one kind The value asked is assigned to the in vivo performance variable of host process structure in shared drive, then is carrying out what is tested to each Subprocess sends a signal.It thus can dynamically change the execution of process, control process performs state.
Step 103, after subprocess receives the notification signal, by judging host process structure in the shared drive Interior performance variable value performs corresponding operation.
After each subprocess for being carrying out test receives the signal, the host process structure in shared drive can be checked What kind of operation interior performance variable determines to perform by judging the value of the performance variable, as process exits, process suspension, Process resumption etc. operation.
In conclusion the method described in Fig. 1 embodiments, in multi-process multithreading measuring executing process, host process receives Then the in vivo performance variable value of host process structure in shared drive is arranged to represent the operation requests by the operation requests of user Value, then to subprocess send notification signal, after subprocess receives the notification signal, by judging in the shared drive The in vivo performance variable value of host process structure performs corresponding operation.By the method, can be asked according to the operation of user It asks, by changing the in vivo performance variable value of host process structure, the dynamic execution for changing process controls holding for each group of process Row state realizes the conversion between several process status, so as to enrich test scene, can also make complexity accordingly Test curve.
Moreover, host process to subprocess send notification signal when, no matter which kind of operation requests, send same signal, because Play the role of notifying subprocess for the signal, there is no which kind of specific operation requests of representative, therefore can using a kind of information With semaphore workable for saving, and the semaphore quantity of operating system is not only restricted to, being suitble in various real systems should With.
In practical applications, performance test plays an important role in the quality assurance of software, in the test that it includes Hold rich and varied.Performance test includes three aspects:Apply client performance test, apply the test of the performance on network With apply the test in server end performance.Under normal conditions, the combination of three aspects effectively and reasonably, can reach to systematicness The prediction with bottleneck can comprehensively be analyzed.
Wherein, server-side performance test is different from UI performance tests, client performance test etc., please by generating a large amount of height The access request of frequency high concurrent is asked to access server-side, server-side is allowed to be run under long-time high load condition, is checked The test method of system running correctness, stability.
In server-side performance test, load testing and pressure test belong to performance test, and the two can be combined and carried out. By load testing, the performance of the system under various workloads is determined, target is tested when load gradually increases, and system is each The situation of change of item performance indicator.Pressure test is the performance point by determining the bottleneck of system or cannot receive, and is come The test for the maximum service rank that acquisition system can provide.
In order to which those skilled in the art is made to further appreciate that present context, below by taking the pressure test of server-side as an example It is described in more details.
By taking Xnix systems (Unix and linux system, and include their derived version) as an example, certain the method is similary Suitable for other operating systems such as Windows.
It is a kind of preferred embodiment of the application below, gives the Performance Test System of Xnix systems in pressure test In execution, a kind of pressure dispatching method that test system and user can interact.
First, test system and the interactive mode of user are determined:
Before host process receives the operation requests of user, host process can receive the scheduling control signal that user sends, and to User returns to actions menu, and user selects the option of operation in the actions menu and is sent to host process, the actions menu In each option of operation correspond to an operation requests.
When Performance Test System performs, if user wishes to carry out compulsory withdrawal test, stops test, pause all tests Pressure, the operation for recovering whole test pressures, pause partial test pressure or recovered part test pressure, user can be to master Process sends some signal (for example the system is using SIGINT signals namely Ctrl+C), after host process receives the signal, One operable menu of user is returned to, user selects a certain option of operation in the menu and inputs to host process, host process It is operated further according to the option, achievees the effect that control subprocess.
Secondly, signal and shared drive structure codetermine operation to be performed:
After user has sent an operation requests to host process, host process will represent the value of the operation requests, be assigned to The childsigopt elements of host process structure bench in shared drive, then it is carrying out pressure test to each Subprocess sends some signal (for example the system uses SIGUSR1 signals), and the semaphore handles function of subsystem receives After the signal, the childsigopt elements of the host process structure bench in shared drive can be checked, by judging the element Value come determine to perform what kind of operation.For example, subprocess is by the in vivo performance variable value of the subprocess structure in shared drive It is arranged to represent the value of the operation requests.
In the multi-process multithreading measuring executing process described in embodiment, each sub-line journey Xun Huan of subprocess performs survey Code is tried, sub-line journey is before each Xun Huan performs, by judging that the affiliated in vivo operation of subprocess structure becomes in shared drive Magnitude performs corresponding operation.For example, the pressure test service logic function performed in each sub-line journey of each subprocess, It is placed in a loop code body, can judge that one belongs to the subprocess in process shared drive before performing every time The state of an element switcher of structure bench_child, the element are respectively there are three types of state:
i.CONTINUE:State in operation, default conditions, in operation or after resuming operation, the value of switcher elements All it is the state;
ii.BREAK:Halted state, when the value of switcher is the state, Xun Huan can jump out loop body next time, from And stop the pressing creation of execution performance test;
iii.SUSPEND:Halted state, when the value of switcher is the state, cycling of this time does not perform, and jumps into next Secondary cycling.
Host process informs that subprocess has request processing, subprocess after the operation requests that user sends are received, by signal By judging the childsigopt elements of host process structure bench, to determine this process structure body bench_child's Switcher elements are assigned to how to be worth.And exist when each sub-line journey of the subprocess cycles in vivo pressure test service logic function Perform next time before, by judging the switcher elements, to decide whether to be to continue with to perform or do not perform to be directly entered down One cycle directly exits the process.Host process can by send a signal to each subprocess or part son into Journey, to reach the pressure test practice condition for controlling all or part of subprocess.
In the present embodiment, at user option option of operation includes:
1) compulsory withdrawal;
User is not intended to test to continue to execute and the test result of executed is not required for some reason, it is expected at once It exits, then can host process be informed by the interactive mode, it is desirable that compulsory withdrawal Performance Test System.
When the operation requests of user are the request of compulsory withdrawal test execution, the corresponding operating that subprocess performs is to exit Process operation.
For example, host process is received the childsigopt of the host process structure bench set in shared drive after asking Its value is arranged to 0, then sends SIGUSR1 signals to each subprocess in execution by element.Subprocess is sentenced after receiving the signal Whether the childsigopt elements of the host process structure bench in disconnected shared drive are 0, and process is exited if it is, performing (exit) operate.
2) all tests are stopped;
User wish for some reason test terminate and provide at once test report data (such as:Performance test Several hours have been run, can required data have been analyzed based on test process so far), then it can be by described Interactive mode inform host process, it is desirable that Stopping Ability test pressure generate,
When the operation requests of user is stop the request of all subprocess execution, each subprocess will be somebody's turn to do in shared drive The in vivo performance variable value of subprocess structure is arranged to represent the value for stopping performing, and each sub-line journey of each subprocess is gone to When cycling next time, judge that the affiliated in vivo performance variable value of subprocess structure is arranged to represent what stopping performed in shared drive Value, then exit circulate operation.Also, after each subprocess waits until that each sub-line journey of the subprocess exits circulate operation, point It analyses the test data of the subprocess and generates test report.
For example, host process is received the childsigopt of the host process structure bench set in shared drive after asking Its value is arranged to 1, then sends SIGUSR1 signals to each subprocess in execution by element.Subprocess is sentenced after receiving the signal Whether the childsigopt elements of the host process structure bench in disconnected shared drive are 1, if it is, in process is shared The bench_child structures for belonging to this process are found in depositing, and the switcher elements of the structure are assigned a value of BREAK.When the loop body of each sub-line journey in each subprocess, which is gone to, to be cycled next time, bench_child knots are determined The switcher element values of structure body are BREAK, then perform and jump out circulate operation (break), the subprocess waits until every height afterwards After thread all exits, then the performance test data work for analyzing the process is performed, to generate performance test report.
3) pause all tests;
User wish for some reason test pause (such as:At present by pressure system discovery abnormal performance, it is necessary to stop pressing Power carries out Commissioning Analysis), then can host process be informed by the interactive mode, it is desirable that pause performance test pressing creation.
When the operation requests of user is suspend the request of all subprocess execution, each subprocess will be somebody's turn to do in shared drive The in vivo performance variable value of subprocess structure is arranged to represent the value that pause performs, and each sub-line journey of each subprocess is gone to When cycling next time, judge that the affiliated in vivo performance variable value of subprocess structure is arranged to represent what pause performed in shared drive Value, then stop performing this circulate operation, and jump into and cycle next time.
For example, host process is received the childsigopt of the host process structure bench set in shared drive after asking Its value is arranged to 2, then sends SIGUSR1 signals to each subprocess in execution by element.Subprocess is sentenced after receiving the signal Whether the childsigopt elements of the host process structure bench in disconnected shared drive are 2, if it is, in process is shared The bench_child structures for belonging to this process are found in depositing, and the switcher elements of the structure are assigned a value of SUSPEND.When the loop body of each sub-line journey in each subprocess, which is gone to, to be cycled next time, bench_child is determined The switcher element values of structure are SUSPEND, then do not perform any pressure test service logic function, several milliseconds of resting Afterwards, into cycling next time, until the switcher element values of bench_child structures are changed to other states.
4) all tests are recovered;
After the pressing creation of all processes of performance test is suspended, user wishes that test recovers fortune for some reason Row, then can inform host process by the interactive mode, it is desirable that restorability test pressure generates.
When the operation requests of user is recover the request of all subprocess execution, each subprocess will be somebody's turn to do in shared drive The in vivo performance variable value of subprocess structure is arranged to represent the value continued to execute, and each sub-line journey of each subprocess is gone to When cycling next time, judge that the affiliated in vivo performance variable value of subprocess structure is arranged to represent what is continued to execute in shared drive Value, then continue to execute circulate operation.
For example, host process is received the childsigopt of the host process structure bench set in shared drive after asking Its value is arranged to 3, then sends SIGUSR1 signals to each subprocess in execution by element.Subprocess is sentenced after receiving the signal Whether the childsigopt elements of the host process structure bench in disconnected shared drive are 3, if it is, in process is shared The bench_child structures for belonging to this process are found in depositing, and the switcher elements of the structure are assigned a value of CONTINUE.When the loop body of each sub-line journey in each subprocess, which is gone to, to be cycled next time, bench_child is determined The switcher element values of structure are CONTINUE, then pressure test service logic function are continued to execute, so as to recover pressure Generation.
5) partial test is suspended;
User wishes the size concurrent by changing pressure for some reason, is visited to simulate real user under certain environment Ask behavior (such as certain main website WEB server in the afternoon 6 points to 9 points concurrently to access pressure very high, and at night after 10 points, Concurrent request quantity continuously decreases), then can host process be informed by the interactive mode, it is desirable that suspend the property of some processes It can test pressure generation.
When the request that the operation requests of user perform for selectivity pause part subprocess, host process traversal shared drive In each subprocess structure, judge whether subprocess is carrying out according to subprocess structure in vivo performance variable value, and general The subprocess mark being carrying out issues user;Then, host process receives the subprocess mark that user selects pause, in shared Deposit the in vivo performance variable value of middle host process structure and be arranged to represent the value that selectivity pause part subprocess performs, then to The subprocess of family selection pause sends notification signal;It, will altogether after user selects the subprocess of pause to receive the notification signal The in vivo performance variable value of the subprocess structure in memory is enjoyed to be arranged to represent the value that pause performs;User select pause son into Each sub-line journey of journey is gone to when cycling next time, judges the affiliated in vivo performance variable value of subprocess structure in shared drive It is arranged to represent the value that pause performs, then stops performing this circulate operation, and jump into and cycle next time.
For example, host process judges the process by traveling through the bench_child structures of each subprocess in shared drive Whether the switcher elementary states of structure are to be currently running i.e. CONTINUE, these are in the subprocess of state in operation Process identification (PID) PID issue user, user is allowed to make choice.User will need the process PID that suspends to be sent to host process, it is main into Journey receive request after by set shared drive in host process structure bench childsigopt elements, its value is arranged to 4, then to several subprocess transmission SIGUSR1 signals that user specifies.These subprocess judge shared drive after receiving the signal In the childsigopt elements of host process structure bench whether be 4, if it is, finding category in process shared drive SUSPEND is assigned a value of in the bench_child structures of this process, and to the switcher elements of the structure.When this batch The loop body of each sub-line journey of subprocess is gone to when cycling next time, determines this process bench_child structures Switcher element values are SUSPEND, then do not perform any pressure test service logic function, after several milliseconds of resting, are entered It cycles next time, until the switcher element values of bench_child structures are changed to other states.
6) recovered part is tested.
After some performance test processes are suspended, user wishes to recover some pressures for being suspended process for some reason Power test execution then can inform host process, it is desirable that recover the performance test pressure of some processes by the interactive mode Generation.
When the request that the operation requests of user perform for selective recovery part subprocess, host process traversal shared drive In each subprocess structure, judge whether subprocess suspends execution, and general according to subprocess structure in vivo performance variable value The subprocess mark that pause performs issues user.Then, host process receives user and selects the subprocess recovered mark, in shared Deposit the in vivo performance variable value of middle host process structure and be arranged to represent the value that selective recovery part subprocess performs, then to The subprocess of family selection sends notification signal.It then, will altogether after user selects the subprocess recovered to receive the notification signal The in vivo performance variable value of the subprocess structure in memory is enjoyed to be arranged to represent the value continued to execute.User select recover son into Each sub-line journey of journey is gone to when cycling next time, judges the affiliated in vivo performance variable value of subprocess structure in shared drive It is arranged to represent the value continued to execute, then continues to execute circulate operation.
For example, host process judges the process by traveling through the bench_child structures of each subprocess in shared drive Whether the switcher elementary states of structure are paused i.e. SUSPEND, by these subprocess placed in a suspend state into Journey PID issues user, and user is allowed to make choice.The process PID for needing to resume operation is sent to host process by user, and host process is received By the childsigopt elements of the host process structure bench set in shared drive after to request, its value is arranged to 5, then SIGUSR1 signals are sent to several subprocess that user specifies.These subprocess are judged after receiving the signal in shared drive Whether the childsigopt elements of host process structure bench are 5, belong to this if it is, being found in process shared drive The bench_child structures of process, and CONTINUE is assigned a value of to the switcher elements of the structure.When this batch of son into The loop body of each sub-line journey of journey is gone to when cycling next time, determines this process bench_child structures Switcher element values are CONTINUE, then the service logic function of pressure test are continued to execute, so that system under test (SUT) obtains To the concurrent pressure of bigger.
In conclusion the present embodiment can also realize the interaction between user and process, as user since certain demand is thought When changing process, signal can be sent to host process, by the feedback of host process, select the process to be changed.Thus can make There are one the process interacted between user and process, so as to change the execution state of these processes, process generation is adjusted Strategy and frequency meet the various demands of user.Also, dynamically change process, can realize between several process status The test scene of process is enriched in conversion, can also provide complicated pressure curve accordingly.
Moreover, in the method described in the present embodiment, when host process is to subprocess transmission notification signal, no matter which kind of is asked It asks, sends same signal, it, please there is no which kind of specific operation is represented because the signal plays the role of notifying subprocess It asks, therefore workable semaphore can be saved using a kind of information, and be not only restricted to the semaphore quantity of operating system, fit Conjunction is applied in various real systems.
Also, the method described in the present embodiment can investigate system under test (SUT) in the case of open test implementation procedure Performance issue, for example, in pressure measuring executing process, a certain moment finds that system under test (SUT) has memory to overflow situation, The generation of pressure can be suspended by the application, then gone to investigate the overflow problem by developer, be observed when pressure is suspended Whether spilling continues or shrinks, and by constantly recovering and suspending, reduces and raises pressure, surveyed not interrupting entire performance In the case of trying implementation procedure, the investigation of system under test (SUT) problem is completed.Thus, there is very strong practicability.
Based on the above, below by Fig. 2 to Fig. 5, detailed introduces a kind of flow of preferred embodiment of the application. In multi-process multithreading measuring executing process described in embodiment, it can dynamically change the execution of process, meet each of user Kind demand.
It is certainly described exemplified by the present embodiment is with Xnix systems (Unix and linux system, and include their derived version) Method is equally applicable to other operating systems such as Windows.
Reference Fig. 2 is a kind of method stream of concurrent quantity of the dynamic dispatching in test execution of the application preferred embodiment Cheng Tu.
Step 201, pressure test is started, host process registration receives SIGINT and SIGUSR1 signals;
Signal processor is made as:signal(SIGNT,cb_trap);signal(SIGUSR1,cb_trap).
Step 202, process shared drive is initialized, initializes host process structure, and is each subprocess structure point With space, the pointer of shared drive is saved in global variable mbp;
Including, the structure of host process and subprocess structure, as shown in the figure.
Step 203, the subprocess of specified quantity is generated by function fork ();
After step 203,204 can be entered step, flow B can also be entered, with reference to Fig. 5.
Step 204, host process generation timer thread so that when the execution number of Cbenchmark host processes can pass through Between control;
If control time, step 205 is performed, if not control time, all subprocess is waited to be finished.
Step 205, specified time starts timing;
By timed thread, by function pthread_create (), specified time.
Step 206, after timing, the bench structures of host process, assignment childsigopt are found by mbp variables Element is 1, and passes through SIGUSR signals and each subprocess is allowed to be handled.
Host process sends SIGUSRI signals to each subprocess, into flow C, with reference to Fig. 4.
With reference to Fig. 3, be the application preferred embodiment a kind of method of concurrent quantity of the dynamic dispatching in test execution in The flow chart of host process.
Step 301, user sends Ctrl+C signals to Cbenchmark host processes;
It, can be by being sent to host process if user wishes to carry out certain operation when Performance Test System performs Ctrl+C signals.
Step 302, host process returns to operable menu to user;
After host process receives the semaphore, one operable menu of user, the operation bag that user can input are returned to It includes:0:It is forced out performance test;1:Stop execution but statistical test data;2:Suspend all Virtual User;3:Recover all Virtual User;4:Suspend nominative testing process;5:Recover nominative testing process.
Step 303, it is desirable that user inputs operation ID;
User determines operation to be performed, inputs corresponding operation ID according to the demand of oneself.
Step 304, user selects the option to be operated, and is sent to host process;
User selects the corresponding operand of the option to be operated, and host process determines accordingly to operate by determining operand n Option.
Step 305, childsigopt elements in bench structures in shared drive are arranged to n by selection operation number n;
That is host process can will represent the value of the operation requests, be assigned to positioned at shared drive when receiving option operations In the in vivo performance variable of host process structure, then to it is each be carrying out test subprocess send signal.
Step 306, the value of operand n is judged;
If n is 0 to 3 any value, step 307 is selected;If n is 4 or 5 any values, step 308 is selected.
Step 307, the subprocess chained list in shared drive is traveled through, obtains subprocess pid, SIGUSRI is sent to each pid Signal;
Host process sends SIGUSRI signals to each subprocess, into flow C, with reference to Fig. 4.
Step 308, the switcher of the subprocess structure in shared drive is traveled through, obtains its current state, and will place It is for selection that user is returned in the pid of certain state course;
Host process determines certain several process pid and exports.
Step 309, user's selection is intended to suspend or the specified process of operations such as recovers;
Step 310, the process pid of user input selection, host process judge input pid whether be this process subprocess pid;
If so, step 311 is performed, if it is not, return to step 308, is re-entered;
Step 311, the structure bench_child of the subprocess in shared drive is obtained by the pid of input;
Step 312, judge whether the switcher elementary states of subprocess structure bench_child are operable;
If so, step 313 is performed, if it is not, return to step 308, is re-entered;
Step 313, SIGUSRI signals are sent to the subprocess by pid.
Host process sends SIGUSRI signals to each subprocess, into flow C, with reference to Fig. 4.
With reference to Fig. 4, be the application preferred embodiment a kind of method of concurrent quantity of the dynamic dispatching in test execution in The flow chart of subprocess.
The execution step of each subprocess is as follows:
Step 401, SIGUSRI signals are received, find the subprocess for belonging to this process in shared drive by mbp pointers Bench_child structures and host process structure bench;
Step 402, the value of host process structure childsigopt elements is judged;
Step 403, judge bench structure childsigopt elements whether be equal to 0, i.e., whether compulsory withdrawal;
If 0, perform exit () and exit this subprocess, if not 0, perform step 404;
Step 404, judge whether bench structure childsigopt elements are equal to 1, i.e., whether stop performing this process;
If 0, step 405 is performed, if not 0, perform step 406;
Step 405, BREAK is assigned a value of to the siwtcher elements of the bench_child structures of this subprocess;
All sub-line journeys of the subprocess next time cycle when exit loop body, then perform exit operation, the son into After journey waits until that each sub-line journey exits, then the performance test data work for analyzing the process is performed, to generate performance test report It accuses.
Step 406, judge bench structure childsigopt elements whether be equal to 2 or 4, i.e., whether suspend execution this into Journey;
If 2 or 4, step 407 is performed, if not 2 or 4, perform step 408;
Step 407, SUSPEND is assigned a value of to the siwtcher elements of the bench_child structures of this subprocess;
All sub-line journeys of the subprocess can not perform pressure test function when cycling next time, and be directly entered again It cycles next time.
Step 408, judge that bench structure childsigopt elements are equal to 3 or 5, i.e., whether recover to perform this process;
If 3 or 5, step 409 is performed, if not 3 or 5, it malfunctions, terminates.
Step 409, CONTINUE is assigned a value of to the siwtcher elements of the bench_child structures of this subprocess.
All sub-line journeys of the subprocess may proceed to perform pressure test function when cycling next time.
With reference to Fig. 5, be the application preferred embodiment a kind of method of concurrent quantity of the dynamic dispatching in test execution in The flow chart of subprocess sub-line journey.
The flow includes two parts, is the flow that the flow of subprocess execution and sub-line journey perform respectively, separately below It introduces.
First, each subprocess performs following steps:
Step 501, subprocess inherits the signal processing mechanism of host process, and obtains the pointer variable mbp of shared drive;
Step 502, the subprocess bench_child structures for belonging to this process are found in shared drive by mbp pointers Body is initialized, and switcher elements are assigned a value of CONTINUE, is represented in operation;
Step 503, the thread of specified quantity is generated;
Per thread is exactly a concurrent Virtual User.
Step 504, all sub-line journeys that this process generates is waited to be finished;
Step 505, judge whether that all threads of this process all have dropped out;
It can be judged according to step 516, if so, performing step 506, step 504 is performed if it is not, returning.
Step 506, collect, statistical test data, generate test report;
Step 507, perform exit () and exit this subprogram.
In above-mentioned steps 502, thread is generated by function d_create (), then can enter step 508.
Each sub-line journey of each subprocess performs following steps:
Step 508, multiple thread parallels of multiple processes, which perform, generates concurrent pressure;
This thread will perform a loop structure, and what is be performed in structure is the business function of pressure test;
Step 509, whether the siwtcher elements for judging the bench_child structures of this subprocess are CONTINUE;
If so, step 510 is performed, if it is not, performing step 512.
Step 510, judge whether to perform predetermined number of times;
If so, step 516 is performed, if it is not, performing step 511.
Step 511, the service logic function of pressure test is performed;
CONTINUE expressions need to perform pressure, so performing the service logic function of pressure test, return to step 509;
Step 512, whether the switcher elements for judging the bench_child structures of this subprocess are SUSPEND;
If so, step 513 is performed, if it is not, performing step 514;
Step 513, the service logic function of pressure test is not performed, after the dormancy some time, then is cycled next time;
SUSPEND expressions need to suspend the generation of the pressure, so not performing the service logic function of pressure test, dormancy After some time, then cycled next time.
Step 514, whether the switcher elements for judging the bench_child structures of this subprocess are BREAK;
If so, perform step 515;If it is not, error, terminates.
Step 515, directly perform break and jump out Xun Huan;
BREAK expressions need to stop the generation of the pressure, so directly performing break here jumps out Xun Huan.
Step 516, this thread is exited;
After exiting this thread, 505 can be entered step.
As known from the above, in performance test, user can change state of a process according to demand, and host process is according to user Selection, change the in vivo performance variable value of host process structure, subprocess judges the in vivo performance variable value of host process structure, hold The corresponding operation of row.
In practical applications, the above method can be realized by C language, can reach good effect.Moreover, the method Independent of specific operating system or hardware, cross-platform can also perform.
Above-described embodiment is illustrated by taking pressure test as an example, but other performances can also be applied in concrete application In test, implementation principle is similar to the aforementioned embodiment, and so it will not be repeated.
It should be noted that for foregoing each method embodiment, in order to be briefly described, therefore it is all expressed as a series of Combination of actions, but those skilled in the art should know, the application and from the limitation of described sequence of movement because According to the application, some steps may be employed other orders or be carried out at the same time.Secondly, those skilled in the art should also know It knows, embodiment described in this description belongs to preferred embodiment, and involved action not necessarily the application institute is necessary 's.
Based on the explanation of above method embodiment, present invention also provides the devices of the scheduling execution of corresponding control test Embodiment, to realize the content described in above method embodiment.
It is a kind of structure drawing of device of concurrent quantity of the dynamic dispatching in test execution of the embodiment of the present application with reference to Fig. 6.
Described device can include user interaction unit 61, host process scheduling unit 62, subprocess scheduling unit 63.Its In,
User interaction unit 61 receives the operation requests of user for host process;Host process is used to generate multiple subprocess, Each subprocess is used to generate multiple sub-line journeys;
Host process scheduling unit 62 is set the in vivo performance variable value of host process structure in shared drive for host process To represent the value of the operation requests, notification signal is sent to subprocess;
Subprocess scheduling unit 63, it is described shared interior by judging for subprocess when receiving the notification signal The in vivo performance variable value of middle host process structure is deposited, performs corresponding operation.
In addition to more than formant is set, according to different operation requests, the present apparatus can also include:
When the operation requests of user are the request of compulsory withdrawal test execution, the subprocess scheduling unit 63 is further It may include:
Compulsory withdrawal subelement 631 exits process operation for subprocess.
When the operation requests of user is stop, suspending or recover the request of subprocess execution:
The subprocess scheduling unit 63 is used for subprocess by the in vivo performance variable of subprocess structure in shared drive Value is arranged to represent the value of the operation requests.
Further, the device further includes:
Sub-line journey scheduling unit 64 performs test code for each sub-line journey Xun Huan of subprocess;Sub-line journey is each Before Xun Huan performs, by judging the affiliated in vivo performance variable value of subprocess structure in shared drive, corresponding operation is performed; Corresponding operation includes:Continue to execute test do not perform either be directly entered cycle or directly exit next time the son into Journey.
When the operation requests of user is stop the request of all subprocess execution:
The subprocess scheduling unit 63 includes:
Process stops subelement 632, and following corresponding operating is performed for each subprocess:Subprocess will be in shared drive The in vivo performance variable value of the subprocess structure is arranged to represent the value for stopping performing;
Report generation subelement 633, after waiting until that each sub-line journey of the subprocess exits circulate operation for subprocess, It analyzes the test data of the subprocess and generates test report.
The sub-line journey scheduling unit 64 includes:
Thread stops subelement 641, and following corresponding operating is performed for each sub-line journey of each subprocess:Sub-line journey It goes to when cycling next time, judges in shared drive that the affiliated in vivo performance variable value of subprocess structure is arranged to represent and stop The value of execution, then exit circulate operation;
When the operation requests of user is suspend the request of all subprocess execution:
The subprocess scheduling unit 63 includes:
Process suspension subelement 634 performs following corresponding operating for each subprocess:Subprocess will be in shared drive The in vivo performance variable value of the subprocess structure is arranged to represent the value that pause performs;
The sub-line journey scheduling unit 64 includes:
Thread suspends subelement 642, and following corresponding operating is performed for each sub-line journey of each subprocess:Sub-line journey It goes to when cycling next time, judges that the affiliated in vivo performance variable value of subprocess structure is arranged to represent pause in shared drive The value of execution then stops performing this circulate operation, and jumps into and cycle next time.
When the operation requests of user is recover the request of all subprocess execution:
The subprocess scheduling unit 63 includes:
Process resumption subelement 635 performs following corresponding operating for each subprocess:Subprocess will be in shared drive The in vivo performance variable value of the subprocess structure is arranged to represent the value continued to execute;
The sub-line journey scheduling unit 64 includes:
Thread recovers subelement 643, and following corresponding operating is performed for each sub-line journey of each subprocess:Sub-line journey It goes to when cycling next time, judges in shared drive that the affiliated in vivo performance variable value of subprocess structure is arranged to represent and continue The value of execution, then continue to execute circulate operation.
When the request that the operation requests of user perform for selectivity pause part subprocess:
The user interaction unit 61 is additionally operable to each subprocess structure in host process traversal shared drive, according to son into The in vivo performance variable value of journey structure judges whether subprocess is carrying out, and the subprocess being carrying out mark is issued use Family;
The host process scheduling unit 62 receives user for host process and the subprocess of pause is selected to identify, by shared drive The middle in vivo performance variable value of host process structure is arranged to represent the value that selectivity pause part subprocess performs, right rear line The subprocess of selection pause sends notification signal;
The subprocess scheduling unit 63 includes:
Process selection suspends subelement 636, and the subprocess for selecting pause for the user performs following corresponding behaviour Make:The in vivo performance variable value of the subprocess structure in shared drive is arranged to represent the value of pause execution by subprocess;
The sub-line journey scheduling unit 64 includes:
Thread-selective suspends subelement 644, and each sub-line journey of the subprocess of pause is selected to perform for the user Following corresponding operating:Sub-line journey is gone to when cycling next time, judges the affiliated in vivo behaviour of subprocess structure in shared drive It is arranged to represent the value of pause execution as variate-value, then stops performing this circulate operation, and jump into and cycle next time.
When the request that the operation requests of user perform for selective recovery part subprocess:
The user interaction unit 61 is for each subprocess structure in host process traversal shared drive, according to subprocess The in vivo performance variable value of structure judges whether subprocess suspends execution, and the subprocess mark for suspending execution is issued user;
The host process scheduling unit 62 receives user for host process and selects the subprocess recovered mark, by shared drive The middle in vivo performance variable value of host process structure is arranged to represent the value that selective recovery part subprocess performs, right rear line The subprocess that selection recovers sends notification signal;
The subprocess scheduling unit 63 includes:
Process selection recovers subelement 637, for the user subprocess recovered is selected to perform following corresponding behaviour Make:The in vivo performance variable value of the subprocess structure in shared drive is arranged to represent the value continued to execute by subprocess;
The sub-line journey scheduling unit 64 includes:
Thread-selective recovers subelement 645, for each sub-line journey execution for the subprocess that the user selects to recover Following corresponding operating:Sub-line journey is gone to when cycling next time, judges the affiliated in vivo behaviour of subprocess structure in shared drive It is arranged to represent the value continued to execute as variate-value, then continues to execute circulate operation.
Preferably, the user interaction unit 61 is additionally operable to before the operation requests that host process receives user, receives user The scheduling control signal sent, and actions menu is returned to user, for the option of operation that user selects in the actions menu, Wherein each option of operation corresponds to an operation requests.
The dispatching device of above-mentioned control test can be used in the concurrent test of multi-process multithreading, can basis user Operation requests, by the in vivo performance variable value of host process structure, the dynamic execution for changing process controls each group of process Execution state.
Moreover, in the present apparatus user to host process send operation requests when, no matter which kind of operation requests, send of the same race Signal, thus workable semaphore can be saved, and the semaphore quantity of operating system is not only restricted to, it is suitble in various realities It is applied in the system of border.
For the device embodiment of the above-mentioned concurrent quantity of the dynamic dispatching in test execution, since itself and method are implemented Example is substantially similar, so description is fairly simple, related part is referring to the part explanation of embodiment of the method shown in Fig. 1 to Fig. 5 It can.
Each embodiment in this specification is described by the way of progressive, the highlights of each of the examples are with The difference of other embodiment, just to refer each other for identical similar part between each embodiment.
Each embodiment in this specification is described by the way of progressive, the highlights of each of the examples are with The difference of other embodiment, just to refer each other for identical similar part between each embodiment.
It should be understood by those skilled in the art that, the embodiment of the embodiment of the present application can be provided as method, apparatus or calculate Machine program product.Therefore, the embodiment of the present application can be used complete hardware embodiment, complete software embodiment or combine software and The form of the embodiment of hardware aspect.Moreover, the embodiment of the present application can be used one or more wherein include computer can With in the computer-usable storage medium (including but not limited to magnetic disk storage, CD-ROM, optical memory etc.) of program code The form of the computer program product of implementation.
In a typical configuration, the computer equipment includes one or more processors (CPU), input/output Interface, network interface and memory.Memory may include the volatile memory in computer-readable medium, random access memory The forms such as device (RAM) and/or Nonvolatile memory, such as read-only memory (ROM) or flash memory (flash RAM).Memory is to calculate The example of machine readable medium.Computer-readable medium includes permanent and non-permanent, removable and non-removable media can be with Realize that information stores by any method or technique.Information can be computer-readable instruction, data structure, the module of program or Other data.The example of the storage medium of computer includes, but are not limited to phase transition internal memory (PRAM), static RAM (SRAM), dynamic random access memory (DRAM), other kinds of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), fast flash memory bank or other memory techniques, read-only optical disc are read-only Memory (CD-ROM), digital versatile disc (DVD) or other optical storages, magnetic tape cassette, tape magnetic rigid disk storage or Other magnetic storage apparatus or any other non-transmission medium, the information that can be accessed by a computing device available for storage.According to Herein defines, and computer-readable medium does not include the computer readable media (transitory media) of non-standing, such as The data-signal and carrier wave of modulation.
The embodiment of the present application is with reference to according to the method for the embodiment of the present application, terminal device (system) and computer program The flowchart and/or the block diagram of product describes.It should be understood that it can realize flowchart and/or the block diagram by computer program instructions In each flow and/or block and flowchart and/or the block diagram in flow and/or box combination.These can be provided Computer program instructions are set to all-purpose computer, special purpose computer, Embedded Processor or other programmable data processing terminals Standby processor is to generate a machine so that is held by the processor of computer or other programmable data processing terminal equipments Capable instruction generation is used to implement in one flow of flow chart or multiple flows and/or one box of block diagram or multiple boxes The device for the function of specifying.
These computer program instructions, which may also be stored in, can guide computer or other programmable data processing terminal equipments In the computer-readable memory to work in a specific way so that the instruction being stored in the computer-readable memory generates bag The manufacture of command device is included, which realizes in one flow of flow chart or multiple flows and/or one side of block diagram The function of being specified in frame or multiple boxes.
These computer program instructions can be also loaded into computer or other programmable data processing terminal equipments so that Series of operation steps is performed on computer or other programmable terminal equipments to generate computer implemented processing, thus The instruction offer performed on computer or other programmable terminal equipments is used to implement in one flow of flow chart or multiple flows And/or specified in one box of block diagram or multiple boxes function the step of.
Although the preferred embodiment of the embodiment of the present application has been described, those skilled in the art once know base This creative concept can then make these embodiments other change and modification.So appended claims are intended to be construed to Including preferred embodiment and fall into all change and modification of the embodiment of the present application scope.
Finally, it is to be noted that, herein, relational terms such as first and second and the like be used merely to by One entity or operation are distinguished with another entity or operation, without necessarily requiring or implying these entities or operation Between there are any actual relationship or orders.Moreover, term " comprising ", "comprising" or its any other variant meaning Covering non-exclusive inclusion, so that process, method, article or terminal device including a series of elements are not only wrapped Those elements are included, but also including other elements that are not explicitly listed or are further included as this process, method, article Or the element that terminal device is intrinsic.In the absence of more restrictions, it is wanted by what sentence "including a ..." limited Element, it is not excluded that also there are other identical elements in the process including the element, method, article or terminal device.
Above to a kind of method and device of concurrent quantity of the dynamic dispatching in test execution provided herein, carry out It is discussed in detail, applying specific case in text, the principle and implementation of this application are described, above example Illustrate to be only intended to help to understand the present processes and its core concept;Meanwhile for those of ordinary skill in the art, according to According to the thought of the application, there will be changes in specific embodiments and applications, in conclusion this specification content It should not be construed as the limitation to the application.

Claims (16)

  1. A kind of 1. method of the concurrent quantity of the dynamic dispatching in test execution, which is characterized in that including:
    Host process receives the operation requests of user;For host process for generating multiple subprocess, each subprocess is multiple for generating Sub-line journey;
    The in vivo performance variable value of the structure of host process in shared drive is arranged to represent the value of the operation requests by host process, to Subprocess sends notification signal;
    Subprocess is when receiving the notification signal, the in vivo operation of structure by judging host process in the shared drive Variate-value performs corresponding operation;
    Wherein, when the operation requests of user is stop, suspending or recover the request of subprocess execution, subprocess performs corresponding Operation includes:
    The in vivo performance variable value of the structure of the subprocess in shared drive is arranged to represent the operation requests by subprocess Value;
    Then the method further includes:
    Each sub-line journey Xun Huan of subprocess performs test code;
    Sub-line journey is before each Xun Huan performs, the in vivo performance variable of structure by judging affiliated subprocess in shared drive Value performs corresponding operation;Corresponding operation includes:Continue to execute test or do not perform be directly entered cycle next time or Person directly exits the subprocess.
  2. 2. according to the method described in claim 1, it is characterized in that, when the operation requests of user are compulsory withdrawal test execution During request, the corresponding operating that subprocess performs includes:
    Subprocess exits process operation.
  3. 3. according to the method described in claim 1, it is characterized in that, when the operation requests of user perform to stop all subprocess Request when:
    The corresponding operating that each subprocess performs includes:Subprocess becomes the in vivo operation of the structure of the subprocess in shared drive Magnitude is arranged to represent the value for stopping performing;
    The corresponding operating that each sub-line journey of each subprocess performs includes:Sub-line journey is gone to when cycling next time, is judged altogether The in vivo performance variable value of structure for enjoying affiliated subprocess in memory is arranged to represent the value for stopping performing, then exits Xun Huan behaviour Make;
    The corresponding operating that each subprocess performs further includes:The each sub-line journey of the subprocess that subprocess waits until exits Xun Huan behaviour After work, analyze the test data of the subprocess and generate test report.
  4. 4. according to the method described in claim 1, it is characterized in that, when the operation requests of user perform to suspend all subprocess Request when:
    The corresponding operating that each subprocess performs includes:Subprocess becomes the in vivo operation of the structure of the subprocess in shared drive Magnitude is arranged to represent the value that pause performs;
    The corresponding operating that each sub-line journey of each subprocess performs includes:Sub-line journey is gone to when cycling next time, is judged altogether The in vivo performance variable value of structure for enjoying affiliated subprocess in memory is arranged to represent the value that pause performs, then stops performing this time Circulate operation, and jump into and cycle next time.
  5. 5. according to the method described in claim 1, it is characterized in that, when the operation requests of user perform to recover all subprocess Request when:
    The corresponding operating that each subprocess performs includes:Subprocess becomes the in vivo operation of the structure of the subprocess in shared drive Magnitude is arranged to represent the value continued to execute;
    The corresponding operating that each sub-line journey of each subprocess performs includes:Sub-line journey is gone to when cycling next time, is judged altogether The in vivo performance variable value of structure for enjoying affiliated subprocess in memory is arranged to represent the value continued to execute, then continues to execute Xun Huan Operation.
  6. 6. according to the method described in claim 1, it is characterized in that, when user operation requests for selectivity pause part son into During the request of Cheng Zhihang,
    It further includes:The structure of each subprocess in host process traversal shared drive, according to the in vivo operation of the structure of subprocess Variate-value judges whether subprocess is carrying out, and the subprocess being carrying out mark is issued user;
    Host process receives the subprocess mark that user selects pause, by the in vivo performance variable of the structure of host process in shared drive Value is arranged to represent the value that selectivity pause part subprocess performs, and the subprocess of right rear line selection pause sends notice letter Number;
    The corresponding operating that the user selects the subprocess of pause to perform includes:Subprocess is by the knot of the subprocess in shared drive The in vivo performance variable value of structure is arranged to represent the value that pause performs;
    The corresponding operating that the user selects each sub-line journey of the subprocess of pause to perform includes:Sub-line journey is gone to next time During cycling, judge that the in vivo performance variable value of structure of affiliated subprocess in shared drive is arranged to represent the value that pause performs, Then stop performing this circulate operation, and jump into and cycle next time.
  7. 7. according to the method described in claim 1, it is characterized in that, when user operation requests for selective recovery part into During the request of Cheng Zhihang,
    It further includes:The structure of each subprocess in host process traversal shared drive, according to the in vivo operation of the structure of subprocess Variate-value judges whether subprocess suspends execution, and the subprocess mark for suspending execution is issued user;
    Host process receives user and selects the subprocess recovered mark, by the in vivo performance variable of the structure of host process in shared drive Value is arranged to represent the value that selective recovery part subprocess performs, and the subprocess that right rear line selection recovers sends notice letter Number;
    The corresponding operating that the user selects the subprocess recovered to perform includes:Subprocess is by the knot of the subprocess in shared drive The in vivo performance variable value of structure is arranged to represent the value continued to execute;
    The corresponding operating that the user selects each sub-line journey of the subprocess recovered to perform includes:Sub-line journey is gone to next time During cycling, judge that the in vivo performance variable value of structure of affiliated subprocess in shared drive is arranged to represent the value continued to execute, Then continue to execute circulate operation.
  8. 8. according to claim 1-7 any one of them methods, which is characterized in that the host process receives the operation requests of user Before, further include:
    Host process receives the scheduling control signal that user sends, and returns to actions menu to user;
    Host process receives the option of operation that user selects in the actions menu, each option of operation pair in the actions menu Answer an operation requests.
  9. 9. one kind concurrent quantity device of dynamic dispatching in test execution, which is characterized in that including:
    User interaction unit receives the operation requests of user for host process;Host process is for generating multiple subprocess, per height Process is used to generate multiple sub-line journeys;
    The in vivo performance variable value of the structure of host process in shared drive is arranged to generation by host process scheduling unit for host process The value of the table operation requests sends notification signal to subprocess;
    Subprocess scheduling unit, it is main in the shared drive by judging for subprocess when receiving the notification signal The in vivo performance variable value of structure of process performs corresponding operation;
    Wherein, when the operation requests of user is stop, suspending or recover the request of subprocess execution:
    The subprocess scheduling unit sets the in vivo performance variable value of the structure of the subprocess in shared drive for subprocess It is set to the value for representing the operation requests;
    Then described device further includes:
    Sub-line journey scheduling unit performs test code for each sub-line journey Xun Huan of subprocess;Sub-line journey is held in each Xun Huan Before row, the in vivo performance variable value of structure by judging affiliated subprocess in shared drive performs corresponding operation;Accordingly Operation include:It continues to execute to test not performing either to be directly entered and cycles or directly exit the subprocess next time.
  10. 10. device according to claim 9, which is characterized in that when the operation requests of user are compulsory withdrawal test execution Request when, the subprocess scheduling unit includes:
    Compulsory withdrawal subelement exits process operation for subprocess.
  11. 11. device according to claim 9, which is characterized in that when the operation requests of user are held to stop all subprocess During capable request:
    The subprocess scheduling unit includes:Process stops subelement, and following corresponding operating is performed for each subprocess:Son The in vivo performance variable value of the structure of the subprocess in shared drive is arranged to represent the value for stopping performing by process;
    The sub-line journey scheduling unit includes:Thread stops subelement, as follows for each sub-line journey execution of each subprocess Corresponding operating:Sub-line journey is gone to when cycling next time, judges the in vivo operation of structure of affiliated subprocess in shared drive Variate-value is arranged to represent the value for stopping performing, then exits circulate operation;
    The subprocess scheduling unit further includes:Report generation subelement waits until each sub-line of the subprocess for subprocess After journey all exits circulate operation, analyze the test data of the subprocess and generate test report.
  12. 12. device according to claim 9, which is characterized in that when the operation requests of user are held to suspend all subprocess During capable request:
    The subprocess scheduling unit includes:Process suspension subelement performs following corresponding operating for each subprocess:Son The in vivo performance variable value of the structure of the subprocess in shared drive is arranged to represent the value of pause execution by process;
    The sub-line journey scheduling unit includes:Thread suspends subelement, as follows for each sub-line journey execution of each subprocess Corresponding operating:Sub-line journey is gone to when cycling next time, judges the in vivo operation of structure of affiliated subprocess in shared drive Variate-value is arranged to represent the value that pause performs, then stops performing this circulate operation, and jump into and cycle next time.
  13. 13. device according to claim 9, which is characterized in that when the operation requests of user are held to recover all subprocess During capable request:
    The subprocess scheduling unit includes:Process resumption subelement performs following corresponding operating for each subprocess:Son The in vivo performance variable value of the structure of the subprocess in shared drive is arranged to represent the value continued to execute by process;
    The sub-line journey scheduling unit includes:Thread recovers subelement, as follows for each sub-line journey execution of each subprocess Corresponding operating:Sub-line journey is gone to when cycling next time, judges the in vivo operation of structure of affiliated subprocess in shared drive Variate-value is arranged to represent the value continued to execute, then continues to execute circulate operation.
  14. 14. device according to claim 9, which is characterized in that when the operation requests of user are selectivity pause part During the request that process performs:
    The user interaction unit is additionally operable to the structure of each subprocess in host process traversal shared drive, according to subprocess The in vivo performance variable value of structure judges whether subprocess is carrying out, and the subprocess being carrying out mark is issued user;
    The host process scheduling unit for host process receive user select pause subprocess mark, will in shared drive lead into The in vivo performance variable value of structure of journey is arranged to represent the value that selectivity pause part subprocess performs, right rear line selection The subprocess of pause sends notification signal;
    The subprocess scheduling unit includes:Process selection suspends subelement, and the subprocess of pause is selected for the user Perform following corresponding operating:The in vivo performance variable value of the structure of the subprocess in shared drive is arranged to represent by subprocess Suspend the value performed;
    The sub-line journey scheduling unit includes:Thread-selective suspends subelement, for the every of the subprocess for selecting to suspend A sub-line journey performs following corresponding operating:Sub-line journey is gone to when cycling next time, judges affiliated subprocess in shared drive The in vivo performance variable value of structure be arranged to represent pause perform value, then stop performing this circulate operation, and jump into down One cycle.
  15. 15. device according to claim 9, which is characterized in that when the operation requests of user are selective recovery part During the request that process performs:
    The user interaction unit is additionally operable to the structure of each subprocess in host process traversal shared drive, according to subprocess The in vivo performance variable value of structure judges whether subprocess suspends execution, and the subprocess mark for suspending execution is issued user;
    The host process scheduling unit for host process receive user select recover subprocess mark, will in shared drive lead into The in vivo performance variable value of structure of journey is arranged to represent the value that selective recovery part subprocess performs, right rear line selection The subprocess of recovery sends notification signal;
    The subprocess scheduling unit includes:Process selection recovers subelement, the subprocess for selecting to recover for the user Perform following corresponding operating:The in vivo performance variable value of the structure of the subprocess in shared drive is arranged to represent by subprocess The value continued to execute;
    The sub-line journey scheduling unit includes:Thread-selective recovers subelement, the subprocess for selecting to recover for the user Each sub-line journey perform following corresponding operating:Sub-line journey is gone to when cycling next time, judges affiliated son in shared drive The in vivo performance variable value of structure of process is arranged to represent the value continued to execute, then continues to execute circulate operation.
  16. 16. device according to claim 9, it is characterised in that:
    The user interaction unit is additionally operable to before the operation requests that host process receives user, receives the scheduling controlling that user sends Signal, and actions menu is returned to user, the option of operation that user selects in the actions menu is received, wherein each operation Option corresponds to an operation requests.
CN201510130667.8A 2011-06-17 2011-06-17 A kind of method and device of the concurrent quantity of the dynamic dispatching in test execution Active CN104809058B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201510130667.8A CN104809058B (en) 2011-06-17 2011-06-17 A kind of method and device of the concurrent quantity of the dynamic dispatching in test execution

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201110163953.6A CN102831053B (en) 2011-06-17 2011-06-17 Scheduling method and device for test execution
CN201510130667.8A CN104809058B (en) 2011-06-17 2011-06-17 A kind of method and device of the concurrent quantity of the dynamic dispatching in test execution

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
CN201110163953.6A Division CN102831053B (en) 2011-06-17 2011-06-17 Scheduling method and device for test execution

Publications (2)

Publication Number Publication Date
CN104809058A CN104809058A (en) 2015-07-29
CN104809058B true CN104809058B (en) 2018-05-18

Family

ID=47334202

Family Applications (3)

Application Number Title Priority Date Filing Date
CN201510130667.8A Active CN104809058B (en) 2011-06-17 2011-06-17 A kind of method and device of the concurrent quantity of the dynamic dispatching in test execution
CN201510131327.7A Active CN104750607B (en) 2011-06-17 2011-06-17 A kind of method and device of selective recovery test execution
CN201110163953.6A Expired - Fee Related CN102831053B (en) 2011-06-17 2011-06-17 Scheduling method and device for test execution

Family Applications After (2)

Application Number Title Priority Date Filing Date
CN201510131327.7A Active CN104750607B (en) 2011-06-17 2011-06-17 A kind of method and device of selective recovery test execution
CN201110163953.6A Expired - Fee Related CN102831053B (en) 2011-06-17 2011-06-17 Scheduling method and device for test execution

Country Status (2)

Country Link
CN (3) CN104809058B (en)
HK (3) HK1174108A1 (en)

Families Citing this family (18)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103544102B (en) * 2013-09-02 2016-01-06 烟台中科网络技术研究所 A kind of software performance test analogy method and device
CN103544103A (en) * 2013-09-02 2014-01-29 烟台中科网络技术研究所 Method and system for test, simulation and concurrence of software performance
CN104834586B (en) * 2014-02-10 2018-11-20 腾讯科技(深圳)有限公司 Android interface automation test method, apparatus and system
CN105426231A (en) * 2014-09-04 2016-03-23 腾讯科技(深圳)有限公司 Multi-processing apparatus and multi-processing method
CN105607991A (en) * 2014-11-20 2016-05-25 阿里巴巴集团控股有限公司 Test method and device based on asynchronous threads
CN105740120B (en) * 2014-12-11 2018-08-17 中国科学院软件研究所 The monitoring in real time of software running process based on shared drive and control method and system
CN105915587B (en) * 2016-04-05 2019-03-26 网宿科技股份有限公司 Content delivery method, system and cache server
CN108632645A (en) * 2017-03-17 2018-10-09 北京京东尚科信息技术有限公司 Information demonstrating method and device
CN109508239A (en) * 2017-09-15 2019-03-22 北京国双科技有限公司 The control method and device of process
CN108255622A (en) * 2018-01-17 2018-07-06 郑州云海信息技术有限公司 The method and system that a kind of SMASH CLP functions are realized
CN109471794A (en) * 2018-10-08 2019-03-15 深圳市广和通无线股份有限公司 Method for testing software, device, computer equipment and readable storage medium storing program for executing
CN110347606B (en) * 2019-07-15 2022-11-08 百度(中国)有限公司 Automatic testing method, device, equipment and storage medium
CN110581787B (en) * 2019-09-11 2020-12-22 成都安恒信息技术有限公司 Application layer data quantity multiplication method applied to performance test
CN113535346B (en) * 2020-04-21 2024-03-19 中移动信息技术有限公司 Method, device, equipment and computer storage medium for adjusting thread number
CN112765019B (en) * 2021-01-13 2024-01-19 北京鼎事兴教育咨询有限公司 Pressure measurement method and device, storage medium and electronic equipment
CN113656175B (en) * 2021-08-18 2022-07-08 北京百度网讯科技有限公司 Method and equipment for training model based on distributed system
CN117240958A (en) * 2022-06-06 2023-12-15 中兴通讯股份有限公司 Audio and video processing performance test method and device
CN116089049B (en) * 2023-04-07 2023-09-12 北京卡普拉科技有限公司 Asynchronous parallel I/O request-based process synchronous scheduling method, device and equipment

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1504892A (en) * 2002-12-05 2004-06-16 华为技术有限公司 Realization method for communication between tasks
CN101248405A (en) * 2005-04-29 2008-08-20 微软公司 Multithreading with concurrency domains

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1217265C (en) * 2002-08-19 2005-08-31 万达信息股份有限公司 Process automatic restoring method
CN1842770A (en) * 2003-08-28 2006-10-04 美普思科技有限公司 Integrated mechanism for suspension and deallocation of computational threads of execution in a processor
US7418585B2 (en) * 2003-08-28 2008-08-26 Mips Technologies, Inc. Symmetric multiprocessor operating system for execution on non-independent lightweight thread contexts
US7321965B2 (en) * 2003-08-28 2008-01-22 Mips Technologies, Inc. Integrated mechanism for suspension and deallocation of computational threads of execution in a processor
CN102063366B (en) * 2009-11-18 2014-12-31 中兴通讯股份有限公司 Method and system for debugging process

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1504892A (en) * 2002-12-05 2004-06-16 华为技术有限公司 Realization method for communication between tasks
CN101248405A (en) * 2005-04-29 2008-08-20 微软公司 Multithreading with concurrency domains

Also Published As

Publication number Publication date
CN104809058A (en) 2015-07-29
CN104750607B (en) 2018-07-06
HK1209216A1 (en) 2016-03-24
CN102831053A (en) 2012-12-19
HK1207723A1 (en) 2016-02-05
CN102831053B (en) 2015-05-13
HK1174108A1 (en) 2013-05-31
CN104750607A (en) 2015-07-01

Similar Documents

Publication Publication Date Title
CN104809058B (en) A kind of method and device of the concurrent quantity of the dynamic dispatching in test execution
Silva et al. Cloudbench: Experiment automation for cloud environments
US8813035B2 (en) Paradigm for concurrency testcase generation
US9442817B2 (en) Diagnosis of application server performance problems via thread level pattern analysis
CN110147327B (en) Multi-granularity-based web automatic test management method
CN103713935A (en) Method and device for managing Hadoop cluster resources in online manner
CN108255689A (en) A kind of Apache Spark application automation tuning methods based on historic task analysis
CN109144511B (en) Method and system for automatically generating numerical simulation graphical user interface
CN105183547A (en) Task scheduling method and device of user interface
US9384044B2 (en) Intelligent inclusion/exclusion automation
CN112650676A (en) Software testing method, device, equipment and storage medium
CN110740079A (en) full link benchmark test system for distributed scheduling system
Dissaux et al. The SMART project: Multi-agent scheduling simulation of real-time architectures
US10169194B2 (en) Multi-thread sequencing
Ali et al. Automated parallel GUI testing as a service for mobile applications
CN109710513A (en) A kind of engine for the test of CBTC system automation
Tsai et al. Taas (testing-as-a-service) design for combinatorial testing
Augusto et al. RETORCH: Resource-aware end-to-end test orchestration
CN117539754A (en) Pressure testing method and device, storage medium and electronic equipment
Shenoy et al. An adaptive framework for web services testing automation using JMeter
CN116719601A (en) Simulation method, device, equipment and storage medium of electronic equipment control system
CN111062681B (en) Course selection tour inspection method and device, server and storage medium
CN114238137A (en) Batch processing task testing method and device, storage medium and program product
Kozak et al. Three-module framework for automated software testing
Rover et al. Software tools for complex distributed systems: Toward integrated tool environments

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
EXSB Decision made by sipo to initiate substantive examination
SE01 Entry into force of request for substantive examination
REG Reference to a national code

Ref country code: HK

Ref legal event code: DE

Ref document number: 1209216

Country of ref document: HK

GR01 Patent grant
GR01 Patent grant
TR01 Transfer of patent right
TR01 Transfer of patent right

Effective date of registration: 20230523

Address after: Room 1-2-A06, Yungu Park, No. 1008 Dengcai Street, Sandun Town, Xihu District, Hangzhou City, Zhejiang Province

Patentee after: Aliyun Computing Co.,Ltd.

Address before: Box 847, four, Grand Cayman capital, Cayman Islands, UK

Patentee before: ALIBABA GROUP HOLDING Ltd.