CN104750607A

CN104750607A - Method and device for selectively recovering test execution

Info

Publication number: CN104750607A
Application number: CN201510131327.7A
Authority: CN
Inventors: 崔峥
Original assignee: Alibaba Group Holding Ltd
Current assignee: Alibaba Cloud Computing Ltd
Priority date: 2011-06-17
Filing date: 2011-06-17
Publication date: 2015-07-01
Anticipated expiration: 2031-06-17
Also published as: HK1209216A1; CN104750607B; CN104809058B; CN102831053A; HK1174108A1; HK1207723A1; CN104809058A; CN102831053B

Abstract

The invention provides a method and device for selectively recovering test execution. The method and device can change execution of progresses dynamically. The method includes the steps that a host progress receives an operation request of a user; the host progress sets an operation variable value in a host progress structure body in a shared memory to be a value representing the operation request, and then notification signals are transmitted to sub-progresses; after receiving the notification signals, the sub-progresses judge the operation variable value in the host progress structure body in the shared memory and execute corresponding operation. Based on the multiple progresses and multiple threads, through the method and device, the operation variable value in the host progress structure body is changed to dynamically change execution of the progresses according to the operation request of the user, execution states of all the progresses are controlled, switching between several progress states is achieved, in this way, test scenes can be enriched, and a complex test curvature can be manufactured accordingly.

Description

A kind of method of selective recovery test execution and device

The divisional application that patented claim of the present invention is the applying date is on June 17th, 2011, application number is 201110163953.6, name is called the Chinese invention patent application of " a kind of dispatching method of test execution and device ".

Technical field

The application relates to measuring technology, particularly relates in performance test, a kind of method of selective recovery test execution and device.

Background technology

Software test utilizes testing tool to carry out function and performance test according to testing scheme and flow process to product exactly, writes different testing tools even as required, design and maintenance test system, may carry out assessment and analysis by produced problem to testing scheme.After implementation of test cases, need to follow the tracks of fault, to guarantee that the product developed is applicable to demand.

Performance test in software test is tested by multiple normal, the peak value of the testing tool of robotization simulation and the property indices of abnormal load conditions to system.In performance test, comprise concurrency performance test, fatigue strength test, big data quantity test and velocity test etc., wherein concurrency performance test is emphasis.

The process of concurrency performance test is the process of a load testing and pressure test, namely load is increased gradually, until the bottleneck of system or the performance point that can not receive, carry out the process of certainty annuity concurrency performance by comprehensively analyzing transaction index of performance and monitoring resource index.

At present, in concurrency performance test, the scheduling of concurrent request just secures when execution performance test at the beginning, and after user have input the number of concurrent that will generate, system just goes generation concurrent according to this fixing value.But in practical application, system has many different situations, such as, certain system is at zero point at night, require to reach the lowest point for the number of concurrent of testing, and at 9 in the morning and point at noon 12, require that again number of concurrent reaches two peak periods, but the generation of above-mentioned dispatching method number of concurrent in whole test process is fixing, this test case of this system cannot be simulated.

Therefore, in the test of existing concurrency performance, above-mentioned this concurrent scheduling method cannot the test scene of Simulation of Complex, causes test result to be not enough to the problem illustrating that test scene runs into, test even may be caused to go wrong.

Summary of the invention

This application provides a kind of method and device of selective recovery test execution, to solve the problem that in test, number of concurrent is fixing.

The embodiment of the present application discloses a kind of method of selective recovery test execution, comprising:

Host process receives operation requests;

When operation requests is the request of selective recovery parton process execution, performance variable value in host process structure in shared drive is set to the value representing the execution of selective recovery parton process by host process, sends notification signal to the subprocess selecting to recover;

The subprocess recovered is selected to be set to the performance variable value in this subprocess structure in shared drive to represent according to the performance variable value representing the execution of selective recovery parton process the value continuing to perform;

Select the sub-thread of the subprocess of recovery before circulation performs test, continue according to representative in subprocess structure affiliated in shared drive the performance variable value performed, perform current test operation.

Preferably, the step that the described subprocess to selecting to recover sends notification signal comprises:

According to the performance variable value in subprocess structure, each subprocess structure in host process traversal shared drive, judges whether subprocess suspends, and return the subprocess mark suspended and perform;

Host process receives suspends from described the subprocess mark selecting the subprocess mark performed to recover;

Host process sends notification signal to the subprocess that the described subprocess mark selecting to recover is corresponding.

Preferably, the method also comprises:

When operation requests is the request of compulsory withdrawal test execution, the performance variable value in host process structure in shared drive is set to the value representing compulsory withdrawal test by host process, sends notification signal to subprocess;

Subprocess, according to the performance variable value representing compulsory withdrawal test in subprocess structure affiliated in shared drive, exits process operation.

Preferably, the method also comprises:

When operation requests is the request stopping all subprocesss to perform, the performance variable value in host process structure in shared drive is set to represent the value stopping all subprocesss to perform by host process, sends notification signal to subprocess;

Performance variable value in this subprocess structure in shared drive is set to represent the value stopping performing by the performance variable value that subprocess stops all subprocesss to perform according to representative;

The sub-thread of subprocess, before circulation performs test, stops according to representative in subprocess structure affiliated in shared drive the performance variable value performed, exits loop test and operate;

Subprocess is according to Test data generation test report.

Preferably, the method also comprises:

When operation requests is the request suspending the execution of all subprocesss, the performance variable value in host process structure in shared drive is set to represent the value suspended all subprocesss and perform by host process, sends notification signal to subprocess;

Performance variable value in this subprocess structure in shared drive is set to represent the value suspended and perform by the performance variable value that subprocess suspends the execution of all subprocesss according to representative;

The sub-thread of subprocess before circulation performs test, according to representative in subprocess structure belonging in shared drive suspend perform performance variable value, stop performing current test operation, to jump into test operation next time.

Preferably, the method also comprises:

When operation requests is the request recovering the execution of all subprocesss, the performance variable value in host process structure in shared drive is set to represent the value recovered all subprocesss and perform by host process, sends notification signal to subprocess;

Performance variable value in this subprocess structure in shared drive is set to represent the value continuing to perform by the performance variable value that subprocess recovers the execution of all subprocesss according to representative;

The sub-thread of subprocess before circulation performs test, according to representative in subprocess structure belonging in shared drive continue to perform performance variable value, continue to perform test operation.

Preferably, the method also comprises:

When operation requests is the request of selectivity time-out parton process execution, performance variable value in host process structure in shared drive is set to represent the value that selectivity suspends the execution of parton process by host process, sends notification signal to the subprocess selecting to suspend;

The subprocess suspended is selected the performance variable value in this subprocess structure in shared drive to be set to represent the value suspended and perform according to the performance variable value representing the execution of selectivity time-out parton process;

Select the sub-thread of the subprocess of time-out before circulation performs test, suspend according to representative in subprocess structure affiliated in shared drive the performance variable value performed, stopping performs current test operation, to jump into test operation next time.

Preferably, the step that the described subprocess to selecting to suspend sends notification signal comprises:

According to the performance variable value in subprocess structure, each subprocess structure in host process traversal shared drive, judges whether subprocess performs, and return the subprocess mark performed;

Host process receives the subprocess mark selecting to suspend from the described subprocess mark performed;

Host process sends notification signal to the subprocess that the subprocess mark selecting to suspend is corresponding.

Preferably, before described host process receives operation requests, described method also comprises:

Host process receiving scheduling control signal, returns actions menu;

Host process receives the option of operation selected in described actions menu, the corresponding operation requests of each option of operation in described actions menu.

The embodiment of the present application also discloses a kind of device of selective recovery test execution, and described device comprises host process, subprocess, sub-thread; Wherein,

Described host process comprises:

Operation requests receiver module, for receiving operation requests;

First master scheduling module, for in operation requests be selective recovery parton process perform request time, performance variable value in host process structure in shared drive is set to the value representing the execution of selective recovery parton process, sends notification signal to the subprocess selecting to recover;

The subprocess recovered is selected to comprise:

Selective recovery module, for being set to represent according to the performance variable value representing the execution of selective recovery parton process the value continuing to perform by the performance variable value in this subprocess structure in shared drive;

The sub-thread of the subprocess recovered is selected to comprise:

Selective recovery test module, before performing test in circulation, continues according to representative in subprocess structure affiliated in shared drive the performance variable value performed, performs current test operation.

Preferably, described first master scheduling module comprises:

First subprocess mark returns submodule, for traveling through each subprocess structure in shared drive, judges whether subprocess suspends according to the performance variable value in subprocess structure, and returns the subprocess mark suspended and perform;

First subprocess mark receives submodule, suspends the subprocess mark selecting the subprocess mark performed to recover for receiving from described;

First notification signal sends submodule, sends notification signal for the subprocess corresponding to the described subprocess mark selecting to recover.Preferably, host process also comprises:

Second master scheduling module, for when operation requests is the request of compulsory withdrawal test execution, is set to the value representing compulsory withdrawal test, sends notification signal to subprocess by the performance variable value in host process structure in shared drive;

Subprocess also comprises:

Compulsory withdrawal module, for according to the performance variable value representing compulsory withdrawal test in subprocess structure affiliated in shared drive, exits process operation.

Preferably, host process also comprises:

3rd master scheduling module, during for being the request stopping all subprocesss to perform in operation requests, being set to the performance variable value in host process structure in shared drive represent the value stopping all subprocesss to perform, sending notification signal to subprocess;

Subprocess also comprises:

Stopping modular, is set to represent for the performance variable value stopping all subprocesss to perform according to representative the value stopping performing by the performance variable value in this subprocess structure in shared drive;

Test report generation module, for according to Test data generation test report.

The sub-thread of subprocess also comprises:

Stop test module, before performing test in circulation, in subprocess structure belonging in foundation shared drive, representative stops the performance variable value of execution, exits loop test operation.

Preferably, host process also comprises:

4th master scheduling module, during for being the request suspending the execution of all subprocesss in operation requests, being set to the performance variable value in host process structure in shared drive represent the value suspended all subprocesss and perform, sending notification signal to subprocess;

Subprocess also comprises:

Suspend module, the performance variable value in this subprocess structure in shared drive is set to represent the value suspended and perform by the performance variable value performed for suspending all subprocesss according to representative;

The sub-thread of subprocess also comprises:

Suspend test module, before performing test in circulation, according to representative in subprocess structure belonging in shared drive suspend perform performance variable value, stop performing current test operation, to jump into test operation next time.

Preferably, host process also comprises:

5th master scheduling module, during for being the request recovering the execution of all subprocesss in operation requests, being set to the performance variable value in host process structure in shared drive represent the value recovered all subprocesss and perform, sending notification signal to subprocess;

Subprocess also comprises:

Recover module, the performance variable value in this subprocess structure in shared drive is set to represent the value continuing to perform by the performance variable value performed for recovering all subprocesss according to representative;

The sub-thread of subprocess also comprises:

Continue test module, before performing test in circulation, according to representative in subprocess structure belonging in shared drive continue to perform performance variable value, continue to perform test operation.

Preferably, host process also comprises:

6th master scheduling module, for when when operation requests being the request of selectivity time-out parton process execution, performance variable value in host process structure in shared drive is set to represent the value that selectivity suspends the execution of parton process, sends notification signal to the subprocess selecting to suspend;

The subprocess suspended is selected also to comprise:

Selectivity suspends module, for the performance variable value in this subprocess structure in shared drive being set to represent the value suspended and perform according to the performance variable value representing the execution of selectivity time-out parton process;

The sub-thread of the subprocess suspended is selected also to comprise:

Selectivity suspends test module, and before circulation performs test, in subprocess structure belonging in foundation shared drive, representative suspends the performance variable value of execution, stops performing current test operation, to jump into test operation next time.

Preferably, described 6th master scheduling module comprises:

Second subprocess mark returns submodule, for traveling through each subprocess structure in shared drive, judges whether subprocess performs according to the performance variable value in subprocess structure, and returns the subprocess mark performed;

Second subprocess mark receives submodule, for receiving the subprocess mark selecting to suspend from the described subprocess mark performed;

Second notification signal sends submodule, sends notification signal for the subprocess corresponding to the subprocess mark selecting to suspend.

Preferably, host process also comprises:

Actions menu returns module, for receiving scheduling control signal, returns actions menu;

Option of operation receiver module, for receiving the option of operation selected in described actions menu, the corresponding operation requests of each option of operation in described actions menu.

The embodiment of the present application comprises following advantage:

First, the embodiment of the present application proposes a kind of dispatching method of the test execution based on multi-process multithreading, in the process of performance test, host process receives the operation requests of user, then the performance variable value in host process structure in shared drive is set to the value representing this operation requests, then sends notification signal, after subprocess receives described notification signal to subprocess, by judging the performance variable value in described shared drive in host process structure, performing and operating accordingly.By described method, can according to the operation requests of user, by changing the performance variable value in host process structure, the execution of dynamic change process, control the executing state of each group process, realize the conversion between several process status, thus can test scene be enriched, also can make complicated test curve accordingly.

And, when in the embodiment of the present application, host process sends notification signal to subprocess, no matter which kind of operation requests, all send same signal, because this signal plays the effect of notice subprocess, do not represent which kind of concrete operation requests, therefore use a kind of information can save spendable semaphore, and be not limited to the semaphore quantity of operating system, be adapted at applying in various real system.

Secondly, it is mutual that the embodiment of the present application can also realize between user and process, when user wants change process due to certain demand, can send signal to host process, by the feedback of host process, select the process that will change.Can make to have between user and process the process that mutual thus, thus can change the executing state of these processes, the strategy regulating process to generate and frequency, meet the various demands of user.

Again, the embodiment of the present application can when open test implementation, the performance issue of investigation system under test (SUT).Such as, in pressure test implementation, the a certain moment finds that system under test (SUT) has internal memory to overflow situation, can be suspended the generation of pressure, then gone to investigate this overflow problem by developer by the application, observe to overflow when pressure suspends and whether continue, or shrink, by constantly recovering and suspending, reduce and raised pressure, when not interrupting whole performance test implementation, complete the investigation of system under test (SUT) problem.

Certainly, the arbitrary product implementing the application not necessarily needs to reach above-described all advantages simultaneously.

Accompanying drawing explanation

Fig. 1 is the method flow diagram of a kind of selective recovery test execution of the embodiment of the present application;

Fig. 2 is the method flow diagram of a kind of selective recovery test execution of the application's preferred embodiment;

Fig. 3 is the process flow diagram of host process in the method for a kind of selective recovery test execution of the application's preferred embodiment;

Fig. 4 is the process flow diagram of the method sub-process of a kind of selective recovery test execution of the application's preferred embodiment;

Fig. 5 is the process flow diagram of the sub-thread of method sub-process of a kind of selective recovery test execution of the application's preferred embodiment;

Fig. 6 is the structure drawing of device of a kind of selective recovery test execution of the embodiment of the present application;

Fig. 7 is the structure drawing of device of the another kind of selective recovery test execution of the embodiment of the present application.

Embodiment

For enabling above-mentioned purpose, the feature and advantage of the application more become apparent, below in conjunction with the drawings and specific embodiments, the application is described in further detail.

In order to change the concurrent quantity in test process dynamically, this application provides a kind of dispatching method of test execution, in the process of performance test, mutual by between user and process, the execution of dynamic change process, controls the executing state of each group process.The application is mainly applicable in the test of various concurrency performance.

Be described in detail below by the content of embodiment to the application.

With reference to Fig. 1, it is the method flow diagram of a kind of selective recovery test execution of the embodiment of the present application.

In the present embodiment, use the implementation of multi-process multithreading, described multithreading multi-process to refer to when running concurrent operations, host process generates multiple subprocess, and each subprocess generates again multiple sub-thread.And in the initialized process of host process, can generate the region of memory that process is shared, in measuring executing process, all processes and sub-thread thereof can access shared drive region, and therefrom read variable.

Described method is mainly used in the execution of dynamic change process in measuring executing process, comprises the following steps:

Step 101, host process receives operation requests;

In the implementation of performance test, can realize mutual between user and process, host process can pass through certain mode, receives the operation requests of user.

In the present embodiment, one preferably, when Performance Test System performs, if user wants to perform certain operation, a signal can be sent to host process, after host process receives this signal, return to user's exercisable menu, user selects a certain option of operation in this menu and inputs to host process.Due to the corresponding operation requests of each option of operation, therefore user selects a certain option of operation and inputs to host process, is namely equivalent to send an operation requests to host process.As can be seen here, user according to the demand of oneself, can select to operate accordingly, controls test mode.

Step 102, the performance variable value in host process structure in shared drive is set to the value representing this operation requests by host process, sends notification signal to subprocess;

Host process, after receiving operation requests, by the performance variable value in host process structure in shared drive, can be set to the value representing this operation requests, then sends notification signal to the subprocess performed.

In the present embodiment, preferably, host process, when receiving option operations, can represent the value of this operation requests to one, assignment to the performance variable of host process structure being arranged in shared drive, then sends a signal to each subprocess performing test.So just can change the execution of process dynamically, control process executing state.

Step 103, after subprocess receives described notification signal, by judging the performance variable value in described shared drive in host process structure, performing and operating accordingly.

After each subprocess performing test receives this signal, the performance variable in the host process structure in shared drive can be checked, by judging what kind of operation is the value of this performance variable decide to perform, as process exit, process suspension, process resumption etc. operation.

In sum, method described in Fig. 1 embodiment is in multi-process multithreading measuring executing process, host process receives the operation requests of user, then the performance variable value in host process structure in shared drive is set to the value representing this operation requests, notification signal is sent again to subprocess, after subprocess receives described notification signal, by judging the performance variable value in described shared drive in host process structure, performing and operating accordingly.By described method, can according to the operation requests of user, by changing the performance variable value in host process structure, the execution of dynamic change process, control the executing state of each group process, realize the conversion between several process status, thus can test scene be enriched, also can make complicated test curve accordingly.

And, when host process sends notification signal to subprocess, no matter which kind of operation requests, all send same signal, because this signal plays the effect of notice subprocess, do not represent which kind of concrete operation requests, therefore use a kind of information can save spendable semaphore, and be not limited to the semaphore quantity of operating system, be adapted at applying in various real system.

In actual applications, performance test plays an important role in the quality assurance of software, and the content measurement that it comprises is rich and varied.Performance test comprises three aspects: be applied in the test of client performance, be applied in the test of performance on network and be applied in the test of server end performance.Under normal circumstances, the combination effectively and reasonably of three aspects, can reach and comprehensively analyze system performance and the prediction of bottleneck.

Wherein, service end performance test is different from UI performance test, client performance test etc., by producing a large amount of high request frequency high concurrent request of access, service end is conducted interviews, allow service end run under long-time high load condition, check system runs the method for testing of correctness, stability.

In service end performance test, load testing and pressure test all belong to performance test, and both can in conjunction with carrying out.By load testing, determine the performance of system under various operating load, target is tested when load increases gradually, the situation of change of system property indices.The performance point that pressure test is bottleneck by determining a system or can not receives, the test of the maximum service rank that the system that obtains can provide.

In order to the content making those skilled in the art understand the application further, be described in more details for the pressure test of service end below.

Be example with Xnix system (Unix and linux system, and the derived version comprising them), certain described method is equally applicable to other operating systems such as Windows.

Be a kind of preferred embodiment of the application below, give the Performance Test System of Xnix system in pressure test performs, the pressure dispatching method that a kind of test macro and user can be mutual.

First, the interactive mode of test macro and user is determined:

Then in the embodiment of the present application, the method can comprise the steps:

Step 104, host process receiving scheduling control signal, returns actions menu;

Step 105, host process receives the option of operation selected in described actions menu, the corresponding operation requests of each option of operation in described actions menu.

Before host process receives the operation requests of user, host process can receive the scheduling control signal that user sends, and returning actions menu to user, user selects the option of operation in described actions menu and sends to host process, the corresponding operation requests of each option of operation in described actions menu.

When Performance Test System performs, if user wants to perform compulsory withdrawal test, stop test, suspend whole test pressure, recover whole test pressure, suspend the operation of partial test pressure or recovered part test pressure, user can send some signals to host process, and (such as native system adopts SIGINT signal, also be Ctrl+C), after host process receives this signal, return to user's exercisable menu, user selects a certain option of operation in this menu and inputs to host process, host process operates according to this option again, reach the effect controlling subprocess.

Secondly, signal and shared drive structure determine the operation that will perform jointly:

After user have sent an operation requests to host process, host process will represent the value of this operation requests, assignment is to the childsigopt element of host process structure bench being arranged in shared drive, some signals (such as native system adopts SIGUSR1 signal) are sent again to each subprocess performing pressure test, after the semaphore handles function of subsystem receives this signal, the childsigopt element of the host process structure bench in shared drive can be checked, by judging that the value of this element decides to perform what kind of operation.Such as, the performance variable value in this subprocess structure in shared drive is set to the value representing described operation requests by subprocess.

In the multi-process multithreading measuring executing process described in embodiment, every sub-thread loops of subprocess performs test code, sub-thread, before each circulation performs, by judging the performance variable value in shared drive in affiliated subprocess structure, performing and operating accordingly.Such as, the pressure test service logic function performed in every sub-thread of each subprocess, be placed in a loop code body, a state being arranged in process shared drive and belonging to an element switcher of the structure bench_child of this subprocess can be judged before each execution, this yuan have three kinds of states, is respectively:

I.CONTINUE: state in operation, default conditions, in operation or after resuming operation, the value of switcher element is all this state;

Ii.BREAK: halted state, when the value of switcher is this state, circulation next time can jump out loop body, thus stops the pressing creation of execution performance test;

Iii.SUSPEND: halted state, when the value of switcher is this state, this circulation does not perform, and jumps into and circulates next time.

Host process is after receiving the operation requests that user sends, inform that subprocess has request process by signal, subprocess, by judging the childsigopt element of host process structure bench, decides the switcher element of this process structure body bench_child to compose with what value.And the pressure test service logic function in every sub-thread loops body of this subprocess is before upper once execution, by judging this switcher element, determine whether it being continue to perform, or do not perform directly to enter and circulate next time, or directly exit this process.Host process by sending a signal to each subprocess or parton process, can reach the pressure test practice condition controlling all or part of subprocess.

In the present embodiment, at user option option of operation comprises:

1) compulsory withdrawal;

Step S11, when operation requests is the request of compulsory withdrawal test execution, the performance variable value in host process structure in shared drive is set to the value representing compulsory withdrawal test by host process, sends notification signal to subprocess;

Step S12, subprocess, according to the performance variable value representing compulsory withdrawal test in subprocess structure affiliated in shared drive, exits process operation.

User does not wish that test continues perform and do not need executed test result for a certain reason, expects to exit at once, then can inform host process by described interactive mode, require compulsory withdrawal Performance Test System.

When the operation requests of user is the request of compulsory withdrawal test execution, the corresponding operating that subprocess performs is for exiting process operation.

Such as, the childsigopt element of host process structure bench will arranged in shared drive after host process receives request, is set to 0 by its value, then sends SIGUSR1 signal to each executory subprocess.Subprocess judges after receiving this signal whether the childsigopt element of the host process structure bench in shared drive is 0, if so, then performs and exits process (exit) operation.

2) all tests are stopped;

Step S21, when operation requests is the request stopping all subprocesss to perform, the performance variable value in host process structure in shared drive is set to represent the value stopping all subprocesss to perform by host process, sends notification signal to subprocess;

Step S22, the performance variable value in this subprocess structure in shared drive is set to represent the value stopping performing by the performance variable value that subprocess stops all subprocesss to perform according to representative;

Step S23, the sub-thread of subprocess, before circulation performs test, stops according to representative in subprocess structure affiliated in shared drive the performance variable value performed, exits loop test and operate;

Step S24, subprocess is according to Test data generation test report.

User wishes that test terminates and provides test report data at once (such as: performance test has run some hours for a certain reason, can based on test process so far, analyze required data), then can inform host process by described interactive mode, require that Stopping Ability test pressure generates

When the operation requests of user is the request stopping all subprocesss to perform, performance variable value in this subprocess structure in shared drive is set to represent the value stopping performing by each subprocess, every sub-thread execution of each subprocess is to circulation time next time, performance variable value in subprocess structure belonging to judging in shared drive is set to represent the value stopping performing, then exit cycling.Further, each subprocess is analyzed the test data of this subprocess and generates test report after waiting until that every sub-thread of this subprocess exits cycling.

Such as, the childsigopt element of host process structure bench will arranged in shared drive after host process receives request, is set to 1 by its value, then sends SIGUSR1 signal to each executory subprocess.Subprocess judges after receiving this signal whether the childsigopt element of the host process structure bench in shared drive is 1, if, in process shared drive, then find the bench_child structure belonging to this process, and be BREAK to the switcher element assignment of this structure.When in each subprocess, the loop body of every sub-thread performs circulation time next time, the switcher element value determining bench_child structure is BREAK, then perform and jump out cycling (break), after this subprocess waits until that every sub-thread all exits afterwards, the performance test data work of this process of execution analysis again, to generate performance test report.

3) time-out is all tested;

Step S31, when operation requests is the request suspending the execution of all subprocesss, the performance variable value in host process structure in shared drive is set to represent the value suspended all subprocesss and perform by host process, sends notification signal to subprocess;

Step S32, the performance variable value in this subprocess structure in shared drive is set to represent the value suspended and perform by the performance variable value that subprocess suspends the execution of all subprocesss according to representative;

Step S33, the sub-thread of subprocess before circulation performs test, according to representative in subprocess structure belonging in shared drive suspend perform performance variable value, stop performing current test operation, to jump into test operation next time.

User wishes that test suspends (such as: found property abnormality by pressing system at present, needing to stop pressure carrying out Commissioning Analysis) for a certain reason, then can inform host process by described interactive mode, performance test pressing creation of requesting timeout.

When the operation requests of user is the request suspending the execution of all subprocesss, performance variable value in this subprocess structure in shared drive is set to represent the value suspended and perform by each subprocess, every sub-thread execution of each subprocess is to circulation time next time, performance variable value in subprocess structure belonging to judging in shared drive is set to represent the value suspended and perform, then stop performing this cycling, and jump into and circulate next time.

Such as, the childsigopt element of host process structure bench will arranged in shared drive after host process receives request, is set to 2 by its value, then sends SIGUSR1 signal to each executory subprocess.Subprocess judges after receiving this signal whether the childsigopt element of the host process structure bench in shared drive is 2, if, in process shared drive, then find the bench_child structure belonging to this process, and be SUSPEND to the switcher element assignment of this structure.When in each subprocess, the loop body of every sub-thread performs circulation time next time, the switcher element value determining bench_child structure is SUSPEND, then do not perform any pressure test service logic function, have a rest after some milliseconds, enter and circulate next time, until the switcher element value of bench_child structure is changed to other states.

4) recover all to test;

Step S41, when operation requests is the request recovering the execution of all subprocesss, the performance variable value in host process structure in shared drive is set to represent the value recovered all subprocesss and perform by host process, sends notification signal to subprocess;

Step S42, the performance variable value in this subprocess structure in shared drive is set to represent the value continuing to perform by the performance variable value that subprocess recovers the execution of all subprocesss according to representative;

Step S43, the sub-thread of subprocess before circulation performs test, according to representative in subprocess structure belonging in shared drive continue to perform performance variable value, continue to perform test operation.

After the pressing creation of all processes of performance test is suspended, user wishes that test is resumed operation for a certain reason, then can inform host process by described interactive mode, require that restorability test pressure generates.

When the operation requests of user is the request recovering the execution of all subprocesss, performance variable value in this subprocess structure in shared drive is set to represent the value continuing to perform by each subprocess, every sub-thread execution of each subprocess is to circulation time next time, performance variable value in subprocess structure belonging to judging in shared drive is set to represent the value continuing to perform, then continue to perform cycling.

Such as, the childsigopt element of host process structure bench will arranged in shared drive after host process receives request, is set to 3 by its value, then sends SIGUSR1 signal to each executory subprocess.Subprocess judges after receiving this signal whether the childsigopt element of the host process structure bench in shared drive is 3, if, in process shared drive, then find the bench_child structure belonging to this process, and be CONTINUE to the switcher element assignment of this structure.When in each subprocess, the loop body of every sub-thread performs circulation time next time, the switcher element value determining bench_child structure is CONTINUE, then continue to perform pressure test service logic function, thus the generation of Recovery and rebuild.

5) partial test is suspended;

Step S51, when operation requests is the request of selectivity time-out parton process execution, performance variable value in host process structure in shared drive is set to represent the value that selectivity suspends the execution of parton process by host process, sends notification signal to the subprocess selecting to suspend;

Step S52, selects the subprocess suspended the performance variable value in this subprocess structure in shared drive to be set to represent the value suspended and perform according to the performance variable value representing the execution of selectivity time-out parton process;

Step S53, selects the sub-thread of the subprocess of time-out before circulation performs test, and suspend according to representative in subprocess structure affiliated in shared drive the performance variable value performed, stopping performs current test operation, to jump into test operation next time.

User wishes by changing the concurrent size of pressure for a certain reason, (such as 6 o'clock to 9 o'clock Concurrency Access pressure is very high in the afternoon for certain main website WEB server to simulate the behavior of real user access under certain environment, and at night after 10, concurrent request quantity reduces gradually), then can inform host process by described interactive mode, the performance test pressing creation of some process of requesting timeout.

When the operation requests of user is the request of selectivity time-out parton process execution, each subprocess structure in host process traversal shared drive, judge whether subprocess performs according to the performance variable value in subprocess structure, and the subprocess performed mark is issued user; Then, host process receives the subprocess mark that user selects to suspend, and the performance variable value in host process structure in shared drive is set to represent the value that selectivity suspends the execution of parton process, and right rear line selects the subprocess suspended to send notification signal; After user selects the subprocess suspended to receive described notification signal, the performance variable value in this subprocess structure in shared drive is set to represent the value suspended and perform; User selects every sub-thread execution of the subprocess suspended to circulation time next time, and the performance variable value in subprocess structure belonging to judging in shared drive is set to represent the value suspended and perform, then stopping execution this cycling, and jumps into and circulate next time.

In a kind of preferred exemplary of the embodiment of the present application, step S51 can comprise following sub-step:

Sub-step S51-1, according to the performance variable value in subprocess structure, each subprocess structure in host process traversal shared drive, judges whether subprocess performs, and return the subprocess mark performed;

Sub-step S51-2, host process receives the subprocess mark selecting to suspend from the described subprocess mark performed;

Sub-step S51-3, host process sends notification signal to the subprocess that the subprocess mark selecting to suspend is corresponding.

Such as, host process is by the bench_child structure of each subprocess in traversal shared drive, judge that whether the switcher elementary state of this process structure body is running i.e. CONTINUE, the process identification (PID) PID these being in the subprocess of state in operation issues user, allows user select.User sends to host process by needing the process PID suspended, the childsigopt element of host process structure bench will arranged in shared drive after host process receives request, its value is set to 4, then sends SIGUSR1 signal to several subprocesss that user specifies.These subprocesss judge after receiving this signal whether the childsigopt element of the host process structure bench in shared drive is 4, if, in process shared drive, then find the bench_child structure belonging to this process, and be SUSPEND to the switcher element assignment of this structure.When the loop body of every sub-thread of this batch of subprocess performs circulation time next time, the switcher element value determining this process bench_child structure is SUSPEND, then do not perform any pressure test service logic function, have a rest after some milliseconds, enter and circulate next time, until the switcher element value of bench_child structure is changed to other states.

6) recovered part test.

Step S61, when operation requests is the request of selective recovery parton process execution, performance variable value in host process structure in shared drive is set to the value representing the execution of selective recovery parton process by host process, sends notification signal to the subprocess selecting to recover;

Step S62, selects the subprocess recovered to be set to the performance variable value in this subprocess structure in shared drive to represent according to the performance variable value representing the execution of selective recovery parton process the value continuing to perform;

Step S63, selects the sub-thread of the subprocess of recovery before circulation performs test, continues the performance variable value performed, perform current test operation according to representative in subprocess structure affiliated in shared drive.

After some performance test process is suspended, user wishes that recovering some pressure test being suspended process performs, then can inform host process by described interactive mode, require the performance test pressing creation recovering some process for a certain reason.

When the operation requests of user is the request of selective recovery parton process execution, each subprocess structure in host process traversal shared drive, judge whether subprocess suspends execution according to the performance variable value in subprocess structure, and issue user by suspending the subprocess mark performed.Then, host process receives the subprocess mark that user selects to recover, and the performance variable value in host process structure in shared drive is set to the value representing the execution of selective recovery parton process, and the subprocess that right rear line is selected sends notification signal.Then, after user selects the subprocess recovered to receive described notification signal, the performance variable value in this subprocess structure in shared drive is set to represent the value continuing to perform.User selects every sub-thread execution of the subprocess recovered to circulation time next time, and the performance variable value in subprocess structure belonging to judging in shared drive is set to represent the value continuing to perform, then continuation execution cycling.

In a kind of preferred exemplary of the embodiment of the present application, step S61 can comprise following sub-step:

Sub-step 61-1, according to the performance variable value in subprocess structure, each subprocess structure in host process traversal shared drive, judges whether subprocess suspends, and return the subprocess mark suspended and perform;

Sub-step 61-2, host process receives suspends from described the subprocess mark selecting the subprocess mark performed to recover;

Sub-step 61-3, host process sends notification signal to the subprocess that the described subprocess mark selecting to recover is corresponding.

Such as, host process is by the bench_child structure of each subprocess in traversal shared drive, judge that whether the switcher elementary state of this process structure body is paused i.e. SUSPEND, the process PID these being in the subprocess of halted state issues user, allows user select.User sends to host process by needing the process PID resumed operation, the childsigopt element of host process structure bench will arranged in shared drive after host process receives request, its value is set to 5, then sends SIGUSR1 signal to several subprocesss that user specifies.These subprocesss judge after receiving this signal whether the childsigopt element of the host process structure bench in shared drive is 5, if, in process shared drive, then find the bench_child structure belonging to this process, and be CONTINUE to the switcher element assignment of this structure.When the loop body of every sub-thread of this batch of subprocess performs circulation time next time, the switcher element value determining this process bench_child structure is CONTINUE, then continue the service logic function performing pressure test, thus make system under test (SUT) obtain larger concurrent pressure.

In sum, it is mutual that the present embodiment can also realize between user and process, when user wants change process due to certain demand, can send signal to host process, by the feedback of host process, selects the process that will change.Can make to have between user and process the process that mutual thus, thus can change the executing state of these processes, the strategy regulating process to generate and frequency, meet the various demands of user.Further, change process dynamically, the conversion between several process status can be realized, enrich the test scene of process, complicated pressure curve also can be provided accordingly.

And, in the method described in the present embodiment, when host process sends notification signal to subprocess, no matter which kind of is asked, and all sends same signal, because this signal plays the effect of notice subprocess, do not represent which kind of concrete operation requests, therefore use a kind of information can save spendable semaphore, and be not limited to the semaphore quantity of operating system, be adapted at applying in various real system.

And, method described in the present embodiment, can when open test implementation, the performance issue of investigation system under test (SUT), such as, in pressure measuring executing process, the a certain moment finds that system under test (SUT) has internal memory to overflow situation, the generation of pressure can be suspended by the application, then gone to investigate this overflow problem by developer, observe to overflow when pressure suspends and whether continue, or shrink, by constantly recovering and suspending, reduce and raised pressure, when not interrupting whole performance test implementation, complete the investigation of system under test (SUT) problem.Thus, very strong practicality is had.

Based on foregoing, below by Fig. 2 to Fig. 5, the detailed flow process introducing a kind of preferred embodiment of the application.In the multi-process multithreading measuring executing process described in embodiment, the execution of process can be changed dynamically, meet the various demands of user.

The present embodiment is example with Xnix system (Unix and linux system, and the derived version comprising them), and certain described method is equally applicable to other operating systems such as Windows.

With reference to Fig. 2, it is the method flow diagram of a kind of selective recovery test execution of the application's preferred embodiment.

Step 201, starting pressure is tested, and host process registration receives SIGINT and SIGUSR1 signal;

Signal processor is made as: signal (SIGNT, cb_trap); Signal (SIGUSR1, cb_trap).

Step 202, initialize process shared drive, initialization host process structure, and be each subprocess structure allocation space, the pointer of shared drive is saved in global variable mbp;

Comprising, the structure of host process and subprocess structure, as shown in the figure.

Step 203, generates the subprocess of specified quantity by function f ork ();

After step 203, can step 204 be entered, also can enter flow process B, with reference to Fig. 5.

Step 204, host process generates timer thread, makes the execution number of times of Cbenchmark host process to pass through time controling;

If the control time, perform step 205, if not control time, wait for that all subprocesss are finished.

Step 205, the fixed time, starts timing;

By timed thread, by function pthread_create (), the fixed time.

Step 206, after timing terminates, found the bench structure of host process by mbp variable, assignment childsigopt element is 1, and allows each subprocess process by SIGUSR signal.

Host process sends SIGUSRI signal to each subprocess, enters flow process C, with reference to Fig. 4.

With reference to Fig. 3, it is the process flow diagram of host process in the method for a kind of selective recovery test execution of the application's preferred embodiment.

Step 301, user sends Ctrl+C signal to Cbenchmark host process;

When Performance Test System performs, if user wants to perform certain operation, can by sending Ctrl+C signal to host process.

Step 302, host process returns exercisable menu to user;

After host process receives this semaphore, return to user's exercisable menu, the operation that user can input comprises: 0: force to release performance test; 1: stop performing but statistical test data; 2: suspend all Virtual User; 3: recover all Virtual User; 4: suspend nominative testing process; 5: recover nominative testing process.

Step 303, requires user's input operation ID;

User, according to the demand of oneself, determines the operation that will perform, and input operates ID accordingly.

Step 304, user selects the option that will operate, and sends to host process;

The operand that user selects the option that will operate corresponding, host process, by determination operation number n, determines the corresponding option that will operate.

Step 305, selects operand n, childsigopt element in bench structure in shared drive is set to n;

Namely host process is when receiving option operations, can represent the value of this operation requests, and assignment to the performance variable of host process structure being arranged in shared drive, then sends signal to each subprocess performing test.

Step 306, judges the value of operand n;

If n is 0 to 3 arbitrary numerical value, select step 307; If n is 4 or 5 arbitrary numerical value, select step 308.

Step 307, the subprocess chained list in traversal shared drive, obtains subprocess pid, sends SIGUSRI signal to each pid;

Step 308, the switcher of the subprocess structure in traversal shared drive, obtain its current state, and it is for you to choose that the pid being in certain state course is returned to user;

Host process is determined certain several process pid and is exported.

Step 309, user selects the appointment process operated for suspend or recovery etc.;

Step 310, the process pid of user's input selection, host process judges that whether the pid inputted is the subprocess pid of this process;

If so, step 311 is performed, if not, return step 308, re-enter;

Step 311, obtains the structure bench_child of this subprocess in shared drive by the pid of input;

Step 312, judges whether the switcher elementary state of this subprocess structure bench_child can operate;

If so, step 313 is performed, if not, return step 308, re-enter;

Step 313, sends SIGUSRI signal by pid to this subprocess.

With reference to Fig. 4, it is the process flow diagram of the method sub-process of a kind of selective recovery test execution described in the application's preferred embodiment.

The execution step of each subprocess is as follows:

Step 401, is received SIGUSRI signal, is found the subprocess bench_child structure and host process structure bench that belong to this process by mbp pointer in shared drive;

Step 402, judges the value of host process structure childsigopt element;

Step 403, judges whether bench structure childsigopt element equals 0, i.e. whether compulsory withdrawal;

If 0, perform exit () and exit this subprocess, if not 0, perform step 404;

Step 404, judges whether bench structure childsigopt element equals 1, namely whether stops performing this process;

If 0, perform step 405, if not 0, perform step 406;

Step 405 is BREAK to the siwtcher element assignment of the bench_child structure of this subprocess;

The all sub-thread of this subprocess exits loop body at upper once circulation time, then performs and exits operation, after this subprocess waits until that every sub-thread all exits, then the performance test data work of this process of execution analysis, to generate performance test report.

Whether step 406, judges whether bench structure childsigopt element equals 2 or 4, namely suspend and perform this process;

If 2 or 4, perform step 407, if not 2 or 4, perform step 408;

Step 407 is SUSPEND to the siwtcher element assignment of the bench_child structure of this subprocess;

The all sub-thread of this subprocess, can not perform pressure test function at upper once circulation time, and directly enters and circulate next time again.

Whether step 408, judge that bench structure childsigopt element equals 3 or 5, namely recover to perform this process;

If 3 or 5, perform step 409, if not 3 or 5, make mistakes, terminate.

Step 409 is CONTINUE to the siwtcher element assignment of the bench_child structure of this subprocess.

The all sub-thread of this subprocess can continue to perform pressure test function at upper once circulation time.

With reference to Fig. 5, it is the process flow diagram of the sub-thread of method sub-process of a kind of selective recovery test execution of the application's preferred embodiment.

Described flow process comprises two parts, is the flow process of subprocess execution and the flow process of sub-thread execution respectively, introduces respectively below.

First, each subprocess performs following steps:

Step 501, subprocess inherits the signal transacting mechanism of host process, and obtains the pointer variable mbp of shared drive;

Step 502, in shared drive, found the subprocess bench_child structure belonging to this process by mbp pointer, carry out initialization, switcher element assignment is CONTINUE, represents in running;

Step 503, generates the thread of specified quantity;

Each thread is exactly a concurrent Virtual User.

Step 504, waits for that all sub-thread execution that this process generates is complete;

Step 505, judges whether that all threads of this process exit all;

Can judge according to step 516, if so, perform step 506, if not, return and perform step 504.

Step 506, collection, statistical test data, generate test report;

Step 507, performs exit () and exits this subroutine.

In above-mentioned steps 502, generate thread by function d_create (), then can enter step 508.

Every sub-thread execution following steps of each subprocess:

Step 508, multiple thread parallels of multiple process perform and generate concurrent pressure;

This thread is by execution loop structure, and what be performed in structure is the business function of pressure test;

Step 509, judges whether the siwtcher element of the bench_child structure of this subprocess is CONTINUE;

If so, perform step 510, if not, perform step 512.

Step 510, judges whether to perform predetermined number of times;

If so, perform step 516, if not, perform step 511.

Step 511, performs the service logic function of pressure test;

CONTINUE represents to be needed to perform pressure, so perform the service logic function of pressure test, returns step 509;

Step 512, judges whether the switcher element of the bench_child structure of this subprocess is SUSPEND;

If so, perform step 513, if not, perform step 514;

Step 513, does not perform the service logic function of pressure test, after the dormancy some time, then circulates next time;

SUSPEND represents the generation needing to suspend this pressure, so do not perform the service logic function of pressure test, after the dormancy some time, then circulates next time.

Step 514, judges whether the switcher element of the bench_child structure of this subprocess is BREAK;

If so, step 515 is performed; If not, make mistakes, terminate.

Step 515, directly performs break and jumps out circulation;

BREAK represents the generation needing to stop this pressure, so directly perform break here to jump out circulation.

Step 516, exits this thread;

After exiting this thread, step 505 can be entered.

As known from the above, in performance test, user can change state of a process according to demand, host process is according to the selection of user, change the performance variable value in host process structure, subprocess judges the performance variable value in host process structure, performs and operates accordingly.

In actual applications, said method can be realized by C language, can reach good effect.And described method does not rely on specific operating system or hardware, also can cross-platformly perform.

Above-described embodiment is described for pressure test, but also can be applied in other performance test in embody rule, and it is similar to the aforementioned embodiment that it implements principle, therefore repeat no more.

It should be noted that, for aforesaid each embodiment of the method, in order to simple description, therefore it is all expressed as a series of combination of actions, but those skilled in the art should know, the application is not by the restriction of described sequence of movement, because according to the application, some step can adopt other orders or carry out simultaneously.Secondly, those skilled in the art also should know, the embodiment described in instructions all belongs to preferred embodiment, and involved action might not be that the application is necessary.

Based on the explanation of said method embodiment, present invention also provides the corresponding device embodiment controlling the scheduled for executing of test, realize the content described in said method embodiment.

With reference to the structure drawing of device that Fig. 6 is a kind of selective recovery test execution described in the embodiment of the present application.

Described device can comprise user interaction unit 61, host process scheduling unit 62, subprocess scheduling unit 63.Wherein,

User interaction unit 61, receives operation requests for host process;

Host process scheduling unit 62, is set to the performance variable value in host process structure in shared drive the value representing this operation requests for host process, sends notification signal to subprocess;

Subprocess scheduling unit 63, after receiving described notification signal, by judging the performance variable value in described shared drive in host process structure, performing and operating accordingly for subprocess.

Except above formant is arranged, according to different operation requests, this device can also comprise:

When operation requests is the request of compulsory withdrawal test execution, described subprocess scheduling unit 63 can comprise further:

Compulsory withdrawal subelement 631, exits process operation for subprocess.

When operation requests is the request stopping, suspending or recover subprocess execution:

Performance variable value in this subprocess structure in shared drive is set to the value representing described operation requests for subprocess by described subprocess scheduling unit 63.

Further, described device also comprises:

Sub-thread scheduling unit 64, every sub-thread loops for subprocess performs test code; Sub-thread, before each circulation performs, by judging the performance variable value in shared drive in affiliated subprocess structure, performing and operating accordingly.

When operation requests is the request stopping all subprocesss to perform:

Described subprocess scheduling unit 63 comprises:

Process stops subelement 632, performs following corresponding operating for each subprocess: the performance variable value in this subprocess structure in shared drive is set to represent the value stopping performing by subprocess;

Report generation subelement 633, after waiting until that every sub-thread of this subprocess all exits cycling, analyzes the test data of this subprocess and generates test report for subprocess.

Described sub-thread scheduling unit 64 comprises:

Thread stops subelement 641, for the corresponding operating that every sub-thread execution of each subprocess is following: sub-thread execution is to circulation time next time, performance variable value in subprocess structure belonging to judging in shared drive is set to represent the value stopping performing, then exit cycling;

When operation requests is the request suspending the execution of all subprocesss:

Described subprocess scheduling unit 63 comprises:

Process suspension subelement 634, performs following corresponding operating for each subprocess: the performance variable value in this subprocess structure in shared drive is set to represent the value suspended and perform by subprocess;

Described sub-thread scheduling unit 64 comprises:

Thread suspends subelement 642, for the corresponding operating that every sub-thread execution of each subprocess is following: sub-thread execution is to circulation time next time, performance variable value in subprocess structure belonging to judging in shared drive is set to represent the value suspended and perform, then stop performing this cycling, and jump into and circulate next time.

When operation requests is the request recovering the execution of all subprocesss:

Described subprocess scheduling unit 63 comprises:

Process resumption subelement 635, performs following corresponding operating for each subprocess: the performance variable value in this subprocess structure in shared drive is set to represent the value continuing to perform by subprocess;

Described sub-thread scheduling unit 64 comprises:

Thread recovers subelement 643, for the corresponding operating that every sub-thread execution of each subprocess is following: sub-thread execution is to circulation time next time, performance variable value in subprocess structure belonging to judging in shared drive is set to represent the value continuing to perform, then continue to perform cycling.

When operation requests is the request of selectivity time-out parton process execution:

According to the performance variable value in subprocess structure, described user interaction unit 61 also for each subprocess structure in host process traversal shared drive, judges whether subprocess performs, and return the subprocess mark performed;

Described host process scheduling unit 62 receives the subprocess mark selecting to suspend for host process, performance variable value in host process structure in shared drive be set to represent the value that selectivity suspends the execution of parton process, the subprocess that right backward selection suspends sends notification signal;

Described subprocess scheduling unit 63 comprises:

Process selection suspends subelement 636, performs following corresponding operating: the performance variable value in this subprocess structure in shared drive is set to represent the value suspended and perform by subprocess for the described subprocess suspended of selecting;

Described sub-thread scheduling unit 64 comprises:

Thread-selective suspends subelement 644, the corresponding operating that every sub-thread execution of the subprocess suspended is following is selected: sub-thread execution is to circulation time next time for described user, performance variable value in subprocess structure belonging to judging in shared drive is set to represent the value suspended and perform, then stop performing this cycling, and jump into and circulate next time.

When operation requests is the request of selective recovery parton process execution:

According to the performance variable value in subprocess structure, described user interaction unit 61, for each subprocess structure in host process traversal shared drive, judges whether subprocess suspends execution, and return the subprocess mark suspended and perform;

Described host process scheduling unit 62 receives the subprocess mark selecting to recover for host process, performance variable value in host process structure in shared drive is set to the value representing the execution of selective recovery parton process, the subprocess that right backward selection recovers sends notification signal;

Described subprocess scheduling unit 63 comprises:

Process selection recovers subelement 637, performs following corresponding operating: the performance variable value in this subprocess structure in shared drive is set to represent the value continuing to perform by subprocess for the described subprocess recovered of selecting;

Described sub-thread scheduling unit 64 comprises:

Thread-selective recovers subelement 645, the corresponding operating that every sub-thread execution of the subprocess recovered is following is selected: sub-thread execution is to circulation time next time for described, performance variable value in subprocess structure belonging to judging in shared drive is set to represent the value continuing to perform, then continue to perform cycling.

Preferably, described user interaction unit 61 receives the scheduling control signal sent, returns actions menu, be received in the option of operation selected in described actions menu before also receiving operation requests for host process, wherein the corresponding operation requests of each option of operation.

The dispatching device of above-mentioned control test can be used in the concurrent test of multi-process multithreading, can the operation requests of user of basis, and by the performance variable value in host process structure, the execution of dynamic change process, controls the executing state of each group process.

And user is when to host process transmit operation request in this device, no matter which kind of operation requests, all send same signal, thus can save spendable semaphore, and not be limited to the semaphore quantity of operating system, be adapted at applying in various real system.

With reference to Fig. 7, show the assembling structure figure of the another kind of selective recovery test execution of the embodiment of the present application, device described in this device can comprise host process 710, subprocess 720, sub-thread 730; Wherein,

Described host process 710 can comprise as lower module:

Operation requests receiver module 711, for receiving operation requests;

First master scheduling module 712, for in operation requests be selective recovery parton process perform request time, performance variable value in host process structure in shared drive is set to the value representing the execution of selective recovery parton process, sends notification signal to the subprocess selecting to recover;

Select the subprocess 720 recovered can comprise as lower module:

Selective recovery module 721, for being set to represent according to the performance variable value representing the execution of selective recovery parton process the value continuing to perform by the performance variable value in this subprocess structure in shared drive;

Select the sub-thread 730 of the subprocess 720 recovered can comprise as lower module:

Selective recovery test module 731, before performing test in circulation, continues according to representative in subprocess structure affiliated in shared drive the performance variable value performed, performs current test operation.

In a kind of preferred exemplary of the embodiment of the present application, described first master scheduling module 712 can comprise following submodule:

First notification signal sends submodule, sends notification signal for the subprocess corresponding to the described subprocess mark selecting to recover.

In a preferred embodiment of the present application, host process 710 can also comprise as lower module:

Second master scheduling module 713, for when operation requests is the request of compulsory withdrawal test execution, is set to the value representing compulsory withdrawal test, sends notification signal to subprocess by the performance variable value in host process structure in shared drive;

Subprocess 720 can also comprise as lower module:

Compulsory withdrawal module 722, for according to the performance variable value representing compulsory withdrawal test in subprocess structure affiliated in shared drive, exits process operation.

3rd master scheduling module 714, during for being the request stopping all subprocesss to perform in operation requests, being set to the performance variable value in host process structure in shared drive represent the value stopping all subprocesss to perform, sending notification signal to subprocess;

Subprocess 720 can also comprise as lower module:

Stopping modular 723, is set to represent for the performance variable value stopping all subprocesss to perform according to representative the value stopping performing by the performance variable value in this subprocess structure in shared drive;

Test report generation module 724, for according to Test data generation test report.

The sub-thread 730 of subprocess 720 can also comprise as lower module:

Stop test module 732, before performing test in circulation, in subprocess structure belonging in foundation shared drive, representative stops the performance variable value of execution, exits loop test operation.

4th master scheduling module 715, during for being the request suspending the execution of all subprocesss in operation requests, being set to the performance variable value in host process structure in shared drive represent the value suspended all subprocesss and perform, sending notification signal to subprocess;

Subprocess 720 can also comprise as lower module:

Suspend module 725, the performance variable value in this subprocess structure in shared drive is set to represent the value suspended and perform by the performance variable value performed for suspending all subprocesss according to representative;

The sub-thread 730 of subprocess 720 can also comprise as lower module:

Suspend test module 733, before performing test in circulation, according to representative in subprocess structure belonging in shared drive suspend perform performance variable value, stop performing current test operation, to jump into test operation next time.

5th master scheduling module 716, during for being the request recovering the execution of all subprocesss in operation requests, being set to the performance variable value in host process structure in shared drive represent the value recovered all subprocesss and perform, sending notification signal to subprocess;

Subprocess 720 can also comprise as lower module:

Recover module 726, the performance variable value in this subprocess structure in shared drive is set to represent the value continuing to perform by the performance variable value performed for recovering all subprocesss according to representative;

The sub-thread 730 of subprocess 720 can also comprise as lower module:

Continue test module 734, before performing test in circulation, according to representative in subprocess structure belonging in shared drive continue to perform performance variable value, continue to perform test operation.

6th master scheduling module 717, for when when operation requests being the request of selectivity time-out parton process execution, performance variable value in host process structure in shared drive is set to represent the value that selectivity suspends the execution of parton process, sends notification signal to the subprocess selecting to suspend;

Select the subprocess 720 suspended can also comprise as lower module:

Selectivity suspends module 727, for the performance variable value in this subprocess structure in shared drive being set to represent the value suspended and perform according to the performance variable value representing the execution of selectivity time-out parton process;

Select the sub-thread 730 of the subprocess 720 suspended can also comprise as lower module:

Selectivity suspends test module 735, and before circulation performs test, in subprocess structure belonging in foundation shared drive, representative suspends the performance variable value of execution, stops performing current test operation, to jump into test operation next time.

In a kind of preferred exemplary of the embodiment of the present application, described 6th master scheduling module 717 can comprise following submodule:

Actions menu returns module 718, for receiving scheduling control signal, returns actions menu;

Option of operation receiver module 719, for receiving the option of operation selected in described actions menu, the corresponding operation requests of each option of operation in described actions menu.

For the device embodiment that above-mentioned selectivity test performs, due to itself and embodiment of the method basic simlarity, so description is fairly simple, relevant part illustrates see the part of embodiment of the method shown in Fig. 1 to Fig. 5.

Each embodiment in this instructions all adopts the mode of going forward one by one to describe, and what each embodiment stressed is the difference with other embodiments, between each embodiment identical similar part mutually see.

Those skilled in the art should understand, the embodiment of the embodiment of the present application can be provided as method, device or computer program.Therefore, the embodiment of the present application can adopt the form of complete hardware embodiment, completely software implementation or the embodiment in conjunction with software and hardware aspect.And the embodiment of the present application can adopt in one or more form wherein including the upper computer program implemented of computer-usable storage medium (including but not limited to magnetic disk memory, CD-ROM, optical memory etc.) of computer usable program code.

In one typically configuration, described computer equipment comprises one or more processor (CPU), input/output interface, network interface and internal memory.Internal memory may comprise the volatile memory in computer-readable medium, and the forms such as random access memory (RAM) and/or Nonvolatile memory, as ROM (read-only memory) (ROM) or flash memory (flash RAM).Internal memory is the example of computer-readable medium.Computer-readable medium comprises permanent and impermanency, removable and non-removable media can be stored to realize information by any method or technology.Information can be computer-readable instruction, data structure, the module of program or other data.The example of the storage medium of computing machine comprises, but be not limited to phase transition internal memory (PRAM), static RAM (SRAM), dynamic RAM (DRAM), the random access memory (RAM) of other types, ROM (read-only memory) (ROM), Electrically Erasable Read Only Memory (EEPROM), fast flash memory bank or other memory techniques, read-only optical disc ROM (read-only memory) (CD-ROM), digital versatile disc (DVD) or other optical memory, magnetic magnetic tape cassette, tape magnetic rigid disk stores or other magnetic storage apparatus or any other non-transmitting medium, can be used for storing the information can accessed by computing equipment.According to defining herein, computer-readable medium does not comprise the computer readable media (transitory media) of non-standing, as data-signal and the carrier wave of modulation.

The embodiment of the present application describes with reference to according to the process flow diagram of the method for the embodiment of the present application, terminal device (system) and computer program and/or block scheme.Should understand can by the combination of the flow process in each flow process in computer program instructions realization flow figure and/or block scheme and/or square frame and process flow diagram and/or block scheme and/or square frame.These computer program instructions can being provided to the processor of multi-purpose computer, special purpose computer, Embedded Processor or other programmable data processing terminal equipment to produce a machine, making the instruction performed by the processor of computing machine or other programmable data processing terminal equipment produce device for realizing the function of specifying in process flow diagram flow process or multiple flow process and/or block scheme square frame or multiple square frame.

These computer program instructions also can be stored in can in the computer-readable memory that works in a specific way of vectoring computer or other programmable data processing terminal equipment, the instruction making to be stored in this computer-readable memory produces the manufacture comprising command device, and this command device realizes the function of specifying in process flow diagram flow process or multiple flow process and/or block scheme square frame or multiple square frame.

These computer program instructions also can be loaded on computing machine or other programmable data processing terminal equipment, make to perform sequence of operations step to produce computer implemented process on computing machine or other programmable terminal equipment, thus the instruction performed on computing machine or other programmable terminal equipment is provided for the step realizing the function of specifying in process flow diagram flow process or multiple flow process and/or block scheme square frame or multiple square frame.

Although described the preferred embodiment of the embodiment of the present application, those skilled in the art once obtain the basic creative concept of cicada, then can make other change and amendment to these embodiments.So claims are intended to be interpreted as comprising preferred embodiment and falling into all changes and the amendment of the embodiment of the present application scope.

Finally, also it should be noted that, in this article, the such as relational terms of first and second grades and so on is only used for an entity or operation to separate with another entity or operational zone, and not necessarily requires or imply the relation that there is any this reality between these entities or operation or sequentially.And, term " comprises ", " comprising " or its any other variant are intended to contain comprising of nonexcludability, thus make to comprise the process of a series of key element, method, article or terminal device and not only comprise those key elements, but also comprise other key elements clearly do not listed, or also comprise by the intrinsic key element of this process, method, article or terminal device.When not more restrictions, the key element limited by statement " comprising ... ", and be not precluded within process, method, article or the terminal device comprising described key element and also there is other identical element.

Above to method and the device of a kind of selective recovery test execution that the application provides, be described in detail, apply specific case in literary composition to set forth the principle of the application and embodiment, the explanation of above embodiment is just for helping method and the core concept thereof of understanding the application; Meanwhile, for one of ordinary skill in the art, according to the thought of the application, all will change in specific embodiments and applications, in sum, this description should not be construed as the restriction to the application.

Claims

1. a method for selective recovery test execution, is characterized in that, comprising:

Host process receives operation requests;

2. method according to claim 1, is characterized in that, the step that the described subprocess to selecting to recover sends notification signal comprises:

3. method according to claim 1, is characterized in that, also comprises:

4. method according to claim 1, is characterized in that, also comprises:

Subprocess is according to Test data generation test report.

5. method according to claim 1, is characterized in that, also comprises:

6. method according to claim 1, is characterized in that, also comprises:

7. method according to claim 1, is characterized in that, also comprises:

8. method according to claim 7, is characterized in that, the step that the described subprocess to selecting to suspend sends notification signal comprises:

9. the method according to any one of claim 1-8, is characterized in that, before described host process receives operation requests, described method also comprises:

Host process receiving scheduling control signal, returns actions menu;

10. a device for selective recovery test execution, is characterized in that, described device comprises host process, subprocess, sub-thread; Wherein,

Described host process comprises:

Operation requests receiver module, for receiving operation requests;

The subprocess recovered is selected to comprise:

The sub-thread of the subprocess recovered is selected to comprise:

11. devices according to claim 10, is characterized in that, described first master scheduling module comprises: