CN102937932A - Automated testing device and method of integrated heterogeneous testing tool - Google Patents
Automated testing device and method of integrated heterogeneous testing tool Download PDFInfo
- Publication number
- CN102937932A CN102937932A CN2011102347925A CN201110234792A CN102937932A CN 102937932 A CN102937932 A CN 102937932A CN 2011102347925 A CN2011102347925 A CN 2011102347925A CN 201110234792 A CN201110234792 A CN 201110234792A CN 102937932 A CN102937932 A CN 102937932A
- Authority
- CN
- China
- Prior art keywords
- test
- testing tool
- testing
- result
- configuration
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Landscapes
- Debugging And Monitoring (AREA)
Abstract
The invention provides an automated testing device and a method of an integrated heterogeneous testing tool. The automated testing device comprises a test case configuration module, a test control module and a testing tool adaptive connector, wherein the test case configuration module is used for configuring a test task according to user input; the test control module is used for controlling the execution of the test task and generating a final test result of the corresponding test task; and the testing tool adaptive connector is used for executing the test task based on a scheduling instruction and sending an execution result to the test control module. According to the automated testing device and the method, the heterogeneous testing tool can be integrated, the automated testing of a complex system can be achieved, and the overall performance of the test device can be improved and expanded obviously.
Description
Technical field
The present invention relates to automatic test device and method, more specifically, relate to automatic test device and the method for integrated isomery testing tool.
Background technology
At present, become increasingly abundant (for example financial transaction field) along with the class of business of the growing and different field of computer technology, the demand of complication system being carried out automatic test is growing, and therefore, automatic test device and method become more and more important.
Usually, existing automatic test device and method substantially can be divided into following classification: from the angle of Technical Architecture mainly be divided into commercial testing tool, the lightweight test script of increase income test frame and tester's establishment; Mainly be divided into functional test instrument, performance testing tool and security test instrument etc. from the angle of function; Mainly be divided into based on Windows operating system, based on Unix/Linux operating system etc. from the operation platform angle; From the system under test (SUT) angle such as being divided into Web testing tool, message testing tool etc.
Yet there are the following problems for above-mentioned existing automatic test device and method: only can test for the specific function of specific system under test (SUT), namely can not finish test cross-platform, that stride framework; For the application system of complexity, only can finish test in a certain respect; Because testing tool is of a great variety, use and complicated operation so be difficult to merge.
Therefore, there is following demand: automatic test device and method that a kind of integrated isomery testing tool is provided.
Summary of the invention
In order to solve existing problem in the above-mentioned prior art scheme, the present invention proposes a kind of automatic test device and method of integrated isomery testing tool.
The objective of the invention is to be achieved through the following technical solutions:
A kind of automatic test device, wherein, described automatic test device comprises:
Test case configuration module, described test case configuration module are used for according to user's input and the configuration testing task;
Testing control module, described testing control module is used for sending to the testing tool adaptable interface based on described test assignment structure dispatch command and with described dispatch command, controlling the execution of described test assignment, and generate final testing result corresponding to described test assignment;
Testing tool adaptable interface, described testing tool adaptable interface are used for carrying out described test assignment based on described dispatch command, and execution result is sent back described testing control module.
In the disclosed scheme, preferably, described configuration testing task comprises at least one test subtask of configuration in the above.
In the disclosed scheme, alternatively, at least one test subtask of described configuration is included at least one testing tool interface model corresponding to described at least one test subtask of configuration in the described automatic test device in the above.
In the above in the disclosed scheme, alternatively, at least one test subtask of described configuration is included at least one testing tool interface model corresponding to described at least one test subtask of configuration on the test assignment configuration server, and the testing tool interface model identification number that configuration is associated with described at least one testing tool interface model in described automatic test device.
In the disclosed scheme, preferably, described testing tool interface model comprises testing tool name field, test case name field, test case description field, test case parameter field and expected result field in the above.
In the above in the disclosed scheme, preferably, wherein dispose at least one testing tool interface model corresponding to described at least one test subtask and comprise according to described user and input each field in the described testing tool interface model of filling.
In the disclosed scheme, preferably, described dispatch command comprises the configuration information of described test assignment in the above.
In the disclosed scheme, preferably, described execution result comprises any one test result information in described at least one test subtask in the above.
In the disclosed scheme, preferably, described testing control module further comprises in the above:
Scheduling unit, described scheduling unit are used for constructing described dispatch command and described dispatch command being sent to described testing tool adaptable interface, thereby with execution parallel or described at least one test subtask of serial mode scheduling;
Test result generation unit, described test result generation unit are used for the described test result information based on each of described at least one test subtask of described execution result record, and generate the final testing result corresponding to described test assignment.
In the disclosed scheme, preferably, described testing tool adaptable interface 3 further comprises in the above:
Testing tool registering unit, described testing tool registering unit are used at least one testing tool of registration, and generate registered testing tool tabulation;
Initialization unit, described initialization unit is used for determining corresponding at least one testing tool of described at least one test subtask and judging whether described at least one testing tool is registered based on the configuration information of described test assignment, if and in described at least one testing tool each is all registered, then according to the call instruction of pre-defined rule generation corresponding to described at least one testing tool, and described call instruction is sent to the test execution unit, if and in described at least one testing tool at least one be not registered, then return the information of indication configuration error to described scheduling unit;
The test execution unit, described test execution unit is used for calling described at least one testing tool according to described call instruction, to carry out described at least one test subtask, and monitor and obtain the test result information of described at least one testing tool output, and described test result information is sent to the collection unit;
The collection unit, compare described test result information in described collection unit with expected result, and based on the comparison result and/or test crash information structuring execution result, and described execution result is sent to described testing control module.
In the above in the disclosed scheme, preferably, described pre-defined rule is based on one or more among Telnet agreement, bat temporary file and the Windows API.
In the above in the disclosed scheme, preferably, described call instruction comprises one or more in Shell order, cmd order and the Windows api function.
In the above in the disclosed scheme, preferably, the result data of described at least one testing tool output is monitored and obtained to described test execution unit at least one mode in the following way: read output data in the Telnet agreement return command, read the cmd order return data, read the output data of invoked Windows api function.
In the above in the disclosed scheme, preferably, described test execution unit further comprises each at least one timer that corresponds respectively in described at least one testing tool, if and in described at least one timer any is overtime, then described test execution unit sends test crash information to described collection unit, and the overtime corresponding testing tool of timer of described test crash information indication fails and carries out its corresponding test subtask.
In the disclosed scheme, preferably, described automatic test device uses at least two testing tools, and described at least two testing tools are isomeries in the above.
Purpose of the present invention also is achieved through the following technical solutions:
A kind of automated testing method, wherein, described automated testing method comprises the steps:
(A1) input and the configuration testing task according to the user;
(A2) send to the testing tool adaptable interface based on described test assignment structure dispatch command and with described dispatch command, to control the execution of described test assignment;
(A3) described testing tool adaptable interface is carried out described test assignment based on described dispatch command, and the output execution result;
(A4) according to the final testing result of described execution result generation corresponding to described test assignment.
In the disclosed scheme, preferably, described configuration testing task comprises at least one test subtask of configuration in the above.
In the disclosed scheme, preferably, at least one test subtask of described configuration comprises at least one testing tool interface model corresponding to described at least one test subtask of configuration in the above.
In the disclosed scheme, preferably, described testing tool interface model comprises testing tool name field, test case name field, test case description field, test case parameter field and expected result field in the above.
In the above in the disclosed scheme, preferably, dispose at least one testing tool interface model corresponding to described at least one test subtask and comprise according to described user and input each field in the described testing tool interface model of filling.
In the disclosed scheme, preferably, described dispatch command comprises the configuration information of described test assignment in the above.
In the disclosed scheme, preferably, described execution result comprises any one test result information in described at least one test subtask in the above.
In the above in the disclosed scheme, preferably, described step (A2) further comprises: constructs described dispatch command and described dispatch command sent to described testing tool adaptable interface, thereby with execution parallel or described at least one test subtask of serial mode scheduling
In the above in the disclosed scheme, preferably, described step (A4) further comprises: based on each the described test result information in described at least one test subtask of described execution result record, and generate final testing result corresponding to described test assignment.
In the disclosed scheme, preferably, described step (A3) further comprises in the above:
(B1) register at least one testing tool, and generate registered testing tool tabulation;
(B2) determine corresponding at least one testing tool of described at least one test subtask and judge whether described at least one testing tool is registered based on the configuration information of described test assignment, if and in described at least one testing tool each is all registered, then according to the call instruction of pre-defined rule generation corresponding to described at least one testing tool, if and in described at least one testing tool at least one be not registered, then return the information of indication configuration error;
(B3) call described at least one testing tool according to described call instruction, carrying out described at least one test subtask, and monitoring and obtain the test result information of described at least one testing tool output;
(B4) described test result information is compared with expected result, and based on the comparison result and/or test crash information structuring execution result.
In the above in the disclosed scheme, preferably, described pre-defined rule is based on one or more among Telnet agreement, bat temporary file and the Windows API.
In the above in the disclosed scheme, preferably, described call instruction comprises one or more in Shell order, cmd order and the Windows api function.
In the above in the disclosed scheme, preferably, wherein the result data of described at least one testing tool output is monitored and obtained at least one mode in the following way: read output data in the Telnet agreement return command, read the cmd order return data, read the output data of invoked Windows api function.
In the above in the disclosed scheme, preferably, described step (B3) further comprises: enable each at least one timer that corresponds respectively in described at least one testing tool, if and in described at least one timer any is overtime, then export described test crash information, the overtime corresponding testing tool of timer of described test crash information indication fails and carries out its corresponding test subtask.
In the disclosed scheme, preferably, in described step (A3), use at least two testing tools, and described at least two testing tools are isomeries in the above.
The automatic test device of integrated isomery testing tool disclosed in this invention and method have following advantage: (1) can realize the automatic test of complication system; (2) since testing tool that can integrated isomery finish the test assignment that single testing tool is difficult to finish so can make up the advantage of various testing tools, thereby significantly improve and expanded the overall performance of proving installation.
Description of drawings
By reference to the accompanying drawings, technical characterictic of the present invention and advantage will be understood better by those skilled in the art, wherein:
Fig. 1 is the schematic diagram of the automatic test device of integrated according to an embodiment of the invention isomery testing tool;
Fig. 2 is the process flow diagram of the automated testing method of integrated according to an embodiment of the invention isomery testing tool.
Embodiment
Fig. 1 is the schematic diagram of the automatic test device of integrated according to an embodiment of the invention isomery testing tool.As shown in Figure 1, the automatic test device of integrated isomery testing tool disclosed in this invention comprises test case configuration module 1, testing control module 2 and testing tool adaptable interface 3.Wherein, described test case configuration module 1 is used for according to user's input and the configuration testing task.Described testing control module 2 is used for sending to described testing tool adaptable interface 3 based on described test assignment structure dispatch command and with described dispatch command, controlling the execution of described test assignment, and generates the final testing result corresponding to described test assignment.Described testing tool adaptable interface 3 is used for carrying out described test assignment based on described dispatch command, and execution result is sent back described testing control module 2.
Preferably, in automatic test device disclosed in this invention, described configuration testing task comprises at least one test subtask of configuration.
Alternatively, in automatic test device disclosed in this invention, at least one test subtask of described configuration is included at least one testing tool interface model corresponding to described at least one test subtask of configuration in the described automatic test device.
Alternatively, in automatic test device disclosed in this invention, at least one test subtask of described configuration is included at least one testing tool interface model corresponding to described at least one test subtask of configuration on the test assignment configuration server, and the testing tool interface model identification number that configuration is associated with described at least one testing tool interface model in described automatic test device.
Exemplarily, table 1 shows the field structure of described testing tool interface model.As shown in table 1, preferably, in automatic test device disclosed in this invention, described testing tool interface model comprises testing tool name field, test case name field, test case description field, test case parameter field and expected result field etc.
Table 1
Exemplarily, in automatic test device disclosed in this invention, dispose at least one testing tool interface model corresponding to described at least one test subtask and comprise according to described user and input filling each field in the described testing tool interface model.
Preferably, in automatic test device disclosed in this invention, described dispatch command comprises the configuration information of described test assignment.
Preferably, in automatic test device disclosed in this invention, described execution result comprises any one test result information in described at least one test subtask.
As shown in Figure 1, in automatic test device disclosed in this invention, described testing control module 2 further comprises scheduling unit 4 and test result generation unit 5.Wherein, described scheduling unit 4 is used for constructing described dispatch command and described dispatch command being sent to described testing tool adaptable interface 3, thereby with execution parallel or described at least one test subtask of serial mode scheduling.Described test result generation unit 5 is used for the described test result information based on each of described at least one test subtask of described execution result record, and generates the final testing result corresponding to described test assignment.
Wherein, exemplarily, in automatic test device disclosed in this invention, described parallel mode is applicable to the functional availability of system in the testing high voltage power situation, and described serial mode is applicable to the binding operation flow of test sequence.
As shown in Figure 1, in automatic test device disclosed in this invention, described testing tool adaptable interface 3 further comprises initialization unit 6, test execution unit 7, collection unit 8 and testing tool registering unit 9.Wherein, described testing tool registering unit 9 is used at least one testing tool of registration, and generates registered testing tool tabulation.Described initialization unit 6 is used for determining corresponding at least one testing tool of described at least one test subtask and judging whether described at least one testing tool is registered based on the configuration information of described test assignment, if and in described at least one testing tool each is all registered, then according to the call instruction of pre-defined rule generation corresponding to described at least one testing tool, and described call instruction is sent to described test execution unit 7, if and in described at least one testing tool at least one be not registered, then return the information of indication configuration error to described scheduling unit 4.Described test execution unit 7 is used for calling described at least one testing tool according to described call instruction, to carry out described at least one test subtask, and monitor and obtain the test result information of described at least one testing tool output, and described test result information is sent to described collection unit 8.Compare described test result information (for example with expected result in described collection unit 8, compare special keyword), and based on the comparison result and/or described test crash information structuring execution result, and described execution result is sent to described testing control module 2.
Exemplarily, in automatic test device disclosed in this invention, described pre-defined rule is based on one or more among Telnet agreement, bat temporary file and the Windows API.
Exemplarily, in automatic test device disclosed in this invention, described call instruction comprises one or more in Shell order, cmd order and the Windows api function.
Exemplarily, in automatic test device disclosed in this invention, the result data of described at least one testing tool output is monitored and obtained to described test execution unit 7 at least one mode in the following way: read output data in the Telnet agreement return command, read the cmd order return data, read the output data of invoked Windows api function.
Preferably, in automatic test device disclosed in this invention, described test execution unit 7 further comprises each at least one timer that corresponds respectively in described at least one testing tool, if and in described at least one timer any is overtime, then described test execution unit 78 sends the test crash information to described collection unit, and the overtime corresponding testing tool of timer of described test crash information indication fails and carries out its corresponding test subtask.
Exemplarily, in automatic test device disclosed in this invention, generate as follows the call instruction corresponding to described at least one testing tool: (1) is if the method for calling of utility command row platform (AIX/UNIX/LINUX etc.) form, then described testing tool adaptable interface 3 is used as the telnet protocol client, thereby connects and sign in to the remote object Test Host; (2) if use the method for calling of the cmd command forms of Windows, then generate executable bat interim order script; (3) if use the method for calling of Windows API form, then constructing variable is also by ShellExecute function call testing tool.
Preferably, in automatic test device disclosed in this invention, described automatic test device uses at least two testing tools, and described at least two testing tools are isomeries.
Exemplarily, in automatic test device disclosed in this invention, described at least one testing tool comprises one or more in following:
Automated test tool (is used for the function regression test, for example, system under test (SUT) is the Windows system), the Shell script (is used for functional test or test is auxiliary, for example, system under test (SUT) is the Unix system), the Python automated test tool (is used for the function regression test, for example, system under test (SUT) is the web system) and LoadRunner performance testing tool (being used for performance test).
As shown in Figure 1, the basic functional principle of automatic test device disclosed in this invention is as follows: described test case configuration module 1 is inputted and the configuration testing task according to the user; Described testing control module 2 structure dispatch commands also send to described testing tool adaptable interface 3 with described dispatch command, controlling the execution of described test assignment, and generate the final testing result corresponding to described test assignment; Described testing tool adaptable interface 3 is carried out described test assignment based on described dispatch command, and execution result is sent back described testing control module 2.
Fig. 2 is the process flow diagram of the automated testing method of integrated according to an embodiment of the invention isomery testing tool.As shown in Figure 2, automated testing method disclosed in this invention comprises the steps: (A1) according to user's input and the configuration testing task; (A2) send to the testing tool adaptable interface based on described test assignment structure dispatch command and with described dispatch command, to control the execution of described test assignment; (A3) described testing tool adaptable interface is carried out described test assignment based on described dispatch command, and the output execution result; (A4) according to the final testing result of described execution result generation corresponding to described test assignment.
Preferably, in automated testing method disclosed in this invention, described configuration testing task comprises at least one test subtask of configuration.
Alternatively, in automated testing method disclosed in this invention, at least one test subtask of described configuration comprises at least one testing tool interface model corresponding to described at least one test subtask of configuration.
Exemplarily, table 1 shows the field structure of described testing tool interface model.As shown in table 1, preferably, in automated testing method disclosed in this invention, described testing tool interface model comprises testing tool name field, test case name field, test case description field, test case parameter field and expected result field etc.
Exemplarily, in automated testing method disclosed in this invention, dispose at least one testing tool interface model corresponding to described at least one test subtask and comprise according to described user and input filling each field in the described testing tool interface model.
Preferably, in automated testing method disclosed in this invention, described dispatch command comprises the configuration information of described test assignment.
Preferably, in automated testing method disclosed in this invention, described execution result comprises any one test result information in described at least one test subtask.
As shown in Figure 2, in automated testing method disclosed in this invention, described step (A2) further comprises: constructs described dispatch command and described dispatch command sent to described testing tool adaptable interface, thereby with execution parallel or described at least one test subtask of serial mode scheduling
As shown in Figure 2, in automated testing method disclosed in this invention, described step (A4) further comprises: based on each the described test result information in described at least one test subtask of described execution result record, and generate final testing result corresponding to described test assignment.
Wherein, exemplarily, in automated testing method disclosed in this invention, described parallel mode is applicable to the functional availability of system in the testing high voltage power situation, and described serial mode is applicable to the binding operation flow of test sequence.
As shown in Figure 2, in automated testing method disclosed in this invention, described step (A3) further comprises: (B1) register at least one testing tool, and generate registered testing tool tabulation; (B2) determine corresponding at least one testing tool of described at least one test subtask and judge whether described at least one testing tool is registered based on the configuration information of described test assignment, if and in described at least one testing tool each is all registered, then according to the call instruction of pre-defined rule generation corresponding to described at least one testing tool, if and in described at least one testing tool at least one be not registered, then return the information of indication configuration error; (B3) call described at least one testing tool according to described call instruction, carrying out described at least one test subtask, and monitoring and obtain the test result information of described at least one testing tool output; (B4) described test result information is compared with expected result (for example, relatively special keyword), and based on the comparison result and/or test crash information structuring execution result.
Exemplarily, in automated testing method disclosed in this invention, described pre-defined rule is based on one or more among Telnet agreement, bat temporary file and the Windows API.
Exemplarily, in automated testing method disclosed in this invention, described call instruction comprises one or more in Shell order, cmd order and the Windows api function.
Exemplarily, in automated testing method disclosed in this invention, the result data of described at least one testing tool output is monitored and obtained at least one mode in the following way: read output data in the Telnet agreement return command, read the cmd order return data, read the output data of invoked Windows api function.
Preferably, in automated testing method disclosed in this invention, described step (B3) further comprises: enable each at least one timer that corresponds respectively in described at least one testing tool, if and in described at least one timer any is overtime, then export described test crash information, the overtime corresponding testing tool of timer of described test crash information indication fails and carries out its corresponding test subtask.
Exemplarily, in automated testing method disclosed in this invention, generate as follows the call instruction corresponding to described at least one testing tool: (1) is if the method for calling of utility command row platform (AIX/UNIX/LINUX etc.) form, then described testing tool adaptable interface 3 is used as the telnet protocol client, thereby connects and sign in to the remote object Test Host; (2) if use the method for calling of the cmd command forms of Windows, then generate executable bat interim order script; (3) if use the method for calling of Windows API form, then constructing variable is also by ShellExecute function call testing tool.
Preferably, in automated testing method disclosed in this invention, in described step (A3), use at least two testing tools, and described at least two testing tools are isomeries.
Exemplarily, in automated testing method disclosed in this invention, described at least one testing tool comprises one or more in following: HP QTP automated test tool (is used for the function regression test, for example, system under test (SUT) is the Windows system), the Shell script (is used for functional test or test is auxiliary, for example, system under test (SUT) is the Unix system), the Python automated test tool (is used for the function regression test, for example, system under test (SUT) is the web system) and LoadRunner performance testing tool (being used for performance test).
Although the present invention is described by above-mentioned preferred implementation, its way of realization is not limited to above-mentioned embodiment.Should be realized that: in the situation that does not break away from purport of the present invention and scope, those skilled in the art can make different variations and modification to the present invention.
Claims (30)
1. automatic test device, wherein, described automatic test device comprises:
Test case configuration module, described test case configuration module are used for according to user's input and the configuration testing task;
Testing control module, described testing control module is used for sending to the testing tool adaptable interface based on described test assignment structure dispatch command and with described dispatch command, controlling the execution of described test assignment, and generate final testing result corresponding to described test assignment;
Testing tool adaptable interface, described testing tool adaptable interface are used for carrying out described test assignment based on described dispatch command, and execution result is sent back described testing control module.
2. automatic test device according to claim 1 is characterized in that, described configuration testing task comprises at least one test subtask of configuration.
3. automatic test device according to claim 2 is characterized in that, at least one test subtask of described configuration is included at least one testing tool interface model corresponding to described at least one test subtask of configuration in the described automatic test device.
4. automatic test device according to claim 2, it is characterized in that, at least one test subtask of described configuration is included at least one testing tool interface model corresponding to described at least one test subtask of configuration on the test assignment configuration server, and the testing tool interface model identification number that configuration is associated with described at least one testing tool interface model in described automatic test device.
5. automatic test device according to claim 3 is characterized in that, described testing tool interface model comprises testing tool name field, test case name field, test case description field, test case parameter field and expected result field.
6. automatic test device according to claim 5, it is characterized in that, wherein dispose at least one testing tool interface model corresponding to described at least one test subtask and comprise according to described user and input filling each field in the described testing tool interface model.
7. automatic test device according to claim 6 is characterized in that, described dispatch command comprises the configuration information of described test assignment.
8. automatic test device according to claim 7 is characterized in that, described execution result comprises any one test result information in described at least one test subtask.
9. automatic test device according to claim 8 is characterized in that, described testing control module further comprises:
Scheduling unit, described scheduling unit are used for constructing described dispatch command and described dispatch command being sent to described testing tool adaptable interface, thereby with execution parallel or described at least one test subtask of serial mode scheduling;
Test result generation unit, described test result generation unit are used for the described test result information based on each of described at least one test subtask of described execution result record, and generate the final testing result corresponding to described test assignment.
10. automatic test device according to claim 9 is characterized in that, described testing tool adaptable interface 3 further comprises:
Testing tool registering unit, described testing tool registering unit are used at least one testing tool of registration, and generate registered testing tool tabulation;
Initialization unit, described initialization unit is used for determining corresponding at least one testing tool of described at least one test subtask and judging whether described at least one testing tool is registered based on the configuration information of described test assignment, if and in described at least one testing tool each is all registered, then according to the call instruction of pre-defined rule generation corresponding to described at least one testing tool, and described call instruction is sent to the test execution unit, if and in described at least one testing tool at least one be not registered, then return the information of indication configuration error to described scheduling unit;
The test execution unit, described test execution unit is used for calling described at least one testing tool according to described call instruction, to carry out described at least one test subtask, and monitor and obtain the test result information of described at least one testing tool output, and described test result information is sent to the collection unit;
The collection unit, compare described test result information in described collection unit with expected result, and based on the comparison result and/or test crash information structuring execution result, and described execution result is sent to described testing control module.
11. automatic test device according to claim 10 is characterized in that, described pre-defined rule is based on one or more among Telnet agreement, bat temporary file and the Windows API.
12. automatic test device according to claim 11 is characterized in that, described call instruction comprises one or more in Shell order, cmd order and the Windows api function.
13. automatic test device according to claim 12, it is characterized in that the result data of described at least one testing tool output is monitored and obtained to described test execution unit at least one mode in the following way: read output data in the Telnet agreement return command, read the cmd order return data, read the output data of invoked Windows api function.
14. automatic test device according to claim 13, it is characterized in that, described test execution unit further comprises each at least one timer that corresponds respectively in described at least one testing tool, if and in described at least one timer any is overtime, then described test execution unit sends test crash information to described collection unit, and the overtime corresponding testing tool of timer of described test crash information indication fails and carries out its corresponding test subtask.
15. automatic test device according to claim 14 is characterized in that, described automatic test device uses at least two testing tools, and described at least two testing tools are isomeries.
16. an automated testing method, wherein, described automated testing method comprises the steps:
(A1) input and the configuration testing task according to the user;
(A2) send to the testing tool adaptable interface based on described test assignment structure dispatch command and with described dispatch command, to control the execution of described test assignment;
(A3) described testing tool adaptable interface is carried out described test assignment based on described dispatch command, and the output execution result;
(A4) according to the final testing result of described execution result generation corresponding to described test assignment.
17. automated testing method according to claim 16 is characterized in that, described configuration testing task comprises at least one test subtask of configuration.
18. automated testing method according to claim 17 is characterized in that, at least one test subtask of described configuration comprises at least one testing tool interface model corresponding to described at least one test subtask of configuration.
19. automated testing method according to claim 18 is characterized in that, described testing tool interface model comprises testing tool name field, test case name field, test case description field, test case parameter field and expected result field.
20. automated testing method according to claim 19, it is characterized in that, dispose at least one testing tool interface model corresponding to described at least one test subtask and comprise according to described user and input filling each field in the described testing tool interface model.
21. automated testing method according to claim 20 is characterized in that, described dispatch command comprises the configuration information of described test assignment.
22. automated testing method according to claim 21 is characterized in that, described execution result comprises any one test result information in described at least one test subtask.
23. automated testing method according to claim 22, it is characterized in that, described step (A2) further comprises: constructs described dispatch command and described dispatch command sent to described testing tool adaptable interface, thereby with execution parallel or described at least one test subtask of serial mode scheduling
24. automated testing method according to claim 23, it is characterized in that, described step (A4) further comprises: based on each the described test result information in described at least one test subtask of described execution result record, and generate final testing result corresponding to described test assignment.
25. automated testing method according to claim 24 is characterized in that, described step (A3) further comprises:
(B1) register at least one testing tool, and generate registered testing tool tabulation;
(B2) determine corresponding at least one testing tool of described at least one test subtask and judge whether described at least one testing tool is registered based on the configuration information of described test assignment, if and in described at least one testing tool each is all registered, then according to the call instruction of pre-defined rule generation corresponding to described at least one testing tool, if and in described at least one testing tool at least one be not registered, then return the information of indication configuration error;
(B3) call described at least one testing tool according to described call instruction, carrying out described at least one test subtask, and monitoring and obtain the test result information of described at least one testing tool output;
(B4) described test result information is compared with expected result, and based on the comparison result and/or test crash information structuring execution result.
26. automated testing method according to claim 25 is characterized in that, described pre-defined rule is based on one or more among Telnet agreement, bat temporary file and the Windows API.
27. automated testing method according to claim 26 is characterized in that, described call instruction comprises one or more in Shell order, cmd order and the Windows api function.
28. automated testing method according to claim 27, it is characterized in that wherein the result data of described at least one testing tool output is monitored and obtained at least one mode in the following way: read output data in the Telnet agreement return command, read the cmd order return data, read the output data of invoked Windows api function.
29. automated testing method according to claim 28, it is characterized in that, described step (B3) further comprises: enable each at least one timer that corresponds respectively in described at least one testing tool, if and in described at least one timer any is overtime, then export described test crash information, the overtime corresponding testing tool of timer of described test crash information indication fails and carries out its corresponding test subtask.
30. automated testing method according to claim 29 is characterized in that, use at least two testing tools in described step (A3), and described at least two testing tools is isomeries.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201110234792.5A CN102937932B (en) | 2011-08-16 | 2011-08-16 | The automatic test device of integrated isomery testing tool and method |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201110234792.5A CN102937932B (en) | 2011-08-16 | 2011-08-16 | The automatic test device of integrated isomery testing tool and method |
Publications (2)
Publication Number | Publication Date |
---|---|
CN102937932A true CN102937932A (en) | 2013-02-20 |
CN102937932B CN102937932B (en) | 2015-08-19 |
Family
ID=47696831
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201110234792.5A Active CN102937932B (en) | 2011-08-16 | 2011-08-16 | The automatic test device of integrated isomery testing tool and method |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN102937932B (en) |
Cited By (20)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN103684919A (en) * | 2013-12-18 | 2014-03-26 | 南京理工大学连云港研究院 | Ubiquitous network performance monitoring system |
CN104317713A (en) * | 2014-10-27 | 2015-01-28 | 北京锐安科技有限公司 | Automatic testing tool and method on basis of templates |
CN104679658A (en) * | 2015-03-17 | 2015-06-03 | 百度在线网络技术(北京)有限公司 | Test method and test system for WEB pages |
CN104850491A (en) * | 2014-02-19 | 2015-08-19 | 深圳中兴网信科技有限公司 | Software test method, equipment and system |
CN104850495A (en) * | 2015-05-14 | 2015-08-19 | 曙光信息产业(北京)有限公司 | Automatic detection method and device |
CN105243015A (en) * | 2015-09-25 | 2016-01-13 | 惠州Tcl移动通信有限公司 | Automated software test method and system |
CN105374131A (en) * | 2015-10-28 | 2016-03-02 | 深圳怡化电脑股份有限公司 | Method and device for automatic testing |
CN105405220A (en) * | 2015-10-28 | 2016-03-16 | 深圳怡化电脑股份有限公司 | Method and device for automated test |
CN105405221A (en) * | 2015-10-28 | 2016-03-16 | 深圳怡化电脑股份有限公司 | Method and device for automated test |
CN105468519A (en) * | 2015-11-17 | 2016-04-06 | 中国建设银行股份有限公司 | Performance-testing tool control method and device |
CN105679375A (en) * | 2015-12-31 | 2016-06-15 | 浪潮(北京)电子信息产业有限公司 | Automatic test system of storage equipment, and method thereof |
CN105808437A (en) * | 2016-03-09 | 2016-07-27 | 广州彩瞳网络技术有限公司 | Automation testing method and system based on test case data table |
CN106775979A (en) * | 2016-12-13 | 2017-05-31 | 郑州云海信息技术有限公司 | Scheduler call method and system |
CN107729237A (en) * | 2017-10-09 | 2018-02-23 | 郑州云海信息技术有限公司 | A kind of method, apparatus of software performance test, computer installation and storage medium |
CN107967158A (en) * | 2016-10-14 | 2018-04-27 | 希捷科技有限公司 | Active drive api |
CN107992418A (en) * | 2017-12-05 | 2018-05-04 | 郑州云海信息技术有限公司 | A kind of method and system for improving software test stability |
CN108809755A (en) * | 2018-05-18 | 2018-11-13 | 烽火通信科技股份有限公司 | The home gateway automatic test approach and system of compatible command row and WEB interface |
CN112597043A (en) * | 2020-12-28 | 2021-04-02 | 深圳供电局有限公司 | Software testing method and device, computer equipment and storage medium |
CN114416458A (en) * | 2022-03-30 | 2022-04-29 | 航天中认软件测评科技(北京)有限责任公司 | Test method, device, equipment and storage medium |
CN115623077A (en) * | 2022-10-18 | 2023-01-17 | 开元华创科技(集团)有限公司 | Autonomous controllable test system |
Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN101082876A (en) * | 2006-05-30 | 2007-12-05 | 四川华智信息技术有限公司 | Software automatically evaluating tool bag |
CN101145993A (en) * | 2007-10-11 | 2008-03-19 | 中兴通讯股份有限公司 | A multi-point access interface test method and its test system |
CN101212362A (en) * | 2006-12-26 | 2008-07-02 | 中兴通讯股份有限公司 | Automatic testing device and method incorporating a variety of testing tools |
-
2011
- 2011-08-16 CN CN201110234792.5A patent/CN102937932B/en active Active
Patent Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN101082876A (en) * | 2006-05-30 | 2007-12-05 | 四川华智信息技术有限公司 | Software automatically evaluating tool bag |
CN101212362A (en) * | 2006-12-26 | 2008-07-02 | 中兴通讯股份有限公司 | Automatic testing device and method incorporating a variety of testing tools |
CN101145993A (en) * | 2007-10-11 | 2008-03-19 | 中兴通讯股份有限公司 | A multi-point access interface test method and its test system |
Cited By (27)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN103684919A (en) * | 2013-12-18 | 2014-03-26 | 南京理工大学连云港研究院 | Ubiquitous network performance monitoring system |
CN104850491A (en) * | 2014-02-19 | 2015-08-19 | 深圳中兴网信科技有限公司 | Software test method, equipment and system |
CN104317713A (en) * | 2014-10-27 | 2015-01-28 | 北京锐安科技有限公司 | Automatic testing tool and method on basis of templates |
CN104679658B (en) * | 2015-03-17 | 2018-11-13 | 百度在线网络技术(北京)有限公司 | The test method and system of WEB page |
CN104679658A (en) * | 2015-03-17 | 2015-06-03 | 百度在线网络技术(北京)有限公司 | Test method and test system for WEB pages |
CN104850495A (en) * | 2015-05-14 | 2015-08-19 | 曙光信息产业(北京)有限公司 | Automatic detection method and device |
CN105243015A (en) * | 2015-09-25 | 2016-01-13 | 惠州Tcl移动通信有限公司 | Automated software test method and system |
CN105374131A (en) * | 2015-10-28 | 2016-03-02 | 深圳怡化电脑股份有限公司 | Method and device for automatic testing |
CN105405220A (en) * | 2015-10-28 | 2016-03-16 | 深圳怡化电脑股份有限公司 | Method and device for automated test |
CN105405221A (en) * | 2015-10-28 | 2016-03-16 | 深圳怡化电脑股份有限公司 | Method and device for automated test |
CN105468519A (en) * | 2015-11-17 | 2016-04-06 | 中国建设银行股份有限公司 | Performance-testing tool control method and device |
CN105679375A (en) * | 2015-12-31 | 2016-06-15 | 浪潮(北京)电子信息产业有限公司 | Automatic test system of storage equipment, and method thereof |
CN105808437B (en) * | 2016-03-09 | 2020-05-12 | 广州优视网络科技有限公司 | Automatic test method and system based on test case data sheet |
CN105808437A (en) * | 2016-03-09 | 2016-07-27 | 广州彩瞳网络技术有限公司 | Automation testing method and system based on test case data table |
US10936350B2 (en) | 2016-10-14 | 2021-03-02 | Seagate Technology Llc | Active drive API |
CN107967158A (en) * | 2016-10-14 | 2018-04-27 | 希捷科技有限公司 | Active drive api |
US11119797B2 (en) | 2016-10-14 | 2021-09-14 | Seagate Technology Llc | Active drive API |
CN107967158B (en) * | 2016-10-14 | 2020-12-25 | 希捷科技有限公司 | Active drive API |
CN106775979A (en) * | 2016-12-13 | 2017-05-31 | 郑州云海信息技术有限公司 | Scheduler call method and system |
CN107729237A (en) * | 2017-10-09 | 2018-02-23 | 郑州云海信息技术有限公司 | A kind of method, apparatus of software performance test, computer installation and storage medium |
CN107992418A (en) * | 2017-12-05 | 2018-05-04 | 郑州云海信息技术有限公司 | A kind of method and system for improving software test stability |
CN108809755B (en) * | 2018-05-18 | 2020-10-30 | 烽火通信科技股份有限公司 | Automatic testing method and system for home gateway compatible with command line and WEB interface |
CN108809755A (en) * | 2018-05-18 | 2018-11-13 | 烽火通信科技股份有限公司 | The home gateway automatic test approach and system of compatible command row and WEB interface |
CN112597043A (en) * | 2020-12-28 | 2021-04-02 | 深圳供电局有限公司 | Software testing method and device, computer equipment and storage medium |
CN114416458A (en) * | 2022-03-30 | 2022-04-29 | 航天中认软件测评科技(北京)有限责任公司 | Test method, device, equipment and storage medium |
CN115623077A (en) * | 2022-10-18 | 2023-01-17 | 开元华创科技(集团)有限公司 | Autonomous controllable test system |
CN115623077B (en) * | 2022-10-18 | 2023-08-18 | 开元华创科技(集团)有限公司 | Autonomous controllable test system |
Also Published As
Publication number | Publication date |
---|---|
CN102937932B (en) | 2015-08-19 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN102937932B (en) | The automatic test device of integrated isomery testing tool and method | |
CN107493310B (en) | Cloud resource processing method and cloud management platform | |
CN109582301B (en) | Service processing method, device, equipment and medium based on task scheduling system | |
JP6630276B2 (en) | Measuring User Behavior and Involvement Using User Interface on Terminal Devices | |
US20140095931A1 (en) | Method and system for automating the process of testing a device | |
CN106293734A (en) | The method and device of detection android terminal information | |
CN103870260A (en) | Method and system for service interface development | |
CN106209503B (en) | RPC interface test method and system | |
CN107368313B (en) | Code detection method, device and electronic equipment | |
CN103336705A (en) | Automatic transcoding and semantic adaptation between scripting and workflow systems | |
CN102567203A (en) | Method and system for testing performance of distributed file system (DFS) | |
CN106919485A (en) | A kind of system based on configuration hardware testing instrument on server | |
CN102306119A (en) | System for capturing global exception and method | |
CN113407393B (en) | Chip verification method, terminal device, verification platform and storage medium | |
CN106354629A (en) | Construction method of iOS system mobile application automatic test system based on multiple stages of servers | |
CN114189274A (en) | Satellite ground station monitoring system based on microservice | |
CN109582524A (en) | A kind of test method, system and electronic equipment and storage medium | |
CN111949484A (en) | Information processing method, information processing apparatus, electronic device, and medium | |
CN111176989A (en) | Fault injection test scenario case model and framework based on service arrangement | |
CN106896956B (en) | The implementation method of multi-point touch under one kind " road " system | |
CN106612215A (en) | Integrated remote detection device and method based on Ethernet | |
CN108984216A (en) | A kind of method and apparatus automatically into configuration BIOS | |
CN104598202A (en) | Command line management device and method | |
CN115668895A (en) | Resource configuration determining method and device of cloud service system | |
CN106161066A (en) | A kind of log collection method and server |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
C06 | Publication | ||
PB01 | Publication | ||
C10 | Entry into substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
C14 | Grant of patent or utility model | ||
GR01 | Patent grant |