CN102937932A - Automated testing device and method of integrated heterogeneous testing tool - Google Patents

Automated testing device and method of integrated heterogeneous testing tool Download PDF

Info

Publication number
CN102937932A
CN102937932A CN2011102347925A CN201110234792A CN102937932A CN 102937932 A CN102937932 A CN 102937932A CN 2011102347925 A CN2011102347925 A CN 2011102347925A CN 201110234792 A CN201110234792 A CN 201110234792A CN 102937932 A CN102937932 A CN 102937932A
Authority
CN
China
Prior art keywords
test
testing tool
testing
result
configuration
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN2011102347925A
Other languages
Chinese (zh)
Other versions
CN102937932B (en
Inventor
尹祥龙
吴金坛
吕苏
翟威
陆寄豪
吴首阳
宋鑫晶
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
China Unionpay Co Ltd
Original Assignee
China Unionpay Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by China Unionpay Co Ltd filed Critical China Unionpay Co Ltd
Priority to CN201110234792.5A priority Critical patent/CN102937932B/en
Publication of CN102937932A publication Critical patent/CN102937932A/en
Application granted granted Critical
Publication of CN102937932B publication Critical patent/CN102937932B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Landscapes

  • Debugging And Monitoring (AREA)

Abstract

The invention provides an automated testing device and a method of an integrated heterogeneous testing tool. The automated testing device comprises a test case configuration module, a test control module and a testing tool adaptive connector, wherein the test case configuration module is used for configuring a test task according to user input; the test control module is used for controlling the execution of the test task and generating a final test result of the corresponding test task; and the testing tool adaptive connector is used for executing the test task based on a scheduling instruction and sending an execution result to the test control module. According to the automated testing device and the method, the heterogeneous testing tool can be integrated, the automated testing of a complex system can be achieved, and the overall performance of the test device can be improved and expanded obviously.

Description

The automatic test device of integrated isomery testing tool and method
Technical field
The present invention relates to automatic test device and method, more specifically, relate to automatic test device and the method for integrated isomery testing tool.
Background technology
At present, become increasingly abundant (for example financial transaction field) along with the class of business of the growing and different field of computer technology, the demand of complication system being carried out automatic test is growing, and therefore, automatic test device and method become more and more important.
Usually, existing automatic test device and method substantially can be divided into following classification: from the angle of Technical Architecture mainly be divided into commercial testing tool, the lightweight test script of increase income test frame and tester's establishment; Mainly be divided into functional test instrument, performance testing tool and security test instrument etc. from the angle of function; Mainly be divided into based on Windows operating system, based on Unix/Linux operating system etc. from the operation platform angle; From the system under test (SUT) angle such as being divided into Web testing tool, message testing tool etc.
Yet there are the following problems for above-mentioned existing automatic test device and method: only can test for the specific function of specific system under test (SUT), namely can not finish test cross-platform, that stride framework; For the application system of complexity, only can finish test in a certain respect; Because testing tool is of a great variety, use and complicated operation so be difficult to merge.
Therefore, there is following demand: automatic test device and method that a kind of integrated isomery testing tool is provided.
Summary of the invention
In order to solve existing problem in the above-mentioned prior art scheme, the present invention proposes a kind of automatic test device and method of integrated isomery testing tool.
The objective of the invention is to be achieved through the following technical solutions:
A kind of automatic test device, wherein, described automatic test device comprises:
Test case configuration module, described test case configuration module are used for according to user's input and the configuration testing task;
Testing control module, described testing control module is used for sending to the testing tool adaptable interface based on described test assignment structure dispatch command and with described dispatch command, controlling the execution of described test assignment, and generate final testing result corresponding to described test assignment;
Testing tool adaptable interface, described testing tool adaptable interface are used for carrying out described test assignment based on described dispatch command, and execution result is sent back described testing control module.
In the disclosed scheme, preferably, described configuration testing task comprises at least one test subtask of configuration in the above.
In the disclosed scheme, alternatively, at least one test subtask of described configuration is included at least one testing tool interface model corresponding to described at least one test subtask of configuration in the described automatic test device in the above.
In the above in the disclosed scheme, alternatively, at least one test subtask of described configuration is included at least one testing tool interface model corresponding to described at least one test subtask of configuration on the test assignment configuration server, and the testing tool interface model identification number that configuration is associated with described at least one testing tool interface model in described automatic test device.
In the disclosed scheme, preferably, described testing tool interface model comprises testing tool name field, test case name field, test case description field, test case parameter field and expected result field in the above.
In the above in the disclosed scheme, preferably, wherein dispose at least one testing tool interface model corresponding to described at least one test subtask and comprise according to described user and input each field in the described testing tool interface model of filling.
In the disclosed scheme, preferably, described dispatch command comprises the configuration information of described test assignment in the above.
In the disclosed scheme, preferably, described execution result comprises any one test result information in described at least one test subtask in the above.
In the disclosed scheme, preferably, described testing control module further comprises in the above:
Scheduling unit, described scheduling unit are used for constructing described dispatch command and described dispatch command being sent to described testing tool adaptable interface, thereby with execution parallel or described at least one test subtask of serial mode scheduling;
Test result generation unit, described test result generation unit are used for the described test result information based on each of described at least one test subtask of described execution result record, and generate the final testing result corresponding to described test assignment.
In the disclosed scheme, preferably, described testing tool adaptable interface 3 further comprises in the above:
Testing tool registering unit, described testing tool registering unit are used at least one testing tool of registration, and generate registered testing tool tabulation;
Initialization unit, described initialization unit is used for determining corresponding at least one testing tool of described at least one test subtask and judging whether described at least one testing tool is registered based on the configuration information of described test assignment, if and in described at least one testing tool each is all registered, then according to the call instruction of pre-defined rule generation corresponding to described at least one testing tool, and described call instruction is sent to the test execution unit, if and in described at least one testing tool at least one be not registered, then return the information of indication configuration error to described scheduling unit;
The test execution unit, described test execution unit is used for calling described at least one testing tool according to described call instruction, to carry out described at least one test subtask, and monitor and obtain the test result information of described at least one testing tool output, and described test result information is sent to the collection unit;
The collection unit, compare described test result information in described collection unit with expected result, and based on the comparison result and/or test crash information structuring execution result, and described execution result is sent to described testing control module.
In the above in the disclosed scheme, preferably, described pre-defined rule is based on one or more among Telnet agreement, bat temporary file and the Windows API.
In the above in the disclosed scheme, preferably, described call instruction comprises one or more in Shell order, cmd order and the Windows api function.
In the above in the disclosed scheme, preferably, the result data of described at least one testing tool output is monitored and obtained to described test execution unit at least one mode in the following way: read output data in the Telnet agreement return command, read the cmd order return data, read the output data of invoked Windows api function.
In the above in the disclosed scheme, preferably, described test execution unit further comprises each at least one timer that corresponds respectively in described at least one testing tool, if and in described at least one timer any is overtime, then described test execution unit sends test crash information to described collection unit, and the overtime corresponding testing tool of timer of described test crash information indication fails and carries out its corresponding test subtask.
In the disclosed scheme, preferably, described automatic test device uses at least two testing tools, and described at least two testing tools are isomeries in the above.
Purpose of the present invention also is achieved through the following technical solutions:
A kind of automated testing method, wherein, described automated testing method comprises the steps:
(A1) input and the configuration testing task according to the user;
(A2) send to the testing tool adaptable interface based on described test assignment structure dispatch command and with described dispatch command, to control the execution of described test assignment;
(A3) described testing tool adaptable interface is carried out described test assignment based on described dispatch command, and the output execution result;
(A4) according to the final testing result of described execution result generation corresponding to described test assignment.
In the disclosed scheme, preferably, described configuration testing task comprises at least one test subtask of configuration in the above.
In the disclosed scheme, preferably, at least one test subtask of described configuration comprises at least one testing tool interface model corresponding to described at least one test subtask of configuration in the above.
In the disclosed scheme, preferably, described testing tool interface model comprises testing tool name field, test case name field, test case description field, test case parameter field and expected result field in the above.
In the above in the disclosed scheme, preferably, dispose at least one testing tool interface model corresponding to described at least one test subtask and comprise according to described user and input each field in the described testing tool interface model of filling.
In the disclosed scheme, preferably, described dispatch command comprises the configuration information of described test assignment in the above.
In the disclosed scheme, preferably, described execution result comprises any one test result information in described at least one test subtask in the above.
In the above in the disclosed scheme, preferably, described step (A2) further comprises: constructs described dispatch command and described dispatch command sent to described testing tool adaptable interface, thereby with execution parallel or described at least one test subtask of serial mode scheduling
In the above in the disclosed scheme, preferably, described step (A4) further comprises: based on each the described test result information in described at least one test subtask of described execution result record, and generate final testing result corresponding to described test assignment.
In the disclosed scheme, preferably, described step (A3) further comprises in the above:
(B1) register at least one testing tool, and generate registered testing tool tabulation;
(B2) determine corresponding at least one testing tool of described at least one test subtask and judge whether described at least one testing tool is registered based on the configuration information of described test assignment, if and in described at least one testing tool each is all registered, then according to the call instruction of pre-defined rule generation corresponding to described at least one testing tool, if and in described at least one testing tool at least one be not registered, then return the information of indication configuration error;
(B3) call described at least one testing tool according to described call instruction, carrying out described at least one test subtask, and monitoring and obtain the test result information of described at least one testing tool output;
(B4) described test result information is compared with expected result, and based on the comparison result and/or test crash information structuring execution result.
In the above in the disclosed scheme, preferably, described pre-defined rule is based on one or more among Telnet agreement, bat temporary file and the Windows API.
In the above in the disclosed scheme, preferably, described call instruction comprises one or more in Shell order, cmd order and the Windows api function.
In the above in the disclosed scheme, preferably, wherein the result data of described at least one testing tool output is monitored and obtained at least one mode in the following way: read output data in the Telnet agreement return command, read the cmd order return data, read the output data of invoked Windows api function.
In the above in the disclosed scheme, preferably, described step (B3) further comprises: enable each at least one timer that corresponds respectively in described at least one testing tool, if and in described at least one timer any is overtime, then export described test crash information, the overtime corresponding testing tool of timer of described test crash information indication fails and carries out its corresponding test subtask.
In the disclosed scheme, preferably, in described step (A3), use at least two testing tools, and described at least two testing tools are isomeries in the above.
The automatic test device of integrated isomery testing tool disclosed in this invention and method have following advantage: (1) can realize the automatic test of complication system; (2) since testing tool that can integrated isomery finish the test assignment that single testing tool is difficult to finish so can make up the advantage of various testing tools, thereby significantly improve and expanded the overall performance of proving installation.
Description of drawings
By reference to the accompanying drawings, technical characterictic of the present invention and advantage will be understood better by those skilled in the art, wherein:
Fig. 1 is the schematic diagram of the automatic test device of integrated according to an embodiment of the invention isomery testing tool;
Fig. 2 is the process flow diagram of the automated testing method of integrated according to an embodiment of the invention isomery testing tool.
Embodiment
Fig. 1 is the schematic diagram of the automatic test device of integrated according to an embodiment of the invention isomery testing tool.As shown in Figure 1, the automatic test device of integrated isomery testing tool disclosed in this invention comprises test case configuration module 1, testing control module 2 and testing tool adaptable interface 3.Wherein, described test case configuration module 1 is used for according to user's input and the configuration testing task.Described testing control module 2 is used for sending to described testing tool adaptable interface 3 based on described test assignment structure dispatch command and with described dispatch command, controlling the execution of described test assignment, and generates the final testing result corresponding to described test assignment.Described testing tool adaptable interface 3 is used for carrying out described test assignment based on described dispatch command, and execution result is sent back described testing control module 2.
Preferably, in automatic test device disclosed in this invention, described configuration testing task comprises at least one test subtask of configuration.
Alternatively, in automatic test device disclosed in this invention, at least one test subtask of described configuration is included at least one testing tool interface model corresponding to described at least one test subtask of configuration in the described automatic test device.
Alternatively, in automatic test device disclosed in this invention, at least one test subtask of described configuration is included at least one testing tool interface model corresponding to described at least one test subtask of configuration on the test assignment configuration server, and the testing tool interface model identification number that configuration is associated with described at least one testing tool interface model in described automatic test device.
Exemplarily, table 1 shows the field structure of described testing tool interface model.As shown in table 1, preferably, in automatic test device disclosed in this invention, described testing tool interface model comprises testing tool name field, test case name field, test case description field, test case parameter field and expected result field etc.
Table 1
Exemplarily, in automatic test device disclosed in this invention, dispose at least one testing tool interface model corresponding to described at least one test subtask and comprise according to described user and input filling each field in the described testing tool interface model.
Preferably, in automatic test device disclosed in this invention, described dispatch command comprises the configuration information of described test assignment.
Preferably, in automatic test device disclosed in this invention, described execution result comprises any one test result information in described at least one test subtask.
As shown in Figure 1, in automatic test device disclosed in this invention, described testing control module 2 further comprises scheduling unit 4 and test result generation unit 5.Wherein, described scheduling unit 4 is used for constructing described dispatch command and described dispatch command being sent to described testing tool adaptable interface 3, thereby with execution parallel or described at least one test subtask of serial mode scheduling.Described test result generation unit 5 is used for the described test result information based on each of described at least one test subtask of described execution result record, and generates the final testing result corresponding to described test assignment.
Wherein, exemplarily, in automatic test device disclosed in this invention, described parallel mode is applicable to the functional availability of system in the testing high voltage power situation, and described serial mode is applicable to the binding operation flow of test sequence.
As shown in Figure 1, in automatic test device disclosed in this invention, described testing tool adaptable interface 3 further comprises initialization unit 6, test execution unit 7, collection unit 8 and testing tool registering unit 9.Wherein, described testing tool registering unit 9 is used at least one testing tool of registration, and generates registered testing tool tabulation.Described initialization unit 6 is used for determining corresponding at least one testing tool of described at least one test subtask and judging whether described at least one testing tool is registered based on the configuration information of described test assignment, if and in described at least one testing tool each is all registered, then according to the call instruction of pre-defined rule generation corresponding to described at least one testing tool, and described call instruction is sent to described test execution unit 7, if and in described at least one testing tool at least one be not registered, then return the information of indication configuration error to described scheduling unit 4.Described test execution unit 7 is used for calling described at least one testing tool according to described call instruction, to carry out described at least one test subtask, and monitor and obtain the test result information of described at least one testing tool output, and described test result information is sent to described collection unit 8.Compare described test result information (for example with expected result in described collection unit 8, compare special keyword), and based on the comparison result and/or described test crash information structuring execution result, and described execution result is sent to described testing control module 2.
Exemplarily, in automatic test device disclosed in this invention, described pre-defined rule is based on one or more among Telnet agreement, bat temporary file and the Windows API.
Exemplarily, in automatic test device disclosed in this invention, described call instruction comprises one or more in Shell order, cmd order and the Windows api function.
Exemplarily, in automatic test device disclosed in this invention, the result data of described at least one testing tool output is monitored and obtained to described test execution unit 7 at least one mode in the following way: read output data in the Telnet agreement return command, read the cmd order return data, read the output data of invoked Windows api function.
Preferably, in automatic test device disclosed in this invention, described test execution unit 7 further comprises each at least one timer that corresponds respectively in described at least one testing tool, if and in described at least one timer any is overtime, then described test execution unit 78 sends the test crash information to described collection unit, and the overtime corresponding testing tool of timer of described test crash information indication fails and carries out its corresponding test subtask.
Exemplarily, in automatic test device disclosed in this invention, generate as follows the call instruction corresponding to described at least one testing tool: (1) is if the method for calling of utility command row platform (AIX/UNIX/LINUX etc.) form, then described testing tool adaptable interface 3 is used as the telnet protocol client, thereby connects and sign in to the remote object Test Host; (2) if use the method for calling of the cmd command forms of Windows, then generate executable bat interim order script; (3) if use the method for calling of Windows API form, then constructing variable is also by ShellExecute function call testing tool.
Preferably, in automatic test device disclosed in this invention, described automatic test device uses at least two testing tools, and described at least two testing tools are isomeries.
Exemplarily, in automatic test device disclosed in this invention, described at least one testing tool comprises one or more in following: Automated test tool (is used for the function regression test, for example, system under test (SUT) is the Windows system), the Shell script (is used for functional test or test is auxiliary, for example, system under test (SUT) is the Unix system), the Python automated test tool (is used for the function regression test, for example, system under test (SUT) is the web system) and LoadRunner performance testing tool (being used for performance test).
As shown in Figure 1, the basic functional principle of automatic test device disclosed in this invention is as follows: described test case configuration module 1 is inputted and the configuration testing task according to the user; Described testing control module 2 structure dispatch commands also send to described testing tool adaptable interface 3 with described dispatch command, controlling the execution of described test assignment, and generate the final testing result corresponding to described test assignment; Described testing tool adaptable interface 3 is carried out described test assignment based on described dispatch command, and execution result is sent back described testing control module 2.
Fig. 2 is the process flow diagram of the automated testing method of integrated according to an embodiment of the invention isomery testing tool.As shown in Figure 2, automated testing method disclosed in this invention comprises the steps: (A1) according to user's input and the configuration testing task; (A2) send to the testing tool adaptable interface based on described test assignment structure dispatch command and with described dispatch command, to control the execution of described test assignment; (A3) described testing tool adaptable interface is carried out described test assignment based on described dispatch command, and the output execution result; (A4) according to the final testing result of described execution result generation corresponding to described test assignment.
Preferably, in automated testing method disclosed in this invention, described configuration testing task comprises at least one test subtask of configuration.
Alternatively, in automated testing method disclosed in this invention, at least one test subtask of described configuration comprises at least one testing tool interface model corresponding to described at least one test subtask of configuration.
Exemplarily, table 1 shows the field structure of described testing tool interface model.As shown in table 1, preferably, in automated testing method disclosed in this invention, described testing tool interface model comprises testing tool name field, test case name field, test case description field, test case parameter field and expected result field etc.
Exemplarily, in automated testing method disclosed in this invention, dispose at least one testing tool interface model corresponding to described at least one test subtask and comprise according to described user and input filling each field in the described testing tool interface model.
Preferably, in automated testing method disclosed in this invention, described dispatch command comprises the configuration information of described test assignment.
Preferably, in automated testing method disclosed in this invention, described execution result comprises any one test result information in described at least one test subtask.
As shown in Figure 2, in automated testing method disclosed in this invention, described step (A2) further comprises: constructs described dispatch command and described dispatch command sent to described testing tool adaptable interface, thereby with execution parallel or described at least one test subtask of serial mode scheduling
As shown in Figure 2, in automated testing method disclosed in this invention, described step (A4) further comprises: based on each the described test result information in described at least one test subtask of described execution result record, and generate final testing result corresponding to described test assignment.
Wherein, exemplarily, in automated testing method disclosed in this invention, described parallel mode is applicable to the functional availability of system in the testing high voltage power situation, and described serial mode is applicable to the binding operation flow of test sequence.
As shown in Figure 2, in automated testing method disclosed in this invention, described step (A3) further comprises: (B1) register at least one testing tool, and generate registered testing tool tabulation; (B2) determine corresponding at least one testing tool of described at least one test subtask and judge whether described at least one testing tool is registered based on the configuration information of described test assignment, if and in described at least one testing tool each is all registered, then according to the call instruction of pre-defined rule generation corresponding to described at least one testing tool, if and in described at least one testing tool at least one be not registered, then return the information of indication configuration error; (B3) call described at least one testing tool according to described call instruction, carrying out described at least one test subtask, and monitoring and obtain the test result information of described at least one testing tool output; (B4) described test result information is compared with expected result (for example, relatively special keyword), and based on the comparison result and/or test crash information structuring execution result.
Exemplarily, in automated testing method disclosed in this invention, described pre-defined rule is based on one or more among Telnet agreement, bat temporary file and the Windows API.
Exemplarily, in automated testing method disclosed in this invention, described call instruction comprises one or more in Shell order, cmd order and the Windows api function.
Exemplarily, in automated testing method disclosed in this invention, the result data of described at least one testing tool output is monitored and obtained at least one mode in the following way: read output data in the Telnet agreement return command, read the cmd order return data, read the output data of invoked Windows api function.
Preferably, in automated testing method disclosed in this invention, described step (B3) further comprises: enable each at least one timer that corresponds respectively in described at least one testing tool, if and in described at least one timer any is overtime, then export described test crash information, the overtime corresponding testing tool of timer of described test crash information indication fails and carries out its corresponding test subtask.
Exemplarily, in automated testing method disclosed in this invention, generate as follows the call instruction corresponding to described at least one testing tool: (1) is if the method for calling of utility command row platform (AIX/UNIX/LINUX etc.) form, then described testing tool adaptable interface 3 is used as the telnet protocol client, thereby connects and sign in to the remote object Test Host; (2) if use the method for calling of the cmd command forms of Windows, then generate executable bat interim order script; (3) if use the method for calling of Windows API form, then constructing variable is also by ShellExecute function call testing tool.
Preferably, in automated testing method disclosed in this invention, in described step (A3), use at least two testing tools, and described at least two testing tools are isomeries.
Exemplarily, in automated testing method disclosed in this invention, described at least one testing tool comprises one or more in following: HP QTP automated test tool (is used for the function regression test, for example, system under test (SUT) is the Windows system), the Shell script (is used for functional test or test is auxiliary, for example, system under test (SUT) is the Unix system), the Python automated test tool (is used for the function regression test, for example, system under test (SUT) is the web system) and LoadRunner performance testing tool (being used for performance test).
Although the present invention is described by above-mentioned preferred implementation, its way of realization is not limited to above-mentioned embodiment.Should be realized that: in the situation that does not break away from purport of the present invention and scope, those skilled in the art can make different variations and modification to the present invention.

Claims (30)

1. automatic test device, wherein, described automatic test device comprises:
Test case configuration module, described test case configuration module are used for according to user's input and the configuration testing task;
Testing control module, described testing control module is used for sending to the testing tool adaptable interface based on described test assignment structure dispatch command and with described dispatch command, controlling the execution of described test assignment, and generate final testing result corresponding to described test assignment;
Testing tool adaptable interface, described testing tool adaptable interface are used for carrying out described test assignment based on described dispatch command, and execution result is sent back described testing control module.
2. automatic test device according to claim 1 is characterized in that, described configuration testing task comprises at least one test subtask of configuration.
3. automatic test device according to claim 2 is characterized in that, at least one test subtask of described configuration is included at least one testing tool interface model corresponding to described at least one test subtask of configuration in the described automatic test device.
4. automatic test device according to claim 2, it is characterized in that, at least one test subtask of described configuration is included at least one testing tool interface model corresponding to described at least one test subtask of configuration on the test assignment configuration server, and the testing tool interface model identification number that configuration is associated with described at least one testing tool interface model in described automatic test device.
5. automatic test device according to claim 3 is characterized in that, described testing tool interface model comprises testing tool name field, test case name field, test case description field, test case parameter field and expected result field.
6. automatic test device according to claim 5, it is characterized in that, wherein dispose at least one testing tool interface model corresponding to described at least one test subtask and comprise according to described user and input filling each field in the described testing tool interface model.
7. automatic test device according to claim 6 is characterized in that, described dispatch command comprises the configuration information of described test assignment.
8. automatic test device according to claim 7 is characterized in that, described execution result comprises any one test result information in described at least one test subtask.
9. automatic test device according to claim 8 is characterized in that, described testing control module further comprises:
Scheduling unit, described scheduling unit are used for constructing described dispatch command and described dispatch command being sent to described testing tool adaptable interface, thereby with execution parallel or described at least one test subtask of serial mode scheduling;
Test result generation unit, described test result generation unit are used for the described test result information based on each of described at least one test subtask of described execution result record, and generate the final testing result corresponding to described test assignment.
10. automatic test device according to claim 9 is characterized in that, described testing tool adaptable interface 3 further comprises:
Testing tool registering unit, described testing tool registering unit are used at least one testing tool of registration, and generate registered testing tool tabulation;
Initialization unit, described initialization unit is used for determining corresponding at least one testing tool of described at least one test subtask and judging whether described at least one testing tool is registered based on the configuration information of described test assignment, if and in described at least one testing tool each is all registered, then according to the call instruction of pre-defined rule generation corresponding to described at least one testing tool, and described call instruction is sent to the test execution unit, if and in described at least one testing tool at least one be not registered, then return the information of indication configuration error to described scheduling unit;
The test execution unit, described test execution unit is used for calling described at least one testing tool according to described call instruction, to carry out described at least one test subtask, and monitor and obtain the test result information of described at least one testing tool output, and described test result information is sent to the collection unit;
The collection unit, compare described test result information in described collection unit with expected result, and based on the comparison result and/or test crash information structuring execution result, and described execution result is sent to described testing control module.
11. automatic test device according to claim 10 is characterized in that, described pre-defined rule is based on one or more among Telnet agreement, bat temporary file and the Windows API.
12. automatic test device according to claim 11 is characterized in that, described call instruction comprises one or more in Shell order, cmd order and the Windows api function.
13. automatic test device according to claim 12, it is characterized in that the result data of described at least one testing tool output is monitored and obtained to described test execution unit at least one mode in the following way: read output data in the Telnet agreement return command, read the cmd order return data, read the output data of invoked Windows api function.
14. automatic test device according to claim 13, it is characterized in that, described test execution unit further comprises each at least one timer that corresponds respectively in described at least one testing tool, if and in described at least one timer any is overtime, then described test execution unit sends test crash information to described collection unit, and the overtime corresponding testing tool of timer of described test crash information indication fails and carries out its corresponding test subtask.
15. automatic test device according to claim 14 is characterized in that, described automatic test device uses at least two testing tools, and described at least two testing tools are isomeries.
16. an automated testing method, wherein, described automated testing method comprises the steps:
(A1) input and the configuration testing task according to the user;
(A2) send to the testing tool adaptable interface based on described test assignment structure dispatch command and with described dispatch command, to control the execution of described test assignment;
(A3) described testing tool adaptable interface is carried out described test assignment based on described dispatch command, and the output execution result;
(A4) according to the final testing result of described execution result generation corresponding to described test assignment.
17. automated testing method according to claim 16 is characterized in that, described configuration testing task comprises at least one test subtask of configuration.
18. automated testing method according to claim 17 is characterized in that, at least one test subtask of described configuration comprises at least one testing tool interface model corresponding to described at least one test subtask of configuration.
19. automated testing method according to claim 18 is characterized in that, described testing tool interface model comprises testing tool name field, test case name field, test case description field, test case parameter field and expected result field.
20. automated testing method according to claim 19, it is characterized in that, dispose at least one testing tool interface model corresponding to described at least one test subtask and comprise according to described user and input filling each field in the described testing tool interface model.
21. automated testing method according to claim 20 is characterized in that, described dispatch command comprises the configuration information of described test assignment.
22. automated testing method according to claim 21 is characterized in that, described execution result comprises any one test result information in described at least one test subtask.
23. automated testing method according to claim 22, it is characterized in that, described step (A2) further comprises: constructs described dispatch command and described dispatch command sent to described testing tool adaptable interface, thereby with execution parallel or described at least one test subtask of serial mode scheduling
24. automated testing method according to claim 23, it is characterized in that, described step (A4) further comprises: based on each the described test result information in described at least one test subtask of described execution result record, and generate final testing result corresponding to described test assignment.
25. automated testing method according to claim 24 is characterized in that, described step (A3) further comprises:
(B1) register at least one testing tool, and generate registered testing tool tabulation;
(B2) determine corresponding at least one testing tool of described at least one test subtask and judge whether described at least one testing tool is registered based on the configuration information of described test assignment, if and in described at least one testing tool each is all registered, then according to the call instruction of pre-defined rule generation corresponding to described at least one testing tool, if and in described at least one testing tool at least one be not registered, then return the information of indication configuration error;
(B3) call described at least one testing tool according to described call instruction, carrying out described at least one test subtask, and monitoring and obtain the test result information of described at least one testing tool output;
(B4) described test result information is compared with expected result, and based on the comparison result and/or test crash information structuring execution result.
26. automated testing method according to claim 25 is characterized in that, described pre-defined rule is based on one or more among Telnet agreement, bat temporary file and the Windows API.
27. automated testing method according to claim 26 is characterized in that, described call instruction comprises one or more in Shell order, cmd order and the Windows api function.
28. automated testing method according to claim 27, it is characterized in that wherein the result data of described at least one testing tool output is monitored and obtained at least one mode in the following way: read output data in the Telnet agreement return command, read the cmd order return data, read the output data of invoked Windows api function.
29. automated testing method according to claim 28, it is characterized in that, described step (B3) further comprises: enable each at least one timer that corresponds respectively in described at least one testing tool, if and in described at least one timer any is overtime, then export described test crash information, the overtime corresponding testing tool of timer of described test crash information indication fails and carries out its corresponding test subtask.
30. automated testing method according to claim 29 is characterized in that, use at least two testing tools in described step (A3), and described at least two testing tools is isomeries.
CN201110234792.5A 2011-08-16 2011-08-16 The automatic test device of integrated isomery testing tool and method Active CN102937932B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201110234792.5A CN102937932B (en) 2011-08-16 2011-08-16 The automatic test device of integrated isomery testing tool and method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201110234792.5A CN102937932B (en) 2011-08-16 2011-08-16 The automatic test device of integrated isomery testing tool and method

Publications (2)

Publication Number Publication Date
CN102937932A true CN102937932A (en) 2013-02-20
CN102937932B CN102937932B (en) 2015-08-19

Family

ID=47696831

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201110234792.5A Active CN102937932B (en) 2011-08-16 2011-08-16 The automatic test device of integrated isomery testing tool and method

Country Status (1)

Country Link
CN (1) CN102937932B (en)

Cited By (20)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103684919A (en) * 2013-12-18 2014-03-26 南京理工大学连云港研究院 Ubiquitous network performance monitoring system
CN104317713A (en) * 2014-10-27 2015-01-28 北京锐安科技有限公司 Automatic testing tool and method on basis of templates
CN104679658A (en) * 2015-03-17 2015-06-03 百度在线网络技术(北京)有限公司 Test method and test system for WEB pages
CN104850491A (en) * 2014-02-19 2015-08-19 深圳中兴网信科技有限公司 Software test method, equipment and system
CN104850495A (en) * 2015-05-14 2015-08-19 曙光信息产业(北京)有限公司 Automatic detection method and device
CN105243015A (en) * 2015-09-25 2016-01-13 惠州Tcl移动通信有限公司 Automated software test method and system
CN105374131A (en) * 2015-10-28 2016-03-02 深圳怡化电脑股份有限公司 Method and device for automatic testing
CN105405220A (en) * 2015-10-28 2016-03-16 深圳怡化电脑股份有限公司 Method and device for automated test
CN105405221A (en) * 2015-10-28 2016-03-16 深圳怡化电脑股份有限公司 Method and device for automated test
CN105468519A (en) * 2015-11-17 2016-04-06 中国建设银行股份有限公司 Performance-testing tool control method and device
CN105679375A (en) * 2015-12-31 2016-06-15 浪潮(北京)电子信息产业有限公司 Automatic test system of storage equipment, and method thereof
CN105808437A (en) * 2016-03-09 2016-07-27 广州彩瞳网络技术有限公司 Automation testing method and system based on test case data table
CN106775979A (en) * 2016-12-13 2017-05-31 郑州云海信息技术有限公司 Scheduler call method and system
CN107729237A (en) * 2017-10-09 2018-02-23 郑州云海信息技术有限公司 A kind of method, apparatus of software performance test, computer installation and storage medium
CN107967158A (en) * 2016-10-14 2018-04-27 希捷科技有限公司 Active drive api
CN107992418A (en) * 2017-12-05 2018-05-04 郑州云海信息技术有限公司 A kind of method and system for improving software test stability
CN108809755A (en) * 2018-05-18 2018-11-13 烽火通信科技股份有限公司 The home gateway automatic test approach and system of compatible command row and WEB interface
CN112597043A (en) * 2020-12-28 2021-04-02 深圳供电局有限公司 Software testing method and device, computer equipment and storage medium
CN114416458A (en) * 2022-03-30 2022-04-29 航天中认软件测评科技(北京)有限责任公司 Test method, device, equipment and storage medium
CN115623077A (en) * 2022-10-18 2023-01-17 开元华创科技(集团)有限公司 Autonomous controllable test system

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101082876A (en) * 2006-05-30 2007-12-05 四川华智信息技术有限公司 Software automatically evaluating tool bag
CN101145993A (en) * 2007-10-11 2008-03-19 中兴通讯股份有限公司 A multi-point access interface test method and its test system
CN101212362A (en) * 2006-12-26 2008-07-02 中兴通讯股份有限公司 Automatic testing device and method incorporating a variety of testing tools

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101082876A (en) * 2006-05-30 2007-12-05 四川华智信息技术有限公司 Software automatically evaluating tool bag
CN101212362A (en) * 2006-12-26 2008-07-02 中兴通讯股份有限公司 Automatic testing device and method incorporating a variety of testing tools
CN101145993A (en) * 2007-10-11 2008-03-19 中兴通讯股份有限公司 A multi-point access interface test method and its test system

Cited By (27)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103684919A (en) * 2013-12-18 2014-03-26 南京理工大学连云港研究院 Ubiquitous network performance monitoring system
CN104850491A (en) * 2014-02-19 2015-08-19 深圳中兴网信科技有限公司 Software test method, equipment and system
CN104317713A (en) * 2014-10-27 2015-01-28 北京锐安科技有限公司 Automatic testing tool and method on basis of templates
CN104679658B (en) * 2015-03-17 2018-11-13 百度在线网络技术(北京)有限公司 The test method and system of WEB page
CN104679658A (en) * 2015-03-17 2015-06-03 百度在线网络技术(北京)有限公司 Test method and test system for WEB pages
CN104850495A (en) * 2015-05-14 2015-08-19 曙光信息产业(北京)有限公司 Automatic detection method and device
CN105243015A (en) * 2015-09-25 2016-01-13 惠州Tcl移动通信有限公司 Automated software test method and system
CN105374131A (en) * 2015-10-28 2016-03-02 深圳怡化电脑股份有限公司 Method and device for automatic testing
CN105405220A (en) * 2015-10-28 2016-03-16 深圳怡化电脑股份有限公司 Method and device for automated test
CN105405221A (en) * 2015-10-28 2016-03-16 深圳怡化电脑股份有限公司 Method and device for automated test
CN105468519A (en) * 2015-11-17 2016-04-06 中国建设银行股份有限公司 Performance-testing tool control method and device
CN105679375A (en) * 2015-12-31 2016-06-15 浪潮(北京)电子信息产业有限公司 Automatic test system of storage equipment, and method thereof
CN105808437B (en) * 2016-03-09 2020-05-12 广州优视网络科技有限公司 Automatic test method and system based on test case data sheet
CN105808437A (en) * 2016-03-09 2016-07-27 广州彩瞳网络技术有限公司 Automation testing method and system based on test case data table
US10936350B2 (en) 2016-10-14 2021-03-02 Seagate Technology Llc Active drive API
CN107967158A (en) * 2016-10-14 2018-04-27 希捷科技有限公司 Active drive api
US11119797B2 (en) 2016-10-14 2021-09-14 Seagate Technology Llc Active drive API
CN107967158B (en) * 2016-10-14 2020-12-25 希捷科技有限公司 Active drive API
CN106775979A (en) * 2016-12-13 2017-05-31 郑州云海信息技术有限公司 Scheduler call method and system
CN107729237A (en) * 2017-10-09 2018-02-23 郑州云海信息技术有限公司 A kind of method, apparatus of software performance test, computer installation and storage medium
CN107992418A (en) * 2017-12-05 2018-05-04 郑州云海信息技术有限公司 A kind of method and system for improving software test stability
CN108809755B (en) * 2018-05-18 2020-10-30 烽火通信科技股份有限公司 Automatic testing method and system for home gateway compatible with command line and WEB interface
CN108809755A (en) * 2018-05-18 2018-11-13 烽火通信科技股份有限公司 The home gateway automatic test approach and system of compatible command row and WEB interface
CN112597043A (en) * 2020-12-28 2021-04-02 深圳供电局有限公司 Software testing method and device, computer equipment and storage medium
CN114416458A (en) * 2022-03-30 2022-04-29 航天中认软件测评科技(北京)有限责任公司 Test method, device, equipment and storage medium
CN115623077A (en) * 2022-10-18 2023-01-17 开元华创科技(集团)有限公司 Autonomous controllable test system
CN115623077B (en) * 2022-10-18 2023-08-18 开元华创科技(集团)有限公司 Autonomous controllable test system

Also Published As

Publication number Publication date
CN102937932B (en) 2015-08-19

Similar Documents

Publication Publication Date Title
CN102937932B (en) The automatic test device of integrated isomery testing tool and method
CN107493310B (en) Cloud resource processing method and cloud management platform
CN109582301B (en) Service processing method, device, equipment and medium based on task scheduling system
JP6630276B2 (en) Measuring User Behavior and Involvement Using User Interface on Terminal Devices
US20140095931A1 (en) Method and system for automating the process of testing a device
CN106293734A (en) The method and device of detection android terminal information
CN103870260A (en) Method and system for service interface development
CN106209503B (en) RPC interface test method and system
CN107368313B (en) Code detection method, device and electronic equipment
CN103336705A (en) Automatic transcoding and semantic adaptation between scripting and workflow systems
CN102567203A (en) Method and system for testing performance of distributed file system (DFS)
CN106919485A (en) A kind of system based on configuration hardware testing instrument on server
CN102306119A (en) System for capturing global exception and method
CN113407393B (en) Chip verification method, terminal device, verification platform and storage medium
CN106354629A (en) Construction method of iOS system mobile application automatic test system based on multiple stages of servers
CN114189274A (en) Satellite ground station monitoring system based on microservice
CN109582524A (en) A kind of test method, system and electronic equipment and storage medium
CN111949484A (en) Information processing method, information processing apparatus, electronic device, and medium
CN111176989A (en) Fault injection test scenario case model and framework based on service arrangement
CN106896956B (en) The implementation method of multi-point touch under one kind " road " system
CN106612215A (en) Integrated remote detection device and method based on Ethernet
CN108984216A (en) A kind of method and apparatus automatically into configuration BIOS
CN104598202A (en) Command line management device and method
CN115668895A (en) Resource configuration determining method and device of cloud service system
CN106161066A (en) A kind of log collection method and server

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant