CN110928774A - Automatic test system based on node formula - Google Patents
Automatic test system based on node formula Download PDFInfo
- Publication number
- CN110928774A CN110928774A CN201911082062.0A CN201911082062A CN110928774A CN 110928774 A CN110928774 A CN 110928774A CN 201911082062 A CN201911082062 A CN 201911082062A CN 110928774 A CN110928774 A CN 110928774A
- Authority
- CN
- China
- Prior art keywords
- test
- report
- node
- execution
- information
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/36—Preventing errors by testing or debugging software
- G06F11/3668—Software testing
- G06F11/3672—Test management
- G06F11/3684—Test management for test design, e.g. generating new test cases
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/36—Preventing errors by testing or debugging software
- G06F11/3668—Software testing
- G06F11/3672—Test management
- G06F11/3688—Test management for test execution, e.g. scheduling of test suites
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/36—Preventing errors by testing or debugging software
- G06F11/3668—Software testing
- G06F11/3672—Test management
- G06F11/3692—Test management for test results analysis
Abstract
The invention discloses a node-based automatic test system, which issues different test stages to different machines for testing, can support test cases on different machines to be executed coordinately, judges output corresponding to test input and an expected result to be compared and matched to complete the test, outputs a test report to a central server for summarizing and analyzing to form a complete test, generates the test report and sends the test report to related personnel. Aiming at the characteristics of the current stage service, the invention solves the difficulty of software testing, realizes a set of device system for omnibearing software automatic testing, can uninterruptedly and automatically complete the test of the whole service flow, generates a report in time, informs related personnel of a test result, monitors the quality of project software in an omnibearing manner, shortens the test time, reduces misoperation or omission of personnel in the test process, increases the test depth and improves the project quality.
Description
Technical Field
The invention belongs to the technical field of software automation test, and particularly relates to an automation test system based on a node type.
Background
At present, in order to complete various services, most service systems are combined by a plurality of systems, including a client, a server, a mobile terminal, and a combination of B/S and C/S modes. The architecture of the service system requires that different operations in the testing process are mutually called to complete the testing of the service flow, wherein the UI compatibility testing, the performance testing and other pertinence testing are integrated in part of the operating process. The fusion of different testing methods in a testing process requires that testing steps are distributed on different machines to complete testing, and cases on different machines are cooperatively executed, matching conditions of actual output and expected output in stages in different environments are detected, reports are reported, and execution results of each stage are gathered after the whole stage is completed to obtain a complete testing report.
Considering the existing technology, the specificity is strong, the technology and the scene are combined too tightly, and a technical solution or a system comprising a client, a server and a mobile terminal and a test scene formed by combining a B/S mode and a C/S mode is not solved. For example, chinese patent publication No. CN104679651A provides an automated test method and an execution node, where the execution node obtains a test case through the execution node, and the execution node starts a corresponding process, so that the corresponding process executes the test case; the number of the execution nodes is at least one, and the number of the processes corresponding to each execution node is at least one, so that the automatic test of the test case by a plurality of processes is realized. Therefore, the technical scheme can carry out automatic test on the test cases in parallel, the described solution is divided according to the case types, and the node machine executes the test cases of the same type; the distributed test method mainly solves the problems that the distributed test method based on the web test lacks the support to a C/S and a mobile terminal, and cannot complete the communication and cooperation of different types of use cases to complete the test of special scene use cases. With the progress of the technology, especially the increase of service scenes such as mobile terminals and the like, the complexity of the real service scene exceeds the past, the automatic test scheme and the system based on the complexity of the current service are required to realize, the tests from the mobile terminal to the B/S terminal to the C/S terminal are fused, and the test scene requirements are realized by mutual coordination.
For another example, chinese patent with publication number CN103678093A provides an automated testing framework and testing method, which effectively solve the technical problems in the prior art that the automated tools are limited to a single terminal machine, cannot implement remote control, the test results of the use cases cannot be automatically corresponding to the use cases, and the test results of the use cases cannot be integrated into a unified report. The main defect of the technology is that the problem that parameters and parameter transmission sharing are required to be mutually transmitted when the mutual calling among different types of test cases is not solved, for example, the case steps comprise UI (user interface) test, interface test, performance test, mobile terminal test and the like, and the complexity of the current tested scene cannot be met by the scheme.
A Chinese patent with publication number CN103577907A provides a continuous integration test method and system, which mainly solves the problem that continuous integration projects simultaneously monitor the target to be tested running in each real environment; when detecting that a target to be detected running in a certain real environment reaches a preset condition, acquiring an environment identifier corresponding to the real environment where the target to be detected runs; calling a test case by sending a test command, wherein the test command comprises an environment identifier; configuring a corresponding test environment by the test case according to the environment identifier; and executing the test script in the test case in the test environment, and acquiring a final test result. The system provides support for testing the whole process, and provides no effective solution for supporting various use cases, and the inductive analysis of the test result has no practical solution.
In addition, Chinese patent with publication number CN106201882A provides an automatic test method and system for an operating system based on Jenkins, and the method is characterized in that a Jenkins test tool and a robotframe frame are set up in a server in advance; acquiring real-time installation information of an operating system in a target test end; when the real-time installation information of the operating system shows that the corresponding operating system is installed at the target test end, calling a script file which is written by a server end in advance by running a test task constructed by a Jenkins test tool so as to execute a test case which is written by a Ride tool in a robot frame in advance, and obtaining a corresponding operating system test result. The technology mainly solves the problems that a solution is provided for an operation mode in software testing, a solution for sequencing use cases, scene fusion and sharing of test data of multiple platforms is lacked, wherein the explanation is only limited to a method for solving problems in the existing robot frame framework, and the method can not provide support for multiple types of test cases.
Disclosure of Invention
In view of the above, the invention provides an automated test system based on a node type, which can solve the problem of mutual calling among different types of test cases, the steps of the cases can be composed of UI test, interface test, performance test and mobile terminal test, and parameters can be mutually transferred, so as to accomplish the mutual calling among the cases without distinguishing the types and the parameter transfer sharing.
An automated test system based on a node, comprising:
the login module is used for providing functions of user login verification and authority verification;
the test case module is responsible for managing cases by a user, namely acquiring case information from the file server, appointing the type of an executing node machine according to the type of the case, compiling and designing a test strategy formed by combining the required cases according to the test points;
the test strategy module is used for adding the test strategy completed by the test case combination into test data, arranging the sequence of execution, configuring a strategy group of which the business logic needs to be repeatedly executed, and forming an executable test plan for calling the test plan;
the test plan module is used for customizing an execution mode for the combined test strategy, putting the strategy triggered and executed manually by a user into a manual execution queue, appointing a trigger condition for the strategy triggered and executed automatically, and customizing an execution plan table for the strategy executed regularly so as to finish the definition of the automatic test;
the report module is used for summarizing and analyzing the test results to form a test report;
the configuration module is used for testing basic environment configuration, including supporting software information, testing architecture information and testing software information in the node machines, after the complete information of the node machines is configured, selecting a corresponding testing type to automatically copy the node machines when a new tested system is added to complete rapid addition of the node machines, rapidly adding a testing queue and completing support of a testing task;
the scheduling module is used for providing an interface for the test plan module, receiving test plan information sent by the test plan module, analyzing the types of the test cases, issuing the test cases of different types to the corresponding test node machines, receiving information responded by the test node machines, generating an execution parameter list, sharing parameters required by the test cases of different types, coordinating the sequence of the execution of the cases, and coordinating the execution of the different cases executed on the different node machines according to the sequence of the test plans;
and the test report module is used for summarizing and analyzing the test reports reported by the scheduling module according to the test execution.
Further, the specific implementation scheme of the login module is as follows: storing the user account in a database in a symmetric encryption mode, and storing the password in an asymmetric encryption mode; the method comprises the steps that different user groups are divided, authorities are distributed according to information of the user groups, the users belong to the user groups, one user can belong to a plurality of groups, the authorities of the plurality of groups of one user are removed and then are the final authorities of the user, an authentication character string is generated after the user is authenticated and is stored in a cache, the validity period is 30 minutes, and the last operation in the validity period enables the validity period to be reset to be 30 minutes after the last operation is started and is expired.
Furthermore, the test cases belong to a test strategy, the parameter transmission among the cases is to write the output of the previous case into a cache server, the output is uniquely distinguished by a test serial number and a strategy number, and the subsequent test cases need to be obtained and used according to the test serial number and the strategy number.
Further, the report module writes test result data into a database after the test execution is finished, and then forms a test report HTML document from the database according to the data of the test in the form of the module, the input, the actual result and the expected result, stores the test report HTML document into a report catalogue, and sends the test report HTML document to the personnel in the user group and the trigger executive personnel through mails.
Further, the configuration module stores the information into a configuration file in a file server, downloads configuration file information in a machine when a new node machine is deployed, determines supporting software required by the node machine item by item according to the configuration file, generates parameters of the corresponding supporting software according to the configuration file information, and starts a monitoring program to complete service configuration of the node machine so as to enable the node machine to be added into a service queue.
Furthermore, the scheduling module monitors the running state of the node during test execution through the link information in the test process, and after the test case execution is finished, a case step execution process document is formed and is put into a test report; the scheduling module provides a registration interface of the node machine, a tcp/ip protocol is adopted, the node machine starts a monitoring service and registers information to the scheduling module, the scheduling module periodically detects the working state of the node machine, the normal node machine provides a test plan module for calling, and the abnormal node machine sends abnormal information of the node machine to an administrator to remind the administrator to troubleshoot faults, so that the node machine solving the faults is added into an execution queue again.
Furthermore, the test report module generates a test report by comparing expected results of the case, including testing input data, execution process, actual output data, information of comparison with the expected results, machine conditions (such as CPU, GPU, memory, I/O use conditions) in the test process, and network flow information of each step, further summarizing the digitized information into a report, drawing an information curve graph in the process, generating an HTML-type test report, simultaneously acquiring user group information to which the test plan belongs, and sending a test report mail to members in the group to complete one-time test.
The invention publishes different test stages to different machines for testing, simultaneously can support that test cases on different machines can be executed coordinately, judges the output corresponding to the test input to be compared and matched with an expected result to complete the test, outputs a test report to a central server for summary analysis to form a complete test, generates the test report and sends the test report to related personnel.
Aiming at the characteristics of the current stage service, the invention solves the difficulty of software testing, realizes a set of device system for omnibearing software automatic testing, can uninterruptedly and automatically complete the test of the whole service flow, generates a report in time, informs related personnel of a test result, monitors the quality of project software in an omnibearing manner, shortens the test time, reduces misoperation or omission of personnel in the test process, increases the test depth and improves the project quality.
Drawings
FIG. 1 is a schematic diagram of a testing process of the automatic testing system of the present invention.
Fig. 2 is a schematic diagram of an application scenario of the system of the present invention.
Detailed Description
In order to more specifically describe the present invention, the following detailed description is provided for the technical solution of the present invention with reference to the accompanying drawings and the specific embodiments.
The automatic test system comprises the following parts:
(1) interface layer: the user operates an interface.
1.1 case management: and (3) placing the test cases in a file server (the file server can select FTP, SVN and GIT, and the example system selects SVN as the file server), triggering a case correlation module when a case is updated, scanning files in the file server, correlating case information in the file server to an automatic node machine test platform system, and finishing the storage of the case.
1.2 customizing the test plan: the test system adopts the B/S mode to realize the interface management, combines the existing test cases in the system, customizes parameters, edits execution sequence, defines parallel and serial modules, forms a test strategy and stores the test strategy in the system. The test strategy is combined according to the actual business process, an execution mode and execution time are designated and stored as a test plan list, and the system executes the test tasks in the test plan list according to the designated mode.
1.3 test configuration: configuring available use case execution machines-test node machines, wherein the node machines consist of different operating systems, the node machine for carrying out UI test by load is WINDOWS, the node machine for carrying out interface test and performance test by load is CENTOS, the node machine for carrying out ANDROID mobile terminal equipment management is UBUNTU system, the node machine for carrying out IOS mobile terminal equipment management is MACOS system, and the available node machine information is configured into the system for calling the test cases according to different test types.
(2) A data exchange layer: control information exchange and use case data exchange.
The dispatching module is responsible for controlling information exchange, when a tester triggers or a timer triggers to execute a test plan, the management system calls the interface of the dispatching module to trigger a test by using an HTTP protocol, and the dispatching module is connected with the test node machine by using a TCP/IP protocol to execute the test plan. The scheduling module comprises a standard HTTP protocol interface and is responsible for receiving external execution instructions and calling the system HTTP interface to return test results by using an HTTP method. The monitoring module in the node machine is responsible for real-time monitoring, receives the execution instruction sent by the scheduling module, and after receiving the execution instruction, the node machine executes the instruction one by one to complete the test task and waits for the next test task. The data exchange between the node machine and the file server is to obtain files through file obtaining commands provided by the file server, and the files are stored in a local disk for being called by test tasks. The node machine does not upload files, deletes the last-time left files in the directory and downloads the latest use case files from the file server during each execution, and therefore instantaneity of use case updating is guaranteed.
(3) An interconnection layer: the system is interconnected with the scheduling module, and the scheduling module is interconnected with the node machine.
Interconnection of the system and the scheduling module: the system adopts a B/S framework, the system and the scheduling module are interconnected by adopting a standard http protocol interface, and the sending and receiving of the information are completed by calling the http interface.
Interconnection between the scheduling module and the node machine: the method comprises the following steps that (1) interconnection is carried out by adopting a TCP/IP protocol, a node machine monitoring program is kept connected with a scheduling module, a test instruction sent by the scheduling module is received, the test instruction is converted into a command executable by a local machine, the command executable by the local machine is executed one by one, and a test result is responded to the scheduling module to complete a test task; the interconnection between the node machine and the file server is realized by SVN command, FTP command or GIT command.
The specific implementation flow of the invention is shown in fig. 1, a user uploads a test case to a file server, an automatic node machine test platform goes to the file server to obtain case information as a user test strategy alternative set, and the user screens and arranges the test case according to test requirements to form a test strategy and store the test strategy; selecting a strategy for execution by a user, selecting an applicable node machine according to the type of a first case, triggering the node machine to execute a case plan, downloading a test case by the node machine according to the strategy, executing the test case, and reporting a test result; after the first case is executed, triggering the next node machine to serve as a second test case according to a strategy, and after all cases are executed, sending a test report to the members of the group and the personnel triggering execution by the automatic node machine test platform in a mail mode; the implementation details of each link are as follows:
(1) a node machine:
the node machines are environment machines for executing the test cases, support (interface, UI, performance and safety test) is provided for the execution of the test cases, and at least one node machine is tested in each type, so that the test execution is not influenced; the initialization environment of the node machine is completed by a configuration module; initializing a node machine, and restoring the test environment to an initial state for executing a test case; the node machines need to open monitoring service and receive a test platform instruction; and sending a plurality of instructions to the node machine for queuing, wherein the queue adopts a first-in first-out principle.
(2) And (3) case storage:
the test case is stored in a file in a mode that one file stores one test function case; uploading and storing the automatic test cases to an SVN, obtaining names of the automatic test cases from an SVN directory by an automatic node machine test platform, comparing the names with information stored in a database, adding newly-added cases into the database, and setting the states of the deleted cases in records of the database as deleted; the test case list in the database is provided for the test strategy to be selected.
(3) And (3) test report:
after the execution of one node machine is completed, transmitting a test report to a sharing designated position in an xml mode; asynchronously starting a test report analysis program, acquiring concise information and recording the concise information to the test step; and (4) integrating the reports after all the use cases in one strategy are executed, forming a test report HTML, and storing the test report HTML to a specified position.
(4) Sending a test report:
after receiving a signal of completing the execution of the test strategy, the test platform of the automatic node machine acquires personnel associated with the strategy and personnel triggering the test, and forms a mail receiver list; and the mail content loads the test report generated after analysis and sends the test report to a mail receiver list.
(5) Monitoring service of the node machine:
the node machine uses the port to monitor, uses the signature verification mode to receive the request sent by the trusty host, decrypts the character string after receiving the operation instruction character string of the host, uses the keyword image server to inquire the concrete execution content, downloads the execution content to the local, executes the test task item by item according to the test strategy in the execution content, and reports the execution result to the host after the completion.
When the test task involves a plurality of different types of tests, each node machine analyzes and completes the task which is currently executed by the node to which the node belongs according to the test strategy acquired from the host machine to perform execution processing, and reports the execution result to the host machine. When the specified parameters need to be returned after the node machine completes the operation in the test strategy, the returned parameters are reported to the test host together when the test is completed, so that the test host generates the test precondition required by the next execution in the test strategy. The direct connection with the host adopts the interactive short link, so that the connection burden of the host is reduced, the host can drive more node machines, the node machines can execute test tasks together, and the node machines can complete the test tasks called by different types of test tasks in a cooperative mode.
(6) Mutual trust is used between the node machine and the host machine:
when the server is started, an MAC inquiry interface is provided, and mutual trust is established between the node machine and the host machine by using a monitoring program to start the server which requests the node machine to generate a signature character string by using an MD5 algorithm by using the MAC address + the connection identifier of the node machine and reporting the signature character string to the server.
(7) Distributing a test strategy:
the testing personnel combines the test cases into the test cases according to the test points, and the test cases comprise functional interface function point test, interface data test, performance test and safety scanning; one test strategy comprises interface data input, clicking, responding to page verification, sending data by taking the response data as interface test, triggering the interface test and verifying the interface response data.
(8) The file access mode:
using a case template: the components required by the interface test are stored in a database, the user selects the components required by the test through a case writing page, the components are well arranged according to the sequence of the test logic, and the expected test logic is realized. The parameters needed in the components are opened outwards by adding one or more input parameters, and one or more output parameters can be added for other components to call; and storing the compiled use case file into a file server, and recording the stored file position and the file name in a database for compiling and calling the test strategy.
(9) Storing the test strategy:
after the tester stores the written test cases, different test cases are combined to form a test strategy according to the requirements of the service flow, and the test strategy is stored in a database, and the test strategies of the test service are distinguished by different names. The test strategy can be a single use case or a combination of a plurality of use cases. The test strategy can be executed in a plurality of batches, can also be executed at a specified time according to the preset of a tester, and can also be executed under a specified trigger condition, for example, the execution is started in a business scene.
(10) And (3) test report:
after each test case is finished, generating a test report, uploading the test report to a file server, and storing a report address and a report name in a database; and after one test strategy is finished, synthesizing the test reports generated by the test, analyzing the test reports to form an integral test report, uploading the integral test report to a file server, and storing the test report name and the file path in a database.
(11) Test notification mail:
acquiring a trigger tester as an addressee, loading a project group in project configuration as a copying worker, and taking a test strategy as a mail title; the attachment is a test report formed after the obtained test strategy is executed, the mail content is a case name passed by the test execution and a failed case name, and the detailed steps of the failed case are listed for the analysis of a tester.
Taking the system application scenario shown in fig. 2 as an example, the implementation process of the system of the present invention is further explained by the following four cases:
case 1:
and compiling a UI test case 1, a UI test case 2, a UI test case 3, a UI test case 4, a UI test case 5 and a UI test case 6, and uploading the UI test cases to a file server.
And the automatic node machine test platform compiles a test strategy 1, executes a UI test case 2 in the strategy 1, then executes the UI test case 1, then executes a UI test case 6 and stores the UI test case.
And setting a test strategy 1 to operate, optionally immediately operating once at specified time, and operating for multiple times at specified time intervals.
And the automatic node machine test platform receives the execution strategy instruction and issues the UI test case 2, the UI test case 1 and the UI test case 6 to the UI test node machine, the automatic node machine test platform triggers the UI node machine according to the requirement of the strategy 1, tests are executed according to the sequence of the UI test case 2, the UI test case 1 and the UI test case 6, and test results are stored to a designated position.
After the execution is finished, the automatic node machine testing platform judges that all tests are finished, obtains a testing result, analyzes the testing report and arranges the testing report into an HTML document, and according to the mail list, the contents of the HTML document generated by the automatic node machine testing platform are switched in and sent to a list person and a person triggering the execution.
Case 2:
and compiling a UI test case 1, an interface test case 2, a performance test case 3, an interface test case 4, a UI test case 5 and a compatibility test case 6, and uploading the UI test case, the interface test case and the compatibility test case to a file server.
The automatic node machine test platform compiles a test strategy 2, executes a UI test case 1, an interface test case 2, a performance test case 3, an interface test case 4, a UI test case 5 and a compatibility test case 6 in the strategy 2, and stores the UI test case, the performance test case 3, the interface test case 4, the UI test case 5 and the compatibility test case 6.
And setting a test strategy 2 to operate, optionally immediately operating once at specified time, and operating for multiple times at specified time intervals.
The automatic node machine test platform receives the requirement of the execution strategy 2, issues the UI test case 2, the UI test case 1 and the UI test case 5 to the UI test node machine, issues the interface test case 2 and the interface test case 4 to the interface test node machine, issues the performance test case 3 to the performance test node machine and issues the compatibility test case 6 to the performance test node machine.
And the automatic node machine test platform triggers the UI test node machine to execute the UI test case 1 according to the requirement of the strategy 2, stores the test result to a specified position, and informs the automatic node machine test platform that the UI test case 1 is executed.
After receiving the completion notification, the automatic node machine test platform triggers the interface test node sending machine to execute the interface test case 2 according to the requirement of the strategy 2, stores the test result to a specified position, and notifies the automatic node machine test platform that the execution of the interface test case 2 is completed.
After receiving the completion notification, the test platform of the automatic node machine triggers the performance test node sending machine to execute the performance test case 3 according to the requirement of the strategy 2, stores the test result to a specified position, and notifies the test platform of the automatic node machine that the execution of the test case 3 is completed.
After receiving the completion notification, the automatic node machine test platform triggers the interface test node sending machine to execute the interface test case 4 according to the requirement of the strategy 2, stores the test result to a specified position, and notifies the automatic node machine test platform that the execution of the interface test case 4 is completed.
After receiving the completion notification, the automatic node machine test platform triggers the UI test node sending machine to execute the UI test case 5 according to the requirement of the strategy 2, stores the test result to the designated position, and notifies the automatic node machine test platform that the UI test case 5 is executed.
After receiving the completion notification, the automatic node machine test platform triggers the compatibility test node sending machine to execute the compatibility test case 6 according to the requirement of the strategy 2, stores the test result to a specified position, and notifies the automatic node machine test platform that the execution of the compatibility test case 6 is completed.
After the execution is finished, the automatic node machine testing platform judges that all tests are finished, obtains a testing result, analyzes the testing report and arranges the testing report into an HTML document, and according to the mail list, the contents of the HTML document generated by the automatic node machine testing platform are switched in and sent to a list person and a person triggering the execution.
Case 3:
the present case introduces a node type mobile automation test solution, firstly, a mobile application program data processing script is compiled and integrated into a platform as a plug-in for general data acquisition and aggregation analysis in the execution process of a mobile automation test case. The plug-in is mainly responsible for collecting information of a mobile application program CPU, an internal memory, power consumption, log stack and the like in the test execution process, and performing aggregation analysis by associating the execution actions of the mobile automation test case after the test is finished, and finally providing a visual and comprehensive mobile application program automation test analysis report for a user through the front end of the test platform of the automation node machine; the method mainly comprises the following steps:
1. compiling a mobile automation test case and uploading the mobile automation test case to a file server;
2. the test strategy 3 is compiled by the test platform of the automatic node machine, an automatic test case is executed in the strategy 3, and the strategy is stored;
3. setting a test strategy 3 to operate, optionally operating immediately, operating once at a specified time, and operating for multiple times at specified time intervals;
4. the automatic node machine test platform receives the requirement of an execution strategy 3 and issues an automatic test case and a mobile data monitoring script to a UI test node machine;
5. the automatic node machine test platform triggers the automatic test node machine to execute the test case according to the requirement of the strategy 3, calls a mobile application program data monitoring script at the same time when the test is started, monitors data such as a CPU, a memory, power consumption, flow and logs of the mobile application program in the test process, aggregates and associates the execution result of the mobile application program test case and stack log report error information generated by program operation to a specific test case after the test is finished, and informs the automatic node machine test platform UI that the test case is executed and completed.
After the execution is finished, the automatic node machine testing platform judges that all tests are finished, a test case execution result is obtained, an application program data log aggregation result is arranged into an HTML document, and the automatic node machine testing platform cuts in and sends the generated HTML document to a list person and a person triggering execution according to the mail list and the content.
Case 4:
a node type mobile compatibility test solution is introduced, firstly, a mobile equipment control processing script is compiled, the main function is to search a test mobile phone connected to an automatic node machine when a compatibility test task is started by the automatic node machine test platform, then a test mobile phone group is called in a multithreading mode to execute a test case and monitor the test progress, a result is output to the automatic node machine test platform after the execution of the test case is completed, the script can be integrated into the automatic node machine test platform as a universal compatibility test plug-in, all that a user needs to do is to compile the compatibility test case according to own requirements, for example, an app is installed on each test mobile phone, then UI pages are traversed, and screenshots are stored on each page. The automatic node machine test platform is responsible for scheduling and controlling a test execution process, a user is responsible for defining test contents, and finally a test result is reported to the automatic node machine test platform server after the test is finished and a visual and comprehensive mobile application program compatibility test analysis report is provided for the user through the front end of the automatic node machine test platform; the method mainly comprises the following steps:
1. compiling a compatibility test case and uploading the compatibility test case to a file server;
2. the automatic node machine test platform compiles a test strategy 3, and a compatibility test case is executed in the strategy 3;
3. the automated node machine test platform receives the requirement of an execution strategy 3 and issues a compatibility test case and a mobile equipment control processing script to the compatibility test node machine;
4. and triggering the compatibility test node machine by the automatic node machine test platform according to the requirement of the strategy 3 to start a mobile equipment control processing script, calling and executing a compatibility test case by the script, sending information generated by screenshot and a test execution result to a server after the test is finished, informing the automatic node machine test platform that the compatibility test case is executed, and switching the generated HTML document into and sending the HTML document to a list person and a person triggering the execution by the automatic node machine test platform according to a mail list and the content after the execution is finished.
The embodiments described above are presented to enable a person having ordinary skill in the art to make and use the invention. It will be readily apparent to those skilled in the art that various modifications to the above-described embodiments may be made, and the generic principles defined herein may be applied to other embodiments without the use of inventive faculty. Therefore, the present invention is not limited to the above embodiments, and those skilled in the art should make improvements and modifications to the present invention based on the disclosure of the present invention within the protection scope of the present invention.
Claims (8)
1. An automated test system based on a node formula, comprising:
the login module is used for providing functions of user login verification and authority verification;
the test case module is responsible for managing cases by a user, namely acquiring case information from the file server, appointing the type of an executing node machine according to the type of the case, compiling and designing a test strategy formed by combining the required cases according to the test points;
the test strategy module is used for adding the test strategy completed by the test case combination into test data, arranging the sequence of execution, configuring a strategy group of which the business logic needs to be repeatedly executed, and forming an executable test plan for calling the test plan;
the test plan module is used for customizing an execution mode for the combined test strategy, putting the strategy triggered and executed manually by a user into a manual execution queue, appointing a trigger condition for the strategy triggered and executed automatically, and customizing an execution plan table for the strategy executed regularly so as to finish the definition of the automatic test;
the report module is used for summarizing and analyzing the test results to form a test report;
the configuration module is used for testing basic environment configuration, including supporting software information, testing architecture information and testing software information in the node machines, after the complete information of the node machines is configured, selecting a corresponding testing type to automatically copy the node machines when a new tested system is added to complete rapid addition of the node machines, rapidly adding a testing queue and completing support of a testing task;
the scheduling module is used for providing an interface for the test plan module, receiving test plan information sent by the test plan module, analyzing the types of the test cases, issuing the test cases of different types to the corresponding test node machines, receiving information responded by the test node machines, generating an execution parameter list, sharing parameters required by the test cases of different types, coordinating the sequence of the execution of the cases, and coordinating the execution of the different cases executed on the different node machines according to the sequence of the test plans;
and the test report module is used for summarizing and analyzing the test reports reported by the scheduling module according to the test execution.
2. The automated test system of claim 1, wherein: the specific implementation scheme of the login module is as follows: storing the user account in a database in a symmetric encryption mode, and storing the password in an asymmetric encryption mode; the method comprises the steps that different user groups are divided, authorities are distributed according to information of the user groups, the users belong to the user groups, one user can belong to a plurality of groups, the authorities of the plurality of groups of one user are removed and then are the final authorities of the user, an authentication character string is generated after the user is authenticated and is stored in a cache, the validity period is 30 minutes, and the last operation in the validity period enables the validity period to be reset to be 30 minutes after the last operation is started and is expired.
3. The automated test system of claim 1, wherein: the test cases belong to test strategies, the parameter transmission among the cases is to write the output of the previous case into a cache server, the test serial number and the strategy number are uniquely distinguished, and the subsequent test cases need to be obtained and used according to the test serial number and the strategy number.
4. The automated test system of claim 1, wherein: and the report module writes the test result data into the database after the test execution is finished, further forms a test report HTML document from the database according to the data of the test in the modes of modules, input, actual results and expected results, stores the test report HTML document into a report catalogue, and sends the test report HTML document to the personnel in the user group and triggers the executive personnel by mails.
5. The automated test system of claim 1, wherein: the configuration module stores the information into a configuration file in a file server, downloads the configuration file information in the machine when a new node machine is deployed, determines supporting software required by the node machine item by item according to the configuration file, generates parameters of the corresponding supporting software according to the configuration file information, and starts a monitor to complete service configuration of the node machine so as to enable the node machine to be added into a service queue.
6. The automated test system of claim 1, wherein: the scheduling module monitors the running state of the node during test execution through the link information in the test process, and forms a case step execution process document and puts the case step execution process document into a test report after the test case execution is finished; the scheduling module provides a registration interface of the node machine, a tcp/ip protocol is adopted, the node machine starts a monitoring service and registers information to the scheduling module, the scheduling module periodically detects the working state of the node machine, the normal node machine provides a test plan module for calling, and the abnormal node machine sends abnormal information of the node machine to an administrator to remind the administrator to troubleshoot faults, so that the node machine solving the faults is added into an execution queue again.
7. The automated test system of claim 1, wherein: the test report module generates a test report by comparing expected results of the cases, and the test report comprises the steps of testing input data, an execution process, actual output data, information compared with the expected results, machine conditions in the test process and network flow information of each step, further summarizing digitalized information into a report, drawing an information curve graph in the process, generating an HTML-type test report, simultaneously acquiring user group information to which a test plan belongs, sending a test report mail to members in a group, and completing one test.
8. The automated test system of claim 1, wherein: the system issues different test stages to different machines for testing, can support test cases on different machines to be executed coordinately, judges output corresponding to test input to be compared and matched with an expected result to complete testing, outputs a test report to a central server for summarizing and analyzing to form a complete test, generates the test report and sends the test report to related personnel.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911082062.0A CN110928774B (en) | 2019-11-07 | 2019-11-07 | Automatic test system based on node type |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911082062.0A CN110928774B (en) | 2019-11-07 | 2019-11-07 | Automatic test system based on node type |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN110928774A true CN110928774A (en) | 2020-03-27 |
| CN110928774B CN110928774B (en) | 2023-05-05 |
Family
ID=69852557
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201911082062.0A Active CN110928774B (en) | 2019-11-07 | 2019-11-07 | Automatic test system based on node type |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110928774B (en) |
Cited By (29)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111611165A (en) * | 2020-05-22 | 2020-09-01 | 厦门理工学院 | Implementation and application of continuous integrated automatic test platform |
| CN111625404A (en) * | 2020-04-21 | 2020-09-04 | 至誉科技（武汉）有限公司 | Method for testing NVMe hard disk based on Jenkins, system storage medium and electronic equipment |
| CN111654416A (en) * | 2020-05-29 | 2020-09-11 | 北京智网信测科技有限公司 | Internet of things testing cloud platform and method |
| CN111770004A (en) * | 2020-06-26 | 2020-10-13 | 武汉众邦银行股份有限公司 | Fiddler-based HTTP (S) flow content automatic verification method and storage medium |
| CN111813676A (en) * | 2020-07-08 | 2020-10-23 | 炬星科技（深圳）有限公司 | Robot software testing method, device and storage medium |
| CN111930608A (en) * | 2020-06-30 | 2020-11-13 | 成都九洲电子信息系统股份有限公司 | Automatic testing device and method based on process control |
| CN112015661A (en) * | 2020-09-08 | 2020-12-01 | 江苏云柜网络技术有限公司 | Software testing method and device |
| CN112015654A (en) * | 2020-08-31 | 2020-12-01 | 京东数字科技控股股份有限公司 | Method and apparatus for testing |
| CN112019544A (en) * | 2020-08-28 | 2020-12-01 | 支付宝(杭州)信息技术有限公司 | Network interface security scanning method, device and system |
| CN112100011A (en) * | 2020-08-31 | 2020-12-18 | 银清科技有限公司 | Performance test method and device |
| CN112286806A (en) * | 2020-10-28 | 2021-01-29 | 成都佰维存储科技有限公司 | Automatic testing method and device, storage medium and electronic equipment |
| CN112511386A (en) * | 2020-12-09 | 2021-03-16 | 爱瑟福信息科技(上海)有限公司 | Vehicle-mounted Ethernet test method and system based on robotframe and Ethernet test equipment |
| CN112560290A (en) * | 2020-12-29 | 2021-03-26 | 中国航空工业集团公司沈阳飞机设计研究所 | Automatic testing method and system based on countermeasure simulation platform |
| CN112783780A (en) * | 2021-01-28 | 2021-05-11 | 开放智能机器（上海）有限公司 | Automatic testing method and system for multi-environment multi-platform embedded system |
| CN112835789A (en) * | 2021-01-15 | 2021-05-25 | 北京高因科技有限公司 | Realization technology for automatic test of automatic test framework |
| CN113051155A (en) * | 2021-03-11 | 2021-06-29 | 中国信息通信研究院 | Control system and control method of automatic test platform |
| CN113568791A (en) * | 2021-07-14 | 2021-10-29 | 麒麟软件有限公司 | Automatic testing tool and method for server operating system based on multi-CPU architecture |
| CN113568842A (en) * | 2021-08-19 | 2021-10-29 | 北京江融信科技有限公司 | Automatic testing method and system for batch tasks |
| CN114629832A (en) * | 2022-03-17 | 2022-06-14 | 广州超云科技有限公司 | Remote automatic test method, system, electronic equipment and storage medium |
| WO2022179363A1 (en) * | 2021-02-26 | 2022-09-01 | 华为云计算技术有限公司 | Application programming interface (api) testing method and device |
| CN115269358A (en) * | 2022-09-30 | 2022-11-01 | 中国信息通信研究院 | Performance test method, device, equipment and medium for block chain service node host |
| CN115454815A (en) * | 2022-08-12 | 2022-12-09 | 广州极点三维信息科技有限公司 | Automatic test system supporting customized test task |
| CN115941719A (en) * | 2022-10-17 | 2023-04-07 | 北京空间飞行器总体设计部 | Global real-time sharing system and method for spacecraft test case execution information |
| CN116185881A (en) * | 2023-04-27 | 2023-05-30 | 杭州城市大数据运营有限公司 | Source system page change detection positioning method, device, equipment and storage medium |
| CN116225944A (en) * | 2023-03-09 | 2023-06-06 | 矩阵时光数字科技有限公司 | Software testing system and method for presetting networking environment |
| CN117076329A (en) * | 2023-10-12 | 2023-11-17 | 浙江云融创新科技有限公司 | Method and system for concurrent execution of use cases in service mutex state |
| CN117421153A (en) * | 2023-11-09 | 2024-01-19 | 哈尔滨市科佳通用机电股份有限公司 | Automatic testing system and method for railway wagon fault image recognition model |
| CN117520210A (en) * | 2024-01-05 | 2024-02-06 | 芯瞳半导体技术(山东)有限公司 | System software testing method, target machine and remote testing central control machine |
| CN116225944B (en) * | 2023-03-09 | 2024-05-07 | 矩阵时光数字科技有限公司 | Software testing system and method for presetting networking environment |
Citations (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20090199047A1 (en) * | 2008-01-31 | 2009-08-06 | Yahoo! Inc. | Executing software performance test jobs in a clustered system |
| CN101727389A (en) * | 2009-11-23 | 2010-06-09 | 中兴通讯股份有限公司 | Automatic test system and method of distributed integrated service |
| US20110150189A1 (en) * | 2009-12-22 | 2011-06-23 | Cyara Solutions Pty Ltd | Integrated testing platform for contact centres |
| CN102495799A (en) * | 2011-12-02 | 2012-06-13 | 刘伟 | Automatic test system and method of movable terminal |
| CN102932205A (en) * | 2012-11-19 | 2013-02-13 | 深圳市亚特尔科技有限公司 | Automatic test method and test platform of network server-side interface |
| CN104407971A (en) * | 2014-11-18 | 2015-03-11 | 中国电子科技集团公司第十研究所 | Method for automatically testing embedded software |
| CN104899134A (en) * | 2015-04-29 | 2015-09-09 | 中国互联网络信息中心 | Automatic domain name registration server testing system and method |
| CN107423211A (en) * | 2017-03-15 | 2017-12-01 | 中国互联网络信息中心 | A kind of SDNS interfaces automatization test system and method |
| CN107643981A (en) * | 2017-08-29 | 2018-01-30 | 顺丰科技有限公司 | A kind of automatic test platform and operation method of polynary operation flow |
| CN108132879A (en) * | 2017-12-21 | 2018-06-08 | 周舟 | Automated software testing method, platform, terminal and medium |
| CN109614310A (en) * | 2018-10-22 | 2019-04-12 | 中国平安财产保险股份有限公司 | Management method, device, computer equipment and the storage medium of test interface |
| US20190243750A1 (en) * | 2018-02-02 | 2019-08-08 | Jpmorgan Chase Bank, N.A. | Test reuse exchange and automation system and method |
-
2019
- 2019-11-07 CN CN201911082062.0A patent/CN110928774B/en active Active
Patent Citations (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20090199047A1 (en) * | 2008-01-31 | 2009-08-06 | Yahoo! Inc. | Executing software performance test jobs in a clustered system |
| CN101727389A (en) * | 2009-11-23 | 2010-06-09 | 中兴通讯股份有限公司 | Automatic test system and method of distributed integrated service |
| US20110150189A1 (en) * | 2009-12-22 | 2011-06-23 | Cyara Solutions Pty Ltd | Integrated testing platform for contact centres |
| CN102495799A (en) * | 2011-12-02 | 2012-06-13 | 刘伟 | Automatic test system and method of movable terminal |
| CN102932205A (en) * | 2012-11-19 | 2013-02-13 | 深圳市亚特尔科技有限公司 | Automatic test method and test platform of network server-side interface |
| CN104407971A (en) * | 2014-11-18 | 2015-03-11 | 中国电子科技集团公司第十研究所 | Method for automatically testing embedded software |
| CN104899134A (en) * | 2015-04-29 | 2015-09-09 | 中国互联网络信息中心 | Automatic domain name registration server testing system and method |
| CN107423211A (en) * | 2017-03-15 | 2017-12-01 | 中国互联网络信息中心 | A kind of SDNS interfaces automatization test system and method |
| CN107643981A (en) * | 2017-08-29 | 2018-01-30 | 顺丰科技有限公司 | A kind of automatic test platform and operation method of polynary operation flow |
| CN108132879A (en) * | 2017-12-21 | 2018-06-08 | 周舟 | Automated software testing method, platform, terminal and medium |
| US20190243750A1 (en) * | 2018-02-02 | 2019-08-08 | Jpmorgan Chase Bank, N.A. | Test reuse exchange and automation system and method |
| CN109614310A (en) * | 2018-10-22 | 2019-04-12 | 中国平安财产保险股份有限公司 | Management method, device, computer equipment and the storage medium of test interface |
Non-Patent Citations (2)
| Title |
|---|
| 刘海峰;: "自动化测试技术在联通cBSS计费系统中的应用", 数字通信世界 * |
| 叶波;孙俊若;林洁;: "软件接口自动化测试技术研究与实现", 信息化研究 * |
Cited By (39)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111625404A (en) * | 2020-04-21 | 2020-09-04 | 至誉科技（武汉）有限公司 | Method for testing NVMe hard disk based on Jenkins, system storage medium and electronic equipment |
| CN111625404B (en) * | 2020-04-21 | 2023-06-30 | 至誉科技（武汉）有限公司 | Method, system storage medium and electronic equipment for testing NVMe hard disk based on Jenkins |
| CN111611165B (en) * | 2020-05-22 | 2023-04-07 | 厦门理工学院 | Implementation and application of continuous integrated automatic test platform |
| CN111611165A (en) * | 2020-05-22 | 2020-09-01 | 厦门理工学院 | Implementation and application of continuous integrated automatic test platform |
| CN111654416A (en) * | 2020-05-29 | 2020-09-11 | 北京智网信测科技有限公司 | Internet of things testing cloud platform and method |
| CN111770004A (en) * | 2020-06-26 | 2020-10-13 | 武汉众邦银行股份有限公司 | Fiddler-based HTTP (S) flow content automatic verification method and storage medium |
| CN111930608A (en) * | 2020-06-30 | 2020-11-13 | 成都九洲电子信息系统股份有限公司 | Automatic testing device and method based on process control |
| CN111813676A (en) * | 2020-07-08 | 2020-10-23 | 炬星科技（深圳）有限公司 | Robot software testing method, device and storage medium |
| CN112019544B (en) * | 2020-08-28 | 2022-10-11 | 支付宝(杭州)信息技术有限公司 | Network interface security scanning method, device and system |
| CN112019544A (en) * | 2020-08-28 | 2020-12-01 | 支付宝(杭州)信息技术有限公司 | Network interface security scanning method, device and system |
| CN112100011A (en) * | 2020-08-31 | 2020-12-18 | 银清科技有限公司 | Performance test method and device |
| CN112015654A (en) * | 2020-08-31 | 2020-12-01 | 京东数字科技控股股份有限公司 | Method and apparatus for testing |
| CN112015661A (en) * | 2020-09-08 | 2020-12-01 | 江苏云柜网络技术有限公司 | Software testing method and device |
| CN112015661B (en) * | 2020-09-08 | 2023-10-03 | 南京云柜网络科技有限公司 | Software testing method and device |
| CN112286806A (en) * | 2020-10-28 | 2021-01-29 | 成都佰维存储科技有限公司 | Automatic testing method and device, storage medium and electronic equipment |
| CN112286806B (en) * | 2020-10-28 | 2023-10-03 | 成都佰维存储科技有限公司 | Automatic test method and device, storage medium and electronic equipment |
| CN112511386A (en) * | 2020-12-09 | 2021-03-16 | 爱瑟福信息科技(上海)有限公司 | Vehicle-mounted Ethernet test method and system based on robotframe and Ethernet test equipment |
| CN112560290A (en) * | 2020-12-29 | 2021-03-26 | 中国航空工业集团公司沈阳飞机设计研究所 | Automatic testing method and system based on countermeasure simulation platform |
| CN112835789A (en) * | 2021-01-15 | 2021-05-25 | 北京高因科技有限公司 | Realization technology for automatic test of automatic test framework |
| CN112783780A (en) * | 2021-01-28 | 2021-05-11 | 开放智能机器（上海）有限公司 | Automatic testing method and system for multi-environment multi-platform embedded system |
| WO2022179363A1 (en) * | 2021-02-26 | 2022-09-01 | 华为云计算技术有限公司 | Application programming interface (api) testing method and device |
| CN113051155A (en) * | 2021-03-11 | 2021-06-29 | 中国信息通信研究院 | Control system and control method of automatic test platform |
| CN113568791A (en) * | 2021-07-14 | 2021-10-29 | 麒麟软件有限公司 | Automatic testing tool and method for server operating system based on multi-CPU architecture |
| CN113568842B (en) * | 2021-08-19 | 2022-03-04 | 北京江融信科技有限公司 | Automatic testing method and system for batch tasks |
| CN113568842A (en) * | 2021-08-19 | 2021-10-29 | 北京江融信科技有限公司 | Automatic testing method and system for batch tasks |
| CN114629832A (en) * | 2022-03-17 | 2022-06-14 | 广州超云科技有限公司 | Remote automatic test method, system, electronic equipment and storage medium |
| CN115454815A (en) * | 2022-08-12 | 2022-12-09 | 广州极点三维信息科技有限公司 | Automatic test system supporting customized test task |
| CN115454815B (en) * | 2022-08-12 | 2023-09-26 | 广州极点三维信息科技有限公司 | Automatic test system supporting customized test tasks |
| CN115269358A (en) * | 2022-09-30 | 2022-11-01 | 中国信息通信研究院 | Performance test method, device, equipment and medium for block chain service node host |
| CN115941719B (en) * | 2022-10-17 | 2024-04-02 | 北京空间飞行器总体设计部 | Global real-time sharing system and method for spacecraft test case execution information |
| CN115941719A (en) * | 2022-10-17 | 2023-04-07 | 北京空间飞行器总体设计部 | Global real-time sharing system and method for spacecraft test case execution information |
| CN116225944A (en) * | 2023-03-09 | 2023-06-06 | 矩阵时光数字科技有限公司 | Software testing system and method for presetting networking environment |
| CN116225944B (en) * | 2023-03-09 | 2024-05-07 | 矩阵时光数字科技有限公司 | Software testing system and method for presetting networking environment |
| CN116185881A (en) * | 2023-04-27 | 2023-05-30 | 杭州城市大数据运营有限公司 | Source system page change detection positioning method, device, equipment and storage medium |
| CN117076329A (en) * | 2023-10-12 | 2023-11-17 | 浙江云融创新科技有限公司 | Method and system for concurrent execution of use cases in service mutex state |
| CN117076329B (en) * | 2023-10-12 | 2024-01-30 | 浙江云融创新科技有限公司 | Method and system for concurrent execution of use cases in service mutex state |
| CN117421153A (en) * | 2023-11-09 | 2024-01-19 | 哈尔滨市科佳通用机电股份有限公司 | Automatic testing system and method for railway wagon fault image recognition model |
| CN117520210A (en) * | 2024-01-05 | 2024-02-06 | 芯瞳半导体技术(山东)有限公司 | System software testing method, target machine and remote testing central control machine |
| CN117520210B (en) * | 2024-01-05 | 2024-04-16 | 芯瞳半导体技术(山东)有限公司 | System software testing method, target machine and remote testing central control machine |
Also Published As
| Publication number | Publication date |
|---|---|
| CN110928774B (en) | 2023-05-05 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110928774B (en) | Automatic test system based on node type | |
| US11652918B2 (en) | Using automatically collected device problem information to route and guide users' requests | |
| CN107291565B (en) | Operation and maintenance visual automatic operation platform and implementation method | |
| US20090307763A1 (en) | Automated Test Management System and Method | |
| US11176030B2 (en) | Conducting automated software testing using centralized controller and distributed test host servers | |
| CN111190812A (en) | Automatic test framework based on embedded equipment | |
| US10223248B2 (en) | Conducting automated software testing using centralized controller and distributed test host servers | |
| CN111130922A (en) | Airborne information safety automatic test method and test platform | |
| CN110659202A (en) | Client automatic testing method and device | |
| CN105096014A (en) | Method and system for recording work operation condition remotely | |
| CN105787300B (en) | A kind of method and system that control software uses | |
| CN112733369A (en) | Intelligent equipment maintenance method, terminal and system and electronic equipment | |
| JP6436705B2 (en) | Test execution device, test execution method, and computer program | |
| US8402125B2 (en) | Method of managing operations for administration, maintenance and operational upkeep, management entity and corresponding computer program product | |
| CN111464350B (en) | Method and system for managing heterogeneous brand network equipment | |
| JP4572093B2 (en) | System construction guide system | |
| JP6705979B2 (en) | Device setting device, device setting method, and program | |
| JP6436704B2 (en) | Test execution device, test execution method, and computer program | |
| JP6382705B2 (en) | Virtual device test apparatus, virtual device test method, and virtual device test program | |
| CN115687054A (en) | Self-adaptive test method and device based on service segmentation and restoration | |
| CN112416805A (en) | Test management cloud platform and method | |
| CN111694671B (en) | Big data component management method, device, server, electronic equipment and system | |
| CN116225944B (en) | Software testing system and method for presetting networking environment | |
| JP6353759B2 (en) | Test execution device, test execution method, and computer program | |
| CN113556269B (en) | SAP client performance test method, system, electronic equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |