CN113094267B - Test result collection method and device - Google Patents
Test result collection method and device Download PDFInfo
- Publication number
- CN113094267B CN113094267B CN202110371418.3A CN202110371418A CN113094267B CN 113094267 B CN113094267 B CN 113094267B CN 202110371418 A CN202110371418 A CN 202110371418A CN 113094267 B CN113094267 B CN 113094267B
- Authority
- CN
- China
- Prior art keywords
- test
- test result
- monitoring
- class
- monitoring class
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000012360 testing method Methods 0.000 title claims abstract description 206
- 238000000034 method Methods 0.000 title claims abstract description 61
- 238000012544 monitoring process Methods 0.000 claims abstract description 84
- 238000013507 mapping Methods 0.000 claims description 16
- 238000004590 computer program Methods 0.000 claims description 14
- 238000013515 script Methods 0.000 abstract description 23
- 230000006870 function Effects 0.000 description 18
- 238000010586 diagram Methods 0.000 description 11
- 230000008569 process Effects 0.000 description 10
- 238000011161 development Methods 0.000 description 7
- 238000012545 processing Methods 0.000 description 6
- 238000004891 communication Methods 0.000 description 4
- 238000013100 final test Methods 0.000 description 4
- 230000006399 behavior Effects 0.000 description 3
- 230000001960 triggered effect Effects 0.000 description 3
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 230000000750 progressive effect Effects 0.000 description 2
- 238000012827 research and development Methods 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 238000004088 simulation Methods 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 238000010998 test method Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/36—Preventing errors by testing or debugging software
- G06F11/3664—Environments for testing or debugging software
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/36—Preventing errors by testing or debugging software
- G06F11/3668—Software testing
- G06F11/3672—Test management
- G06F11/368—Test management for test version control, e.g. updating test cases to a new software version
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/36—Preventing errors by testing or debugging software
- G06F11/3668—Software testing
- G06F11/3672—Test management
- G06F11/3684—Test management for test design, e.g. generating new test cases
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/36—Preventing errors by testing or debugging software
- G06F11/3668—Software testing
- G06F11/3672—Test management
- G06F11/3688—Test management for test execution, e.g. scheduling of test suites
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/36—Preventing errors by testing or debugging software
- G06F11/3668—Software testing
- G06F11/3672—Test management
- G06F11/3692—Test management for test results analysis
Abstract
The invention can be used in the financial field or other fields, and provides a test result collecting method and a device, wherein the test result collecting method comprises the following steps: generating a monitoring class in the system according to the test logic corresponding to the test result to be collected; configuring monitoring parameters in the system according to the monitoring class; and collecting the test result of the system according to the monitoring class and the monitoring parameters. According to the invention, the test personnel can automatically report the operation result and collect and register the operation result in the database when the IDE executes the automatic test case, and the actual execution condition of the project case can be automatically analyzed through the connection of the script and the case relation, so that the influence of manual errors is reduced.
Description
Technical Field
The invention belongs to the technical field of big data, and particularly relates to a test result collection method and device.
Background
Automated testing, as the name suggests, automatically completes the testing work. Specifically, simulation manual testing work is achieved through some automated testing tools and the results are verified to complete the entire testing process. TestNG is a test framework in JAVA, and is a currently popular and practical automated test framework. Testers typically write and execute automated test cases of the TestNg framework with IDE tools. After execution, the case state is manually updated according to the script execution condition, and the test manager evaluates the test progress of the project mainly according to the case execution condition reported by the tester, so that the execution result of the actual case cannot be accurately known in time. The condition that the automatic test is unsuccessful but the project case passes easily occurs, and hidden danger exists for the project quality.
Disclosure of Invention
The test result collection method and device provided by the invention have the following advantages: the method belongs to the lightweight class, only needs to write a small amount of codes to realize the registration and the analysis of the logic codes of the test results, and is suitable for test teams with weak research and development capability. The deployment is simple, and the tester can complete the deployment by only submitting the tool to the git warehouse, pulling the latest code and answering the latest code in IDE configuration. The collected test results are accurate and timely, the automatic test cases are connected with the project test scenes in a hanging mode, the automatic test results directly reflect the test progress of the project, and a test manager can execute statistical logic at any time or at regular time to know the latest test conditions.
In order to solve the technical problems, the invention provides the following technical scheme:
in a first aspect, the present invention provides a test result collection method, including:
generating a monitoring class in the system according to the test logic corresponding to the test result to be collected;
configuring monitoring parameters in the system according to the monitoring class;
and collecting the test result of the system according to the monitoring class and the monitoring parameters.
In an embodiment, the generating, in the system, a listening class according to the test logic corresponding to the test result to be collected includes:
generating a monitoring class according to the test logic by using a testng tool monitor;
setting the monitoring class in a GIT version library;
and responding to a interception class pulling request of the distributed client, and sending the interception class to a plurality of distributed clients.
In one embodiment, the test results according to the listening class and the listening parameter collection system include:
and collecting the test result through the GIT version library.
In one embodiment, the test result collection method further includes:
establishing a mapping relation between the test result and the corresponding test case;
and determining the test progress according to the test result and the mapping relation.
In a second aspect, the present invention provides a test result collection device comprising:
the monitoring class generating module is used for generating a monitoring class in the system according to the test logic corresponding to the test result to be collected;
a monitoring parameter configuration module, configured to configure monitoring parameters in the system according to the monitoring class;
and the test result collection module is used for collecting the test result of the system according to the monitoring class and the monitoring parameters.
In one embodiment, the listening class generating module includes:
a monitoring class generating unit, configured to generate a monitoring class according to the test logic by using a testng tool monitor;
a monitoring class setting unit, configured to set the monitoring class in a GIT version library;
and the monitoring class sending unit is used for responding to the monitoring class pulling request of the distributed clients and sending the monitoring class to a plurality of distributed clients.
In an embodiment, the test result collection module is specifically configured to collect the test result through the GIT version library.
In one embodiment, the test result collection device further comprises:
the mapping relation establishing module is used for establishing a mapping relation between the test result and the corresponding test case;
and the test progress determining module is used for determining the test progress according to the test result and the mapping relation.
In a third aspect, the present invention provides an electronic device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, the processor implementing the steps of a test result collection method when the program is executed by the processor.
In a fourth aspect, the present invention provides a computer readable storage medium having stored thereon a computer program which, when executed by a processor, performs the steps of a test result collection method.
As can be seen from the above description, the test result collecting method and apparatus provided by the embodiments of the present invention first generate a monitoring class in a system according to a test logic corresponding to a test result to be collected; then, configuring monitoring parameters in the system according to the monitoring class; and finally, collecting the test result of the system according to the monitoring class and the monitoring parameters. Specifically, the invention has the following beneficial effects:
1. the method belongs to the lightweight class, only needs to write a small amount of codes to realize the registration and the analysis of the logic codes of the test results, and is suitable for test teams with weak research and development capability.
2. The deployment is simple, and the deployment can be completed by only submitting the tool to the git warehouse, pulling the latest code and the simple answer in IDE configuration.
3. The collected test results are accurate and timely, the automatic test cases are connected with the project test scenes in a hanging mode, the automatic test results directly reflect the test progress of the project, and a test manager can execute statistical logic at any time or at regular time to know the latest test conditions.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings that are required in the embodiments or the description of the prior art will be briefly described, and it is obvious that the drawings in the following description are some embodiments of the present invention, and other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.
FIG. 1 is a flow chart of a test result collection method according to an embodiment of the invention;
FIG. 2 is a flowchart of step 100 in a test result collection method according to an embodiment of the present invention;
FIG. 3 is a flowchart of step 300 in a test result collection method according to an embodiment of the present invention;
FIG. 4 is a flow chart of a test result collection method according to an embodiment of the invention;
FIG. 5 is a schematic diagram of a test result collection system according to an embodiment of the present invention;
FIG. 6 is a flow chart of a test result collection method in a specific application example of the present invention;
FIG. 7 is a block diagram of a test result collection device according to an embodiment of the present invention;
FIG. 8 is a block diagram illustrating the configuration of a snoop class generation module 10 according to an embodiment of the present invention;
FIG. 9 is a block diagram II of a test result collection device according to an embodiment of the present invention;
fig. 10 is a schematic structural diagram of an electronic device in an embodiment of the invention.
Detailed Description
For the purpose of making the objects, technical solutions and advantages of the embodiments of the present invention more apparent, the technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention, and it is apparent that the described embodiments are some embodiments of the present invention, but not all embodiments of the present invention. All other embodiments, which can be made by those skilled in the art based on the embodiments of the invention without making any inventive effort, are intended to be within the scope of the invention.
It will be appreciated by those skilled in the art that embodiments of the present invention may be provided as a method, system, or computer program product. Accordingly, the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present invention may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
It should be noted that the terms "comprises" and "comprising," and any variations thereof, in the description and claims of the present application and in the foregoing figures, are intended to cover a non-exclusive inclusion, such that a process, method, system, article, or apparatus that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed or inherent to such process, method, article, or apparatus.
It should be noted that, in the case of no conflict, the embodiments and features in the embodiments may be combined with each other. The present application will be described in detail below with reference to the accompanying drawings in conjunction with embodiments.
An embodiment of the present invention provides a specific implementation manner of a test result collection method, referring to fig. 1, the method specifically includes the following contents:
step 100: and generating a monitoring class in the system according to the test logic corresponding to the test result to be collected.
Related terms are first introduced:
TestNg: open source automatic test bottom layer frame
IDE (Integrated Development Environment), integrated development environment: the application program for providing the program development environment integrates a code writing function, an analysis function, a compiling function, a debugging function and other integrated development software service sets, and all software or software sets with the characteristics can be called an integrated development environment. (Eclipse software is taken as an example in this patent)
GIT: an open source distributed version control system capable of efficiently and rapidly handling very small to very large project version management
Step 100, when implemented, may refer to the testng tool listener and write a listening class program to automatically trigger registration of execution result information into the database when the automated test script is running. The monitoring program can be triggered only by configuring relevant parameters in the tested system, and a tester is not required to modify own script codes.
In addition, it will be appreciated that a class is a reference data type, similar to the basic data types byte, short, int (char), long, float, double, etc., except that it is a complex data type. Because it is data type in nature, not data, it does not exist in memory, cannot be directly manipulated, and only becomes operable when instantiated as an object. If the type of data provided in a program directly corresponds to the concept in the application, the program is easier to understand and easier to modify. A well-selected set of user-defined classes may make the procedure more compact. In addition, it can make various forms of code analysis easier. In particular, it may also make it possible for the compiler to check for illegal use of the object. The class internally encapsulates attributes and methods for manipulating its own members. A class is a definition of an object, has a behavior (behavior), which describes what an object can do and the method (method) it does, which are programs and processes that can operate on the object. It contains information about the behavior of the object including its name, attributes, methods and events. The composition of the class includes member attributes and member methods (data members and member functions). The data members of the class are also a data type and do not need to allocate memory, corresponding to the attributes of the class. The member function is used for operating each attribute of the class, and is a specific operation of the class. Whereas the listening class in step 100 refers to a class for listening to other programs.
Step 200: and configuring monitoring parameters in the system according to the monitoring class.
It should be noted that, the system in step 200 refers to a monitored system, preferably, the system may be an IDE environment (Integrated Development Environment ), which is an application program for providing a program development environment, and is a development software service set integrated with a code writing function, an analysis function, a compiling function, a debugging function, and the like, and all software or software sets having this feature may be called an integrated development environment.
Step 300: and collecting the test result of the system according to the monitoring class and the monitoring parameters.
Specifically, when the test result of the tested system is generated, the monitoring parameters in step 300 are started, and the monitoring class collects the test result at this time, so as to achieve the purpose of collecting the test result.
As can be seen from the above description, in the test result collection method provided by the embodiment of the present invention, a workflow model to be tested is translated into an executable primary test script; then, adding test assertions in the test script to generate a final test script; and finally executing the final test script, and comparing the execution result with an expected value. According to the invention, the test personnel can automatically report the operation result and collect and register the operation result in the database when the IDE executes the automatic test case, and the actual execution condition of the project case can be automatically analyzed through the connection of the script and the case relation, so that the influence of manual errors is reduced.
In one embodiment, referring to fig. 2, step 100 comprises:
step 101: generating a monitoring class according to the test logic by using a testng tool monitor;
the TestNG tool listener is an open source automated test framework, and the design goal of TestNG is to be able to be used to perform various types of tests: unit testing, functional testing, end-to-end testing, integrated testing. the testng tool listener has the following characteristics:
supporting Java annotation function;
tests run in arbitrarily large thread pools and there are a variety of running strategies available for selection (all test methods run in their own threads, one thread per test class, etc.);
thread security;
flexible test configuration;
supporting data driving test;
supporting parameterization;
a powerful operation model;
there are a variety of tools and plug-in support;
embedding the BeanShell to further enhance flexibility;
providing a running time and log function of the JDK by default;
methods of application server test dependency are provided.
Step 102: setting the monitoring class in a GIT version library;
the GIT version library can be simply understood as a directory in which all files are managed by the GIT, and each file is modified and deleted, and the GIT can track the history at any time, or can be "restored" at some future time.
Step 103: and responding to a interception class pulling request of the distributed client, and sending the interception class to a plurality of distributed clients.
Specifically, by pulling the latest code through the GIT client tool, the relevant code will be deployed into the local machine of each tester.
In one embodiment, referring to fig. 3, step 300 comprises:
step 301: and collecting the test result through the GIT version library.
In one embodiment, referring to fig. 4, the test result collection method further includes:
step 400: establishing a mapping relation between the test result and the corresponding test case;
step 500: and determining the test progress according to the test result and the mapping relation.
In step 400 and step 500, an association (mapping) is first established between the test cases and the test scripts, then the running details of the automated test scripts in the project period are analyzed, and finally the project test progress is counted.
In order to further illustrate the scheme, the invention also takes Eclipse as an example, provides a specific application example of the test result collection method,
the present embodiment also provides a test result collection system, referring to fig. 5, the system includes: automatically triggering and collecting and reporting the automatic test execution module 1; the project test progress module 2 is analyzed. Specifically:
automatic triggering collection and reporting automatic test execution module 1: the automatic test engineering is managed in the GIT version library, each tester submits and pulls the test script code through the GIT client, the automatic test engineering refers to the testng tool monitor, and a monitoring program is written, so that when the automatic test script runs, the execution result information is automatically triggered to be registered in the database. The monitoring program can be triggered only by configuring relevant parameters in the IDE, and a tester is not required to modify own script codes.
Analysis project test progress module 2: and analyzing the project test progress according to the script execution details registered in the database.
Referring to fig. 6, based on the test result collection system, the test result collection method provided by the present embodiment specifically includes the following steps:
it will be appreciated that Eclipse is an open source, java-based extensible development platform. Is a framework and set of services for building a development environment through plug-in components.
S101: compiling monitoring class and collecting test result logic in automatic test engineering: under the automatic test engineering, writing a TestNG monitoring class to realize the automatic triggering and collecting function when executing TestNG cases.
S102: the listening class and the code that gathers the test results are submitted to the GIT repository.
S103: the latest codes are pulled through the GIT client tool, and relevant codes are deployed to the local machines of all testers.
S104: the TestNG plug-in configuration in the IDE initiates the listening class.
S105: collecting results of the local IDE execution automation test cases.
S106: and establishing an association relation between the test cases and the test scripts.
S107: and analyzing the running details of the automatic test script in the project period.
S108: and counting project test progress.
To sum up, in the prior art, the tester mainly executes the automated test script in the local eclipse software, and then manually updates the case state after the execution is completed, and the test manager mainly evaluates the test progress of the project according to the report of the tester, so that the execution result of the actual case cannot be accurately known in time. As can be seen from the above description, the test result collecting method and apparatus provided by the embodiments of the present invention first generate a monitoring class in a system according to a test logic corresponding to a test result to be collected; then, configuring monitoring parameters in the system according to the monitoring class; and finally, collecting the test result of the system according to the monitoring class and the monitoring parameters.
Based on the same inventive concept, the embodiments of the present application also provide a test result collecting device, which may be used to implement the method described in the above embodiments, such as the following embodiments. Because the principle of the test result collecting device for solving the problem is similar to that of the test result collecting method, the implementation of the test result collecting device can be implemented by referring to the test result collecting method, and the repeated parts are not repeated. As used below, the term "unit" or "module" may be a combination of software and/or hardware that implements the intended function. While the system described in the following embodiments is preferably implemented in software, implementation in hardware, or a combination of software and hardware, is also possible and contemplated.
An embodiment of the present invention provides a specific implementation manner of a test result collecting device capable of implementing a test result collecting method, referring to fig. 7, the test result collecting device specifically includes:
the monitoring class generating module 10 is configured to generate a monitoring class in the system according to the test logic corresponding to the test result to be collected;
a listening parameter configuration module 20, configured to configure listening parameters in the system according to the listening class;
and the test result collection module 30 is configured to collect test results of the system according to the listening class and the listening parameter.
In one embodiment, referring to fig. 8, the listening class generating module 10 includes:
a listening class generating unit 101, configured to generate a listening class according to the test logic by using a testng tool listener;
a listening class setting unit 102, configured to set the listening class in a GIT version library;
and the monitoring class sending unit 103 is configured to send the monitoring class to a plurality of distributed clients in response to a monitoring class pull request of the distributed clients.
In one embodiment, the test result collection module 30 is specifically configured to collect the test result through the GIT version library.
In one embodiment, referring to fig. 9, the test result collection device further includes:
a mapping relation establishing module 40, configured to establish a mapping relation between the test result and the corresponding test case;
and the test progress determining module 50 is configured to determine a test progress according to the test result and the mapping relationship.
As can be seen from the above description, the test result collecting device provided by the embodiment of the present invention first translates a workflow model to be tested into an executable primary test script; then, adding test assertions in the test script to generate a final test script; and finally executing the final test script, and comparing the execution result with an expected value. According to the invention, the test personnel can automatically report the operation result and collect and register the operation result in the database when the IDE executes the automatic test case, and the actual execution condition of the project case can be automatically analyzed through the connection of the script and the case relation, so that the influence of manual errors is reduced.
Referring now to fig. 10, a schematic diagram of an electronic device 600 suitable for use in implementing embodiments of the present application is shown.
As shown in fig. 10, the electronic apparatus 600 includes a Central Processing Unit (CPU) 601, which can perform various appropriate works and processes according to a program stored in a Read Only Memory (ROM) 602 or a program loaded from a storage section 608 into a Random Access Memory (RAM)) 603. In the RAM603, various programs and data required for the operation of the system 600 are also stored. The CPU601, ROM602, and RAM603 are connected to each other through a bus 604. An input/output (I/O) interface 605 is also connected to bus 604.
The following components are connected to the I/O interface 605: an input portion 606 including a keyboard, mouse, etc.; an output portion 607 including a Cathode Ray Tube (CRT), a Liquid Crystal Display (LCD), and the like, a speaker, and the like; a storage section 608 including a hard disk and the like; and a communication section 609 including a network interface card such as a LAN card, a modem, or the like. The communication section 609 performs communication processing via a network such as the internet. The drive 610 is also connected to the I/O interface 605 as needed. Removable media 611 such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, or the like is mounted on drive 610 as needed, so that a computer program read therefrom is mounted as needed as storage section 608.
In particular, according to embodiments of the present invention, the processes described above with reference to flowcharts may be implemented as computer software programs. For example, an embodiment of the present invention includes a computer-readable storage medium having stored thereon a computer program which, when executed by a processor, implements the steps of the above-described person distance determination method in a data room-based scenario, the steps comprising:
step 100: generating a monitoring class in the system according to the test logic corresponding to the test result to be collected;
step 200: configuring monitoring parameters in the system according to the monitoring class;
step 300: and collecting the test result of the system according to the monitoring class and the monitoring parameters.
In such an embodiment, the computer program may be downloaded and installed from a network through the communication portion 609, and/or installed from the removable medium 611.
In this specification, each embodiment is described in a progressive manner, and identical and similar parts of each embodiment are all referred to each other, and each embodiment mainly describes differences from other embodiments. In particular, for a hardware+program class embodiment, the description is relatively simple, as it is substantially similar to the method embodiment, as relevant see the partial description of the method embodiment.
The foregoing describes specific embodiments of the present disclosure. Other embodiments are within the scope of the following claims. In some cases, the actions or steps recited in the claims can be performed in a different order than in the embodiments and still achieve desirable results. In addition, the processes depicted in the accompanying figures do not necessarily require the particular order shown, or sequential order, to achieve desirable results. In some embodiments, multitasking and parallel processing are also possible or may be advantageous.
For convenience of description, the above devices are described as being functionally divided into various units, respectively. Of course, the functions of each element may be implemented in one or more software and/or hardware elements when implemented in the present application.
The present invention is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems) and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flowchart illustrations and/or block diagrams, and combinations of flows and/or blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
It should also be noted that the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising one … …" does not exclude the presence of other like elements in a process, method, article or apparatus that comprises the element.
In this specification, each embodiment is described in a progressive manner, and identical and similar parts of each embodiment are all referred to each other, and each embodiment mainly describes differences from other embodiments. In particular, for system embodiments, since they are substantially similar to method embodiments, the description is relatively simple, as relevant to see a section of the description of method embodiments.
The foregoing is merely exemplary of the present application and is not intended to limit the present application. Various modifications and changes may be made to the present application by those skilled in the art. Any modifications, equivalent substitutions, improvements, etc. which are within the spirit and principles of the present application are intended to be included within the scope of the claims of the present application.
Claims (4)
1. A test result collection method, comprising:
generating a monitoring class in the system according to the test logic corresponding to the test result to be collected;
configuring monitoring parameters in the system according to the monitoring class;
collecting test results of a system according to the monitoring class and the monitoring parameters;
establishing a mapping relation between the test result and the corresponding test case;
determining a test progress according to the test result and the mapping relation;
the generating a monitoring class in the system according to the test logic corresponding to the test result to be collected comprises the following steps:
generating a monitoring class according to the test logic by using a testng tool monitor;
setting the monitoring class in a GIT version library;
responding to a monitoring class pulling request of a distributed client, and transmitting the monitoring class to a plurality of distributed clients;
the test results according to the monitoring class and the monitoring parameter collecting system comprise:
and collecting the test result through the GIT version library.
2. A test result collection device, comprising:
the monitoring class generating module is used for generating a monitoring class in the system according to the test logic corresponding to the test result to be collected;
a monitoring parameter configuration module, configured to configure monitoring parameters in the system according to the monitoring class;
the test result collection module is used for collecting test results of the system according to the monitoring class and the monitoring parameters;
the mapping relation establishing module is used for establishing a mapping relation between the test result and the corresponding test case;
the test progress determining module is used for determining the test progress according to the test result and the mapping relation;
the monitoring class generating module comprises:
a monitoring class generating unit, configured to generate a monitoring class according to the test logic by using a testng tool monitor;
a monitoring class setting unit, configured to set the monitoring class in a GIT version library;
a monitoring class sending unit, configured to respond to a monitoring class pulling request of a distributed client, and send the monitoring class to a plurality of distributed clients;
the test result collection module is specifically configured to collect the test result through the GIT version library.
3. An electronic device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, characterized in that the processor implements the steps of the test result collection method of claim 1 when the program is executed by the processor.
4. A computer readable storage medium having stored thereon a computer program, characterized in that the computer program when executed by a processor implements the steps of the test result collection method of claim 1.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110371418.3A CN113094267B (en) | 2021-04-07 | 2021-04-07 | Test result collection method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110371418.3A CN113094267B (en) | 2021-04-07 | 2021-04-07 | Test result collection method and device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113094267A CN113094267A (en) | 2021-07-09 |
| CN113094267B true CN113094267B (en) | 2024-01-30 |
Family
ID=76674418
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110371418.3A Active CN113094267B (en) | 2021-04-07 | 2021-04-07 | Test result collection method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113094267B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117077592B (en) * | 2023-10-12 | 2024-03-08 | 芯耀辉科技有限公司 | Regression data monitoring method, monitoring device and monitoring system |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108519952A (en) * | 2018-04-13 | 2018-09-11 | 南京新贝金服科技有限公司 | A kind of distributed WEB automatization test systems and method |
| CN110275822A (en) * | 2019-04-26 | 2019-09-24 | 武汉众邦银行股份有限公司 | Performance test methods, device, equipment and the storage medium of application programming interfaces |
| CN110851356A (en) * | 2019-10-30 | 2020-02-28 | 河海大学 | Selenium-based Web application automatic test framework and construction method and system thereof |
| CN111966587A (en) * | 2020-08-06 | 2020-11-20 | 中国建设银行股份有限公司 | Data acquisition method, device and equipment |
-
2021
- 2021-04-07 CN CN202110371418.3A patent/CN113094267B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108519952A (en) * | 2018-04-13 | 2018-09-11 | 南京新贝金服科技有限公司 | A kind of distributed WEB automatization test systems and method |
| CN110275822A (en) * | 2019-04-26 | 2019-09-24 | 武汉众邦银行股份有限公司 | Performance test methods, device, equipment and the storage medium of application programming interfaces |
| CN110851356A (en) * | 2019-10-30 | 2020-02-28 | 河海大学 | Selenium-based Web application automatic test framework and construction method and system thereof |
| CN111966587A (en) * | 2020-08-06 | 2020-11-20 | 中国建设银行股份有限公司 | Data acquisition method, device and equipment |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113094267A (en) | 2021-07-09 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US8074204B2 (en) | Test automation for business applications | |
| US10127141B2 (en) | Electronic technology resource evaluation system | |
| Memon et al. | Studying the fault-detection effectiveness of GUI test cases for rapidly evolving software | |
| CN102902619B (en) | The regression testing method of web application and device | |
| JP4961123B2 (en) | Automated test case validation loosely coupled with respect to automated test case execution | |
| US8719784B2 (en) | Assigning runtime artifacts to software components | |
| Izurieta et al. | A multiple case study of design pattern decay, grime, and rot in evolving software systems | |
| US10678666B1 (en) | Method and system for implementing automated test and retest procedures in a virtual test environment | |
| US20150178182A1 (en) | Software testing platform and method | |
| US20040010735A1 (en) | Formal test case definitions | |
| US11436128B2 (en) | System and computer implemented method for generating test scripts | |
| US10169002B2 (en) | Automated and heuristically managed solution to quantify CPU and path length cost of instructions added, changed or removed by a service team | |
| JP2010231782A (en) | Method and system for function automation | |
| Marchetto et al. | Reajax: a reverse engineering tool for ajax web applications | |
| Ganesan et al. | An analysis of unit tests of a flight software product line | |
| CN111597104A (en) | Multi-protocol adaptive interface regression testing method, system, equipment and medium | |
| Zhu et al. | A test automation solution on gui functional test | |
| CN113094267B (en) | Test result collection method and device | |
| US20060129891A1 (en) | Software test framework | |
| Tanida et al. | Automated system testing of dynamic web applications | |
| Tufarolo et al. | Automated distributed system testing: designing an RTI verification system | |
| Abdullah | Evaluating Impact of Design Patterns on Software Maintainability and Performance | |
| Lübke | Calculating test coverage for BPEL processes with process log analysis | |
| Majeed et al. | Model-based replay testing for event-driven software | |
| Schulz | Integrating performance tests in a generative software development platform |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |