CN113094267A - Test result collection method and device - Google Patents
Test result collection method and device Download PDFInfo
- Publication number
- CN113094267A CN113094267A CN202110371418.3A CN202110371418A CN113094267A CN 113094267 A CN113094267 A CN 113094267A CN 202110371418 A CN202110371418 A CN 202110371418A CN 113094267 A CN113094267 A CN 113094267A
- Authority
- CN
- China
- Prior art keywords
- test
- test result
- monitoring
- class
- monitoring class
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000012360 testing method Methods 0.000 title claims abstract description 210
- 238000000034 method Methods 0.000 title claims abstract description 67
- 238000012544 monitoring process Methods 0.000 claims abstract description 90
- 238000013507 mapping Methods 0.000 claims description 16
- 238000004590 computer program Methods 0.000 claims description 14
- 230000006870 function Effects 0.000 description 18
- 238000010586 diagram Methods 0.000 description 13
- 230000008569 process Effects 0.000 description 10
- 238000011161 development Methods 0.000 description 7
- 238000012545 processing Methods 0.000 description 6
- 238000004891 communication Methods 0.000 description 4
- 238000013100 final test Methods 0.000 description 4
- 238000012986 modification Methods 0.000 description 3
- 230000004048 modification Effects 0.000 description 3
- 230000001960 triggered effect Effects 0.000 description 3
- 230000006399 behavior Effects 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 230000000750 progressive effect Effects 0.000 description 2
- 238000012827 research and development Methods 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000012217 deletion Methods 0.000 description 1
- 230000037430 deletion Effects 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 230000010354 integration Effects 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 238000004088 simulation Methods 0.000 description 1
- 238000010998 test method Methods 0.000 description 1
- 238000012795 verification Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/36—Preventing errors by testing or debugging software
- G06F11/3664—Environments for testing or debugging software
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/36—Preventing errors by testing or debugging software
- G06F11/3668—Software testing
- G06F11/3672—Test management
- G06F11/368—Test management for test version control, e.g. updating test cases to a new software version
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/36—Preventing errors by testing or debugging software
- G06F11/3668—Software testing
- G06F11/3672—Test management
- G06F11/3684—Test management for test design, e.g. generating new test cases
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/36—Preventing errors by testing or debugging software
- G06F11/3668—Software testing
- G06F11/3672—Test management
- G06F11/3688—Test management for test execution, e.g. scheduling of test suites
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/36—Preventing errors by testing or debugging software
- G06F11/3668—Software testing
- G06F11/3672—Test management
- G06F11/3692—Test management for test results analysis
Abstract
The invention can be used in the financial field or other fields, the invention provides a test result collection method and a device, and the test result collection method comprises the following steps: generating a monitoring class in the system according to the test logic corresponding to the test result to be collected; configuring monitoring parameters in the system according to the monitoring class; and collecting the test result of the system according to the monitoring class and the monitoring parameter. The invention can automatically analyze the actual execution condition of the project case and reduce the influence of manual errors by realizing that a tester automatically reports the operation result while executing the automatic test case in the IDE, collecting and registering the operation result in the database and hanging the script and case relation.
Description
Technical Field
The invention belongs to the technical field of big data, and particularly relates to a test result collection method and device.
Background
Automatic test, as the name implies, accomplishes the test work automatically. Specifically, the simulation of manual test work and the verification of the result are realized by some automatic test tools to complete the whole test process. TestNG is a test framework in JAVA, and is a popular and practical automatic test framework at present. Testers typically use the IDE tool to write and execute automated test cases for the TestNg framework. After the execution is finished, the case state is manually updated according to the script execution condition, and the test manager mainly evaluates the test progress of the project according to the case execution condition reported by the test personnel, so that the execution result of the actual case cannot be known accurately in time. The situation that the automatic test is unsuccessful but the project case passes easily occurs, and hidden danger exists for the project quality.
Disclosure of Invention
The test result collecting method and device provided by the invention have the following advantages: the method is light in weight, only a small amount of codes are needed to be written to register and analyze logic codes of test results, and the method is suitable for test teams with weak research and development capability. The deployment is simple, and the deployment is completed only by submitting the tool to the git warehouse and pulling the latest code and the brief answer by a tester in the IDE configuration. The collected test results are accurate and timely, the automatic test cases are connected with the project test scenes, the automatic test results directly reflect the test progress of the project, and a test manager can execute statistical logic at any time or at regular time to know the latest test condition.
In order to solve the technical problems, the invention provides the following technical scheme:
in a first aspect, the present invention provides a test result collection method, including:
generating a monitoring class in the system according to the test logic corresponding to the test result to be collected;
configuring monitoring parameters in the system according to the monitoring class;
and collecting the test result of the system according to the monitoring class and the monitoring parameter.
In an embodiment, the generating a listening class in a system according to a test logic corresponding to a test result to be collected includes:
generating a monitoring class according to the test logic by using a testng tool monitor;
setting the monitoring class in a GIT version library;
and responding to a monitoring class pulling request of the distributed client, and sending the monitoring class to the plurality of distributed clients.
In an embodiment, the test result according to the listening class and the listening parameter collecting system includes:
and collecting the test result through the GIT version library.
In one embodiment, the test result collecting method further includes:
establishing a mapping relation between the test result and the corresponding test case;
and determining the testing progress according to the testing result and the mapping relation.
In a second aspect, the present invention provides a test result collecting apparatus, including:
the monitoring generation module is used for generating a monitoring in the system according to the test logic corresponding to the test result to be collected;
a monitoring parameter configuration module, configured to configure monitoring parameters in the system according to the monitoring class;
and the test result collection module is used for collecting the test result of the system according to the monitoring class and the monitoring parameters.
In one embodiment, the listening class generation module includes:
a monitoring class generating unit, configured to generate a monitoring class according to the test logic by using a testng tool listener;
the monitoring class setting unit is used for setting the monitoring class in the GIT version library;
and the monitoring class sending unit is used for responding to a monitoring class pulling request of the distributed client and sending the monitoring class to the plurality of distributed clients.
In an embodiment, the test result collecting module is specifically configured to collect the test result through the GIT version library.
In one embodiment, the test result collecting apparatus further includes:
the mapping relation establishing module is used for establishing the mapping relation between the test result and the corresponding test case;
and the test progress determining module is used for determining the test progress according to the test result and the mapping relation.
In a third aspect, the present invention provides an electronic device, comprising a memory, a processor, and a computer program stored on the memory and executable on the processor, wherein the processor implements the steps of the test result collection method when executing the program.
In a fourth aspect, the present invention provides a computer readable storage medium having stored thereon a computer program which, when executed by a processor, performs the steps of the test result collection method.
As can be seen from the above description, in the test result collection method and apparatus provided in the embodiments of the present invention, a monitoring class is first generated in a system according to a test logic corresponding to a test result to be collected; then, configuring monitoring parameters in the system according to the monitoring class; and finally, collecting the test result of the system according to the monitoring class and the monitoring parameter. Specifically, the invention has the following beneficial effects:
1. the method is light in weight, only a small amount of codes are needed to be written to register and analyze logic codes of test results, and the method is suitable for test teams with weak research and development capability.
2. The deployment is simple, and the deployment can be completed only by submitting the tool to the git warehouse, pulling the latest code and simply answering in the IDE configuration.
3. The collected test results are accurate and timely, the automatic test cases are connected with the project test scenes, the automatic test results directly reflect the test progress of the project, and a test manager can execute statistical logic at any time or at regular time to know the latest test condition.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below, and it is obvious that the drawings in the following description are some embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to these drawings without creative efforts.
FIG. 1 is a first flowchart illustrating a test result collection method according to an embodiment of the present invention;
FIG. 2 is a flowchart illustrating a step 100 in a test result collection method according to an embodiment of the present invention;
FIG. 3 is a flowchart illustrating a step 300 in a test result collection method according to an embodiment of the present invention;
FIG. 4 is a flowchart illustrating a second method for collecting test results according to an embodiment of the present invention;
FIG. 5 is a schematic diagram of a test result collection system according to an embodiment of the present invention;
FIG. 6 is a flowchart illustrating a method for collecting test results according to an embodiment of the present invention;
FIG. 7 is a block diagram of a test result collecting apparatus according to an embodiment of the present invention;
fig. 8 is a block diagram of the listening class generation module 10 according to an embodiment of the present invention;
FIG. 9 is a block diagram of a second exemplary embodiment of a test result collecting device;
fig. 10 is a schematic structural diagram of an electronic device in an embodiment of the invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, but not all, embodiments of the present invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
As will be appreciated by one skilled in the art, embodiments of the present invention may be provided as a method, system, or computer program product. Accordingly, the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present invention may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
It should be noted that the terms "comprises" and "comprising," and any variations thereof, in the description and claims of this application and the above-described drawings, are intended to cover a non-exclusive inclusion, such that a process, method, system, article, or apparatus that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed, but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.
It should be noted that the embodiments and features of the embodiments in the present application may be combined with each other without conflict. The present application will be described in detail below with reference to the embodiments with reference to the attached drawings.
The embodiment of the present invention provides a specific implementation manner of a test result collection method, and referring to fig. 1, the method specifically includes the following steps:
step 100: and generating a monitoring class in the system according to the test logic corresponding to the test result to be collected.
First, the relevant terms are introduced:
TestNg: open source automated test bottom layer framework
Ide (integrated Development environment), integrated Development environment: the application program for providing a program development environment integrates a code compiling function, an analyzing function, a compiling function, a debugging function and the like, and all software or software sets with the characteristics can be called the integrated development environment. (Eclipse software is mainly taken as an example in the patent.)
GIT: an open source distributed version control system that can efficiently and quickly handle very small to very large project version management
When the step 100 is implemented, a testng tool listener can be referred to, and a listening type program is compiled, so that after the automatic test script runs, the execution result information is automatically triggered to be registered in the database. The monitoring program can be triggered only by configuring relevant parameters in the tested system, and a tester does not need to modify own script codes.
In addition, it will be appreciated that a class is a reference data type, similar to the basic data types of byte, short, int (char), long, float, double, etc., except that it is a complex data type. Because it is data type in nature, not data, it does not exist in memory, cannot be directly manipulated, and only when instantiated as an object, it becomes operable. If the type of data provided in a program has a direct correspondence to concepts in the application, the program will be more easily understood and more easily modified. A well-chosen set of user-defined classes makes the program more compact. In addition, it also makes various forms of code analysis easier to perform. In particular, it also makes it possible for the compiler to check for illegal use of the object. The inside of the class encapsulates attributes and methods for manipulating its members. A class is a definition of an object, having behaviors (behaviors) that describe what an object can do and the methods (methods) that it can do, which are the procedures and processes that can operate on the object. It contains information about the way an object behaves, including its name, properties, methods, and events. The composition of the class includes member attributes and member methods (data members and member functions). The data members correspond to the attributes of the class, and the data members of the class are also of a data type and do not need to be allocated with memory. The member function is used for each attribute of the operation class and is a specific operation of one class. And the listening class in step 100 refers to a class for listening to other programs.
Step 200: and configuring monitoring parameters in the system according to the monitoring class.
It should be noted that the system in step 200 refers to a monitored system, and preferably, the system may be an Integrated Development Environment (IDE Environment), which is an application program for providing a program Development Environment, and integrates an Integrated Development software service suite such as a code writing function, an analysis function, a compiling function, and a debugging function, and all software or software suites having this characteristic may be called an Integrated Development Environment.
Step 300: and collecting the test result of the system according to the monitoring class and the monitoring parameter.
Specifically, when the test result of the system under test is generated, the monitoring parameters in step 300 are set off, and the monitoring class collects the test result, so as to achieve the purpose of collecting the test result.
As can be seen from the above description, in the test result collection method provided in the embodiment of the present invention, a workflow model to be tested is first translated into an executable preliminary test script; then, adding a test assertion in the test script to generate a final test script; and finally executing the final test script, and comparing the execution result with an expected value. The invention can automatically analyze the actual execution condition of the project case and reduce the influence of manual errors by realizing that a tester automatically reports the operation result while executing the automatic test case in the IDE, collecting and registering the operation result in the database and hanging the script and case relation.
In one embodiment, referring to fig. 2, step 100 comprises:
step 101: generating a monitoring class according to the test logic by using a testng tool monitor;
the TestNG tool listener is an open source automated testing framework, and the design goal of TestNG is to be able to be used to perform various types of tests: unit test, function test, end-to-end test and integration test. the testng tool listener has the following characteristics:
support for Java annotation functionality;
the test is run in an arbitrarily large thread pool, and a plurality of running strategies can be selected (all test methods run in own threads, one thread for each test class, and the like);
thread safety;
flexible test configuration;
supporting data driving test;
parameterization is supported;
a powerful running model;
a plurality of tools and plug-in supports;
embedded in the beenshell to further enhance flexibility;
default provision of run-time and log functions for JDK;
a method for testing dependency of an application server is provided.
Step 102: setting the monitoring class in a GIT version library;
the GIT version library can be simply understood as a directory, all files in the directory can be managed by the GIT, and each file modification and deletion can be tracked by GIT, so that the history can be tracked at any time or the "restoration" can be realized at a future time.
Step 103: and responding to a monitoring class pulling request of the distributed client, and sending the monitoring class to the plurality of distributed clients.
Specifically, through the GIT client tool, the latest code is pulled, and the relevant code is deployed to the local machine of each tester.
In one embodiment, referring to FIG. 3, step 300 comprises:
step 301: and collecting the test result through the GIT version library.
In an embodiment, referring to fig. 4, the test result collecting method further includes:
step 400: establishing a mapping relation between the test result and the corresponding test case;
step 500: and determining the testing progress according to the testing result and the mapping relation.
In step 400 and step 500, an association relationship (mapping relationship) is first established between the test case and the test script, then the operation details of the automated test script in the project period are analyzed, and finally the project test progress is counted.
To further illustrate the present solution, the present invention also provides a specific application example of the test result collection method by taking Eclipse as an example,
this embodiment also provides a test result collection system, as shown in fig. 5, including: automatically triggering, collecting and reporting the automatic test execution module 1; the project test progress module 2 is analyzed. Specifically, the method comprises the following steps:
the automatic triggering collection and reporting automatic test execution module 1: the automatic test project is managed in a GIT version library, each tester submits and pulls a test script code through a GIT client, the automatic test project quotes a testng tool monitor and compiles a monitoring program, and after the automatic test script runs, the automatic test project automatically triggers the execution result information to be registered in a database. The monitoring program can be triggered only by configuring related parameters in the IDE, and a tester is not required to modify own script codes.
The analysis project test progress module 2: and analyzing the project testing progress according to the script execution details registered in the database.
Referring to fig. 6, based on the test result collection system, the test result collection method provided by the present specific application example specifically includes the following steps:
it is understood that Eclipse is an open source, Java-based extensible development platform. Is a framework and a set of services for building a development environment through plug-in components.
S101: compiling monitoring class and collecting test result logic in an automated test project: and compiling a TestNG monitoring class under an automatic test engineering to realize the automatic trigger collection function when executing the TestNG case.
S102: the snooping class and code to collect test results are submitted to the GIT repository.
S103: and pulling the latest code through the GIT client tool, and deploying the related code to the local machine of each tester.
S104: the TestNG plug-in the IDE configures the start listening class.
S105: collecting results of executing automated test cases by local IDE.
S106: and establishing an association relation between the test case and the test script.
S107: and analyzing the running details of the automatic test script in the project period.
S108: and (5) counting the project testing progress.
To sum up, in the prior art, a tester mainly executes an automated test script in local eclipse software, and manually updates the case state after the execution is completed, and a test manager mainly evaluates the test progress of a project according to the report of the tester, so that the execution result of an actual case cannot be known accurately in time. As can be seen from the above description, in the test result collection method and apparatus provided in the embodiments of the present invention, a monitoring class is first generated in a system according to a test logic corresponding to a test result to be collected; then, configuring monitoring parameters in the system according to the monitoring class; and finally, collecting the test result of the system according to the monitoring class and the monitoring parameter.
Based on the same inventive concept, the embodiment of the present application further provides a test result collecting device, which can be used to implement the methods described in the above embodiments, such as the following embodiments. Because the principle of the test result collection device for solving the problems is similar to that of the test result collection method, the test result collection device can be implemented by the test result collection method, and repeated details are not repeated. As used hereinafter, the term "unit" or "module" may be a combination of software and/or hardware that implements a predetermined function. While the system described in the embodiments below is preferably implemented in software, implementations in hardware, or a combination of software and hardware are also possible and contemplated.
An embodiment of the present invention provides a specific implementation of a test result collecting device capable of implementing a test result collecting method, and referring to fig. 7, the test result collecting device specifically includes the following contents:
the monitoring generation module 10 is configured to generate a monitoring in the system according to the test logic corresponding to the test result to be collected;
a monitoring parameter configuration module 20, configured to configure monitoring parameters in the system according to the monitoring class;
and the test result collection module 30 is configured to collect the test result of the system according to the monitoring class and the monitoring parameter.
In an embodiment, referring to fig. 8, the listening class generating module 10 includes:
a monitoring class generating unit 101, configured to generate a monitoring class according to the test logic by using a testng tool listener;
a monitoring class setting unit 102, configured to set the monitoring class in a GIT version library;
a listening class sending unit 103, configured to send the listening class to multiple distributed clients in response to a listening class pull request of the distributed clients.
In an embodiment, the test result collecting module 30 is specifically configured to collect the test result through the GIT version library.
In one embodiment, referring to fig. 9, the test result collecting apparatus further includes:
the mapping relation establishing module 40 is used for establishing a mapping relation between the test result and the corresponding test case;
and the test progress determining module 50 is configured to determine a test progress according to the test result and the mapping relationship.
As can be seen from the above description, the test result collecting device provided in the embodiment of the present invention first translates the workflow model to be tested into an executable preliminary test script; then, adding a test assertion in the test script to generate a final test script; and finally executing the final test script, and comparing the execution result with an expected value. The invention can automatically analyze the actual execution condition of the project case and reduce the influence of manual errors by realizing that a tester automatically reports the operation result while executing the automatic test case in the IDE, collecting and registering the operation result in the database and hanging the script and case relation.
Referring now to FIG. 10, shown is a schematic diagram of an electronic device 600 suitable for use in implementing embodiments of the present application.
As shown in fig. 10, the electronic apparatus 600 includes a Central Processing Unit (CPU)601 that can perform various appropriate works and processes according to a program stored in a Read Only Memory (ROM)602 or a program loaded from a storage section 608 into a Random Access Memory (RAM)) 603. In the RAM603, various programs and data necessary for the operation of the system 600 are also stored. The CPU601, ROM602, and RAM603 are connected to each other via a bus 604. An input/output (I/O) interface 605 is also connected to bus 604.
The following components are connected to the I/O interface 605: an input portion 606 including a keyboard, a mouse, and the like; an output portion 607 including a display such as a Cathode Ray Tube (CRT), a Liquid Crystal Display (LCD), and the like, and a speaker; a storage section 608 including a hard disk and the like; and a communication section 609 including a network interface card such as a LAN card, a modem, or the like. The communication section 609 performs communication processing via a network such as the internet. The driver 610 is also connected to the I/O interface 605 as needed. A removable medium 611 such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, or the like is mounted on the drive 610 as necessary, so that a computer program read out therefrom is mounted as necessary on the storage section 608.
In particular, according to an embodiment of the present invention, the processes described above with reference to the flowcharts may be implemented as computer software programs. For example, an embodiment of the present invention includes a computer-readable storage medium, on which a computer program is stored, the computer program, when being executed by a processor, implementing the steps of the above-mentioned method for determining a distance to a person in a data-based room scenario, the steps including:
step 100: generating a monitoring class in the system according to the test logic corresponding to the test result to be collected;
step 200: configuring monitoring parameters in the system according to the monitoring class;
step 300: and collecting the test result of the system according to the monitoring class and the monitoring parameter.
In such an embodiment, the computer program may be downloaded and installed from a network through the communication section 609, and/or installed from the removable medium 611.
The embodiments in the present specification are described in a progressive manner, and the same and similar parts among the embodiments are referred to each other, and each embodiment focuses on the differences from the other embodiments. In particular, for the hardware + program class embodiment, since it is substantially similar to the method embodiment, the description is simple, and the relevant points can be referred to the partial description of the method embodiment.
The foregoing description has been directed to specific embodiments of this disclosure. Other embodiments are within the scope of the following claims. In some cases, the actions or steps recited in the claims may be performed in a different order than in the embodiments and still achieve desirable results. In addition, the processes depicted in the accompanying figures do not necessarily require the particular order shown, or sequential order, to achieve desirable results. In some embodiments, multitasking and parallel processing may also be possible or may be advantageous.
For convenience of description, the above devices are described as being divided into various units by function, and are described separately. Of course, the functionality of the units may be implemented in one or more software and/or hardware when implementing the present application.
The present invention is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
It should also be noted that the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.
The embodiments in the present specification are described in a progressive manner, and the same and similar parts among the embodiments are referred to each other, and each embodiment focuses on the differences from the other embodiments. In particular, for the system embodiment, since it is substantially similar to the method embodiment, the description is simple, and for the relevant points, reference may be made to the partial description of the method embodiment.
The above description is only an example of the present application and is not intended to limit the present application. Various modifications and changes may occur to those skilled in the art. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present application should be included in the scope of the claims of the present application.
Claims (10)
1. A method for collecting test results, comprising:
generating a monitoring class in the system according to the test logic corresponding to the test result to be collected;
configuring monitoring parameters in the system according to the monitoring class;
and collecting the test result of the system according to the monitoring class and the monitoring parameter.
2. The method of claim 1, wherein the generating a snoop class in a system according to the test logic corresponding to the test result to be collected comprises:
generating a monitoring class according to the test logic by using a testng tool monitor;
setting the monitoring class in a GIT version library;
and responding to a monitoring class pulling request of the distributed client, and sending the monitoring class to the plurality of distributed clients.
3. The method of claim 2, wherein the collecting test results according to the listening class and the listening parameter collecting system comprises:
and collecting the test result through the GIT version library.
4. The test result collection method according to claim 1, further comprising:
establishing a mapping relation between the test result and the corresponding test case;
and determining the testing progress according to the testing result and the mapping relation.
5. A test result collection apparatus, comprising:
the monitoring generation module is used for generating a monitoring in the system according to the test logic corresponding to the test result to be collected;
a monitoring parameter configuration module, configured to configure monitoring parameters in the system according to the monitoring class;
and the test result collection module is used for collecting the test result of the system according to the monitoring class and the monitoring parameters.
6. The test result collection device according to claim 5, wherein the listening class generation module comprises:
a monitoring class generating unit, configured to generate a monitoring class according to the test logic by using a testng tool listener;
the monitoring class setting unit is used for setting the monitoring class in the GIT version library;
and the monitoring class sending unit is used for responding to a monitoring class pulling request of the distributed client and sending the monitoring class to the plurality of distributed clients.
7. The test result collection device of claim 6, wherein the test result collection module is specifically configured to collect the test results via the GIT version library.
8. The test result collection apparatus according to claim 5, further comprising:
the mapping relation establishing module is used for establishing the mapping relation between the test result and the corresponding test case;
and the test progress determining module is used for determining the test progress according to the test result and the mapping relation.
9. An electronic device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, wherein the steps of the test result collection method of any one of claims 1 to 4 are implemented when the program is executed by the processor.
10. A computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, carries out the steps of the test result collection method according to any one of claims 1 to 4.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110371418.3A CN113094267B (en) | 2021-04-07 | 2021-04-07 | Test result collection method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110371418.3A CN113094267B (en) | 2021-04-07 | 2021-04-07 | Test result collection method and device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113094267A true CN113094267A (en) | 2021-07-09 |
| CN113094267B CN113094267B (en) | 2024-01-30 |
Family
ID=76674418
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110371418.3A Active CN113094267B (en) | 2021-04-07 | 2021-04-07 | Test result collection method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113094267B (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117077592A (en) * | 2023-10-12 | 2023-11-17 | 芯耀辉科技有限公司 | Regression data monitoring method, monitoring device and monitoring system |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108519952A (en) * | 2018-04-13 | 2018-09-11 | 南京新贝金服科技有限公司 | A kind of distributed WEB automatization test systems and method |
| CN110275822A (en) * | 2019-04-26 | 2019-09-24 | 武汉众邦银行股份有限公司 | Performance test methods, device, equipment and the storage medium of application programming interfaces |
| CN110851356A (en) * | 2019-10-30 | 2020-02-28 | 河海大学 | Selenium-based Web application automatic test framework and construction method and system thereof |
| CN111966587A (en) * | 2020-08-06 | 2020-11-20 | 中国建设银行股份有限公司 | Data acquisition method, device and equipment |
-
2021
- 2021-04-07 CN CN202110371418.3A patent/CN113094267B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108519952A (en) * | 2018-04-13 | 2018-09-11 | 南京新贝金服科技有限公司 | A kind of distributed WEB automatization test systems and method |
| CN110275822A (en) * | 2019-04-26 | 2019-09-24 | 武汉众邦银行股份有限公司 | Performance test methods, device, equipment and the storage medium of application programming interfaces |
| CN110851356A (en) * | 2019-10-30 | 2020-02-28 | 河海大学 | Selenium-based Web application automatic test framework and construction method and system thereof |
| CN111966587A (en) * | 2020-08-06 | 2020-11-20 | 中国建设银行股份有限公司 | Data acquisition method, device and equipment |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117077592A (en) * | 2023-10-12 | 2023-11-17 | 芯耀辉科技有限公司 | Regression data monitoring method, monitoring device and monitoring system |
| CN117077592B (en) * | 2023-10-12 | 2024-03-08 | 芯耀辉科技有限公司 | Regression data monitoring method, monitoring device and monitoring system |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113094267B (en) | 2024-01-30 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| EP3769223B1 (en) | Unified test automation system | |
| US10430319B1 (en) | Systems and methods for automatic software testing | |
| US8074204B2 (en) | Test automation for business applications | |
| JP4961123B2 (en) | Automated test case validation loosely coupled with respect to automated test case execution | |
| US7296188B2 (en) | Formal test case definitions | |
| Sincero et al. | Approaching non-functional properties of software product lines: Learning from products | |
| US10169002B2 (en) | Automated and heuristically managed solution to quantify CPU and path length cost of instructions added, changed or removed by a service team | |
| US20200110694A1 (en) | System and computer implemented method for generating test scripts | |
| Grechanik et al. | Creating GUI testing tools using accessibility technologies | |
| US8832640B1 (en) | Component mapped software development workflow | |
| Mijatov et al. | A Framework for Testing UML Activities Based on fUML. | |
| CN111597104A (en) | Multi-protocol adaptive interface regression testing method, system, equipment and medium | |
| Zhu et al. | A test automation solution on gui functional test | |
| CN113094267B (en) | Test result collection method and device | |
| Khan | Comparative study of performance testing tools: apache Jmeter and HP loadrunner | |
| CN114297961A (en) | Chip test case processing method and related device | |
| Kanstrén | A framework for observation-based modelling in model-based testing | |
| Abdullah | Evaluating Impact of Design Patterns on Software Maintainability and Performance | |
| US20080066005A1 (en) | Systems and Methods of Interfacing with Enterprise Resource Planning Systems | |
| CN115509923A (en) | Unit test case generation method and device and computer storage medium | |
| Schulz | Integrating performance tests in a generative software development platform | |
| Löberbauer et al. | Testing the composability of plug-and-play components: A method for unit testing of dynamically composed applications | |
| Damm | Evaluating and Improving Test Efficiency | |
| Sundbaum | Automated Verification of Load Test Results in a Continuous Delivery Deployment Pipeline | |
| Uspenskiy | A survey and classification of software testing tools |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |