CN112269745A

CN112269745A - Test case processing method, device, equipment and storage medium

Info

Publication number: CN112269745A
Application number: CN202011239056.4A
Authority: CN
Inventors: 苏京刚; 成敏
Original assignee: Beijing Didi Infinity Technology and Development Co Ltd
Current assignee: Beijing Didi Infinity Technology and Development Co Ltd
Priority date: 2020-11-09
Filing date: 2020-11-09
Publication date: 2021-01-26

Abstract

The application provides a test case processing method, a test case processing device, test case processing equipment and a storage medium, and relates to the technical field of case testing. The method comprises the following steps: receiving a first example removal notification sent by a first server; calling the test task to run the test cases in the second test case set to obtain a first test running result of the second test case set; and if the test operation of the removed test case in the first test operation result fails, determining that the removed test case is a first false alarm test case. Compared with the prior art, the problems of low efficiency and high cost caused by manual troubleshooting of the false-alarm test cases are solved.

Description

Test case processing method, device, equipment and storage medium

Technical Field

The present application relates to the field of use case testing technologies, and in particular, to a test use case processing method, apparatus, device, and storage medium.

Background

Nowadays, the competition is increasingly violent in the rapid development of the internet application product test field, the product function iteration speed of the internet is high, the online frequency of the research and development technology is very high, the quality of the online project needs to be detected after the upper limit of the research and development technology is reached every time, and whether each use case can be normally executed or not is detected, namely whether each use case can be successfully executed or not is detected.

In the prior art, generally, an online project is tested in a manual mode, each use case is tested, each use case with execution failure is determined in a manual screening mode, and then the use cases with execution failure are processed, so that each use case in the online project can be successfully executed.

However, this processing method is high in cost and low in efficiency, and in practical application, due to the fact that false alarm may be caused by test environment, use case design and other factors, a large number of false alarms may affect usability and online efficiency of use cases, and further reduce efficiency.

Disclosure of Invention

In view of this, an object of the present application is to provide a method, an apparatus, a device and a storage medium for processing a test case, which can solve the problems of high test cost and low efficiency in testing a case in the prior art, so as to achieve the effects of improving the test efficiency of the test case and automatically determining a false-alarm test case.

In a first aspect of the present application, the present application provides a test case processing method, where the method includes:

receiving a first example removal notification sent by a first server, wherein the first example removal notification comprises: the method comprises the steps that an identifier of a test case is removed from a first server, the removed test case is a service operation result of a test case set obtained by calling a service task to operate the test case in the first test case set by the first server so as to test a project code to be tested, and the test case with failed service operation is determined from the first test case set;

calling a test task to run a test case in a second test case set to obtain a first test running result of the second test case set;

and if the test operation of the removed test case in the first test operation result fails, determining that the removed test case is a first false-positive test case.

Optionally, the method further comprises:

calling the test task to run the test cases in the second test case set to obtain a second test running result of the second test case set;

if the test operation failure of the test case exists in the second test operation result, determining the test case with the test operation failure as a second false alarm test case;

sending a second example removal notification to the first server, the second example removal notification comprising: and the second case removal notice is used for indicating the first server to execute removal operation on the second false positive test case.

Optionally, the method further comprises:

sending a case repairing notice, wherein the case repairing notice is used for notifying a user to repair the false alarm test case;

receiving an input repaired test case;

and replacing the false alarm test case in the second test case set as the repaired test case.

Optionally, the method further comprises:

calling the test task for multiple times to run the test cases in the second test case set to obtain a third test running result of the second test case set;

if the repaired test case in the third test operation result is successfully tested and operated for a first preset number of times, sending a case replacement notification to the first server, where the case replacement notification includes: the case replacement notification is used for enabling the first server to replace the false-positive test case in the first test case set as the repaired test case, and recovering the operation of the repaired test case.

Optionally, the method further comprises:

and if the stable test cases except the false report test cases in the third test operation result are tested and operated successfully for a second preset number of times, executing removal operation on the stable test cases in the second test case set.

Optionally, the invoking the test task to run the test case in the second test case set includes:

and calling the test task to run the test cases in the second test case set according to the preset interval time.

In a second aspect of the present application, the present application further provides a test case processing method, where the method includes:

calling a service task to run a test case in a first test case set so as to test the project code to be tested to obtain a service running result of the test case set;

according to the service operation result, removing the test case with the service operation failure in the first test case set;

sending a first case removal notification to a second server, the first case removal notification comprising: the first server is used for receiving a test case removing notice, the second server is used for calling a test task to run the test case in the second test case set, a first test running result of the second test case set is obtained, and if the test running of the removed test case in the first test running result fails, the removed test case is determined to be a first false-positive test case.

Optionally, the method further comprises:

receiving a second example removal notification sent by the second server, wherein the second example removal notification comprises: an identification of a second false positive test case; the second false alarm test case is a test case which is determined to fail in test operation according to a second test operation result obtained by the second server calling the test task to operate the test case in the second test case set;

and executing removal operation on the second false alarm test case.

Optionally, the method further comprises:

receiving a use case put-back notification sent by the second server, wherein the use case put-back notification includes: testing cases after repairing;

and replacing the false alarm test case in the first test case set as the repaired test case.

Optionally, the invoking the service task to run the test case in the first test case set to test the project code to be tested to obtain the service running result of the test case set, where the service running result includes:

and responding to the online request of the project code to be tested, and calling the service task to run the test cases in the first test case set.

In a third aspect of the present application, the present application further provides a test case processing apparatus, including: the device comprises a receiving module, a calling module and a determining module, wherein:

the receiving module is configured to receive a first example removal notification sent by a first server, where the first example removal notification includes: the method comprises the steps that an identifier of a test case is removed from a first server, the removed test case is a service operation result of a test case set obtained by calling a service task to operate the test case in the first test case set by the first server so as to test a project code to be tested, and the test case with failed service operation is determined from the first test case set;

the calling module is used for calling a test task to run the test cases in the second test case set to obtain a first test running result of the second test case set;

the determining module is configured to determine that the removed test case is a first false-positive test case if the test operation of the removed test case in the first test operation result fails.

Optionally, the apparatus further comprises: a sending module, wherein:

the calling module is specifically configured to call the test task to run the test cases in the second test case set to obtain a second test running result of the second test case set;

the determining module is specifically configured to determine, if the test operation failure of the test case exists in the second test operation result, that the test case with the test operation failure is a second false positive test case;

the sending module is configured to send a second example removal notification to the first server, where the second example removal notification includes: and the second case removal notice is used for indicating the first server to execute removal operation on the second false positive test case.

Optionally, the apparatus further comprises: a replacement module, wherein:

the sending module is specifically used for sending a case repairing notice, and the case repairing notice is used for informing a user of repairing the false alarm test case;

the receiving module is specifically used for receiving an input repaired test case;

the replacement module is configured to replace the false positive test case in the second test case set with the repaired test case.

Optionally, the invoking module is specifically configured to invoke the test task for multiple times to run the test case in the second test case set, so as to obtain a third test running result of the second test case set;

the sending module is specifically configured to send a case replacement notification to the first server if the repaired test case in the third test operation result is successfully tested and operated for a first preset number of consecutive times, where the case replacement notification includes: the case replacement notification is used for enabling the first server to replace the false-positive test case in the first test case set as the repaired test case, and recovering the operation of the repaired test case.

Optionally, the apparatus further comprises: an ablation module, wherein:

the calling module is specifically configured to call the test task for multiple times to run the test cases in the second test case set, so as to obtain a third test running result of the second test case set;

and the removing module is used for executing removing operation on the stable test cases in the second test case set if the stable test cases except the false report test cases in the third test operation result are tested and operated successfully for a second preset number of times.

Optionally, the invoking module is specifically configured to invoke the test task to run the test case in the second test case set according to a preset interval time.

In a fourth aspect of the present application, the present application further provides a test case processing apparatus, including: the module is transferred, excision module and sending module, wherein:

the calling module is used for calling the service task to run the test case in the first test case set so as to test the project code to be tested to obtain a service running result of the test case set;

the removing module is used for executing removing operation on the test cases with service operation failure in the first test case set according to the service operation result;

the sending module is configured to send a first example removal notification to a second server, where the first example removal notification includes: the first server is used for receiving a test case removing notice, the second server is used for calling a test task to run the test case in the second test case set, a first test running result of the second test case set is obtained, and if the test running of the removed test case in the first test running result fails, the removed test case is determined to be a first false-positive test case.

Optionally, the apparatus further comprises: a receiving module, configured to receive a second example removal notification sent by the second server, where the second example removal notification includes: an identification of a second false positive test case; the second false alarm test case is a test case which is determined to fail in test operation according to a second test operation result obtained by the second server calling the test task to operate the test case in the second test case set;

the removal module is specifically configured to perform removal operations on the second false positive test case.

Optionally, the apparatus further comprises: a replacement module, wherein:

the receiving module is specifically configured to receive a use case put-back notification sent by the second server, where the use case put-back notification includes: and (5) testing the repaired test case.

The replacement module is specifically configured to replace the false-positive test case in the first test case set as the repaired test case.

Optionally, the invoking module is specifically configured to invoke the service task to run the test case in the first test case set in response to the online request of the item code to be tested.

In a fifth aspect of the present application, there is also provided a server comprising: a processor, a storage medium and a bus, wherein the storage medium stores machine-readable instructions executable by the processor, when the server runs, the processor communicates with the storage medium through the bus, and the processor executes the machine-readable instructions to perform the steps of any one of the methods of the first aspect.

In a seventh aspect of the present application, the present application further provides a server, including: a processor, a storage medium and a bus, wherein the storage medium stores machine-readable instructions executable by the processor, the processor and the storage medium communicate with each other through the bus when the server runs, and the processor executes the machine-readable instructions to perform the steps of the method according to any one of the second aspect.

In an eighth aspect of the present application, the present application further provides a test case processing system, including: a first server and a second server; the first server and the second server are communicatively connected, wherein the first server is configured to perform the method of any of the above first aspects, and the second server is configured to perform the method of any of the above second aspects.

In a ninth aspect of the present application, there is also provided a storage medium having stored thereon a computer program which, when executed by a processor, performs the steps of the method according to any one of the above first aspects.

Based on any aspect, by adopting the test case processing method provided by the present application, according to the received first case removal notification sent by the first server, and the test task is called to run the test case in the second test case set to obtain the first test running result, if the first test running result, the test case that failed to run is the same as the removed test case included in the removal notification, determining the removed test case as a first false positive test case, wherein the setting mode is that the first false positive test case in the test cases can be determined through the cooperation between the first server and the second server, therefore, the problems of low efficiency and high cost caused by manual troubleshooting of the false-alarm test cases in the prior art are solved, the test efficiency of the test cases is improved, and the false-alarm test cases can be automatically determined.

Drawings

In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings that are required to be used in the embodiments will be briefly described below, it should be understood that the following drawings only illustrate some embodiments of the present application and therefore should not be considered as limiting the scope, and for those skilled in the art, other related drawings can be obtained from the drawings without inventive effort.

FIG. 1 is a schematic structural diagram of a test case processing system according to an embodiment of the present disclosure;

FIG. 2 is a flowchart illustrating a test case processing method according to an embodiment of the present application;

FIG. 3 is a flowchart illustrating a test case processing method according to another embodiment of the present application;

FIG. 4 is a flowchart illustrating a test case processing method according to another embodiment of the present application;

FIG. 5 is a flowchart illustrating a test case processing method according to another embodiment of the present application;

FIG. 6 is a flowchart illustrating a test case processing method according to another embodiment of the present application;

FIG. 7 is a flowchart illustrating a test case processing method according to another embodiment of the present application;

FIG. 8 is a flowchart illustrating a test case processing method according to another embodiment of the present application;

fig. 9 is a schematic structural diagram of a test case processing apparatus according to an embodiment of the present application;

fig. 10 is a schematic structural diagram of a test case processing apparatus according to another embodiment of the present application;

fig. 11 is a schematic structural diagram of a test case processing apparatus according to another embodiment of the present application;

fig. 12 is a schematic structural diagram of a test case processing apparatus according to another embodiment of the present application;

fig. 13 is a schematic structural diagram of a first server according to an embodiment of the present application;

fig. 14 is a schematic structural diagram of a second server according to an embodiment of the present application.

Detailed Description

In order to make the purpose, technical solutions and advantages of the embodiments of the present application clearer, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it should be understood that the drawings in the present application are for illustrative and descriptive purposes only and are not used to limit the scope of protection of the present application. Additionally, it should be understood that the schematic drawings are not necessarily drawn to scale. The flowcharts used in this application illustrate operations implemented according to some embodiments of the present application. It should be understood that the operations of the flow diagrams may be performed out of order, and steps without logical context may be performed in reverse order or simultaneously. One skilled in the art, under the guidance of this application, may add one or more other operations to, or remove one or more operations from, the flowchart.

In addition, the described embodiments are only a part of the embodiments of the present application, and not all of the embodiments. The components of the embodiments of the present application, generally described and illustrated in the figures herein, can be arranged and designed in a wide variety of different configurations. Thus, the following detailed description of the embodiments of the present application, presented in the accompanying drawings, is not intended to limit the scope of the claimed application, but is merely representative of selected embodiments of the application. All other embodiments, which can be derived by a person skilled in the art from the embodiments of the present application without making any creative effort, shall fall within the protection scope of the present application.

To enable those skilled in the art to utilize the present disclosure, the following embodiments are presented in conjunction with a specific application scenario automation test case scenario. It will be apparent to those skilled in the art that the general principles defined herein may be applied to other embodiments and applications without departing from the spirit and scope of the application.

It should be noted that in the embodiments of the present application, the term "comprising" is used to indicate the presence of the features stated hereinafter, but does not exclude the addition of further features.

For the purpose of facilitating an understanding of the embodiments of the present application, the following partial terms are used in the present application:

automatic use case: serving the online automated test case development.

Removing: and prohibiting the execution of a certain automatic test case, or shielding the execution result of a certain case, which is not on-line sensing.

False alarm: the automatic execution fails, but the failure is not caused by the online code failure at this time but caused by other factors such as test environment, case design and the like, and the failure has no much reference value for intercepting the code failure and belongs to a false-alarm test case.

Jenkins is an open source software project, is a continuous integration tool developed based on Java, is used for monitoring continuous and repeated work, and aims to provide an open and easy-to-use software platform so that software can be continuously integrated.

One aspect of the present application relates to a test case processing system. The system can realize the operation of the first test case set and the second test case set according to the cooperation between the first server and the second server of the user, obtain the removed test case and the first test operation result, and determine the first false-report test case according to the removed test case and the first test operation result, thereby realizing the automatic test of the test case set and the automatic determination of the false-report test case.

It is worth noting that, before the application is filed, the prior art generally tests each case according to an online project in a manual mode, determines each case with execution failure in a manual screening mode, and then processes the case with execution failure, thereby ensuring that each case in the online project can be successfully executed.

The test case processing method provided by the application can remove the notification according to the received first case sent by the first server, and call the test task to run the test case in the second test case set to obtain the first test running result, and if the test case which fails to run in the first test running result is the same as the removed test case in the removal notification, the removed test case is determined to be the first false positive test case.

Fig. 1 is a schematic structural diagram of a test case processing system 100 according to an embodiment of the present application, for example: the test case processing system 100 may be a service for automating test cases, or any platform or scenario involving test cases. As shown in FIG. 1, the test case processing system 100 may include a first server 110 and a second server 120, where the first server 110 and the second server 120 are communicatively coupled.

In some embodiments, first server 110 and second server 120 may each include a processor. In some embodiments, a processor may include one or more processing cores (e.g., a single-core processor (S) or a multi-core processor (M)). Merely by way of example, a Processor may include a Central Processing Unit (CPU), an Application Specific Integrated Circuit (ASIC), an Application Specific Instruction Set Processor (ASIP), a Graphics Processing Unit (GPU), a Physical Processing Unit (PPU), a Digital Signal Processor (DSP), a Field Programmable Gate Array (FPGA), a Programmable Logic Device (PLD), a controller, a microcontroller Unit, a Reduced Instruction Set computer (Reduced Instruction Set computer), a microprocessor, or the like, or any combination thereof.

In some embodiments, the test case processing system 100 may further include a database 130, wherein the database 130 may be connected to a network to communicate with one or more components (e.g., the first server 110, the second server 120, a service provider, etc.) in the test case processing system 100. One or more components in the test case processing system 100 may access data or instructions stored in the database 130 via a network. In some embodiments, the database 130 may be directly connected to one or more components in the test case processing system 100, or the database 130 may be part of the first server 110 or the second server 120.

Illustratively, the first server 110 and the second server 120 are two independent servers, and the first server 110 and the second server 120 may be connected by Remote Procedure Call (RPC) communication, for example, so as to facilitate the service tasks on the first server 110 and the second server 120 to communicate. The first server 110 and the second server 120 are respectively provided with a set of tasks, the two sets of tasks are used for respectively executing two sets of automatic test case sets, and the two servers transmit extracted or returned information in an RPC mode according to the test results of the two sets of automatic test case sets and the service logic. In the implementation process, each server is provided with an idempotent mechanism, and the uniqueness of the transmitted removal information is ensured when RPC retries are caused by problems of networks and the like through the design of the idempotent mechanism; the storage persistence and the data integrity of the removing information are ensured through a pre-Write log system/… … (WAL: Write-Ahead Logging/… …, WAL/AOF) mechanism, and the loss of power failure is avoided.

In an embodiment of the present application, the first Server 110 may be, for example, an odin, which, in a process of a research and development line, if it is detected that a research and development staff deploys and pre-issues a research and development product, for example, a project code to be tested, an open source software project, for example, Jenkins, is called, a service task Server Job is called to run a test case in a first test case combination, so as to test the project code to be tested, and obtain a service running result of the test case combination, and a test case in which a service running failure is determined from the first test case combination is a test case that has been removed; the second server 120 may be, for example, a carrot, and the second server 120 may trigger, according to a preset rule, for example, a preset time interval every interval, that is, to call the Test task Test Job to run the Test case in the second Test case set, so as to obtain a first Test running result of the second Test case set; and determining a first false positive test case according to the first test operation result and the removed test case, wherein the first false positive test case is the removed test case in the first test operation result.

The service task and the test task run independently without interfering with each other, but the second server 120 analyzes the running results of the service task and the test task and communicates the two running results, thereby removing the control case.

The following describes the test case processing method provided in the embodiment of the present application in detail with reference to the content described in the test case processing system 100 shown in fig. 1, where the following test case processing method is applied to the above system, an execution subject may be a service terminal or a server, a preset scene may be designed and adjusted according to user needs, any scene related to automated case testing or case testing may be used, and the two scenes provided in the embodiment are not limited.

Referring to fig. 2, a flowchart of a test case processing method according to an embodiment of the present application is shown, where the method may be executed by a second server, and the method may include:

s101: and receiving a first example removal notice sent by the first server.

Wherein the first example removal notification comprises: the removed test case is a service operation result of the test case set obtained by the first server calling the service task to operate the test case in the first test case set so as to test the project code to be tested, and is a test case determined from the first test case set and having failed service operation. The service task is used for generating a test report of the first test case set and providing a quality evaluation result for research and development online.

S102: and calling the test task to run the test cases in the second test case set to obtain a first test running result of the second test case set.

The first test case set and the second test case set comprise the same test cases, the same test cases are deployed on different servers, and only the second test case set is not controlled by the research and development online; the test task runs the test cases in the second test case set, and obtains a first test running result, wherein the first test running result comprises the identification of each test case and a corresponding running result, for example, if the running is successful, the running is failed. The test task is used for monitoring each test case in the second test case set.

If the test operation of the removed test case in the first test operation result fails, S103 is executed.

S103: and determining the removed test case as a first false alarm test case.

For example, in some possible embodiments, for example, in the first test running result, according to the identifier of the removed test case, the corresponding removed test case in the first test case set is determined according to the identifier, and the running result of the test case is obtained, and if the running result of the test case is a failure, it indicates that the test case fails to run in the tests of the first server and the second server, and it is determined that the removed test case is the first false positive test case.

If the test operation of the test case removed from the first test operation result is successful, the test case may be continuously monitored, for example, the test case is operated for a first preset number of times, where the first preset number of times may be, for example, 3 times, and if the operation result of each time is successful, it is indicated that the test case may stably operate, and at this time, the second server may notify the first server to place the test case back into the first test case set, where the setting of the first preset number of times may be flexibly adjusted according to the user needs, and is not limited by the above embodiment.

By adopting the test case processing method provided by the application, the notification can be removed according to the received first case sent by the first server, the test case in the second test case set can be operated by calling the test task, the first test operation result can be obtained, if the test case which fails to operate in the first test operation result is the same as the removed test case in the removal notification, the removed test case is determined to be the first false-positive test case, and the setting mode enables the first false-positive test case in the test case to be determined through the cooperation between the first server and the second server, so that the problems of low efficiency and high cost caused by manually checking the false-positive test case in the prior art can be solved, the test efficiency of the test case can be improved, and the effect of the false-positive test case can be automatically determined.

Optionally, on the basis of the foregoing embodiment, an embodiment of the present application may further provide a test case processing method, and an implementation process of the foregoing method is described as follows with reference to the accompanying drawings. Fig. 3 is a schematic flowchart of a test case processing method according to another embodiment of the present application, and as shown in fig. 3, the method may further include:

s204: and calling the test task to run the test cases in the second test case set to obtain a second test running result of the second test case set.

For example, in some possible embodiments, the second server may invoke the test task to run the test cases in the second test case set according to a preset interval time, and obtain a second test running result, where the preset interval time may be, for example, 10 minutes, and the like, and the setting of the specific preset interval time may be flexibly adjusted according to a user requirement, and is not limited to the foregoing embodiment.

If the test operation of the test case in the second test operation result fails, S205 is executed.

S205: and determining the test case with the test operation failure as a second false alarm test case.

For example, the first test case set and the second test case combination both include M test cases, and if P test cases fail in the continuous running process of the test task on the combinations of the first test case set and the second test case set, it indicates that the test task digs out false cases in advance, and the number of the cases is P.

S206: a second example removal notification is sent to the first server.

At this time, in order to avoid that the false alarm affects the online of the research and development, the second server needs to send a second example removal notification to the first server, where the second example removal notification includes: the second false-positive test case removing notice is used for indicating the first server to execute removing operation on the second false-positive test case; and removing the P second false alarm test cases by the service task in the first server, wherein the test cases operated in the first test case set operated by the service task only comprise M-P test cases.

For example, in some possible embodiments, if the value of P is too large, for example, the ratio between P and M is greater than a preset ratio, for example, may be 40%, this indicates that there may be a significant fault in the test case, at this time, the problem may not be solved by removing the test case, and a manual troubleshooting is required, at this time, the test will not be performed again, and the manual troubleshooting stage is entered, it should be understood that the preset ratio may be flexibly adjusted according to the user's needs, and may also be any ratio such as 10% or 30%, and is not limited to the ratios given in the above embodiments.

By the arrangement mode, the second server can mine the second test case set in advance, mine a second false-alarm test case which is mistakenly reported in the second test case set in advance, and feed back the second false-alarm test case to the first server in time, so that the problem that the research and development line is influenced by the false alarm is solved.

Optionally, on the basis of the foregoing embodiment, an embodiment of the present application may further provide a test case processing method, and an implementation process of the foregoing method is described as follows with reference to the accompanying drawings. Fig. 4 is a schematic flowchart of a test case processing method according to another embodiment of the present application, and as shown in fig. 4, the method may further include:

s207: and sending a case repairing notice, wherein the case repairing notice is used for informing a user to repair the false alarm test case.

The false-positive test case can be a first false-positive test case or a second false-positive test case, and the sent case repairing notice is used for informing a troubleshooting worker to manually inspect and repair the false-positive test case.

S208: and receiving an input repaired test case.

In some possible embodiments, for example, the repaired test case may be uploaded to the second server by a troubleshooting worker.

S209: and replacing the false alarm test case in the second test case set as the repaired test case.

In some possible embodiments, after the false positive test case in the second test case set is replaced with the repaired test case, the test task may be called again for multiple times to run the test case in the second test case set, so as to obtain a third test running result of the second test case set; if the repaired test case in the third test operation result is successfully tested and operated for the first preset times, it is indicated that the repaired test case is stably operated and returned, and at this time, a case returning notification is sent to the first server, where the case returning notification includes: and the case playback notice is used for enabling the first server to replace the false-positive test case in the first test case set as the repaired test case and recovering the operation of the repaired test case.

If the running result is successful and the number of times of successful running is greater than the first preset number of times, for example, 3 times, the second server sends a case put back notification to the first server at this time, so that the service task in the first server replaces the false-positive test case in the first test case set with the repaired test case and resumes the running of the repaired test case.

Optionally, on the basis of the foregoing embodiment, an embodiment of the present application may further provide a test case processing method, and an implementation process of the foregoing method is described as follows with reference to the accompanying drawings. Fig. 5 is a schematic flowchart of a test case processing method according to another embodiment of the present application, and as shown in fig. 5, the method may further include:

s210: and calling the test task for multiple times to run the test cases in the second test case set to obtain a third test running result of the second test case set.

If the stable test cases except the false-report test case in the third test operation result are successfully tested and operated for the second preset times, S211 is executed.

S211: and executing the removing operation on the stable test case in the second test case set.

Optionally, in an embodiment of the application, the second preset number of times may be, for example, 1000 times, that is, if the second test case set has 1000 consecutive times and the test results are all successful test cases, it is determined that the test case can continuously and stably run, and the test case can be removed from the second test case set, so as to reduce a load of a test task.

By adopting the test case processing method provided by the application, the removal notification can be sent according to the received first case sent by the first server, the test case in the second test case set is operated by calling the test task, the first test operation result is obtained, and if the test case which fails to operate in the first test operation result is the same as the removed test case in the removal notification, the removed test case is determined to be the first false-positive test case; in addition, the second server can test the second test case according to the preset interval, the test case which fails to operate is determined to be a second false-positive test case, a second false-positive notification is sent to the first server, the first server is notified to remove the second false-positive test case from the first test case set, and the setting mode enables the method provided by the application to determine the first false-positive test case in the test case through the cooperation between the first server and the second server, so that the problems of low efficiency and high cost caused by manual false-positive test case detection in the prior art are solved, the test efficiency of the test case is improved, and the effect of the false-positive test case can be automatically determined.

Optionally, on the basis of the foregoing embodiment, an embodiment of the present application may further provide a test case processing method, and an implementation process of the foregoing method is described as follows with reference to the accompanying drawings. Fig. 6 is a flowchart illustrating a test case processing method according to another embodiment of the present application, where the method is applied to a first server, and as shown in fig. 6, the method may include:

s301: and calling the service task to run the test case in the first test case set so as to test the project code to be tested to obtain a service running result of the test case set.

Optionally, in an embodiment of the present application, the first server responds to an online request of the item code to be tested, and then invokes the service task to run the test case in the first test case set.

S302: and according to the service operation result, removing the test case with the service operation failure in the first test case set.

S303: a first example removal notification is sent to a second server.

Wherein the first example removal notification comprises: the first instance removal notification is used for enabling the second server to call a test task to run the test cases in the second test case set to obtain a first test running result of the second test case set, and if the test running of the removed test cases in the first test running result fails, the removed test cases are determined to be first false-positive test cases.

The above method is a method for executing a main body on the opposite side of the method provided in fig. 1 to 5, and therefore, the beneficial effects are the same as those of the method provided in fig. 1 to 5, and are not described herein again.

Optionally, on the basis of the foregoing embodiment, an embodiment of the present application may further provide a test case processing method, and an implementation process of the foregoing method is described as follows with reference to the accompanying drawings. Fig. 7 is a schematic flowchart of a test case processing method according to another embodiment of the present application, and as shown in fig. 7, the method may further include:

s304: and receiving a second example removal notification sent by the second server.

Wherein the second example removal notification comprises: an identification of a second false positive test case; the second false-report test case is a test case which is determined to fail in test operation according to a second test operation result obtained by the second server calling the test task to operate the second test case set.

S305: and executing removal operation on the second false alarm test case.

Optionally, on the basis of the foregoing embodiment, an embodiment of the present application may further provide a test case processing method, and an implementation process of the foregoing method is described as follows with reference to the accompanying drawings. Fig. 8 is a schematic flowchart of a test case processing method according to another embodiment of the present application, and as shown in fig. 8, the method may further include:

s306: and receiving a use case put back notification sent by the second server.

Wherein the use case put back notification comprises: and (5) testing the repaired test case.

S307: and replacing the false-positive test case in the first test case set as the repaired test case.

Based on the same inventive concept, a test case processing apparatus corresponding to the test case processing method is also provided in the embodiments of the present application, and since the principle of solving the problem of the apparatus in the embodiments of the present application is similar to that of the test case processing method in fig. 1 to 5 in the embodiments of the present application, the implementation of the apparatus may refer to the implementation of the method, and the repeated points of the beneficial effects are not described again.

Fig. 9 is a schematic structural diagram of a test case processing apparatus according to an embodiment of the present application, and as shown in fig. 9, the apparatus includes: a receiving module 401, a calling module 402 and a determining module 403, wherein:

a receiving module 401, configured to receive a first example removal notification sent by a first server, where the first example removal notification includes: the method comprises the steps that the identification of a test case is removed from a first server, the removed test case is a service operation result of a test case set obtained by calling a service task to operate the test case in a first test case set so as to test a project code to be tested, and the test case with service operation failure is determined from the first test case set.

The calling module 402 is configured to call the test task to run the test case in the second test case set, so as to obtain a first test running result of the second test case set.

The determining module 403 is configured to determine that the removed test case is the first false-positive test case if the test operation of the removed test case in the first test operation result fails.

Fig. 10 is a schematic structural diagram of a test case processing apparatus according to another embodiment of the present application, and as shown in fig. 10, the apparatus further includes: a sending module 404, wherein:

the calling module 402 is specifically configured to call the test task to run the test cases in the second test case set, so as to obtain a second test running result of the second test case set;

the determining module 403 is specifically configured to determine, if the test operation failure of the test case exists in the second test operation result, that the test case with the test operation failure is a second false positive test case;

a sending module 404, configured to send a second example removal notification to the first server, where the second example removal notification includes: and the second case removal notice is used for indicating the first server to execute removal operation on the second false positive test case.

As shown in fig. 10, the apparatus further includes: an alternate module 405, wherein:

the sending module 404 is specifically configured to send a case repairing notification, where the case repairing notification is used to notify a user of repairing the false-positive test case.

The receiving module 401 is specifically configured to receive an input repaired test case.

And a replacing module 405, configured to replace the false positive test case in the second test case set as a repaired test case.

Optionally, the invoking module 402 is specifically configured to invoke the test task multiple times to run the test case in the second test case set, so as to obtain a third test running result of the second test case set.

The sending module 404 is specifically configured to send a case replacement notification to the first server if the repaired test case in the third test operation result is successfully tested and operated for a first preset number of consecutive times, where the case replacement notification includes: and the case playback notice is used for enabling the first server to replace the false-positive test case in the first test case set as the repaired test case and recovering the operation of the repaired test case.

As shown in fig. 10, the apparatus further includes: an ablation module 406, wherein:

the invoking module 402 is specifically configured to invoke the test task multiple times to execute the test case in the second test case set, so as to obtain a third test execution result of the second test case set.

And the removing module 406 is configured to, if the stable test cases other than the false-report test case in the third test operation result are successfully tested and operated for the second preset number of times, perform removing operation on the stable test case in the second test case set.

Optionally, the invoking module 402 is specifically configured to invoke the test task to run the test case in the second test case set according to the preset interval time.

Based on the same inventive concept, a test case processing apparatus corresponding to the test case processing method is also provided in the embodiments of the present application, and since the principle of solving the problem of the apparatus in the embodiments of the present application is similar to that of the test case processing method in fig. 6 to 8 described above in the embodiments of the present application, the implementation of the apparatus may refer to the implementation of the method, and the repeated portions of the beneficial effects are not described again.

Fig. 11 is a schematic structural diagram of a test case processing apparatus according to another embodiment of the present application, and as shown in fig. 11, the apparatus includes: a calling module 501, a removing module 502 and a sending module 503, wherein:

the invoking module 501 is configured to invoke a service task to execute a test case in the first test case set so as to test a test item code to be tested, so as to obtain a service operation result of the test case set.

The removing module 502 is configured to perform a removing operation on a test case in the first test case set, where the service operation fails, according to the service operation result.

A sending module 503, configured to send a first example removal notification to the second server, where the first example removal notification includes: the first instance removal notification is used for enabling the second server to call a test task to run the test cases in the second test case set to obtain a first test running result of the second test case set, and if the test running of the removed test cases in the first test running result fails, the removed test cases are determined to be first false-positive test cases.

Fig. 12 is a schematic structural diagram of a test case processing apparatus according to another embodiment of the present application, and as shown in fig. 12, the apparatus further includes: a receiving module 504, configured to receive a second example removal notification sent by a second server, where the second example removal notification includes: an identification of a second false positive test case; the second false-report test case is a test case which is determined to fail in test operation according to a second test operation result obtained by the second server calling the test task to operate the second test case set.

The removal module 502 is specifically configured to perform a removal operation on the second false positive test case.

As shown in fig. 12, the apparatus further includes: a replacement module 505, wherein:

the receiving module 504 is specifically configured to receive a use case put-back notification sent by the second server, where the use case put-back notification includes: and (5) testing the repaired test case.

The replacing module 505 is specifically configured to replace the false positive test case in the first test case set as the repaired test case.

Optionally, the invoking module 501 is specifically configured to invoke a service task to run a test case in the first test case set in response to an online request of the item code to be tested.

Fig. 13 is a schematic structural diagram of a first server according to an embodiment of the present application, and as shown in fig. 8, the first server includes: a processor 601, a memory 602, and a bus 603; the memory 602 stores machine-readable instructions executable by the processor 601, the processor 601 and the memory 602 communicate via the bus 603 when the first server is running, and the processor 601 executes the machine-readable instructions to perform the steps of the test case processing method as provided in the foregoing method embodiments of fig. 1-5.

Specifically, the machine readable instructions stored in the memory 602 are execution steps of the test case processing method according to the foregoing embodiment of the present application, and the processor 601 can execute the test case processing method to process the test case set, so that the first server also has all the beneficial effects described in the foregoing embodiment of the method, and the description of the present application is not repeated.

It should be noted that the first server may be a general-purpose computer or a special-purpose computer, and other servers for processing data, and the like, and all of the three may be used to implement the first server method of the present application. Although the first server method has been described only with respect to a computer and a server, respectively, for convenience, the functions described herein may be implemented in a distributed manner on a plurality of similar platforms to balance processing loads.

For example, memory 602 may include one or more processors for executing program instructions, a communication bus, and different forms of storage media, such as a disk, ROM, or RAM, or any combination thereof. Illustratively, the computer platform may also include program instructions stored in ROM, RAM, or other types of non-transitory storage media, or any combination thereof. The method of the present application may be implemented in accordance with these program instructions.

For ease of illustration, only one processor is described in the above embodiments. However, it should be noted that the first server in the present application may also include a plurality of processors, and thus, the steps performed by one processor described in the present application may also be performed by a plurality of processors in combination or individually.

Fig. 14 is a schematic structural diagram of a second server according to an embodiment of the present application, and as shown in fig. 14, the second server includes: a processor 701, a memory 702, and a bus 703; the memory 702 stores machine-readable instructions executable by the processor 701, and when the second server is running, the processor 701 communicates with the memory 702 through the bus 703, and the processor 701 executes the machine-readable instructions to perform the steps of the test case processing method as provided in the foregoing method embodiments fig. 6-8.

Specifically, the machine readable instructions stored in the memory 702 are execution steps of the test case processing method according to the foregoing embodiment of the present application, and the processor 701 can execute the test case processing method to process the test case set, so that the second server also has all the beneficial effects described in the foregoing method embodiment, and the description of the present application is not repeated.

The second server may be a general-purpose computer, a special-purpose computer, or other servers for processing data, and all of the three may be used to implement the second server method of the present application. Although the second server method has been described only by the computer and the server, respectively, for convenience, the functions described herein may be implemented in a distributed manner on a plurality of similar platforms to balance the processing load.

For example, memory 702 may include one or more processors for executing program instructions, a communication bus, and different forms of storage media, such as a disk, ROM, or RAM, or any combination thereof. Illustratively, the computer platform may also include program instructions stored in ROM, RAM, or other types of non-transitory storage media, or any combination thereof. The method of the present application may be implemented in accordance with these program instructions.

For ease of illustration, only one processor is described in the above embodiments. However, it should be noted that the second server in the present application may also comprise a plurality of processors, and thus the steps performed by one processor described in the present application may also be performed by a plurality of processors in combination or individually.

The embodiment of the present application further provides a storage medium, on which a computer program is stored, and the computer program, when executed by a processor, performs the steps of the methods provided in fig. 1 to 8.

Specifically, the storage medium can be a general-purpose storage medium, such as a removable disk, a hard disk, and the like, and when a computer program on the storage medium is executed, the method provided in fig. 1 to 8 can be executed, so that the problems of high cost and low efficiency in testing a case in the prior art are solved.

It can be clearly understood by those skilled in the art that, for convenience and brevity of description, the specific working processes of the system and the apparatus described above may refer to corresponding processes in the method embodiments, and are not described in detail in this application. In the several embodiments provided in the present application, it should be understood that the disclosed system, apparatus and method may be implemented in other ways. The above-described apparatus embodiments are merely illustrative, and for example, the division of the modules is merely a logical division, and there may be other divisions in actual implementation, and for example, a plurality of modules or components may be combined or integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection of devices or modules through some communication interfaces, and may be in an electrical, mechanical or other form.

The modules described as separate parts may or may not be physically separate, and parts displayed as modules may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.

In addition, functional units in the embodiments of the present application may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit.

The functions, if implemented in the form of software functional units and sold or used as a stand-alone product, may be stored in a non-volatile computer-readable storage medium executable by a processor. Based on such understanding, the technical solution of the present application or portions thereof that substantially contribute to the prior art may be embodied in the form of a software product stored in a storage medium and including instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the method according to the embodiments of the present application. And the aforementioned storage medium includes: various media capable of storing program codes, such as a U disk, a removable hard disk, a ROM, a RAM, a magnetic disk, or an optical disk.

The above description is only for the specific embodiments of the present application, but the scope of the present application is not limited thereto, and any person skilled in the art can easily conceive of the changes or substitutions within the technical scope of the present application, and shall be covered by the scope of the present application. Therefore, the protection scope of the present application shall be subject to the protection scope of the claims.

Claims

1. A test case processing method, the method comprising:

2. The method of claim 1, wherein the method further comprises:

3. The method of claim 2, wherein the method further comprises:

receiving an input repaired test case;

4. The method of claim 3, wherein the method further comprises:

5. The method of claim 1, wherein the method further comprises:

6. The method of any of claims 1-5, wherein invoking the test task to run the test cases in the second set of test cases comprises:

7. A test case processing method, the method comprising:

sending a first case removal notification to a second server, the first case removal notification comprising: the method comprises the steps that an identifier of a removed test case in a first server is removed, a first case removal notice is used for enabling a second server to call a test task to run the test case in a second test case set, a first test running result of the second test case set is obtained, and if the test running of the removed test case in the first test running result fails, the removed test case is determined to be a first false-positive test case.

8. The method of claim 7, wherein the method further comprises:

and executing removal operation on the second false alarm test case.

9. The method of claim 7, wherein the method further comprises:

10. The method according to any one of claims 7 to 9, wherein the invoking of the service task to execute the test case in the first test case set to test the project code to be tested to obtain the service execution result of the test case set, comprises:

11. A test case processing apparatus, the apparatus comprising: the device comprises a receiving module, a calling module and a determining module, wherein:

12. A test case processing apparatus, the apparatus comprising: the module is transferred, excision module and sending module, wherein:

the sending module is configured to send a first example removal notification to a second server, where the first example removal notification includes: the method comprises the steps that an identifier of a removed test case in a first server is removed, a first case removal notice is used for enabling a second server to call a test task to run the test case in a second test case set, a first test running result of the second test case set is obtained, and if the test running of the removed test case in the first test running result fails, the removed test case is determined to be a first false-positive test case.

13. A server, characterized in that the server comprises: a processor, a storage medium and a bus, the storage medium storing machine-readable instructions executable by the processor, the processor and the storage medium communicating via the bus when the server is running, the processor executing the machine-readable instructions to perform the method of any of claims 1-6.

14. A server, characterized in that the server comprises: a processor, a storage medium and a bus, the storage medium storing machine-readable instructions executable by the processor, the processor and the storage medium communicating via the bus when the server is running, the processor executing the machine-readable instructions to perform the method of any one of claims 7-10.

15. A test case processing system, comprising: a first server and a second server; the first server and the second server are communicatively connected, wherein the first server is configured to perform the method of any of the preceding claims 1 to 6, and the second server is configured to perform the method of any of the preceding claims 7 to 10.

16. A storage medium, characterized in that the storage medium has stored thereon a computer program which, when being executed by a processor, performs the method of any of the preceding claims 1-10.