CN114301760A

CN114301760A - Test method, test device, electronic equipment and storage medium

Info

Publication number: CN114301760A
Application number: CN202111556008.2A
Authority: CN
Inventors: 苗星
Original assignee: Beijing Dajia Internet Information Technology Co Ltd
Current assignee: Beijing Dajia Internet Information Technology Co Ltd
Priority date: 2021-12-17
Filing date: 2021-12-17
Publication date: 2022-04-08

Abstract

The present disclosure relates to a testing method, an apparatus, an electronic device, and a storage medium, which can improve efficiency of triggering a flow load test for stopping a data flow and reduce cost when the flow load test for the data flow is performed on a system. The specific scheme comprises the following steps: acquiring target data in the process of carrying out a flow load test task of a data flow on a target system; the target data is used to indicate at least one of: client data transmission parameters and server data transmission parameters; and based on the target data, interrupting the transmission of the virtual test data stream under the condition that the flow load test task is determined to have abnormity through a first preset rule.

Description

Test method, test device, electronic equipment and storage medium

Technical Field

The present disclosure relates to the field of network technologies, and in particular, to a testing method and apparatus, an electronic device, and a storage medium.

Background

The pressure test aiming at the performance of the system is an important means for exploring the performance bottleneck of the system and ensuring the stability of the system so as to quickly verify the stability and the error handling capability of the system under the high-strength load. When a system is subjected to pressure testing, the system is in a high-load state, and stability problems are easily caused in a processed service and a downstream link thereof, so that service requests of real online users are damaged, and if the pressure testing of the system cannot be stopped in time (namely the input of pressure measurement flow is stopped), the influence is enlarged, and larger system faults are caused.

When the test service executed in the system and the monitoring alarm of the core service in the downstream link must be observed manually in real time currently, the pressure test stopping task is triggered manually, and the input of the pressure test flow is stopped from the client (namely, the pressure test engine).

However, in the above scheme, a lot of core services are usually involved in the process of performing the pressure test on the whole link corresponding to the system, a lot of labor cost is consumed by the operation and maintenance personnel to monitor and alarm in real time, and the cost consumed in the whole pressure test process is high; moreover, the operation and maintenance personnel observe the alarm, the timeliness of the manual pressure test stopping task is poor, and the damage can not be effectively stopped in time. Therefore, when the system is subjected to pressure testing, the efficiency of triggering to stop the pressure testing task is low, and the cost is high.

Disclosure of Invention

The present disclosure provides a testing method, an apparatus, an electronic device, and a storage medium, which can improve efficiency of triggering a flow load test for stopping a data flow and reduce cost when the flow load test for the data flow is performed on a system. The technical scheme of the disclosure is as follows:

according to a first aspect of the present disclosure, there is provided a test method, the method comprising: acquiring target data in the process of carrying out a flow load test task of a data flow on a target system; the data stream includes: virtual test data flow and real service data flow; the target data is used to indicate at least one of: client data transmission parameters and server data transmission parameters; and based on the target data, interrupting the transmission of the virtual test data stream under the condition that the flow load test task is determined to have abnormity through a first preset rule.

As can be seen from the above, in the process of performing the traffic load test task of the data stream on the target system, the client data transmission parameter and/or the server data transmission parameter may be obtained in real time, so as to determine whether the traffic load test task is abnormal or not through the first preset rule based on the client data transmission parameter and/or the server data transmission parameter, so that the transmission of the virtual test data stream may be interrupted in time under the condition that the traffic load test task is determined to be abnormal through the first preset rule. By the implementation mode, the state of the traffic load test task of the data stream to the target system can be monitored in real time, so that the transmission of the virtual test data stream is interrupted in time when the traffic load test task is abnormal, the execution of the traffic load test task of the data stream to the target system is flexibly controlled, and the problem that the traffic load test task causes system abnormity to the target system is prevented. Therefore, when the flow load test of the data flow is carried out on the system, the efficiency of triggering and stopping the flow load test of the data flow is improved, and the triggering cost is reduced.

Optionally, the method for "interrupting transmission of the virtual test data stream when it is determined that the traffic load test task is abnormal according to the first preset rule based on the target data" specifically includes: and under the condition that the target data meets the first threshold value condition through the first preset rule, determining that the traffic load testing task is abnormal, and interrupting the transmission of the virtual testing data stream.

As can be seen from the above, it can be specifically determined that the traffic load test task is abnormal under the condition that the target data meets the first threshold condition according to the first preset rule, so as to interrupt transmission of the virtual test data stream. By the implementation mode, whether the traffic load testing task is abnormal or not can be accurately determined through specific threshold conditions, and the accuracy of interrupting the transmission of the virtual testing data stream is improved.

Optionally, the method further comprises: and determining that the flow load test task is abnormal and giving an alarm prompt under the condition that the target data meets the second threshold value condition through a second preset rule.

According to the above, it can be further determined that the traffic load testing task is abnormal under the condition that the target data meets the second threshold condition through the second preset rule, so as to give an alarm prompt. By the aid of the implementation mode, the accuracy of determining the flow load test task to have the abnormity can be further improved.

Optionally, the method for acquiring the target data in the process of performing the traffic load test task of the data stream on the target system specifically includes: acquiring basic data in the process of carrying out a flow load test task of a data flow on a target system; carrying out data processing on the basic data to obtain target data; the target data is data meeting the matching rules of the first preset rule and the second preset rule.

As can be seen from the above, the target data is obtained by performing data processing on the pre-acquired basic data, so that the target data is data that meets the matching rule corresponding to the first preset rule and the second preset rule. Through the implementation mode, the data input into the first preset rule and the second preset rule can be matched, so that the accuracy of determining that the flow load test task has the abnormity can be improved.

Optionally, the client data transmission parameters include at least one of the following types: data transmission delay, query rate per second QPS and interface success rate; the server data transmission parameters include at least one of the following types: service availability data, Central Processing Unit (CPU) data, memory display program (MEM) data and network data; the method for interrupting transmission of the virtual test data stream when it is determined that the traffic load test task is abnormal according to the first preset rule based on the target data specifically includes: under the condition that any type of data included in the target data meets a first threshold value condition through a first preset rule, determining that a traffic load test task is abnormal, and interrupting the transmission of a virtual test data stream; or determining that the traffic load test task is abnormal and interrupting the transmission of the virtual test data stream under the condition that at least two types of data included in the target data meet a first threshold condition through a first preset rule; or, under the condition that any type of data included in the target data meets the first threshold value condition through the first preset rule for multiple times continuously, determining that the traffic load test task is abnormal, and interrupting the transmission of the virtual test data stream.

As can be seen from the above, it can be determined whether the data included in the target data satisfies the first threshold condition in various ways to determine whether the traffic load test task has an anomaly, thereby determining whether to interrupt the transmission of the virtual test data stream. By the implementation mode, the diversity of determining whether the traffic load testing task has the abnormity can be improved.

Optionally, the method further comprises: adding mark information to a virtual test data stream corresponding to the traffic load test task; the marking information is used for identifying the virtual test data stream by the server.

As can be seen from the above, the server may identify the virtual test data stream included in the received data stream by adding the mark information to the virtual test data stream corresponding to the traffic load testing task.

Optionally, the target data comprises server data transmission parameters; the method for interrupting transmission of the virtual test data stream when it is determined that the traffic load test task is abnormal according to the first preset rule based on the target data specifically includes: and based on the server data transmission parameters, under the condition that the flow load test task is determined to be abnormal through a first preset rule, controlling the server to stop receiving the virtual test data flow according to the marking information.

As can be seen from the above, in the case that it is determined that the traffic load test task is abnormal through the first preset rule, the server may identify the virtual test data stream included in the received data stream according to the flag information, and stop receiving the virtual test data stream to interrupt transmission of the virtual test data stream. By this implementation, the accuracy of interrupting the transmission of the virtual test data stream may be improved.

Optionally, before the "acquiring the target data during the task of testing the traffic load of the data stream on the target system", the method further includes: acquiring historical data; the historical data is data corresponding to a plurality of times of flow load testing tasks performed on the target system before the current moment, and the historical data comprises at least one of the following items: historical test results, historical client data transmission parameters and historical server data transmission parameters; determining reference data corresponding to the target system according to the historical data; based on the reference data and the preset coefficient, a first threshold condition and a second threshold condition are determined.

As can be seen from the above, before the current time, historical data corresponding to a traffic load test task performed on the target system for multiple times may be obtained, so as to determine reference data corresponding to the target system through the historical data, thereby determining the first threshold condition and the second threshold condition. By the implementation mode, the accuracy of determining whether the traffic load test task has the abnormity can be improved, so that the accuracy of interrupting the transmission of the virtual test data stream is improved.

According to a second aspect of the present disclosure, there is provided a test apparatus comprising: an acquisition unit and a processing unit; the system comprises an acquisition unit, a processing unit and a processing unit, wherein the acquisition unit is configured to acquire target data in the process of executing a flow load test task of data flow on a target system; the data stream includes: virtual test data flow and real service data flow; the target data is used to indicate at least one of: client data transmission parameters and server data transmission parameters; and the processing unit is configured to interrupt the transmission of the virtual test data flow under the condition that the flow load test task is determined to have an abnormity through a first preset rule based on the target data.

Optionally, the processing unit is configured to determine that the traffic load testing task has an exception and interrupt transmission of the virtual testing data stream if it is determined that the target data meets the first threshold condition through the first preset rule.

Optionally, the processing unit is configured to determine that the traffic load testing task is abnormal and perform alarm prompting when it is determined that the target data meets the second threshold condition through a second preset rule.

Optionally, the obtaining unit is configured to obtain the basic data during a process of performing a traffic load test task of a data stream on the target system; the processing unit is configured to execute data processing on the basic data to obtain target data; the target data is data meeting the matching rules of the first preset rule and the second preset rule.

Optionally, the client data transmission parameters include at least one of the following types: data transmission delay, query rate per second QPS and interface success rate; the server data transmission parameters include at least one of the following types: service availability data, Central Processing Unit (CPU) data, memory display program (MEM) data and network data; the processing unit is configured to determine that the traffic load testing task is abnormal and interrupt the transmission of the virtual testing data stream under the condition that any type of data included in the target data meets a first threshold value condition through a first preset rule; or, the processing unit is configured to determine that the traffic load test task is abnormal and interrupt transmission of the virtual test data stream if it is determined that at least two types of data included in the target data satisfy a first threshold condition through a first preset rule; or, the processing unit is configured to determine that the traffic load testing task has an abnormality and interrupt transmission of the virtual testing data stream if it is determined that any type of data included in the target data meets the first threshold condition through the first preset rule for a plurality of times in succession.

Optionally, the processing unit is configured to add mark information to the virtual test data stream corresponding to the traffic load testing task; the marking information is used for identifying the virtual test data stream by the server.

Optionally, the target data comprises server data transmission parameters; and the processing unit is configured to execute controlling the server to stop receiving the virtual test data stream according to the mark information under the condition that the flow load test task is determined to have abnormity through a first preset rule based on the server data transmission parameters.

Optionally, an obtaining unit configured to perform obtaining the history data; the historical data is data corresponding to a plurality of times of flow load testing tasks performed on the target system before the current moment, and the historical data comprises at least one of the following items: historical test results, historical client data transmission parameters and historical server data transmission parameters; the determining unit is configured to determine reference data corresponding to the target system according to the historical data; a determination unit configured to perform determining a first threshold condition and a second threshold condition based on the reference data and a preset coefficient.

According to a third aspect of the present disclosure, there is provided an electronic apparatus comprising:

a processor; a memory for storing processor-executable instructions; wherein the processor is configured to execute the instructions to implement any of the above described alternative testing methods of the first aspect.

According to a fourth aspect of the present disclosure, there is provided a computer-readable storage medium having instructions stored thereon, which, when executed by a processor of an electronic device, enable the electronic device to perform any one of the above-described first aspect optional testing methods.

According to a fifth aspect of the present disclosure, there is provided a computer program product containing instructions which, when run on a computer, cause the computer to perform the optional testing method of any one of the first aspects.

According to a sixth aspect of the present disclosure, there is provided a chip comprising a processor and a communication interface, the communication interface being coupled to the processor, the processor being configured to execute a computer program or instructions to implement the optional testing method as in any one of the first aspects.

The technical scheme provided by the disclosure at least brings the following beneficial effects:

based on any one of the above aspects, in the present disclosure, in the process of performing the traffic load test task of the data stream on the target system, the client data transmission parameter and/or the server data transmission parameter may be obtained in real time, so as to determine whether the traffic load test task is abnormal or not through the first preset rule based on the client data transmission parameter and/or the server data transmission parameter, so that the transmission of the virtual test data stream may be interrupted in time under the condition that the traffic load test task is determined to be abnormal through the first preset rule. By the implementation mode, the state of the traffic load test task of the data stream to the target system can be monitored in real time, so that the transmission of the virtual test data stream is interrupted in time when the traffic load test task is abnormal, the execution of the traffic load test task of the data stream to the target system is flexibly controlled, and the problem that the traffic load test task causes system abnormity to the target system is prevented. Therefore, when the flow load test of the data flow is carried out on the system, the efficiency of triggering and stopping the flow load test of the data flow is improved, and the triggering cost is reduced.

It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the disclosure.

Drawings

The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and, together with the description, serve to explain the principles of the disclosure and are not to be construed as limiting the disclosure.

FIG. 1 is a schematic diagram of a prior art test system shown in accordance with an embodiment of the present disclosure;

FIG. 2 is a schematic diagram illustrating a test system according to an embodiment of the present disclosure;

FIG. 3 is a schematic flow chart diagram illustrating a testing method according to an embodiment of the present disclosure;

FIG. 4 is a schematic flow chart diagram illustrating another testing method according to an embodiment of the present disclosure;

FIG. 5 is a schematic flow chart diagram illustrating yet another testing method according to an embodiment of the present disclosure;

FIG. 6 is a schematic diagram of another test system shown in accordance with an embodiment of the present disclosure;

FIG. 7 is a schematic flow chart diagram illustrating yet another testing method according to an embodiment of the present disclosure;

FIG. 8 is a diagram illustrating a preset rule corresponding to a testing method according to an embodiment of the disclosure;

FIG. 9 is a schematic flow chart diagram illustrating yet another testing method according to an embodiment of the present disclosure;

FIG. 10 is a schematic diagram illustrating yet another test system according to an embodiment of the present disclosure;

FIG. 11 is a schematic flow chart diagram illustrating yet another testing method according to an embodiment of the present disclosure;

FIG. 12 is a schematic diagram illustrating a configuration of a testing device according to an embodiment of the present disclosure;

fig. 13 is a schematic structural diagram illustrating another testing apparatus according to an embodiment of the present disclosure.

Detailed Description

In order to make the technical solutions of the present disclosure better understood by those of ordinary skill in the art, the technical solutions in the embodiments of the present disclosure will be clearly and completely described below with reference to the accompanying drawings.

It should be noted that the terms "first," "second," and the like in the description and claims of the present disclosure and in the above-described drawings are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used is interchangeable under appropriate circumstances such that the embodiments of the disclosure described herein are capable of operation in sequences other than those illustrated or otherwise described herein. The implementations described in the exemplary embodiments below are not intended to represent all implementations consistent with the present disclosure. Rather, they are merely examples of apparatus and methods consistent with certain aspects of the present disclosure, as detailed in the appended claims.

First, an application scenario of the embodiment of the present disclosure is described. In the prior art, during a process of performing a flow load testing task (pressure testing) on a system, an operation and maintenance person may manually trigger and terminate the flow load testing task, specifically, as shown in fig. 1, when the flow load testing task is performed on the system, the operation and maintenance person observes an operation condition of the system and an operation condition corresponding to a downstream link corresponding to a server in real time, when an alarm is triggered due to an abnormality of the system or the downstream link, the operation and maintenance person manually triggers and terminates the flow load testing task in time, and terminates input of a pressure testing flow (virtual testing flow) from a client. Under the condition, the operation condition of the system and the operation condition corresponding to the downstream link corresponding to the server are monitored in real time by the operation and maintenance personnel, a large amount of human resource cost needs to be consumed, and the timeliness of the flow load testing task is poor when the operation and maintenance personnel manually trigger and terminate the operation condition. In another case, the error rate of the interface corresponding to the system may be determined, and when the error rate reaches a threshold within a certain time, the task of performing the traffic load test may be automatically terminated. However, in this case, after the system has an abnormal problem, the traffic load testing task can be terminated, and the abnormal problem of the core service in the downstream link of the server is sometimes hard to be reflected in the error rate, so that the timeliness of performing the traffic load testing task is poor.

In order to solve the above problem, an embodiment of the present disclosure provides a testing method, which may obtain a client data transmission parameter and/or a server data transmission parameter in real time during a process of performing a traffic load testing task on a target system, so as to determine whether a traffic load testing task is abnormal or not according to a first preset rule based on the client data transmission parameter and/or the server data transmission parameter, so that transmission of a virtual testing data stream may be interrupted in time when it is determined that the traffic load testing task is abnormal according to the first preset rule. By the implementation mode, the state of the traffic load test task of the data stream to the target system can be monitored in real time, so that the transmission of the virtual test data stream is interrupted in time when the traffic load test task is abnormal, the execution of the traffic load test task of the data stream to the target system is flexibly controlled, and the problem that the traffic load test task causes system abnormity to the target system is prevented. Therefore, when the flow load test of the data flow is carried out on the system, the efficiency of triggering and stopping the flow load test of the data flow is improved, and the triggering cost is reduced.

The content display method provided by the embodiment of the disclosure is exemplarily described below with reference to the accompanying drawings:

fig. 2 is a schematic diagram of a testing system provided by an embodiment of the present disclosure, and as shown in fig. 2, the testing system may include a server 11, a client 12 (only one client 12 is shown in fig. 1 by way of example, and there may be more clients in a specific implementation) and a testing platform 13. Wherein, communication connection can be established among the server 11, the client 12 and the testing platform 13. The server 11, the client 12, and the test platform 13 may be connected in a wired manner or in a wireless manner, which is not limited in the embodiment of the present disclosure.

And the server 11 is configured to receive the virtual test data stream and the real service data stream sent by the client 12, and execute a corresponding service according to the virtual test data stream and the real service data stream.

And the client 12 is used for generating a virtual test data stream and sending the virtual test data stream to the server 11. For example, the client 12 generates a virtual test data stream according to the instruction of the test platform 13 to send to the server 11 for testing the performance of the target system.

The test platform 13 is configured to control the client 12 to generate a virtual test data stream, and control a process of performing a traffic load test task of the data stream on the target system, so as to control whether to interrupt transmission of the virtual test data stream.

In an implementation manner, the server 11 may be one server, a server cluster composed of a plurality of servers, or a cloud computing service center. The server 11 may include a processor, memory, and a network interface, among others.

In one implementable manner, the client 12 is used to provide voice and/or data connectivity services to users. The client 12 may be variously named, for example, a UE end, a terminal unit, a terminal station, a mobile station, a remote terminal, a mobile device, a wireless communication device, a vehicular user equipment, a terminal agent, or a terminal device, etc.

Alternatively, the client 12 may be a handheld device, an in-vehicle device, a wearable device, or a computer with various communication functions, which is not limited in this disclosure. For example, the handheld device may be a smartphone. The in-vehicle device may be an in-vehicle navigation system. The wearable device may be a smart bracelet. The computer may be a Personal Digital Assistant (PDA) computer, a tablet computer, and a laptop computer.

The testing method provided by the embodiment of the present disclosure may be applied to the server 11, the client 12 and the testing platform 13 in the testing system shown in fig. 2. The electronic device to which the present disclosure relates may be the server 11 or the client 12. Taking the application of the testing method disclosed by the invention to a server in the process of executing a service as an example, the testing method provided by the embodiment of the disclosure is described in detail.

After introducing the application scenario and the test system of the embodiment of the present disclosure, the following describes in detail a test method provided by the embodiment of the present disclosure with reference to the test system shown in fig. 2.

As shown in fig. 3, a flowchart of a testing method according to an exemplary embodiment is shown applied to an electronic device. The test method may include S201-S202.

S201, in the process of carrying out a flow load test task of a data flow on a target system, target data are obtained.

Wherein the data stream comprises: virtual test data flow and real service data flow; the target data is used to indicate at least one of: client data transmission parameters, server data transmission parameters.

It should be noted that the target system is a system that needs to test a traffic load, and a traffic load test task is performed on the target system, so that a highest load corresponding to the target system can be determined, and the traffic load test task of the data stream can also be understood as a pressure test task.

For example, when a traffic load test task of a data stream is performed on a target system, monitoring data corresponding to a client and full-link monitoring data (i.e., server data transmission parameters) of a server corresponding to a target system to be tested may be acquired in real time.

Alternatively, the client may be understood as a pressure test engine, i.e. a device that generates pressure test data (virtual test data stream).

The user information (including, but not limited to, various information such as client information and user personal information) referred to in the present disclosure is information authorized by the user or sufficiently authorized by each party.

S202, based on the target data, under the condition that the flow load test task is determined to be abnormal through a first preset rule, the transmission of the virtual test data flow is interrupted.

Optionally, after the target data is acquired, it may be determined whether the traffic load test task is abnormal through a predetermined first preset rule, so as to determine whether to interrupt transmission of the virtual test data stream. It will be appreciated that the traffic load testing task may be terminated by interrupting the transmission of the virtual test data stream.

Specifically, the transmission of the virtual test data stream may be triggered to be interrupted by a fusing event, and the input of the pressure measurement flow rate may be stopped from the pressure measurement engine (i.e., the client). It can be understood that the fusing event is the input of the pressure measurement flow controlled by the fusing component, so that the purpose of controlling the flow load test task is achieved.

Optionally, the interrupting transmission of the virtual test data stream includes at least one of: and controlling the client to stop inputting the virtual test data stream and controlling the server to stop receiving the virtual test data stream.

It should be noted that, when performing a traffic load test task of a data stream on a target system, a real service data stream input in the target system is less than a preset number of data streams, that is, the traffic load test task of the data stream needs to be performed under the condition that the real service data stream is small, so as to test the data carrying capacity of the target system through a virtual test data stream.

Optionally, under the condition that it is determined that the traffic load test task is abnormal, transmission of the virtual test data stream may be interrupted, specifically, transmission of the virtual test data stream may be interrupted by controlling the client to stop inputting the virtual test data stream, or transmission of the virtual test data stream may be interrupted by controlling the server to stop receiving the virtual test data stream.

It should be noted that the existence of the exception in the traffic load testing task can be understood as: in the virtual test data stream input to the target system, some data streams exist to cause the target system to be abnormal, so that errors can be generated when the target system processes a real service data stream.

The embodiment of the present disclosure may interrupt transmission of the virtual test data stream by interrupting transmission of the virtual test data stream included in the data stream, and specifically may control the client to stop inputting the virtual test data stream and/or control the server to stop receiving the virtual test data stream, and interrupt transmission of the virtual test data stream. By the implementation mode, the transmission of the virtual test data stream can be interrupted in various modes without influencing the transmission of the real service data stream, and the accuracy of triggering the flow load test task of stopping the data stream is improved.

The technical scheme provided by the embodiment at least has the following beneficial effects: in the process of carrying out the traffic load test task of the data stream on the target system, the client data transmission parameters and/or the server data transmission parameters can be obtained in real time, so that whether the traffic load test task is abnormal or not is determined through the first preset rule based on the client data transmission parameters and/or the server data transmission parameters, and therefore the transmission of the virtual test data stream can be interrupted in time under the condition that the traffic load test task is determined to be abnormal through the first preset rule. By the implementation mode, the state of the traffic load test task of the data stream to the target system can be monitored in real time, so that the transmission of the virtual test data stream is interrupted in time when the traffic load test task is abnormal, the execution of the traffic load test task of the data stream to the target system is flexibly controlled, and the problem that the traffic load test task causes system abnormity to the target system is prevented. Therefore, when the flow load test of the data flow is carried out on the system, the efficiency of triggering and stopping the flow load test of the data flow is improved, and the triggering cost is reduced.

In an implementable manner, as shown in fig. 4 in conjunction with fig. 3, the method in S202 may specifically include S2021.

S2021, based on the target data, determining that the traffic load testing task is abnormal and interrupting transmission of the virtual testing data stream when it is determined that the target data meets the first threshold condition through the first preset rule.

Optionally, whether the traffic load testing task is abnormal or not may be determined by determining whether the acquired target data meets a first threshold condition or not.

For example, it may be determined whether the traffic load test task is abnormal by determining whether the CPU occupancy included in the target data is greater than or equal to 80% (i.e., a first threshold condition), to determine that the traffic load test task is abnormal when the CPU occupancy is greater than or equal to 80%; or may determine whether the traffic load testing task has an abnormality by determining whether the availability included in the target data is less than or equal to 90% to determine that the traffic load testing task has an abnormality when the availability is less than or equal to 90%.

The technical scheme provided by the embodiment at least has the following beneficial effects: specifically, when it is determined that the target data meets the first threshold condition through the first preset rule, it is determined that the traffic load test task is abnormal, so that transmission of the virtual test data stream is interrupted. By the implementation mode, whether the traffic load testing task is abnormal or not can be accurately determined through specific threshold conditions, and the accuracy of interrupting the transmission of the virtual testing data stream is improved.

In a practical manner, in conjunction with fig. 3, as shown in fig. 5, the method may further include S301.

S301, determining that the flow load test task is abnormal and giving an alarm prompt under the condition that the target data meets the second threshold value condition through the second preset rule.

Optionally, it may also be determined in advance by a second preset rule whether the target data meets a second threshold condition, so that when it is determined that the target data meets the second threshold condition, it is determined that the traffic load test task is abnormal, and thus an alarm prompt may be performed in advance.

It can be understood that before the transmission of the virtual test data stream is interrupted, whether the target data meets the second threshold condition may be determined through a second preset rule to perform an alarm prompt, so as to prompt a user that an abnormality may exist in a task of performing a traffic load test on the target system.

For example, the second threshold condition may be whether the CPU occupancy is greater than or equal to 70%, or the availability is less than or equal to 95%; when the CPU occupancy rate is greater than or equal to 70%, alarming and prompting the target system to perform a traffic load test task possibly to cause abnormality; or when the availability is less than or equal to 95%, determining that the traffic load testing task may have an anomaly.

For example, as shown in fig. 6, in order to monitor and schedule a process of performing a traffic load test task of a data stream on a target system through a pressure measurement platform, specifically, a pressure measurement monitoring module included in the pressure measurement platform monitors a client data transmission parameter of a client and a server data transmission parameter of a server, so as to determine whether there is an abnormality in the traffic load test task through an alarm threshold (i.e., a second threshold condition) and a termination threshold (i.e., a first threshold condition) determined by a rule engine (i.e., a module for determining preset conditions), so as to execute a corresponding action in a case that the client data transmission parameter and/or the server data transmission parameter satisfy a corresponding threshold. Specifically, when the data meets an alarm threshold, alarm prompt is carried out; or triggering to interrupt the transmission of the virtual test data stream when the data meets a termination threshold.

The technical scheme provided by the embodiment at least has the following beneficial effects: and when the target data meets the second threshold condition, the flow load test task is determined to be abnormal, so that an alarm prompt is given. By the aid of the implementation mode, the accuracy of determining the flow load test task to have the abnormity can be further improved.

In an implementable manner, as shown in fig. 7 in conjunction with fig. 5, the method in S201 may specifically include S2011 and S2012.

And S2011, acquiring basic data in the process of carrying out a flow load test task of the data flow on the target system.

It should be noted that the basic data is original data directly acquired from the client and the server.

And S2012, performing data processing on the basic data to obtain target data.

The target data is data which accords with a matching rule of a first preset rule and a second preset rule.

Optionally, after the original data are directly obtained from the client and the server, all the obtained original data need to be encapsulated into a monitoring fact (that is, data meeting a matching rule of the first preset rule and the second preset rule), and then whether the flow load test task is abnormal or not can be determined by comparing preset conditions through the preset rules.

The technical scheme provided by the embodiment at least has the following beneficial effects: the target data is obtained by processing the pre-acquired basic data, so that the target data is data according with a matching rule corresponding to the first preset rule and the second preset rule. Through the implementation mode, the data input into the first preset rule and the second preset rule can be matched, so that the accuracy of determining that the flow load test task has the abnormity can be improved.

In one implementable manner, the client data transmission parameters include at least one of the following types: data transmission delay, query rate per second QPS and interface success rate; the server data transmission parameters include at least one of the following types: service availability data, Central Processing Unit (CPU) data, memory display program (MEM) data and network data; the method in S202 may specifically include S401, S402, or S403.

S401, under the condition that any type of data included in the target data meets a first threshold value condition through a first preset rule, determining that the traffic load test task is abnormal, and interrupting the transmission of the virtual test data stream.

Optionally, whether the traffic load testing task is abnormal or not may be determined through a parallel rule, that is, when it is determined that any data included in the target data meets the first threshold condition, it may be determined that the traffic load testing task is abnormal.

S402, under the condition that at least two types of data included in the target data meet a first threshold value condition through a first preset rule, determining that a traffic load test task is abnormal, and interrupting transmission of the virtual test data flow.

Optionally, whether the traffic load testing task is abnormal or not may be determined through a serial rule, that is, when it is determined that at least two data included in the target data satisfy the first threshold condition, it may be determined that the traffic load testing task is abnormal.

S403, under the condition that any type of data included in the target data meets a first threshold value condition through a first preset rule continuously for multiple times, determining that the traffic load test task is abnormal, and interrupting the transmission of the virtual test data stream.

Optionally, it may be determined whether the traffic load testing task is abnormal through a repetition rule, that is, it may be determined that the traffic load testing task is abnormal when it is determined that the same data included in the target data satisfies the first threshold condition multiple times.

For example, as shown in fig. 8, the obtained client data transmission parameters include: data transmission delay, query rate per second QPS and interface success rate; the server data transmission parameters include: service availability data, CPU data, MEM data, network data; the data with the data in direct proportion to the relevance corresponding to the abnormal flow load test task comprises the following data: the data with the data inversely proportional to the relevance corresponding to the abnormal flow load test task comprises the following data: service availability data, interface success rate, etc. Rule parallelism can be understood as: when the CPU occupancy rate corresponding to the CPU data is greater than or equal to 80%, determining that the flow load test task is abnormal; regular concatenation can be understood as: when the CPU occupancy rate corresponding to the CPU data is greater than or equal to 80% and the service availability data is less than or equal to 95%, determining that the traffic load test task is abnormal; the repetition rule can be understood as: and when the CPU occupancy rate corresponding to the CPU data for three consecutive times is greater than or equal to 80%, determining that the flow load test task is abnormal.

The technical scheme provided by the embodiment at least has the following beneficial effects: determining whether data included in the target data satisfies the first threshold condition may be performed in a variety of ways to determine whether the traffic load testing task is abnormal, and thus whether to interrupt transmission of the virtual test data stream. By the implementation mode, the diversity of determining whether the traffic load testing task has the abnormity can be improved.

In a practical manner, in conjunction with fig. 3, as shown in fig. 9, the method may further include S501.

S501, adding mark information to the virtual test data stream corresponding to the traffic load test task.

Wherein the marking information is used for identifying the virtual test data stream by the server.

Optionally, the pressure measurement flow may be dyed (i.e., the virtual test data stream is added with the mark information), so that when the virtual test data stream is transmitted in the server, full link automatic transparent transmission may be performed, thereby ensuring that each layer of service of the full link can recognize the virtual test data stream.

Optionally, a fusing component may be set in the RPC middleware, so that when it is determined that the traffic load test task is abnormal, the virtual test data stream is controlled to be interrupted or not by automatically fusing/limiting the flow of the current pressure measurement through the fusing component.

For example, as shown in fig. 10, a termination component (i.e., a fuse component) may be disposed in the link service 2 corresponding to the server, so that when it is determined that there is an abnormality in the traffic load testing task, the transmission of the virtual test data stream is controlled by the termination component, so as to control to interrupt the transmission of the virtual test data stream.

The technical scheme provided by the embodiment at least has the following beneficial effects: the server may identify the virtual test data stream included in the received data stream by adding the marker information to the virtual test data stream corresponding to the traffic load testing task.

In one implementable manner, the target data includes server data transmission parameters; with reference to fig. 9, as shown in fig. 11, the method in S202 may specifically include S2022.

And S2022, based on the server data transmission parameters, under the condition that the flow load test task is determined to be abnormal through a first preset rule, controlling the server to stop receiving the virtual test data flow according to the marking information.

Optionally, when it is determined that the traffic load test task is abnormal through the first preset rule, the server may stop receiving the virtual test data stream including the flag information according to whether the transmitted data stream includes the flag information, so as to control to interrupt transmission of the virtual test data stream.

The technical scheme provided by the embodiment at least has the following beneficial effects: under the condition that the flow load test task is determined to be abnormal through the first preset rule, the server can identify the virtual test data stream included in the received data stream according to the marking information, and stop receiving the virtual test data stream so as to interrupt the transmission of the virtual test data stream. By this implementation, the accuracy of interrupting the transmission of the virtual test data stream may be improved.

In a practical manner, before the above S201, the method may further include S601-S603.

S601, acquiring historical data.

The historical data is data corresponding to a plurality of traffic load test tasks performed on the target system before the current moment, and the historical data comprises at least one of the following items: historical test results, historical client data transmission parameters and historical server data transmission parameters.

And S602, determining reference data corresponding to the target system according to the historical data.

It can be understood that the load condition corresponding to the target system can be analyzed and determined according to the data corresponding to the flow load test task performed on the target system for multiple times, so that when the flow load test task is performed on the target system at this time, reasonable reference data can be determined to determine the corresponding alarm threshold value and the termination threshold value.

S603, determining a first threshold condition and a second threshold condition based on the reference data and a preset coefficient.

Optionally, after determining the reference data, the reference data may be appropriately adjusted by a preset coefficient to determine a reasonable first threshold condition and a reasonable second threshold condition.

For example, the preset coefficient may be a coefficient of 0.9 or 1.1, and may be determined according to actual use requirements.

The technical scheme provided by the embodiment at least has the following beneficial effects: historical data corresponding to a flow load test task performed on the target system for multiple times before the current time can be acquired, so that reference data corresponding to the target system can be determined through the historical data, and the first threshold condition and the second threshold condition can be determined. By the implementation mode, the accuracy of determining whether the traffic load test task has the abnormity can be improved, so that the accuracy of interrupting the transmission of the virtual test data stream is improved.

With the above example, when the system is subjected to the traffic load test of the data stream, the efficiency of triggering the traffic load test of the data stream to stop is improved, the cost is reduced, and the cost is reduced by automatically acquiring the client data transmission parameters and the server data transmission parameters, and determining to trigger the interruption of the transmission of the virtual test data stream according to the preset rule. The service condition is automatically determined by monitoring the indexes of all the services of the full link of the server in real time, the flow (virtual test data flow) is automatically fused/limited in voltage and flow, and the abnormal problem of the flow load test of the data flow to the system is avoided in time.

It will be appreciated that the above method may be implemented by a test apparatus. In order to implement the above functions, the test apparatus includes a hardware structure and/or a software module corresponding to each function. Those of skill in the art will readily appreciate that the various illustrative modules and algorithm steps described in connection with the embodiments disclosed herein may be implemented as hardware or combinations of hardware and computer software. Whether a function is performed as hardware or computer software drives hardware depends upon the particular application and design constraints imposed on the solution. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the disclosed embodiments.

The embodiment of the present disclosure may divide the functional modules of the test apparatus according to the method example, for example, each functional module may be divided according to each function, or two or more functions may be integrated into one processing module. The integrated module can be realized in a hardware mode, and can also be realized in a software functional module mode. It should be noted that, the division of the modules in the embodiments of the present disclosure is illustrative, and is only one division of logic functions, and there may be another division in actual implementation.

FIG. 12 is a schematic diagram illustrating a configuration of a testing device according to an exemplary embodiment. Referring to fig. 12, the test apparatus 100 may include: an acquisition unit 1001, a processing unit 1002, and a determination unit 1003.

An obtaining unit 1001 configured to obtain target data in a process of performing a traffic load test task of a data stream on a target system; the data stream includes: virtual test data flow and real service data flow; the target data is used to indicate at least one of: client data transmission parameters and server data transmission parameters; for example, the obtaining unit 1001 may be configured to perform the step in step 201 in fig. 3.

The processing unit 1002 is configured to execute, based on the target data, interrupting transmission of the virtual test data stream in a case where it is determined by a first preset rule that the traffic load test task has an abnormality. For example, the processing unit 1002 may be configured to perform the steps in step 202 in fig. 3.

Optionally, the processing unit 1002 is configured to determine that the traffic load testing task has an exception and interrupt transmission of the virtual testing data stream if it is determined that the target data meets the first threshold condition through the first preset rule. For example, the processing unit 1002 may be configured to perform the step in step 2021 in fig. 4.

Optionally, the processing unit 1002 is configured to determine that the traffic load testing task is abnormal and perform an alarm prompt if it is determined that the target data meets the second threshold condition through the second preset rule. For example, the processing unit 1002 may be configured to perform the steps in step 302 in fig. 5.

Optionally, the obtaining unit 1001 is configured to obtain basic data during a process of performing a traffic load test task of a data stream on a target system; for example, the obtaining unit 1001 may be configured to perform the step in step 2011 in fig. 7.

A processing unit 1002 configured to perform data processing on the basic data to obtain target data; the target data is data meeting the matching rules of the first preset rule and the second preset rule. For example, processing unit 1002 may be used to perform the steps in step 2012 in fig. 7.

Optionally, the processing unit 1002 is configured to determine that the traffic load testing task has an exception and interrupt transmission of the virtual testing data stream if it is determined that any type of data included in the target data meets the first threshold condition through the first preset rule.

The processing unit 1002 is configured to determine that the traffic load testing task has an exception and interrupt transmission of the virtual testing data stream if it is determined that at least two types of data included in the target data satisfy the first threshold condition through the first preset rule.

The processing unit 1002 is configured to determine that the traffic load test task is abnormal and interrupt transmission of the virtual test data stream if it is determined that any type of data included in the target data satisfies the first threshold condition through the first preset rule a plurality of times in succession.

Optionally, the processing unit 1002 is configured to add label information to the virtual test data stream corresponding to the traffic load testing task; the marking information is used for identifying the virtual test data stream by the server. For example, the processing unit 1002 may be configured to perform the steps in step 501 in fig. 9.

Optionally, the target data comprises server data transmission parameters; the processing unit 1002 is configured to execute, based on the server data transmission parameter, controlling the server to stop receiving the virtual test data stream according to the flag information in a case where it is determined that the traffic load testing task is abnormal by a first preset rule. For example, the processing unit 1002 may be configured to perform the step in step 2022 in fig. 11.

Optionally, an obtaining unit 1001 configured to perform obtaining history data; the historical data is data corresponding to a plurality of times of flow load testing tasks performed on the target system before the current moment, and the historical data comprises at least one of the following items: historical test results, historical client data transmission parameters and historical server data transmission parameters.

A determining unit 1003 configured to perform determining reference data corresponding to the target system according to the history data.

A determining unit 1003 configured to perform determining a first threshold condition and a second threshold condition based on the reference data and a preset coefficient.

As above, the embodiment of the present disclosure may perform division of functional modules on an electronic device according to the above method example. The integrated module can be realized in a hardware form, and can also be realized in a software functional module form. In addition, it should be further noted that the division of the modules in the embodiments of the present disclosure is schematic, and is only a logic function division, and there may be another division manner in actual implementation. For example, the functional blocks may be divided for the respective functions, or two or more functions may be integrated into one processing block.

With regard to the test apparatus in the above-described embodiment, the specific manner in which each module performs the operation has been described in detail in the embodiment related to the method, and will not be elaborated here.

Fig. 13 is a schematic structural diagram of a testing apparatus 60 provided by the present disclosure. As shown in fig. 13, the testing device 60 may include at least one processor 601 and a memory 603 for storing instructions executable by the processor 601. Wherein the processor 601 is configured to execute the instructions in the memory 603 to implement the testing method in the above-described embodiments.

In addition, the test apparatus 60 may also include a communication bus 602 and at least one communication interface 604.

The processor 601 may be a GPU, a micro-processing unit, an ASIC, or one or more integrated circuits for controlling the execution of programs in accordance with the disclosed aspects.

The communication bus 602 may include a path that conveys information between the aforementioned components.

The communication interface 604 may be any device, such as a transceiver, for communicating with other devices or communication networks, such as an ethernet, a Radio Access Network (RAN), a Wireless Local Area Network (WLAN), etc.

The memory 603 may be, but is not limited to, a read-only memory (ROM) or other type of static storage device that can store static information and instructions, a Random Access Memory (RAM) or other type of dynamic storage device that can store information and instructions, an electrically erasable programmable read-only memory (EEPROM), a compact disc read-only memory (CD-ROM) or other optical disk storage, optical disk storage (including compact disc, laser disc, optical disc, digital versatile disc, blu-ray disc, etc.), magnetic disk storage media or other magnetic storage devices, or any other medium that can be used to carry or store desired program code in the form of instructions or data structures and that can be accessed by a computer. The memory may be self-contained and connected to the processing unit by a bus. The memory may also be integrated with the processing unit as a volatile storage medium in the GPU.

The memory 603 is used for storing instructions for executing the disclosed solution, and is controlled by the processor 601. The processor 601 is configured to execute instructions stored in the memory 603 to implement the functions of the disclosed method.

In particular implementations, processor 601 may include one or more GPUs, such as GPU0 and GPU1 in fig. 13, as one embodiment.

In one implementation, test device 60 may include multiple processors, such as processor 601 and processor 607 of FIG. 13, for example. Each of these processors may be a single-Core (CPU) processor or a multi-core (multi-GPU) processor. A processor herein may refer to one or more devices, circuits, and/or processing cores for processing data (e.g., computer program instructions).

In one embodiment, the testing apparatus 60 may further include an output device 605 and an input device 606. Output device 605 is in communication with processor 601 and may display information in a variety of ways. For example, the output device 605 may be a Liquid Crystal Display (LCD), a Light Emitting Diode (LED) display device, a Cathode Ray Tube (CRT) display device, a projector (projector), or the like. The input device 606 is in communication with the processor 601 and may accept user input in a variety of ways. For example, the input device 606 may be a mouse, a keyboard, a touch screen device, or a sensing device, among others.

Those skilled in the art will appreciate that the configuration shown in FIG. 13 is not intended to be limiting of testing device 60, and may include more or fewer components than shown, or some components may be combined, or a different arrangement of components may be used.

The present disclosure also provides a computer-readable storage medium having instructions stored thereon, where the instructions in the storage medium, when executed by a processor of an electronic device, enable the electronic device to perform the group communication method provided by the embodiments of the present disclosure.

The embodiment of the present disclosure further provides a computer program product containing instructions, which when run on an electronic device, causes the electronic device to execute the test method provided by the embodiment of the present disclosure.

The embodiment of the present disclosure also provides a communication system, as shown in fig. 2, the system includes a server 11, a client 12, and a test platform 13. The server 11, the client 12, and the test platform 13 are respectively configured to execute corresponding steps in the foregoing embodiments of the present disclosure, so that the communication system solves technical problems solved by the embodiments of the present disclosure and achieves technical effects achieved by the embodiments of the present disclosure, which are not described herein again.

Other embodiments of the disclosure will be apparent to those skilled in the art from consideration of the specification and practice of the disclosure disclosed herein. This disclosure is intended to cover any variations, uses, or adaptations of the disclosure following, in general, the principles of the disclosure and including such departures from the present disclosure as come within known or customary practice within the art to which the disclosure pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the disclosure being indicated by the following claims.

It will be understood that the present disclosure is not limited to the precise arrangements described above and shown in the drawings and that various modifications and changes may be made without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.

Claims

1. A method of testing, the method comprising:

acquiring target data in the process of carrying out a flow load test task of a data flow on a target system; the data stream includes: virtual test data flow and real service data flow; the target data is used to indicate at least one of: client data transmission parameters and server data transmission parameters;

and based on the target data, interrupting the transmission of the virtual test data stream under the condition that the flow load test task is determined to be abnormal through a first preset rule.

2. The method according to claim 1, wherein the interrupting transmission of the virtual test data stream in the case that it is determined by a first preset rule that the traffic load testing task is abnormal based on the target data comprises:

and under the condition that the target data meet a first threshold value condition through the first preset rule, determining that the traffic load test task is abnormal, and interrupting the transmission of the virtual test data stream.

3. The method of claim 1, further comprising:

and under the condition that the target data meets a second threshold value condition through a second preset rule, determining that the flow load test task is abnormal, and giving an alarm.

4. The method according to claim 3, wherein the acquiring target data during the task of performing traffic load testing on the data stream on the target system comprises:

acquiring basic data in the process of carrying out a flow load test task of a data flow on a target system;

carrying out data processing on the basic data to obtain the target data; the target data is data which accords with a matching rule of the first preset rule and the second preset rule.

5. The method of claim 1, further comprising:

adding marking information to the virtual test data stream corresponding to the traffic load test task; the marking information is used for identifying the virtual test data stream by the server.

6. The method of claim 5, wherein the target data comprises server data transmission parameters;

the interrupting transmission of the virtual test data stream when it is determined that the traffic load test task is abnormal according to a first preset rule based on the target data includes:

and based on the server data transmission parameters, under the condition that the flow load test task is determined to have abnormity through a first preset rule, controlling the server to stop receiving the virtual test data stream according to the marking information.

7. A test apparatus, comprising:

the system comprises an acquisition unit, a processing unit and a processing unit, wherein the acquisition unit is configured to acquire target data in the process of executing a flow load test task of data flow on a target system; the data stream includes: virtual test data flow and real service data flow; the target data is used to indicate at least one of: client data transmission parameters and server data transmission parameters;

and the processing unit is configured to interrupt transmission of the virtual test data stream when the traffic load test task is determined to have an abnormality through a first preset rule based on the target data.

8. An electronic device, characterized in that the electronic device comprises:

a processor;

a memory for storing the processor-executable instructions;

wherein the processor is configured to execute the instructions to implement the testing method of any of claims 1-6.

9. A computer-readable storage medium having instructions stored thereon, wherein the instructions in the computer-readable storage medium, when executed by a processor of an electronic device, enable the electronic device to perform the testing method of any of claims 1-6.

10. A computer program product comprising computer programs/instructions, characterized in that the computer programs/instructions, when executed by a processor, implement the testing method of any of claims 1-6.