CN118312440A - Automated stress testing method, device, equipment, and readable storage medium - Google Patents

Abstract

The present disclosure provides an automated pressure testing method, apparatus, device, readable storage medium. An automated pressure testing method comprising: starting a test management module, and configuring test parameters required by pressure test in the test management module; determining a test execution module according to the test parameters, and distributing a pressure test task to the test execution module; the test execution module executes the pressure test task and returns an execution result; and determining the performance of the test execution module according to the execution result and a preset expected return result. The automatic pressure test device can meet the requirement of completing automatic pressure test, and user experience is improved.

Description

Automated stress testing method, device, equipment, and readable storage medium

Technical Field

The present disclosure relates to the field of project testing, and in particular to an automated stress testing method, device, equipment, and readable storage medium.

Background technique

In modern software development, it is crucial to ensure that applications or online services can withstand high traffic. Especially for some real-time interactive systems, it is necessary to solve the problem of large-scale stress testing of WEB services with time limits. Whether a large number of concurrent requests can be handled is directly related to user experience and service stability. Therefore, conducting stress testing to simulate real user load has become an important step. Traditional stress testing methods often require the intervention of testers to adjust test parameters, which is not only time-consuming but also inefficient. With the development of artificial intelligence and automation technology, there is an urgent need to create a smarter and more efficient stress testing method, system, etc.

The above technical problems existing in the prior art have greatly affected the user experience.

Summary of the invention

The present disclosure is completed to solve the above-mentioned problems, and its purpose is to provide an automated stress testing method, device, equipment, and readable storage medium that can realize the automated stress testing requirements.

The present disclosure provides this invention summary section to introduce concepts in a brief form, which will be described in detail in the detailed implementation section below. This invention summary section is not intended to identify the key features or essential features of the technical solution claimed for protection, nor is it intended to be used to limit the scope of the technical solution claimed for protection.

In order to solve the above technical problems, the present disclosure provides an automated stress testing method, which adopts the following technical solutions, including:

Start the test management module and configure the test parameters required for the stress test in the test management module;

Determine a test execution module according to the test parameters, and assign a stress test task to the test execution module;

The test execution module executes the stress test task and returns the execution result;

The performance of the test execution module is determined according to the execution result and the preset expected return result.

In order to solve the above technical problems, the embodiment of the present disclosure further provides an automated pressure testing device, which is used to implement the above method and adopts the following technical solutions, including:

A test management module, used to configure the test parameters required for the stress test, determine the test execution module according to the test parameters, and assign the stress test task to the test execution module;

The test execution module is used to execute the stress test task and return the execution result.

The test management module is also used to determine the performance of the test execution module according to the execution result and the preset expected return result.

In order to solve the above technical problems, the embodiments of the present disclosure further provide a computer device, which adopts the technical solution described below, including: a memory and a processor, wherein a computer program is stored in the memory, and when the processor executes the computer program, the method described in any of the preceding items is implemented.

In order to solve the above technical problems, the embodiment of the present disclosure also provides a computer-readable storage medium, which adopts the technical solution described below, including: a computer program is stored on the computer-readable storage medium, and when the computer program is executed by a processor, it implements the method described in any of the previous items.

According to the technical solution disclosed in the present invention, compared with the existing technology, through multi-party docking message services, stress test demand instructions for the services to be stress tested are received in real time, and preset large-scale stress testing demands are automatically completed, especially WEB services with time limits, thereby improving user experience.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG1 is a schematic diagram of an embodiment of a system architecture according to the present disclosure;

FIG2 is a flow chart of an embodiment of an automated stress testing method according to the present disclosure;

FIG3 is a schematic diagram of part of the data of the stress test management background according to the present disclosure;

FIG4 is a schematic diagram of part of the data of the stress test management background according to the present disclosure;

FIG5 is a schematic diagram of part of the data of the stress test management background according to the present disclosure;

FIG6 is a schematic diagram of an embodiment of an automated pressure testing device according to the present disclosure;

FIG. 7 is a schematic diagram of one embodiment of a computer device according to the present disclosure.

The above and other features, advantages and aspects of the embodiments of the present disclosure will become more apparent with reference to the following detailed description in conjunction with the accompanying drawings. Throughout the accompanying drawings, the same or similar reference numerals represent the same or similar elements. It should be understood that the drawings are schematic and that components and elements are not necessarily drawn to scale.

Detailed ways

Unless otherwise defined, all technical and scientific terms used herein have the same meaning as those commonly understood by those skilled in the art to which the present disclosure belongs; the terms used in the specification of the application herein are only for the purpose of describing specific embodiments and are not intended to limit the present disclosure; the terms "including" and "having" and any variations thereof in the specification and claims of the present disclosure and the above-mentioned drawings are intended to cover non-exclusive inclusions. The terms "first", "second", etc. in the specification and claims of the present disclosure or the above-mentioned drawings are used to distinguish different objects, not to describe a specific order.

Reference to "embodiments" herein means that a particular feature, structure, or characteristic described in conjunction with the embodiments may be included in at least one embodiment of the present disclosure. The appearance of the phrase in various places in the specification does not necessarily refer to the same embodiment, nor is it an independent or alternative embodiment that is mutually exclusive with other embodiments. It is explicitly and implicitly understood by those skilled in the art that the embodiments described herein may be combined with other embodiments.

In order to enable those skilled in the art to better understand the solution of the present disclosure, the technical solution in the embodiments of the present disclosure will be clearly and completely described below in conjunction with the accompanying drawings.

system structure

First, the structure of a system of an embodiment of the present disclosure is described. As shown in FIG1 , the system structure 100 may include terminal devices 101, 102, 103, 104, a network 105, and a server 106. The network 105 is used to provide a medium for a communication link between the terminal devices 101, 102, 103, 104 and the server 106.

In this embodiment, the electronic device on which the method is run (e.g., the terminal device 101, 102, 103, or 104 shown in FIG. 1) can transmit various information through the network 105. The network 105 may include various connection types, such as wired, wireless communication links, or optical fiber cables, etc. It should be noted that the above-mentioned wireless connection methods may include, but are not limited to, 3G/4G/5G connections, Wi-Fi connections, Bluetooth connections, WiMAX connections, Zigbee connections, UWB connections, local area networks ("LAN"), wide area networks ("WAN"), Internet (e.g., the Internet), and peer-to-peer networks (e.g., ad hoc peer-to-peer networks) and other network connection methods known now or developed in the future. The network 105 can communicate using any currently known or future developed network protocol such as HTTP (Hyper Text Transfer Protocol), and can be interconnected with digital data communications (e.g., communication networks) of any form or medium.

The user can use the terminal devices 101, 102, 103, 104 to interact with the server 106 through the network 105 to receive or send messages, etc. Various client applications can be installed on the terminal devices 101, 102, 103 or 104, such as video live broadcast and playback applications, web browser applications, shopping applications, search applications, instant messaging tools, email clients, social platform software, etc.

The terminal devices 101, 102, 103 or 104 can be various electronic devices with a touch display and/or support for web browsing, including but not limited to smart phones, tablet computers, e-book readers, MP3 (Moving Picture Experts Compressed Standard Audio Layer 3) players, MP4 (Moving Picture Experts Compressed Standard Audio Layer 4) players, head-mounted display devices, laptop computers, digital broadcast receivers, PDAs (personal digital assistants), PMPs (portable multimedia players), vehicle-mounted terminals (such as vehicle-mounted navigation terminals), etc., as well as mobile terminals such as digital TVs, desktop computers, etc.

The server 106 may be a server that provides various services, such as a background server that provides support for pages displayed on the terminal device 101 , 102 , 103 or 104 or data transmitted.

It should be understood that the number of terminal devices, networks and servers in Figure 1 is only illustrative. Any number of terminal devices, networks and servers may be provided according to implementation requirements.

Here, the terminal device can independently or in cooperation with other electronic terminal devices run various operating systems such as applications in the Android system to implement the embodiment method of the present disclosure, and can also run applications in other operating systems to implement the embodiment method of the present disclosure.

Automated stress testing methods

Referring to FIG2 , a flow chart of an embodiment of an automated stress testing method according to the present disclosure is shown. The automated stress testing method comprises:

S21, start the test management module, and configure the test parameters required for the stress test in the test management module.

In one or more embodiments, for example, the application scenario is that a programmer develops a quiz web service. Assume that a quiz session is configured with 10 questions, each with 3 options, and after the question is released, the user has 10 seconds to submit the answer. During the project testing phase, it is necessary to simulate the real pressure state of 500,000 logged-in users submitting different answers within 10 seconds.

Here, for example, the stress test system includes at least two parts: at least one test management module, such as a test management WEB service, and n test execution modules, such as a test execution WEB service. The test execution WEB service is deployed on n servers. Here, the stress test system needs to initiate 500,000 network requests to the question answering WEB service within 10 seconds. The number of network I/Os that a single server can initiate within a certain time limit is limited, and it cannot meet the requirement of initiating 500,000 requests within 10 seconds. Before starting the stress test, the programmer will roughly estimate the system load performance of the backup server and deploy at least one test execution WEB service.

In one or more embodiments, for example, the stress testing system also includes a message module, such as a message WEB service. Of course, the message module can also be used as an independent service, and is not limited. For example, other WEB services that provide services to users can be long-connected with the message WEB service as producers or consumers. Other WEB services that act as producers can send message data of a specified topic to the message WEB service. Other WEB services that act as consumers can subscribe to the corresponding topic to the message WEB service to receive the message data sent by the producer in real time.

In one or more embodiments, for example, after the test management WEB service is started, it internally connects to the message WEB service and acts as a producer (topic=A).

In one or more embodiments, as shown in FIG. 3, a partial data diagram of the stress test management background is shown. For example, when the "Initialize Stress Test" button is clicked, the background will display the current stress test editing pop-up window for configuring the test parameters required for the stress test in the test management module, and also includes:

You can click the "Add" button to add test parameters as needed. For example, if there are 10 questions, you need to edit 10 test parameters in total. Click the "Confirm Submission" button to confirm submission.

Here, the test parameters include at least one of the execution identifier, the total number of executions, the interface to be requested, the parameter string to be selected for the interface to be requested, the expected return result, and the expected maximum return time. Here, the execution identifier AAA, etc., for example, is a non-repeatable identifier, and the total number of executions is, for example, 500,000 times. For example, the parameter string to be selected for the interface to be requested includes at least one, and each parameter string to be selected is not repeated, and each parameter string to be selected specifies the probability of being selected; in addition, the number of parameter strings to be selected can also be determined according to the optional types of optional parameter values of the actual stress-tested interface. For example, if each question in the current field has 3 answers to be selected, there are 3 parameter strings to be selected. According to the user interface or configuration file disclosed in the present invention, the tester is allowed to set all necessary parameters and rules in advance, and once the configuration is completed, the stress test can be run completely automatically.

In one or more embodiments, for example, through automated test scripts, the stress test service is automatically executed when it is started, and the test cases are automatically run according to the preset test plan and test parameters. The test execution WEB service, for example, automatically triggers the next stage of the stress test when a specific event occurs (such as reaching a certain performance threshold). Here, the event can be a time point (such as checking every 10 seconds) or a performance indicator (such as the response time exceeds a predetermined value), and when the monitoring tool detects that the performance indicator reaches a specific condition, the system will automatically notify the stress test service to adjust the test rhythm.

In one or more embodiments, for example, a feedback loop is established so that the stress testing service can automatically adjust the test load according to real-time performance data. For example, if the server response time increases, the system will automatically reduce the frequency of sending requests. It is also possible to design a state mechanism so that the stress testing service can switch between different states, such as "start", "run", "adjust" and "stop", and each state has clear entry and exit conditions to ensure that the test is automatically carried out according to the predetermined process.

S22, determining a test execution module according to the test parameters, and assigning a stress test task to the test execution module.

In one or more embodiments, for example, a test execution module is determined based on test parameters, and a stress test task is assigned to the test execution module. Here, for example, after the test execution WEB service is started, the message WEB service is internally connected and subscribes to a specific first message topic=A and a second message topic=B as a consumer.

The test management module sends a first message to the test execution module. For example, the test management WEB service sends a first message [message 1] with topic=A to the message WEB service. The content of [message 1] is, for example: after receiving the message, each test execution WEB service immediately requests the sign-in interface of the test management WEB service.

After receiving the first message, the test execution module requests the check-in interface of the test management module. After receiving [Message 1] through the message WEB service, each test execution WEB service requests the check-in interface of the test management WEB service.

The test management module allocates stress test tasks to the test execution module according to the number of requests received.

After [Message 1] is sent, the test management WEB service counts the check-in requests that arrive within a period of time (assuming 3 seconds). Here, for example, the request contains the IP address of the corresponding test execution WEB service, which is also used as the unique identifier of the service. The test management WEB service obtains n test execution WEB services based on the counted requests, assuming the IP addresses are: 192.168.0.2, 192.168.0.3, and 192.168.0.1. First, sort by IP address, and assign stress test tasks to each test execution WEB service based on the number n. If the number is not divisible by integer, it is placed at the end by default. Finally, request the receiving task interface of each test execution WEB service to synchronize the following list data to each test execution WEB service.

serial number IP Number of tasks Task range 1 192.168.0.1 166666 1~166666 2 192.168.0.2 166666 166667~333336 3 192.168.0.3 166668 333336~500000

As shown in Figure 4, an execution details table is generated for the test management WEB service and the background data is displayed, which includes at least the number of execution machines, the number of executions, the number of successes, the number of failures, the total execution time, the average execution time, QPS (Queries-per-second), or the query rate per second, and other data.

S23, the test execution module executes the stress test task and returns the execution result.

In one or more embodiments, when a service to be tested, such as the example question answering service, requires stress testing, the test execution module executes the stress testing task and returns the execution result.

The test management module sends a second message to the test execution module, for example, connects to the message WEB service and acts as a producer to send a second message [Message 2] of topic=B to the message WEB service, wherein the content of [Message 2] is, for example: execution identifier (such as AAA).

After receiving the second message, the test execution module generates a unique virtual user corresponding to the task interval according to the preset task interval. For example, after each test execution WEB service receives [Message 2] through the message WEB service, it generates a batch of virtual users with unique IDs corresponding to the task interval according to its own task interval.

In one or more embodiments, for example, a distributed user simulation system may be used to perform comprehensive and in-depth stress testing on WEB services without affecting real users, thereby ensuring the performance and stability of the services under high load conditions.

Here, the distributed architecture user simulation system adopts a distributed architecture, for example, it consists of multiple nodes, each of which can simulate a certain number of users. These nodes are distributed in different servers or containers and can run in different geographical locations to simulate the user distribution in the real world. The simulated users running on each node can, for example, perform operations according to preset behavior scripts. For example, in the scenario of answering questions WEB service, the simulated user will select the answer and submit it within 10 seconds after the question is released. Here, the system is designed with scalability in mind, and the number of simulated users can be increased or decreased as needed to achieve the ability to easily simulate a small number of users to 500,000 or even more users. Here, the behavior of simulated users can also be controlled by parameterized input to allow testers to define different test scenarios, such as different answer options and submission times, and can also automatically adjust test parameters according to preset algorithms, such as different answers to the same question by different users, to ensure that the test covers all possible usage scenarios. In addition, the nodes in the system need to be able to operate synchronously to ensure that all simulated users start the test almost at the same time. In addition, the communication mechanism between nodes ensures the consistency and accuracy of the test data. The system can also simulate node failures and test the recovery capability of the service to evaluate the performance when encountering problems in a real environment.

The test execution module initiates concurrent requests to the service to be tested based on the performance of the server where it is located. Here, the concurrent requests include at least virtual user information, an interface URI of a preset corresponding identifier (AAA), and a parameter string randomly selected according to a preset probability, which completely simulates the request of a real user.

Here, for example, there will be one or more load balancers at the front end of the system, which are responsible for distributing incoming requests to multiple servers at the back end to ensure that no single server becomes a bottleneck due to overload. In order to manage a large number of concurrent requests, the system will use message queues to cache requests to control the rate at which data flows to the service and prevent the service from crashing due to a surge in requests. For example, the system will also use asynchronous processing mechanisms to process requests so that it can continue to receive and process other requests while waiting for the processing result of one request. In order to improve the reliability of the system, when a server fails, the load balancer will also redistribute requests to other healthy servers.

In one or more embodiments, for example, the performance of the test execution module is determined based on the execution results and the preset expected return results, including: matching the return results of concurrent requests with the preset expected return results, and comparing whether the request consumption time is within the preset expected maximum return time. If both are met, the automated stress test is successful, otherwise the automated stress test fails.

S24, determining the performance of the test execution module according to the execution result and the preset expected return result.

For example, when the test execution web service completes a batch of requests, let's say 1,000, it reports to the test management web service once until all request tasks are completed. The report includes whether each request is successful and the time taken for each request.

Here, as shown in FIG5 , after the test management WEB service receives the reported data, it summarizes the data and updates the detailed background data, which at least includes the number of execution machines, the number of executions, the number of successes, the number of failures, the total execution time, the average execution time, QPS (Queries-per-second), or the query rate per second, and other data.

According to the automated stress testing method disclosed in the present invention, after the stress test starts, the stress test rhythm is completely notified by the stress test service and completed automatically, and no tester intervention is required during the process; the stress testing process with different parameters initiated by different real users can be fully simulated (for example, different users submit different answers to the same question during the test process); and the performance of each interface under stress test can be automatically summarized and counted.

It should be understood that, although the steps in the flowchart of the accompanying drawings are displayed in sequence as indicated by the arrows, these steps are not necessarily executed in sequence in the order indicated by the arrows. Unless otherwise specified herein, there is no strict order restriction on the execution of these steps, and they can be executed in other orders. Moreover, at least a part of the steps in the flowchart of the accompanying drawings may include multiple sub-steps or multiple stages, and these sub-steps or stages are not necessarily executed at the same time, but can be executed at different times, and their execution order is not necessarily sequential, but can be executed in turn or alternately with other steps or at least a part of the sub-steps or stages of other steps.

Automated pressure testing device

In order to implement the technical solution in the embodiments of the present disclosure, an embodiment of the present disclosure provides an automated stress testing device, as shown in Figure 6, which, for example, includes a test management module 601, a test execution module 602, and a message module 603. Of course, the automated stress testing device may also include other functional operation modules.

The test management module 601 is used to configure the test parameters required for the stress test, determine the test execution module according to the test parameters, and allocate the stress test task to the test execution module.

In one or more embodiments, for example, the test management module 601 is also used to determine the performance of the test execution module according to the execution result and the preset expected return result.

Here, the test management module 601 can, for example, implement the corresponding functions or technical solutions in steps S21-S24 or other steps in the above method, which will not be described in detail here.

The test execution module 602 is used to execute the stress test task and return the execution result.

Here, the test execution module 602 can, for example, implement steps S21-S24 in the above method or corresponding functions or technical solutions in other steps, which will not be described in detail here.

The message module 603 is used to implement the test management module sending a first message to the test execution module and the test management module sending a second message to the test execution module.

Here, the message module 603 can, for example, implement the corresponding functions or technical solutions in steps S21-S24 or other steps in the above method, which will not be repeated here.

It should be understood that, although each box in the block diagram of the accompanying drawings may represent a module, a part of which contains one or more executable instructions for implementing a specified logical function, these modules are not necessarily executed in sequence. The modules and functional units in the device embodiments disclosed herein may be integrated into a processing module, or each unit may exist physically separately, or two or more modules or functional units may be integrated into one module. The above-mentioned integrated modules may be implemented in the form of hardware or in the form of software functional modules. If the integrated modules are implemented in the form of software functional modules and sold or used as independent products, they may also be stored in a computer-readable storage medium. The above-mentioned storage medium may be a read-only memory, a disk or an optical disk, etc.

Computer equipment

Referring to Figure 7, a schematic diagram of the structure of a computer device suitable for implementing the embodiment of the present disclosure is shown below. The computer device in the embodiment of the present disclosure is only an example and should not bring any limitation to the function and scope of use of the embodiment of the present disclosure.

As shown in FIG7 , the electronic device 700 may include a processing device (e.g., a central processing unit, a graphics processing unit, etc.) 701 for controlling the overall operation of the electronic device. The processing device may include one or more processors to execute instructions to complete all or part of the steps of the above method. In addition, the processing device 701 may also include one or more modules for processing and interacting with other devices.

The storage device 702 is used to store various types of data. The storage device 702 may include various types of computer-readable storage media or combinations thereof, such as electrical, magnetic, optical, electromagnetic, infrared, or semiconductor systems, devices or components, or any combination thereof. More specific examples of computer-readable storage media may include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination thereof. In the present disclosure, a computer-readable storage medium may be any tangible medium that contains or stores a program that may be used by or in conjunction with an instruction execution system, device, or component.

The sensor device 703 is used to sense the specified measured information and convert it into a usable output signal according to a certain rule, and may include one or more sensors. For example, it may include an acceleration sensor, a gyroscope sensor, a magnetic sensor, a pressure sensor or a temperature sensor, etc., for detecting changes in the opening/closing state, relative positioning, acceleration/deceleration, temperature, humidity and light of the electronic device.

The processing device 701 , the storage device 702 , and the sensor device 703 are connected to each other via a bus 704 . An input/output (I/O) interface 705 is also connected to the bus 704 .

The multimedia device 706 may include input devices such as a touch screen, a touchpad, a keyboard, a mouse, a camera, a microphone, etc. for receiving input signals from a user. The various input devices may cooperate with the various sensors of the above-mentioned sensor device 703 to complete, for example, gesture operation input, image recognition input, distance detection input, etc. The multimedia device 706 may also include output devices such as a liquid crystal display (LCD), a speaker, a vibrator, etc.

The power supply device 707 is used to provide power to various devices in the electronic device, and may include a power management system, one or more power supplies, and components for distributing power to other devices.

The communication device 708 may allow the electronic device 700 to communicate with other devices wirelessly or by wire to exchange data.

The above-mentioned devices can also be connected to the I/O interface 705 to implement the application of the electronic device 700.

Although the electronic device with various devices is shown in the figure, it should be understood that it is not required to implement or possess all the devices shown. More or fewer devices may be implemented or possessed instead.

In particular, according to an embodiment of the present disclosure, the process described above with reference to the flowchart can be implemented as a computer software program. For example, an embodiment of the present disclosure includes a computer program product, which includes a computer program carried on a non-transitory computer-readable medium, and the computer program contains a program code for executing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from a network through a communication device, or installed from a storage device. When the computer program is executed by a processing device, the above-mentioned functions defined in the method of the embodiment of the present disclosure are executed.

In the context of the present disclosure, a machine-readable medium may be a tangible medium that can contain or store a program for use by or in connection with an instruction execution system, apparatus, or device.

It should be noted that the computer-readable medium mentioned above in the present disclosure may be a computer-readable signal medium or a computer-readable storage medium or any combination of the above two. In the present disclosure, a computer-readable signal medium may include a data signal propagated in a baseband or as part of a carrier wave, which carries a computer-readable program code. Such propagated data signals may take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. A computer-readable signal medium may also be any computer-readable medium other than a computer-readable storage medium, which may send, propagate, or transmit a program for use by or in conjunction with an instruction execution system, device, or device. The program code contained on the computer-readable medium may be transmitted using any suitable medium, including but not limited to: wires, optical cables, RF (radio frequency), etc., or any suitable combination of the above.

The computer-readable medium may be included in the electronic device, or may exist independently without being installed in the electronic device.

Computer program code for performing the operations of the present disclosure may be written in one or more programming languages or a combination thereof, including, but not limited to, object-oriented programming languages, such as Java, Smalltalk, C++, and conventional procedural programming languages, such as "C" or similar programming languages. The program code may be executed entirely on the user's computer, partially on the user's computer, as a separate software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving a remote computer, the remote computer may be connected to the user's computer through any type of network, or may be connected to an external computer (e.g., through the Internet using an Internet service provider).

The flow chart and block diagram in the accompanying drawings illustrate the possible architecture, function and operation of the system, method and computer program product according to various embodiments of the present disclosure. In this regard, each square box in the flow chart or block diagram can represent a module, a program segment or a part of a code, and the module, the program segment or a part of the code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some implementations as replacements, the functions marked in the square box can also occur in a sequence different from that marked in the accompanying drawings. For example, two square boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each square box in the block diagram and/or flow chart, and the combination of the square boxes in the block diagram and/or flow chart can be implemented with a dedicated hardware-based system that performs a specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

The units involved in the embodiments described in the present disclosure may be implemented by software or hardware, wherein the name of a unit does not, in some cases, constitute a limitation on the unit itself.

The functions described above herein may be performed at least in part by one or more hardware logic components. For example, exemplary types of hardware logic components that may be used include, without limitation, field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chips (SOCs), complex programmable logic devices (CPLDs), and the like.

According to one or more embodiments of the present disclosure, an automated stress testing method is provided, which adopts the following technical solution, including:

Start the test management module and configure the test parameters required for the stress test in the test management module;

Determine a test execution module according to the test parameters, and assign a stress test task to the test execution module;

The test execution module executes the stress test task and returns the execution result;

The performance of the test execution module is determined according to the execution result and the preset expected return result.

According to one or more embodiments of the present disclosure, an automated stress testing method is provided, which adopts the following technical solution, including:

The configuration of the test parameters required for the stress test in the test management module also includes:

Add the test parameters and confirm submission;

The test parameters include at least one of an execution identifier, a total number of executions, an interface to be requested, a parameter string to be selected for the interface to be requested, an expected return result, and an expected maximum return time.

According to one or more embodiments of the present disclosure, an automated stress testing method is provided, which adopts the following technical solution, including:

The interface parameter string to be selected for the request to be initiated includes at least one, each of the parameter strings to be selected is not repeated, and each of the parameter strings to be selected specifies a probability of selection;

The number of the parameter strings to be selected is determined according to the optional types of optional parameter values of the actual stress-tested interface.

According to one or more embodiments of the present disclosure, an automated stress testing method is provided, which adopts the following technical solution, including:

The step of determining a test execution module according to the test parameters and assigning a stress test task to the test execution module includes:

The test management module sends a first message to the test execution module;

After receiving the first message, the test execution module requests the check-in interface of the test management module;

The test management module allocates the stress test task to the test execution module according to the number of requests received.

According to one or more embodiments of the present disclosure, an automated stress testing method is provided, which adopts the following technical solution, including:

The test execution module executes the stress test task and returns the execution result, including:

The test management module sends a second message to the test execution module;

After receiving the second message, the test execution module generates a unique virtual user corresponding to the task interval according to the preset task interval;

The test execution module initiates concurrent requests to the service to be tested according to the performance of the server where it is located;

The concurrent request at least includes virtual user information, an interface with a preset corresponding identifier, and a parameter string randomly selected according to a preset probability.

According to one or more embodiments of the present disclosure, an automated stress testing method is provided, which adopts the following technical solution:

Determining the performance of the test execution module according to the execution result and a preset expected return result includes:

The return result of the concurrent request is matched with the preset expected return result, and the request consumption time is compared to see whether it is within the preset expected maximum return time. If both are met, the automated stress test is successful.

According to one or more embodiments of the present disclosure, an automated pressure testing device is provided, which is used to implement any of the above methods, and adopts the following technical solution, including:

A test management module, used to configure the test parameters required for the stress test, determine the test execution module according to the test parameters, and assign the stress test task to the test execution module;

The test execution module is used to execute the stress test task and return the execution result.

The test management module is also used to determine the performance of the test execution module according to the execution result and the preset expected return result.

According to one or more embodiments of the present disclosure, an automated pressure testing device is provided, which adopts the following technical solution, including:

It also includes a message module, which is used to enable the test management module to send a first message to the test execution module and the test management module to send a second message to the test execution module.

According to one or more embodiments of the present disclosure, a computer device is provided, including a memory and a processor, wherein a computer program is stored in the memory, and when the processor executes the computer program, the method described in any one of the preceding items is implemented.

According to one or more embodiments of the present disclosure, a computer-readable storage medium is provided, on which a computer program is stored. When the computer program is executed by a processor, the method described in any of the preceding items is implemented.

The above description is only a preferred embodiment of the present disclosure and an explanation of the technical principles used. Those skilled in the art should understand that the scope of disclosure involved in the present disclosure is not limited to the technical solutions formed by a specific combination of the above technical features, but should also cover other technical solutions formed by any combination of the above technical features or their equivalent features without departing from the above disclosed concept. For example, the above features are replaced with the technical features with similar functions disclosed in the present disclosure (but not limited to) to form a technical solution.

In addition, although each operation is described in a specific order, this should not be understood as requiring these operations to be performed in the specific order shown or in a sequential order. Under certain circumstances, multitasking and parallel processing may be advantageous. Similarly, although some specific implementation details are included in the above discussion, these should not be interpreted as limiting the scope of the present disclosure. Some features described in the context of a separate embodiment can also be implemented in a single embodiment in combination. On the contrary, the various features described in the context of a single embodiment can also be implemented in multiple embodiments individually or in any suitable sub-combination mode.

Although the subject matter has been described in language specific to structural features and/or methodological logical actions, it should be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or actions described above. On the contrary, the specific features and actions described above are merely example forms of implementing the claims.

Claims (10)

1. An automated stress testing method, comprising: Start the test management module and configure the test parameters required for the stress test in the test management module; Determine a test execution module according to the test parameters, and assign a stress test task to the test execution module; The test execution module executes the stress test task and returns the execution result; The performance of the test execution module is determined according to the execution result and the preset expected return result. 2. The automated stress testing method according to claim 1, wherein: The configuration of the test parameters required for the stress test in the test management module also includes: Add the test parameters and confirm submission; The test parameters include at least one of an execution identifier, a total number of executions, an interface to be requested, a parameter string to be selected for the interface to be requested, an expected return result, and an expected maximum return time. 3. The automated stress testing method according to claim 2, wherein: The interface parameter string to be selected for the request to be initiated includes at least one, each of the parameter strings to be selected is not repeated, and each of the parameter strings to be selected specifies a probability of selection; The number of the parameter strings to be selected is determined according to the optional types of optional parameter values of the actual stress-tested interface. 4. The automated stress testing method according to claim 1, wherein: The step of determining a test execution module according to the test parameters and assigning a stress test task to the test execution module includes: The test management module sends a first message to the test execution module; After receiving the first message, the test execution module requests the check-in interface of the test management module; The test management module allocates the stress test task to the test execution module according to the number of requests received. 5. The automated stress testing method according to claim 1, wherein: The test execution module executes the stress test task and returns the execution result, including: The test management module sends a second message to the test execution module; After receiving the second message, the test execution module generates a unique virtual user corresponding to the task interval according to the preset task interval; The test execution module initiates concurrent requests to the service to be tested according to the performance of the server where it is located; The concurrent request at least includes virtual user information, an interface with a preset corresponding identifier, and a parameter string randomly selected according to a preset probability. 6. The automated stress testing method according to claim 5, characterized in that: Determining the performance of the test execution module according to the execution result and a preset expected return result includes: The return result of the concurrent request is matched with the preset expected return result, and the request consumption time is compared to see whether it is within the preset expected maximum return time. If both are met, the automated stress test is successful. 7. An automated pressure testing device, used to implement the method according to any one of claims 1 to 6, characterized in that it comprises: A test management module, used to configure the test parameters required for the stress test, determine the test execution module according to the test parameters, and assign the stress test task to the test execution module; A test execution module, used to execute the stress test task and return the execution result; The test management module is also used to determine the performance of the test execution module according to the execution result and the preset expected return result. 8. The automated pressure testing device according to claim 7, characterized in that: It also includes a message module, which is used to enable the test management module to send a first message to the test execution module and the test management module to send a second message to the test execution module. 9. A computer device, comprising a memory and a processor, wherein the memory stores a computer program, and the processor implements the method according to any one of claims 1 to 6 when executing the computer program. 10. A computer-readable storage medium, characterized in that a computer program is stored on the computer-readable storage medium, and when the computer program is executed by a processor, the method according to any one of claims 1 to 6 is implemented.