CN115687044A - System performance stability testing method, system, device and storage medium - Google Patents
System performance stability testing method, system, device and storage medium Download PDFInfo
- Publication number
- CN115687044A CN115687044A CN202211261451.1A CN202211261451A CN115687044A CN 115687044 A CN115687044 A CN 115687044A CN 202211261451 A CN202211261451 A CN 202211261451A CN 115687044 A CN115687044 A CN 115687044A
- Authority
- CN
- China
- Prior art keywords
- preheating
- test
- performance
- value
- performance value
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 53
- 238000012430 stability testing Methods 0.000 title claims description 15
- 238000012360 testing method Methods 0.000 claims abstract description 155
- 230000008569 process Effects 0.000 claims description 17
- 238000012544 monitoring process Methods 0.000 claims description 16
- 238000013112 stability test Methods 0.000 claims description 5
- 238000004891 communication Methods 0.000 description 8
- 238000012545 processing Methods 0.000 description 5
- 238000004364 calculation method Methods 0.000 description 4
- 230000009471 action Effects 0.000 description 3
- 230000008878 coupling Effects 0.000 description 3
- 238000010168 coupling process Methods 0.000 description 3
- 238000005859 coupling reaction Methods 0.000 description 3
- 238000000605 extraction Methods 0.000 description 3
- 230000009286 beneficial effect Effects 0.000 description 2
- 238000004422 calculation algorithm Methods 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000013461 design Methods 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 230000007246 mechanism Effects 0.000 description 1
- 230000000750 progressive effect Effects 0.000 description 1
Images
Landscapes
- Test And Diagnosis Of Digital Computers (AREA)
Abstract
The invention provides a method, a system, a device and a storage medium for testing system performance stability, wherein the method comprises the following steps: when the number of times of preheating is 1, the average value and variance of preheating performance cannot be obtained. At this time, the preheating performance value is compared with the formal test performance value, so as to judge whether the system enters a steady state. When the preheating times is more than or equal to 2, the average value and the standard deviation of each test can be taken, and then the variation coefficient is calculated to measure the performance value of each preheating relative to the deviation of the average value. If the variation coefficient is large, the preheating performance value is large in fluctuation each time, and the system does not enter a steady state at the moment. Otherwise, the system enters the steady state already during the preheating. And after the system is determined to enter the steady state, loading the load, and continuing to test until all the test loads are loaded, and obtaining a test result after the test operation is finished. The invention realizes the quick judgment of whether the test system enters the steady state or not, and improves the SERT test efficiency.
Description
Technical Field
The invention relates to the technical field of computers, in particular to a method, a system, a device and a storage medium for testing system performance stability.
Background
SPEC SERT is a test toolset that is internationally authoritative for measuring and evaluating server energy efficiency. The SERT suite is created according to the opinion of the leaders and their stakeholders of various energy efficiency plans around the world, in order to adapt to the energy efficiency plan requirements within their region.
The SPEC SERT is a testing tool written by Java language, and due to factors such as a garbage collection mechanism of a Java virtual machine, different JIT compilation, memory allocation, cache loading of a testing system and the like, a performance value of the tested system is not stable at a test load starting stage, and is easy to generate deviation. For the accuracy of the tested data, the SERT tool specifies that each workload requires the system to reach a steady state first, and then records the performance value and power consumption of the system.
In the prior art, a preheating stage is required to be provided before a workload formal test is performed before a SERT tool is used for testing, so that a tested system reaches a relatively stable state. The SERT tool specifies the number of warmups per time from 1 to 10, which can be customized by the user, with a default of 3. Generally, more preheating times make the system enter a steady state more easily, but too many preheating times greatly increase the test time, which increases the test time by 1/3 at most, and seriously affects the test efficiency. However, since it is difficult for a user to determine the minimum number of times of preheating to enable the system to reach a steady state, the user needs to wait for the end of the test after each preheating to check the test report to determine whether the system reaches the steady state during the test, which results in low test efficiency.
Disclosure of Invention
In view of the above problems, an object of the present invention is to provide a method, a system, a device, and a storage medium for testing system performance stability, which achieve quick determination of whether a test system enters a steady state, and improve SERT test efficiency.
In order to achieve the purpose, the invention is realized by the following technical scheme: a system performance stability test method comprises the following steps:
s1: setting the test preheating times to be 1;
s2: starting a SERT test;
s3: in the test operation process, monitoring the log file in real time to obtain a preheating performance value, and obtaining a formal performance value when the formal test is finished after preheating;
s4: calculating the deviation amount between the preset performance value and the formal performance value;
s5: judging whether the deviation amount is smaller than a deviation threshold value or not; if yes, executing step S6; if not, executing the step S9;
s6: judging whether all loads are loaded or not; if yes, executing step S7; if not, executing the step S8; s7: the test continues to run until the end;
s8: adding a load and going to step S3;
s9: by increasing the preheating times, the system is judged to reach a steady state by utilizing the preheating performance variation coefficient after the system is preheated, and the test is executed.
Further, step S9 includes the steps of:
s91: forcibly ending the test program, and setting the preheating times to be 2;
s92: starting a SERT test;
s93: extracting a preheating performance value from the log file;
s94: calculating the coefficient of variation of preheating performance according to the preheating performance value of each preheating;
s95: judging whether the coefficient of variation of the preheating performance is larger than a judgment threshold value or not; if yes, go to step S96; if not, executing step S97;
s96: terminating the test, and executing S92 after adding 1 to the preheating times;
s97: judging whether all loads are loaded or not; if yes, executing step S7; if not, executing step S98; s98: a load is added and the process goes to step S93.
Further, step S94 includes:
calculating the average value and the standard deviation of the preheating performance value according to the preheating performance value of each preheating;
and calculating the preheating variation coefficient according to the average value and the standard deviation of the preheating performance value.
Further, step S94 specifically includes:
calculating the average value a and the standard deviation b of the preheating performance value according to the preheating performance value of each preheating;
and calculating the preheating variation coefficient c according to the formula c = b/a.
Further, step S7 further includes:
and recording the current preheating times and setting the preheating times as the optimal preheating times.
Further, the deviation threshold is 5% of the formal performance value.
Further, the determination threshold is 5%.
Correspondingly, the invention also discloses a system performance stability testing system, which comprises:
the setting unit is used for setting the test preheating times;
the starting unit is used for starting the SERT test;
the monitoring unit is used for monitoring the log file in real time in the test running process to obtain a preheating performance value and obtaining a formal performance value when the formal test is finished after preheating;
the calculating unit is used for calculating the deviation amount of the preset performance value and the formal performance value;
a first judgment unit for judging whether the deviation amount is smaller than a deviation threshold value;
the second judgment unit is used for judging whether all the loads are loaded or not;
the execution unit is used for running the test until the test is finished;
the adjusting unit is used for starting the SERT test again after increasing a load;
and the judgment test unit is used for judging that the system reaches a steady state by increasing the preheating times and utilizing the preheating performance variation coefficient after the system is preheated, and executing the test.
Further, the judgment test unit includes:
the termination module is used for forcibly ending the test program;
the extraction module is used for extracting the preheating performance value from the log file;
the calculation module is used for calculating the preheating performance variation coefficient according to the preheating performance value of each preheating;
and the judging module is used for judging whether the preheating performance variation coefficient is larger than a judging threshold value.
Correspondingly, the invention discloses a system performance stability testing device, which comprises:
the memory is used for storing a system performance stability test program;
a processor, configured to implement the steps of the system performance stability testing method according to any one of the above embodiments when executing the system performance stability testing program.
Accordingly, the present invention discloses a readable storage medium, on which a system performance stability test program is stored, wherein the system performance stability test program, when executed by a processor, implements the steps of the system performance stability test method as described in any one of the above.
Compared with the prior art, the invention has the beneficial effects that:
1. the invention judges whether the system enters a steady state or not by the variation coefficient during the system preheating, and if the system does not reach the steady state, the preheating times can be increased until the system enters the steady state. The system can be determined whether the system reaches the stable performance state or not by checking the test result without the test passing, and the invention can realize automation through the script, save labor and improve the test efficiency.
2. The invention can quickly and conveniently determine the preheating times of the system, only needs to monitor the output log in real time, and can determine that the test system enters the steady state without waiting for the test to finish and checking the test report, thereby realizing the quick judgment of whether the test system enters the steady state or not and improving the SERT test efficiency.
Therefore, compared with the prior art, the invention has prominent substantive features and remarkable progress, and the beneficial effects of the implementation are also obvious.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to the provided drawings without creative efforts.
Fig. 1 is a flowchart of a method according to a first embodiment of the present invention.
FIG. 2 is a flowchart illustrating a step S9 according to an embodiment of the present invention.
FIG. 3 is a flowchart of a method according to a second embodiment of the present invention.
Fig. 4 is a system configuration diagram of the third embodiment of the present invention.
In the figure, 1, a setting unit; 2. a start unit; 3. a monitoring unit; 4. a calculation unit; 5. a first judgment unit; 6. a second judgment unit; 7. an execution unit; 8. an adjustment unit; 9. judging a test unit; 10. a termination module; 11. an extraction module; 12. a calculation module; 13. and a judging module.
Detailed Description
The core of the invention is to provide a method for testing the performance stability of a system, in the prior art, because a user is difficult to determine the minimum preheating times for enabling the system to reach a steady state, the user needs to wait for the test to finish after each preheating and check a test report to determine whether the system reaches the steady state in the test, thereby causing low test efficiency.
In the method for testing the system performance stability provided by the invention, when the preheating times is 1, the average value and the variance of the preheating performance cannot be obtained. At this time, the preheating performance value is compared with the formal test performance value, so as to judge whether the system enters a steady state. When the preheating times > =2, the average value and the standard deviation of each test can be taken, and then the variation coefficient is calculated to measure the magnitude of the deviation of the performance value of each preheating relative to the average value. If the variation coefficient is large, the preheating performance value is large in fluctuation each time, and the system does not enter a steady state at the moment. Otherwise, the system enters the steady state already during the preheating. And after the system is determined to enter the steady state, loading the load, and continuing to test until all the test loads are loaded, and obtaining a test result after the test operation is finished. Therefore, whether the test system enters a steady state or not is rapidly judged, and the SERT test efficiency is improved.
In order that those skilled in the art will better understand the disclosure, reference will now be made in detail to the embodiments of the disclosure as illustrated in the accompanying drawings. It is to be understood that the described embodiments are merely exemplary of the invention, and not restrictive of the full scope of the invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
The first embodiment is as follows:
as shown in fig. 1, the embodiment provides a method for testing system performance stability, which includes the following steps:
s1: the test preheating times are set to 1.
S2: a SERT test is initiated.
S3: and in the test operation process, monitoring the log file in real time to obtain a preheating performance value, and obtaining a formal performance value when the formal test is finished after preheating.
S4: and calculating the deviation amount between the preset performance value and the formal performance value.
S5: judging whether the deviation amount is less than 5% of the formal performance value; if yes, executing step S6; if not, step S9 is executed.
S6: judging whether all loads are loaded or not; if yes, executing step S7; if not, step S8 is executed.
S7: and the test is continued to run until the test is finished, the current preheating times are recorded and set as the optimal preheating time value.
S8: a load is added and the process goes to step S3.
S9: by increasing the preheating times, the system is judged to reach a steady state by utilizing the preheating performance variation coefficient after the system is preheated, and the test is executed.
Specifically, as shown in fig. 2, step S9 includes the steps of:
s91: the test program is forcibly ended, and the number of preheating times is set to 2.
S92: a SERT test is initiated.
S93: the warm-up performance value is extracted from the log file.
S94: and calculating the average value a and the standard deviation b of the preheating performance value according to the preheating performance value of each preheating, and calculating the preheating variation coefficient c according to the formula c = b/a.
S95: judging whether the coefficient c of variation of the preheating performance is more than 5 percent; if yes, go to step S96; if not, step S97 is executed.
S96: the test is terminated, and S92 is executed after adding 1 to the number of warm-up times.
S97: judging whether all loads are loaded or not; if yes, executing step S7; if not, step S98 is executed.
S98: a load is added and it goes to step S93.
The embodiment provides a system performance stability testing method, which can quickly and conveniently determine the times of preheating needed by a system, only needs to monitor an output log in real time, and can determine that the testing system enters a steady state without waiting for the test to finish and checking a test report, so that whether the testing system enters the steady state or not can be quickly judged, and the SERT testing efficiency is improved.
Example two:
based on the first embodiment, as shown in fig. 3, this embodiment further discloses a system performance stability testing method, which includes the following steps:
1. firstly, setting the test preheating times to be 1, starting an SERT test, monitoring a log file in real time in the test running process, acquiring a preheating performance value, and acquiring the performance value when the formal test is finished by preheating. And calculating whether the deviation amount is within 5%.
2. If the deviation is less than 5%, the system is stable, the test can continue to load the next load, the deviation of the performance value calculated by monitoring the log in the previous step is repeated for judgment, until all the test loads are loaded, and the test operation is finished to obtain the test result. If the preheating deviation of certain load performance is larger than 5%, the system is not enabled to enter a steady state through one-time preheating, and the next step is carried out.
3. Forcibly ending the test program, setting the preheating times to be 2, and starting the SERT test. In the test operation process, the log file is monitored in real time, the preheating performance value is obtained, and the average value a and the standard deviation b are calculated. Thus, the coefficient of variation for preheating c = b/a was obtained.
4. Judging whether the coefficient of variation c of the preheating performance is within 5 percent.
If the coefficient of variation is less than 5%, the system is considered to enter a steady state through preheating. And loading the next load, repeating the monitoring log in the previous step to calculate the coefficient of variation until all the test loads are loaded, and obtaining the test result after the test operation is finished.
If the deviation of the performance value is larger than 5%, the performance value deviation is overlarge during preheating, the system does not reach a steady state, the test can be finished without entering formal test (if the formal test is entered, the steady-state performance and power consumption of the system cannot be obtained, and the test data at the moment are invalid), and the next step is carried out.
5. And (4) repeating the step 4 according to the preheating times + 1.
6. And finally obtaining the optimal preheating times after multiple judgments.
The embodiment provides a method for testing system performance stability, which judges whether a system enters a steady state or not by a coefficient of variation during system preheating, and if the system does not reach the steady state, the preheating times can be increased until the system enters the steady state. The system can be determined whether the system reaches the stable performance state or not by checking the test result without the test passing, and the invention can realize automation through the script, save labor and improve the test efficiency.
Example three:
based on the first embodiment, as shown in fig. 4, the present invention further discloses a system performance stability testing system, which includes: the device comprises a setting unit 1, a starting unit 2, a monitoring unit 3, a calculating unit 4, a first judging unit 5, a second judging unit 6, an executing unit 7, an adjusting unit 8 and a judging and testing unit 9.
And the setting unit 1 is used for setting the test preheating times.
And the starting unit 2 is used for starting the SERT test.
And the monitoring unit 3 is used for monitoring the log file in real time in the test running process, acquiring the preheating performance value and acquiring the formal performance value when the formal test is finished after preheating.
And the calculating unit 4 is used for calculating the deviation amount between the preset performance value and the formal performance value.
A first judgment unit 5 for judging whether the deviation amount is smaller than the deviation threshold.
And a second judging unit 6, configured to judge whether all the loads are loaded.
And the execution unit 7 is used for running the test until the test is finished.
And the adjusting unit 8 is used for starting the SERT test again after increasing one load.
And the judgment and test unit 9 is used for judging that the system reaches a steady state by increasing the preheating times and utilizing the preheating performance variation coefficient after the system is preheated, and executing a test.
Specifically, the judgment test unit 9 includes: a termination module 10, an extraction module 11, a calculation module 12 and a judgment module 13.
And a termination module 10 for forcibly ending the test program.
And an extracting module 11, configured to extract the preheating performance value from the log file.
And the calculating module 12 is configured to calculate a preheating performance variation coefficient according to the preheating performance value of each preheating.
And the judging module 13 is configured to judge whether the preheating performance variation coefficient is greater than a judgment threshold.
The embodiment provides a system performance stability test system, which can quickly and conveniently determine the times of preheating needed by the system, only needs to monitor an output log in real time, and can determine that the test system enters a stable state without waiting for the test to finish and checking a test report, so that whether the test system enters the stable state is quickly judged, and the SERT test efficiency is improved.
Example four:
the embodiment discloses a system performance stability testing device, which comprises a processor and a memory; wherein the processor implements the following steps when executing the system performance stability test program stored in the memory:
1. the test preheating times are set to 1.
2. A SERT test is initiated.
3. And in the test operation process, monitoring the log file in real time to obtain a preheating performance value, and obtaining a formal performance value when the formal test is finished after preheating.
4. And calculating the deviation amount between the preset performance value and the formal performance value.
5. Judging whether the deviation amount is smaller than a deviation threshold value or not; if yes, executing step 6; if not, go to step 9.
6. Judging whether all loads are loaded or not; if yes, executing step 7; if not, go to step 8.
7. The test continues to run until the end.
8. Add a load and go to step 3.
9. By increasing the preheating times, the system is judged to reach a steady state by utilizing the preheating performance variation coefficient after the system is preheated, and the test is executed.
Further, the system performance stability testing apparatus in this embodiment may further include:
and the input interface is used for acquiring an externally introduced system performance stability test program, storing the acquired system performance stability test program into the memory, and also used for acquiring various instructions and parameters transmitted by external terminal equipment and transmitting the instructions and parameters to the processor so that the processor performs corresponding processing by using the instructions and the parameters. In this embodiment, the input interface may specifically include, but is not limited to, a USB interface, a serial interface, a voice input interface, a fingerprint input interface, a hard disk reading interface, and the like.
And the output interface is used for outputting various data generated by the processor to the terminal equipment connected with the output interface, so that other terminal equipment connected with the output interface can acquire various data generated by the processor. In this embodiment, the output interface may specifically include, but is not limited to, a USB interface, a serial interface, and the like.
And the communication unit is used for establishing remote communication connection between the system performance stability testing device and the external server so that the system performance stability testing device can mount the mirror image file into the external server. In this embodiment, the communication unit may specifically include, but is not limited to, a remote communication unit based on a wireless communication technology or a wired communication technology.
And the keyboard is used for acquiring various parameter data or instructions input by a user through real-time key cap knocking.
And the display is used for displaying relevant information in the short circuit positioning process of the power supply line of the running server in real time.
The mouse can be used for assisting a user in inputting data and simplifying the operation of the user.
Example five:
the present embodiments also disclose a readable storage medium, where the readable storage medium includes Random Access Memory (RAM), memory, read Only Memory (ROM), electrically programmable ROM, electrically erasable programmable ROM, registers, a hard disk, a removable hard disk, a CD-ROM, or any other form of storage medium known in the art. The readable storage medium stores a system performance stability test program, and the system performance stability test program realizes the following steps when being executed by the processor:
1. the test preheating times are set to 1.
2. The SERT test is initiated.
3. And in the test operation process, monitoring the log file in real time to obtain a preheating performance value, and obtaining a formal performance value when the formal test is finished after preheating.
4. And calculating the deviation amount between the preset performance value and the formal performance value.
5. Judging whether the deviation amount is smaller than a deviation threshold value or not; if yes, executing step 6; if not, go to step 9.
6. Judging whether all loads are loaded or not; if yes, executing step 7; if not, go to step 8.
7. The test continues to run until the end.
8. Add a load and go to step 3.
9. By increasing the preheating times, the system is judged to reach a steady state by utilizing the preheating performance variation coefficient after the system is preheated, and the test is executed.
In conclusion, the method and the device realize the rapid judgment of whether the test system enters the steady state or not, and improve the SERT test efficiency.
The embodiments are described in a progressive manner, each embodiment focuses on differences from other embodiments, and the same or similar parts among the embodiments are referred to each other. The method disclosed by the embodiment corresponds to the system disclosed by the embodiment, so that the description is simple, and the relevant points can be referred to the description of the method part.
Those of skill would further appreciate that the various illustrative elements and algorithm steps described in connection with the embodiments disclosed herein may be implemented as electronic hardware, computer software, or combinations of both, and that the various illustrative components and steps have been described above generally in terms of their functionality in order to clearly illustrate this interchangeability of hardware and software. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the technical solution. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present invention.
In the embodiments provided by the present invention, it should be understood that the disclosed system, system and method can be implemented in other ways. For example, the above-described system embodiments are merely illustrative, and for example, the division of the units is only one logical functional division, and other divisions may be realized in practice, for example, a plurality of units or components may be combined or integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed coupling or direct coupling or communication connection between each other may be through some interfaces, indirect coupling or communication connection of systems or units, and may be in an electrical, mechanical or other form.
The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.
In addition, functional modules in the embodiments of the present invention may be integrated into one processing unit, or each module may exist alone physically, or two or more modules are integrated into one unit.
Similarly, each processing unit in the embodiments of the present invention may be integrated into one functional module, or each processing unit may exist physically, or two or more processing units are integrated into one functional module.
The steps of a method or algorithm described in connection with the embodiments disclosed herein may be embodied directly in hardware, in a software module executed by a processor, or in a combination of the two. A software module may reside in Random Access Memory (RAM), memory, read-only memory (ROM), electrically programmable ROM, electrically erasable programmable ROM, registers, hard disk, a removable disk, a CD-ROM, or any other form of storage medium known in the art.
Finally, it should also be noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising a … …" does not exclude the presence of another identical element in a process, method, article, or apparatus that comprises the element.
The method, system, device and readable storage medium for testing the system performance stability provided by the invention are described in detail above. The principles and embodiments of the present invention are explained herein using specific examples, which are presented only to assist in understanding the method and its core concepts. It should be noted that, for those skilled in the art, it is possible to make various improvements and modifications to the present invention without departing from the principle of the present invention, and those improvements and modifications also fall within the scope of the claims of the present invention.
Claims (10)
1. A system performance stability test method is characterized by comprising the following steps:
s1: setting the test preheating times to be 1;
s2: starting a SERT test;
s3: in the test operation process, monitoring the log file in real time to obtain a preheating performance value, and obtaining a formal performance value when the formal test is finished after preheating;
s4: calculating the deviation amount between the preset performance value and the formal performance value;
s5: judging whether the deviation amount is smaller than a deviation threshold value or not; if yes, executing step S6; if not, executing the step S9;
s6: judging whether all loads are loaded or not; if yes, executing step S7; if not, executing the step S8;
s7: the test continues to run until the end;
s8: adding a load and going to step S3;
s9: by increasing the preheating times, the system is judged to reach a steady state by utilizing the preheating performance variation coefficient after the system is preheated, and the test is executed.
2. The method for testing system performance stability according to claim 1, wherein the step S9 comprises the steps of:
s91: forcibly ending the test program, and setting the preheating times to be 2;
s92: starting a SERT test;
s93: extracting a preheating performance value from the log file;
s94: calculating the coefficient of variation of preheating performance according to the preheating performance value of each preheating;
s95: judging whether the coefficient of variation of the preheating performance is larger than a judgment threshold value or not; if yes, go to step S96; if not, executing step S97;
s96: terminating the test, adding 1 to the preheating times, and executing S92;
s97: judging whether all loads are loaded or not; if yes, executing step S7; if not, executing step S98;
s98: a load is added and the process goes to step S93.
3. The method for testing system performance stability according to claim 2, wherein the step S94 comprises:
calculating the average value and the standard deviation of the preheating performance value according to the preheating performance value of each preheating;
and calculating the preheating variation coefficient according to the average value and the standard deviation of the preheating performance value.
4. The method for testing system performance stability according to claim 3, wherein the step S94 specifically comprises:
calculating the average value a and the standard deviation b of the preheating performance value according to the preheating performance value of each preheating;
and calculating the preheating variation coefficient c according to the formula c = b/a.
5. The method for testing system performance stability according to claim 1, wherein the step S7 further comprises:
and recording the current preheating times and setting the preheating times as the optimal preheating times.
6. The method of claim 1, wherein the deviation threshold is 5% of a formal performance value.
7. The method according to claim 2, wherein the determination threshold is 5%.
8. A system performance stability testing system, comprising:
the setting unit is used for setting the test preheating times;
the starting unit is used for starting the SERT test;
the monitoring unit is used for monitoring the log file in real time in the test running process to obtain a preheating performance value and obtaining a formal performance value when the formal test is finished after preheating;
the calculating unit is used for calculating the deviation amount between the preset performance value and the formal performance value;
a first judgment unit for judging whether the deviation amount is smaller than a deviation threshold value;
the second judgment unit is used for judging whether all the loads are loaded or not;
the execution unit is used for running the test until the test is finished;
the adjusting unit is used for starting the SERT test again after increasing a load;
and the judgment test unit is used for judging that the system reaches a steady state by increasing the preheating times and utilizing the preheating performance variation coefficient after the system is preheated, and executing the test.
9. A system performance stability testing apparatus, comprising:
the memory is used for storing a system performance stability test program;
a processor for implementing the steps of the system performance stability testing method according to any one of claims 1 to 7 when executing the system performance stability testing program.
10. A readable storage medium, characterized by: the readable storage medium has stored thereon a system performance stability test program, which when executed by a processor implements the steps of the system performance stability test method of any one of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211261451.1A CN115687044A (en) | 2022-10-14 | 2022-10-14 | System performance stability testing method, system, device and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211261451.1A CN115687044A (en) | 2022-10-14 | 2022-10-14 | System performance stability testing method, system, device and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN115687044A true CN115687044A (en) | 2023-02-03 |
Family
ID=85066015
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202211261451.1A Pending CN115687044A (en) | 2022-10-14 | 2022-10-14 | System performance stability testing method, system, device and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN115687044A (en) |
-
2022
- 2022-10-14 CN CN202211261451.1A patent/CN115687044A/en active Pending
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110532168B (en) | Full-link interface pressure measurement method and device, computer equipment and storage medium | |
| US6820222B2 (en) | Apparatus and method for processor power measurement in a digital signal processor using trace data and simulation techniques | |
| CN113961413A (en) | Server power consumption testing method and device | |
| CN111309579B (en) | Test method and related device for system event log quantity acquisition function | |
| CN110891000A (en) | GPU bandwidth performance detection method, system and related device | |
| CN109800022B (en) | Method, system, terminal and storage medium for automatically comparing BIOS information difference | |
| CN112948189B (en) | Margin test method, margin test system and related device | |
| CN112269697B (en) | Equipment storage performance testing method, system and related device | |
| CN115687044A (en) | System performance stability testing method, system, device and storage medium | |
| WO2018227475A1 (en) | Fingerprint chip detection method, device and system | |
| CN111597111A (en) | Application program starting speed monitoring method and device | |
| CN110543394A (en) | server sensor information consistency testing method, system, terminal and storage medium | |
| CN110609243B (en) | Method and system for testing CPU power supply efficiency and related components | |
| CN111340349B (en) | Product reliability evaluation method, device, computer equipment and storage medium | |
| CN114942878A (en) | Automatic performance testing method for internet application and related equipment | |
| CN111190806B (en) | Log processing method and device of voice interaction equipment | |
| CN113704099A (en) | Test script generation method and equipment for spacecraft power system evaluation | |
| CN115269345A (en) | Database testing method, device, equipment and storage medium | |
| CN112632174A (en) | Data inspection method, device and system | |
| CN116387652B (en) | Online maintenance system and method for formation/capacity-division power supply equipment | |
| CN113741672B (en) | Mainboard power supply leakage detection method, system and related components | |
| US20230350772A1 (en) | Power supply health check system and method thereof | |
| CN116347412A (en) | Intelligent measurement method, device and equipment for health index | |
| CN117608938A (en) | Server testing method and device, electronic equipment and storage medium | |
| CN115934568A (en) | Method and related device for automatically testing performance of exported file |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |