CN118363799A

CN118363799A - Method, device, equipment and medium for testing performance problem recurrence of solid state disk

Info

Publication number: CN118363799A
Application number: CN202410366500.0A
Authority: CN
Inventors: 刘方健; 靳嘉晖; 李允阳
Original assignee: Suzhou Metabrain Intelligent Technology Co Ltd
Current assignee: Suzhou Metabrain Intelligent Technology Co Ltd
Priority date: 2024-03-28
Filing date: 2024-03-28
Publication date: 2024-07-19

Abstract

The application discloses a method, a device, equipment and a medium for testing the performance problem recurrence of a solid state disk, and relates to the technical field of computers. The method comprises the following steps: acquiring performance problem data of a target solid state disk, determining a corresponding processing rule according to a storage format of the performance problem data, and analyzing the performance problem data according to the processing rule to acquire test environment information and workload information corresponding to the target solid state disk; determining a target test strategy corresponding to the target solid state disk according to the performance problem data, and obtaining a test method based on a general test strategy and the target test strategy; generating a test script according to the test environment information, the workload information and the test method, and performing performance problem reproduction test by running the test script. The performance problem can be reproduced efficiently and accurately, the waste of time and labor cost is reduced, and the accuracy of the performance test result after the test process and the test are finished is ensured.

Description

Method, device, equipment and medium for testing performance problem recurrence of solid state disk

Technical Field

The present invention relates to the field of computer technologies, and in particular, to a method, an apparatus, a device, and a medium for testing performance problems of a solid state disk.

Background

Problem reproduction means that the problem is presented again, i.e. the problem needs to be reproduced first and then to be examined where it is difficult to find where the problem is if it is not reproduced.

In the related art, for the performance problem reproduction test of the Solid state disk (Solid STATE DISK or Solid STATE DRIVE), the following method is generally adopted: and acquiring performance problems from clients or maintenance departments, manually analyzing the performance test problems, and then writing test scripts to reproduce the problems. But in actual use the following problems remain: the conventional performance test method cannot reproduce the problems; if the test items are more, a lot of time is spent in script writing, reworking or retesting is easily caused by mistakes in the manual writing process, and the stability and the accuracy of the test result cannot be ensured; in addition, when the performance problem is a result file, the file needs to be opened one by one for viewing, and when the mass file is faced, the analysis cannot be basically performed, and retest can be performed only by means of personal experience design examples.

Disclosure of Invention

Therefore, the invention aims to provide a method, a device, equipment and a medium for reproducing the performance problem of the solid state disk, which can reproduce the performance problem efficiently and accurately, reduce the waste of time and labor cost and ensure the accuracy of the performance test result after the test process and the test are completed. The specific scheme is as follows:

in a first aspect, the application discloses a method for testing the performance problem recurrence of a solid state disk, which comprises the following steps:

Acquiring performance problem data of a target solid state disk, determining a corresponding processing rule according to a storage format of the performance problem data, and analyzing the performance problem data according to the processing rule to acquire test environment information and workload information corresponding to the target solid state disk;

Determining a target test strategy corresponding to the target solid state disk according to the performance problem data, and obtaining a test method based on a general test strategy and the target test strategy;

generating a test script according to the test environment information, the workload information and the test method, and performing performance problem reproduction test by running the test script.

Optionally, the storage format includes text format, picture format, table format and file format; analyzing the performance problem data according to the processing rule to obtain test environment information and workload information corresponding to the target solid state disk, including:

If the storage format is a text format, extracting to obtain test environment information and workload information in the performance problem data by extracting keywords;

if the storage format is a picture format or a table format, converting the performance problem data into a word description through format conversion, and extracting test environment information and workload information corresponding to the target solid state disk from the word description in a keyword extraction mode;

And if the storage format is a file format, screening out a target result file according to a target file suffix format, and extracting test environment information and workload information corresponding to the target solid state disk from the target result file in a regular matching mode by running a preset result analysis script.

Optionally, if the storage format is a file format, screening a target result file according to a target file suffix format, and extracting test environment information and workload information corresponding to the target solid state disk from the target result file by running a preset result analysis script in a regular matching manner, where the method further includes:

Determining a load test mode according to the workload information, and determining a multi-load execution sequence according to the workload information;

and adding the load test mode and the multi-load execution sequence into the workload information.

Optionally, the determining a load test mode according to the workload information includes:

Determining the operation time from the workload information, and rounding the operation time to obtain rounded operation time;

Judging whether the operation time after rounding can be divided by 60, if so, judging that the test load is tested according to time;

if the data cannot be divided, judging whether the written data amount is a multiple of the disk capacity;

If the capacity of the disk is multiple, judging that the test load is tested according to a full-disk cyclic writing mode;

If the test load is not a multiple of the disk capacity, judging that the test load is tested according to the load size;

And obtaining a load test mode according to the judgment result.

Optionally, the determining the multi-load execution sequence according to the workload information includes:

determining the test ending time and the running time of all the test items from the workload information, and calculating the starting time corresponding to each test item;

screening test items with the difference value of the starting time within the allowable error range as parallel tests;

screening two adjacent test items of which the starting time is before the ending time of the previous test item from the starting time of the next test item as parallel test items;

screening out two adjacent test items with the starting time of the rear test item being after the ending time of the front test item, and taking the two adjacent test items as sequential test items;

and obtaining a multi-load execution sequence according to the screening result.

Optionally, the determining, according to the performance problem data, a target test policy corresponding to the target solid state disk includes:

acquiring attribute information of the target solid state disk;

Inquiring a corresponding relation between a pre-constructed hard disk attribute and a testing strategy according to the attribute information, and determining a target testing strategy corresponding to the target solid state disk; the testing strategies in the corresponding relation between the hard disk attributes and the testing strategies comprise a load testing strategy and a testing step strategy.

Optionally, the querying, according to the attribute information, a corresponding relationship between a pre-constructed hard disk attribute and a test policy, and determining a target test policy corresponding to the target solid state disk includes:

Acquiring version information of the target solid state disk;

inquiring the corresponding relation between the hard disk attribute and the test strategy according to the version information, and determining a load test strategy corresponding to the target solid state disk; wherein the load test policy includes a load value;

Correspondingly, the method for obtaining the test based on the universal test strategy and the target test strategy comprises the following steps:

Modifying an original load value in the general test strategy according to the load value, and taking the modified general test strategy as the test method;

the step of inquiring the corresponding relation between the pre-constructed hard disk attribute and the testing strategy according to the attribute information to determine the target testing strategy corresponding to the target solid state disk comprises the following steps:

Obtaining model information of the target solid state disk;

Inquiring the corresponding relation between the hard disk attribute and the testing strategy according to the model information, and determining a first testing step strategy corresponding to the target solid state disk; the first test step strategy comprises the steps of firstly executing formatting operation on the solid state disk and then executing pre-writing operation of sequential writing on a cache region;

adjusting the testing steps in the general testing strategy according to the first testing step strategy, and taking the modified general testing strategy as the testing method;

Obtaining manufacturer information corresponding to the target solid state disk;

Inquiring the corresponding relation between the hard disk attribute and the testing strategy according to the manufacturer information, and determining a second testing step strategy corresponding to the target solid state disk; the second testing step strategy comprises the steps of executing random write operation on the whole disk after executing sequential write operation on the whole disk, and then performing bandwidth test;

correspondingly, the method for obtaining the test based on the general test strategy and the target test strategy comprises the following steps:

And adjusting the testing steps in the general testing strategy according to the second testing step strategy, and taking the modified general testing strategy as the testing method.

In a second aspect, the application discloses a device for testing the performance problem reproduction of a solid state disk, which comprises:

The data analysis module is used for acquiring performance problem data of the target solid state disk, determining corresponding processing rules according to the storage format of the performance problem data, and analyzing the performance problem data according to the processing rules to acquire test environment information and workload information corresponding to the target solid state disk;

The test method generation module is used for determining a target test strategy corresponding to the target solid state disk according to the performance problem data, and obtaining a test method based on the general test strategy and the target test strategy;

And the problem reproduction test module is used for generating a test script according to the test environment information, the workload information and the test method, and executing the performance problem reproduction test by running the test script.

In a third aspect, the present application discloses an electronic device, comprising:

A memory for storing a computer program;

And the processor is used for executing the computer program to realize the solid state disk performance problem reproduction test method.

In a fourth aspect, the present application discloses a computer-readable storage medium for storing a computer program; the computer program realizes the method for testing the performance problem of the solid state disk when being executed by the processor.

According to the method, performance problem data of a target solid state disk are obtained, corresponding processing rules are determined according to storage formats of the performance problem data, and the performance problem data are analyzed according to the processing rules so as to obtain testing environment information and workload information corresponding to the target solid state disk; determining a target test strategy corresponding to the target solid state disk according to the performance problem data, and obtaining a test method based on a general test strategy and the target test strategy; generating a test script according to the test environment information, the workload information and the test method, and performing performance problem reproduction test by running the test script. It can be seen that according to the performance problem data of the solid state disk, the original performance test problem is automatically analyzed through the script, the performance test problem is rapidly analyzed by adopting the corresponding rule according to the performance problem storage format, the corresponding target test strategy is adopted according to the characteristics of the performance problem data, the problem that the general test strategy cannot detect the problem is avoided, and finally the corresponding problem reproduction and comparison test are performed according to the analysis result. Therefore, the performance problems are reversely analyzed, the standardized automatic test and test result is restored after the analysis is completed, the performance problems can be effectively and accurately reproduced, the time and labor cost waste caused by the performance test and the reproduction of the solid state disk are reduced, the accuracy of the performance test result in the test process and after the test is completed is ensured, and the performance test efficiency is improved.

Drawings

In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings that are required to be used in the embodiments or the description of the prior art will be briefly described below, and it is obvious that the drawings in the following description are only embodiments of the present invention, and that other drawings can be obtained according to the provided drawings without inventive effort for a person skilled in the art.

FIG. 1 is a flow chart of a method for testing the performance problem reproduction of a solid state disk;

FIG. 2 is a schematic diagram of a performance problem result file according to one embodiment of the present application;

FIG. 3 is a schematic diagram of data of a result file according to the present application;

FIG. 4 is a schematic diagram of a device for testing performance problems of a solid state disk according to the present application;

fig. 5 is a block diagram of an electronic device according to the present application.

Detailed Description

For the purpose of making the objects, technical solutions and advantages of the embodiments of the present invention more apparent, the technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention, and it is apparent that the described embodiments are only some embodiments of the present invention, not all embodiments. All other embodiments, which can be made by those skilled in the art based on the embodiments of the invention without making any inventive effort, are intended to be within the scope of the invention.

In the related art, the method for testing the performance problem of the solid state disk is generally as follows: and acquiring performance problems from clients or maintenance groups, manually analyzing the performance test problems, and then writing test scripts to reproduce the problems. But in actual use the following problems remain: based on the characteristics of the solid state disk, the performance is influenced by the standard parameters of the expansion bus of the high-speed serial computer, the CPU performance of the tester, the workload difference and the like, and the positioning problem is tested for multiple times each time, so that the positioning time is longer; the testing strategies of different clients are different, and the conventional performance testing steps cannot reproduce the problems. If the test items are more, the time spent in writing the script, the multi-environment comparison test and the subsequent result arrangement time are longer; because each person has different experiences, reworking or retesting is easily caused by mistakes in the manual writing process, and the problem of quick retesting is not easily caused; different methods for writing script test by different persons are different, and stability and accuracy of the test result cannot be guaranteed; the process of collecting results may be manual or may be a different script, and the results may be erroneous. When the original problem is a result file, only one result file can be opened to check at the moment, then the testing process before and after analysis is carried out, the construction environment reproduction problem is carried out, and when the files are more, the analysis can not be basically carried out, and only the retest can be carried out by means of personal experience design examples. In order to overcome the technical problems, the application provides a method for reproducing the performance problems of a solid state disk, which can reproduce the performance problems efficiently and accurately, reduce the waste of time and labor cost and ensure the accuracy of the performance test results after the test process and the test are completed.

The embodiment of the application discloses a method for testing the performance problem reproduction of a solid state disk, which is shown in FIG. 1, and can comprise the following steps:

Step S11: and acquiring performance problem data of the target solid state disk, determining a corresponding processing rule according to a storage format of the performance problem data, and analyzing the performance problem data according to the processing rule to acquire test environment information and workload information corresponding to the target solid state disk.

Firstly, the performance problem of the target solid state disk can be obtained from a client or a maintenance department, and the performance problem is generally described as an excel, a picture or a result file (such as a fio file) mode. The analysis processing rules are different for different storage formats, so that corresponding processing rules are determined according to the storage formats of the performance problem data, and then the performance problem data are analyzed according to the determined processing rules so as to extract information such as test environment information, workload information and the like corresponding to the target solid state disk.

It should be noted that, in a complete problem reproduction test, a lot of keyword information is required, and in particular, the information may be divided into test environment information, workload information and a test method, where the information may sometimes be directly extracted from performance problem data, and when the information cannot be obtained from the performance problem data, the information needs to be further calculated and obtained. Test environment information includes, but is not limited to, server, capacity point, vendor, version information, number (number of SSDs required for testing). Test methods include, but are not limited to, test steps and test loads. Workload information includes, but is not limited to, engine, bs (Buffer Size), read and write type, thread count (numjobs), queue depth (iodepth), run time (runtime) or number of loops (loops), task name, and log file.

In some embodiments, the storage format includes text format, picture format, table format, and file format; analyzing the performance problem data according to the processing rule to obtain test environment information and workload information corresponding to the target solid state disk, wherein the method specifically includes: and if the storage format is a text format, extracting the test environment information and the workload information in the performance problem data by extracting keywords. The method is characterized in that the method aims at the performance problem, namely, text description is adopted, and the keyword is extracted for processing; for example, the text of performance problems is described as: the random writing performance of 4k is not up to standard and is lower; then the key is extracted: 4K, random writing and substandard. If the storage format is a picture format or a table format, converting the performance problem data into a text description through format conversion, and extracting test environment information and workload information corresponding to the target solid state disk from the text description through a keyword extraction mode. If the performance problem is in a picture or excel format, converting the performance problem into characters through picture word processing and excel processing, and then processing the characters through a keyword extraction mode; the sequence defaults to sequential processing during testing, and can also be set to processing according to a general mode. And if the storage format is a file format, screening out a target result file according to a target file suffix format, and extracting test environment information and workload information corresponding to the target solid state disk from the target result file in a regular matching mode by running a preset result analysis script. For example, the original problem is a number of fio result files, as shown in fig. 2, the target result file to be analyzed is xxx.log (the remaining files like randrw30_1_iops.1.Log are not analyzed); and (3) using the existing result analysis script, opening a result file, and obtaining corresponding keyword information of the load in a regular or character matching mode and the like to obtain an analysis processing result shown in fig. 3.

If the storage format is a file format, screening out a target result file according to a target file suffix format, and extracting test environment information and workload information corresponding to the target solid state disk from the target result file in a regular matching mode by running a preset result analysis script, wherein the method further comprises the following steps: determining a load test mode according to the workload information, and determining a multi-load execution sequence according to the workload information; and adding the load test mode and the multi-load execution sequence into the workload information. It can be understood that, for the performance problem data of the file format, the load test mode and the multi-load execution sequence cannot be directly extracted, and further calculation and acquisition are required according to the load information which can be extracted.

In some embodiments, the determining a load test manner according to the workload information may include: determining the operation time from the workload information, and rounding the operation time to obtain rounded operation time; judging whether the operation time after rounding can be divided by 60, if so, judging that the test load is tested according to time; if the data cannot be divided, judging whether the written data amount is a multiple of the disk capacity; if the capacity of the disk is multiple, judging that the test load is tested according to a full-disk cyclic writing mode; if the test load is not a multiple of the disk capacity, judging that the test load is tested according to the load size; and obtaining a load test mode according to the judgment result. It will be appreciated that, based on the results of several previous tests, if the typical error in terms of time is within 10ms, the value of the extracted run time (runtime) is an integer (the method is the last 1 bit to 0, then the last but one bit is also 0 if 1), such as the run time is 600001msec, rounded up to 600000msec; then dividing 60, if the dividing can be completed, testing the load according to time; if not, the test is writing according to the size or the mode of writing several times of the whole disk, the load is size or loops, and whether the writing is multi-time writing can be calculated according to the written data quantity and the capacity of the disk; for example, if the capacity of the disc is 3.84T and the amount of written data is 7.68T, the parameters are loops =2 when the disc is written 2 times.

In some embodiments, determining the multi-load execution order according to the workload information may include: determining the test ending time and the running time of all the test items from the workload information, and calculating the starting time corresponding to each test item; screening test items with the difference value of the starting time within the allowable error range as parallel tests; screening two adjacent test items of which the starting time is before the ending time of the previous test item from the starting time of the next test item as parallel test items; screening out two adjacent test items with the starting time of the rear test item being after the ending time of the front test item, and taking the two adjacent test items as sequential test items; and obtaining a multi-load execution sequence according to the screening result. Namely, the load sequence determining method comprises the following steps: 1. the method comprises the steps of obtaining the time and the operation duration of the test ending, wherein the test starting time is as follows: end time-run length; the start and end times of all files are sequentially obtained and calculated. 2. Ordered by test start and end times. 3. Parallel testing is performed from scratch for 2 or more items that have the same start time (within 10ms of error); if the starting time is different, calculating 2 adjacent time differences, and if the starting test time of the following item is after the ending time of the previous item for 2 adjacent items, the 2 items are sequential tests; if the latter item start time is before the former item end time, then these 2 items are parallel tests, where the time of the latter item start needs to be calculated.

The analyzing the performance problem data according to the processing rule to obtain the test environment information and the workload information corresponding to the target solid state disk may include: analyzing the performance problem data according to the processing rule to obtain testing environment information, workload information and a testing method corresponding to the target solid state disk; correspondingly, the determining the target test strategy corresponding to the target solid state disk according to the performance problem data, and before obtaining the test method based on the general test strategy and the target test strategy, further comprises: judging whether a test method obtained from the performance problem data is complete or not; if the target test strategy is incomplete, executing the operation of determining the target test strategy corresponding to the target solid state disk according to the performance problem data; and if the test environment information is complete, executing the operation of generating the test script according to the test environment information, the workload information and the test method. It will be appreciated that performance testing generally includes: bandwidth, iops (Input/Output Operations Per Second, read/write times per second), latency, qos (Quality of Service ). Each test step comprises: initialization, pre-writing, testing and result analysis. The testing method comprises three steps of initialization, pre-writing and testing, wherein for the three steps, whether the analysis result of the performance problem data according to the first step can be completely contained is firstly checked, and if the analysis result is contained, the next step of script retesting is directly generated; if not, the test method is calculated and generated.

Step S12: and determining a target test strategy corresponding to the target solid state disk according to the performance problem data, and obtaining a test method based on the general test strategy and the target test strategy.

It will be appreciated that, based on the characteristics of the SSD, the performance values of the SSD are different when the SSD is empty (after first powering up or after formatting the SSD to return to an initial state (format operation)), steady state (after writing certain data sequentially), GC operation (after garbage collection in the background, such as after randomly writing certain data), background with small data processing, and different QDs (test loads), and the initialization and pre-writing processes are different, which may also result in different test results. In the related art, the test complies with the test standard of the Performance test set by the PTS (Performance TESTING SERVICE, global network storage industry association (SNIA)), and the form of initialization, pre-writing and testing in the test strategy is fixed, so that the Performance test problem cannot be reproduced in many cases. Therefore, the application introduces test strategy selection, and adds other test strategies besides the original PTS test.

In some embodiments, the determining, according to the performance problem data, a target test policy corresponding to the target solid state disk may include: acquiring attribute information of the target solid state disk; inquiring a corresponding relation between a pre-constructed hard disk attribute and a testing strategy according to the attribute information, and determining a target testing strategy corresponding to the target solid state disk; the testing strategies in the corresponding relation between the hard disk attributes and the testing strategies comprise a load testing strategy and a testing step strategy. Acquiring attribute information (such as manufacturer, nand attribute, data arrangement, GC efficiency and the like) of the hard disk according to analysis of the performance problem data, selecting a strategy according to a corresponding relation between the attribute of the hard disk and a test strategy, and directly carrying out the next step if the corresponding strategy exists; if the corresponding strategies do not exist, a testing method can be sequentially generated according to the priority of each strategy in the corresponding relation between the hard disk attribute and the testing strategy to carry out the reproduction test of the performance problem of the solid state disk.

In some embodiments, the querying the corresponding relationship between the pre-constructed hard disk attribute and the test policy according to the attribute information, determining a target test policy corresponding to the target solid state disk, and obtaining a test method based on the general test policy and the target test policy may include the following steps:

S211: acquiring version information of the target solid state disk;

S212: inquiring the corresponding relation between the hard disk attribute and the test strategy according to the version information, and determining a load test strategy corresponding to the target solid state disk; wherein the load test policy includes a load value;

s213: and modifying an original load value in the universal test strategy according to the load value, and taking the modified universal test strategy as the test method.

For example, the hard disk FTL (flash translation layer ) layers of the solid state hard disk of the Gen3 version and the solid state hard disk of the Gen4 version are different for the pressure processing mode, so the random write test load QD for Gen3 can be set to 4×32; gen4 random write test load QD may be set to then be 4 x 64. Test load QD = number of threads x queue depth. By adopting different test loads for different versions of hard disk, effective performance test can be performed, so that accuracy of performance problem reproduction is improved.

S221: obtaining model information of the target solid state disk;

S222: inquiring the corresponding relation between the hard disk attribute and the testing strategy according to the model information, and determining a first testing step strategy corresponding to the target solid state disk; the first test step strategy comprises the steps of firstly executing formatting operation on the solid state disk and then executing pre-writing operation of sequential writing on a cache region;

s223: and adjusting the testing steps in the general testing strategy according to the first testing step strategy, and taking the modified general testing strategy as the testing method.

For example, when the bandwidth test is performed in general sequential writing, the corresponding buffer area is directly switched to perform sequential writing for 2 times, after strategy selection, the internal arrangement of SSD is optimized according to the arrangement of model A, for example, the arrangement of 64k is optimized, when the bandwidth test is performed, the formatting operation of the solid state disk is required to be performed first, and then the buffer area sequential writing of 64k is performed to complete the pre-writing. By adopting different testing sequences aiming at different types of hard disks, the effectiveness of performance test can be improved, and the accuracy of performance problem reproduction is improved.

S231: obtaining manufacturer information corresponding to the target solid state disk;

S232: inquiring the corresponding relation between the hard disk attribute and the testing strategy according to the manufacturer information, and determining a second testing step strategy corresponding to the target solid state disk; the second testing step strategy comprises the steps of executing random write operation on the whole disk after executing sequential write operation on the whole disk, and then performing bandwidth test;

s233: and adjusting the testing steps in the general testing strategy according to the second testing step strategy, and taking the modified general testing strategy as the testing method.

For example, the default pre-writing in the general policy is to write a piece of data only sequentially, and then perform the bandwidth test, but the test policies of some manufacturers are different, and in this embodiment, after a new processing mode is adjusted to write a piece of data sequentially according to the manufacturer keyword identification, a part of data is written randomly, and then the bandwidth test is performed. By adopting different testing sequences aiming at hard disks of different manufacturers, the effectiveness of performance test can be improved, and the accuracy of performance problem reproduction is improved.

Therefore, the target testing strategy for adapting to the attributes of the solid state disk is selected according to the version information, the model information, the manufacturer information and the like of the solid state disk, and the generated testing method is more adapted to the target solid state disk, so that the comprehensiveness of the performance problem reproduction test of the solid state disk can be improved, and the situation that the universal performance testing method cannot reproduce the problem is avoided.

In one embodiment, the general test method steps include: 1. formatting the SSD so as to return the SSD to an initial state; 2. full disc sequential write 2 passes (steady state); 3. performing sequential read-write bandwidth, time delay and Qos test; 4. sequential read-write hybrid bandwidth, time delay and Qos test; 5. performing random reading iops, time delay and Qos test; 6. full disc random write for 2 hours (random write steady state); 7. performing random writing iops, time delay and Qos test; 8. the whole disk is randomly mixed for reading and writing for 1 hour; 9. hybrid random read-write iops, latency, qos test. The testing method obtained after the universal testing method is adjusted based on the determined target testing strategy comprises the following steps: 1. formatting the SSD so as to return the SSD to an initial state; 2. full disc sequential write 2 passes (steady state); 3. full disc random write 2 passes (random write steady state); 4. sequential read-write hybrid bandwidth, time delay and Qos test; 5. performing random reading iops, time delay and Qos test; 6. full disc random write for 2 hours (random write steady state); 8. hybrid random read-write iops, latency, qos test.

Step S13: generating a test script according to the test environment information, the workload information and the test method, and performing performance problem reproduction test by running the test script.

After the test environment information, the workload information and the test method are determined, a test script is generated, and performance problem reproduction test is carried out by running the test script. The method specifically comprises the steps of analyzing an output file to obtain a performance result, analyzing consistency in the test result and drawing the test result through a code borrowing related tool, collecting a test disc, environment information and the test result, packaging the test result together and placing the test result at a designated position to realize the storage of the test result.

After performance problem reproduction testing by running the test script, further comprising: obtaining a test result, and comparing the performance problem data with the test result; if the performance problem data is consistent with the test result, the target test strategy is reserved; recording the retention times of different target test strategies, and screening out target test strategies with the retention times exceeding a threshold value as test strategies to be updated; and updating the universal test strategy by using the test strategy to be updated to obtain a new universal test strategy. Analyzing and comparing whether the original performance problem data and the test result data are consistent, if so, characterizing that a test method generated based on a target test strategy meets requirements, and recording the target test strategy at the moment; the method comprises the steps of recording the retention times of different target test strategies, screening out the target test strategies with the retention times exceeding a threshold value as test strategies to be updated after repeated test of performance problems of the solid state disk, and updating the original general test strategy by using the retention strategies, so that the updated general test strategies are more matched with the performance problems of the solid state disk, and when a special situation can not determine that the target test strategies generate a customized test method, performing problem reproduction test by using the updated general test strategies.

The test method has the advantages that by combining the analysis result and selecting a proper strategy to carry out reproduction test, the test strategy can be updated according to the test result record after problem reproduction, the test is automatically analyzed according to the text pictures or the result files, then a test script is generated according to the test strategy to carry out relevant test, the execution time of manually analyzing the problem and writing the script is reduced, errors or missing detection are prevented, and original data can be compared according to different test environment results; the time of manual retesting is reduced, the steps of problem retesting are standardized, errors are prevented, the accuracy of performance problem retesting is improved, automatic analysis is realized, and performance problem retesting is executed.

From the above, in this embodiment, performance problem data of a target solid state disk is obtained, a corresponding processing rule is determined according to a storage format of the performance problem data, and the performance problem data is analyzed according to the processing rule, so as to obtain test environment information and workload information corresponding to the target solid state disk; determining a target test strategy corresponding to the target solid state disk according to the performance problem data, and obtaining a test method based on a general test strategy and the target test strategy; generating a test script according to the test environment information, the workload information and the test method, and performing performance problem reproduction test by running the test script. It can be seen that according to the performance problem data of the solid state disk, the original performance test problem is automatically analyzed through the script, the performance test problem is rapidly analyzed by adopting the corresponding rule according to the performance problem storage format, the corresponding target test strategy is adopted according to the characteristics of the performance problem data, the problem that the general test strategy cannot detect the problem is avoided, and finally the corresponding problem reproduction and comparison test are performed according to the analysis result. Therefore, the performance problems are reversely analyzed, the standardized automatic test and test result is restored after the analysis is completed, the performance problems can be effectively and accurately reproduced, the time and labor cost waste caused by the performance test and the reproduction of the solid state disk are reduced, the accuracy of the performance test result in the test process and after the test is completed is ensured, and the performance test efficiency is improved.

Correspondingly, the embodiment of the application also discloses a device for testing the performance problem recurrence of the solid state disk, which is shown in fig. 4 and comprises the following components:

the data analysis module 11 is configured to obtain performance problem data of a target solid state disk, determine a corresponding processing rule according to a storage format of the performance problem data, and analyze the performance problem data according to the processing rule to obtain test environment information and workload information corresponding to the target solid state disk;

The test method generating module 12 is configured to determine a target test policy corresponding to the target solid state disk according to the performance problem data, and obtain a test method based on the general test policy and the target test policy;

and the problem reproduction test module 13 is used for generating a test script according to the test environment information, the workload information and the test method, and executing the performance problem reproduction test by running the test script.

In some embodiments, the storage format may include text format, picture format, table format, and file format; the data analysis module 11 may specifically include:

The first data analysis unit is used for extracting test environment information and workload information in the performance problem data by extracting keywords if the storage format is a text format;

The second data analysis unit is used for converting the performance problem data into text description through format conversion if the storage format is a picture format or a table format, and extracting the test environment information and the workload information corresponding to the target solid state disk from the text description through a keyword extraction mode;

And the third data analysis unit is used for screening out a target result file according to a target file suffix format if the storage format is a file format, and extracting test environment information and workload information corresponding to the target solid state disk from the target result file in a regular matching mode by running a preset result analysis script.

In some specific embodiments, the third data analysis unit may specifically include:

The load test mode and execution sequence determining unit is used for determining a load test mode according to the workload information and determining a multi-load execution sequence according to the workload information;

And the information adding unit is used for adding the load test mode and the multi-load execution sequence into the workload information.

In some embodiments, the load test manner and execution sequence determining unit may specifically include:

the rounding unit is used for determining the running time from the workload information, and rounding the running time to obtain rounded running time;

the first test mode judging unit is used for judging whether the rounded running time can be divided by 60, and if so, judging that the test load is tested according to time;

a data amount judging unit for judging whether the written data amount is a multiple of the disk capacity if it cannot be divided by the integer;

the second test mode judging unit is used for judging that the test load is tested according to the full-disc circulation writing mode if the disc capacity is multiple;

A third test mode judging unit for judging that the test load is tested according to the load size if the test load is not a multiple of the disk capacity;

and the load test mode determining unit is used for obtaining a load test mode according to the judging result.

The starting time determining unit is used for determining the testing ending time and the running time of all the test items from the workload information and calculating the starting time corresponding to each test item;

The first screening unit is used for screening test items with the difference value of the starting time within the allowable error range as parallel tests;

the second screening unit is used for screening two adjacent test items, the starting time of which is before the ending time of the previous test item, of the rear test item to be used as parallel test items;

A third screening unit, configured to screen two adjacent test items after the start time of the subsequent test item is the end time of the preceding test item, as sequential test items;

And the multi-load execution sequence determining unit is used for obtaining the multi-load execution sequence according to the screening result.

In some embodiments, the test method generating module 12 may specifically include:

the attribute information acquisition unit is used for acquiring attribute information of the target solid state disk;

the target test strategy determining unit is used for inquiring the corresponding relation between the pre-constructed hard disk attribute and the test strategy according to the attribute information and determining a target test strategy corresponding to the target solid state disk; the testing strategies in the corresponding relation between the hard disk attributes and the testing strategies comprise a load testing strategy and a testing step strategy.

In some specific embodiments, the target test policy determining unit may specifically include:

the version information acquisition unit is used for acquiring the version information of the target solid state disk;

the load test strategy determining unit is used for inquiring the corresponding relation between the hard disk attribute and the test strategy according to the version information and determining the load test strategy corresponding to the target solid state disk; wherein the load test policy includes a load value;

accordingly, the test method generating module 12 may specifically include:

The load value modification unit is used for modifying an original load value in the universal test strategy according to the load value, and taking the modified universal test strategy as the test method;

The target test policy determining unit may specifically include:

the model information acquisition unit is used for acquiring the model information of the target solid state disk;

The first testing step strategy determining unit is used for inquiring the corresponding relation between the hard disk attribute and the testing strategy according to the model information and determining a first testing step strategy corresponding to the target solid state disk; the first test step strategy comprises the steps of firstly executing formatting operation on the solid state disk and then executing pre-writing operation of sequential writing on a cache region;

accordingly, the test method generating module 12 may specifically include:

a first step adjustment unit, configured to adjust a test step in the generic test policy according to the first test step policy, and use the modified generic test policy as the test method;

The target test policy determining unit may specifically include:

The manufacturer information acquisition unit is used for acquiring manufacturer information corresponding to the target solid state disk;

the second testing step strategy determining unit is used for inquiring the corresponding relation between the hard disk attribute and the testing strategy according to the manufacturer information and determining a second testing step strategy corresponding to the target solid state disk; the second testing step strategy comprises the steps of executing random write operation on the whole disk after executing sequential write operation on the whole disk, and then performing bandwidth test;

accordingly, the test method generating module 12 may specifically include:

And the second step adjusting unit is used for adjusting the testing steps in the general testing strategy according to the second testing step strategy, and taking the modified general testing strategy as the testing method.

Further, the embodiment of the application also discloses an electronic device, and referring to fig. 5, the content in the drawing should not be considered as any limitation on the application scope of the application.

Fig. 5 is a schematic structural diagram of an electronic device 20 according to an embodiment of the present application. The electronic device 20 may specifically include: at least one processor 21, at least one memory 22, a power supply 23, a communication interface 24, an input output interface 25, and a communication bus 26. The memory 22 is configured to store a computer program, where the computer program is loaded and executed by the processor 21 to implement relevant steps in the solid state disk performance problem reproduction test method disclosed in any of the foregoing embodiments.

In this embodiment, the power supply 23 is configured to provide an operating voltage for each hardware device on the electronic device 20; the communication interface 24 can create a data transmission channel between the electronic device 20 and an external device, and the communication protocol to be followed is any communication protocol applicable to the technical solution of the present application, which is not specifically limited herein; the input/output interface 25 is used for acquiring external input data or outputting external output data, and the specific interface type thereof may be selected according to the specific application requirement, which is not limited herein.

The memory 22 may be a carrier for storing resources, such as a read-only memory, a random access memory, a magnetic disk, or an optical disk, and the resources stored thereon include an operating system 221, a computer program 222, and data 223 including performance problem data, and the storage may be temporary storage or permanent storage.

The operating system 221 is used for managing and controlling various hardware devices on the electronic device 20 and the computer program 222, so as to implement the operation and processing of the processor 21 on the mass data 223 in the memory 22, which may be Windows Server, netware, unix, linux, etc. The computer program 222 may further include a computer program that can be used to perform other specific tasks in addition to the computer program that can be used to perform the solid state disk performance problem reproduction test method performed by the electronic device 20 as disclosed in any of the foregoing embodiments.

Further, the embodiment of the application also discloses a computer storage medium, wherein the computer storage medium stores computer executable instructions, and when the computer executable instructions are loaded and executed by a processor, the steps of the solid state disk performance problem recurrence test method disclosed in any embodiment are realized.

In this specification, each embodiment is described in a progressive manner, and each embodiment is mainly described in a different point from other embodiments, so that the same or similar parts between the embodiments are referred to each other. For the device disclosed in the embodiment, since it corresponds to the method disclosed in the embodiment, the description is relatively simple, and the relevant points refer to the description of the method section.

The steps of a method or algorithm described in connection with the embodiments disclosed herein may be embodied directly in hardware, in a software module executed by a processor, or in a combination of the two. The software modules may be disposed in Random Access Memory (RAM), memory, read Only Memory (ROM), electrically programmable ROM, electrically erasable programmable ROM, registers, hard disk, a removable disk, a CD-ROM, or any other form of storage medium known in the art.

Finally, it is further noted that relational terms such as first and second, and the like are used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Moreover, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising one … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.

The method, the device, the equipment and the medium for testing the performance problem reproduction of the solid state disk provided by the invention are described in detail, and specific examples are applied to the description of the principle and the implementation mode of the invention, and the description of the examples is only used for helping to understand the method and the core idea of the invention; meanwhile, as those skilled in the art will have variations in the specific embodiments and application scope in accordance with the ideas of the present invention, the present description should not be construed as limiting the present invention in view of the above.

Claims

1. The method for testing the performance problem recurrence of the solid state disk is characterized by comprising the following steps of:

2. The method for testing the performance problem reproduction of the solid state disk according to claim 1, wherein the storage format comprises a text format, a picture format, a table format and a file format; analyzing the performance problem data according to the processing rule to obtain test environment information and workload information corresponding to the target solid state disk, including:

3. The method for testing the performance problem of the solid state disk according to claim 2, wherein if the storage format is a file format, screening a target result file according to a target file suffix format, and extracting test environment information and workload information corresponding to the target solid state disk from the target result file by running a preset result analysis script in a regular matching manner, further comprises:

4. The method for testing the performance problem of the solid state disk according to claim 3, wherein the determining the load test mode according to the workload information comprises:

And obtaining a load test mode according to the judgment result.

5. The method for testing the performance problem recurrence of solid state disk according to claim 3, wherein determining the multi-load execution order according to the workload information comprises:

6. The method for testing the performance problem of the solid state disk according to any one of claims 1 to 5, wherein the determining, according to the performance problem data, the target test policy corresponding to the target solid state disk includes:

acquiring attribute information of the target solid state disk;

7. The method for testing the performance problem of the solid state disk according to claim 6, wherein the determining the target test policy corresponding to the target solid state disk according to the corresponding relation between the attribute of the hard disk constructed in advance and the test policy by querying the attribute information comprises:

Acquiring version information of the target solid state disk;

Obtaining model information of the target solid state disk;

8. The utility model provides a solid state disk performance problem recurrence testing arrangement which characterized in that includes:

9. An electronic device, comprising:

A memory for storing a computer program;

A processor for executing the computer program to implement the solid state disk performance problem reproduction test method as claimed in any one of claims 1 to 7.

10. A computer-readable storage medium storing a computer program; the method for testing the performance problem reproduction of the solid state disk according to any one of claims 1 to 7, wherein the computer program is executed by a processor.