CN111737098A - Method and system for evaluating IOPS (input/output protection system) of storage system based on number of hard disks - Google Patents
Method and system for evaluating IOPS (input/output protection system) of storage system based on number of hard disks Download PDFInfo
- Publication number
- CN111737098A CN111737098A CN202010508605.7A CN202010508605A CN111737098A CN 111737098 A CN111737098 A CN 111737098A CN 202010508605 A CN202010508605 A CN 202010508605A CN 111737098 A CN111737098 A CN 111737098A
- Authority
- CN
- China
- Prior art keywords
- iops
- hard disks
- storage
- storage system
- array
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 29
- 238000012360 testing method Methods 0.000 claims abstract description 42
- 238000013507 mapping Methods 0.000 claims description 9
- 238000011156 evaluation Methods 0.000 claims description 4
- 238000010586 diagram Methods 0.000 description 4
- 238000006467 substitution reaction Methods 0.000 description 3
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000000691 measurement method Methods 0.000 description 1
- 238000011056 performance test Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/30—Monitoring
- G06F11/34—Recording or statistical evaluation of computer activity, e.g. of down time, of input/output operation ; Recording or statistical evaluation of user activity, e.g. usability assessment
- G06F11/3466—Performance evaluation by tracing or monitoring
- G06F11/3485—Performance evaluation by tracing or monitoring for I/O devices
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Computer Hardware Design (AREA)
- Quality & Reliability (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Debugging And Monitoring (AREA)
Abstract
The invention provides a method and a system for evaluating a storage system IOPS based on the number of hard disks, which comprises the following steps: enumerating different storage configurations of the storage system except the number of the hard disks, and creating an array of the number of the hard disks of the storage system; substituting the array under each storage configuration to perform an IOPS test to obtain test data of each storage configuration; substituting the test data into a fitting formula to obtain a relational expression of the number of hard disks and the IOPS under different storage configurations; and evaluating the IPOS of the storage system under different configurations according to the relational expression. According to the method, the number of the hard disks and the IOPS of the same configuration storage system can be quantized into a formula through curve fitting, and the IOPS of the storage system is estimated through the number of the hard disks, so that reference is provided for performance estimation of the storage system.
Description
Technical Field
The invention belongs to the technical field of storage systems, and particularly relates to a method and a system for evaluating an IOPS (IOPS) of a storage system based on the number of hard disks.
Background
IOPS (Input/Output Operations Per Second) is a measurement method for computer storage device performance test, and is equivalent to the number of read/write times Per Second. With the development of internet technology, the global data volume is exponentially increased, and the storage of data is receiving more and more attention. In order to meet the increasing demand of data, the storage of data is also evolved from a single storage device to a complete storage system, and generally, storage systems with different configurations are applicable to different service scenarios, while IOPS is an important performance index of the storage system. For storage system manufacturers, how to recommend an appropriate storage system according to the actual service scene of a customer is very important, and no method for solving the above problems exists at present.
Disclosure of Invention
In view of the above disadvantages in the prior art, the present invention provides a method and system for evaluating a storage system IOPS based on the number of hard disks, so as to solve the above technical problems.
In a first aspect, the present invention provides a method for evaluating a storage system IOPS based on the number of hard disks, including:
enumerating different storage configurations of the storage system except the number of the hard disks, and creating an array of the number of the hard disks of the storage system;
substituting the array under each storage configuration to perform an IOPS test to obtain test data of each storage configuration;
substituting the test data into a fitting formula to obtain a relational expression of the number of hard disks and the IOPS under different storage configurations;
and evaluating the IPOS of the storage system under different configurations according to the relational expression.
Furthermore, the fitting formula is an exponential function y ═ ae ^ (b/x), a and b are calibration coefficients, b is less than 0, x is the number of hard disks, and y is IOPS.
Further, the array is an arithmetic difference array of the number of the hard disks of the storage system.
Further, the substituting the array for the IOPS test under each storage configuration to obtain the test data of each storage configuration includes:
under each storage configuration, IOPS is obtained by adjusting the number of the hard disks for testing;
creating a two-dimensional array of the number of hard disks and the IOPS;
and establishing a mapping relation between the storage configuration and the two-dimensional array.
Further, substituting the test data into a fitting formula to obtain a relational expression between the number of hard disks and the IOPS under different storage configurations includes:
performing point fitting on the two-dimensional array to obtain values corresponding to a and b, and further obtaining the relational expression;
and establishing a mapping relation between the storage configuration and the relational expression according to the mapping relation between the storage configuration and the two-dimensional array.
Further, the method further comprises:
and evaluating the performance of the storage system under different storage configurations according to the IOPS under different storage configurations.
Further, the method further comprises:
formula fitting was performed by MATLAB tool or Matplotlib library.
In a second aspect, the present invention provides a system for evaluating a storage system IOPS based on the number of hard disks, including:
the data acquisition unit is configured for enumerating different storage configurations of the storage system except the number of the hard disks and creating an array of the number of the hard disks of the storage system;
the IPOS testing unit is configured for substituting the array under each storage configuration to perform IOPS testing to obtain testing data of each storage configuration;
the formula fitting unit is configured to substitute the test data into a fitting formula and obtain a relational expression of the number of hard disks and the IOPS under different storage configurations;
and the IPOS evaluation unit is configured for evaluating the IPOS of the storage system under different configurations according to the relational expression.
The beneficial effect of the invention is that,
according to the method and the system for evaluating the IOPS of the storage system based on the number of the hard disks, provided by the invention, curve fitting is carried out through benchmark test data, the number of the hard disks of the same configuration storage system and the IOPS can be quantized into a formula, and the IOPS of the storage system is evaluated through the number of the hard disks, so that reference is provided for performance evaluation of the storage system.
In addition, the invention has reliable design principle, simple structure and very wide application prospect.
Drawings
In order to more clearly illustrate the embodiments or technical solutions in the prior art of the present invention, the drawings used in the description of the embodiments or prior art will be briefly described below, and it is obvious for those skilled in the art that other drawings can be obtained based on these drawings without creative efforts.
FIG. 1 is a schematic flow chart diagram of a method of one embodiment of the present invention;
FIG. 2 is a schematic block diagram of a system of one embodiment of the present invention;
FIG. 3 is a graph of a fit of an embodiment of the present invention;
FIG. 4 is a flow diagram of a method of one embodiment of the invention.
Detailed Description
In order to make those skilled in the art better understand the technical solution of the present invention, the technical solution in the embodiment of the present invention will be clearly and completely described below with reference to the drawings in the embodiment of the present invention, and it is obvious that the described embodiment is only a part of the embodiment of the present invention, and not all embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
The following explains key terms appearing in the present invention.
FIG. 1 is a schematic flow diagram of a method of one embodiment of the invention. The execution subject in fig. 1 may be a system for evaluating the storage system IOPS based on the number of hard disks.
As shown in fig. 1, the method 100 includes:
and step 140, evaluating the IPOS of the storage system under different configurations according to the relational expression.
Optionally, as an embodiment of the present invention, the fitting formula is an exponential function y ═ ae ^ (b/x), a and b are calibration coefficients, b <0, x is the number of hard disks, and y is IOPS.
Optionally, as an embodiment of the present invention, the array is an arithmetic array of the number of hard disks of the storage system.
Optionally, as an embodiment of the present invention, the substituting the array for the IOPS test under each storage configuration to obtain the test data of each storage configuration includes:
under each storage configuration, IOPS is obtained by adjusting the number of the hard disks for testing;
creating a two-dimensional array of the number of hard disks and the IOPS;
and establishing a mapping relation between the storage configuration and the two-dimensional array.
Optionally, as an embodiment of the present invention, the substituting the test data into a fitting formula to obtain a relationship between the number of hard disks and the IOPS under different storage configurations includes:
performing point fitting on the two-dimensional array to obtain values corresponding to a and b, and further obtaining the relational expression;
and establishing a mapping relation between the storage configuration and the relational expression according to the mapping relation between the storage configuration and the two-dimensional array.
Optionally, as an embodiment of the present invention, the method further includes:
and evaluating the performance of the storage system under different storage configurations according to the IOPS under different storage configurations.
Optionally, as an embodiment of the present invention, the method further includes:
formula fitting was performed by MATLAB tool or Matplotlib library.
In order to facilitate understanding of the present invention, the principle of the method for evaluating the storage system IOPS based on the number of hard disks according to the present invention is combined with the process of evaluating the storage system in the embodiment to further describe the method for evaluating the storage system IOPS based on the number of hard disks according to the present invention.
Specifically, as shown in fig. 4, the method for evaluating the storage system IOPS based on the number of hard disks includes:
1. enumerating different configuration combinations N of the storage system except the number of hard disks, wherein each configuration combination is used as a group of test prepositioned items;
2. setting an array M of the number of the hard disks, such as [24, 48, 72, 96, 120], wherein the longer the array is, the more accurate the result is;
3. traversing the storage configuration combination N, wherein each storage configuration is combined with the hard disk number array M to obtain a group of hard disk numbers and IOPS test data through testing, and N groups of N × M test items are total;
for the same storage system configuration, a group of IOPS data is tested by adjusting the number of hard disks, the number of the hard disks and the IOPS are defined as a two-dimensional array, and by dotting the two-dimensional array, the fact that the number of the hard disks and the IOPS have an exponential relationship is found, namely the IOPS of the storage system is improved along with the increase of the number of the hard disks in the initial stage, and after a certain IOPS is reached, the IOPS tends to be stable along with the increase of the number of the hard disks;
4. importing the N groups of test data into a fitting module to obtain N fitting formulas, wherein the fitting formulas are as follows:
y ═ ae ^ (b/x), wherein a and b are calibration coefficients, b is less than 0, x is the number of hard disks, and y is the corresponding IOPS; for different storage configurations, the calibration coefficients a and b have different values, by the method, a quantitative formula of the number of hard disks and the IOPS can be fitted for each storage configuration, the values of a and b can be obtained by performing point fitting on a two-dimensional array through an MATLAB tool or a Matplotlib library, and the fitting curve is shown in FIG. 3.
5. The IOPS can be obtained according to the storage configuration and the number of the hard disks according to a formula, and then the performances of different storage configurations are evaluated.
As shown in fig. 2, the system 200 includes:
the data acquisition unit 210 is configured to enumerate different storage configurations of the storage system except for the number of hard disks, and create an array of the number of the hard disks of the storage system;
an IPOS test unit 220 configured to perform an IOPS test on the array under each storage configuration to obtain test data of each storage configuration;
a formula fitting unit 230 configured to substitute the test data into a fitting formula and obtain a relational expression between the number of hard disks and the IOPS under different storage configurations;
and the IPOS evaluation unit 240 is configured to evaluate IPOS of the storage system under different configurations according to the relational expression.
Although the present invention has been described in detail by referring to the drawings in connection with the preferred embodiments, the present invention is not limited thereto. Various equivalent modifications or substitutions can be made on the embodiments of the present invention by those skilled in the art without departing from the spirit and scope of the present invention, and these modifications or substitutions are within the scope of the present invention/any person skilled in the art can easily conceive of the changes or substitutions within the technical scope of the present invention. Therefore, the protection scope of the present invention shall be subject to the protection scope of the claims.
Claims (8)
1. A method for evaluating a storage system IOPS based on the number of hard disks is characterized by comprising the following steps:
enumerating different storage configurations of the storage system except the number of the hard disks, and creating an array of the number of the hard disks of the storage system;
substituting the array under each storage configuration to perform an IOPS test to obtain test data of each storage configuration;
substituting the test data into a fitting formula to obtain a relational expression of the number of hard disks and the IOPS under different storage configurations;
and evaluating the IPOS of the storage system under different configurations according to the relational expression.
2. The method of claim 1, wherein the fitting formula is an exponential function y ═ ae ^ (b/x), a and b are calibration coefficients, b <0, x is the number of hard disks, and y is the IOPS.
3. The method of claim 1, wherein the array is an arithmetic array of the number of hard disks in the storage system.
4. The method of claim 1, wherein the replacing the array with the data of each storage configuration to perform the IOPS test to obtain the test data of each storage configuration comprises:
under each storage configuration, IOPS is obtained by adjusting the number of the hard disks for testing;
creating a two-dimensional array of the number of hard disks and the IOPS;
and establishing a mapping relation between the storage configuration and the two-dimensional array.
5. The method of claim 4, wherein the step of substituting the test data into a fitting formula to obtain the relationship between the number of the hard disks and the IOPS under different storage configurations comprises:
performing point fitting on the two-dimensional array to obtain values corresponding to a and b, and further obtaining the relational expression;
and establishing a mapping relation between the storage configuration and the relational expression according to the mapping relation between the storage configuration and the two-dimensional array.
6. The method for evaluating the IOPS of the storage system based on the number of the hard disks according to claim 1, further comprising:
and evaluating the performance of the storage system under different storage configurations according to the IOPS under different storage configurations.
7. The method for evaluating the IOPS of the storage system based on the number of the hard disks according to claim 1, further comprising:
formula fitting was performed by MATLAB tool or Matplotlib library.
8. A system for estimating storage system IOPS based on the number of hard disks is characterized by comprising:
the data acquisition unit is configured for enumerating different storage configurations of the storage system except the number of the hard disks and creating an array of the number of the hard disks of the storage system;
the IPOS testing unit is configured for substituting the array under each storage configuration to perform IOPS testing to obtain testing data of each storage configuration;
the formula fitting unit is configured to substitute the test data into a fitting formula and obtain a relational expression of the number of hard disks and the IOPS under different storage configurations;
and the IPOS evaluation unit is configured for evaluating the IPOS of the storage system under different configurations according to the relational expression.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010508605.7A CN111737098A (en) | 2020-06-06 | 2020-06-06 | Method and system for evaluating IOPS (input/output protection system) of storage system based on number of hard disks |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010508605.7A CN111737098A (en) | 2020-06-06 | 2020-06-06 | Method and system for evaluating IOPS (input/output protection system) of storage system based on number of hard disks |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN111737098A true CN111737098A (en) | 2020-10-02 |
Family
ID=72648444
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010508605.7A Pending CN111737098A (en) | 2020-06-06 | 2020-06-06 | Method and system for evaluating IOPS (input/output protection system) of storage system based on number of hard disks |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111737098A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115167770A (en) * | 2022-07-04 | 2022-10-11 | 中航机载系统共性技术有限公司 | Storage system IOPS performance evaluation method based on VDI scene |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109491610A (en) * | 2018-11-07 | 2019-03-19 | 郑州云海信息技术有限公司 | A kind of memory bandwidth analysis method and device based on hard disk configuration |
| CN110851317A (en) * | 2019-08-31 | 2020-02-28 | 苏州浪潮智能科技有限公司 | Method, device, equipment and storage medium for predicting IOPS performance data of storage equipment |
-
2020
- 2020-06-06 CN CN202010508605.7A patent/CN111737098A/en active Pending
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109491610A (en) * | 2018-11-07 | 2019-03-19 | 郑州云海信息技术有限公司 | A kind of memory bandwidth analysis method and device based on hard disk configuration |
| CN110851317A (en) * | 2019-08-31 | 2020-02-28 | 苏州浪潮智能科技有限公司 | Method, device, equipment and storage medium for predicting IOPS performance data of storage equipment |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115167770A (en) * | 2022-07-04 | 2022-10-11 | 中航机载系统共性技术有限公司 | Storage system IOPS performance evaluation method based on VDI scene |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US8983936B2 (en) | Incremental visualization for structured data in an enterprise-level data store | |
| US5655074A (en) | Method and system for conducting statistical quality analysis of a complex system | |
| US7970755B2 (en) | Test execution of user SQL in database server code | |
| US8468134B1 (en) | System and method for measuring consistency within a distributed storage system | |
| CN104636240B (en) | A kind of acquisition methods and terminal of information report | |
| CN110750529B (en) | Data processing method, device, equipment and storage medium | |
| US8245084B2 (en) | Two-level representative workload phase detection | |
| CN107480040A (en) | Workflow stability test method and apparatus | |
| CN115841046A (en) | Accelerated degradation test data processing method and device based on wiener process | |
| CN110334012B (en) | Risk assessment method and device | |
| CN111737098A (en) | Method and system for evaluating IOPS (input/output protection system) of storage system based on number of hard disks | |
| US20150154103A1 (en) | Method and apparatus for measuring software performance | |
| Whalen et al. | An evaluation of the self-determined probability-weighted moment method for estimating extreme wind speeds | |
| CN1851409B (en) | Method for estimating reliability of piezoelectric gyro | |
| CN111581080A (en) | Method, device, equipment and storage medium for generating interface test data | |
| CN114124318B (en) | Eye pattern measuring and calculating method and device under additive noise interference and storage medium | |
| CN107423222B (en) | A kind of method and apparatus of definite test coverage | |
| CN115859195A (en) | Riverway water quality index soft measurement method based on random forest algorithm model | |
| CN105160446A (en) | Method and device of obtaining loan limit | |
| CN111340349B (en) | Product reliability evaluation method, device, computer equipment and storage medium | |
| CN105912681A (en) | Aging testing method and system for electricity marketing database | |
| CN107491576B (en) | Missile component reliability analysis method based on performance degradation data | |
| CN106201455B (en) | A kind of system cohesion degree calculation method | |
| CN110569155A (en) | data processing method and system, electronic device and medium | |
| CN113569413B (en) | Refrigerant leakage diagnosis method and device and refrigeration system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20201002 |