CN112269723B - Performance analysis method and device of storage equipment and readable storage medium - Google Patents
Performance analysis method and device of storage equipment and readable storage medium Download PDFInfo
- Publication number
- CN112269723B CN112269723B CN202011109509.1A CN202011109509A CN112269723B CN 112269723 B CN112269723 B CN 112269723B CN 202011109509 A CN202011109509 A CN 202011109509A CN 112269723 B CN112269723 B CN 112269723B
- Authority
- CN
- China
- Prior art keywords
- historical
- data
- time period
- delay
- preset
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000004458 analytical method Methods 0.000 title claims abstract description 45
- 238000012545 processing Methods 0.000 claims abstract description 57
- 238000000034 method Methods 0.000 claims abstract description 34
- 238000004364 calculation method Methods 0.000 claims description 31
- 238000009825 accumulation Methods 0.000 claims description 26
- 230000003993 interaction Effects 0.000 claims description 12
- 238000004590 computer program Methods 0.000 claims description 6
- 230000001934 delay Effects 0.000 claims description 5
- 150000001875 compounds Chemical class 0.000 claims 2
- 238000007405 data analysis Methods 0.000 abstract description 8
- 230000002349 favourable effect Effects 0.000 abstract 1
- 230000001186 cumulative effect Effects 0.000 description 17
- 230000008569 process Effects 0.000 description 7
- 230000009286 beneficial effect Effects 0.000 description 4
- 238000010586 diagram Methods 0.000 description 4
- 230000006870 function Effects 0.000 description 3
- 238000013473 artificial intelligence Methods 0.000 description 2
- 238000004422 calculation algorithm Methods 0.000 description 2
- 238000004891 communication Methods 0.000 description 2
- 238000011161 development Methods 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 230000001360 synchronised effect Effects 0.000 description 2
- 238000013500 data storage Methods 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 239000003999 initiator Substances 0.000 description 1
- 238000010801 machine learning Methods 0.000 description 1
- 230000005055 memory storage Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000000750 progressive effect Effects 0.000 description 1
- 238000009877 rendering Methods 0.000 description 1
- 238000012360 testing method Methods 0.000 description 1
- 230000001052 transient effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/30—Monitoring
- G06F11/34—Recording or statistical evaluation of computer activity, e.g. of down time, of input/output operation ; Recording or statistical evaluation of user activity, e.g. usability assessment
- G06F11/3466—Performance evaluation by tracing or monitoring
- G06F11/3476—Data logging
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/30—Monitoring
- G06F11/3003—Monitoring arrangements specially adapted to the computing system or computing system component being monitored
- G06F11/3037—Monitoring arrangements specially adapted to the computing system or computing system component being monitored where the computing system component is a memory, e.g. virtual memory, cache
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Quality & Reliability (AREA)
- General Physics & Mathematics (AREA)
- Computing Systems (AREA)
- Computer Hardware Design (AREA)
- Mathematical Physics (AREA)
- Debugging And Monitoring (AREA)
Abstract
The application discloses a performance analysis method and device of storage equipment and a computer readable storage medium. The method comprises the steps of obtaining current performance data of the storage device in a preset working stage, obtaining performance data of the storage device in the same preset working stage and in a preset historical time period at the same position, and conducting statistical processing on the data to obtain real-time performance data and historical performance data. And performing performance analysis on the storage device according to the real-time performance data and the historical performance data. The method and the device can ensure that unified, effective and correct historical performance data and real-time performance data are obtained, are favorable for improving the data analysis accuracy, and increase the accuracy of the performance data and the reliability of the equipment.
Description
Technical Field
The present application relates to the field of storage technologies, and in particular, to a method and an apparatus for analyzing performance of a storage device, and a computer-readable storage medium.
Background
With the rapid development of scientific computing, cloud computing, internet of things and various Network applications, the amount of electronic information has been increased explosively, and accordingly, the Storage of electronic data has also been developed, which makes the Storage component more and more important in the whole Computer System, and the Storage has been shifted from a single disk and a tape to a disk array, and further developed into currently popular Storage networks, such as NAS (Network Storage Technologies), SAN (Storage Area Network ), iscsi (Internet Computer System Interface, internet Small Computer System Interface), and the like. The large-scale data application demand is continuously emerging, mass data and application thereof become a new development direction, data storage has great influence on daily work and life, the performance demand of storage equipment is higher and higher, and the analysis of various performance data of the storage equipment is naturally more and more important.
It is understood that various items of performance data of a storage device generally refer to some data generated during an initialization phase of the storage device and during interaction between the storage device and a host device through, for example, a computer system interface. In the process of analyzing various performance data, the real-time data and the historical data are generally required to be compared, in the related art, the real-time data and the historical data are directly compared to analyze the data, and the historical data and the current real-time data are not unified inevitably due to network reasons, system faults or other reasons, so that the result obtained by directly analyzing the data is inevitably inaccurate.
In view of this, how to ensure the unification, correctness and effectiveness of the historical performance data and the real-time performance data and improve the accuracy of data analysis is a technical problem to be solved by those skilled in the art.
Disclosure of Invention
The application provides a performance analysis method and device for storage equipment and a computer readable storage medium, which can ensure that unified, effective and correct historical performance data and real-time performance data are obtained, and are beneficial to improving the data analysis accuracy.
In order to solve the above technical problems, embodiments of the present invention provide the following technical solutions:
an embodiment of the present invention provides a performance analysis method for a storage device, including:
performing statistical processing on the acquired current performance data of the storage device in a preset working stage to obtain real-time performance data;
meanwhile, performing accumulation processing on the performance data in the same preset working stage and in a preset historical time period at the same position as the position where the real-time performance data is obtained to obtain historical performance data;
and performing performance analysis on the storage equipment according to the real-time performance data and the historical performance data.
Optionally, the performing statistical processing on the obtained current performance data of the storage device in the preset working stage to obtain the real-time performance data includes:
counting IO (input/output) number, byte number and delay number of a target port in the current time period respectively at an initialization stage of the storage device and a task stage of interaction between the storage device and a host, and performing accumulation processing on delay when the IO number is counted; and/or
Counting IO (input/output) number, byte number and delay number of a target node in the current time period in the initialization stage and the task stage respectively, and performing accumulation processing on the delay when the IO number is counted; and/or
Counting the IO number, the byte number and the time delay number of the target volume in the current time period in the initialization stage and the task stage respectively, and performing accumulation processing on the time delay when counting the IO number; and/or
And counting the IO number, the byte number and the time delay number of the target disk in the current time period in the initialization stage and the task stage respectively, and performing accumulation processing on the time delay when counting the IO number.
Optionally, the performing the accumulated processing on the performance data in the same preset working phase and in the preset historical time period to obtain the historical performance data includes:
respectively acquiring IO (input/output) number, byte number and delay number of the storage equipment in an initialization stage and a task stage of interaction with a host within the preset historical time period;
obtaining IO historical data according to the total IO number accumulated in the preset historical time period and the duration value of the preset historical time period;
obtaining byte number historical data according to the total number of bytes accumulated in the preset historical time period and the time length value of the preset historical time period;
obtaining time delay historical data according to the total time delay accumulated in the preset historical time period and the total IO count;
and taking the IO historical data, the byte number historical data and the time delay historical data as the historical performance data.
Optionally, the obtaining of the delay history data according to the total delay accumulated in the preset history time period and the total IO number includes:
calling a time delay calculation relational expression to calculate to obtain time delay historical data based on the total time delay accumulated in the preset historical time period and the total IO count; the time delay calculation relation is as follows:
reading delay = reading delay number accumulated value/reading IO number accumulated value;
write latency = write latency number cumulative value/write IO number cumulative value;
total delay = (number of read delays cumulative value + number of write delays cumulative value)/(number of read IO cumulative value + number of write IO cumulative value).
Optionally, the obtaining of the IO history data according to the total number of the IO accumulated in the preset history time period and the duration value of the preset history time period is as follows:
calling an IO calculation relational expression to calculate to obtain IO historical data based on the total IO amount accumulated in the preset historical time period and the duration value of the preset historical time period; the IO calculation relational expression is as follows:
IO e ＝IO s /T；
in the formula, IO e For the IO history data, IO s And T is the duration value of the preset historical time period for the total IO.
Optionally, the obtaining of the byte number history data according to the total number of bytes accumulated in the preset history time period and the duration value of the preset history time period is as follows:
calling a byte number calculation relational expression to calculate to obtain byte number historical data based on the total number of bytes accumulated in the preset historical time period and the time length value of the preset historical time period; the byte number calculation relation is as follows:
Bytes e ＝Bytes s /T；
in the formula, bytes e For the byte number history data, bytes s And T is the time length value of the preset historical time period.
Another aspect of an embodiment of the present invention provides a performance analysis apparatus for a storage device, including:
the real-time performance data acquisition module is used for carrying out statistical processing on the acquired current performance data of the storage device in a preset working stage to obtain real-time performance data;
the historical performance acquisition module is used for performing accumulation processing on the performance data in the same preset working stage and in a preset historical time period at the same position as the position of the real-time performance data to obtain historical performance data;
and the data processing module is used for carrying out performance analysis on the storage equipment according to the real-time performance data and the historical performance data.
Optionally, the real-time performance data acquiring module is specifically configured to:
counting IO (input/output) number, byte number and delay number of a target port in the current time period respectively at an initialization stage of the storage device and a task stage of interaction between the storage device and a host, and performing accumulation processing on delay when the IO number is counted; and/or
Counting IO (input/output) number, byte number and delay number of a target node in the current time period in the initialization stage and the task stage respectively, and performing accumulation processing on the delay when the IO number is counted; and/or
Counting the IO number, the byte number and the time delay number of the target volume in the current time period respectively in the initialization stage and the task stage, and performing accumulation processing on the time delay when the IO number is counted; and/or
And counting the IO number, the byte number and the time delay number of the target disk in the current time period respectively in the initialization stage and the task stage, and performing accumulation processing on the time delay when the IO number is counted.
The embodiment of the present invention further provides a performance analysis apparatus for a storage device, which includes a processor, where the processor is configured to implement the steps of the performance analysis method for the storage device according to any one of the foregoing embodiments when executing a computer program stored in a memory.
Finally, an embodiment of the present invention provides a computer-readable storage medium, where a performance analysis program of a storage device is stored on the computer-readable storage medium, and when executed by a processor, the performance analysis program of the storage device implements the steps of the performance analysis method of the storage device according to any previous item.
The technical scheme provided by the application has the advantages that the real-time performance data and the historical performance data are counted and processed at the same time, the same position and the same working stage in different working stages of the storage system, synchronous accumulated statistics of the historical performance data and the real-time performance data is ensured by adopting a unified collection mode of the historical performance data and the real-time performance data, the condition that the real-time performance data is inconsistent with the historical performance data is effectively avoided, the unified, effective and correct historical performance data and real-time performance data can be ensured to be obtained, the data analysis accuracy is favorably improved, and the accuracy of the performance data and the reliability of equipment are improved.
In addition, the embodiment of the invention also provides a corresponding implementation device and a computer readable storage medium for the performance analysis method of the storage equipment, so that the method has higher practicability, and the device and the computer readable storage medium have corresponding advantages.
It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the disclosure.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions of the related arts, the drawings used in the description of the embodiments or the related arts will be briefly described below, it is obvious that the drawings in the description below are only some embodiments of the present invention, and it is obvious for those skilled in the art that other drawings can be obtained according to the drawings without creative efforts.
Fig. 1 is a schematic flowchart of a method for analyzing performance of a storage device according to an embodiment of the present invention;
FIG. 2 is a flow chart illustrating another method for analyzing performance of a storage device according to an embodiment of the present invention;
fig. 3 is a structural diagram of a specific embodiment of a performance analysis apparatus of a storage device according to an embodiment of the present invention;
fig. 4 is a structural diagram of another specific embodiment of a performance analysis apparatus of a storage device according to an embodiment of the present invention.
Detailed Description
In order that those skilled in the art will better understand the disclosure, reference will now be made in detail to the embodiments of the disclosure as illustrated in the accompanying drawings. It is to be understood that the described embodiments are merely exemplary of the invention, and not restrictive of the full scope of the invention. All other embodiments, which can be obtained by a person skilled in the art without making any creative effort based on the embodiments in the present invention, belong to the protection scope of the present invention.
The terms "first," "second," "third," "fourth," and the like in the description and claims of this application and in the foregoing drawings are used for distinguishing between different objects and not necessarily for describing a particular sequential order. Furthermore, the terms "comprising" and "having," as well as any variations thereof, are intended to cover non-exclusive inclusions. For example, a process, method, system, article, or apparatus that comprises a list of steps or elements is not limited to only those steps or elements but may include other steps or elements not expressly listed.
Having described the technical solutions of the embodiments of the present invention, various non-limiting embodiments of the present application are described in detail below.
Referring to fig. 1, fig. 1 is a schematic flow chart of a method for analyzing performance of a storage device according to an embodiment of the present invention, where the embodiment of the present invention includes the following:
s101: and carrying out statistical processing on the acquired current performance data of the storage device in a preset working stage to obtain real-time performance data.
It is to be understood that, in general, one storage device has two controllers, namely a master controller and a slave controller, if the storage device is a single storage device, the execution subject of the present application may be the master controller, if the storage device is a storage array formed by a plurality of storage devices, the master controller of any other storage device may be used, or after the storage array is designated as a master node, the controller of the master node executes the present application. Of course, the slave controller may be migrated to execute after the master controller fails.
The preset working phase in this step may be, for example, an initialization phase, a task phase in an interaction process between the storage device and the host, and the like, the working phase is a working state of the storage device, and a user may select a corresponding working phase according to data required by performance analysis, which is not limited in this application. The real-time performance data is the performance data of the storage system in the current short time such as 5s, and after the performance data of each moment in the current time period is obtained, the obtained performance data is subjected to accumulation processing to obtain the real-time performance data.
S102: and meanwhile, performing accumulative processing on the performance data in the same preset working stage and in a preset historical time period at the same position as the position where the real-time performance data is obtained to obtain historical performance data.
The historical performance data of the storage equipment is a historical record stored by various performance data of the storage equipment, the operation condition of the storage equipment can be effectively monitored, the quality of the storage equipment is analyzed, and the future operation condition of the storage equipment is predicted by analyzing the historical performance data, the statistical historical performance data is often compared with the real-time performance data to ensure the accuracy and the effectiveness of the data, and thus the requirements of the historical performance data and the real-time performance data must be unified, correct and effective. In addition, since real-time or historical performance data can be counted in a target task stage, an initiator initialization stage and other stages, received data between controllers and other performance data except the received data, such as interaction data between one storage controller and another storage controller, or interaction data between different controllers of the same storage device, can also be counted respectively for real-time or historical performance data, it is particularly important to reasonably count historical performance data of the storage device, process historical performance data and unify the real-time performance data. In order to achieve the purpose, the historical performance data in the step and the real-time performance data in the previous step are data obtained by performing accumulation processing on the same position, namely the same logical position and the same physical position, in the same working stage and at the same time, and the only difference is that the time periods of the collected performance data are different.
S103: and performing performance analysis on the storage device according to the real-time performance data and the historical performance data.
After uniform, effective and accurate historical performance data and real-time performance data are obtained, the data can be analyzed by adopting a proper performance analysis algorithm according to the type of performance analysis required to be carried out to obtain a corresponding performance analysis result, and the performance analysis result is accurate because the data used for analysis is accurate.
In the technical scheme provided by the embodiment of the invention, the real-time performance data and the historical performance data are counted and processed at the same time, the same position and the same working stage in different working stages of the storage system, and the historical performance data and the real-time performance data are synchronously accumulated and counted by adopting a unified collection mode of the historical performance data and the real-time performance data, so that the condition that the real-time performance data is inconsistent with the historical performance data is effectively avoided, the unified, effective and correct historical performance data and real-time performance data can be ensured to be obtained, the data analysis accuracy is favorably improved, and the accuracy of the performance data and the reliability of equipment are increased.
In the foregoing embodiment, how to perform step S101 is not limited, and this embodiment provides an implementation manner, which may include the following steps:
respectively counting Input Output (IO) number, byte number and time delay number of a target port in the current time period at an initialization stage of the storage device and a task stage of interaction between the storage device and the host, and performing accumulated processing on time delay when the IO number is counted; and/or
Counting the IO number, the byte number and the time delay number of the target node in the current time period respectively in an initialization stage and a task stage, and performing accumulated processing on the time delay when the IO number is counted; and/or
Counting IO (input/output) number, byte number and delay number of a target volume in the current time period respectively at an initialization stage and a task stage, and performing accumulation processing on the delay when the IO number is counted; and/or
And counting the IO number, the byte number and the time delay number of the target disk in the current time period respectively in an initialization stage and a task stage, and performing accumulation processing on the time delay when the IO number is counted.
The steps can be executed simultaneously or randomly, for example, cumulative processing of historical performance data and real-time performance data at the port can be performed first, and so on, and the same statistical processing is performed on the nodes, the volumes, the disks and the like until all statistics are completed. The performance data includes, but is not limited to, IO number, byte number, and delay number, and can be selected by one skilled in the art according to actual situations.
Based on the foregoing embodiment, referring to fig. 2, in order to ensure synchronous cumulative statistics of historical performance data and real-time performance data, performing cumulative processing on performance data in the same preset working phase and in a preset historical time period, and obtaining the historical performance data may include:
s201: respectively obtaining IO (input/output) number, byte number and delay number of the storage device in an initialization stage and a task stage interacting with a host within a preset historical time period.
S202: and obtaining IO historical data according to the total IO number accumulated in the preset historical time period and the duration value of the preset historical time period.
The IO historical data can be obtained by calling an IO calculation relational expression to calculate based on the total IO amount accumulated in the preset historical time period and the duration value of the preset historical time period. The IO calculation relationship may be expressed as:
IO e ＝IO s /T；
in the formula, IO e For IO historical data, IO s T is the total IO number and is the duration value of the preset historical time period.
S203: and obtaining byte number historical data according to the total number of the accumulated bytes in the preset historical time period and the duration value of the preset historical time period.
Calling a byte number calculation relational expression to calculate to obtain byte number historical data based on the total number of bytes accumulated in a preset historical time period and the duration value of the preset historical time period; the byte count calculation relation can be expressed as:
Bytes e ＝Bytes s /T；
in the formula, bytes e As byte count historical data, bytes s T is the time length value of the preset historical time period.
S204: and obtaining time delay historical data according to the accumulated time delay sum and IO sum in the preset historical time period.
As an implementation manner of this embodiment, based on the total delay and the total IO count accumulated in the preset historical time period, a delay calculation relational expression may be invoked to calculate the delay historical data, instead of dividing the time interval by the accumulated delay value, where the delay calculation relational expression may be represented as:
reading delay = reading delay number accumulated value/reading IO number accumulated value;
write latency = write latency number cumulative value/write IO number cumulative value;
total delay = (read delay number accumulated value + write delay number accumulated value)/(read IO number accumulated value + write IO number accumulated value).
After each delay value is calculated by using the delay calculation relational expression, rounding processing can be further performed.
S205: and taking IO historical data, byte number historical data and delay historical data as historical performance data.
After the IO history data, the byte number history data, and the delay history data are obtained through calculation in the above steps, an aggregate or a sum of these data may be used as the history performance data.
It should be noted that, in the present application, there is no strict sequential execution order among the steps, and as long as a logical order is met, the steps may be executed simultaneously or according to a certain preset order, and fig. 1 to fig. 2 are only schematic manners, and do not represent only such an execution order.
The embodiment of the invention also provides a corresponding device for the performance analysis method of the storage equipment, so that the method has higher practicability. Wherein the means can be described separately from the functional module point of view and the hardware point of view. The following describes a performance analysis apparatus for a storage device according to an embodiment of the present invention, and the performance analysis apparatus for the storage device described below and the performance analysis method for the storage device described above may be referred to correspondingly.
Based on the angle of the functional module, referring to fig. 3, fig. 3 is a structural diagram of an apparatus for analyzing performance of a storage device according to an embodiment of the present invention, in a specific implementation, the apparatus may include:
the real-time performance data acquiring module 301 is configured to perform statistical processing on the acquired current performance data of the storage device in the preset working stage to obtain real-time performance data.
The historical performance obtaining module 302 is configured to perform, at the same time and at the same position as the position where the real-time performance data is obtained, accumulation processing on the performance data in the same preset working stage and in a preset historical time period to obtain historical performance data.
And the data processing module 303 is configured to perform performance analysis on the storage device according to the real-time performance data and the historical performance data.
Optionally, in some embodiments of this embodiment, the real-time performance data acquiring module 301 may be specifically configured to:
respectively counting the IO number, the byte number and the time delay number of a target port in the current time period at the initialization stage of the storage device and the task stage of interaction between the storage device and the host, and performing accumulation processing on the time delay when counting the IO number; and/or
Counting the IO number, the byte number and the time delay number of the target node in the current time period respectively in an initialization stage and a task stage, and performing accumulated processing on the time delay when the IO number is counted; and/or
Counting the IO number, the byte number and the time delay number of the target volume in the current time period respectively in an initialization stage and a task stage, and performing accumulation processing on the time delay when the IO number is counted; and/or
And counting the IO number, the byte number and the time delay number of the target disk in the current time period in an initialization stage and a task stage respectively, and performing accumulation processing on the time delay when the IO number is counted.
In some implementations of this embodiment, the historical performance obtaining module 302 may include, for example:
the data acquisition submodule is used for respectively acquiring IO (input/output) number, byte number and delay number of the storage equipment in an initialization stage and a task stage interacting with the host within a preset historical time period;
the IO historical data calculation submodule is used for obtaining IO historical data according to the total IO amount accumulated in the preset historical time period and the duration value of the preset historical time period;
the byte number historical data calculation submodule is used for obtaining byte number historical data according to the total number of bytes accumulated in a preset historical time period and the time length value of the preset historical time period;
the delay history data calculation submodule is used for obtaining delay history data according to the total delay and the total IO count accumulated in the preset history time period;
and the historical performance data obtaining submodule is used for taking the IO historical data, the byte number historical data and the time delay historical data as historical performance data.
As an optional implementation manner of this embodiment, the delay history data calculation submodule may be a module that calls a delay calculation relational expression to calculate to obtain delay history data based on the total delay count and the total IO count accumulated in the preset history time period; the delay calculation relationship can be expressed as:
reading delay = reading delay number accumulated value/reading IO number accumulated value;
write latency = write latency number cumulative value/write IO number cumulative value;
total delay = (number of read delays cumulative value + number of write delays cumulative value)/(number of read IO cumulative value + number of write IO cumulative value).
As another optional implementation manner of this embodiment, the IO history data calculation sub-module may be, for example, a module that calls an IO calculation relational expression to calculate IO history data based on the total number of IOs accumulated in the preset history time period and the duration value of the preset history time period; the IO computation relationship may be expressed as:
IO e ＝IO s /T；
in the formula, IO e For IO historical data, IO s And T is the total number of IO and is the time length value of the preset historical time period.
As another optional implementation manner of this embodiment, the byte count historical data calculation sub-module may be, for example, a module that calls a byte count calculation relational expression to calculate to obtain byte count historical data based on the total number of bytes accumulated in a preset historical time period and a duration value of the preset historical time period; the byte count calculation relation can be expressed as:
Bytes e ＝Bytes s /T；
in the formula, bytes e Being historical data of number of Bytes, bytes s T is the time length value of the preset historical time period.
The functions of each functional module of the performance analysis apparatus of the storage device in the embodiment of the present invention may be specifically implemented according to the method in the foregoing method embodiment, and the specific implementation process may refer to the related description of the foregoing method embodiment, which is not described herein again.
Therefore, the embodiment of the invention can ensure that uniform, effective and correct historical performance data and real-time performance data are obtained, is beneficial to improving the data analysis accuracy, and increases the accuracy of the performance data and the reliability of equipment.
The performance analysis apparatus of the storage device mentioned above is described from the perspective of the functional module, and further, the present application also provides a performance analysis apparatus of a storage device, which is described from the perspective of hardware. Fig. 4 is a structural diagram of another performance analysis apparatus for a storage device according to an embodiment of the present application. As shown in fig. 4, the apparatus comprises a memory 40 for storing a computer program;
a processor 41, configured to implement the steps of the method for analyzing performance of a storage device as mentioned in any of the above embodiments when executing the computer program.
Processor 41 may include one or more processing cores, such as a 4-core processor, an 8-core processor, and so forth. The processor 41 may be implemented in at least one hardware form of a DSP (Digital Signal Processing), an FPGA (Field-Programmable Gate Array), and a PLA (Programmable Logic Array). The processor 41 may also include a main processor and a coprocessor, where the main processor is a processor for Processing data in a wake state, and is also called a Central Processing Unit (CPU); a coprocessor is a low power processor for processing data in a standby state. In some embodiments, the processor 41 may be integrated with a GPU (Graphics Processing Unit), which is responsible for rendering and drawing the content required to be displayed on the display screen. In some embodiments, processor 41 may further include an AI (Artificial Intelligence) processor for processing computing operations related to machine learning.
Memory 40 may include one or more computer-readable storage media, which may be non-transitory. Memory 40 may also include high speed random access memory, as well as non-volatile memory, such as one or more magnetic disk storage devices, flash memory storage devices. In this embodiment, the memory 40 is at least used for storing the following computer program 401, wherein after being loaded and executed by the processor 41, the computer program can implement the relevant steps of the performance analysis method of the storage device disclosed in any of the foregoing embodiments. In addition, the resources stored in the memory 40 may also include an operating system 402, data 403, and the like, and the storage manner may be a transient storage or a permanent storage. Operating system 402 may include, among other things, windows, unix, linux, and the like. Data 403 may include, but is not limited to, data corresponding to test results, and the like.
In some embodiments, the performance analysis apparatus of the storage device may further include a display 42, an input/output interface 43, a communication interface 44, a power supply 45, and a communication bus 46.
It will be appreciated by those skilled in the art that the configuration shown in FIG. 4 does not constitute a limitation of the performance analysis means of the storage device, and may include more or fewer components than those shown, such as sensor 47.
The functions of the functional modules of the performance analysis apparatus of the storage device according to the embodiment of the present invention may be specifically implemented according to the method in the foregoing method embodiment, and the specific implementation process may refer to the related description of the foregoing method embodiment, which is not described herein again.
Therefore, the embodiment of the invention can ensure that uniform, effective and correct historical performance data and real-time performance data are obtained, is beneficial to improving the data analysis accuracy, and increases the accuracy of the performance data and the reliability of equipment.
It is to be understood that, if the performance analysis method of the storage device in the above embodiment is implemented in the form of a software functional unit and sold or used as a stand-alone product, it may be stored in a computer readable storage medium. Based on such understanding, the technical solutions of the present application, which are essential or part of the prior art, or all or part of the technical solutions may be embodied in the form of a software product, which is stored in a storage medium and executes all or part of the steps of the methods of the embodiments of the present application. And the aforementioned storage medium includes: a U disk, a removable hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), an electrically erasable programmable ROM, a register, a hard disk, a removable magnetic disk, a CD-ROM, a magnetic disk, or an optical disk.
Based on this, an embodiment of the present invention further provides a computer-readable storage medium, in which a performance analysis program of a storage device is stored, where the performance analysis program of the storage device is executed by a processor, and the steps of the performance analysis method of the storage device according to any one of the above embodiments are provided.
The functions of the functional modules of the computer-readable storage medium according to the embodiment of the present invention may be specifically implemented according to the method in the foregoing method embodiment, and the specific implementation process may refer to the related description of the foregoing method embodiment, which is not described herein again.
Therefore, the embodiment of the invention can ensure that uniform, effective and correct historical performance data and real-time performance data are obtained, is beneficial to improving the data analysis accuracy, and increases the accuracy of the performance data and the reliability of equipment.
In the present specification, the embodiments are described in a progressive manner, and each embodiment focuses on differences from other embodiments, and the same or similar parts between the embodiments are referred to each other. The device disclosed in the embodiment corresponds to the method disclosed in the embodiment, so that the description is simple, and the relevant points can be referred to the description of the method part.
Those of skill would further appreciate that the various illustrative components and algorithm steps described in connection with the embodiments disclosed herein may be implemented as electronic hardware, computer software, or combinations of both, and that the components and steps of the various examples have been described above generally in terms of their functionality in order to clearly illustrate this interchangeability of hardware and software. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the implementation. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present invention.
The method, the apparatus, and the computer-readable storage medium for analyzing performance of a storage device provided in the present application are described in detail above. The principles and embodiments of the present invention have been described herein using specific examples, which are presented only to assist in understanding the method and its core concepts of the present invention. It should be noted that, for those skilled in the art, without departing from the principle of the present invention, it can make several improvements and modifications to the present application, and those improvements and modifications also fall into the protection scope of the claims of the present application.
Claims (7)
1. A method for analyzing performance of a storage device, comprising:
performing statistical processing on the acquired current performance data of the storage device in a preset working stage to obtain real-time performance data;
meanwhile, performing accumulation processing on the performance data in the same preset working stage and in a preset historical time period at the same position as the position of obtaining the real-time performance data to obtain historical performance data;
performing performance analysis on the storage device according to the real-time performance data and the historical performance data;
wherein, the statistical processing is performed on the acquired current performance data of the storage device in a preset working stage, and the acquiring of the real-time performance data comprises:
counting IO (input/output) number, byte number and delay number of a target port in the current time period respectively at an initialization stage of the storage device and a task stage of interaction between the storage device and a host, and performing accumulation processing on delay when the IO number is counted; and/or
Counting the IO number, the byte number and the time delay number of the target node in the current time period in the initialization stage and the task stage respectively, and performing accumulated processing on the time delay when counting the IO number; and/or
Counting the IO number, the byte number and the time delay number of the target volume in the current time period respectively in the initialization stage and the task stage, and performing accumulation processing on the time delay when the IO number is counted; and/or
Counting the IO number, the byte number and the time delay number of the target disk in the current time period in the initialization stage and the task stage respectively, and performing accumulation processing on the time delay when counting the IO number;
the method for performing accumulative processing on the performance data in the same preset working stage and in a preset historical time period to obtain historical performance data comprises the following steps:
respectively acquiring IO (input/output) number, byte number and delay number of the storage equipment in an initialization stage and a task stage of interaction with a host within the preset historical time period;
obtaining IO historical data according to the total IO number accumulated in the preset historical time period and the duration value of the preset historical time period;
obtaining byte number historical data according to the total number of bytes accumulated in the preset historical time period and the duration value of the preset historical time period;
obtaining time delay historical data according to the total time delay accumulated in the preset historical time period and the IO total;
and taking the IO historical data, the byte number historical data and the time delay historical data as the historical performance data.
2. The method for analyzing performance of a storage device according to claim 1, wherein the obtaining of the history data of the delay according to the total number of delays accumulated in the preset history time period and the total number of IO comprises:
calling a time delay calculation relational expression to calculate to obtain time delay historical data based on the total time delay accumulated in the preset historical time period and the total IO count; the time delay calculation relation is as follows:
reading delay = reading delay number accumulated value/reading IO number accumulated value;
writing delay = writing delay number integrated value/writing IO number integrated value;
total delay = (read delay number accumulated value + write delay number accumulated value)/(read IO number accumulated value + write IO number accumulated value).
3. The performance analysis method of the storage device according to claim 1, wherein the obtaining of IO history data according to the total number of IO accumulated in the preset history period and the duration value of the preset history period is:
based on the total IO number accumulated in the preset historical time period and the duration value of the preset historical time period, calling an IO calculation relational expression to calculate to obtain IO historical data; the IO calculation relational expression is as follows:
IO e =IO s /T；
in the formula (I), the compound is shown in the specification,IO e in order to obtain the IO history data,IO s the sum of the number of the IOs is,Tand the time length value of the preset historical time period is used.
4. The performance analysis method of the storage device according to claim 1, wherein the obtaining of the byte count history data according to the total number of bytes accumulated in the preset history time period and the duration value of the preset history time period is:
calling a byte number calculation relational expression to calculate to obtain byte number historical data based on the total number of bytes accumulated in the preset historical time period and the time length value of the preset historical time period; the byte number calculation relation is as follows:
Bytes e =Bytes s /T；
in the formula (I), the compound is shown in the specification,Bytes e the data is the historical data of the number of bytes,Bytes s for the total number of said bytes,Tand the time length value of the preset historical time period is used.
5. An apparatus for analyzing performance of a storage device, comprising:
the real-time performance data acquisition module is used for carrying out statistical processing on the acquired current performance data of the storage device in a preset working stage to obtain real-time performance data;
the historical performance acquisition module is used for performing accumulation processing on the performance data in the same preset working stage and in a preset historical time period at the same position as the position of the real-time performance data to obtain historical performance data;
the data processing module is used for carrying out performance analysis on the storage equipment according to the real-time performance data and the historical performance data;
the real-time performance data acquisition module is specifically configured to:
counting IO (input/output) number, byte number and delay number of a target port in the current time period respectively at an initialization stage of the storage device and a task stage of interaction between the storage device and a host, and performing accumulation processing on delay when the IO number is counted; and/or
Counting the IO number, the byte number and the time delay number of the target node in the current time period in the initialization stage and the task stage respectively, and performing accumulated processing on the time delay when counting the IO number; and/or
Counting the IO number, the byte number and the time delay number of the target volume in the current time period respectively in the initialization stage and the task stage, and performing accumulation processing on the time delay when the IO number is counted; and/or
Counting the IO number, the byte number and the time delay number of the target disk in the current time period in the initialization stage and the task stage respectively, and performing accumulation processing on the time delay when counting the IO number;
the historical performance acquisition module is specifically configured to:
respectively acquiring IO (input/output) number, byte number and delay number of the storage equipment in an initialization stage and a task stage interacting with a host within the preset historical time period;
obtaining IO historical data according to the total IO number accumulated in the preset historical time period and the duration value of the preset historical time period;
obtaining byte number historical data according to the total number of bytes accumulated in the preset historical time period and the duration value of the preset historical time period;
obtaining time delay historical data according to the total time delay accumulated in the preset historical time period and the total IO count;
and taking the IO historical data, the byte number historical data and the time delay historical data as the historical performance data.
6. A performance analysis apparatus for a storage device, comprising a processor configured to implement the steps of the performance analysis method for the storage device according to any one of claims 1 to 4 when executing a computer program stored in a memory.
7. A computer-readable storage medium, on which a performance analysis program of a storage device is stored, the performance analysis program of the storage device, when executed by a processor, implementing the steps of the performance analysis method of the storage device according to any one of claims 1 to 4.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011109509.1A CN112269723B (en) | 2020-10-16 | 2020-10-16 | Performance analysis method and device of storage equipment and readable storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011109509.1A CN112269723B (en) | 2020-10-16 | 2020-10-16 | Performance analysis method and device of storage equipment and readable storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN112269723A CN112269723A (en) | 2021-01-26 |
| CN112269723B true CN112269723B (en) | 2023-01-10 |
Family
ID=74337253
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011109509.1A Active CN112269723B (en) | 2020-10-16 | 2020-10-16 | Performance analysis method and device of storage equipment and readable storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112269723B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114492737B (en) | 2021-12-31 | 2022-12-09 | 北京百度网讯科技有限公司 | Data processing method, data processing device, electronic equipment, storage medium and program product |
Family Cites Families (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101951027B (en) * | 2010-09-01 | 2014-01-15 | 中国电力科学研究院 | Uniform data acquisition and monitoring system of low-medium voltage power distribution network |
| US8850161B2 (en) * | 2010-10-13 | 2014-09-30 | Riverbed Technology, Inc. | Method of improving performance of a data storage device |
| CN107908533B (en) * | 2017-06-15 | 2019-11-12 | 平安科技（深圳）有限公司 | A kind of monitoring method, device, computer readable storage medium and the equipment of database performance index |
| US10732873B1 (en) * | 2019-04-18 | 2020-08-04 | Microsoft Technology Licensing, Llc | Timeout mode for storage devices |
-
2020
- 2020-10-16 CN CN202011109509.1A patent/CN112269723B/en active Active
Also Published As
| Publication number | Publication date |
|---|---|
| CN112269723A (en) | 2021-01-26 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US20180157438A1 (en) | Slow-disk detection method and apparatus | |
| US9442817B2 (en) | Diagnosis of application server performance problems via thread level pattern analysis | |
| CN112269723B (en) | Performance analysis method and device of storage equipment and readable storage medium | |
| CN116362168B (en) | Modeling method and device for GPGPU offline clock and storage medium | |
| CN114186519A (en) | Time sequence bottleneck probing method and device, terminal equipment and storage medium | |
| US20130013283A1 (en) | Distributed multi-pass microarchitecture simulation | |
| CN105700998A (en) | Method and device for monitoring and analyzing performance of parallel programs | |
| CN113127314A (en) | Method and device for detecting program performance bottleneck and computer equipment | |
| CN109389215B (en) | Network structure determination method and device of deep learning network | |
| US10311184B2 (en) | Circuit verification on a distributed database processing system | |
| CN107451038B (en) | Hardware event acquisition method, processor and computing system | |
| US9684550B2 (en) | Robust and adaptable management of event counters | |
| US20090216515A1 (en) | Using a serial profiler to estimate the performance of a parallel circuit simulation | |
| CN110287158B (en) | Method, device and storage medium for monitoring IO time delay of distributed file system | |
| CN115686789A (en) | Discrete event parallel processing method, terminal equipment and storage medium | |
| JP2012128771A (en) | Information processing apparatus and program | |
| CN111679924B (en) | Reliability simulation method and device for componentized software system and electronic equipment | |
| CN109885442B (en) | Performance analysis method, device, equipment and storage medium | |
| CN109800191B (en) | Method and apparatus for calculating covariance of sequence data | |
| AU2018309575B2 (en) | Focused execution of traced code in a debugger | |
| CN111090554A (en) | Method, device, equipment and storage medium for predicting server performance test time | |
| CN110231969A (en) | User interface management method, apparatus, computer installation and readable storage medium storing program for executing | |
| US20070010982A1 (en) | Automatic time warp for electronic system simulation | |
| CN109614148B (en) | Data logic operation method, monitoring method and device | |
| CN111221713A (en) | FC parameter-based storage performance tuning method, system, terminal and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |