CN112882916A - IO performance data acquisition method and related device - Google Patents
IO performance data acquisition method and related device Download PDFInfo
- Publication number
- CN112882916A CN112882916A CN202110285352.6A CN202110285352A CN112882916A CN 112882916 A CN112882916 A CN 112882916A CN 202110285352 A CN202110285352 A CN 202110285352A CN 112882916 A CN112882916 A CN 112882916A
- Authority
- CN
- China
- Prior art keywords
- data
- performance data
- read
- test
- write
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Withdrawn
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/30—Monitoring
- G06F11/34—Recording or statistical evaluation of computer activity, e.g. of down time, of input/output operation ; Recording or statistical evaluation of user activity, e.g. usability assessment
- G06F11/3409—Recording or statistical evaluation of computer activity, e.g. of down time, of input/output operation ; Recording or statistical evaluation of user activity, e.g. usability assessment for performance assessment
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/30—Monitoring
- G06F11/34—Recording or statistical evaluation of computer activity, e.g. of down time, of input/output operation ; Recording or statistical evaluation of user activity, e.g. usability assessment
- G06F11/3466—Performance evaluation by tracing or monitoring
- G06F11/3485—Performance evaluation by tracing or monitoring for I/O devices
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/28—Databases characterised by their database models, e.g. relational or object models
- G06F16/284—Relational databases
- G06F16/285—Clustering or classification
- G06F16/287—Visualization; Browsing
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Databases & Information Systems (AREA)
- Computer Hardware Design (AREA)
- Quality & Reliability (AREA)
- Data Mining & Analysis (AREA)
- Debugging And Monitoring (AREA)
Abstract
The application discloses an IO performance data acquisition method, which comprises the following steps: performing performance test by using FIO to obtain test data; determining corresponding read-write performance data from the data inquired by iostat according to the test time of the test data; and importing the read-write performance data into an excel table. The FIO is used for testing, and then the corresponding read-write performance data is determined from iostat according to the test time of the test data instead of directly adopting the test data obtained by the FIO, so that the condition that the readability of the test data of the FIO is reduced is avoided, and the readability of the data is improved by adopting the read-write performance data in iostat. The application also discloses an IO performance data acquisition device, a computing device and a computer readable storage medium, which have the beneficial effects.
Description
Technical Field
The present application relates to the field of computer technologies, and in particular, to an IO performance data obtaining method, an IO performance data obtaining apparatus, a computing device, and a computer-readable storage medium.
Background
In computer performance monitoring, IO (Input/Output) performance often needs to be detected and drawn into a corresponding data chart or a visual view, so that technicians can conveniently view and monitor the IO performance. Currently, a FIO (Flexible IO Tester) is often used to test the performance of the hard disk, so as to check and monitor the performance of the hard disk. The FIO is an I/O tool used for carrying out pressure test and verification on hardware, and can start a plurality of threads to simulate various different IO operations according to the requirements of a user, so that the actual pressure which can be borne by a disk with a file system in an actual random read-write working mode is tested.
In the related technology, the recorded data obtained after the FIO test only has some numbers and does not have the drive letter information, and the timestamp is in a digital form and is inconvenient to read, so that the difficulty of data reading is improved; the recorded data is used for drawing a chart and an additional downloading tool; the FIO self-contained tool has requirements on command parameters during the execution of the FIO, and if the FIO self-contained tool does not carry specified parameters, the FIO drawing tool cannot be used; the FIO drawing tool only finishes one picture, which is inconvenient to modify; the FIO drawing tool only has the reading rate or the writing rate at the time, and has no record on the parameters such as the number of threads and the like. Therefore, the recorded data acquired through the FIO not only has high reading difficulty, but also is not beneficial to visual display, and the readability of the data and the data acquisition effect are reduced.
Therefore, how to acquire simple and readable data and improve the readability of the data are important issues to be paid attention to by those skilled in the art.
Disclosure of Invention
The application aims to provide an IO performance data acquisition method, an IO performance data acquisition device, a computing device and a computer readable storage medium, the test is performed through FIO, corresponding read-write performance data are determined from iostat according to the test time of the test data instead of directly adopting the test data obtained through FIO, the condition that the readability of the test data of FIO is reduced is avoided, and the readability of the data is improved by adopting the read-write performance data in iostat.
In order to solve the above technical problem, the present application provides an IO performance data obtaining method, including:
performing performance test by using FIO to obtain test data;
determining corresponding read-write performance data from the data inquired by iostat according to the test time of the test data;
and importing the read-write performance data into an excel table.
Optionally, determining corresponding read-write performance data from data queried by iostat according to the test time of the test data includes:
determining test time according to the test data;
reading and writing data query is carried out by adopting the iostat to obtain target data;
and selecting data corresponding to the test time from the target data, and taking the data as the read-write performance data.
Optionally, the method further includes:
carrying out visualization processing on the excel table according to a preset display style to obtain visualization data;
and displaying the visual data.
Optionally, importing the read-write performance data into an excel table, including:
and importing the read-write performance data into an excel table by adopting an xlsxwriter.
Optionally, the read-write performance data includes sequential read data, sequential write data, random read data, and random write data.
The present application further provides an IO performance data acquisition apparatus, including:
the FIO testing module is used for performing performance testing by adopting FIO to obtain testing data;
the performance data acquisition module is used for determining corresponding read-write performance data from data inquired by iostat according to the test time of the test data;
and the data import module is used for importing the read-write performance data into the excel table.
Optionally, the performance data obtaining module includes:
the test time determining unit is used for determining test time according to the test data;
the data query unit is used for performing read-write data query by adopting the iostat to obtain target data;
and the data selection unit is used for selecting the data corresponding to the test time from the target data and taking the data as the read-write performance data.
Optionally, the method further includes:
the visualization module is used for performing visualization processing on the excel table according to a preset display style to obtain visualization data; and displaying the visual data.
The present application further provides a computing device comprising:
a memory for storing a computer program;
a processor for implementing the steps of the IO performance data acquisition method as described above when executing the computer program.
The present application further provides a computer-readable storage medium having stored thereon a computer program, which when executed by a processor, implements the steps of the IO performance data acquisition method as described above.
The application provides an IO performance data acquisition method, which comprises the following steps: performing performance test by using FIO to obtain test data; determining corresponding read-write performance data from the data inquired by iostat according to the test time of the test data; and importing the read-write performance data into an excel table.
The FIO is used for testing, and then the corresponding read-write performance data is determined from iostat according to the test time of the test data instead of directly adopting the test data obtained by the FIO, so that the condition that the readability of the test data of the FIO is reduced is avoided, and the readability of the data is improved by adopting the read-write performance data in iostat.
The application further provides an IO performance data acquisition device, a computing device and a computer readable storage medium, which have the above beneficial effects and are not described herein again.
Drawings
In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings needed to be used in the description of the embodiments or the prior art will be briefly introduced below, it is obvious that the drawings in the following description are only embodiments of the present application, and for those skilled in the art, other drawings can be obtained according to the provided drawings without creative efforts.
Fig. 1 is a flowchart of an IO performance data obtaining method according to an embodiment of the present application;
fig. 2 is a schematic structural diagram of an IO performance data acquisition apparatus according to an embodiment of the present application.
Detailed Description
The core of the application is to provide an IO performance data acquisition method, an IO performance data acquisition device, a computing device and a computer readable storage medium, the test is performed through FIO, then corresponding read-write performance data is determined from iostat according to the test time of the test data, the FIO is not directly adopted to obtain the test data, the condition that the readability of the FIO test data is reduced is avoided, and the readability of the data is improved by adopting the read-write performance data in iostat.
In order to make the objects, technical solutions and advantages of the embodiments of the present application clearer, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are some embodiments of the present application, but not all embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
In the related technology, the recorded data obtained after the FIO test only has some numbers and does not have the drive letter information, and the timestamp is in a digital form and is inconvenient to read, so that the difficulty of data reading is improved; the recorded data is used for drawing a chart and an additional downloading tool; the FIO self-contained tool has requirements on command parameters during the execution of the FIO, and if the FIO self-contained tool does not carry specified parameters, the FIO drawing tool cannot be used; the FIO drawing tool only finishes one picture, which is inconvenient to modify; the FIO drawing tool only has the reading rate or the writing rate at the time, and has no record on the parameters such as the number of threads and the like. Therefore, the recorded data acquired through the FIO not only has high reading difficulty, but also is not beneficial to visual display, and the readability of the data and the data acquisition effect are reduced.
Therefore, the IO performance data acquisition method provided by the application tests through FIO first, and then determines corresponding read-write performance data from iostat according to the test time of the test data instead of directly adopting the test data obtained by FIO, so that the condition that the readability of the test data of FIO is reduced is avoided, and the readability of the data is improved by adopting the read-write performance data in iostat.
An IO performance data obtaining method provided by the present application is described below by an embodiment.
Referring to fig. 1, fig. 1 is a flowchart of an IO performance data obtaining method according to an embodiment of the present disclosure.
In this embodiment, the method may include:
s101, performing performance test by using FIO to obtain test data;
therefore, in the step, the FIO is mainly adopted for performance test to obtain test data.
Among them, FIO is a common performance testing tool, and generally performs data writing and reading on a storage device for a period of time, and then obtains corresponding test data. However, in the related art, only some numbers are recorded in the test data obtained by performing the performance test using the FIO, and there is no corresponding drive letter information. Where the time stamp is in digital form, it is inconvenient for a technician to read and determine the time.
S102, determining corresponding read-write performance data from data inquired by iostat according to the test time of the test data;
on the basis of S101, this step aims to determine corresponding read-write performance data from the data queried by iostat according to the test time of the test data. That is, the corresponding test is performed through the FIO, and the read-write performance data of the final test result is obtained from the iostat query. Rather than test data acquired from the FIO.
Iostat is used for reporting the statistical information of the central processing unit and the input/output statistical information of the whole system, an adapter, tty (terminal) equipment, a magnetic disk and a CD-ROM. Moreover, the iostat record information is very comprehensive, simple and easy to read. However, only the iostat acquires the corresponding performance data, and there is no way to determine the time of the data, which causes the data queried by the iostat to be troublesome in displaying and visualizing.
Therefore, in the step, the corresponding test time is determined through the test data, and then the read-write performance data corresponding to the test time is determined from the data inquired by iostat.
The read-write performance data comprises sequential read data, sequential write data, random read data and random write data.
Specifically, in the process of this step in the specific embodiment, the corresponding read-write performance data may be obtained from the data of iostat by one key of the test time of the test data.
Further, the step may include:
step 1, determining test time according to test data;
step 2, performing read-write data query by using iostat to obtain target data;
and 3, selecting data corresponding to the test time from the target data, and taking the data as read-write performance data.
It can be seen that the step is mainly to explain how to obtain the read-write performance data. In the alternative, firstly, the test time is determined according to the test data; then, performing read-write data query by using iostat to obtain target data; and finally, selecting data corresponding to the test time from the target data, and taking the data as read-write performance data. Therefore, the alternative scheme can conveniently acquire the corresponding read-write performance data from the target data inquired by iostat.
And S103, importing the read-write performance data into an excel table.
On the basis of S102, this step is intended to import the read-write performance data into the excel table. That is, the obtained read-write performance data is saved in an excel form file, so that the test result data is obtained.
Therefore, the obtained read-write performance data can be imported into the corresponding excel table finally, so that the data can be displayed visually in the form of the excel table instead of viewing the original data. Finally, corresponding visualization graphs, such as a line graph, a bar graph and a pie graph, can be directly generated on the basis of the excel table.
Further, the step may include:
the xlsxwriter is used to import the read-write performance data into the excel table.
It can be seen that the alternative mainly illustrates that the read-write performance data is imported into the excel table by the xlsxwriter module.
Further, this embodiment may further include:
step 1, carrying out visualization processing on an excel table according to a preset display style to obtain visualization data;
and 2, displaying the visual data.
Therefore, the optional scheme mainly comprises the steps of carrying out visualization processing on the excel table and finally displaying the visualized data. In the alternative scheme, firstly, visualization processing is carried out on an excel table according to a preset display style to obtain visualization data; then, the visualized data is displayed.
In summary, in the embodiment, the FIO is used for performing the test first, and then the corresponding read-write performance data is determined from iostat according to the test time of the test data, instead of directly using the test data obtained by the FIO, so that the readability of the test data of the FIO is prevented from being reduced, and the readability of the data is improved by using the read-write performance data in iostat.
The following further describes an IO performance data obtaining method provided by the present application with a specific embodiment.
The embodiment uses a unittest framework of python, and os, xlsxwriter and ddt modules under the framework, wherein the os module is used for acquiring a path of a file and providing a saving path of an output file, the xlsxwriter is used for importing data extracted from iostat into an excel table and drawing a chart, and the ddt module is used for circularly executing a use case, and when a plurality of extracted files are required to generate a table, a file name only needs to be added into a data block of the ddt module.
And modifying the file name used for generating the excel chart to be consistent with the file name in the tool, placing the file name in a same-level directory of the tool, and operating the tool.
Based on this, the steps of this embodiment may include:
step 1, performing performance test by using FIO to obtain test data;
step 2, determining corresponding read-write performance data from the data inquired by iostat according to the test time of the test data;
and 3, importing the read-write performance data into the excel table by adopting an xlsxwriter module.
It can be seen that, in the embodiment, the FIO is used for testing first, and then the corresponding read-write performance data is determined from iostat according to the test time of the test data, instead of directly using the test data obtained by the FIO, so that the readability of the test data of the FIO is prevented from being reduced, and the readability of the data is improved by using the read-write performance data in iostat.
The following introduces an IO performance data obtaining apparatus provided in an embodiment of the present application, and the IO performance data obtaining apparatus described below and the IO performance data obtaining method described above may be referred to correspondingly.
Referring to fig. 2, fig. 2 is a schematic structural diagram of an IO performance data obtaining apparatus according to an embodiment of the present disclosure.
In this embodiment, the apparatus may include:
the FIO test module 100 is used for performing performance test by adopting FIO to obtain test data;
the performance data acquisition module 200 is configured to determine corresponding read-write performance data from data queried by iostat according to test time of the test data;
and the data import module 300 is configured to import the read-write performance data into the excel table.
Optionally, the performance data obtaining module 200 may include:
the test time determining unit is used for determining test time according to the test data;
the data query unit is used for performing read-write data query by using iostat to obtain target data;
and the data selection unit is used for selecting data corresponding to the test time from the target data and taking the data as the read-write performance data.
Optionally, the apparatus may further include:
the visualization module is used for performing visualization processing on the excel table according to a preset display style to obtain visualization data; and displaying the visual data.
An embodiment of the present application further provides a computing device, including:
a memory for storing a computer program;
a processor for implementing the steps of the IO performance data acquisition method as the above embodiments when executing the computer program.
An embodiment of the present application further provides a computer-readable storage medium, where a computer program is stored on the computer-readable storage medium, and when the computer program is executed by a processor, the steps of the IO performance data obtaining method according to the above embodiment are implemented.
The embodiments are described in a progressive manner in the specification, each embodiment focuses on differences from other embodiments, and the same and similar parts among the embodiments are referred to each other. The device disclosed by the embodiment corresponds to the method disclosed by the embodiment, so that the description is simple, and the relevant points can be referred to the method part for description.
Those of skill would further appreciate that the various illustrative elements and algorithm steps described in connection with the embodiments disclosed herein may be implemented as electronic hardware, computer software, or combinations of both, and that the various illustrative components and steps have been described above generally in terms of their functionality in order to clearly illustrate this interchangeability of hardware and software. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the implementation. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present application.
The steps of a method or algorithm described in connection with the embodiments disclosed herein may be embodied directly in hardware, in a software module executed by a processor, or in a combination of the two. A software module may reside in Random Access Memory (RAM), memory, Read Only Memory (ROM), electrically programmable ROM, electrically erasable programmable ROM, registers, hard disk, a removable disk, a CD-ROM, or any other form of storage medium known in the art.
The detailed description is given above of an IO performance data obtaining method, an IO performance data obtaining apparatus, a computing device, and a computer readable storage medium provided by the present application. The principles and embodiments of the present application are explained herein using specific examples, which are provided only to help understand the method and the core idea of the present application. It should be noted that, for those skilled in the art, it is possible to make several improvements and modifications to the present application without departing from the principle of the present application, and such improvements and modifications also fall within the scope of the claims of the present application.
Claims (10)
1. An IO performance data acquisition method, comprising:
performing performance test by using FIO to obtain test data;
determining corresponding read-write performance data from the data inquired by iostat according to the test time of the test data;
and importing the read-write performance data into an excel table.
2. The IO performance data obtaining method according to claim 1, wherein determining corresponding read-write performance data from data queried by iostat according to the test time of the test data includes:
determining test time according to the test data;
reading and writing data query is carried out by adopting the iostat to obtain target data;
and selecting data corresponding to the test time from the target data, and taking the data as the read-write performance data.
3. The IO performance data acquisition method according to claim 1, further comprising:
carrying out visualization processing on the excel table according to a preset display style to obtain visualization data;
and displaying the visual data.
4. The IO performance data obtaining method according to claim 1, wherein importing the read-write performance data into an excel table includes:
and importing the read-write performance data into an excel table by adopting an xlsxwriter.
5. The IO performance data acquisition method according to claim 1, wherein the read-write performance data includes sequential read data, sequential write data, random read data, and random write data.
6. An IO performance data acquisition apparatus, comprising:
the FIO testing module is used for performing performance testing by adopting FIO to obtain testing data;
the performance data acquisition module is used for determining corresponding read-write performance data from data inquired by iostat according to the test time of the test data;
and the data import module is used for importing the read-write performance data into the excel table.
7. The IO performance data acquisition device according to claim 6, wherein the performance data acquisition module includes:
the test time determining unit is used for determining test time according to the test data;
the data query unit is used for performing read-write data query by adopting the iostat to obtain target data;
and the data selection unit is used for selecting the data corresponding to the test time from the target data and taking the data as the read-write performance data.
8. The IO performance data acquisition apparatus according to claim 6, further comprising:
the visualization module is used for performing visualization processing on the excel table according to a preset display style to obtain visualization data; and displaying the visual data.
9. A computing device, comprising:
a memory for storing a computer program;
a processor for implementing the steps of the IO performance data acquisition method according to any one of claims 1 to 5 when executing the computer program.
10. A computer-readable storage medium, having stored thereon a computer program which, when being executed by a processor, carries out the steps of the IO performance data acquisition method according to any one of claims 1 to 5.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110285352.6A CN112882916A (en) | 2021-03-17 | 2021-03-17 | IO performance data acquisition method and related device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110285352.6A CN112882916A (en) | 2021-03-17 | 2021-03-17 | IO performance data acquisition method and related device |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN112882916A true CN112882916A (en) | 2021-06-01 |
Family
ID=76041082
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110285352.6A Withdrawn CN112882916A (en) | 2021-03-17 | 2021-03-17 | IO performance data acquisition method and related device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112882916A (en) |
-
2021
- 2021-03-17 CN CN202110285352.6A patent/CN112882916A/en not_active Withdrawn
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106951364B (en) | Test method and device | |
| US8375364B2 (en) | Size and effort estimation in testing applications | |
| CN109062802B (en) | Software testing method, computer readable storage medium and terminal equipment | |
| CN107480039B (en) | Small file read-write performance test method and device for distributed storage system | |
| CN109407984B (en) | Method, device and equipment for monitoring performance of storage system | |
| US20130036330A1 (en) | Execution difference identification tool | |
| CN112667834A (en) | Image annotation method and related device | |
| CN107885628A (en) | A kind of method of testing, device and the equipment of magnetic disc i/o performance | |
| CN114141302A (en) | Test method of solid state disk and electronic equipment | |
| CN106294109B (en) | Method and device for acquiring defect code | |
| CN111127223B (en) | Insurance product testing method, insurance product testing device and storage medium | |
| CN112882916A (en) | IO performance data acquisition method and related device | |
| CN111143216A (en) | Quality report generation method, quality report generation device, quality report generation equipment and computer readable storage medium | |
| CN114398140B (en) | Dynamic generation method of trend graph, electronic measurement device and storage medium | |
| CN111984742B (en) | Audit line management method and device and computer equipment | |
| US9147005B1 (en) | Consistently delivering a web page having source code with a dynamic instruction | |
| JP6290743B2 (en) | Information processing apparatus and program | |
| CN112506765A (en) | Software testing method, device, equipment and storage medium | |
| JP2018026056A (en) | Software quality determination method | |
| JP5515815B2 (en) | Verification device and verification program | |
| CN112363944A (en) | Method and equipment for comparing return values of multiple environment interfaces | |
| CN110569184A (en) | test method and terminal equipment | |
| CN115470229B (en) | Data table processing method and device, electronic equipment and storage medium | |
| CN112559255B (en) | Method, system, device and storage medium for testing file mount recovery | |
| CN110765022B (en) | Method, device, computer equipment and storage medium for automatically testing sample sending SSD |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WW01 | Invention patent application withdrawn after publication |
Application publication date: 20210601 |
|
| WW01 | Invention patent application withdrawn after publication |