CN107992403B - IO performance test method, device, equipment and computer readable storage medium - Google Patents
IO performance test method, device, equipment and computer readable storage medium Download PDFInfo
- Publication number
- CN107992403B CN107992403B CN201711436627.1A CN201711436627A CN107992403B CN 107992403 B CN107992403 B CN 107992403B CN 201711436627 A CN201711436627 A CN 201711436627A CN 107992403 B CN107992403 B CN 107992403B
- Authority
- CN
- China
- Prior art keywords
- test
- configuration file
- model
- preset
- host
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 36
- 238000011056 performance test Methods 0.000 title claims abstract description 14
- 238000012360 testing method Methods 0.000 claims abstract description 116
- 238000013515 script Methods 0.000 claims abstract description 26
- 238000004590 computer program Methods 0.000 claims description 10
- 238000013507 mapping Methods 0.000 claims description 5
- 238000012545 processing Methods 0.000 claims description 3
- 238000012216 screening Methods 0.000 claims description 3
- 238000007726 management method Methods 0.000 description 18
- 238000010586 diagram Methods 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000004891 communication Methods 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 238000010248 power generation Methods 0.000 description 1
- 230000000750 progressive effect Effects 0.000 description 1
- 238000012552 review Methods 0.000 description 1
- 238000004088 simulation Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/30—Monitoring
- G06F11/34—Recording or statistical evaluation of computer activity, e.g. of down time, of input/output operation ; Recording or statistical evaluation of user activity, e.g. usability assessment
- G06F11/3409—Recording or statistical evaluation of computer activity, e.g. of down time, of input/output operation ; Recording or statistical evaluation of user activity, e.g. usability assessment for performance assessment
- G06F11/3414—Workload generation, e.g. scripts, playback
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/30—Monitoring
- G06F11/34—Recording or statistical evaluation of computer activity, e.g. of down time, of input/output operation ; Recording or statistical evaluation of user activity, e.g. usability assessment
- G06F11/3466—Performance evaluation by tracing or monitoring
- G06F11/3485—Performance evaluation by tracing or monitoring for I/O devices
Abstract
The invention discloses an IO performance test method, which comprises the steps of running a test script preset in a management machine; the management machine calls and runs a preset test environment configuration file, and configures hosts to be configured and stores in the SAN network through corresponding interfaces; after the configuration is completed, the management machine calls and runs a preset IO model configuration file, generates an IO model instruction according to the IO model configuration file and sends the IO model instruction to each configured host; and each configured host generates expected IO load for the volume mapped by the corresponding configured storage according to the IO model instruction, and records an execution result. The invention reduces the workload and has high testing efficiency; the invention also discloses a device, equipment and a computer readable storage medium based on the method.
Description
Technical Field
The invention relates to the technical field of photovoltaic power generation, in particular to an IO performance testing method. The invention also relates to an IO performance testing device, equipment and a computer readable storage medium.
Background
An SAN (Storage Area Network) adopts a mesh Channel (FC) technology, connects a Storage array and a server host through an FC switch, and establishes an Area Network dedicated to data Storage.
The IO performance index is an important index of the SAN storage product and has an extremely key reference value for project bidding and scheme review. Because different hard disks, different physical topologies and different protocols are used for storage, the performance levels of the storage are different, and the performance values of the storage are different for different IO service models, the SAN storage complete performance test is very huge, and the IO performance test at present needs to manually run corresponding configuration files to test different IO service models, so that the degree of automation is low, the operation process is complex, and the efficiency is low.
Therefore, how to provide an efficient IO performance testing method, apparatus, device and computer readable storage medium is a problem that needs to be solved by those skilled in the art.
Disclosure of Invention
The invention aims to provide an IO performance testing method, which reduces the workload and has high testing efficiency; another object of the present invention is to provide an apparatus, a device and a computer readable storage medium based on the above method.
In order to solve the technical problem, the invention provides an IO performance testing method based on an SAN network, which comprises the following steps:
running a test script preset in a manager;
the management machine calls and runs a preset test environment configuration file, and configures hosts to be configured and stores in the SAN network through corresponding interfaces;
after the configuration is completed, the management machine calls and runs a preset IO model configuration file, generates an IO model instruction according to the IO model configuration file and sends the IO model instruction to each configured host;
and each configured host generates expected IO load for the volume mapped by the corresponding configured storage according to the IO model instruction, and records an execution result.
Preferably, a batch scheduler script and a plurality of groups of configuration files are arranged in the manager, and each group of configuration files comprises a test environment configuration file and an IO model configuration file; the method comprises the following steps of before the test script preset in the operation manager:
running the batch scheduling program scripts and sequentially calling the preset test scripts;
correspondingly, after the preset test script is called each time, different groups of the configuration files are called respectively to run.
Preferably, the method further comprises the following steps:
and after the test is finished, the management machine generates a test log for all test processes and results and stores the test log.
Preferably, the method further comprises the following steps:
and the performance testing tool in the management machine performs text processing and screening on the stored test logs to obtain and store a test table.
Preferably, the test environment configuration file includes:
the IP of the host to be configured, the host type, the password-free login authority, and any combination of a pool, volume number, storage type and mapping relation between the host and the storage planned to be built in the storage to be configured.
Preferably, the IO model configuration file includes:
IO block size, IO run time, and read-write type.
In order to solve the above technical problem, the present invention further provides an IO performance testing apparatus based on a manager in a SAN network, including:
the test environment configuration file generation module is used for setting a test environment configuration file by a user and storing a setting result;
the IO model configuration file generation module is used for setting the IO model configuration file by a user and storing a setting result;
the test module is used for running a preset test script in the test module;
the first configuration module is used for calling and running a preset test environment configuration file, and configuring hosts to be configured and storage in the SAN network through corresponding interfaces; triggering a second configuration module after configuration is completed;
the second configuration module is used for the management machine to call and run a preset IO model configuration file, generate an IO model instruction according to the IO model configuration file and send the IO model instruction to each configured host; and each configured host generates expected IO load for the volume mapped by the corresponding configured storage according to the IO model instruction, and records an execution result.
Preferably, the method further comprises the following steps:
and the management database is used for storing all test processes and test logs generated by results after the test is finished.
In order to solve the above technical problem, the present invention further provides an IO performance testing device, including:
a memory for storing a computer program;
a processor for implementing the steps of the IO performance testing method according to any one of the above when the computer program is executed.
To solve the above technical problem, the present invention further provides a computer-readable storage medium, on which a computer program is stored, and the computer program, when executed by a processor, implements the steps of the IO performance testing method according to any one of the above.
The invention provides an IO performance testing method, which can automatically call a preset testing environment configuration file and an IO model configuration file to generate a corresponding IO model for testing after a testing script in a management machine is operated. Therefore, the staff can operate the test script, the workload is greatly reduced, and the IO performance test efficiency is improved. The invention also provides a device, equipment and a computer readable storage medium based on the method.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings needed in the prior art and the embodiments will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art to obtain other drawings without creative efforts.
FIG. 1 is a flow chart of a process of an IO performance testing method according to the present invention;
fig. 2 is a schematic structural diagram of an IO performance testing apparatus provided in the present invention.
Detailed Description
The core of the invention is to provide an IO performance test method, which reduces the workload and has high test efficiency; another object of the present invention is to provide an apparatus, a device and a computer readable storage medium based on the above method. .
In order to make the objects, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, but not all, embodiments of the present invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
The invention provides an IO performance testing method based on SAN network, referring to FIG. 1, FIG. 1 is a flow chart of the process of the IO performance testing method provided by the invention; the method comprises the following steps:
step s 1: running a test script preset in a manager;
step s 2: the management machine calls and runs a preset test environment configuration file, and configures hosts to be configured and stores in the SAN network through corresponding interfaces;
wherein the hypervisor creates pools, volumes, mappings, etc. either through the storage CLI interface.
Step s 3: after the configuration is completed, the management machine calls and runs a preset IO model configuration file, generates an IO model instruction according to the IO model configuration file and sends the IO model instruction to each configured host;
specifically, the operation specifically comprises:
after calling and running a preset IO model configuration file, the management machine issues a corresponding IO model instruction to a suiter in each configured host, the suiter receives the instruction and then calls a CSOP (program for actually generating IO load) in the host where the suiter is located to generate expected IO load for the volume of the storage mapping, and the suiter records an execution result through a raw log.
Step s 4: each configured host generates expected IO loads for the volume mapped by the corresponding configured storage according to the IO model instruction, and records an execution result (which may be recorded in a log form, for example, a raw log).
It can be understood that the IO performance test in the present invention specifically refers to IO pressure simulation, and specifically includes creation and automatic operation of an IO model.
The test environment configuration file may be a YML file, and the IO model configuration file may be a CFG file, but the present invention is not limited to the specific types of the above two configuration files.
It can be understood that preparation work is required before preparing IO performance tests: preparing a physical topological environment, namely the connection of a host, a storage and an exchanger in an SAN network to enable each device to carry out normal communication, wherein a management machine is respectively connected with a press machine and a storage cluster, and the press machine is also connected with the storage cluster through an FC exchanger; in addition, the method also comprises the steps of configuring a test environment configuration file and an IO model configuration file in advance, wherein the test environment configuration file can comprise the IP of the host to be configured, the host type, the password-free login authority, and any combination of a pool planned to be built in the storage to be configured, the volume number, the storage type and the mapping relation between the host and the storage; the IO model configuration file includes an IO model to be tested, which includes an IO block size, an IO running time, a read-write type, and the like, for example, the IO model configuration file includes "sequential read 4K block size cache hit", and then the expected IO load is generated for the volume mapped by the storage after the management machine runs the IO model configuration file.
It can be further seen that,
in a preferred embodiment, a batch scheduler script (e.g. a scanner program) and a plurality of sets of configuration files are arranged in the manager, and each set of configuration files comprises a test environment configuration file and an IO model configuration file; the method also comprises the following steps before the test script preset in the operation manager:
step s 0: running a batch scheduling program script, and calling preset test scripts in sequence;
correspondingly, after the preset test script is called each time, different groups of configuration files are called respectively to run.
Preferably, the method further comprises:
after the test is completed, the management machine generates a test log (for example, jsonlog) of all test processes and results and stores the test log.
Preferably, the method further comprises:
and a performance testing tool (perfweb tool) in the manager performs text processing and screening on the stored test logs to obtain and store a test table. In addition, the stored test table may also be derived and formed into an HTML (Hyper Text Markup Language) file.
The invention provides an IO performance testing method, which can automatically call a preset testing environment configuration file and an IO model configuration file to generate a corresponding IO model for testing after a testing script in a management machine is operated. Therefore, the staff can operate the test script, the workload is greatly reduced, and the IO performance test efficiency is improved.
The invention also provides an IO performance testing device, which is based on a management machine in the SAN network, and is shown in fig. 2, and fig. 2 is a schematic structural diagram of the IO performance testing device provided by the invention. The device includes:
the test environment configuration file generation module 1 is used for setting a test environment configuration file by a user and storing a setting result;
the IO model configuration file generation module 2 is used for setting the IO model configuration file by a user and storing a setting result;
the test module 3 is used for running a preset test script in the test module;
the first configuration module 4 is used for calling and running a preset test environment configuration file, and configuring a host to be configured and storage in the SAN network through a corresponding interface; after the configuration is completed, triggering a second configuration module 5;
the second configuration module 5 is used for the management machine to call and run a preset IO model configuration file, generate an IO model instruction according to the IO model configuration file, and send the IO model instruction to each configured host; and each configured host generates expected IO load for the volume mapped by the corresponding configured storage according to the IO model instruction, and records an execution result.
Preferably, the apparatus further comprises:
and the management database 6 is used for storing all test processes and test logs generated by results after the test is finished.
The invention provides an IO performance testing device which can automatically call a preset testing environment configuration file and an IO model configuration file to generate a corresponding IO model for testing after a testing script in a management machine is operated. Therefore, the staff can operate the test script, the workload is greatly reduced, and the IO performance test efficiency is improved.
The invention also provides an IO performance test apparatus, comprising:
a memory for storing a computer program;
a processor for implementing the steps of the IO performance testing method as any one of the above when executing the computer program.
The invention also provides a computer readable storage medium having stored thereon a computer program which, when executed by a processor, implements the steps of the IO performance testing method as any one of the above.
The above embodiments are only preferred embodiments of the present invention, and the above embodiments can be combined arbitrarily, and the combined embodiments are also within the scope of the present invention. It should be noted that other modifications and variations that may suggest themselves to persons skilled in the art without departing from the spirit and scope of the invention are intended to be included within the scope of the invention as defined by the appended claims.
The embodiments in the present description are described in a progressive manner, each embodiment focuses on differences from other embodiments, and the same and similar parts among the embodiments are referred to each other. The device disclosed by the embodiment corresponds to the method disclosed by the embodiment, so that the description is simple, and the relevant points can be referred to the method part for description.
The previous description of the disclosed embodiments is provided to enable any person skilled in the art to make or use the present invention. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other embodiments without departing from the spirit or scope of the invention. Thus, the present invention is not intended to be limited to the embodiments shown herein but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.
Claims (10)
1. An IO performance test method based on SAN network is characterized by comprising the following steps:
running a preset test script in a manager to call a preset test environment configuration file and an IO model configuration file;
the management machine calls and runs the test environment configuration file, and configures hosts to be configured and storage in the SAN network through corresponding interfaces;
after the configuration is completed, the management machine calls and runs the IO model configuration file, generates an IO model instruction according to the IO model configuration file and sends the IO model instruction to each configured host;
and each configured host generates expected IO load for the volume mapped by the corresponding configured storage according to the IO model instruction, and records an execution result.
2. The method according to claim 1, wherein a batch dispatcher script and a plurality of sets of configuration files are arranged in the manager, each set of configuration files comprising a test environment configuration file and an IO model configuration file; the method comprises the following steps of before the test script preset in the operation manager:
running the batch scheduling program script and calling the preset test scripts in sequence, wherein the batch scheduling program script is used for scheduling the preset test scripts in sequence;
correspondingly, after the preset test script is called each time, different groups of the configuration files are called respectively to run.
3. The method of claim 1 or 2, further comprising:
and after the test is finished, the management machine generates a test log for all test processes and results and stores the test log.
4. The method of claim 3, further comprising:
and the performance testing tool in the management machine performs text processing and screening on the stored test logs to obtain and store a test table.
5. The method of claim 4, wherein the test environment profile comprises:
the method comprises the steps of configuring parameters of a host to be configured and parameters to be configured and stored, wherein the parameters of the host to be configured comprise an IP (Internet protocol) of the host to be configured, a host type and a password-free login authority, and the parameters to be configured and stored comprise a pool planned to be built in the storage to be configured, the number of volumes, a storage type and a mapping relation between the host and the storage.
6. The method of claim 4, wherein the IO model configuration file comprises:
IO block size, IO run time, and read-write type.
7. An IO performance testing device is based on a management machine in a SAN network, and is characterized by comprising:
the test environment configuration file generation module is used for setting a test environment configuration file by a user and storing a setting result;
the IO model configuration file generation module is used for setting the IO model configuration file by a user and storing a setting result;
the test module is used for running a preset test script in the test module to call the test environment configuration file and the IO model configuration file;
the first configuration module is used for calling and running a preset test environment configuration file, and configuring hosts to be configured and storage in the SAN network through corresponding interfaces; triggering a second configuration module after configuration is completed;
the second configuration module is used for the management machine to call and run a preset IO model configuration file, generate an IO model instruction according to the IO model configuration file and send the IO model instruction to each configured host; and each configured host generates expected IO load for the volume mapped by the corresponding configured storage according to the IO model instruction, and records an execution result.
8. The apparatus of claim 7, further comprising:
and the management database is used for storing all test processes and test logs generated by results after the test is finished.
9. An IO performance test device, comprising:
a memory for storing a computer program;
a processor for implementing the steps of the IO performance testing method according to any one of claims 1 to 6 when executing the computer program.
10. A computer-readable storage medium, having stored thereon a computer program which, when being executed by a processor, carries out the steps of the IO performance testing method according to any one of claims 1 to 6.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711436627.1A CN107992403B (en) | 2017-12-26 | 2017-12-26 | IO performance test method, device, equipment and computer readable storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711436627.1A CN107992403B (en) | 2017-12-26 | 2017-12-26 | IO performance test method, device, equipment and computer readable storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN107992403A CN107992403A (en) | 2018-05-04 |
| CN107992403B true CN107992403B (en) | 2021-07-02 |
Family
ID=62042797
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201711436627.1A Active CN107992403B (en) | 2017-12-26 | 2017-12-26 | IO performance test method, device, equipment and computer readable storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107992403B (en) |
Families Citing this family (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108984356A (en) * | 2018-07-10 | 2018-12-11 | 郑州云海信息技术有限公司 | A kind of IT product test method and device |
| CN109240888B (en) * | 2018-09-17 | 2023-06-06 | 深圳市闻耀电子科技有限公司 | Information grabbing method, device, equipment and medium |
| CN111427783A (en) * | 2020-03-24 | 2020-07-17 | 上海科世达-华阳汽车电器有限公司 | RTE interface testing method, device, equipment and storage medium |
| CN112433922B (en) * | 2020-10-26 | 2023-01-06 | 苏州浪潮智能科技有限公司 | Storage performance testing method and device |
| CN115801633B (en) * | 2023-02-08 | 2023-04-28 | 湖南国科亿存信息科技有限公司 | Multi-client sharing concurrency performance testing method and system for SAN storage |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103716174A (en) * | 2012-10-09 | 2014-04-09 | 鸿富锦精密工业（深圳）有限公司 | Test log acquisition system and method for the same |
| CN104317726A (en) * | 2014-11-19 | 2015-01-28 | 浪潮电子信息产业股份有限公司 | Testing method for storage IO performance |
| CN104765665A (en) * | 2015-04-14 | 2015-07-08 | 浪潮电子信息产业股份有限公司 | Method and device for testing hard disks |
| CN105607988A (en) * | 2015-12-18 | 2016-05-25 | 浪潮电子信息产业股份有限公司 | Automated test and analysis method for IO performance of storage devices in server |
Family Cites Families (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8078799B2 (en) * | 2009-06-10 | 2011-12-13 | Lsi Corporation | Method and system of an adaptive input/output scheduler for storage arrays |
| CN106874159A (en) * | 2016-12-30 | 2017-06-20 | 北京同有飞骥科技股份有限公司 | A kind of concentrating type automated testing method |
| CN106919485B (en) * | 2017-03-09 | 2020-02-07 | 苏州浪潮智能科技有限公司 | System based on hardware testing tool configured on server |
-
2017
- 2017-12-26 CN CN201711436627.1A patent/CN107992403B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103716174A (en) * | 2012-10-09 | 2014-04-09 | 鸿富锦精密工业（深圳）有限公司 | Test log acquisition system and method for the same |
| CN104317726A (en) * | 2014-11-19 | 2015-01-28 | 浪潮电子信息产业股份有限公司 | Testing method for storage IO performance |
| CN104765665A (en) * | 2015-04-14 | 2015-07-08 | 浪潮电子信息产业股份有限公司 | Method and device for testing hard disks |
| CN105607988A (en) * | 2015-12-18 | 2016-05-25 | 浪潮电子信息产业股份有限公司 | Automated test and analysis method for IO performance of storage devices in server |
Also Published As
| Publication number | Publication date |
|---|---|
| CN107992403A (en) | 2018-05-04 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107992403B (en) | IO performance test method, device, equipment and computer readable storage medium | |
| CN107341098B (en) | Software performance testing method, platform, equipment and storage medium | |
| US10515000B2 (en) | Systems and methods for performance testing cloud applications from multiple different geographic locations | |
| WO2018120721A1 (en) | Method and system for testing user interface, electronic device, and computer readable storage medium | |
| CN107656968B (en) | Method and system for exporting large-batch business data | |
| US20220237162A1 (en) | System and method for cardinality estimation feedback loops in query processing | |
| WO2018184420A1 (en) | Software testing method, apparatus, electronic device, and medium | |
| CN109254922B (en) | Automatic testing method and device for BMC Redfish function of server | |
| CN108459951B (en) | Test method and device | |
| CN106168993B (en) | Real-time simulation analysis system for power grid | |
| CN106713011B (en) | Method and system for obtaining test data | |
| Liu | Research of performance test technology for big data applications | |
| CN102045397A (en) | Method and equipment for logining embedded terminals by using Telnet to debug embedded terminals | |
| CN111782452A (en) | Method, system, device and medium for interface contrast test | |
| CN103117878A (en) | Design method of Nagios-based distribution monitoring system | |
| CN111027197A (en) | Simulation analysis system and method for power equipment | |
| WO2021253239A1 (en) | Method and apparatus for determining resource configuration of cloud service system | |
| CN110868330B (en) | Evaluation method, device and evaluation system for CPU resources which can be divided by cloud platform | |
| CN110750453B (en) | HTML 5-based intelligent mobile terminal testing method, system, server and storage medium | |
| CN101969442B (en) | Process running environment perception and migration based network analog framework implementation method | |
| CN112416747A (en) | Test case execution method, device, equipment and medium | |
| CN106033211B (en) | A kind of method and device of control gluing board rubber head cleaning | |
| CN111124890B (en) | Distributed database performance test method, system, terminal and storage medium | |
| CN114171107A (en) | Detection method, device, equipment and storage medium for VPD information of solid state disk | |
| CN106899451B (en) | Method and device for testing MIB (management information base) |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |