CN106897181B - Vdbernh testing arrangement - Google Patents
Vdbernh testing arrangement Download PDFInfo
- Publication number
- CN106897181B CN106897181B CN201710117902.7A CN201710117902A CN106897181B CN 106897181 B CN106897181 B CN 106897181B CN 201710117902 A CN201710117902 A CN 201710117902A CN 106897181 B CN106897181 B CN 106897181B
- Authority
- CN
- China
- Prior art keywords
- test
- module
- testing
- machines
- scene
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000012360 testing method Methods 0.000 title claims abstract description 165
- 238000009434 installation Methods 0.000 claims abstract description 32
- 238000001514 detection method Methods 0.000 claims abstract description 25
- 238000011056 performance test Methods 0.000 claims abstract description 16
- 238000012544 monitoring process Methods 0.000 claims abstract description 15
- 238000013515 script Methods 0.000 claims abstract description 9
- 238000000034 method Methods 0.000 claims description 7
- 238000012986 modification Methods 0.000 claims description 4
- 230000004048 modification Effects 0.000 claims description 4
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000006835 compression Effects 0.000 description 1
- 238000007906 compression Methods 0.000 description 1
- 238000010276 construction Methods 0.000 description 1
- 238000011156 evaluation Methods 0.000 description 1
- 238000010998 test method Methods 0.000 description 1
- 238000012795 verification Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/22—Detection or location of defective computer hardware by testing during standby operation or during idle time, e.g. start-up testing
- G06F11/2205—Detection or location of defective computer hardware by testing during standby operation or during idle time, e.g. start-up testing using arrangements specific to the hardware being tested
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/22—Detection or location of defective computer hardware by testing during standby operation or during idle time, e.g. start-up testing
- G06F11/2268—Logging of test results
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/22—Detection or location of defective computer hardware by testing during standby operation or during idle time, e.g. start-up testing
- G06F11/2273—Test methods
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/22—Detection or location of defective computer hardware by testing during standby operation or during idle time, e.g. start-up testing
- G06F11/2289—Detection or location of defective computer hardware by testing during standby operation or during idle time, e.g. start-up testing by configuration test
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Computer Hardware Design (AREA)
- Quality & Reliability (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Debugging And Monitoring (AREA)
- Data Exchanges In Wide-Area Networks (AREA)
- Computer And Data Communications (AREA)
Abstract
The invention discloses a Vdbernh testing device, which comprises: a network configuration module: according to the definition of a user, IP addresses are distributed to all the testing machines, a network is configured, and SSH mutual trust among the testing machines is established; a scene pre-defining module: integrating storage performance test scenes, and generating a user-defined test scene configuration file by using the storage performance test scenes; disk detection and test tool installation module: completing the detection of the number and the state of the disks on all the testing machines and the installation of the testing tools; the test result monitoring and collecting module: and monitoring real-time performance test data, classifying and collecting Vdbenc test results, and drawing parameter change images. According to the invention, complex test script editing is not required, the test scene can be reused, and the test efficiency is improved; the test result is clear at a glance, and a large amount of time is not spent on extracting effective information from a large number of data; the test environment is automatic and convenient to deploy.
Description
Technical Field
The invention relates to a storage performance testing tool, in particular to a Vdbnch testing device.
Background
Vdbench is a command line utility introduced by ORACLE, which is intended to assist engineers and customers in generating disk I/O loads for verification of storage performance and storage data integrity, and is widely used in storage performance test evaluation. Vdbranc execution parameters are designated by inputting a text file, an html file record test result is generated after the execution of each command is finished, and the overall average value of the avg-item record in the last line of the file is recorded.
When the Vdbench is used for testing a plurality of disks and a plurality of scenes of a plurality of clients, firstly, a network needs to be configured for each testing machine, SSH mutual trust is established, and the Vdbench is installed; second, a large number of test scripts need to be written as execution parameter inputs. Most of the two tasks are repeated operations, and manual setting is not only too low in efficiency, but also prone to errors, and finally results in inaccurate test results. In addition, in the Vdbench executing process, real-time performance data cannot be effectively monitored, and the final output result html file has too large data volume, so that a great amount of time is required for a tester to extract and collect effective test data.
Disclosure of Invention
In order to solve the problems, the invention improves the Vdbench test tool and provides the Vdbench test device with reusable test scenes and high test efficiency.
The technical scheme of the invention is as follows: a Vdbench testing apparatus comprising:
a network configuration module: according to the definition of a user, IP addresses are distributed to all the testing machines, a network is configured, and SSH mutual trust among the testing machines is established;
a scene pre-defining module: integrating storage performance test scenes, and generating a user-defined test scene configuration file by using the storage performance test scenes;
disk detection and test tool installation module: completing the detection of the number and the state of the disks on all the testing machines and the installation of the testing tools;
the test result monitoring and collecting module: and monitoring real-time performance test data, classifying and collecting Vdbenc test results, and drawing parameter change images.
Further, the network configuration module further comprises: defining the IP address and the host name of each tester in a linux system/etc/hosts file, wherein one IP corresponds to one host name; the network configuration module determines the next available host name and IP address by checking the unused IP address in the network, and allocates the next available host name and IP address to the current tester; one of the testers is set as a main node, SSH mutual trust is not required to be opened, and the SSH mutual trust from the main node to other testers is opened on other testers.
Further, the storage performance test scenario integrated in the scenario predefining module includes: oracle, SQLserver, VDI, Fileserver, Exchange.
Further, a disk detection and test tool installation module is installed on the main node, the number of the testers and the number of the disks are input, the main node checks the current network of the testers and the states of the disks on the testers according to the number of the testers and the number of the disks, and the disk detection and test tool installation module on the main node is copied to each tester for installation.
Further, if the disk detection and test tool installation module is successfully installed, the corresponding test machine returns installation success information to the main node and generates a part of Vdbranc test script; if the disk detection and test tool is not installed successfully, the corresponding test machine returns the installation error information to the main node for modification, and the host node checks again until installation success information is returned.
Furthermore, the test result monitoring and collecting module classifies and arranges the collected Vdbench test results according to three indexes of IOPS, bandwidth and time delay, and draws a change curve graph of each index in the whole test process according to the collected real-time data.
Furthermore, the test result monitoring and collecting module counts the maximum value, the minimum value and the average value of each index according to the drawn change curve graph, generates a pdf document and stores the pdf document in a test result storage position appointed by a user.
The Vdbernh testing device provided by the invention has the beneficial effects that: (1) complex test script editing is not needed, test scenes can be multiplexed, and test efficiency is improved; when a traditional vbdbench test is carried out, a large number of test script files need to be edited, when a certain parameter changes, the content of the test script files also needs to be modified correspondingly, the workload is large, and errors are easy to occur; when the test is executed, a plurality of test parameters are required to be specified according to the test scene. According to the invention, frequently used scenes are packaged through the scene predefining module, and when a test instruction is executed, the setting of the test scene can be completed only by appointing one test scene parameter, and meanwhile, the repeated multiplexing of the test scene is realized. When a certain parameter changes, only one field in the workload.sh file needs to be modified, so that all test script files can be modified, and the test efficiency is greatly improved. (2) The test result is clear at a glance, and a large amount of time is not spent on extracting effective information from a large number of data; the traditional vdbench test result is output in the format of an html file, and the file records the real-time monitoring data and the final average value of each index in the test process in the form of numbers and characters. The amount of digital information is too large, so that it takes too much time to find the digital change rule and the maximum and minimum values. The invention arranges the test results, draws an index change curve chart, has clear change rule and maximum and minimum values, and does not need to spend a large amount of time to extract effective information from a plurality of data. (3) The test environment is automatically and conveniently deployed; in the past test, network configuration files need to be modified, SSH mutual trust needs to be configured, disk states need to be checked and the like on each test machine so as to complete the construction of a test environment, and when the number of the test machines is increased, the workload is multiplied. The invention can complete the configuration of the test machine network only by two steps, namely, the first step, executing one instruction, and the second step, executing another instruction, and completing the disk and state detection of the test machine.
Detailed Description
The present invention will be described in detail with reference to specific examples, which are illustrative of the present invention and are not to be construed as being limited thereto.
The Vdbnch testing device provided by the invention is improved on the basis of a Vdbnch testing tool, and the following modules are added:
a network configuration module: according to the definition of a user, IP addresses are distributed to all the testing machines, a network is configured, and SSH mutual trust among the testing machines is established;
a scene pre-defining module: integrating storage performance test scenes, and generating a user-defined test scene configuration file by using the storage performance test scenes;
disk detection and test tool installation module: completing the detection of the number and the state of the disks on all the testing machines and the installation of the testing tools;
the test result monitoring and collecting module: and monitoring real-time performance test data, classifying and collecting Vdbenc test results, and drawing parameter change images.
The network configuration module defines the IP address and the host name of each test machine in a linux system/etc/hosts file, and one IP corresponds to one host name; the module determines the next available host name and IP address by checking the unused IP address in the network, and allocates the next available host name and IP address to the current tester; one of the testing machines is set as a main node, SSH mutual trust does not need to be opened, and the SSH mutual trust from the main node to the local testing machine is opened on other testing machines, so that the testing machines can be uniformly managed on the main node. After configuration is completed, the host node can access each tester through a ssh host name instruction to determine that network configuration is successful.
The storage performance test scene integrated in the scene predefining module comprises the following steps: oracle, SQLserver, VDI, Fileserver, Exchange. By taking Oracle as an example, in the module, various parameters such as the compression ratio, the repetition ratio, the data block size, the read-write ratio, the sequence, the random ratio and the like of the test file in an Oracle scene are specified. When the test is operated, a user only needs to designate an oracle scene, the system can search the parameter setting under the oracle scene in the scene pre-defining module, and execute the corresponding test instruction according to the corresponding parameter. Besides the test scenes defined by the system, the user can add some frequently used custom scenes in the scene pre-defining module, and can modify some defined scenes according to the specific project requirements. The module provides a workflow.
And installing a disk detection and test tool installation module on the main node, inputting the number of the test machines and the number of disks, checking the states of the test machines in the current network and the disks on the test machines according to the number of the test machines and the number of the disks by the main node, and copying the disk detection and test tool installation module on the main node to each test machine for installation. If the disk detection and test tool installation module is successfully installed, the corresponding test machine returns the installation success information to the main node and generates part of the Vdbech test script; if the disk detection and the test tool are not installed successfully, the corresponding test machine returns the installation error information to the main node for modification, and the host node checks again until installation success information is returned, so that the disk detection and the test tool installation are completed.
The test result monitoring and collecting module classifies and arranges the collected Vdbench test results according to three indexes of IOPS, bandwidth and time delay, and draws a change curve graph of each index in the whole test process according to the collected real-time data. Meanwhile, the test result monitoring and collecting module counts the maximum value, the minimum value and the average value of each index according to the drawn change curve graph, generates a pdf document and stores the pdf document in a test result storage position appointed by a user. In addition, the test result file generated by the vdbech default is also saved to the storage position designated by the user, so that more detailed test data can be viewed in the future. Real-time test data output by Vdbench is stored in a test result directory in a txt file form, a ssh session window is opened again in the test process, and the real-time performance data can be checked through a tail-f/test result path/file name txt instruction.
The installation test method of the Vdbernh test device comprises the following steps:
step one, software installation and network configuration:
copying the tool pack of the invention to each test machine (linux system), decompressing, according to the network IP planning, modifying/etc/hosts file, operating network configuration module on the main node and each test machine in turn to complete the network configuration.
Step two, editing a test scene:
and viewing a scene predefining module, if a scene needing to be tested is contained, skipping the step, if the scene does not contain the scene, modifying the work load.
Step three, mounting and detecting a disk:
the method comprises the steps of distributing the same number and size of disks for each test machine on a tested storage device, mounting the disks on the test machines after distribution is completed, operating disk detection and tool installation modules, entering the next step after detection is successful, and modifying related configuration according to error prompts if detection is failed until detection is successful.
Step four, executing the test:
and inputting a test instruction, designating a test result storage path, a file name, a test scene, the size of a tested disk and the like, and starting to execute the test. Another SSH session is opened and real-time performance data is viewed via tail instructions.
Step five, checking and collecting test results:
and checking test result files including PDF files and html files in the path specified in the step four, and extracting corresponding data according to actual project requirements.
The above disclosure is only for the preferred embodiments of the present invention, but the present invention is not limited thereto, and any non-inventive changes that can be made by those skilled in the art and several modifications and amendments made without departing from the principle of the present invention shall fall within the protection scope of the present invention.
Claims (4)
1. A Vdbench test device, comprising:
a network configuration module: according to the definition of a user, IP addresses are distributed to all the testing machines, a network is configured, and SSH mutual trust among the testing machines is established;
a scene pre-defining module: integrating storage performance test scenes, and generating a user-defined test scene configuration file by using the storage performance test scenes;
disk detection and test tool installation module: completing the detection of the number and the state of the disks on all the testing machines and the installation of the testing tools;
the test result monitoring and collecting module: monitoring real-time performance test data, collecting Vdbench test results in a classified mode, and drawing a parameter change image;
the network configuration module further comprises: defining the IP address and the host name of each tester in a linux system/etc/hosts file, wherein one IP corresponds to one host name; the network configuration module determines the next available host name and IP address by checking the unused IP address in the network, and allocates the next available host name and IP address to the current tester; setting one of the test machines as a main node, and starting SSH mutual trust from the main node to other test machines on other test machines without starting the SSH mutual trust;
the storage performance test scene integrated in the scene predefining module comprises the following steps: oracle, SQLserver, VDI, Fileserver, Exchange;
and installing a disk detection and test tool installation module on the main node, inputting the number of the test machines and the number of disks, checking the states of the test machines in the current network and the disks on the test machines according to the number of the test machines and the number of the disks by the main node, and copying the disk detection and test tool installation module on the main node to each test machine for installation.
2. The Vdbench testing device according to claim 1, wherein if the disk testing and testing tool installation module is successfully installed, the corresponding testing machine returns installation success information to the master node and generates part of Vdbench testing scripts; if the disk detection and test tool is not installed successfully, the corresponding test machine returns the installation error information to the main node for modification, and the host node checks again until installation success information is returned.
3. The Vdbench test device of claim 1, wherein the test result monitoring and collecting module sorts and arranges the collected Vdbench test results according to three indexes of IOPS, bandwidth and time delay, and draws a change curve graph of each index in the whole test process according to the collected real-time data.
4. The Vdbench test device of claim 3, wherein the test result monitoring and collecting module is configured to count the maximum value, the minimum value and the average value of each index according to the plotted variation curve, generate a pdf document, and store the pdf document in a test result storage location specified by a user.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710117902.7A CN106897181B (en) | 2017-03-01 | 2017-03-01 | Vdbernh testing arrangement |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710117902.7A CN106897181B (en) | 2017-03-01 | 2017-03-01 | Vdbernh testing arrangement |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN106897181A CN106897181A (en) | 2017-06-27 |
| CN106897181B true CN106897181B (en) | 2020-03-20 |
Family
ID=59185365
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710117902.7A Active CN106897181B (en) | 2017-03-01 | 2017-03-01 | Vdbernh testing arrangement |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106897181B (en) |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108897651A (en) * | 2018-07-02 | 2018-11-27 | 郑州云海信息技术有限公司 | A kind of test method and its system of SAN storage equipment |
| CN112749069B (en) * | 2020-12-25 | 2023-03-21 | 河南创新科信息技术有限公司 | Method for detecting file stability by utilizing vbbech circular running and computer readable storage medium |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102063372A (en) * | 2010-12-30 | 2011-05-18 | 浪潮集团山东通用软件有限公司 | Main key driven modularized automated test method |
| CN104317726A (en) * | 2014-11-19 | 2015-01-28 | 浪潮电子信息产业股份有限公司 | Testing method for storage IO performance |
| CN104657276A (en) * | 2015-03-13 | 2015-05-27 | 浪潮集团有限公司 | Configuration iozone cluster testing method |
-
2017
- 2017-03-01 CN CN201710117902.7A patent/CN106897181B/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102063372A (en) * | 2010-12-30 | 2011-05-18 | 浪潮集团山东通用软件有限公司 | Main key driven modularized automated test method |
| CN104317726A (en) * | 2014-11-19 | 2015-01-28 | 浪潮电子信息产业股份有限公司 | Testing method for storage IO performance |
| CN104657276A (en) * | 2015-03-13 | 2015-05-27 | 浪潮集团有限公司 | Configuration iozone cluster testing method |
Non-Patent Citations (2)
| Title |
|---|
| Iozone集群测试;佚名;《http://blog.csdn.net/dong976209075/article/details/8224454》;20121126;第1页 * |
| 使用iozone测试磁盘性能;佚名;《http://www.cnblogs.com/jrun/archive/2012/09/29/2708778.html》;20120929;第1-5页 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN106897181A (en) | 2017-06-27 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US9785532B2 (en) | Performance regression manager for large scale systems | |
| CN111756575B (en) | Performance analysis method and device of storage server and electronic equipment | |
| US20140282400A1 (en) | Systems and methods for managing software development environments | |
| US20060041539A1 (en) | Method and apparatus for organizing, visualizing and using measured or modeled system statistics | |
| CN108038013A (en) | Distributed performance test method and device and computer-readable recording medium | |
| CN110798373A (en) | Method for realizing performance test, test server and computer storage medium | |
| CN110008129B (en) | Reliability test method, device and equipment for storage timing snapshot | |
| CN112115058A (en) | Test method and device, test case generation method and device and test system | |
| CN111767258A (en) | File compression method, device, equipment and storage medium applied to mass files | |
| CN112328363B (en) | Cloud hard disk mounting method and device | |
| CN106897181B (en) | Vdbernh testing arrangement | |
| CN110855458A (en) | Configuration command generation method and equipment | |
| CN110795304B (en) | Method and device for testing performance of distributed storage system | |
| CN106354587A (en) | Mirror image server and method for exporting mirror image files of virtual machine | |
| CN109063040A (en) | Client-side program collecting method and system | |
| US10884873B2 (en) | Method and apparatus for recovery of file system using metadata and data cluster | |
| CN110147313A (en) | A kind of log-output method and device | |
| CN115987821A (en) | Gateway routing test method and device | |
| CN115098322A (en) | Method, device, equipment and medium for automatically generating IO test model | |
| CN115168124A (en) | Stability test method and device for concurrently executing multiple files on hard disk, computer equipment and medium | |
| JP2007133632A (en) | Method and program for setting security policy | |
| CN114398283A (en) | Automatic testing method and device for user interface, electronic equipment and storage medium | |
| CN113282505A (en) | Software test progress analysis method, device, equipment and storage medium | |
| CN113742145A (en) | Method, system, equipment and storage medium for testing performance of solid state disk | |
| CN113342632A (en) | Simulation data automatic processing method and device, electronic equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |