CN109522181B - Performance test method, device and equipment of distributed storage system - Google Patents
Performance test method, device and equipment of distributed storage system Download PDFInfo
- Publication number
- CN109522181B CN109522181B CN201811231254.9A CN201811231254A CN109522181B CN 109522181 B CN109522181 B CN 109522181B CN 201811231254 A CN201811231254 A CN 201811231254A CN 109522181 B CN109522181 B CN 109522181B
- Authority
- CN
- China
- Prior art keywords
- test
- tested
- performance
- distributed storage
- storage system
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 29
- 238000011056 performance test Methods 0.000 title claims description 24
- 238000012360 testing method Methods 0.000 claims abstract description 302
- 230000002159 abnormal effect Effects 0.000 claims description 10
- 238000002360 preparation method Methods 0.000 claims description 7
- 230000008569 process Effects 0.000 description 4
- 238000010586 diagram Methods 0.000 description 3
- 238000010998 test method Methods 0.000 description 3
- 238000012935 Averaging Methods 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 238000012423 maintenance Methods 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000012545 processing Methods 0.000 description 2
- 239000003086 colorant Substances 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 238000013508 migration Methods 0.000 description 1
- 230000005012 migration Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000002688 persistence Effects 0.000 description 1
- 230000000750 progressive effect Effects 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- 230000033764 rhythmic process Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/30—Monitoring
- G06F11/3003—Monitoring arrangements specially adapted to the computing system or computing system component being monitored
- G06F11/3034—Monitoring arrangements specially adapted to the computing system or computing system component being monitored where the computing system component is a storage system, e.g. DASD based or network based
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/30—Monitoring
- G06F11/34—Recording or statistical evaluation of computer activity, e.g. of down time, of input/output operation ; Recording or statistical evaluation of user activity, e.g. usability assessment
- G06F11/3409—Recording or statistical evaluation of computer activity, e.g. of down time, of input/output operation ; Recording or statistical evaluation of user activity, e.g. usability assessment for performance assessment
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/30—Monitoring
- G06F11/34—Recording or statistical evaluation of computer activity, e.g. of down time, of input/output operation ; Recording or statistical evaluation of user activity, e.g. usability assessment
- G06F11/3466—Performance evaluation by tracing or monitoring
- G06F11/3476—Data logging
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Quality & Reliability (AREA)
- General Physics & Mathematics (AREA)
- Computer Hardware Design (AREA)
- Computing Systems (AREA)
- Mathematical Physics (AREA)
- Techniques For Improving Reliability Of Storages (AREA)
- Debugging And Monitoring (AREA)
Abstract
The embodiment of the invention discloses a performance testing method, a device and equipment of a distributed storage system, wherein a testing configuration file of the distributed storage system is read, and the testing configuration file comprises relevant information of nodes to be tested of the distributed storage system and performance indexes to be tested; then, connecting to the node to be tested according to the related information of the node to be tested; and then, testing the nodes to be tested based on the performance indexes to be tested, obtaining the current performance indexes of the nodes to be tested, and generating a test report according to the current performance indexes. Therefore, the automatic test equipment encapsulating each test flow is utilized to carry out targeted test on the distributed storage system by reading the test configuration file without manual intervention or manual writing of a test program, and the method is suitable for quickly, comprehensively and accurately testing various to-be-tested performance indexes of various distributed storage systems, so that the distributed storage system can be ensured to reliably and accurately provide high-quality service for users.
Description
Technical Field
The present invention relates to the field of test technologies, and in particular, to a method, an apparatus, and a device for testing performance of a distributed storage system.
Background
With the advent of the information age, a large amount of data is generated every moment, and data to be stored and processed also rises exponentially, so that the distributed storage system with low cost, high performance, expandability and easiness in use needs to be constructed. In order to ensure that the distributed storage system can realize data and state information persistence and maintain data consistency in automatic migration, automatic fault tolerance and concurrent reading and writing processes, the functions and performance of the distributed storage system need to be fully tested to ensure the reliability and availability of the distributed storage system, so that higher-quality services are provided for users.
At present, a manual test mode can be adopted for testing a distributed storage system, so that on one hand, the manual test is difficult to cover all code paths of the distributed storage system due to the complex code paths of the distributed storage system; in addition, because the tested fault items (such as time sequence, deadlock, resource conflict and multithreading) are more, the comprehensive test of each fault is difficult to realize; on the other hand, the distributed storage system is suitable for a plurality of application occasions, so that the manual test is difficult to simulate and test the system performance in various application occasions; moreover, when the data volume is increased sharply, the manual testing speed is slow, and in the current fast-paced work and life, the safety of the distributed storage system is difficult to ensure through short-time testing.
However, the automatic test script is not universal, and if another performance needs to be tested or another type of distributed system needs to be tested, an automatic test script for testing needs to be rewritten or the existing automatic test script is modified, so that the test method is not manual, the test efficiency can be improved, but the test method is difficult to expand, needs frequent maintenance, and is complex in operation of debugging and testing processes, time-consuming and labor-consuming. Therefore, it is desirable to provide a testing method capable of testing various distributed storage systems quickly, comprehensively and accurately.
Disclosure of Invention
The technical problem to be solved by the present invention is to provide a method, an apparatus and a device for testing performance of a distributed storage system, so that no matter how many complex distributed storage systems are faced with performance indexes to be tested, the performance indexes to be tested of the distributed storage system can be tested quickly, comprehensively and accurately, thereby ensuring that the distributed storage system can reliably and accurately provide high quality service for users.
In a first aspect, a performance testing method of a distributed storage system is provided, including:
reading a test configuration file of a distributed storage system, wherein the test configuration file comprises relevant information of nodes to be tested of the distributed storage system and performance indexes to be tested;
connecting to the nodes to be tested according to the related information of the nodes to be tested;
and testing the nodes to be tested based on the performance indexes to be tested, obtaining the current performance indexes of the nodes to be tested, and generating a test report according to the current performance indexes.
Optionally, the method further comprises:
configuring a test flow by using the nodes to be tested and the corresponding performance indexes to be tested, and calling a test interface to obtain a test preparation condition;
the testing the nodes to be tested based on the performance indexes to be tested specifically comprises:
and under the accurate test condition, automatically testing the nodes to be tested based on the performance indexes to be tested.
Optionally, the generating a test report according to the current performance index includes:
acquiring related performance indexes in the system logs of the nodes to be tested;
and generating a test report according to the current performance index and the related performance index in the system log.
Optionally, after the generating a test report according to the current performance index, the method further includes:
comparing the performance index in the test report with a reference range corresponding to the performance index;
and if the performance index is not in the reference range, generating alarm information for indicating that the performance index of the distributed storage system is abnormal.
In a second aspect, a performance testing apparatus for a distributed storage system is further provided, including:
the reading unit is used for reading a test configuration file of the distributed storage system, wherein the test configuration file comprises relevant information of nodes to be tested of the distributed storage system and performance indexes to be tested;
the connecting unit is used for connecting to the nodes to be tested according to the related information of the nodes to be tested;
and the testing unit is used for testing the nodes to be tested based on the performance indexes to be tested, obtaining the current performance indexes of the nodes to be tested, and generating a test report according to the current performance indexes.
Optionally, the apparatus further comprises:
the configuration and calling unit is used for configuring a test flow by using the nodes to be tested and the corresponding performance indexes to be tested, and calling a test interface to obtain a test preparation condition;
the test unit is specifically configured to:
and after the execution of the configuration and calling unit is finished, automatically testing the nodes to be tested based on the performance indexes to be tested.
Optionally, the test unit includes:
the acquisition subunit is used for acquiring the relevant performance indexes in the system logs of the nodes to be tested;
and the generating subunit is used for generating a test report according to the current performance index and the related performance index in the system log.
Optionally, the apparatus further comprises:
the comparison unit is used for comparing the performance index in the test report with a reference range corresponding to the performance index after the execution of the test unit is completed;
and the warning unit is used for generating warning information if the performance index is not in the reference range, and the warning information is used for indicating that the performance index of the distributed storage system is abnormal.
In a third aspect, a performance testing apparatus for a distributed storage system is further provided, including: a configuration file loading module and an automatic testing module;
the configuration file loading module is used for generating a configuration file corresponding to the test requirement according to the test requirement of the distributed storage system and sending the configuration file to the automatic test module;
the automatic test module is configured to execute the performance test method of the distributed storage system according to the first aspect, obtain a current performance index, and output a first test report.
Optionally, the apparatus further comprises: a log analysis module;
and the log analysis module is used for outputting a second test report according to the current performance index obtained by the automatic test module and the related performance index in the system log.
In the embodiment of the invention, a test configuration file of the distributed storage system can be read, wherein the test configuration file comprises relevant information of nodes to be tested of the distributed storage system and performance indexes to be tested; then, connecting to the node to be tested according to the related information of the node to be tested; and then, testing the nodes to be tested based on the performance indexes to be tested, obtaining the current performance indexes of the nodes to be tested, and generating a test report according to the current performance indexes. Therefore, the automatic test equipment encapsulating each test flow can be used for performing targeted test on the distributed storage system by reading the test configuration file without manual intervention or manually writing a test program, and the method can be suitable for quickly, comprehensively and accurately testing various to-be-tested performance indexes of various distributed storage systems, so that the distributed storage system can be ensured to reliably and accurately provide high-quality service for users.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings needed to be used in the description of the embodiments are briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments described in the present invention, and it is obvious for those skilled in the art to obtain other drawings according to these drawings.
FIG. 1 is a block diagram of a network system according to an embodiment of the present invention;
fig. 2 is a schematic flowchart illustrating a performance testing method of a distributed storage system according to an embodiment of the present invention;
fig. 3 is a schematic flowchart of another performance testing method for a distributed storage system according to an embodiment of the present invention;
fig. 4 is a schematic structural diagram of a performance testing apparatus of a distributed storage system according to an embodiment of the present invention;
fig. 5 is a schematic structural diagram of a performance testing apparatus of a distributed storage system according to an embodiment of the present invention.
Detailed Description
The inventor finds that if the performance of the distributed storage system is tested, two methods, namely manual testing and targeted compiling of an automatic test script, can be adopted at present, but the manual testing is not only low in testing efficiency and difficult to meet the requirement of corresponding testing speed under the current fast rhythm, but also the complex distributed storage system and the performance index of the distributed system which is more biased are difficult to obtain through the manual testing, so that the comprehensiveness of the testing of the distributed storage system is limited; and writing an automatic test script cannot test various distributed storage systems, and only a certain distributed storage system can be tested in a targeted manner, i.e., the test method is not universal, and is complex in early writing, later debugging and maintenance operations and high in cost.
However, in the present, a large amount of data is generated in each field, especially in a cloud computing data center, and therefore, a fast and accurate test needs to be performed on a distributed storage system storing the data to ensure that the distributed storage system can be confirmed to be fault-free and put into use quickly. Therefore, the two testing methods for the distributed storage system are difficult to meet the requirements of testers, and a method capable of quickly and fully testing the performance of the distributed storage system is needed to ensure the reliability and the availability of the distributed storage system, so that the requirement of a user on higher-quality service is met.
Based on this, in the embodiment of the present invention, reusable automatic test equipment encapsulating each test flow is used, and the test configuration file is read to perform a targeted test on the distributed storage system, so that a test program does not need to be manually intervened or manually written, and the method can be applied to a rapid, comprehensive and accurate test of various to-be-tested performance indexes of various distributed storage systems, thereby ensuring that the distributed storage system can reliably and accurately provide a high-quality service for a user.
For example, one of the scenarios of the embodiment of the present invention may be applied to the scenario shown in fig. 1. The scene comprises the following steps: a client 100 and a performance testing apparatus 200 of a distributed storage system, wherein the performance testing apparatus 200 of the distributed storage system includes: a configuration file loading module 210 and an automatic test module 220. It can be understood that the configuration file loading module 210 may automatically generate a test configuration file according to configuration information generated by a configuration operation of a tester on the client 100, where the tester on the client 100 may perform a corresponding configuration operation according to a test requirement of the distributed storage system; alternatively, the configuration file loading module 210 may receive the configuration file generated according to the configuration information directly from the client 100. The configuration file loading module 210 sends the obtained configuration file to the automatic test module 220.
It is understood that the automatic test module 220 may be specifically packaged with a plurality of test flow sub-modules, and each test flow sub-module may be written in the C + + language to implement a test on one or more performance indexes. Specifically, the test flow sub-module can be operated by calling the interface of each test flow sub-module, so as to test the performance index corresponding to the test flow sub-module; and the testing of the performance indexes of the distributed storage system can be completed among the testing process sub-modules through calling the interfaces.
As an example, assuming that a tester wants to test the performance index a and the performance index B of the node 1, the node 2, and the node 3, respectively, the corresponding configuration information may be input on the client 100, and the configuration file loading module 210 generates a test configuration file according to the configuration information, where the test configuration file carries (node 1- (performance index a, performance index B); node 2- (performance index a, performance index B); node 3- (performance index a, performance index B)). Then, when a new test configuration file is generated, the automatic test module 220 may read the test configuration file, and connect to the node to be tested according to the relevant information of the node to be tested, such as the IP address and the port number of the node to be tested; then, the automatic testing module 220 may test the node to be tested based on the performance index to be tested, and obtain the current performance index of the node to be tested, for example: the performance index A test result a1 and the performance index B test result B1 of the node 1, and a test report is generated according to the current performance index, wherein the test report comprises: (node 1- (a1, b 1); node 2- (a2, b 2); node 3- (a3, b 3)).
It will be appreciated that while the distributed storage system is undergoing other processing, other relevant performance indicators may be generated and recorded in the system log for subsequent use. Therefore, the performance test apparatus 200 of the distributed storage system may further include a log analysis module 230; the log analysis module 230 is configured to output another test report according to the current performance index obtained by the automatic test module and the related performance index in the system log. Therefore, the performance of the distributed storage system can be more comprehensively reflected by the generated test report by combining the relevant performance indexes in the system log and the current performance indexes obtained by testing, and the method is suitable for being used in high-requirement test occasions.
It is to be understood that the above scenario is only one scenario example provided by the embodiment of the present invention, and the embodiment of the present invention is not limited to this scenario.
The following describes in detail a specific implementation manner of a method, an apparatus, and a device for testing performance of a distributed storage system according to an embodiment of the present invention, with reference to the accompanying drawings.
Fig. 2 is a schematic flowchart of a performance testing method of a distributed storage system according to an embodiment of the present invention. Referring to fig. 2, the method may specifically include:
It can be understood that the test configuration file may reflect the test requirements of the tester on the distributed storage system, including the nodes to be tested and the performance index to be tested of each node to be tested. The test configuration file may be a conf file, an init file, or an xml file, and a suitable file type may be selected as the test configuration file according to the development environment and the design requirement, for example: in order to make the test configuration file universal, an xml file may be selected as the test configuration file.
As an example, the test configuration file may be generated by a performance testing device of the distributed storage system, and specifically may be: the method comprises the steps that a tester carries out corresponding configuration operation on a client according to test requirements, configuration information corresponding to the determined configuration operation is sent to performance test equipment of the distributed storage system, and the performance test equipment of the distributed storage system can generate a corresponding test configuration file according to the received configuration information.
As another example, the test configuration file may be generated and sent to the performance testing apparatus of the distributed storage system on another terminal, for example, a client operated by a tester, and the performance test of the distributed storage system receives the test configuration file itself.
During specific implementation, the performance test equipment of the distributed storage system may read the test configuration file, and obtain the relevant information of the nodes to be tested and the performance index to be tested of the distributed storage system, which are included in the test configuration file. The relevant information of the node to be tested can be specifically an IP address, a port number and the like of the node to be tested, and the IP address can be a physical IP address and/or a virtual IP address; the performance indicators to be tested may include at least one indicator that may characterize the performance of the node, such as: 1GB 4 bytes of data, the time required for one-time reading and writing, the reading and writing times per second of the block storage device and the like, if the performance indexes to be tested comprise a plurality of indexes, the indexes can be embodied in a test configuration file in a list form.
And step 202, connecting to the node to be tested according to the relevant information of the node to be tested.
It can be understood that, through reading the configuration file to be tested, the relevant information of the node to be tested can be analyzed from the configuration file to be tested, and according to this, the performance testing device of the distributed storage system needs to be connected to the node to be tested before testing.
As an example, if it can be known from the relevant information of the nodes to be tested that there are a specified target node and other nodes to be tested in all nodes to be tested, step 202 may specifically include: firstly, searching a specified target node according to the related information of each node to be tested; then, according to address information (such as an IP address) in the related information of the target node, connecting the performance test equipment of the distributed storage system to the target node based on the address information; and then, the target node is sequentially connected to other nodes to be tested to complete the connection of all the nodes to be tested.
As another example, if it can be known from the relevant information of the nodes to be tested that all nodes to be tested are of one level and there is no designated target node, step 202 may specifically include: firstly, address information (such as IP address) of each node to be tested is respectively searched from the related information of each node to be tested; and then, respectively connecting the performance test equipment of the distributed storage system to each node to be tested based on the corresponding address information to complete the connection of all the nodes to be tested.
It is understood that, in step 202, the performance testing device of the distributed storage system is connected to the node to be tested according to the relevant information of the node to be tested, so as to provide a testing basis for automatic testing.
It should be noted that, after the connection with each node to be tested is completed in step 202, before the test operation in step 203 is performed, in order that the performance test device of the distributed storage system can accurately implement the test, the performance test device of the distributed storage system is not affected by the previous configuration items in the performance test device of the distributed storage system, and the initialization operation may also be performed on the performance test device of the distributed storage system, specifically: and configuring a test flow by using the nodes to be tested and the corresponding performance indexes to be tested, and calling a test interface to obtain test preparation conditions. Namely, configuring the test flows required to be used in the test configuration file into the performance test equipment of the distributed storage system, and shielding other test flows; starting interfaces for testing the nodes to be tested and the performance indexes to be tested, calling the interfaces, and setting the interfaces which are not used in the test to be closed or to be in a non-calling state; the accurate test condition is the current state of the performance test equipment of the distributed storage system after the test flow is configured and the test interface is called. Therefore, the test can be promoted according to the test requirements of the testers.
It is understood that the test report may be a file generated according to a format preset by the tester, for example: txt files or doc files. Considering the content of the test report, in one case, the test report may be a file obtained by summarizing and sorting the current performance index, and in another case, the test report may also be a file obtained by analyzing and summarizing the current performance index.
As an example, if the initialization operation of the performance testing apparatus of the distributed storage system is performed between step 202 and step 203, step 203 may specifically be: and under the accurate test condition, automatically testing the nodes to be tested based on the performance indexes to be tested.
For example: assuming that the test configuration file comprises a node 1 and a node 2 to be tested, the node 1 tests a performance index A and a performance index B of the node 1, and the node 2 tests a performance index B and a performance index C of the node 2, then the performance test equipment of the distributed storage system can test the connected node 1 by using a test flow X corresponding to the call performance index A to obtain a test result a; similarly, the performance test equipment of the distributed storage system can test the connected node 1 and node 2 respectively by using the test flow Y corresponding to the calling performance index B to obtain test results B1 and B2 respectively; the performance test equipment of the distributed storage system can test the connected node 2 by the test flow Z corresponding to the calling performance index C to obtain a test result C; thus, the current performance indexes obtained by the node 1 are a and b1, and the current performance indexes obtained by the node 2 are b2 and c; then, the test report that can be obtained according to the current performance index may be: node 1 (A: a, B: B1) node 2 (B: B2, C: C).
In addition, in other implementation manners, when a test report is generated, if it is desired to obtain more performance indexes or load more performance indexes into the test report, the embodiment of the present invention may further complete the test report according to the current test result obtained by the test and other related performance indexes of the distributed storage system recorded in the system log.
In a specific implementation, the generating test may specifically include:
s1, testing the node to be tested based on the performance index to be tested, and obtaining the current performance index of the node to be tested;
s2, acquiring the relevant performance index in the system log of the node to be tested;
and S3, generating a test report according to the current performance index and the related performance index in the system log.
The related performance index in the system log may specifically refer to index data generated when the distributed storage system operates, and may represent the performance of the distributed storage system to a certain extent. It should be noted that the current performance index obtained by the test may also be recorded in the system log, and the information recorded in the system log is relatively comprehensive and reliable.
In a specific implementation, the performance testing apparatus of the distributed storage system may include a log analysis module, as an example, the log analysis module is configured to, after obtaining the current performance index, analyze whether there are other related performance indexes that can assist in explaining the performance of the distributed storage system in the system log, and if there are other related performance indexes, may also list the other related performance indexes into the generated test report, or perform preset processing (e.g., averaging) on the other related performance indexes and the current performance index to obtain a new performance index, so as to support the test report with as much data as possible.
As another example, the log analysis module may also be configured to, after obtaining the current performance index, in response to the obtaining operation of the tester, obtain a specified related performance index from the system log and list the specified related performance index into the generated test report, or perform a preset process (e.g., averaging) on the specified related performance index and the current performance index to obtain a new performance index, so as to support the test report with as much data as possible.
In addition, after the test report is generated, in order to enable a tester to intuitively and quickly know the performance of the distributed storage system, the judgment is not required to be performed in a manner of looking up a table or querying a manual, in step 203, after the test report is generated according to the current performance index, as shown in fig. 3, the following steps are performed:
For example, if the current performance index of the performance index a in the test report is a (a > 0), but the reference range is 0 to b (b > 0), the performance testing device of the distributed storage system may compare whether a is between 0 and b, and if 0 < a < b, the testing result of the performance index is normal; if b is less than a, the performance index is abnormal, and then alarm information can be directly generated for visually prompting the abnormal performance index and the abnormal performance index of the distributed storage system for a tester. For example, the performance index a of the tester may be prompted to be abnormal by striking characters (e.g., special fonts, special colors, etc.) at the start position of the test report, so that the tester does not need to look over the detailed test report in an emergency, and can also know the current state of the distributed storage system, thereby saving the time of the tester and optimizing the test report.
Therefore, in the embodiment of the present invention, a test configuration file of the distributed storage system may be read, where the test configuration file includes related information of nodes to be tested of the distributed storage system and performance indexes to be tested; then, connecting to the node to be tested according to the related information of the node to be tested; and then, testing the nodes to be tested based on the performance indexes to be tested, obtaining the current performance indexes of the nodes to be tested, and generating a test report according to the current performance indexes. Therefore, the automatic test equipment encapsulating each test flow can be used for performing targeted test on the distributed storage system by reading the test configuration file without manual intervention or manually writing a test program, and the method can be suitable for quickly, comprehensively and accurately testing various to-be-tested performance indexes of various distributed storage systems, so that the distributed storage system can be ensured to reliably and accurately provide high-quality service for users.
Correspondingly, an embodiment of the present invention further provides a performance testing apparatus for a distributed storage system, as shown in fig. 4, the apparatus may specifically include:
a reading unit 401, configured to read a test configuration file of a distributed storage system, where the test configuration file includes relevant information of a node to be tested of the distributed storage system and a performance index to be tested;
a connection unit 402, configured to connect to the node to be tested according to the relevant information of the node to be tested;
the testing unit 403 is configured to test the node to be tested based on the performance index to be tested, obtain a current performance index of the node to be tested, and generate a test report according to the current performance index.
Optionally, the apparatus further comprises:
the configuration and calling unit is used for configuring a test flow by using the nodes to be tested and the corresponding performance indexes to be tested, and calling a test interface to obtain a test preparation condition;
the test unit 403 is specifically configured to:
and after the execution of the configuration and calling unit is finished, automatically testing the nodes to be tested based on the performance indexes to be tested.
Optionally, the test unit 403 includes:
the acquisition subunit is used for acquiring the relevant performance indexes in the system logs of the nodes to be tested;
and the generating subunit is used for generating a test report according to the current performance index and the related performance index in the system log.
Optionally, the apparatus further comprises:
a comparing unit, configured to compare the performance index in the test report with a reference range corresponding to the performance index after the execution of the testing unit 403 is completed;
and the warning unit is used for generating warning information if the performance index is not in the reference range, and the warning information is used for indicating that the performance index of the distributed storage system is abnormal.
The above description is related to a performance testing apparatus of a distributed storage system, wherein specific implementation manners and achieved effects may refer to the description of the embodiment of the performance testing method of the distributed storage system shown in fig. 2, and are not described herein again.
In addition, an embodiment of the present invention further provides a performance testing device of a distributed storage system, as shown in fig. 5, the device may specifically include: a configuration file loading module 501 and an automatic testing module 502;
the configuration file loading module 501 is configured to generate a configuration file corresponding to a test requirement according to the test requirement of the distributed storage system, and send the configuration file to the automatic test module 502;
the automatic test module 502 is configured to execute the performance test method of the distributed storage system, obtain a current performance index, and output a first test report.
Optionally, the apparatus further comprises: a log analysis module 503;
the log analysis module 503 is configured to output a second test report according to the current performance index obtained by the automatic test module 502 and the related performance index in the system log.
The above description is related to a performance testing device of a distributed storage system, wherein specific implementation manners and achieved effects may refer to the description of the performance testing method embodiment of the distributed storage system shown in fig. 2, and are not described herein again.
As can be seen from the above description of the embodiments, those skilled in the art can clearly understand that all or part of the steps in the above embodiment methods can be implemented by software plus a general hardware platform. With this understanding, the technical solution of the present invention can be embodied in the form of a software product, which can be stored in a storage medium, such as a read-only memory (ROM)/RAM, a magnetic disk, an optical disk, etc., and includes several instructions for enabling a computer device (which may be a personal computer, a server, or a network communication device such as a router, etc.) to execute the method according to the embodiments or some parts of the embodiments of the present invention.
The embodiments in the present specification are described in a progressive manner, and the same and similar parts among the embodiments are referred to each other, and each embodiment focuses on the differences from the other embodiments. In particular, for the apparatus and device embodiments, since they are substantially similar to the method embodiments, they are described relatively simply, and reference may be made to some of the descriptions of the method embodiments for related points. The above-described embodiments of the apparatus and device are merely illustrative, and the modules described as separate parts may or may not be physically separate, and the parts displayed as modules may or may not be physical modules, may be located in one place, or may be distributed on a plurality of network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of the present embodiment. One of ordinary skill in the art can understand and implement it without inventive effort.
The above description is only for the preferred embodiment of the present invention and is not intended to limit the scope of the present invention. It should be noted that, for a person skilled in the art, several modifications and refinements can be made without departing from the invention, and these modifications and refinements should be regarded as the protection scope of the present invention.
Claims (8)
1. A performance testing method of a distributed storage system is characterized by comprising the following steps:
reading a test configuration file of a distributed storage system, wherein the test configuration file comprises relevant information of nodes to be tested of the distributed storage system and performance indexes to be tested;
connecting to the nodes to be tested according to the related information of the nodes to be tested;
testing the nodes to be tested based on the performance indexes to be tested, obtaining the current performance indexes of the nodes to be tested, and generating a test report according to the current performance indexes;
configuring a test flow by using the nodes to be tested and the corresponding performance indexes to be tested, and calling a test interface to obtain a test preparation condition;
the testing the nodes to be tested based on the performance indexes to be tested specifically comprises:
under the accurate test condition, automatically testing the nodes to be tested based on the performance indexes to be tested;
the obtaining test preparation conditions include:
and starting the interfaces for testing the nodes to be tested and the performance indexes to be tested, calling the interfaces, and setting the interfaces which are not used in the test to be closed or to be in a non-calling state, wherein the test accuracy condition is the current state of the performance test equipment of the distributed storage system after configuring the test flow and calling the test interfaces.
2. The method of claim 1, wherein generating a test report based on the current performance metric comprises:
acquiring related performance indexes in the system logs of the nodes to be tested;
and generating a test report according to the current performance index and the related performance index in the system log.
3. The method of claim 1 or 2, further comprising, after said generating a test report according to the current performance indicator:
comparing the performance index in the test report with a reference range corresponding to the performance index;
and if the performance index is not in the reference range, generating alarm information for indicating that the performance index of the distributed storage system is abnormal.
4. A performance testing apparatus for a distributed storage system, comprising:
the reading unit is used for reading a test configuration file of the distributed storage system, wherein the test configuration file comprises relevant information of nodes to be tested of the distributed storage system and performance indexes to be tested;
the connecting unit is used for connecting to the nodes to be tested according to the related information of the nodes to be tested;
the testing unit is used for testing the nodes to be tested based on the performance indexes to be tested, obtaining the current performance indexes of the nodes to be tested and generating a testing report according to the current performance indexes;
the configuration and calling unit is used for configuring a test flow by using the nodes to be tested and the corresponding performance indexes to be tested, and calling a test interface to obtain a test preparation condition;
the test unit is specifically configured to:
after the configuration and calling unit completes execution, automatically testing the nodes to be tested based on the performance indexes to be tested;
the configuration and call unit is specifically configured to:
and starting the interfaces for testing the nodes to be tested and the performance indexes to be tested, calling the interfaces, and setting the interfaces which are not used in the test to be closed or to be in a non-calling state, wherein the test accuracy condition is the current state of the performance test equipment of the distributed storage system after configuring the test flow and calling the test interfaces.
5. The apparatus of claim 4, wherein the test unit comprises:
the acquisition subunit is used for acquiring the relevant performance indexes in the system logs of the nodes to be tested;
and the generating subunit is used for generating a test report according to the current performance index and the related performance index in the system log.
6. The apparatus of claim 4 or 5, further comprising:
the comparison unit is used for comparing the performance index in the test report with a reference range corresponding to the performance index after the execution of the test unit is completed;
and the warning unit is used for generating warning information if the performance index is not in the reference range, and the warning information is used for indicating that the performance index of the distributed storage system is abnormal.
7. A performance test apparatus of a distributed storage system, comprising: a configuration file loading module and an automatic testing module;
the configuration file loading module is used for generating a configuration file corresponding to the test requirement according to the test requirement of the distributed storage system and sending the configuration file to the automatic test module;
the automatic test module is used for executing the performance test method of the distributed storage system according to claims 1 to 3, obtaining the current performance index, and outputting a first test report.
8. The apparatus of claim 7, further comprising: a log analysis module;
and the log analysis module is used for outputting a second test report according to the current performance index obtained by the automatic test module and the related performance index in the system log.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811231254.9A CN109522181B (en) | 2018-10-22 | 2018-10-22 | Performance test method, device and equipment of distributed storage system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811231254.9A CN109522181B (en) | 2018-10-22 | 2018-10-22 | Performance test method, device and equipment of distributed storage system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN109522181A CN109522181A (en) | 2019-03-26 |
| CN109522181B true CN109522181B (en) | 2021-11-09 |
Family
ID=65772929
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201811231254.9A Active CN109522181B (en) | 2018-10-22 | 2018-10-22 | Performance test method, device and equipment of distributed storage system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109522181B (en) |
Families Citing this family (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111209188A (en) * | 2019-12-26 | 2020-05-29 | 曙光信息产业股份有限公司 | Testing method and device for distributed storage system |
| CN111309604B (en) * | 2020-02-07 | 2023-10-03 | Tcl移动通信科技（宁波）有限公司 | Offline automatic test method, system, storage medium and mobile terminal |
| CN112115029A (en) * | 2020-09-28 | 2020-12-22 | 中国银行股份有限公司 | Performance test method and device, computer equipment and computer readable storage medium |
| CN117130901A (en) * | 2023-02-24 | 2023-11-28 | 荣耀终端有限公司 | Dimension measuring method and electronic equipment |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103326902A (en) * | 2013-06-28 | 2013-09-25 | 广东电网公司电力科学研究院 | Configurable monitoring system and monitoring method for distributed type mainframe performance testing data |
| CN106569943A (en) * | 2015-10-09 | 2017-04-19 | 北京北方微电子基地设备工艺研究中心有限责任公司 | Hardware testing method and hardware testing system for equipment |
| WO2017092544A1 (en) * | 2016-07-15 | 2017-06-08 | 上海华岭集成电路技术股份有限公司 | Configuration and testing method and system for fpga chip using bumping process |
| CN107302475A (en) * | 2017-07-06 | 2017-10-27 | 郑州云海信息技术有限公司 | The method of testing and device of a kind of Based on Distributed storage cluster |
| CN107368426A (en) * | 2017-08-28 | 2017-11-21 | 郑州云海信息技术有限公司 | A kind of method of testing and test device |
-
2018
- 2018-10-22 CN CN201811231254.9A patent/CN109522181B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103326902A (en) * | 2013-06-28 | 2013-09-25 | 广东电网公司电力科学研究院 | Configurable monitoring system and monitoring method for distributed type mainframe performance testing data |
| CN106569943A (en) * | 2015-10-09 | 2017-04-19 | 北京北方微电子基地设备工艺研究中心有限责任公司 | Hardware testing method and hardware testing system for equipment |
| WO2017092544A1 (en) * | 2016-07-15 | 2017-06-08 | 上海华岭集成电路技术股份有限公司 | Configuration and testing method and system for fpga chip using bumping process |
| CN107302475A (en) * | 2017-07-06 | 2017-10-27 | 郑州云海信息技术有限公司 | The method of testing and device of a kind of Based on Distributed storage cluster |
| CN107368426A (en) * | 2017-08-28 | 2017-11-21 | 郑州云海信息技术有限公司 | A kind of method of testing and test device |
Also Published As
| Publication number | Publication date |
|---|---|
| CN109522181A (en) | 2019-03-26 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109522181B (en) | Performance test method, device and equipment of distributed storage system | |
| CN107436844B (en) | Method and device for generating interface use case aggregate | |
| CN105787364B (en) | Automatic testing method, device and system for tasks | |
| CN108459850B (en) | Method, device and system for generating test script | |
| CN110569194A (en) | interface testing method and device, electronic equipment and storage medium | |
| CN109977012B (en) | Joint debugging test method, device, equipment and computer readable storage medium of system | |
| WO2016188101A1 (en) | Service system test method and device | |
| CN111694735B (en) | Page performance testing method and device, electronic equipment and storage medium | |
| CN112148599A (en) | Performance pressure measurement method, device and equipment | |
| KR101794016B1 (en) | Method of analyzing application objects based on distributed computing, method of providing item executable by computer, server performing the same and storage media storing the same | |
| CN112685079A (en) | Method and equipment for automatically analyzing test range based on code difference comparison | |
| CN115276844B (en) | Communication module testing method and device, storage medium and electronic equipment | |
| CN116662197A (en) | Automatic interface testing method, system, computer and readable storage medium | |
| CN110968517A (en) | Automatic test method, device, platform and computer readable storage medium | |
| CN115757165A (en) | Automatic testing method, device, equipment and storage medium | |
| CN114141302A (en) | Test method of solid state disk and electronic equipment | |
| CN110737549A (en) | Application testing method, device, server and system | |
| CN110795338B (en) | Front-end and back-end interaction-based automatic testing method and device and electronic equipment | |
| CN111400117B (en) | Method for automatically testing Ceph cluster | |
| CN111881021A (en) | Interface test method, device and system | |
| CN117632620B (en) | Management method and device for software radio equipment test | |
| CN109673017B (en) | RRU automatic testing method and device | |
| CN114816956A (en) | Interface performance test method and device | |
| CN114201388A (en) | Python function-based dynamic baffle testing method and related device | |
| CN114090357A (en) | Hard disk performance test method and device, electronic equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |