CN105515898A - Test method and system aiming at network storage system performance - Google Patents

Abstract

The invention discloses a method and system for testing the performance of a network storage system, comprising: the initiator server continuously initiates a first data reading request to the target server at intervals of a predetermined time, and accepts that the target server opens according to the data reading request. The feedback parameters returned after corresponding target files, and put the feedback parameters into the monitoring queue; the initiator server scans the feedback parameters in the monitoring queue in turn, and judges whether the opening time interval of the target file corresponding to the feedback parameters exceeds the first predetermined time value; if not, then judge whether the target file corresponding to the feedback parameter is readable according to the feedback parameter; if readable, then read the data of the target file, it can be seen that in the present embodiment, initiate the Request, so that the amount of requests initiated by the originating server can easily exceed the maximum load of the target server, so that it is closer to the actual access situation and realizes accurate testing of network storage.

Description

A test method and system for network storage system performance

technical field

The invention relates to the field of computer software, more specifically, to a testing method and system for network storage system performance.

Background technique

Use traditional test tools to test the network storage system, and the test tools can initiate different requests to the server. These request types are close to the actual access conditions to a certain extent, but because they are not designed for network storage systems, the test results are not accurate enough when using these tools for testing. For example, IOMeter is mainly used to test traditional disks, and it is also a widely used test tool in network storage, but it does not consider the impact of the network on I/O in the network storage system. In the actual access environment, the amount of access may exceed the maximum load that the server can bear, and IOMeter does not take this into account. When the amount of requests is close to the maximum load of the server, due to the influence of the network, the initiator server is suppressed by the server, and it is difficult to generate requests exceeding the maximum load of the server. This test result deviates from the actual access situation.

Therefore, how to test network storage more accurately is a problem that needs to be solved now.

Contents of the invention

The purpose of the present invention is to provide a method and system for testing the performance of a network storage system, so as to test the network storage more accurately.

In order to achieve the above object, the embodiment of the present invention provides the following technical solutions:

A test method for network storage system performance, comprising:

The initiator server continuously initiates the first data read request to the target server at intervals of predetermined time, accepts the feedback parameter returned by the target server after opening the corresponding target file according to the data read request, and puts the feedback parameter in to the listening queue;

The initiator server sequentially scans the feedback parameters in the monitoring queue, and judges whether the opening time interval of the target file corresponding to the feedback parameters exceeds the first predetermined time value;

If it does not exceed the first predetermined time value, it is judged according to the feedback parameter whether the target file corresponding to the feedback parameter is readable; if it is readable, the data of the target file is read.

Preferably, if the opening time interval of the target file corresponding to the feedback parameter exceeds the first predetermined time value, the initiator server resends a second data read request to the target server; wherein, the The second data reading request is a data reading request for obtaining target files whose open time interval exceeds a predetermined time value.

Preferably, before the initiator server sequentially scans the feedback parameters in the listening queue, it further includes:

Judging whether there is a feedback parameter sent by the target server in the listening queue;

If there is a feedback parameter sent by the target server in the listening queue, the step of sequentially scanning the feedback parameters in the listening queue by the initiator server is performed.

Preferably, after reading the data of the target file, it includes:

Closing the target file, and clearing the feedback parameters corresponding to the target file from the listening queue.

Preferably, if it is judged according to the feedback parameter that the target file corresponding to the feedback parameter is unreadable, it is judged whether the connection time of the feedback parameter exceeds a second predetermined time value;

If yes, close the target file, and clear the feedback parameter corresponding to the target file from the listening queue.

A test system for network storage system performance, including:

Initiating server and target server;

Wherein, the initiator server includes:

A data request module, configured to continuously initiate a first data read request to the target server at predetermined time intervals;

The receiving module is used to accept the feedback parameter returned by the target server after opening the corresponding target file according to the data reading request, and put the feedback parameter into the listening queue;

The first judging module is used to sequentially scan the feedback parameters in the listening queue, and judge whether the opening time interval of the target file corresponding to the feedback parameter exceeds the first predetermined time value; if it does not exceed the first predetermined time value, Then trigger the second judging module;

The second judging module is configured to judge whether the target file corresponding to the feedback parameter is readable according to the feedback parameter; if readable, trigger the reading module to read the data of the target file.

Preferably, if the first judgment module judges that the opening time interval of the target file corresponding to the feedback parameter exceeds the first predetermined time value, the data request module is triggered;

The data request module is further configured to resend a second data read request to the target server; wherein, the second data read request is a data read request for obtaining a target file whose opening time interval exceeds a predetermined time value .

Preferably, the initiator server also includes:

A third judging module, configured to judge whether there is a feedback parameter sent by the target server in the listening queue; if there is a feedback parameter sent by the target server in the listening queue, trigger the first judging module .

Preferably, the initiator server also includes:

An execution module, configured to close the target file, and clear the feedback parameter corresponding to the target file from the listening queue.

Preferably, if the second judging module judges that the target file corresponding to the feedback parameter is unreadable, trigger the fourth judging module;

The fourth judging module is used to judge whether the connection time of the feedback parameter exceeds a second predetermined time value; if so, trigger the executing module.

It can be seen from the above solutions that the embodiment of the present invention provides a method and system for testing the performance of a network storage system, including: the initiator server continuously initiates a first data read request to the target server at intervals of a predetermined time, and accepts the The target server opens the feedback parameter returned after the corresponding target file according to the data read request, and puts the feedback parameter into the monitoring queue; Whether the opening time interval of the corresponding target file exceeds the first predetermined time value; if it does not exceed the first predetermined time value, then judge whether the target file corresponding to the feedback parameter is readable according to the feedback parameter; if readable, read the data of the target file.

It can be seen that the test method provided by this embodiment can initiate a request to the target at a predetermined time interval, so that the pace of the initiator server initiating the request is no longer restricted by the target server, and it is only responsible for initiating the request, thereby reducing the time required for initiating the request. The time interval makes it easier for the amount of requests initiated by the initiator server to exceed the maximum load of the target server, which is closer to the actual access situation and realizes accurate testing of network storage.

Description of drawings

In order to more clearly illustrate the technical solutions in the embodiments of the present invention or the prior art, the following will briefly introduce the drawings that need to be used in the description of the embodiments or the prior art. Obviously, the accompanying drawings in the following description are only These are some embodiments of the present invention. Those skilled in the art can also obtain other drawings based on these drawings without creative work.

FIG. 1 is a schematic flowchart of a test method for performance of a network storage system disclosed in an embodiment of the present invention;

FIG. 2 is a schematic flowchart of another test method for network storage system performance disclosed by an embodiment of the present invention;

FIG. 3 is a schematic structural diagram of a test system for network storage system performance disclosed by an embodiment of the present invention.

detailed description

The following will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only some, not all, embodiments of the present invention. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without creative efforts fall within the protection scope of the present invention.

The embodiment of the invention discloses a method and system for testing the performance of a network storage system, so as to test the network storage more accurately.

Referring to Fig. 1, a kind of test method for the performance of network storage system provided by the embodiment of the present invention includes:

S101. The initiator server continuously initiates a first data read request to the target server at intervals of a predetermined time;

Specifically, in this embodiment, the initiating server cyclically initiates requests to the target server at intervals of a predetermined time, that is, at a fixed frequency, regardless of whether the server can receive new requests. In this way, the pace of initiating requests is no longer restrained by the server, that is, the initiating server is only responsible for initiating requests, thereby reducing the time interval for initiating requests, and continuously increasing the speed of initiating requests until it exceeds the maximum acceptable load of the server. The speed at which requests can be initiated can put the system under test into a livelock state.

Among them, the method of generating load in traditional testing tools is mainly to use multiple concurrent threads to initiate read and write requests to the server. The tasks completed by each thread are: initiate a request, establish a connection, read data, and close the connection. All steps are performed sequentially, and another request is initiated immediately after the completion of these steps. The length of the queue for receiving requests on the target side depends on the speed of the request initiated by the initiator and the round-trip time of the request. That is, if the speed of the request initiated by the initiator exceeds the processing speed of the storage system for receiving queue requests, more and more requests will be stranded in the queue. , until the queue can no longer store any newly received requests, the target end will discard all newly received requests without returning any confirmation information to the initiator. The retransmission time of the initiator's request will continue to increase, and the initiator process will fall into the next cycle. The waiting time will become longer and longer, and the request information will be retransmitted at a lower and lower speed. Based on this, the traditional test tool request production method can only make the load close to the maximum load of the server, but it is difficult to exceed it.

That is, the key to the difficulty of excessive load in the traditional test is to let the initiator get rid of the inhibition of the TCP retransmission mechanism. To the confirmation information of the TCP three-way handshake, the time interval is measured by the number of CPU hops, which can make the time accuracy very high. When the time interval is small enough, the amount of requests can easily reach the maximum load on the server.

S102. The initiator server accepts the feedback parameter returned by the target server after opening the corresponding target file according to the data read request, and puts the feedback parameter into the listening queue;

Wherein, before the initiator server sequentially scans the feedback parameters in the listening queue, it also includes:

Judging whether there is a feedback parameter sent by the target server in the listening queue;

If there is a feedback parameter sent by the target server in the listening queue, the step of sequentially scanning the feedback parameters in the listening queue by the initiator server is performed.

Specifically, in this embodiment, before the initiating server scans the listening queue, it may first be determined whether the request sent by the initiating server reaches the target server, that is, whether the initiating server establishes a connection with the target server. Because when the initiator server establishes a connection with the target server, the target server will send feedback parameters to the initiator server. Therefore, whether to execute S102 is determined by detecting whether there is a feedback parameter sent by the target server in the listening queue. Among them, the select method of the system can be used to monitor whether the request is completed.

S103. The initiator server sequentially scans the feedback parameters in the listening queue, and judges whether the opening time interval of the target file corresponding to the feedback parameters exceeds a first predetermined time value;

Wherein, if the opening time interval of the target file corresponding to the feedback parameter exceeds the first predetermined time value, the initiator server resends a second data read request to the target server; wherein, the first The second data reading request is a data reading request for obtaining target files whose open time interval exceeds a predetermined time value.

Specifically, in this embodiment, when the request sent by the initiator server is large, the target server may not be able to process the request in time, so when the initiator server sends a request to the target end to open the target file, the time is greater than the first predetermined time When the value is set, the originating server will resend the request to the target server.

S104. If the first predetermined time value is not exceeded, judge whether the target file corresponding to the feedback parameter is readable according to the feedback parameter; if readable, read data of the target file.

Wherein, after reading the data of the target file, it includes:

Closing the target file, and clearing the feedback parameters corresponding to the target file from the listening queue.

Specifically, in this implementation, in order to repeatedly read the target file corresponding to the feedback parameter, after each target file is read, the feedback parameter corresponding to the target file whose data has been read will be cleared in the listening queue. Wherein, in this embodiment, the FD_ISSET method can be used to confirm whether the target file corresponding to the feedback parameter is readable, if readable, read from the file, if unreadable, judge whether the request has timed out, and close the connection if found timed out.

Wherein, if it is judged according to the feedback parameter that the target file corresponding to the feedback parameter is unreadable, it is judged whether the connection time of the feedback parameter exceeds a second predetermined time value;

If yes, close the target file, and clear the feedback parameter corresponding to the target file from the listening queue.

Specifically, since the feedback parameter will return different values during connection, when the connection time of the feedback parameter exceeds the second predetermined time value, the target file is closed. If the connection time of the feedback parameter does not exceed the second predetermined time value, Then re-initiate the connection request.

For the convenience of understanding, this embodiment provides a complete test method for network storage system performance, see Figure 2 for details, including:

S201, call the open () function to designate the target file to be opened, and return the file descriptor;

Specifically, the file descriptor here is the feedback parameter in this embodiment.

S202. Call FD_SET to add the file descriptor to the listening queue;

S203, call select () to monitor whether there is an available device;

Wherein, steps S203-S210 are the main loop of this embodiment, where the number of cycles of the main loop can be set, and steps S203-S210 are cyclically executed according to the number of cycles.

If not, then execute S204, prompt an error and end the program; if so, execute S205, judge whether the opening time of the target file exceeds the first predetermined time value;

Wherein, S205-S209 is the inner loop of this embodiment;

If the opening time of the target file exceeds the first predetermined time value, then re-execute S201; if the opening time of the target file does not exceed the first predetermined time value, then execute S206, judge whether the target file is readable according to the file descriptor;

If the target file is unreadable, execute S207; if the target file is readable, execute S208;

S207. Determine whether the time of the file descriptor connection request exceeds the second predetermined time value; if yes, execute S209; if not, execute S201 again;

S208. Read the data of the target file;

S209. Close the target file, and clear the file descriptor corresponding to the target file from the monitoring queue;

S210. Determine whether the inner loop ends; if yes, execute S211; if not, continue to execute S205;

S211. Determine whether the main loop ends; if yes, end the program; if not, continue to execute S203.

Wherein, the criterion for judging whether the main loop ends is whether the number of loops of the main loop reaches a predetermined number of loops. If reached, the main loop ends; if not, the main loop continues to be executed.

A test method for the performance of a network storage system provided by an embodiment of the present invention includes: the initiator server continuously initiates a first data read request to the target server at intervals of a predetermined time, and accepts the target server according to the data read request. After requesting to open the corresponding target file, return the feedback parameter, and put the feedback parameter into the monitoring queue; the initiator server scans the feedback parameters in the monitoring queue in turn, and judges the opening of the target file corresponding to the feedback parameter. Whether the time interval exceeds the first predetermined time value; if it does not exceed the first predetermined time value, then judge whether the target file corresponding to the feedback parameter is readable according to the feedback parameter; if readable, then read the Describe the data of the target file.

It can be seen that the test method provided by this embodiment can initiate a request to the target at a predetermined time interval, so that the pace of the initiator server initiating the request is no longer restricted by the target server, and it is only responsible for initiating the request, thereby reducing the time required for initiating the request. The time interval makes it easier for the amount of requests initiated by the initiator server to exceed the maximum load of the target server, which is closer to the actual access situation and realizes accurate testing of network storage.

The following is an introduction to a test system for the performance of a network storage system provided by an embodiment of the present invention. A test system for the performance of a network storage system described below and a test method for the performance of a network storage system described above can be used for each other. refer to.

Referring to Fig. 3, a test system for network storage system performance provided by an embodiment of the present invention includes:

Initiating server 100 and target server 200;

Wherein, the originating server 100 includes:

A data request module 110, configured to continuously initiate a first data read request to the target server at predetermined time intervals;

The receiving module 120 is used to accept the feedback parameter returned by the target server after opening the corresponding target file according to the data reading request, and put the feedback parameter into the listening queue;

The first judging module 130 is used to sequentially scan the feedback parameters in the listening queue, and judge whether the opening time interval of the target file corresponding to the feedback parameter exceeds the first predetermined time value; if it does not exceed the first predetermined time value , trigger the second judging module;

The second judging module 140 is configured to judge whether the target file corresponding to the feedback parameter is readable according to the feedback parameter; if it is readable, trigger the reading module to read the data of the target file.

Preferably, if the first judgment module judges that the opening time interval of the target file corresponding to the feedback parameter exceeds the first predetermined time value, the data request module is triggered;

The data request module is further configured to resend a second data read request to the target server; wherein, the second data read request is a data read request for obtaining a target file whose opening time interval exceeds a predetermined time value .

Preferably, the initiator server also includes:

A third judging module, configured to judge whether there is a feedback parameter sent by the target server in the listening queue; if there is a feedback parameter sent by the target server in the listening queue, trigger the first judging module .

Preferably, the initiator server also includes:

An execution module, configured to close the target file, and clear the feedback parameter corresponding to the target file from the listening queue.

Preferably, if the second judging module judges that the target file corresponding to the feedback parameter is unreadable, trigger the fourth judging module;

The fourth judging module is used to judge whether the connection time of the feedback parameter exceeds a second predetermined time value; if so, trigger the executing module.

Each embodiment in this specification is described in a progressive manner, each embodiment focuses on the difference from other embodiments, and the same and similar parts of each embodiment can be referred to each other.

The above description of the disclosed embodiments is provided to enable any person skilled in the art to make or use the invention. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the general principles defined herein may be implemented in other embodiments without departing from the spirit or scope of the invention. Therefore, the present invention will not be limited to the embodiments shown herein, but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.

Claims (10)

1. A test method for network storage system performance, characterized in that, comprising: The initiator server continuously initiates the first data read request to the target server at intervals of predetermined time, accepts the feedback parameter returned by the target server after opening the corresponding target file according to the data read request, and puts the feedback parameter in to the listening queue; The initiator server sequentially scans the feedback parameters in the monitoring queue, and judges whether the opening time interval of the target file corresponding to the feedback parameters exceeds the first predetermined time value; If it does not exceed the first predetermined time value, it is judged according to the feedback parameter whether the target file corresponding to the feedback parameter is readable; if it is readable, the data of the target file is read. 2. The test method according to claim 1, wherein, if the opening time interval of the target file corresponding to the feedback parameter exceeds the first predetermined time value, the initiator server sends the target file to the target again. The server sends a second data read request; wherein, the second data read request is a data read request for acquiring a target file whose open time interval exceeds a predetermined time value. 3. The test method according to claim 2, wherein, before the initiator server sequentially scans the feedback parameters in the listening queue, it also includes: judging whether there is a feedback parameter sent by the target server in the listening queue; If there is a feedback parameter sent by the target server in the listening queue, the step of sequentially scanning the feedback parameters in the listening queue by the initiator server is executed. 4. The test method according to any one of claims 1-3, characterized in that, after reading the data of the target file, it includes: Closing the target file, and clearing the feedback parameters corresponding to the target file from the listening queue. 5. The test method according to claim 4, wherein if it is judged according to the feedback parameter that the target file corresponding to the feedback parameter is unreadable, then it is judged whether the connection time of the feedback parameter exceeds the second predetermined time. time value; If yes, close the target file, and clear the feedback parameter corresponding to the target file from the listening queue. 6. A test system for network storage system performance, characterized in that, comprising: Initiating server and target server; Wherein, the initiator server includes: A data request module, configured to continuously initiate a first data read request to the target server at predetermined time intervals; The receiving module is used to accept the feedback parameter returned by the target server after opening the corresponding target file according to the data reading request, and put the feedback parameter into the listening queue; The first judging module is used to sequentially scan the feedback parameters in the listening queue, and judge whether the opening time interval of the target file corresponding to the feedback parameter exceeds the first predetermined time value; if it does not exceed the first predetermined time value, Then trigger the second judging module; The second judging module is configured to judge whether the target file corresponding to the feedback parameter is readable according to the feedback parameter; if readable, trigger the reading module to read the data of the target file. 7. The test system according to claim 6, wherein if the first judging module judges that the opening time interval of the target file corresponding to the feedback parameter exceeds the first predetermined time value, then trigger the data request module; The data request module is further configured to resend a second data read request to the target server; wherein, the second data read request is a data read request for obtaining a target file whose opening time interval exceeds a predetermined time value . 8. The test system according to claim 7, wherein the initiator server further comprises: A third judging module, configured to judge whether there is a feedback parameter sent by the target server in the listening queue; if there is a feedback parameter sent by the target server in the listening queue, trigger the first judging module . 9. The test system according to any one of claims 5-8, wherein the initiator server further comprises: An execution module, configured to close the target file, and clear the feedback parameter corresponding to the target file from the listening queue. 10. The test system according to claim 9, wherein if the second judging module judges that the target file corresponding to the feedback parameter is unreadable, a fourth judging module is triggered; The fourth judging module is used to judge whether the connection time of the feedback parameter exceeds a second predetermined time value; if so, trigger the executing module.