CN101090345A - Performance test method for network storage system - Google Patents
Performance test method for network storage system Download PDFInfo
- Publication number
- CN101090345A CN101090345A CN 200710072543 CN200710072543A CN101090345A CN 101090345 A CN101090345 A CN 101090345A CN 200710072543 CN200710072543 CN 200710072543 CN 200710072543 A CN200710072543 A CN 200710072543A CN 101090345 A CN101090345 A CN 101090345A
- Authority
- CN
- China
- Prior art keywords
- descriptor
- request
- overtime
- readable
- filec
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Landscapes
- Computer And Data Communications (AREA)
- Data Exchanges In Wide-Area Networks (AREA)
Abstract
This invention puts forward a performance test method for a network storage system, which first of all opens a file mapping onto the local disc server and feeds back a file descriptor, then connects the descriptor to a connection tank to monitor it in circulation to read data if there is one or close the descriptor if it' s not readable and exceeds the time, judges if the time interval initiating IO request is over during the circulation, if so, it opens the file to operate and transfers the open file descriptor to the connection tank.
Description
(1) technical field
The present invention relates to network storage field, be specifically related to storage area network (Storage AreaNetwork-SAN) field in the Network storage technology.
(2) background technology
The increase of development of internet technology and company information amount makes data access and storage present explosive growth.Need accurately network store system to be carried out performance evaluation.Network store system can make the memory device on the use telecommunication network of user transparent, be that its occupation mode is consistent with the use local disk, so traditional disk performance testing tool such as IOMeter, IOZone etc. are still available, but because they do not consider Network Transmission to the IO Effect on Performance, so its test result is accurate inadequately.For example: IOMeter is difficult to produce the maximum load that can bear above server, this is because the retransmission mechanism in procotol realizes and the inhibition of livelock, thereby the performance of quantification storage system under overload situations that can not be correct, also there is similar problem in other storage testing tool IOZone etc.
(3) summary of the invention
The object of the present invention is to provide and a kind ofly send IO request to system under test (SUT) according to fixed rate, can produce request at lower cost, thereby provide the performance test methods of the network store system of the performance specification of network store system under the overburden situation above the storage system maximum load.
The object of the present invention is achieved like this:
1.1, originating end sends IO request according to set rate to the network store system of being surveyed, and promptly opens file on the server that is mapped to local disk, backspace file descriptor by set rate;
1.2, this document descriptor connected passes to connection pool;
1.3, whether the filec descriptor monitored in the connection pool of circulation readable;
If 1.4 readable, then reading of data is closed this document descriptor then and remove it in connection pool;
If 1.5 not readable, whether the request of then judging filec descriptor connects overtime, if overtime, close file descriptor and in connection pool, remove it then;
1.6, whether time interval of judge initiating the IO request overtime, if overtime, then carry out open file operation, and the filec descriptor of opening passed to connection pool.
The same read operation of the process of write operation.
The present invention also has some technical characterictics like this:
The time interval that cycle-index, filec descriptor request connect hours should be set earlier before 1, described circulation is monitored and initiate the IO request enters major cycle then, the step below carrying out:
1.1, call setting program filec descriptor in the connection pool joined the monitoring formation;
1.2, call option program and select to judge monitor formation whether ready filec descriptor is arranged;
1.3 if option program returns mistake, EP (end of program);
If 1.4 there is filec descriptor to be ready to, step below then circulation is carried out;
1.5 if the time interval of initiation IO request is overtime, then carry out open file operation, the filec descriptor of opening is joined the monitoring formation;
1.6, choose a filec descriptor of monitoring in the formation, judge whether this document descriptor readable;
If 1.7 readable, then reading of data is closed this document descriptor, and from monitor formation, remove this document descriptor;
If 1.8 not readable, judge then whether this document descriptor connection request is overtime;
If 1.9 overtime, then close this document descriptor, from monitor formation, remove this document descriptor;
If, forward step 1.5 to, carry out next circulation 1.10 also have the not filec descriptor of scanning;
If 1.11 major cycle finishes termination routine then, otherwise turn to step 1.2.
Key of the present invention is that originating end sends IO request according to given pace to the network store system of being surveyed, can be at lower cost or the performance characteristics the during overload of less client test network storage system.And use other testing tools will reach this purpose, and need a large amount of parallel load generators, cost dearly or infeasible.Compare with the traditional measurement instrument, the present invention is real simulated actual loading situation more, thereby can more effective performance of storage system be measured and improve, and reflects the performance characteristics of network store system more accurately.
The generation method of storage system overload access request has overcome the effectively shortcoming of analog storage system overload request of traditional test instrument among the present invention; This method can be with given pace, be not subjected to server end restriction, circulation to initiate request to server end, surpasses the disposal ability of server up to request amount.
The method that traditional testing tool generates load mainly is to use a plurality of concurrent threads to initiate read-write requests to server, and the task that each thread is finished is followed successively by: initiate to ask, connect, reading of data, close connection.Institute all is that order is carried out in steps, can initiate the another one request at once after these steps are finished.At the target of storage system end a formation that receives request is arranged, the length of this formation depends on that initiator initiates the speed of request and the two-way time of request.If initiating the speed of request, the initiator end surpasses storage system to receiving processing of request speed in the formation, the request of queue-stuck can get more and more, again can not store any request of new reception up to formation, this time, the target end can be lost all requests of up-to-date acceptance, and the initiator end was not returned any confirmation.According to the adaptive algorithm of the retransmission mechanism of TCP, the re-transmission time of initiator end request can constantly increase, and the initiation process then can be absorbed in a circulation, and the stand-by period is more and more longer, can be with more and more lower speed repeat requests information.Based on this point, traditional test instrument request generation method can only make load approach the server maximum load, but is difficult to surpass it.
The present invention has overcome this defective, makes server end under the situation near queue full, and its inhibitory action no longer works to originating end.The present invention asks generation module to improve initiator, and key point is to initiate request continuously with certain speed, after initiating to ask, connection is passed to connection pool; By circulation follow-up is handled subsequently, called to monitor by select and FD_ISSET and be connected confirmation, and the information of the affirmation that server is returned is handled and reading of data from ready filec descriptor.
Use IOMeter and new method to initiate request to being stored system respectively, the contrast test result as can be seen, the realistic visit situation of request curve that the present invention measures is along with the increase of the speed of request, curve rises, and descends rapidly after reaching the server maximum load.And the test result curve of IOMeter is along with the increase of queue depth, and curve just maintained in the horizontal extent after a period of time of rising, and did not meet the actual access situation.
(4) description of drawings
Fig. 1 is the flow chart of overload request generation method;
Fig. 2 is the schematic diagram of experiment porch of the present invention.
(5) embodiment
The present invention is further illustrated below in conjunction with the drawings and specific embodiments:
With iSCSI is example: the configuration of new method experiment porch is as follows: in conjunction with Fig. 2, a PC is installed the client of initiator part as storage system, just originating end; An other end is installed the server end of target part as storage system, just destination end; Two machines all use PCI-Express, and the middle gigabit switch that uses links to each other.Move the request of our new method simulation overload at originating end, and draw server performance parameter under the overload situations.
The key of the method for excess load generation difficulty is to allow originating end break away from the inhibition of TCP retransmission mechanism above solving.The inventive method is initiated the part of request and is constantly initiated request to server at interval with certain hour, and no matter whether can receive the affirmation information of TCP three-way handshake.The time interval measures with the timestamp of CPU, can make the precision of time very high.Enough hour of the time interval request amount of reading file when circulation can reach the maximum load that server can bear.The specific implementation process is as follows, in conjunction with Fig. 1:
1. call open () function and specify the file that to open, backspace file descriptor;
2. call FD_SET filec descriptor is joined the monitoring formation;
In the time interval that 3. cycle-index, filec descriptor request connect hours is set and initiates the IO request, the step below circulation is carried out is called major cycle;
4. call select () monitoring ready filec descriptor arranged?
If 5. select () returns mistake, EP (end of program);
If 6. there is filec descriptor to be ready to, step below then circulation is carried out will be monitored the interior All Files descriptor scanning of formation one time;
If it is overtime 7. to initiate the time interval of IO request, then carry out open file operation, the filec descriptor of opening is joined the monitoring formation;
8. call FD_ISSET and judge whether filec descriptor readable?
If 9. readable, then reading of data is closed this document descriptor, and removes this document descriptor from monitor formation;
Do you if 10. not readable, judge then whether this document descriptor connects overtime?
If is overtime, then closes this document descriptor, and from monitor formation, remove this document descriptor;
If also has the not filec descriptor of scanning, forward to 7., carry out next circulation;
If the major cycle finishes, termination routine then, otherwise turn to 4..
As described above, it is independent that new method will be initiated the part of request, initiates request with given pace, suppressed by server end, and this is the key point that is different from the conventional load production method.If the time interval of initiation IO request is suitable, server load is reached capacity rapidly, if originating end continues to initiate request, system can be absorbed in the livelock state, then being used for handling the resource that receives formation can be fewer and feweri, in this case, all serviced device end of request that originating end is initiated is lost, and the readable request of originating end also can descend rapidly.
Claims (2)
1, a kind of performance test methods of network store system is characterized in that originating end sends the IO request according to set rate to the network store system of being surveyed, and specifically comprises following components:
1.1 originating end is opened the file on the server that is mapped to local disk, backspace file descriptor by set rate;
1.2 connection pool is passed in the connection of this document descriptor;
1.3 whether the filec descriptor that circulation is monitored in the connection pool is readable;
If 1.4 readable, reading of data then;
If 1.5 not readable, whether the request of then judging filec descriptor connects overtime, if overtime, close file descriptor and in connection pool, remove it then;
1.6 judge whether the time interval of initiating the IO request is overtime, if overtime, then carries out open file operation, and the filec descriptor of opening is passed to connection pool;
The same read operation of the process of write operation.
2, the performance test methods of network store system according to claim 1, it is characterized in that the described time interval that before circulation is monitored, cycle-index, filec descriptor request connect hours should be set earlier and initiate the IO request, enter major cycle then, the step below carrying out:
2.1 call setting program filec descriptor in the connection pool is joined the monitoring formation;
Select to judge whether monitor formation has ready filec descriptor 2.2 call option program;
2.3 if option program returns mistake, EP (end of program);
If 2.4 there is filec descriptor to be ready to, step below then circulation is carried out;
2.5 if the time interval of initiation IO request is overtime, then carry out open file operation, the filec descriptor of opening is joined the monitoring formation;
2.6 choose a filec descriptor in the connection pool in order, judge whether it is readable;
If 2.7 readable, then reading of data is closed this document descriptor, and from monitor formation, remove this document descriptor;
If 2.8 not readable, judge then whether this document descriptor connection request is overtime;
If 2.9 overtime, then close this document descriptor, from monitor formation, remove this document descriptor;
If, forward step 2.5 to, carry out next circulation 2.10 also have the not filec descriptor of scanning;
If 2.11 major cycle finishes termination routine then, otherwise turn to step 2.2.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CNB2007100725434A CN100542108C (en) | 2007-07-20 | 2007-07-20 | The performance test methods of network store system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CNB2007100725434A CN100542108C (en) | 2007-07-20 | 2007-07-20 | The performance test methods of network store system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN101090345A true CN101090345A (en) | 2007-12-19 |
| CN100542108C CN100542108C (en) | 2009-09-16 |
Family
ID=38943522
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CNB2007100725434A Expired - Fee Related CN100542108C (en) | 2007-07-20 | 2007-07-20 | The performance test methods of network store system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN100542108C (en) |
Cited By (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102185741A (en) * | 2011-06-10 | 2011-09-14 | 浙江大学 | Method for estimating needs of transaction in processor in multi-tier architecture |
| CN102184746A (en) * | 2010-12-31 | 2011-09-14 | 中国传媒大学 | Storage performance testing system and method based on particle swarm optimization parameter |
| CN104462148A (en) * | 2013-09-24 | 2015-03-25 | 浙江大华技术股份有限公司 | Data storage management method and device |
| CN105337786A (en) * | 2014-07-23 | 2016-02-17 | 华为技术有限公司 | Server performance detection method, apparatus and equipment |
| CN105515898A (en) * | 2015-12-03 | 2016-04-20 | 浪潮(北京)电子信息产业有限公司 | Test method and system aiming at network storage system performance |
| CN106055441A (en) * | 2016-05-31 | 2016-10-26 | 深圳市国鑫恒宇科技有限公司 | Internet access performance testing method and system of servers under linux system |
| CN107977296A (en) * | 2017-11-20 | 2018-05-01 | 郑州云海信息技术有限公司 | A kind of method, apparatus and medium of NAS storage system performance test |
| CN111427507A (en) * | 2019-01-09 | 2020-07-17 | 深圳市茁壮网络股份有限公司 | Disk connection method and device and electronic equipment |
-
2007
- 2007-07-20 CN CNB2007100725434A patent/CN100542108C/en not_active Expired - Fee Related
Cited By (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102184746A (en) * | 2010-12-31 | 2011-09-14 | 中国传媒大学 | Storage performance testing system and method based on particle swarm optimization parameter |
| CN102185741A (en) * | 2011-06-10 | 2011-09-14 | 浙江大学 | Method for estimating needs of transaction in processor in multi-tier architecture |
| CN102185741B (en) * | 2011-06-10 | 2013-06-26 | 浙江大学 | Method for estimating needs of transaction in processor in multi-tier architecture |
| CN104462148A (en) * | 2013-09-24 | 2015-03-25 | 浙江大华技术股份有限公司 | Data storage management method and device |
| CN104462148B (en) * | 2013-09-24 | 2018-02-16 | 浙江大华技术股份有限公司 | A kind of data storage and management method and device |
| CN105337786A (en) * | 2014-07-23 | 2016-02-17 | 华为技术有限公司 | Server performance detection method, apparatus and equipment |
| CN105515898A (en) * | 2015-12-03 | 2016-04-20 | 浪潮(北京)电子信息产业有限公司 | Test method and system aiming at network storage system performance |
| CN106055441A (en) * | 2016-05-31 | 2016-10-26 | 深圳市国鑫恒宇科技有限公司 | Internet access performance testing method and system of servers under linux system |
| CN106055441B (en) * | 2016-05-31 | 2019-06-14 | 深圳市同泰怡信息技术有限公司 | The network port performance test method and system of server under a kind of Linux system |
| CN107977296A (en) * | 2017-11-20 | 2018-05-01 | 郑州云海信息技术有限公司 | A kind of method, apparatus and medium of NAS storage system performance test |
| CN111427507A (en) * | 2019-01-09 | 2020-07-17 | 深圳市茁壮网络股份有限公司 | Disk connection method and device and electronic equipment |
| CN111427507B (en) * | 2019-01-09 | 2023-09-12 | 深圳市茁壮网络股份有限公司 | Disk connection method and device and electronic equipment |
Also Published As
| Publication number | Publication date |
|---|---|
| CN100542108C (en) | 2009-09-16 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN100542108C (en) | The performance test methods of network store system | |
| CN102035697B (en) | Concurrent connections performance testing system and method for file system | |
| US20220129288A1 (en) | Method and apparatus for determining the capacity of an application cluster | |
| US10699798B2 (en) | Testing storage device power circuitry | |
| CN105760286A (en) | Application database dynamic property detection method and detection device | |
| CN102928772B (en) | Timing sequence test system and method for testing thereof | |
| CN109471762A (en) | Solid-state hard disk SSD performance test methods and device | |
| CN109408370A (en) | Interface testing document generating method, device, computer equipment and storage medium | |
| CN110908920A (en) | Interface function testing method and device and related components | |
| CN102647315A (en) | Device for detecting network flow | |
| CN101246444B (en) | Module testing method and system | |
| CN104917645A (en) | Online detection message transmission timeout method and device | |
| CN109143072A (en) | A kind of test method of battery management system, device and equipment | |
| CN109815102A (en) | A kind of test data statistical method, device and storage medium | |
| CN110085278A (en) | A kind of test method and system of eMMC power down protection | |
| CN116682479A (en) | Method and system for testing enterprise-level solid state disk time delay index | |
| CN105487960A (en) | Mobile terminal APP loading energy consumption automatic measurement method based on physical actual measurement | |
| CN105515898A (en) | Test method and system aiming at network storage system performance | |
| CN116244133A (en) | Hard disk test management method, system, terminal and storage medium | |
| TWI796561B (en) | Memory verification system and method with immediate interrupt verification function | |
| CN103902421A (en) | Basic performance test method for EDA (electronic design automation) design platform of enterprise | |
| CN115017018A (en) | Method and device for testing performance of server and computer readable storage medium | |
| FR2994485A1 (en) | METHOD FOR TESTING EQUIPMENT, TESTING TOOL AND TESTING SYSTEM THEREFOR | |
| CN107132990A (en) | Reading I O scheduling method and device based on super fusion storage | |
| CN108073502B (en) | Test method and system thereof |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| EE01 | Entry into force of recordation of patent licensing contract |
Application publication date: 20071219 Assignee: Dandong Transformer Co., Ltd. Assignor: Harbin Engineering Univ. Contract record no.: 2010210000034 Denomination of invention: Performance test method for network storage system Granted publication date: 20090916 License type: Exclusive License Record date: 20100322 |
|
| C17 | Cessation of patent right | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20090916 Termination date: 20120720 |