CN105389237A - Performance test tool for block-level storage system - Google Patents
Performance test tool for block-level storage system Download PDFInfo
- Publication number
- CN105389237A CN105389237A CN201510939261.4A CN201510939261A CN105389237A CN 105389237 A CN105389237 A CN 105389237A CN 201510939261 A CN201510939261 A CN 201510939261A CN 105389237 A CN105389237 A CN 105389237A
- Authority
- CN
- China
- Prior art keywords
- record
- request
- performance test
- storage system
- load
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/22—Detection or location of defective computer hardware by testing during standby operation or during idle time, e.g. start-up testing
- G06F11/2205—Detection or location of defective computer hardware by testing during standby operation or during idle time, e.g. start-up testing using arrangements specific to the hardware being tested
- G06F11/2221—Detection or location of defective computer hardware by testing during standby operation or during idle time, e.g. start-up testing using arrangements specific to the hardware being tested to test input/output devices or peripheral units
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/22—Detection or location of defective computer hardware by testing during standby operation or during idle time, e.g. start-up testing
- G06F11/2268—Logging of test results
Abstract
The invention relates to a performance test tool for a block-level storage system. The performance test tool is used for generating a same I/O request load according to an I/O record of a real storage system and simulating real load change of a running environment to perform a performance test on the storage system. The performance test tool comprises an I/O record reader, an I/O request controller, an I/O transmitter, a result collector and a result analyzer, wherein the I/O record reader reads out I/O records in a trace file; the content of each I/O record comprises a disk number, a starting byte, a total byte number of access and request starting time; the I/O request controller has three functions of controlling the weight of a load, tracking a state of the I/O record and controlling transmission time of the I/O record; the I/O transmitter is in charge of asynchronously submitting an I/O request to the system for processing; and the result collector views an I/O reading or writing state in a process of playing the I/O record and collects result data of the performance test in a result file after the I/O reading or writing is completed.
Description
Technical field
The present invention relates to according to the I/O record from actual stored system, generate identical I/O and ask load, with the change of the real load of dry run environment, thus reach block rank performance of storage system testing tool storage system being carried out to performance test.
Background technology
In recent years, data explosion increases and computing power improves rapidly, and the application of I/O intensity proposes the memory property demand of high bandwidth, low delay.Block rank memory device is widely used, and it can build the multiple access interfaces such as raw device, file system, database, cloud storage.Therefore, the focus that high performance piece of rank storage system is storage system research field is always developed.Performance test contributes to the key factor determining to affect performance of storage system, thus can carry out analysis and modification targetedly; Also can be used for more different storage systems, provide reference for choosing or buy storage system.In the face of high-capacity storage device, complicated network store system, and the application demand of various dimensions, be necessary to promote existing memory system testing assessment technique, design and Implement credible, reliably, repeatably performance of storage system testing tool.
Under normal circumstances, the quality of a performance of storage system, the ability mainly through its process load is weighed.Difference according to adding loaded really degree and weight situation divides, and generally has three kinds of methods to realize.Run practical application, namely build real system environments, add the real application load that user is concerned about; Generate Prof. Du Yucang load, namely for the situation of system and the demand etc. of user group, generate the load of synthesis, and to this system plays; Play I/O record, namely play existing to storage system, obtain the real load of public acceptance.
The most accurate method of performance of storage system test runs the real application program used.But application program is often difficult to configuration, even can not use due to reasons such as concerning security matters.And when user's request changes and retests, need amendment application, reconfigure experimental situation, the complexity of the method is significantly improved.Artificial workload's generation technique and trace reset and have the low advantage of implementation complexity simultaneously, but the load of Prof. Du Yucang does not have authenticity, and it relies on I/O load generator program and the parameter configuration of specifying according to user, generate the load of user's expection.Existing I/O load generator program comprises TPC benchmark, Postmark, IOzone, Bonnie, SPC, SPECSFS, Iometer etc.Predict that in real world, the performance of system is challenging with artificial workload's Core Generator, and configure and run very complicated.Trace reproducing process provides a kind of replacement scheme based on real-life program test.Trace is the memory access daily record of recording in true application or reference application program operation process.The I/O record of certain application program given, trace reproducing process attempts to generate identical I/O asks load, changes with the real load of dry run environment.The advantage of trace reproducing process is that load is representative and be easy to use.
The test of block rank performance of storage system is carried out by the mode playing I/O record, have concurrently the really degree running practical application high and generate Prof. Du Yucang load realize the low double dominant of difficulty, namely load is truly representative, and does not need configuration parameter, runs simple and convenient.But existing I/O record reproducing instrument lacks the ability of simply and accurately reappearing I/O load, bring appreciable error easily to performance of storage system index observed reading.
Summary of the invention
For the problems of the prior art, the invention provides a kind of testing tool, according to the I/O record from actual stored system, generate identical I/O and ask load, with the change of the real load of dry run environment, and then reach the object of storage system being carried out to performance test.
For realizing above technical purpose, technical scheme of the present invention is: IOmark of the present invention is according to the I/O record from actual stored system, generate identical I/O and ask load, with the change of the real load of dry run environment, and then reach the object of storage system being carried out to performance test.As shown in Figure 1, IOmark is made up of five function elements, comprises I/O and records reader, I/O request controller, I/O transmitter, collection device and interpretation of result device.
(1) I/O record reader is responsible for the I/O record in trace file to read out, and the content that every bar I/O records generally comprises: reel number, beginning byte, the total amount of byte of access, request start time.
(2) I/O request controller mainly contains three functions, the weight of control load, follows the tracks of the state of I/O record and the transmitting time of control I/O record.(3) I/O transmitter is responsible for I/O request to submit to away in an asynchronous manner, and the system of giving goes process.
(4) collection device is in broadcasting I/O recording process, checks the state that I/O reads and writes, if I/O has read and write, is then collected in destination file by the result data of performance test.
(5) interpretation of result device is after test terminates, according to the requirement of tester, the data in destination file are carried out statistics and analysis, adopt Cumulative Distribution Function (cumulativedistributionfunction, CDF), segmentation such as to be averaged at the statistical method, obtain the convenient data evaluating performance of storage system, avoid the excessive Evaluation results that causes of data volume directly perceived and there is the problems such as information noise.
As can be seen from the above description, the present invention possesses following advantage: IOmark of the present invention is according to the I/O record from actual stored system, generate identical I/O and ask load, with the change of the real load of dry run environment, and then reach the object of storage system being carried out to performance test.As shown in Figure 1, IOmark is made up of five function elements, comprises I/O and records reader, I/O request controller, I/O transmitter, collection device and interpretation of result device.
(1) I/O record reader is responsible for the I/O record in trace file to read out, and the content that every bar I/O records generally comprises: reel number, beginning byte, the total amount of byte of access, request start time.
(2) I/O request controller mainly contains three functions, the weight of control load, follows the tracks of the state of I/O record and the transmitting time of control I/O record.(3) I/O transmitter is responsible for I/O request to submit to away in an asynchronous manner, and the system of giving goes process.
(4) collection device is in broadcasting I/O recording process, checks the state that I/O reads and writes, if I/O has read and write, is then collected in destination file by the result data of performance test.
(5) interpretation of result device is after test terminates, according to the requirement of tester, the data in destination file are carried out statistics and analysis, adopt Cumulative Distribution Function (cumulativedistributionfunction, CDF), segmentation such as to be averaged at the statistical method, obtain the convenient data evaluating performance of storage system, avoid the excessive Evaluation results that causes of data volume directly perceived and there is the problems such as information noise.
Accompanying drawing explanation
Fig. 1 is the structural representation of of the present invention piece of rank performance of storage system testing tool.
Embodiment
With reference to the accompanying drawings described in 1, a kind of block rank performance of storage system testing tool, comprise I/O and record reader, I/O request controller, I/O transmitter, collection device and interpretation of result device, I/O records reader and is read out by the I/O record in trace file, and the content that every bar I/O records comprises: reel number, beginning byte, the total amount of byte of access, request start time; I/O request controller has three functions, the weight of control load, follows the tracks of the state of I/O record and the transmitting time of control I/O record; I/O transmitter is responsible for I/O request to submit to away in an asynchronous manner, and the system of giving goes process; Collection device, in broadcasting I/O recording process, is checked the state that I/O reads and writes, when I/O has read and write, is then collected in destination file by the result data of performance test.
1, I/O Request Control
1.1 load weights control
IOmark carrys out the weight of control load by screening reel number.The target device reel number markings that the every bar I/O read from trace file records, and the distribution of reel number is uneven.IOmark carries out by selecting the I/O record with certain or some reel numbers the weight playing control load.
1.2 record I/O solicited statuss
IOmark uses the status information of round-robin queue record I/O request.This queue does not observe first-in first-out rule, is used for storing some essential informations.Such as, after I/O request is launched, record launch time, after completing for I/O, add up I/O time delay.Before broadcasting I/O record is tested, IOmark is round-robin queue's predistribution memory headroom.In whole test process, round-robin queue's Reusability.After performance test completes, then by the release of the memory headroom of application.
IOmark uses and takies mark to represent whether entries in queues is just used.Before an I/O operation starts, the array item that circulation searching one is idle in round-robin queue, and this mark that takies is put 1.After certain I/O has operated, find corresponding array item from the data item of bio structure, and the mark that takies of this array item has been set to 0.
2, I/O request is launched
The control of 2.1 launch times
In theory, the transmitting time to system transmission I/O request should for the request time in I/O record.But when the I/O of section records enormous amount sometime in trace file, the speed sending I/O request can be greater than the speed of system process I/O request, request time is made to be not necessarily transmitting time just.When being greater than current time upon request, thread needs a period of time of sleeping, until current time rises to request time; On the contrary, when being less than current time upon request, then create delay, this I/O request is launched by IOmark at once.
The radiation pattern of 2.2I/O request
I/O records reader and reads load information, is controlled accordingly by I/O request controller.Finally be responsible for I/O to record to launch by I/O transmitter.Adopt the access mode of kernel state asynchronous I/O to process I/O request herein, after I/O request is submitted to, do not need to wait for that I/O read-write operation completes.Like this, I/O records reader, I/O request controller and I/O transmitter and constantly to circulate executions, ceaselessly submits to I/O to ask to system.After I/O request is launched, the bottom of linux kernel, by a series of system call, realizes the read-write operation to disk.
Be described the present invention and embodiment thereof above, this description does not have restricted, and shown in accompanying drawing is also one of embodiments of the present invention, and actual structure is not limited thereto.If generally speaking those of ordinary skill in the art enlightens by it, when not departing from the invention aim, designing the frame mode similar to this technical scheme and embodiment without creationary, all should protection scope of the present invention be belonged to.Be described the present invention and embodiment thereof above, this description does not have restricted, and shown in accompanying drawing is also one of embodiments of the present invention, and actual structure is not limited thereto.If generally speaking those of ordinary skill in the art enlightens by it, when not departing from the invention aim, designing the frame mode similar to this technical scheme and embodiment without creationary, all should protection scope of the present invention be belonged to.
Claims (1)
1. a block rank performance of storage system testing tool, comprise I/O and record reader, I/O request controller, I/O transmitter, collection device and interpretation of result device, I/O records reader and is read out by the I/O record in trace file, and the content that every bar I/O records comprises: reel number, beginning byte, the total amount of byte of access, request start time; I/O request controller has three functions, the weight of control load, follows the tracks of the state of I/O record and the transmitting time of control I/O record; I/O transmitter is responsible for I/O request to submit to away in an asynchronous manner, and the system of giving goes process; Collection device, in broadcasting I/O recording process, is checked the state that I/O reads and writes, when I/O has read and write, is then collected in destination file by the result data of performance test.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510939261.4A CN105389237A (en) | 2015-12-15 | 2015-12-15 | Performance test tool for block-level storage system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510939261.4A CN105389237A (en) | 2015-12-15 | 2015-12-15 | Performance test tool for block-level storage system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN105389237A true CN105389237A (en) | 2016-03-09 |
Family
ID=55421544
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510939261.4A Pending CN105389237A (en) | 2015-12-15 | 2015-12-15 | Performance test tool for block-level storage system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN105389237A (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109408270A (en) * | 2018-10-18 | 2019-03-01 | 郑州云海信息技术有限公司 | A kind of processing method and processing device of read-write operation |
| CN110781040A (en) * | 2018-07-31 | 2020-02-11 | 深圳兆日科技股份有限公司 | System performance automatic test method, device and computer readable storage medium |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7550985B2 (en) * | 2001-07-18 | 2009-06-23 | Micron Technology, Inc. | Methods of testing memory devices |
| CN102842342A (en) * | 2011-06-20 | 2012-12-26 | 鸿富锦精密工业（深圳）有限公司 | Test system and method for data storage |
| CN104505126A (en) * | 2014-12-09 | 2015-04-08 | 深圳市国微电子有限公司 | Dynamic memory testing system and dynamic memory testing method |
-
2015
- 2015-12-15 CN CN201510939261.4A patent/CN105389237A/en active Pending
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7550985B2 (en) * | 2001-07-18 | 2009-06-23 | Micron Technology, Inc. | Methods of testing memory devices |
| CN102842342A (en) * | 2011-06-20 | 2012-12-26 | 鸿富锦精密工业（深圳）有限公司 | Test system and method for data storage |
| CN104505126A (en) * | 2014-12-09 | 2015-04-08 | 深圳市国微电子有限公司 | Dynamic memory testing system and dynamic memory testing method |
Non-Patent Citations (1)
| Title |
|---|
| 宋丽丽 等: "IOmark：一种精确的存储系统性能测试工具", 《高技术通讯》 * |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110781040A (en) * | 2018-07-31 | 2020-02-11 | 深圳兆日科技股份有限公司 | System performance automatic test method, device and computer readable storage medium |
| CN110781040B (en) * | 2018-07-31 | 2023-05-30 | 深圳兆日科技股份有限公司 | Automatic system performance test method and device and computer readable storage medium |
| CN109408270A (en) * | 2018-10-18 | 2019-03-01 | 郑州云海信息技术有限公司 | A kind of processing method and processing device of read-write operation |
| CN109408270B (en) * | 2018-10-18 | 2021-12-03 | 郑州云海信息技术有限公司 | Read-write operation processing method and device |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| EP2843537B1 (en) | Method and systems for simulating a workload of a storage system | |
| CN106021045B (en) | The test method of server hard disc IO performance under a kind of Linux system | |
| Louis et al. | Cloudsimdisk: Energy-aware storage simulation in cloudsim | |
| CN107068199B (en) | Performance test method of SSD (solid State disk) | |
| CN105893230A (en) | Method and device for detecting IOPS performance of hard disks | |
| CN105389237A (en) | Performance test tool for block-level storage system | |
| CN109256173A (en) | On-board memory devices test macro | |
| US20090150137A1 (en) | Method for generating performance evaluation model | |
| CN117009196A (en) | Performance test method, test device and test platform for enterprise-level solid state disk | |
| Bezrukov et al. | A data buffering and transmission system: A study of the performance of a disk subsystem | |
| Steiner et al. | Exploration of ddr5 with the open-source simulator dramsys | |
| CN116682479A (en) | Method and system for testing enterprise-level solid state disk time delay index | |
| CN109146558A (en) | A kind of method and apparatus identifying spurious motion step number | |
| CN109215721A (en) | A kind of method, device and equipment of test NVME SSD hard disk delay | |
| Prada et al. | A novel black-box simulation model methodology for predicting performance and energy consumption in commodity storage devices | |
| Boito et al. | I/O performance of a large atmospheric model using PVFS | |
| CN108958658B (en) | Target data acquisition method and device | |
| Bhimani et al. | Automatic stream identification to improve flash endurance in data centers | |
| Delimitrou et al. | Storage I/O generation and replay for datacenter applications | |
| CN110688289A (en) | Processor performance event dynamic monitoring method based on simulation | |
| Chen et al. | MRP: Mix real cores and pseudo cores for FPGA-based chip-multiprocessor simulation | |
| El Sayed et al. | Using file system counters in modelling parallel i/o architectures | |
| CN111242163B (en) | Method, system and equipment for predicting performance of storage equipment | |
| Strong | Data allocation approaches for optimizing storage systems | |
| Sun et al. | RB-Explorer: An Accurate and Practical Approach to Write Amplification Measurement for SSDs |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| CB02 | Change of applicant information |
Address after: 214000 Wuxi City, Jiangsu, Tianan Intelligent City, new Wu District, 1-406 Applicant after: Wuxi Chen Yun Polytron Technologies Inc Address before: 214000 Taihu international science and Technology Park, Wuxi City, Wuxi, Jiangsu Province, C506 Applicant before: Jiangsu Morning Cloud Information Technology Co., Ltd. |
|
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20160309 |