CN102081565B - Method and device for performing stability test on storage system - Google Patents
Method and device for performing stability test on storage system Download PDFInfo
- Publication number
- CN102081565B CN102081565B CN201010624437.4A CN201010624437A CN102081565B CN 102081565 B CN102081565 B CN 102081565B CN 201010624437 A CN201010624437 A CN 201010624437A CN 102081565 B CN102081565 B CN 102081565B
- Authority
- CN
- China
- Prior art keywords
- mdc
- task
- resource
- iscsi
- server
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Landscapes
- Television Signal Processing For Recording (AREA)
Abstract
The invention provides a method for performing stability test on a storage system. The method comprises the following steps of: A, establishing internet protocol (IP) connection mode resources on storage equipment and establishing a shared folder on the IP connection mode resources of the storage equipment to ensure that the folder can be accessed at a plurality of video clients; B, establishing video reading and writing tasks for accessing the shared folder by using the plurality of the video clients, and monitoring each index and state; and C, judging whether the monitored state and the monitored index meet preset stability test requirements; if the monitored state and the monitored index do not meet the preset stability test requirements, adjusting parameters and/or tasks and returning to the step B; and if the monitored state and the monitored index meet the preset stability test requirements, ending the process. The invention also provides a device for performing the stability test on the storage system.
Description
Technical field
The present invention relates to computer memory technical field, particularly one is carried out stability test method and apparatus to storage system.
Background technology
IP connection mode has good extended capability and managerial, possesses high performance price ratio, dilatation at any time as required.Memory device can be distributed in network Anywhere, can formulate neatly storage backup strategy.Described IP connection mode includes but not limited to small computer system interface (iSCSI, Internet Small Computer System Interface) and network attached storage (NAS, Network Attached Storage).Therefore, be applicable to being very much applied to network video monitor and control system of new generation based on the integrated IP network storage system of iSCSI/NAS.
In network video monitor and control system, audio, video data is saved in storage system incessantly continuously, and require can call at any time, the aspect such as reliability and performance of storage has all been proposed to new requirement, also the stability of IP-based network store system is had higher requirement.
According to the feature of Video Applications, except thering is the function of storage mass data, need the steady in a long-term application that data access is externally provided simultaneously.The stability of system is the pacing items that memory device is survived on Video Applications market.Memory device manufacturing enterprise is limited at the environment in laboratory, can not load onto thousands of cameras in real time to memory device read-write video file.
The existing iSCSI/NAS reading and writing data of industry instrument is as IOmeter, and Sanergy etc. are mainly the performances for test storage.And read-write that can not analog video data (read-write of video data is from block size, and read-write ratio etc. has its singularity).
Summary of the invention
The invention provides and a kind of storage system is carried out to stability test method and apparatus, can realize analog video data and read and write the stability of test storage system.
The one that the embodiment of the present invention proposes is carried out stability test method to storage system, comprises the steps:
A, on memory device, create IP connection mode resource; In the IP of memory device connection mode resource, create Shared Folders, to ensure can to access this file at multiple videoconference clients;
B, multiple videoconference client create the video read-write task of the described Shared Folders of access, and monitor each index and state;
C, judge monitoring state and index whether meet the requirement of the stability test setting in advance, if do not meet, parameter and/or task are adjusted, and are returned to step B, if meet, process ends.
Preferably, described IP connection mode is small computer system interface iSCSI or network attached storage NAS.
Preferably, steps A comprises:
A1, on memory device, creating iSCSI/NAS resource, for iSCSI resource, is MDC server by storage device configurations, and the iSCSI resource that connects memory device is to MDC server; For NAS resource, directly on MDC server, access NAS resource;
A2, multiple videoconference clients are configured to MDC client, the iSCSI/NAS resource of memory device is connected to each MDC client;
A3, in the iSCSI/NAS of MDC server resource, create Shared Folders, Shared Folders described in each MDC client-access, and test with SANergy;
A4, on MDC server, move SANergy control end.
Preferably, multiple videoconference clients create in the video read-write task of the described Shared Folders of access described in step B, and the Media Stream flow of each road access Shared Folders of videoconference client is 2Mb/s.
Preferably, described in step B, monitor each index and state comprises: calculate and by the real-time demonstration real time rate of display interface, mean speed, frame losing number, number of times and tasks carrying progress of carrying out read-write operation per second.
The embodiment of the present invention also proposes a kind of device that storage system is carried out to stability test, comprising:
Resource arranges module, for create IP connection mode resource on memory device; In the IP of memory device connection mode resource, create Shared Folders, to ensure can to access this file at multiple videoconference clients;
Parameter arranges module, accesses the correlation parameter of the video read-write task of described Shared Folders for multiple videoconference clients are set;
Monitoring module, in video read-write task run process, monitors each index and state;
Whether task control module, meet the requirement of the stability test setting in advance for the state and the index that judge described monitoring module monitoring, if do not meet, parameter and/or number of tasks adjusted.
Preferably, the correlation parameter that described parameter arranges module setting comprises: the combination in any of task names, task type, bandwidth types, additional audio files, time span, code check, frame buffer threshold, frame buffer number, block size or above content.
Preferably, described task control module is adjusted into parameter and/or task: the number of times that change is executed the task, stops/initiating task, or change the Writing/Reading video streams of simultaneously moving in each client.
Preferably, described monitoring module is for calculating and by the real-time demonstration real time rate of display interface, mean speed, frame losing number, number of times and tasks carrying progress of carrying out read-write operation per second.
As can be seen from the above technical solutions, multiple videoconference client access Shared Folders, this file is carried out to read and write access simultaneously, and the requirement whether state to monitoring and index meet the stability test setting in advance judges, if do not meet, nepal rattlesnake plantain root number and/or task are adjusted, until reach the stability test requirement of plan.Read and write the stability of test storage system by realizing analog video data with upper type.
Brief description of the drawings
Fig. 1 is the stability test device block diagram that the embodiment of the present invention proposes;
Fig. 2 is the stability test process flow diagram that the embodiment of the present invention proposes.
Embodiment
The embodiment of the present invention provides a kind of Video Applications stability test method and apparatus based on the integrated IP storage system of iSCSI/NAS, for use in testing for video data read and write for a long time, the Stability and adaptability of storage system in the process of accessing storage device, thereby investigate the impact on IP storage system of various factors in network sharing mode Video Applications.
As shown in Figure 1, the stability test device that the embodiment of the present invention proposes comprises: resource arranges module 101, parameter arranges module 102, task control module 103 and monitoring module 104.
Resource arranges module 101, for create IP connection mode resource on memory device; In the IP of memory device connection mode resource, create Shared Folders, to ensure can to access this file at multiple videoconference clients.
Parameter arranges module 102:
Be used for arranging the relevant each parameter of test assignment and task.Include but not limited to:
1) task names;
2) task type (read/write);
3) bandwidth types (stablizing bandwidth/extreme bandwidth/random bandwidth);
4) additional audio files (the additional how many roads of each video file audio file)
5) time span
6) code check (establishing by demand, as test 25Mbps)
7) frame buffer threshold (as PAL-system)
8) frame buffer number
9) block size
Task control module 103:
This module can be controlled flexibly to video task, includes but not limited to
1) number of times that change is executed the task,
2) stop/initiating task
3) change the Writing/Reading video streams of simultaneously moving in each client
Monitoring module 104:
The following situation of observation that can be real-time by this module:
1) video server and memory device cpu usage, internal memory service condition
2) speed (real time rate, maximum rate, minimum-rate, mean speed) of video read-write
3) access time delay situation (maximum access time delay, Average access delay)
4) be in real time the number of times (IOPS, Input/Output Operations Per Second) of the I/O of read-write per second operation
Can also be by Change generation graph table of above indices different time points etc.
In addition, in order to make memory device in having IO, each index meets the requirement of stability test.Can revise flexibly the every data in the task of carrying out by this stability test program.To meet the requirement of memory device stability test.
The stability test method flow that the embodiment of the present invention proposes as shown in Figure 2, comprises the steps:
Step 201: create iSCSI/NAS resource on memory device.
Step 202: create Shared Folders in the iSCSI/NAS of memory device resource, to ensure can to access this file at multiple videoconference clients.
SANergy is a comprehensive storage management software of IBM Corporation.When configuration MDC server uses, major function is to realize multiple host reading while write same volume.Metadata controller (MDC, Meta Data Controller) is the machine based on each volume, is responsible for hard installation and control security and assignment information.Substantially can understand like this, MDC is just as individual yardman, and host node needs first to ask its data is at which before visit data, but when visit data by it, but oneself directly goes access.
This step comprises following sub-step:
Sub-step 202-1: create iSCSI/NAS Shared Folders at MDC server.
For iSCSI, be MDC server (know from iSCSI agreement, iSCSI resource can not be simultaneously in multi-client access, and utilizing the MDC of SANergy to realize Shared Folders in iSCSI resource can be simultaneously by multiple client-access) by storage device configurations.And the iSCSI resource that connects memory device is to this station server.
For NAS resource, directly on MDC server, access NAS Shared Folders.NAS Shared Folders itself is exactly to support multi-client access simultaneously.
Sub-step 202-2: other multiple videoconference clients are configured to MDC client, the iSCSI/NAS resource of memory device are connected to each client simultaneously.
Sub-step 202-3: create Shared Folders in MDC server iSCSI/NAS resource, at other client-access Shared Folders, and with SANergy test, keep merging with MDC.
Sub-step 202-4: move SANergy control end on MDC server.
Step 203: at MDC videoconference client operation video stabilization test procedure.According to the specific requirement of stability test, create the video read-write task (analog video read-write) of the described Shared Folders of access in each client, and monitor each index and state.
The simulation of video data and the realization of configuration:
Video data has following characteristics:
Store video files: the high concurrent real-time sequential write of multipath, the bulk more than 60k are write, and long-time constant code stream also can produce and lose hardwood.
Video playback: read to write few application, the reading of the random large concurrent above chunk data of 60k applied more.
According to above feature, realize by program:
High concurrent: adopt D1 form according to the every road of video industry standard, flow is 2Mb/s.Flow by the every road of the inner definition of program Media Stream is 2Mb/s.Program interface can arrange the concrete way of video flexibly.Thereby realize the simulation of high concurrent constant code stream.
Long data block: this parameter of the inner definition of program.By program interface, concrete data block size can be set flexibly.
Access time: this parameter of the inner definition of program.By program interface, concrete access time length can be set flexibly.
Frame losing: this parameter of the inner definition of program.By program interface, frame losing threshold value can be set flexibly.
Monitor the realization of each index and state:
Carry out after video read-write application, program, according to situation about carrying out, calculates real time rate, mean speed, frame losing number, the number of times (IOPS) that carries out read-write operation per second, the numerical value such as tasks carrying progress.And by real-time the showing of display interface.
Step 204: judge, in the process of stability test, whether the state of monitoring and index meet the requirement of stability test, if do not meet, execution step 205; If reach the stability test requirement of plan, process ends.
Step 205: parameter and/or task are adjusted, and returned to step 203.Described adjustment includes but not limited to the change number of times of executing the task, and stops/initiating task, or changes in each client simultaneously the Writing/Reading video streams of operation etc.
For example,, writing in video task, if the frame losing number that program interface shows is too large.Must reduce the way of writing video.By program interface, first stop read-write task.Amendment video way.
The foregoing is only preferred embodiment of the present invention, in order to limit the present invention, within the spirit and principles in the present invention not all, any amendment of making, be equal to replacement, improvement etc., within all should being included in the scope of protection of the invention.
Claims (7)
1. storage system is carried out to a stability test method, it is characterized in that, comprise the steps:
A1, on memory device, creating small computer system interface iSCSI/network attached storage NAS resource, for iSCSI resource, is MDC server by storage device configurations, and the iSCSI resource that connects memory device is to MDC server; For NAS resource, directly on MDC server, access NAS resource;
A2, multiple videoconference clients are configured to MDC client, the iSCSI/NAS resource of memory device is connected to each MDC client;
A3, in the iSCSI/NAS of MDC server resource, create Shared Folders, Shared Folders described in each MDC client-access, and test with SANergy;
A4, on MDC server, move SANergy control end;
B, multiple videoconference client create the video read-write task of the described Shared Folders of access, and monitor each index and state;
C, judge whether state and the index of monitoring meet the requirement of the stability test setting in advance, if do not meet, correlation parameter and/or the task of video read-write task are adjusted, and returned to step B, if meet, process ends.
2. method according to claim 1, is characterized in that, multiple videoconference clients create in the video read-write task of the described Shared Folders of access described in step B, and the Media Stream flow of each road access Shared Folders of videoconference client is 2Mb/s.
3. method according to claim 1, it is characterized in that, monitor each index described in step B and state comprises: calculate and by the real-time demonstration real time rate of display interface, mean speed, frame losing number, number of times and tasks carrying progress of carrying out read-write operation per second.
4. a device that storage system is carried out to stability test, is characterized in that, comprising:
Resource arranges module, for create small computer system interface iSCSI/network attached storage NAS resource on memory device, for iSCSI resource, is MDC server by storage device configurations, and the iSCSI resource that connects memory device is to MDC server; For NAS resource, directly on MDC server, access NAS resource; Multiple videoconference clients are configured to MDC client, the iSCSI/NAS resource of memory device is connected to each MDC client; In the iSCSI/NAS of MDC server resource, create Shared Folders, Shared Folders described in each MDC client-access, and test with SANergy; On MDC server, move SANergy control end;
Parameter arranges module, accesses the correlation parameter of the video read-write task of described Shared Folders for multiple videoconference clients are set;
Monitoring module, in video read-write task run process, monitors each index and state;
Whether task control module, meet the requirement of the stability test setting in advance for the state and the index that judge described monitoring module monitoring, if do not meet, correlation parameter and/or the task of video read-write task adjusted.
5. device according to claim 4, it is characterized in that, the correlation parameter that described parameter arranges module setting comprises: the combination in any of task names, task type, bandwidth types, additional audio files, time span, code check, frame buffer threshold, frame buffer number, block size or above content.
6. device according to claim 4, it is characterized in that, described task control module is adjusted into correlation parameter and/or the task of video read-write task: the number of times that change is executed the task, stops/initiating task, or change the Writing/Reading video streams of simultaneously moving in each client.
7. device according to claim 4, is characterized in that, described monitoring module is for calculating and by the real-time demonstration real time rate of display interface, mean speed, frame losing number, number of times and tasks carrying progress of carrying out read-write operation per second.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201010624437.4A CN102081565B (en) | 2010-12-31 | 2010-12-31 | Method and device for performing stability test on storage system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201010624437.4A CN102081565B (en) | 2010-12-31 | 2010-12-31 | Method and device for performing stability test on storage system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN102081565A CN102081565A (en) | 2011-06-01 |
| CN102081565B true CN102081565B (en) | 2014-07-16 |
Family
ID=44087538
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201010624437.4A Active CN102081565B (en) | 2010-12-31 | 2010-12-31 | Method and device for performing stability test on storage system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN102081565B (en) |
Families Citing this family (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102789410A (en) * | 2012-06-29 | 2012-11-21 | 浪潮电子信息产业股份有限公司 | Method for testing performance of storage system |
| CN102915270B (en) * | 2012-09-14 | 2015-04-15 | 福建升腾资讯有限公司 | Method for recording storage I/O (input/output) requirement and verifying pressure simulation |
| CN103984619A (en) * | 2014-06-06 | 2014-08-13 | 山东超越数控电子有限公司 | Performance monitoring method of network storage system |
| CN106161132B (en) * | 2015-04-17 | 2019-10-01 | 伊姆西公司 | Device and method for being tested storage network |
| CN104902029A (en) * | 2015-06-24 | 2015-09-09 | 北京麓柏科技有限公司 | Storage request control based on configuration parameter and client-side statistics |
| CN109408487B (en) * | 2018-11-01 | 2021-10-22 | 郑州云海信息技术有限公司 | File processing system and method under NAS file system |
Citations (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101883019A (en) * | 2010-03-15 | 2010-11-10 | 浪潮电子信息产业股份有限公司 | Test method for verifying video application of storage server |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8099638B2 (en) * | 2004-11-12 | 2012-01-17 | Ati Technologies Ulc | Apparatus and methods for tuning a memory interface |
-
2010
- 2010-12-31 CN CN201010624437.4A patent/CN102081565B/en active Active
Patent Citations (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101883019A (en) * | 2010-03-15 | 2010-11-10 | 浪潮电子信息产业股份有限公司 | Test method for verifying video application of storage server |
Also Published As
| Publication number | Publication date |
|---|---|
| CN102081565A (en) | 2011-06-01 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN102081565B (en) | Method and device for performing stability test on storage system | |
| WO2021126295A1 (en) | Request throttling in distributed storage systems | |
| US9626105B2 (en) | Controlling a storage system | |
| EP3033678B1 (en) | Methods, systems, and computer readable media for modeling a workload | |
| Lai et al. | Towards a framework for large-scale multimedia data storage and processing on Hadoop platform | |
| IE20070392A1 (en) | System and method of dynamically changing file representations | |
| US9135259B2 (en) | Multi-tenancy storage node | |
| Xu et al. | {SpringFS}: Bridging Agility and Performance in Elastic Distributed Storage | |
| CN102722405B (en) | Counting method and system in high concurrent and multithreaded application | |
| CN103078763A (en) | Multi-protocol parallel test method and system of information storage system | |
| CN101883019B (en) | Test method for verifying video application of storage server | |
| Dai et al. | A performance study of lustre file system checker: Bottlenecks and potentials | |
| CN103177080A (en) | File pre-reading method and file pre-reading device | |
| KR101531564B1 (en) | Method and System for load balancing of iSCSI storage system used network distributed file system and method | |
| Li et al. | NetStorage: A synchronized trace-driven replayer for network-storage system evaluation | |
| CN103108045B (en) | Based on the web map service implementation method of cloud framework | |
| Kang et al. | OStoreBench: benchmarking distributed object storage systems using real-world application scenarios | |
| Ahmadi et al. | Effect of virtual techniques in data storage access | |
| Ou et al. | Is cloud storage ready? A comprehensive study of IP-based storage systems | |
| Gu et al. | DFS-PERF: A scalable and unified benchmarking framework for distributed file systems | |
| Li et al. | Storage benchmarking for workload aware storage platform | |
| Divate et al. | High performance computing and big data | |
| Avilés-González et al. | Batching operations to improve the performance of a distributed metadata service | |
| Pang et al. | Defragmenting DHT-based distributed file systems | |
| Castro et al. | NetCDF based data archiving system applied to ITER Fast Plant System Control prototype |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| CP03 | Change of name, title or address | ||
| CP03 | Change of name, title or address |
Address after: Room 505, Taixing Building, 11 Garden East Road, Haidian District, Beijing, 100191 Co-patentee after: Shenzhen Innovation Software Technology Co., Ltd. Patentee after: Innovation Technology Co., Ltd. Address before: Room 0801-0810, 51 College Road, Haidian District, Beijing, 100191 Co-patentee before: Chuangxinke Software Technology (Shenzhen) Co., Ltd. Patentee before: Innovation and Technology Storage Technology Co., Ltd. |