CN111510338B - Distributed block storage network sub-health test method, device and storage medium - Google Patents
Distributed block storage network sub-health test method, device and storage medium Download PDFInfo
- Publication number
- CN111510338B CN111510338B CN202010157494.XA CN202010157494A CN111510338B CN 111510338 B CN111510338 B CN 111510338B CN 202010157494 A CN202010157494 A CN 202010157494A CN 111510338 B CN111510338 B CN 111510338B
- Authority
- CN
- China
- Prior art keywords
- storage
- network
- sub
- storage node
- distributed block
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000010998 test method Methods 0.000 title claims abstract description 5
- 238000012360 testing method Methods 0.000 claims abstract description 31
- 238000004891 communication Methods 0.000 claims abstract description 7
- 238000000034 method Methods 0.000 claims description 6
- 238000010200 validation analysis Methods 0.000 claims description 3
- 238000006467 substitution reaction Methods 0.000 description 3
- 230000007547 defect Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 230000007812 deficiency Effects 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L43/00—Arrangements for monitoring or testing data switching networks
- H04L43/50—Testing arrangements
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/1097—Protocols in which an application is distributed across nodes in the network for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Data Exchanges In Wide-Area Networks (AREA)
Abstract
The invention relates to a distributed block storage network sub-health test method, a device and a storage medium, wherein the test method comprises the following steps: s1: building a test environment; s2: setting the storage performance of the tested distributed blocks; s3: checking the storage performance state of the tested distributed block before network congestion; s4: simulating network congestion of the switch; s5: switching active interfaces, and increasing 10% of packet loss rate at the current active port of the storage network of the storage node; s6: logging in a second storage node, communicating the storage node with the storage node in the sub-health state, and confirming that network packet loss exists; checking whether the network ports of the storage nodes in the sub-health state are switched; s7: deleting the packet loss rate in the step S5 and recovering the communication; s8: and logging in a second storage node, communicating the storage node with the storage node in the sub-health state, and confirming that the response time is longer than the preset threshold time.
Description
Technical Field
The invention belongs to the technical field of distributed block storage network testing, and particularly relates to a distributed block storage network sub-health testing method, a distributed block storage network sub-health testing device and a distributed block storage network sub-health testing storage medium.
Background
With the rapid development of the distributed storage system, the storage capacity reaches the PB level, the stored data is more and more, the application range is wider, and the transmission and storage of the data become more important.
In the prior art, the defect of low storage speed in the data storage process is caused by not aiming at the network health state in the storage process.
In view of the above, the present invention provides a distributed block storage network sub-health testing method, apparatus and storage medium; it is very necessary to solve the above-mentioned defects existing in the prior art.
Disclosure of Invention
In view of the above-mentioned deficiencies of the prior art, the present invention provides a distributed block storage network sub-health testing method, apparatus and storage medium to solve the above-mentioned technical problems.
In order to achieve the purpose, the invention provides the following technical scheme:
in a first aspect, the present invention provides a distributed block storage network sub-health testing method, including the following steps:
s1: building a test environment;
building a test node environment, connecting the tested distributed block to a switch, operating the normal tested distributed block, calling a command to query the cluster operation state,
s2: setting the storage performance of the tested distributed blocks;
executing a script program to enable the storage performance of the tested distributed block to be higher than 850 MB/s; setting a service quality flow control in a storage network of a storage node;
s3: checking the storage performance state of the tested distributed block before network congestion;
s4: simulating network congestion of the switch;
checking whether the network ports of the storage nodes in the sub-health state are switched or not, and relieving the network congestion of the switch;
s5: switching active ports, and increasing 10% of packet loss rate at the current active port of the storage network of the storage node;
s6: logging in a second storage node, communicating the storage node with the storage node in the sub-health state, and confirming that network packet loss exists; checking whether the network ports of the storage nodes in the sub-health state are switched;
s7: deleting the packet loss rate in the step S5, and recovering normal communication;
s8: logging in a second storage node, communicating the storage node with the storage node in the sub-health state, and determining whether the response time is longer than a preset threshold time; checking whether the network port of the storage node in the sub-health state switches the running condition of the Vdbench; and adding the timing delay to the current active port of the storage network of the storage node in the sub-health state.
Preferably, in step S8, the preset threshold time is 100 ms.
Preferably, in step S8, the timing delay is 100 ms.
In a second aspect, the present invention provides a distributed block storage network sub-health testing apparatus, including:
a building module of a test environment, wherein:
building a test node environment, connecting the tested distributed block to a switch, operating the normal tested distributed block, calling a command to query the cluster operation state,
setting a storage performance module of the tested distributed block, wherein:
executing a script program to enable the storage performance of the tested distributed block to be higher than 850 MB/s; setting a service quality flow control in a storage network of a storage node;
a module for checking the storage performance state of the tested distributed block before network congestion, wherein:
checking and recording the storage performance state of the tested distributed block before network congestion;
a simulated switch network congestion module, wherein:
checking whether the network ports of the storage nodes in the sub-health state are switched or not, and relieving the network congestion of the switch;
a module for increasing packet loss rate, wherein:
switching active ports, and increasing 10% of packet loss rate at the current active port of the storage network of the storage node;
a module for confirming network packet loss, wherein:
logging in a second storage node, communicating the storage node with the storage node in the sub-health state, and confirming that network packet loss exists; checking whether the network ports of the storage nodes in the sub-health state are switched;
a validation response time module in which, in the module,
deleting the network packet loss rate and recovering normal communication; logging in a second storage node, communicating the storage node with the storage node in the sub-health state, and determining whether the response time is longer than a preset threshold time; checking whether the network port of the storage node in the sub-health state switches the running condition of the Vdbench; and adding the timing delay to the current active port of the storage network of the storage node in the sub-health state.
Preferably, in the acknowledgement response time module, the preset threshold time is 100 ms.
Preferably, in the acknowledgement response time module, the timing delay is 100 ms.
In a third aspect, there is provided a computer storage medium having stored therein instructions that, when run on a computer, cause the computer to perform the method of the first aspect described above.
The invention has the beneficial effects that the application provides a distributed block storage network sub-health testing method, a device and a storage medium; the method fills the blank in the technical field of sub-health testing of the distributed block storage network, and improves the safety and the high efficiency of distributed block storage. In addition, the invention has reliable design principle, simple structure and very wide application prospect.
Drawings
In order to more clearly illustrate the embodiments or technical solutions in the prior art of the present invention, the drawings used in the description of the embodiments or prior art will be briefly described below, and it is obvious for those skilled in the art that other drawings can be obtained based on these drawings without creative efforts.
Fig. 1 is a flowchart of a distributed block storage network sub-health testing method provided by the present invention.
Detailed Description
In order to make those skilled in the art better understand the technical solution of the present invention, the technical solution in the embodiment of the present invention will be clearly and completely described below with reference to the drawings in the embodiment of the present invention, and it is obvious that the described embodiment is only a part of the embodiment of the present invention, and not all embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
Example 1:
the embodiment provides a distributed block storage network sub-health testing method, which comprises the following steps:
s1: building a test environment;
building a test node environment, connecting the tested distributed block to a switch, operating the normal tested distributed block, calling a command to query the cluster operation state,
s2: setting the storage performance of the tested distributed blocks;
executing a script program to enable the storage performance of the tested distributed block to be higher than 850 MB/s; setting a service quality flow control in a storage network of a storage node;
s3: checking the storage performance state of the tested distributed block before network congestion;
s4: simulating network congestion of the switch;
checking whether the network ports of the storage nodes in the sub-health state are switched or not, and relieving the network congestion of the switch;
s5: switching active ports, and increasing 10% of packet loss rate at the current active port of the storage network of the storage node;
s6: logging in a second storage node, communicating the storage node with the storage node in the sub-health state, and confirming that network packet loss exists; checking whether the network ports of the storage nodes in the sub-health state are switched;
s7: deleting the packet loss rate in the step S5, and recovering normal communication;
s8: logging in a second storage node, communicating the storage node with the storage node in the sub-health state, and determining whether the response time is longer than a preset threshold time; checking whether the network port of the storage node in the sub-health state switches the running condition of the Vdbench; increasing the timing delay of the current active port of the storage network of the storage node in the sub-health state; presetting the threshold time to be 100 ms; the timing delay is 100 ms.
Example 2:
the embodiment provides a sub-health testing device of a distributed block storage network, which comprises:
a building module of a test environment, wherein:
building a test node environment, connecting the tested distributed block to a switch, operating the normal tested distributed block, calling a command to query the cluster operation state,
setting a storage performance module of the tested distributed block, wherein:
executing a script program to enable the storage performance of the tested distributed block to be higher than 850 MB/s; setting a service quality flow control in a storage network of a storage node;
a module for checking the storage performance state of the tested distributed block before network congestion, wherein:
checking and recording the storage performance state of the tested distributed block before network congestion;
a simulated switch network congestion module, wherein:
checking whether the network ports of the storage nodes in the sub-health state are switched or not, and relieving the network congestion of the switch;
a module for increasing packet loss rate, wherein:
switching active ports, and increasing 10% of packet loss rate at the current active port of the storage network of the storage node;
a module for confirming network packet loss, wherein:
logging in a second storage node, communicating the storage node with the storage node in the sub-health state, and confirming that network packet loss exists; checking whether the network ports of the storage nodes in the sub-health state are switched;
a validation response time module in which, in the module,
deleting the network packet loss rate and recovering normal communication; logging in a second storage node, communicating the storage node with the storage node in the sub-health state, and determining whether the response time is longer than a preset threshold time; checking whether the network port of the storage node in the sub-health state switches the running condition of the Vdbench; increasing the timing delay of the current active port of the storage network of the storage node in the sub-health state; presetting the threshold time to be 100 ms; the timing delay is 100 ms.
Example 3:
the present embodiment provides a computer storage medium having stored therein instructions that, when run on a computer, cause the computer to perform the method of embodiment 1 described above.
Although the present invention has been described in detail by referring to the drawings in connection with the preferred embodiments, the present invention is not limited thereto. Various equivalent modifications or substitutions can be made on the embodiments of the present invention by those skilled in the art without departing from the spirit and scope of the present invention, and these modifications or substitutions are within the scope of the present invention/any person skilled in the art can easily conceive of the changes or substitutions within the technical scope of the present invention. Therefore, the protection scope of the present invention shall be subject to the protection scope of the claims.
Claims (7)
1. A distributed block storage network sub-health test method is characterized by comprising the following steps:
s1: building a test environment;
building a test node environment, connecting the tested distributed block to a switch, operating the normal tested distributed block, calling a command to query the cluster operation state,
s2: setting the storage performance of the tested distributed blocks;
executing a script program to enable the storage performance of the tested distributed block to be higher than 850 MB/s; setting a service quality flow control in a storage network of a storage node;
s3: checking the storage performance state of the tested distributed block before network congestion;
s4: simulating network congestion of the switch;
checking whether the network ports of the storage nodes in the sub-health state are switched or not, and relieving the network congestion of the switch;
s5: switching active ports, and increasing 10% of packet loss rate at the current active port of the storage network of the storage node;
s6: logging in a second storage node, communicating the storage node with the storage node in the sub-health state, and confirming that network packet loss exists; checking whether the network ports of the storage nodes in the sub-health state are switched;
s7: deleting the packet loss rate in the step S5, and recovering normal communication;
s8: logging in a second storage node, communicating the storage node with the storage node in the sub-health state, and determining whether the response time is longer than a preset threshold time; checking whether the network port of the storage node in the sub-health state switches the running condition of the Vdbench; and adding the timing delay to the current active port of the storage network of the storage node in the sub-health state.
2. The distributed block storage network sub-health testing method according to claim 1, wherein in step S8, the preset threshold time is 100 ms.
3. The distributed block storage network sub-health testing method according to claim 1 or 2, wherein in step S8, the timing delay is 100 ms.
4. A distributed block storage network sub-health testing device, comprising:
a building module of a test environment, wherein:
building a test node environment, connecting the tested distributed block to a switch, operating the normal tested distributed block, calling a command to query the cluster operation state,
setting a storage performance module of the tested distributed block, wherein:
executing a script program to enable the storage performance of the tested distributed block to be higher than 850 MB/s; setting a service quality flow control in a storage network of a storage node;
a module for checking the storage performance state of the tested distributed block before network congestion, wherein:
checking and recording the storage performance state of the tested distributed block before network congestion;
a simulated switch network congestion module, wherein:
checking whether the network ports of the storage nodes in the sub-health state are switched or not, and relieving the network congestion of the switch;
a module for increasing packet loss rate, wherein:
switching active ports, and increasing 10% of packet loss rate at the current active port of the storage network of the storage node;
a module for confirming network packet loss, wherein:
logging in a second storage node, communicating the storage node with the storage node in the sub-health state, and confirming that network packet loss exists; checking whether the network ports of the storage nodes in the sub-health state are switched;
a validation response time module in which, in the module,
deleting the network packet loss rate and recovering normal communication; logging in a second storage node, communicating the storage node with the storage node in the sub-health state, and determining whether the response time is longer than a preset threshold time; checking whether the network port of the storage node in the sub-health state switches the running condition of the Vdbench; and adding the timing delay to the current active port of the storage network of the storage node in the sub-health state.
5. The distributed block storage network sub-health testing apparatus according to claim 4, wherein in the acknowledgement response time module, the preset threshold time is 100 ms.
6. The distributed block storage network sub-health testing apparatus according to claim 4 or 5, wherein in the acknowledgement response time module, the timing delay is 100 ms.
7. A computer storage medium having stored therein instructions that, when executed on a computer, cause the computer to perform the method of any one of claims 1-3.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202010157494.XA CN111510338B (en) | 2020-03-09 | 2020-03-09 | Distributed block storage network sub-health test method, device and storage medium |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202010157494.XA CN111510338B (en) | 2020-03-09 | 2020-03-09 | Distributed block storage network sub-health test method, device and storage medium |
Publications (2)
Publication Number | Publication Date |
---|---|
CN111510338A CN111510338A (en) | 2020-08-07 |
CN111510338B true CN111510338B (en) | 2022-04-26 |
Family
ID=71875723
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN202010157494.XA Active CN111510338B (en) | 2020-03-09 | 2020-03-09 | Distributed block storage network sub-health test method, device and storage medium |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN111510338B (en) |
Families Citing this family (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN113132160B (en) * | 2021-04-08 | 2023-02-28 | 山东英信计算机技术有限公司 | Method and system for detecting network sub-health state of client node |
CN114007246B (en) * | 2021-10-29 | 2024-02-02 | 北京天融信网络安全技术有限公司 | Method, apparatus, computer device and medium for reducing network congestion |
Citations (11)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN101706805A (en) * | 2009-10-30 | 2010-05-12 | 中国科学院计算技术研究所 | Method and system for storing object |
CN103763155A (en) * | 2014-01-24 | 2014-04-30 | 国家电网公司 | Multi-service heartbeat monitoring method for distributed type cloud storage system |
CN107007284A (en) * | 2017-03-24 | 2017-08-04 | 北京动亮健康科技有限公司 | Dynamic monitoring and method for tracking and managing and system applied to chronic disease athletic rehabilitation |
CN107547252A (en) * | 2017-06-29 | 2018-01-05 | 新华三技术有限公司 | A kind of network failure processing method and device |
CN108141374A (en) * | 2015-12-21 | 2018-06-08 | 华为技术有限公司 | A kind of network inferior health diagnostic method and device |
CN108235751A (en) * | 2017-12-18 | 2018-06-29 | 华为技术有限公司 | Identify the method, apparatus and data-storage system of object storage device inferior health |
CN108804038A (en) * | 2018-05-29 | 2018-11-13 | 新华三技术有限公司 | Method, apparatus, server and the computer-readable medium of daily record data migration |
CN108958970A (en) * | 2018-05-29 | 2018-12-07 | 新华三技术有限公司 | A kind of data reconstruction method, server and computer-readable medium |
CN109298945A (en) * | 2018-10-17 | 2019-02-01 | 北京京航计算通讯研究所 | The monitoring of Ceph distributed storage and tuning management method towards big data platform |
CN110502496A (en) * | 2019-07-19 | 2019-11-26 | 苏州浪潮智能科技有限公司 | A kind of distributed file system restorative procedure, system, terminal and storage medium |
CN110825552A (en) * | 2018-08-14 | 2020-02-21 | 华为技术有限公司 | Data storage method, data recovery method, node and storage medium |
Family Cites Families (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6416471B1 (en) * | 1999-04-15 | 2002-07-09 | Nexan Limited | Portable remote patient telemonitoring system |
US6700876B1 (en) * | 1999-07-29 | 2004-03-02 | International Business Machines Corporation | Congestion monitoring and message flow control in a blocking network |
US8880799B2 (en) * | 2005-09-30 | 2014-11-04 | Cleversafe, Inc. | Rebuilding data on a dispersed storage network |
CN103560913A (en) * | 2013-10-31 | 2014-02-05 | 华为技术有限公司 | Disaster recovery switching method, equipment and system |
SG11201703220SA (en) * | 2014-11-06 | 2017-05-30 | Huawei Tech Co Ltd | Distributed storage and replication system and method |
CN104657250B (en) * | 2014-12-16 | 2018-07-06 | 无锡华云数据技术服务有限公司 | A kind of monitoring system and its monitoring method that performance monitoring is carried out to cloud host |
US10728206B2 (en) * | 2017-03-22 | 2020-07-28 | Citrix Systems, Inc. | Method for DNS response reordering based on path quality and connection priority for better QOS |
CN109450666B (en) * | 2018-10-12 | 2022-06-10 | 新华三技术有限公司成都分公司 | Distributed system network management method and device |
CN109787859B (en) * | 2019-01-11 | 2022-06-10 | 深圳市网心科技有限公司 | Intelligent speed limiting method and device based on network congestion detection and storage medium |
-
2020
- 2020-03-09 CN CN202010157494.XA patent/CN111510338B/en active Active
Patent Citations (11)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN101706805A (en) * | 2009-10-30 | 2010-05-12 | 中国科学院计算技术研究所 | Method and system for storing object |
CN103763155A (en) * | 2014-01-24 | 2014-04-30 | 国家电网公司 | Multi-service heartbeat monitoring method for distributed type cloud storage system |
CN108141374A (en) * | 2015-12-21 | 2018-06-08 | 华为技术有限公司 | A kind of network inferior health diagnostic method and device |
CN107007284A (en) * | 2017-03-24 | 2017-08-04 | 北京动亮健康科技有限公司 | Dynamic monitoring and method for tracking and managing and system applied to chronic disease athletic rehabilitation |
CN107547252A (en) * | 2017-06-29 | 2018-01-05 | 新华三技术有限公司 | A kind of network failure processing method and device |
CN108235751A (en) * | 2017-12-18 | 2018-06-29 | 华为技术有限公司 | Identify the method, apparatus and data-storage system of object storage device inferior health |
CN108804038A (en) * | 2018-05-29 | 2018-11-13 | 新华三技术有限公司 | Method, apparatus, server and the computer-readable medium of daily record data migration |
CN108958970A (en) * | 2018-05-29 | 2018-12-07 | 新华三技术有限公司 | A kind of data reconstruction method, server and computer-readable medium |
CN110825552A (en) * | 2018-08-14 | 2020-02-21 | 华为技术有限公司 | Data storage method, data recovery method, node and storage medium |
CN109298945A (en) * | 2018-10-17 | 2019-02-01 | 北京京航计算通讯研究所 | The monitoring of Ceph distributed storage and tuning management method towards big data platform |
CN110502496A (en) * | 2019-07-19 | 2019-11-26 | 苏州浪潮智能科技有限公司 | A kind of distributed file system restorative procedure, system, terminal and storage medium |
Non-Patent Citations (2)
Title |
---|
"Scalable and distributed detection analysis on wormhole links in wireless sensor networks for networked systems";Jayashree Padmanabhan,;《IEEE Access》;20171207(第6期);全文 * |
蔡咏才,." 智能网络存储系统后台服务器软件架构的研究与设计".《中国优秀硕士学位论文全文数据库-信息科技辑》.2011,(第3期), * |
Also Published As
Publication number | Publication date |
---|---|
CN111510338A (en) | 2020-08-07 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN111510338B (en) | Distributed block storage network sub-health test method, device and storage medium | |
CN106034051B (en) | Network monitoring data processing method and network monitoring data processing unit | |
CN112468372B (en) | Method and device for detecting equipment state in power line communication network | |
JP7037066B2 (en) | Evaluation device, evaluation method and evaluation program | |
CN107070752B (en) | Testing method and testing system for long connection capacity | |
CN101702811A (en) | Monitoring method and device for quality of service | |
CN105306306A (en) | Link connectivity detection system and method | |
RU2602977C2 (en) | Method for detecting correctness of optic fibre connection based on radio remote unit (rru) looped network and base band unit (bbu) | |
US20170206125A1 (en) | Monitoring system, monitoring device, and monitoring program | |
CN109120539B (en) | Method and device for realizing data transmission processing | |
CN105049238A (en) | Redundancy backup method and equipment for LTE (Long Term Evolution) gateway equipment exchange subsystem | |
CN111314290B (en) | Method and device for WEB application firewall service continuity protection and electronic equipment | |
CN110224872A (en) | A kind of communication means, device and storage medium | |
CN115037651A (en) | RDMA bandwidth transmission testing method, system and storage medium | |
CN113708978B (en) | Network availability test method and device, computer equipment and storage medium | |
CN112165495B (en) | DDoS attack prevention method and device based on super-fusion architecture and super-fusion cluster | |
CN115189910A (en) | Network digital twin-based deliberate attack survivability evaluation method | |
CN112433982A (en) | FPGA dynamic reconstruction method for ship public computing service terminal | |
Abbasi Zadeh et al. | Load migration in distributed softwarized network controllers | |
CN111741383A (en) | Automatic virtual system function verification platform and verification method | |
CN112671909A (en) | Application method and system of Internet of things rule chain | |
CN104243197A (en) | Data transmitting method and system and virtual storage gateways | |
CN107786357B (en) | Interface performance test method and device and network equipment | |
CN112463445B (en) | Link recovery method, device, equipment and computer readable storage medium | |
CN114338525B (en) | Automatic route aggregation method and device, electronic equipment and storage medium |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant |