CN105630416B - Disk method and device is kicked in a kind of cloud storage system - Google Patents
Disk method and device is kicked in a kind of cloud storage system Download PDFInfo
- Publication number
- CN105630416B CN105630416B CN201510981752.5A CN201510981752A CN105630416B CN 105630416 B CN105630416 B CN 105630416B CN 201510981752 A CN201510981752 A CN 201510981752A CN 105630416 B CN105630416 B CN 105630416B
- Authority
- CN
- China
- Prior art keywords
- disk
- threshold
- data
- queue
- write
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
- G06F3/061—Improving I/O performance
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F21/00—Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
- G06F21/50—Monitoring users, programs or devices to maintain the integrity of platforms, e.g. of processors, firmware or operating systems
- G06F21/57—Certifying or maintaining trusted computer platforms, e.g. secure boots or power-downs, version controls, system software checks, secure updates or assessing vulnerabilities
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
- G06F3/0629—Configuration or reconfiguration of storage systems
- G06F3/0634—Configuration or reconfiguration of storage systems by changing the state or mode of one or more devices
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0668—Interfaces specially adapted for storage systems adopting a particular infrastructure
- G06F3/067—Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Human Computer Interaction (AREA)
- Computer Hardware Design (AREA)
- Computer Security & Cryptography (AREA)
- Software Systems (AREA)
- Debugging And Monitoring (AREA)
Abstract
This application discloses disk method is kicked in a kind of cloud storage system, every piece of disk first threshold and second threshold are set in cloud storage system, the first threshold is that the max-thresholds of data queue are written, and second threshold is the minimum write performance threshold value of disk；The number of tasks blocked in data write-in queue is found out more than or equal to first threshold and writing speed is less than or equal to second threshold disk, the disk is kicked out of into cloud storage system.Application scheme can influence the performance of cloud storage system to avoid the disk that writing speed is greatly reduced.
Description
Technical field
This application involves kick disk method and device in cloud storage technical field more particularly to a kind of cloud storage system.
Background technology
The scale of cloud storage system is bigger, and number of nodes is more, and the number of disks of the cloud storage system is more, for low-quality disk
And the management of the exception such as slow disk is more difficult.Most of cloud storage system be all only in the case where disk breaks down completely,
It could detect and make corresponding operation.If disk be in will badly but not bad situation, the writing speed of disk is relative to just
Normal disk is greatly reduced, but does not do any processing for these " slow disks ".These so-called " slow disks " will influence whole
The performance of a cloud storage system.
Invention content
This application provides disk method and device is kicked in a kind of cloud storage system, can be greatly reduced to avoid writing speed
Disk influence cloud storage system performance.
Disk method is kicked in a kind of cloud storage system provided by the embodiments of the present application, including：
A, every piece of disk first threshold and second threshold are set in cloud storage system, the first threshold is write-in data
The max-thresholds of queue, second threshold are the minimum write performance threshold value of disk；
B, the number of tasks blocked in data write-in queue is found out in cloud storage system to be greater than or equal to first threshold and write
Enter speed and be less than or equal to second threshold disk, the disk is kicked out of into cloud storage system.
Optionally, step B includes：
The write-in data queue of each piece of hard disk of each data memory node in B1, monitoring cloud storage system；It is all
Writing task enter data write-in queue and be lined up, the number of tasks blocked in queue, which is written, to data counts；
B2, judge whether the number of tasks blocked in data write-in queue is greater than or equal to first threshold, if so, being directed to data
The disk that the number of tasks blocked in write-in queue is more than first threshold executes step B3, otherwise return to step B1；
B3, the disk writing speed is obtained, judges whether said write speed is less than or equal to second threshold, if so,
Step B4 is executed, otherwise return to step B1；
B4, the disk is kicked out of into cloud storage system, is then back to step B1.
Optionally, any value of the first threshold value between 500-1000.
Optionally, the second threshold value range is 1MB/s to 5MB/s.
Optionally, in same cloud storage system, first threshold and the second threshold difference of the disk of same model are equal.
The embodiment of the present application also provides disk policy enforcement means are kicked in a kind of cloud storage system, which is located at data
Memory node, including：
Threshold setting module, for every piece of disk first threshold and second threshold to be arranged, the first threshold is write-in number
According to the max-thresholds of queue, second threshold is the minimum write performance threshold value of disk；
Data queue's maintenance module is written, the write-in data queue of each piece of hard disk for supervising data storage node；
All writing tasks enter data write-in queue and are lined up, and the number of tasks blocked in queue, which is written, to data counts；
Judgment module, for judging whether the number of tasks blocked in the data write-in queue is greater than or equal to the first threshold
Value obtains the disk write-in speed if so, being more than the disk of first threshold for the number of tasks blocked in data write-in queue
Degree, judges whether said write speed is less than or equal to second threshold, if so, by the identification notification execution module of the disk；
Execution module, for according to the disk mark from judgment module, the disk being identified corresponding disk and is kicked out of
Cloud storage system.
Optionally, any value of the first threshold value between 500-1000.
Optionally, the second threshold value range is 1MB/s to 5MB/s.
As can be seen from the above technical solutions, it is monitored by the write-in data queue to disk, and according to disk
Write performance comes whether comprehensive descision disk is normal, carries out kicking disk processing, the application side for the disk of low-quality disk or degraded performance
Case can be to handling in so-called " the slow disk " that will damage edge, it is ensured that the overall performance of cloud storage and safety.
Description of the drawings
Fig. 1 is to kick disk processing flow schematic diagram in cloud storage system provided by the embodiments of the present application.
Specific implementation mode
This application provides disk method is kicked in a kind of cloud storage system, fundamental design idea is：By to disk
Whether write-in data queue is monitored, and normal come comprehensive descision disk according to the write performance of disk, for low-quality disk or
The disk of degraded performance carries out kicking disk processing.Specifically,
A, every piece of disk first threshold and second threshold are set in cloud storage system, the first threshold is write-in data
The max-thresholds of queue, second threshold are the minimum write performance threshold value of disk；
B, the number of tasks blocked in data write-in queue is found out in cloud storage system to be greater than or equal to first threshold and write
Enter speed and be less than or equal to second threshold disk, the disk is kicked out of into cloud storage system.
To keep the technical principle, feature and technique effect of technical scheme clearer, below in conjunction with specific reality
Example is applied technical scheme is described in detail.
Disk process flow is kicked as shown in Figure 1, including the following steps in cloud storage system provided by the embodiments of the present application：
Step 101：Every piece of disk first threshold and second threshold are set in cloud storage system, and the first threshold is to write
Enter the max-thresholds of data queue " write_queue ", second threshold is the minimum write performance threshold value of disk；
Step 102：Monitor the write-in data queue of each piece of hard disk of each data memory node in cloud storage system
"write_queue"；All writing tasks enter data write-in queue and are lined up, to data be written in queue the number of tasks blocked into
Row statistics；
Step 103：Judge whether the number of tasks blocked in data write-in queue is greater than or equal to first threshold, if so, needle
Data are written with the disk execution step 104 that the number of tasks blocked in queue is more than first threshold, otherwise return to step 102；
Step 104：The disk writing speed is obtained, judges whether said write speed is less than or equal to second threshold,
If so, executing step 105, otherwise return to step 102.
Step 105：The disk is kicked out of into cloud storage system.It is then back to step 102, continues the feelings for monitoring other disks
Condition.
The setting of above all threshold values can be automatically configured by parameter mode when data storage service starts；
First threshold is the number of tasks being written in data queue " write_queue ", disk when considering data write-in
Whether read-write is busy and the states such as network delay, any value of the usual value of first threshold between 500-1000；
Second threshold is the minimum write performance threshold value of disk, mainly according in the theoretical value of disk and practical application
Actual readwrite performance considers on every piece of disk, and the value range that second threshold is usually arranged is 1MB/s to 5MB/s.For example,
It can set second threshold to 2MB/s.
In general, the same cloud storage system uses the disk of same model, therefore all first thresholds can be made
And second threshold value is consistent.It, can be according to difference if being used in mixed way various types of disks in cloud storage system
The performance of model disk is different, is adjusted to first threshold and/or second threshold.
When the operating system that another embodiment of the application gives data memory node is Linux system, disk write is obtained
Enter the method for speed, including：
The write performance when front disk is obtained from/proc/diskstats.
Obtaining disk speed performance order is：
cat/proc/diskstats|grep-E sda|awk'{print$3""$6""$10}'
2 data are obtained using the order interval time t, the difference divided by time t between 2 data are exactly current magnetic
The writing speed of disk." sda " in order line is the disc identifier that data queue is written and is more than threshold value and continues to increase.
The embodiment of the present application also provides disk policy enforcement means are kicked in a kind of cloud storage system, which is located at data
Memory node, including：
Threshold setting module, for every piece of disk first threshold and second threshold to be arranged, the first threshold is write-in number
According to the max-thresholds of queue, second threshold is the minimum write performance threshold value of disk；
Data queue's maintenance module is written, the write-in data queue of each piece of hard disk for supervising data storage node；
All writing tasks enter data write-in queue and are lined up, and the number of tasks blocked in queue, which is written, to data counts；
Judgment module, for judging whether the number of tasks blocked in the data write-in queue is greater than or equal to the first threshold
Value obtains the disk write-in speed if so, being more than the disk of first threshold for the number of tasks blocked in data write-in queue
Degree, judges whether said write speed is less than or equal to second threshold, if so, by the identification notification execution module of the disk；
Execution module, for according to the disk mark from judgment module, the disk being identified corresponding disk and is kicked out of
Cloud storage system.
Optionally, any value of the first threshold value between 500-1000.
Optionally, the second threshold value range is 1MB/s to 5MB/s.
It should be appreciated that although this specification is described according to each embodiment, not each embodiment is only wrapped
Containing an independent technical solution, this description of the specification is merely for the sake of clarity, and those skilled in the art should
It considers the specification as a whole, the technical solution in each embodiment may also be suitably combined to form people in the art
The other embodiment that member is appreciated that.
The foregoing is merely the preferred embodiments of the application, not to limit the protection domain of the application, it is all
Within the spirit and principle of technical scheme, any modification, equivalent substitution, improvement and etc. done should be included in this Shen
Within the scope of please protecting.
Claims (8)
1. kicking disk method in a kind of cloud storage system, which is characterized in that including
A, every piece of disk first threshold and second threshold are set in cloud storage system, the first threshold is write-in data queue
Max-thresholds, second threshold be the minimum write performance threshold value of disk；
B, the number of tasks blocked in data write-in queue is found out in cloud storage system is greater than or equal to first threshold and write-in speed
Degree is less than or equal to second threshold disk, and the disk is kicked out of cloud storage system.
2. according to the method described in claim 1, which is characterized in that step B includes：
The write-in data queue of each piece of hard disk of each data memory node in B1, monitoring cloud storage system；All writes
Task enters data write-in queue and is lined up, and the number of tasks blocked in queue, which is written, to data counts；
B2, judge whether the number of tasks blocked in data write-in queue is greater than or equal to first threshold, if so, being written for data
The disk that the number of tasks blocked in queue is more than first threshold executes step B3, otherwise return to step B1；
B3, the disk writing speed is obtained, judges whether said write speed is less than or equal to second threshold, if so, executing
Step B4, otherwise return to step B1；
B4, the disk is kicked out of into cloud storage system, is then back to step B1.
3. method according to claim 1 or 2, which is characterized in that the first threshold value is between 500-1000
Any value.
4. method according to claim 1 or 2, which is characterized in that the second threshold value range is 1MB/s to 5MB/
s。
5. method according to claim 1 or 2, which is characterized in that in same cloud storage system, the disk of same model
First threshold and second threshold difference are equal.
6. kicking disk policy enforcement means in a kind of cloud storage system, which is characterized in that the device is located at data memory node, packet
It includes：
Threshold setting module, for every piece of disk first threshold and second threshold to be arranged, the first threshold is write-in data team
The max-thresholds of row, second threshold are the minimum write performance threshold value of disk；
Data queue's maintenance module is written, the write-in data queue of each piece of hard disk for supervising data storage node；It is all
Writing task enter data write-in queue and be lined up, the number of tasks blocked in queue, which is written, to data counts；
Judgment module, for judging whether the number of tasks blocked in the data write-in queue is greater than or equal to first threshold, if
It is that the disk that the number of tasks blocked in queue is more than first threshold is written for data, obtains the disk writing speed, judge
Whether said write speed is less than or equal to second threshold, if so, by the identification notification execution module of the disk；
Execution module, for according to the disk mark from judgment module, the corresponding disk of disk mark being kicked out of cloud and is deposited
Storage system.
7. device according to claim 6, which is characterized in that any of the first threshold value between 500-1000
Value.
8. device according to claim 6, which is characterized in that the second threshold value range is 1MB/s to 5MB/s.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510981752.5A CN105630416B (en) | 2015-12-24 | 2015-12-24 | Disk method and device is kicked in a kind of cloud storage system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510981752.5A CN105630416B (en) | 2015-12-24 | 2015-12-24 | Disk method and device is kicked in a kind of cloud storage system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN105630416A CN105630416A (en) | 2016-06-01 |
| CN105630416B true CN105630416B (en) | 2018-10-26 |
Family
ID=56045414
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510981752.5A Active CN105630416B (en) | 2015-12-24 | 2015-12-24 | Disk method and device is kicked in a kind of cloud storage system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN105630416B (en) |
Families Citing this family (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108319527B (en) * | 2017-12-21 | 2021-08-24 | 深圳创新科技术有限公司 | Bad track disk detection method and device |
| CN110515535B (en) * | 2018-05-22 | 2021-01-01 | 杭州海康威视数字技术股份有限公司 | Hard disk read-write control method and device, electronic equipment and storage medium |
| CN109684140B (en) * | 2018-12-11 | 2022-07-01 | 广东浪潮大数据研究有限公司 | Slow disk detection method, device and equipment and computer readable storage medium |
| CN110196884B (en) * | 2019-05-31 | 2022-04-29 | 北京大米科技有限公司 | Data writing method based on distributed database, storage medium and electronic equipment |
Family Cites Families (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102214073A (en) * | 2010-04-08 | 2011-10-12 | 杭州华三通信技术有限公司 | Hot spare switching control method of redundant array of independent disks (RAID) and controller |
| CN103019623B (en) * | 2012-12-10 | 2016-01-20 | 华为技术有限公司 | Memory disc disposal route and device |
| CN103488544B (en) * | 2013-09-26 | 2016-08-17 | 华为技术有限公司 | Detect the treating method and apparatus of slow dish |
-
2015
- 2015-12-24 CN CN201510981752.5A patent/CN105630416B/en active Active
Also Published As
| Publication number | Publication date |
|---|---|
| CN105630416A (en) | 2016-06-01 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN105630416B (en) | Disk method and device is kicked in a kind of cloud storage system | |
| US12013940B2 (en) | Automatic detection of software that performs unauthorized privilege escalation | |
| CN102254120B (en) | Method, system and relevant device for detecting malicious codes | |
| US20160028757A1 (en) | Cross-user correlation for detecting server-side multi-target intrusion | |
| CN109428913B (en) | Storage capacity expansion method and device | |
| WO2017173927A1 (en) | Method and device for detecting and processing hard disk hanging fault in distributed storage system | |
| CN106502814B (en) | Method and device for recording error information of PCIE (peripheral component interface express) equipment | |
| CN104205113B (en) | Rogue activity is reported to operating system | |
| WO2016202040A1 (en) | Pcie-based sub-card hot plugging method and apparatus | |
| CN107544755B (en) | Data read-write control method and device | |
| CN105320884A (en) | Security protection method and system for virtual machine | |
| US20150286514A1 (en) | Implementing tiered predictive failure analysis at domain intersections | |
| CN104657088B (en) | A kind of acquisition methods and device of hard disk bad block message | |
| US9304955B2 (en) | Techniques for identifying and handling processor interrupts | |
| CN102981939A (en) | Disc monitoring method | |
| CN110659147A (en) | Self-repairing method and system based on module self-checking behavior | |
| JP5689783B2 (en) | Computer, computer system, and failure information management method | |
| CN110515756A (en) | Fault prevention method, device, equipment and storage medium of storage system | |
| CN114556338A (en) | Malware identification | |
| CN106503250B (en) | A kind of log tracks method and apparatus | |
| US8589722B2 (en) | Methods and structure for storing errors for error recovery in a hardware controller | |
| JP2024506157A (en) | Malware detection system | |
| WO2021144978A1 (en) | Attack estimation device, attack estimation method, and attack estimation program | |
| CN113485872A (en) | Fault processing method and device and distributed storage system | |
| KR101310070B1 (en) | Method for preventing collision between each programs and recording-medium recorded program thereof |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| CP01 | Change in the name or title of a patent holder |
Address after: 518057 Shenzhen Software Park, No. 9, 501, 502, Science and Technology Middle Road, Nanshan District, Shenzhen City, Guangdong Province Co-patentee after: Shenzhen Innovation Software Technology Co., Ltd. Patentee after: Shenzhen Innovation Technology Co., Ltd. Address before: 518057 Shenzhen Software Park, No. 9, 501, 502, Science and Technology Middle Road, Nanshan District, Shenzhen City, Guangdong Province Co-patentee before: Chuangxinke Software Technology (Shenzhen) Co., Ltd. Patentee before: UIT Storage Technology (Shenzhen) Co., Ltd. |
|
| CP01 | Change in the name or title of a patent holder |