CN103067485A - Disk monitoring method for cloud storage system - Google Patents
Disk monitoring method for cloud storage system Download PDFInfo
- Publication number
- CN103067485A CN103067485A CN201210570758XA CN201210570758A CN103067485A CN 103067485 A CN103067485 A CN 103067485A CN 201210570758X A CN201210570758X A CN 201210570758XA CN 201210570758 A CN201210570758 A CN 201210570758A CN 103067485 A CN103067485 A CN 103067485A
- Authority
- CN
- China
- Prior art keywords
- disk
- state information
- management node
- node
- state
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Landscapes
- Debugging And Monitoring (AREA)
Abstract
The invention provides a disk monitoring method for a cloud storage system. The disk monitoring method for the cloud storage system includes that each service node of a plurality of service nodes sends disk state information to a management node at a predetermined period; and a disk information log sheet corresponding to disks of the plurality of service nodes is established by the management node, a disk state of a corresponding disk in the disk information log sheet is updated according to received disk state information by the management node. According to the disk monitoring method for the cloud storage system, the disk state information is sent to the management node at the predetermined period through the service nodes in the cloud storage system run process, and therefore the disk information log sheet can be timely updated by the management node, the disk state is monitored in real time with the method, and data security in the cloud storage system is guaranteed.
Description
Technical field
Relate generally to field of computer technology of the present invention more specifically, relates to the disk method for supervising for cloud storage system.
Background technology
The monitoring of disk is the importance of cloud storage system management in the cloud storage system, several aspects such as management and disk performance monitoring that the monitoring of cloud storage system disk comprises the detection of disk availability, disk initialization preparation, disk type management, disk is reached the standard grade and disk rolls off the production line.In the process of disposing cloud storage system, need to detect automatically the available disk of each service node, use and the purposes of the customization node disk that also can use according to reality are such as the setting of the disk of the disk of Metadata Service node storing metadata and storing daily record.
All be accompanied by the monitoring of disk in the process that the deployment of storage system is installed, moved and close, under extensive cloud storage system environment, disk number in the system can reach disk thousands of even up to ten thousand, relies on the cost of keeper's manual management and maintenance very high, and operate miss may occur.
The disk management of existing cloud storage system lacks the automation of available disk automatic detection and disk to be prepared, and need to finish by hand the preparation of disk before disposing cloud storage system.In the running of cloud storage system, by write find often by disk failure for the disabled detection of disk, and there is hysteresis quality in the discovery of disk event, and this also can have influence on Information Security.In addition, perfect not enough to disk location and Disk State displaying aspect in the existing cloud storage system management, the problem of disk can't be navigated to efficiently by administration interface, and the real-time status (comprise the node slot to lack that dish, disk roll off the production line, disk is reached the standard grade stand-by, disk with states such as, disk are bad) of disk can be observed intuitively.
Summary of the invention
There is hysteresis quality for disk detection in the prior art, can't navigates to efficiently by administration interface the problem of disk, and can not observe intuitively the defective of the real-time status of disk, the present invention proposes the disk method for supervising that can address the aforementioned drawbacks.
The invention provides a kind of disk method for supervising for cloud storage system, comprising: each service node in a plurality of service nodes sends Disk State information with predetermined period to management node; And management node sets up the disc information record sheet corresponding with the disk of a plurality of service nodes, and according to the Disk State of corresponding disk in the Disk State information updating disc information record sheet that receives.
Preferably, the disk method for supervising also comprises: client node sends the query requests of the Disk State that is used to indicate the one or more disks of inquiry to management node; And the inquiry response that management node will have a corresponding Disk State of one or more disks feeds back to client node.
Preferably, service node is after starting and before management node transmission Disk State information, the disk monitoring module of service node obtains the Disk State of service node; And the disk processing module of service node generates Disk State information according to Disk State.
Preferably, Disk State comprises: disk normal condition and disk abnormality.
Preferably, the disk abnormality comprises: disk is extracted, disk adds, disk unloads and the disk carry.
Preferably, Disk State information also comprises: the magnetic disc ID corresponding with the disk position.
Preferably, be in the situation of disk normal condition at Disk State, Disk State information also comprises: disk performance.
Preferably, the disk method for supervising also comprises: management node carries out corresponding operating according to the Disk State Information Selection to the disk that is in the disk abnormality and reports to the police.
Preferably, corresponding operating further comprises: the disk operating of rolling off the production line, add disk operating and the disk operating of reaching the standard grade.
Preferably, management node shows Disk State and corresponding disk position thereof the form with the disk distribution map according to Disk State information.
Preferably, disk performance comprises disk resource utilance, read-write attribute and read or write speed.
Preferably, management node also shows the performance of each disk with graphic form according to Disk State information.
Utilize disk disk method for supervising of the present invention, can be in the running of cloud storage system, the Real Time Monitoring Disk State, thus guarantee Information Security.Inquire about Disk State at client node by carrying out information interaction with management node.In addition, cloud storage system can in time operate disk accordingly, therefore can guarantee the integrality of cloud storage system disk when node is restarted.To disk location and Disk State displaying, can navigate to efficiently by administration interface the problem of disk, and can observe intuitively the real-time status of disk in the perfect cloud storage system management.
Other features and advantages of the present invention will be set forth in the following description, and, partly from specification, become apparent, perhaps understand by implementing the present invention.Purpose of the present invention and other advantages can realize and obtain by specifically noted structure in the specification of writing, claims and accompanying drawing.
Description of drawings
Below in conjunction with accompanying drawing the preferred embodiments of the present invention are described, should be appreciated that preferred embodiment described herein only is used for description and interpretation the present invention, is not intended to limit the present invention.In the accompanying drawings:
Fig. 1 is the overall flow figure of disk method for supervising according to an embodiment of the invention;
Fig. 2 is the particular flow sheet of disk method for supervising according to an embodiment of the invention; And
Fig. 3 is Disk State transition diagram according to an embodiment of the invention.
Embodiment
Below in conjunction with accompanying drawing the preferred embodiments of the present invention are described, should be appreciated that preferred embodiment described herein only is used for description and interpretation the present invention, is not intended to limit the present invention.
Fig. 1 is the overall flow figure of disk method for supervising according to an embodiment of the invention.Disk method for supervising 100 comprises: step S102, and each service node in a plurality of service nodes sends Disk State information with predetermined period to management node; Step 104, management node are set up the disc information record sheet corresponding with the disk of a plurality of service nodes, and according to the Disk State of corresponding disk in the Disk State information updating disc information record sheet that receives.
Utilize disk method for supervising of the present invention can automatically finish the disk monitoring.In the cloud storage system running, send Disk State information with predetermined period to management node by service node, and the management node disc information record sheet that upgrades in time, thereby Real Time Monitoring Disk State by this way guarantee the Information Security in the cloud storage system.
Fig. 2 is the particular flow sheet of disk method for supervising according to an embodiment of the invention.Disk method for supervising 200 may further comprise the steps, and in step 202, service node is after starting and before sending Disk State information to management node, the disk monitoring module of service node obtains the Disk State of service node.Wherein, Disk State comprises disk normal condition and disk abnormality, and the disk abnormality comprises: disk is extracted, disk adds, disk unloads (that is, deletion disk path) and disk carry (that is, being the disk allocation path).In step 204, the disk processing module of service node generates Disk State information according to Disk State.Service node generates corresponding Disk State information according to above-mentioned Disk State, and Disk State information also comprises the magnetic disc ID corresponding with the disk position.This magnetic disc ID is general unique identification code UUID (Universally Uniqe Identifier).
In step 206, each service node in a plurality of service nodes sends Disk State information with predetermined period to management node.In step 208, management node is set up the disc information record sheet corresponding with the disk of a plurality of service nodes, and according to the Disk State of corresponding disk in the Disk State information updating disc information record sheet that receives.Particularly, management node is according to Disk State information real-time update disc information record sheet, and then in time grasps the Disk State of each service node.
In step 210, client node sends the query requests of the Disk State that is used to indicate the one or more disks of inquiry to management node.In step 212, the inquiry response that management node will have the corresponding Disk State of one or more disks feeds back to client node.Particularly, management node can directly offer client node with Disk State, and does not need management node after receiving query requests, and the access services node obtains Disk State.
In addition, the disk method for supervising can also comprise: management node carries out corresponding operating according to the Disk State Information Selection to the disk that is in the disk abnormality and reports to the police.Wherein, corresponding operating further comprises the disk operating of rolling off the production line, adds disk operating and the disk operating of reaching the standard grade.Management node is identified this Disk State information after receiving Disk State information, then according to recognition result the disk that is in abnormality is operated accordingly.For example, extract state if a certain disk is in disk, then management node is deleted this disk, namely to the disk operating of rolling off the production line of this disk.Because cloud storage system in time operates accordingly to disk, therefore when restarting, node can guarantee the integrality of cloud storage system disk.
Fig. 3 is Disk State transition diagram according to an embodiment of the invention.The concrete meaning of each state in the Disk State transition diagram as described in Figure 3 is as follows:
INIT: disk newly adds, and does not add storage system.
OK: disk has added storage system and nothing is unusual.
OFFLINE (disk rolls off the production line): disk is pulled out, within the time of appointment, do not turn back to, then storage system can be deleted this disk, otherwise storage system waits for that this disk is turned back to, after disk is turned back to, need the order by diskonline (disk is reached the standard grade), the notice storage system, disk is reached the standard grade again.
WAIT ADD: disk can be added into system again, and trigger condition is the add event.
WAIT UMOUNT: under the OFFLINE state, add (interpolation) event arrives with umount (unloading) event first, in this case, drive can may change, UUID can not change (generally, considering in the situation that disk UUID may be reset that system can give and be kept on the disk for unique UUID of disk allocation number, to distinguish).
Management node shows Disk State and corresponding disk position thereof the form with the disk distribution map according to Disk State information.Comprise magnetic disc ID in the Disk State information, that is, UUID, so this UUID is corresponding with the disk physical location of special services node in the cloud storage system, that is, corresponding with the concrete slot position of disk in service node.Therefore show each Disk State and corresponding disk position thereof in the cloud storage system at the disk distribution map.As long as thereby check the disk distribution map, just can accurately locate the concrete physical location of the disk that is in abnormality.
Management node also shows the performance of each disk with graphic form according to Disk State information.Be in the situation of disk normal condition at Disk State, Disk State information also comprises disk performance.Wherein, disk performance comprises disk resource utilance, read-write attribute and read or write speed.For example, the disk management interface can show disk resource utilance, read-write attribute and read-write speed by pie chart or column diagram graphical form.Therefore, the user can check according to these figures the specific object index of particular disk.
Utilize this disk method for supervising can in the cloud storage system running, automatically carry out the Disk State monitoring, thereby can guarantee the data security in the cloud storage system.During client node inquiry Disk State, management node can inquire about the disc information record sheet and with corresponding Disk State rapid feedback to client node.Cloud storage system can in time operate disk accordingly, therefore can guarantee the integrality of cloud storage system disk when node is restarted.In addition, this disk method for supervising is perfect disk management interface, namely can navigate to efficiently by administration interface the problem of disk, can observe intuitively by administration interface again the real-time status (comprise the node slot to lack that dish, disk roll off the production line, disk is reached the standard grade stand-by, disk with states such as, disk are bad) of disk.
Be the preferred embodiments of the present invention only below, be not limited to the present invention, for a person skilled in the art, the present invention can have various modifications and variations.Within the spirit and principles in the present invention all, any modification of doing, be equal to replacement, improvement etc., all should be included within protection scope of the present invention.
Claims (12)
1. a disk method for supervising that is used for cloud storage system is characterized in that, comprising:
Each service node in described a plurality of service node sends Disk State information with predetermined period to management node; And
Described management node is set up the disc information record sheet corresponding with the disk of a plurality of service nodes, and according to the Disk State of corresponding described disk in the described disc information record sheet of the Disk State information updating that receives.
2. disk method for supervising according to claim 1 is characterized in that, also comprises:
Client node sends the query requests of the Disk State that is used to indicate the one or more described disks of inquiry to described management node; And
The inquiry response that described management node will have the corresponding described Disk State of one or more described disks feeds back to described client node.
3. disk method for supervising according to claim 1 is characterized in that, described service node after starting and before sending described Disk State information to described management node,
The disk monitoring module of described service node obtains the Disk State of described service node; And
The disk processing module of described service node generates described Disk State information according to described Disk State.
4. disk method for supervising according to claim 3 is characterized in that, described Disk State comprises: disk normal condition and disk abnormality.
5. disk method for supervising according to claim 4 is characterized in that, described disk abnormality comprises: disk is extracted, disk adds, disk unloads and the disk carry.
6. disk method for supervising according to claim 5 is characterized in that, described Disk State information also comprises: the magnetic disc ID corresponding with described disk position.
7. disk method for supervising according to claim 4 is characterized in that, is in the situation of described disk normal condition at described Disk State, and described Disk State information also comprises: disk performance.
8. disk method for supervising according to claim 4 is characterized in that, also comprises: described management node carries out corresponding operating according to described Disk State Information Selection to the disk that is in described disk abnormality and reports to the police.
9. disk method for supervising according to claim 8 is characterized in that, described corresponding operating further comprises: the disk operating of rolling off the production line, add disk operating and the disk operating of reaching the standard grade.
10. disk method for supervising according to claim 6 is characterized in that, described management node shows described Disk State and corresponding described disk position thereof the form with the disk distribution map according to described Disk State information.
11. disk method for supervising according to claim 7 is characterized in that described disk performance comprises disk resource utilance, read-write attribute and read or write speed.
12. disk method for supervising according to claim 11 is characterized in that, described management node also shows the performance of each described disk with graphic form according to described Disk State information.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201210570758XA CN103067485A (en) | 2012-12-25 | 2012-12-25 | Disk monitoring method for cloud storage system |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201210570758XA CN103067485A (en) | 2012-12-25 | 2012-12-25 | Disk monitoring method for cloud storage system |
Publications (1)
Publication Number | Publication Date |
---|---|
CN103067485A true CN103067485A (en) | 2013-04-24 |
Family
ID=48109939
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201210570758XA Pending CN103067485A (en) | 2012-12-25 | 2012-12-25 | Disk monitoring method for cloud storage system |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN103067485A (en) |
Cited By (15)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN103729146A (en) * | 2013-12-19 | 2014-04-16 | 浪潮(北京)电子信息产业有限公司 | Method and system for quickly positioning magnetic disks of mass storage systems |
CN104035728A (en) * | 2014-03-31 | 2014-09-10 | 深圳英飞拓科技股份有限公司 | Hard disk hot plug handling method, device and node |
CN105242998A (en) * | 2015-09-01 | 2016-01-13 | 福建新大陆软件工程有限公司 | HDFS (Hadoop Distributed File System) based disk fault detection method and system |
CN105373549A (en) * | 2014-08-25 | 2016-03-02 | 浙江大华技术股份有限公司 | Data migration method and device and data node server |
CN105847358A (en) * | 2016-03-24 | 2016-08-10 | 广东三盟信息科技有限公司 | Method for realizing big data node distribution in cloud computing environment and system thereof |
CN106528005A (en) * | 2017-01-12 | 2017-03-22 | 郑州云海信息技术有限公司 | Disk adding method and device for distributed type storage system |
CN107368261A (en) * | 2017-07-20 | 2017-11-21 | 郑州云海信息技术有限公司 | A kind of hard disk management method and system |
CN107577545A (en) * | 2016-07-05 | 2018-01-12 | 北京金山云网络技术有限公司 | A kind of failed disk detection and restorative procedure and device |
CN108733500A (en) * | 2017-04-13 | 2018-11-02 | 阿里巴巴集团控股有限公司 | Fault Locating Method and device, the generation method of correspondence and device |
CN110109790A (en) * | 2019-05-13 | 2019-08-09 | 深圳前海微众银行股份有限公司 | Server hard disc management method, device, equipment and computer readable storage medium |
CN110502401A (en) * | 2019-08-27 | 2019-11-26 | 中国工商银行股份有限公司 | For monitoring the method, apparatus, system and medium of disk performance |
CN111381766A (en) * | 2018-12-28 | 2020-07-07 | 杭州海康威视系统技术有限公司 | Method for dynamically loading disk and cloud storage system |
CN112118030A (en) * | 2020-08-27 | 2020-12-22 | 深圳市力合微电子股份有限公司 | Pre-response method suitable for pan DALI system |
CN113778753A (en) * | 2021-09-14 | 2021-12-10 | 杭州沃趣科技股份有限公司 | Method, device, equipment and medium for automatically correcting database after storage recovery |
CN114428709A (en) * | 2022-01-17 | 2022-05-03 | 广州鲁邦通物联网科技股份有限公司 | SDS state detection method and system in cloud management platform |
Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN1929410A (en) * | 2006-09-04 | 2007-03-14 | 曙光信息产业(北京)有限公司 | Intelligent computers group monitoring method |
CN1929411A (en) * | 2006-09-04 | 2007-03-14 | 曙光信息产业(北京)有限公司 | Intelligent computers group monitoring method |
CN101764846A (en) * | 2009-12-18 | 2010-06-30 | 西南交通大学 | Remote centralized disk array operation monitoring system and implement method thereof |
CN102143215A (en) * | 2011-01-20 | 2011-08-03 | 中国人民解放军理工大学 | Network-based PB level cloud storage system and processing method thereof |
-
2012
- 2012-12-25 CN CN201210570758XA patent/CN103067485A/en active Pending
Patent Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN1929410A (en) * | 2006-09-04 | 2007-03-14 | 曙光信息产业(北京)有限公司 | Intelligent computers group monitoring method |
CN1929411A (en) * | 2006-09-04 | 2007-03-14 | 曙光信息产业(北京)有限公司 | Intelligent computers group monitoring method |
CN101764846A (en) * | 2009-12-18 | 2010-06-30 | 西南交通大学 | Remote centralized disk array operation monitoring system and implement method thereof |
CN102143215A (en) * | 2011-01-20 | 2011-08-03 | 中国人民解放军理工大学 | Network-based PB level cloud storage system and processing method thereof |
Cited By (23)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN103729146A (en) * | 2013-12-19 | 2014-04-16 | 浪潮(北京)电子信息产业有限公司 | Method and system for quickly positioning magnetic disks of mass storage systems |
CN104035728A (en) * | 2014-03-31 | 2014-09-10 | 深圳英飞拓科技股份有限公司 | Hard disk hot plug handling method, device and node |
CN105373549B (en) * | 2014-08-25 | 2019-02-12 | 浙江大华技术股份有限公司 | Data migration method, equipment and back end server |
CN105373549A (en) * | 2014-08-25 | 2016-03-02 | 浙江大华技术股份有限公司 | Data migration method and device and data node server |
CN105242998A (en) * | 2015-09-01 | 2016-01-13 | 福建新大陆软件工程有限公司 | HDFS (Hadoop Distributed File System) based disk fault detection method and system |
CN105242998B (en) * | 2015-09-01 | 2019-05-14 | 福建新大陆软件工程有限公司 | A kind of disk failure detection method and system based on HDFS |
CN105847358A (en) * | 2016-03-24 | 2016-08-10 | 广东三盟信息科技有限公司 | Method for realizing big data node distribution in cloud computing environment and system thereof |
CN107577545B (en) * | 2016-07-05 | 2021-02-02 | 北京金山云网络技术有限公司 | Method and device for detecting and repairing fault disk |
CN107577545A (en) * | 2016-07-05 | 2018-01-12 | 北京金山云网络技术有限公司 | A kind of failed disk detection and restorative procedure and device |
CN106528005A (en) * | 2017-01-12 | 2017-03-22 | 郑州云海信息技术有限公司 | Disk adding method and device for distributed type storage system |
CN106528005B (en) * | 2017-01-12 | 2019-12-31 | 苏州浪潮智能科技有限公司 | Disk adding method and device of distributed storage system |
CN108733500A (en) * | 2017-04-13 | 2018-11-02 | 阿里巴巴集团控股有限公司 | Fault Locating Method and device, the generation method of correspondence and device |
CN107368261A (en) * | 2017-07-20 | 2017-11-21 | 郑州云海信息技术有限公司 | A kind of hard disk management method and system |
CN111381766A (en) * | 2018-12-28 | 2020-07-07 | 杭州海康威视系统技术有限公司 | Method for dynamically loading disk and cloud storage system |
CN111381766B (en) * | 2018-12-28 | 2022-08-02 | 杭州海康威视系统技术有限公司 | Method for dynamically loading disk and cloud storage system |
CN110109790A (en) * | 2019-05-13 | 2019-08-09 | 深圳前海微众银行股份有限公司 | Server hard disc management method, device, equipment and computer readable storage medium |
CN110109790B (en) * | 2019-05-13 | 2023-04-07 | 深圳前海微众银行股份有限公司 | Server hard disk management method, device, equipment and computer readable storage medium |
CN110502401A (en) * | 2019-08-27 | 2019-11-26 | 中国工商银行股份有限公司 | For monitoring the method, apparatus, system and medium of disk performance |
CN112118030A (en) * | 2020-08-27 | 2020-12-22 | 深圳市力合微电子股份有限公司 | Pre-response method suitable for pan DALI system |
CN112118030B (en) * | 2020-08-27 | 2022-02-11 | 深圳市力合微电子股份有限公司 | Pre-response method suitable for pan DALI system |
CN113778753A (en) * | 2021-09-14 | 2021-12-10 | 杭州沃趣科技股份有限公司 | Method, device, equipment and medium for automatically correcting database after storage recovery |
CN113778753B (en) * | 2021-09-14 | 2024-05-03 | 杭州沃趣科技股份有限公司 | Method, device, equipment and medium for automatically correcting database after storage recovery |
CN114428709A (en) * | 2022-01-17 | 2022-05-03 | 广州鲁邦通物联网科技股份有限公司 | SDS state detection method and system in cloud management platform |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN103067485A (en) | Disk monitoring method for cloud storage system | |
US11886707B2 (en) | Dataset space reclamation | |
CN101206581B (en) | System and method for guiding using external memory device | |
US7007144B2 (en) | Method, apparatus, and computer readable medium for managing back-up | |
JP4733461B2 (en) | Computer system, management computer, and logical storage area management method | |
CN102981931A (en) | Backup method and device for virtual machine | |
CN103036986A (en) | Update notification provided on distributed application object | |
CN103488793A (en) | User behavior monitoring method based on information retrieval | |
CN108170832B (en) | Monitoring system and monitoring method for heterogeneous database of industrial big data | |
CN103873288A (en) | System and method for positioning failures of communication network equipment based on alarm information | |
US10144131B2 (en) | Operation monitoring server and operation monitoring system | |
CN112269543B (en) | Storage logical volume management method, device and related components | |
CN110399171A (en) | A kind of hard disk management method, system and associated component | |
US11281550B2 (en) | Disaster recovery specific configurations, management, and application | |
CN115004662A (en) | Data synchronization method, data synchronization device, data storage system and computer readable medium | |
US20130024859A1 (en) | Control computer and data accessing method | |
CN103778024A (en) | Server system and message processing method thereof | |
CN110717130B (en) | Dotting method, dotting device, dotting terminal and storage medium | |
CN109542727B (en) | Information prompting method and device | |
CN111367880A (en) | Universal real-time data storage management system and implementation method thereof | |
JP4554949B2 (en) | Management computer and storage device management method | |
CN108459942A (en) | A kind of data processing method, device and storage medium | |
US8424019B1 (en) | Managing channel instances in a messaging-middleware environment | |
CN111506360B (en) | External equipment access system and method of real-time data processing system | |
US9189160B2 (en) | Transport agnostic sequential drive recovery with mode data snooping |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
C06 | Publication | ||
PB01 | Publication | ||
C10 | Entry into substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
C12 | Rejection of a patent application after its publication | ||
RJ01 | Rejection of invention patent application after publication |
Application publication date: 20130424 |