CN103067485A - Disk monitoring method for cloud storage system - Google Patents

Disk monitoring method for cloud storage system Download PDF

Info

Publication number
CN103067485A
CN103067485A CN201210570758XA CN201210570758A CN103067485A CN 103067485 A CN103067485 A CN 103067485A CN 201210570758X A CN201210570758X A CN 201210570758XA CN 201210570758 A CN201210570758 A CN 201210570758A CN 103067485 A CN103067485 A CN 103067485A
Authority
CN
China
Prior art keywords
disk
state information
management node
node
state
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201210570758XA
Other languages
Chinese (zh)
Inventor
张健
苗艳超
刘新春
邵宗有
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Dawning Information Industry Beijing Co Ltd
Original Assignee
Dawning Information Industry Beijing Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Dawning Information Industry Beijing Co Ltd filed Critical Dawning Information Industry Beijing Co Ltd
Priority to CN201210570758XA priority Critical patent/CN103067485A/en
Publication of CN103067485A publication Critical patent/CN103067485A/en
Pending legal-status Critical Current

Links

Images

Landscapes

  • Debugging And Monitoring (AREA)

Abstract

The invention provides a disk monitoring method for a cloud storage system. The disk monitoring method for the cloud storage system includes that each service node of a plurality of service nodes sends disk state information to a management node at a predetermined period; and a disk information log sheet corresponding to disks of the plurality of service nodes is established by the management node, a disk state of a corresponding disk in the disk information log sheet is updated according to received disk state information by the management node. According to the disk monitoring method for the cloud storage system, the disk state information is sent to the management node at the predetermined period through the service nodes in the cloud storage system run process, and therefore the disk information log sheet can be timely updated by the management node, the disk state is monitored in real time with the method, and data security in the cloud storage system is guaranteed.

Description

The disk method for supervising of cloud storage system
Technical field
Relate generally to field of computer technology of the present invention more specifically, relates to the disk method for supervising for cloud storage system.
Background technology
The monitoring of disk is the importance of cloud storage system management in the cloud storage system, several aspects such as management and disk performance monitoring that the monitoring of cloud storage system disk comprises the detection of disk availability, disk initialization preparation, disk type management, disk is reached the standard grade and disk rolls off the production line.In the process of disposing cloud storage system, need to detect automatically the available disk of each service node, use and the purposes of the customization node disk that also can use according to reality are such as the setting of the disk of the disk of Metadata Service node storing metadata and storing daily record.
All be accompanied by the monitoring of disk in the process that the deployment of storage system is installed, moved and close, under extensive cloud storage system environment, disk number in the system can reach disk thousands of even up to ten thousand, relies on the cost of keeper's manual management and maintenance very high, and operate miss may occur.
The disk management of existing cloud storage system lacks the automation of available disk automatic detection and disk to be prepared, and need to finish by hand the preparation of disk before disposing cloud storage system.In the running of cloud storage system, by write find often by disk failure for the disabled detection of disk, and there is hysteresis quality in the discovery of disk event, and this also can have influence on Information Security.In addition, perfect not enough to disk location and Disk State displaying aspect in the existing cloud storage system management, the problem of disk can't be navigated to efficiently by administration interface, and the real-time status (comprise the node slot to lack that dish, disk roll off the production line, disk is reached the standard grade stand-by, disk with states such as, disk are bad) of disk can be observed intuitively.
Summary of the invention
There is hysteresis quality for disk detection in the prior art, can't navigates to efficiently by administration interface the problem of disk, and can not observe intuitively the defective of the real-time status of disk, the present invention proposes the disk method for supervising that can address the aforementioned drawbacks.
The invention provides a kind of disk method for supervising for cloud storage system, comprising: each service node in a plurality of service nodes sends Disk State information with predetermined period to management node; And management node sets up the disc information record sheet corresponding with the disk of a plurality of service nodes, and according to the Disk State of corresponding disk in the Disk State information updating disc information record sheet that receives.
Preferably, the disk method for supervising also comprises: client node sends the query requests of the Disk State that is used to indicate the one or more disks of inquiry to management node; And the inquiry response that management node will have a corresponding Disk State of one or more disks feeds back to client node.
Preferably, service node is after starting and before management node transmission Disk State information, the disk monitoring module of service node obtains the Disk State of service node; And the disk processing module of service node generates Disk State information according to Disk State.
Preferably, Disk State comprises: disk normal condition and disk abnormality.
Preferably, the disk abnormality comprises: disk is extracted, disk adds, disk unloads and the disk carry.
Preferably, Disk State information also comprises: the magnetic disc ID corresponding with the disk position.
Preferably, be in the situation of disk normal condition at Disk State, Disk State information also comprises: disk performance.
Preferably, the disk method for supervising also comprises: management node carries out corresponding operating according to the Disk State Information Selection to the disk that is in the disk abnormality and reports to the police.
Preferably, corresponding operating further comprises: the disk operating of rolling off the production line, add disk operating and the disk operating of reaching the standard grade.
Preferably, management node shows Disk State and corresponding disk position thereof the form with the disk distribution map according to Disk State information.
Preferably, disk performance comprises disk resource utilance, read-write attribute and read or write speed.
Preferably, management node also shows the performance of each disk with graphic form according to Disk State information.
Utilize disk disk method for supervising of the present invention, can be in the running of cloud storage system, the Real Time Monitoring Disk State, thus guarantee Information Security.Inquire about Disk State at client node by carrying out information interaction with management node.In addition, cloud storage system can in time operate disk accordingly, therefore can guarantee the integrality of cloud storage system disk when node is restarted.To disk location and Disk State displaying, can navigate to efficiently by administration interface the problem of disk, and can observe intuitively the real-time status of disk in the perfect cloud storage system management.
Other features and advantages of the present invention will be set forth in the following description, and, partly from specification, become apparent, perhaps understand by implementing the present invention.Purpose of the present invention and other advantages can realize and obtain by specifically noted structure in the specification of writing, claims and accompanying drawing.
Description of drawings
Below in conjunction with accompanying drawing the preferred embodiments of the present invention are described, should be appreciated that preferred embodiment described herein only is used for description and interpretation the present invention, is not intended to limit the present invention.In the accompanying drawings:
Fig. 1 is the overall flow figure of disk method for supervising according to an embodiment of the invention;
Fig. 2 is the particular flow sheet of disk method for supervising according to an embodiment of the invention; And
Fig. 3 is Disk State transition diagram according to an embodiment of the invention.
Embodiment
Below in conjunction with accompanying drawing the preferred embodiments of the present invention are described, should be appreciated that preferred embodiment described herein only is used for description and interpretation the present invention, is not intended to limit the present invention.
Fig. 1 is the overall flow figure of disk method for supervising according to an embodiment of the invention.Disk method for supervising 100 comprises: step S102, and each service node in a plurality of service nodes sends Disk State information with predetermined period to management node; Step 104, management node are set up the disc information record sheet corresponding with the disk of a plurality of service nodes, and according to the Disk State of corresponding disk in the Disk State information updating disc information record sheet that receives.
Utilize disk method for supervising of the present invention can automatically finish the disk monitoring.In the cloud storage system running, send Disk State information with predetermined period to management node by service node, and the management node disc information record sheet that upgrades in time, thereby Real Time Monitoring Disk State by this way guarantee the Information Security in the cloud storage system.
Fig. 2 is the particular flow sheet of disk method for supervising according to an embodiment of the invention.Disk method for supervising 200 may further comprise the steps, and in step 202, service node is after starting and before sending Disk State information to management node, the disk monitoring module of service node obtains the Disk State of service node.Wherein, Disk State comprises disk normal condition and disk abnormality, and the disk abnormality comprises: disk is extracted, disk adds, disk unloads (that is, deletion disk path) and disk carry (that is, being the disk allocation path).In step 204, the disk processing module of service node generates Disk State information according to Disk State.Service node generates corresponding Disk State information according to above-mentioned Disk State, and Disk State information also comprises the magnetic disc ID corresponding with the disk position.This magnetic disc ID is general unique identification code UUID (Universally Uniqe Identifier).
In step 206, each service node in a plurality of service nodes sends Disk State information with predetermined period to management node.In step 208, management node is set up the disc information record sheet corresponding with the disk of a plurality of service nodes, and according to the Disk State of corresponding disk in the Disk State information updating disc information record sheet that receives.Particularly, management node is according to Disk State information real-time update disc information record sheet, and then in time grasps the Disk State of each service node.
In step 210, client node sends the query requests of the Disk State that is used to indicate the one or more disks of inquiry to management node.In step 212, the inquiry response that management node will have the corresponding Disk State of one or more disks feeds back to client node.Particularly, management node can directly offer client node with Disk State, and does not need management node after receiving query requests, and the access services node obtains Disk State.
In addition, the disk method for supervising can also comprise: management node carries out corresponding operating according to the Disk State Information Selection to the disk that is in the disk abnormality and reports to the police.Wherein, corresponding operating further comprises the disk operating of rolling off the production line, adds disk operating and the disk operating of reaching the standard grade.Management node is identified this Disk State information after receiving Disk State information, then according to recognition result the disk that is in abnormality is operated accordingly.For example, extract state if a certain disk is in disk, then management node is deleted this disk, namely to the disk operating of rolling off the production line of this disk.Because cloud storage system in time operates accordingly to disk, therefore when restarting, node can guarantee the integrality of cloud storage system disk.
Fig. 3 is Disk State transition diagram according to an embodiment of the invention.The concrete meaning of each state in the Disk State transition diagram as described in Figure 3 is as follows:
INIT: disk newly adds, and does not add storage system.
OK: disk has added storage system and nothing is unusual.
OFFLINE (disk rolls off the production line): disk is pulled out, within the time of appointment, do not turn back to, then storage system can be deleted this disk, otherwise storage system waits for that this disk is turned back to, after disk is turned back to, need the order by diskonline (disk is reached the standard grade), the notice storage system, disk is reached the standard grade again.
WAIT ADD: disk can be added into system again, and trigger condition is the add event.
WAIT UMOUNT: under the OFFLINE state, add (interpolation) event arrives with umount (unloading) event first, in this case, drive can may change, UUID can not change (generally, considering in the situation that disk UUID may be reset that system can give and be kept on the disk for unique UUID of disk allocation number, to distinguish).
Management node shows Disk State and corresponding disk position thereof the form with the disk distribution map according to Disk State information.Comprise magnetic disc ID in the Disk State information, that is, UUID, so this UUID is corresponding with the disk physical location of special services node in the cloud storage system, that is, corresponding with the concrete slot position of disk in service node.Therefore show each Disk State and corresponding disk position thereof in the cloud storage system at the disk distribution map.As long as thereby check the disk distribution map, just can accurately locate the concrete physical location of the disk that is in abnormality.
Management node also shows the performance of each disk with graphic form according to Disk State information.Be in the situation of disk normal condition at Disk State, Disk State information also comprises disk performance.Wherein, disk performance comprises disk resource utilance, read-write attribute and read or write speed.For example, the disk management interface can show disk resource utilance, read-write attribute and read-write speed by pie chart or column diagram graphical form.Therefore, the user can check according to these figures the specific object index of particular disk.
Utilize this disk method for supervising can in the cloud storage system running, automatically carry out the Disk State monitoring, thereby can guarantee the data security in the cloud storage system.During client node inquiry Disk State, management node can inquire about the disc information record sheet and with corresponding Disk State rapid feedback to client node.Cloud storage system can in time operate disk accordingly, therefore can guarantee the integrality of cloud storage system disk when node is restarted.In addition, this disk method for supervising is perfect disk management interface, namely can navigate to efficiently by administration interface the problem of disk, can observe intuitively by administration interface again the real-time status (comprise the node slot to lack that dish, disk roll off the production line, disk is reached the standard grade stand-by, disk with states such as, disk are bad) of disk.
Be the preferred embodiments of the present invention only below, be not limited to the present invention, for a person skilled in the art, the present invention can have various modifications and variations.Within the spirit and principles in the present invention all, any modification of doing, be equal to replacement, improvement etc., all should be included within protection scope of the present invention.

Claims (12)

1. a disk method for supervising that is used for cloud storage system is characterized in that, comprising:
Each service node in described a plurality of service node sends Disk State information with predetermined period to management node; And
Described management node is set up the disc information record sheet corresponding with the disk of a plurality of service nodes, and according to the Disk State of corresponding described disk in the described disc information record sheet of the Disk State information updating that receives.
2. disk method for supervising according to claim 1 is characterized in that, also comprises:
Client node sends the query requests of the Disk State that is used to indicate the one or more described disks of inquiry to described management node; And
The inquiry response that described management node will have the corresponding described Disk State of one or more described disks feeds back to described client node.
3. disk method for supervising according to claim 1 is characterized in that, described service node after starting and before sending described Disk State information to described management node,
The disk monitoring module of described service node obtains the Disk State of described service node; And
The disk processing module of described service node generates described Disk State information according to described Disk State.
4. disk method for supervising according to claim 3 is characterized in that, described Disk State comprises: disk normal condition and disk abnormality.
5. disk method for supervising according to claim 4 is characterized in that, described disk abnormality comprises: disk is extracted, disk adds, disk unloads and the disk carry.
6. disk method for supervising according to claim 5 is characterized in that, described Disk State information also comprises: the magnetic disc ID corresponding with described disk position.
7. disk method for supervising according to claim 4 is characterized in that, is in the situation of described disk normal condition at described Disk State, and described Disk State information also comprises: disk performance.
8. disk method for supervising according to claim 4 is characterized in that, also comprises: described management node carries out corresponding operating according to described Disk State Information Selection to the disk that is in described disk abnormality and reports to the police.
9. disk method for supervising according to claim 8 is characterized in that, described corresponding operating further comprises: the disk operating of rolling off the production line, add disk operating and the disk operating of reaching the standard grade.
10. disk method for supervising according to claim 6 is characterized in that, described management node shows described Disk State and corresponding described disk position thereof the form with the disk distribution map according to described Disk State information.
11. disk method for supervising according to claim 7 is characterized in that described disk performance comprises disk resource utilance, read-write attribute and read or write speed.
12. disk method for supervising according to claim 11 is characterized in that, described management node also shows the performance of each described disk with graphic form according to described Disk State information.
CN201210570758XA 2012-12-25 2012-12-25 Disk monitoring method for cloud storage system Pending CN103067485A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201210570758XA CN103067485A (en) 2012-12-25 2012-12-25 Disk monitoring method for cloud storage system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201210570758XA CN103067485A (en) 2012-12-25 2012-12-25 Disk monitoring method for cloud storage system

Publications (1)

Publication Number Publication Date
CN103067485A true CN103067485A (en) 2013-04-24

Family

ID=48109939

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201210570758XA Pending CN103067485A (en) 2012-12-25 2012-12-25 Disk monitoring method for cloud storage system

Country Status (1)

Country Link
CN (1) CN103067485A (en)

Cited By (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103729146A (en) * 2013-12-19 2014-04-16 浪潮(北京)电子信息产业有限公司 Method and system for quickly positioning magnetic disks of mass storage systems
CN104035728A (en) * 2014-03-31 2014-09-10 深圳英飞拓科技股份有限公司 Hard disk hot plug handling method, device and node
CN105242998A (en) * 2015-09-01 2016-01-13 福建新大陆软件工程有限公司 HDFS (Hadoop Distributed File System) based disk fault detection method and system
CN105373549A (en) * 2014-08-25 2016-03-02 浙江大华技术股份有限公司 Data migration method and device and data node server
CN105847358A (en) * 2016-03-24 2016-08-10 广东三盟信息科技有限公司 Method for realizing big data node distribution in cloud computing environment and system thereof
CN106528005A (en) * 2017-01-12 2017-03-22 郑州云海信息技术有限公司 Disk adding method and device for distributed type storage system
CN107368261A (en) * 2017-07-20 2017-11-21 郑州云海信息技术有限公司 A kind of hard disk management method and system
CN107577545A (en) * 2016-07-05 2018-01-12 北京金山云网络技术有限公司 A kind of failed disk detection and restorative procedure and device
CN108733500A (en) * 2017-04-13 2018-11-02 阿里巴巴集团控股有限公司 Fault Locating Method and device, the generation method of correspondence and device
CN110109790A (en) * 2019-05-13 2019-08-09 深圳前海微众银行股份有限公司 Server hard disc management method, device, equipment and computer readable storage medium
CN110502401A (en) * 2019-08-27 2019-11-26 中国工商银行股份有限公司 For monitoring the method, apparatus, system and medium of disk performance
CN111381766A (en) * 2018-12-28 2020-07-07 杭州海康威视系统技术有限公司 Method for dynamically loading disk and cloud storage system
CN112118030A (en) * 2020-08-27 2020-12-22 深圳市力合微电子股份有限公司 Pre-response method suitable for pan DALI system
CN113778753A (en) * 2021-09-14 2021-12-10 杭州沃趣科技股份有限公司 Method, device, equipment and medium for automatically correcting database after storage recovery
CN114428709A (en) * 2022-01-17 2022-05-03 广州鲁邦通物联网科技股份有限公司 SDS state detection method and system in cloud management platform

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1929411A (en) * 2006-09-04 2007-03-14 曙光信息产业(北京)有限公司 Intelligent computers group monitoring method
CN1929410A (en) * 2006-09-04 2007-03-14 曙光信息产业(北京)有限公司 Intelligent computers group monitoring method
CN101764846A (en) * 2009-12-18 2010-06-30 西南交通大学 Remote centralized disk array operation monitoring system and implement method thereof
CN102143215A (en) * 2011-01-20 2011-08-03 中国人民解放军理工大学 Network-based PB level cloud storage system and processing method thereof

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1929411A (en) * 2006-09-04 2007-03-14 曙光信息产业(北京)有限公司 Intelligent computers group monitoring method
CN1929410A (en) * 2006-09-04 2007-03-14 曙光信息产业(北京)有限公司 Intelligent computers group monitoring method
CN101764846A (en) * 2009-12-18 2010-06-30 西南交通大学 Remote centralized disk array operation monitoring system and implement method thereof
CN102143215A (en) * 2011-01-20 2011-08-03 中国人民解放军理工大学 Network-based PB level cloud storage system and processing method thereof

Cited By (23)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103729146A (en) * 2013-12-19 2014-04-16 浪潮(北京)电子信息产业有限公司 Method and system for quickly positioning magnetic disks of mass storage systems
CN104035728A (en) * 2014-03-31 2014-09-10 深圳英飞拓科技股份有限公司 Hard disk hot plug handling method, device and node
CN105373549B (en) * 2014-08-25 2019-02-12 浙江大华技术股份有限公司 Data migration method, equipment and back end server
CN105373549A (en) * 2014-08-25 2016-03-02 浙江大华技术股份有限公司 Data migration method and device and data node server
CN105242998A (en) * 2015-09-01 2016-01-13 福建新大陆软件工程有限公司 HDFS (Hadoop Distributed File System) based disk fault detection method and system
CN105242998B (en) * 2015-09-01 2019-05-14 福建新大陆软件工程有限公司 A kind of disk failure detection method and system based on HDFS
CN105847358A (en) * 2016-03-24 2016-08-10 广东三盟信息科技有限公司 Method for realizing big data node distribution in cloud computing environment and system thereof
CN107577545B (en) * 2016-07-05 2021-02-02 北京金山云网络技术有限公司 Method and device for detecting and repairing fault disk
CN107577545A (en) * 2016-07-05 2018-01-12 北京金山云网络技术有限公司 A kind of failed disk detection and restorative procedure and device
CN106528005A (en) * 2017-01-12 2017-03-22 郑州云海信息技术有限公司 Disk adding method and device for distributed type storage system
CN106528005B (en) * 2017-01-12 2019-12-31 苏州浪潮智能科技有限公司 Disk adding method and device of distributed storage system
CN108733500A (en) * 2017-04-13 2018-11-02 阿里巴巴集团控股有限公司 Fault Locating Method and device, the generation method of correspondence and device
CN107368261A (en) * 2017-07-20 2017-11-21 郑州云海信息技术有限公司 A kind of hard disk management method and system
CN111381766A (en) * 2018-12-28 2020-07-07 杭州海康威视系统技术有限公司 Method for dynamically loading disk and cloud storage system
CN111381766B (en) * 2018-12-28 2022-08-02 杭州海康威视系统技术有限公司 Method for dynamically loading disk and cloud storage system
CN110109790A (en) * 2019-05-13 2019-08-09 深圳前海微众银行股份有限公司 Server hard disc management method, device, equipment and computer readable storage medium
CN110109790B (en) * 2019-05-13 2023-04-07 深圳前海微众银行股份有限公司 Server hard disk management method, device, equipment and computer readable storage medium
CN110502401A (en) * 2019-08-27 2019-11-26 中国工商银行股份有限公司 For monitoring the method, apparatus, system and medium of disk performance
CN112118030A (en) * 2020-08-27 2020-12-22 深圳市力合微电子股份有限公司 Pre-response method suitable for pan DALI system
CN112118030B (en) * 2020-08-27 2022-02-11 深圳市力合微电子股份有限公司 Pre-response method suitable for pan DALI system
CN113778753A (en) * 2021-09-14 2021-12-10 杭州沃趣科技股份有限公司 Method, device, equipment and medium for automatically correcting database after storage recovery
CN113778753B (en) * 2021-09-14 2024-05-03 杭州沃趣科技股份有限公司 Method, device, equipment and medium for automatically correcting database after storage recovery
CN114428709A (en) * 2022-01-17 2022-05-03 广州鲁邦通物联网科技股份有限公司 SDS state detection method and system in cloud management platform

Similar Documents

Publication Publication Date Title
CN103067485A (en) Disk monitoring method for cloud storage system
CN102981931B (en) Backup method and device for virtual machine
US11886707B2 (en) Dataset space reclamation
CN101206581B (en) System and method for guiding using external memory device
US7007144B2 (en) Method, apparatus, and computer readable medium for managing back-up
JP4733461B2 (en) Computer system, management computer, and logical storage area management method
CN103036986A (en) Update notification provided on distributed application object
CN103488793A (en) User behavior monitoring method based on information retrieval
CN103873288A (en) System and method for positioning failures of communication network equipment based on alarm information
US10144131B2 (en) Operation monitoring server and operation monitoring system
CN105760251B (en) A kind of method and apparatus of Backup Data
CN106874343B (en) Data deletion method and system for time sequence database
US20200089587A1 (en) Disaster recovery specific configurations, management, and application
US20130024859A1 (en) Control computer and data accessing method
CN103778024A (en) Server system and message processing method thereof
CN110717130B (en) Dotting method, dotting device, dotting terminal and storage medium
CN112269543B (en) Storage logical volume management method, device and related components
CN115004662A (en) Data synchronization method, data synchronization device, data storage system and computer readable medium
CN112905668A (en) Database derivative method, apparatus, and medium based on distributed data stream processing engine
CN102867029B (en) A kind of method managing distributive catalogue of document system and distributed file system
US8424019B1 (en) Managing channel instances in a messaging-middleware environment
CN111506360B (en) External equipment access system and method of real-time data processing system
CN101242201B (en) A master-slave system maintenance method, system and device
JP2005208967A (en) Management computer and method for managing storage device
US9189160B2 (en) Transport agnostic sequential drive recovery with mode data snooping

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C12 Rejection of a patent application after its publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20130424