CN109407983B - Disk loading method of distributed file storage system - Google Patents
Disk loading method of distributed file storage system Download PDFInfo
- Publication number
- CN109407983B CN109407983B CN201811166217.4A CN201811166217A CN109407983B CN 109407983 B CN109407983 B CN 109407983B CN 201811166217 A CN201811166217 A CN 201811166217A CN 109407983 B CN109407983 B CN 109407983B
- Authority
- CN
- China
- Prior art keywords
- service
- executing
- osd
- disk
- judging whether
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000011068 loading method Methods 0.000 title claims abstract description 15
- 238000000034 method Methods 0.000 claims description 9
- 230000007547 defect Effects 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
- G06F3/0614—Improving the reliability of storage systems
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
- G06F3/0629—Configuration or reconfiguration of storage systems
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0668—Interfaces specially adapted for storage systems adopting a particular infrastructure
- G06F3/067—Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention relates to a disk loading method of a distributed file storage system, which comprises the following steps: s1: acquiring disk information, entering the next step if the information inquiry is successful, and ending if the information inquiry is failed; s2: switching a working directory, formatting a disk and synchronizing configuration files; s3: judging whether the disc is an SSD disc, if so, executing S4, otherwise, executing S7; s4: judging whether the MON service is needed, if so, rebuilding the MON service and executing S5, otherwise, executing S5; s5: if the pgcache service is needed, reconstructing the pgcache service, and executing the step S6, otherwise executing the step S6; s6: if the OSD service is needed, the reconstruction of the OSD service is finished, otherwise, the OSD service is directly finished; s7: and judging whether the nvram card exists or not, if so, finishing the OSD reconstruction, and finishing the OSD reconstruction.
Description
Technical Field
The invention belongs to the technical field of disk loading design, and particularly relates to a disk loading method of a distributed file storage system.
Background
With the rapid development of the distributed file storage system, the storage capacity reaches the PB level, the stored data is more and more, the application range is wider and wider, the distributed file storage system mainly shares files to users through various protocols such as cifs/nfs/ftp/http, and when the cluster capacity is not practical enough, a disk needs to be loaded. There is no method for this type of disk loading in the prior art. This is a disadvantage of the prior art.
Therefore, aiming at the defects in the prior art, a method for loading a disk of a distributed file storage system is provided; it is very necessary to solve the above-mentioned defects in the prior art.
Disclosure of Invention
The present invention provides a method for loading a disk in a distributed file storage system to solve the above technical problems.
In order to achieve the purpose, the invention provides the following technical scheme:
a method for loading a disk of a distributed file storage system is characterized by comprising the following steps:
s1: and acquiring the disk information, entering the next step if the information inquiry is successful, and ending if the information inquiry is failed.
S2: switching a working directory, formatting a disk and synchronizing configuration files;
s3: judging whether the disc is an SSD disc, if so, executing step S4, otherwise, executing step S7;
s4: judging whether the MON service is needed, if so, rebuilding the MON service, and executing the step S5, otherwise, directly executing the step S5;
s5: judging whether the pgcache service is needed, if the pgcache service is needed, rebuilding the pgcache service, and executing the step S6, otherwise, directly executing the step S6;
s6: judging whether the OSD service is needed, if the OSD service is needed, rebuilding the OSD service and ending, otherwise, directly ending;
s7: judging whether the nvram card exists or not, if so, finishing after reconstructing OSD, wherein the reconstructed OSD is a log on a nonvolatile random access memory; otherwise, the OSD reconstruction is finished.
Preferably, in step S1, the disc information is obtained according to the slot number by the CLI command.
Preferably, the step S2 further includes the steps of:
and judging whether the current execution node is the main mon node, if so, directly executing the step S3, otherwise, synchronizing the deployment configuration information on the main mon node to the current node, and then executing the step S3.
The following problems are solved: when the main MON node fails and the node where the SSD disk is loaded is changed from the non-main MON node to the main MON node, an error report of the disk deployment command may occur because the original non-main MON node lacks some configuration files.
The invention has the advantages of being suitable for various distributed file storage scenes, convenient for customer operation, strong in usability, capable of more efficiently meeting customer requirements and capable of meeting diversification of products.
When the cluster capacity is not practical enough, the disk loading is conveniently realized. In addition, the invention has reliable design principle, simple structure and very wide application prospect.
Therefore, compared with the prior art, the invention has prominent substantive features and remarkable progress, and the beneficial effects of the implementation are also obvious.
Drawings
Fig. 1 is a flowchart of a method for loading a disk in a distributed file storage system according to the present invention.
Detailed Description
The present invention will be described in detail below with reference to the accompanying drawings by way of specific examples, which are illustrative of the present invention and are not limited to the following embodiments.
As shown in fig. 1, a method for loading a disk in a distributed file storage system provided by the present invention is characterized by comprising the following steps:
s1: and acquiring the disk information, entering the next step if the information inquiry is successful, and ending if the information inquiry is failed.
S2: switching a working directory, formatting a disk and synchronizing configuration files;
s3: judging whether the disc is an SSD disc, if so, executing step S4, otherwise, executing step S7;
s4: judging whether the MON service is needed, if so, rebuilding the MON service, and executing the step S5, otherwise, directly executing the step S5;
s5: judging whether the pgcache service is needed, if the pgcache service is needed, rebuilding the pgcache service, and executing the step S6, otherwise, directly executing the step S6;
s6: judging whether the OSD service is needed, if the OSD service is needed, rebuilding the OSD service and ending, otherwise, directly ending;
s7: judging whether the nvram card exists or not, if so, finishing after reconstructing OSD, wherein the reconstructed OSD is a log on a nonvolatile random access memory; otherwise, the OSD reconstruction is finished.
In this embodiment, in step S1, the disk information is obtained according to the slot number by a CLI command.
In this embodiment, the step S2 further includes the following steps:
and judging whether the current execution node is the main mon node, if so, directly executing the step S3, otherwise, synchronizing the deployment configuration information on the main mon node to the current node, and then executing the step S3.
The following problems are solved: when the main MON node fails and the node where the SSD disk is loaded is changed from the non-main MON node to the main MON node, an error report of the disk deployment command may occur because the original non-main MON node lacks some configuration files.
The above disclosure is only for the preferred embodiments of the present invention, but the present invention is not limited thereto, and any non-inventive changes that can be made by those skilled in the art and several modifications and amendments made without departing from the principle of the present invention shall fall within the protection scope of the present invention.
Claims (3)
1. A method for loading a disk of a distributed file storage system is characterized by comprising the following steps:
s1: acquiring disk information, entering the next step if the information inquiry is successful, and ending if the information inquiry is failed;
s2: switching a working directory, formatting a disk and synchronizing configuration files;
s3: judging whether the disc is an SSD disc, if so, executing step S4, otherwise, executing step S7;
s4: judging whether the MON service is needed, if so, rebuilding the MON service, and executing the step S5, otherwise, directly executing the step S5;
s5: judging whether the pgcache service is needed, if the pgcache service is needed, rebuilding the pgcache service, and executing the step S6, otherwise, directly executing the step S6;
s6: judging whether the OSD service is needed, if the OSD service is needed, rebuilding the OSD service and ending, otherwise, directly ending;
s7: judging whether the nvram card exists or not, if so, finishing after reconstructing OSD, wherein the reconstructed OSD is a log on a nonvolatile random access memory; otherwise, the OSD reconstruction is finished.
2. The method for loading a disk of a distributed file storage system according to claim 1, wherein in step S1, the disk information is obtained according to the slot number by a CLI command.
3. The method for loading a disk of a distributed file storage system according to claim 2, wherein said step S2 further comprises the steps of:
and judging whether the current execution node is the main mon node, if so, directly executing the step S3, otherwise, synchronizing the deployment configuration information on the main mon node to the current node, and then executing the step S3.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811166217.4A CN109407983B (en) | 2018-10-08 | 2018-10-08 | Disk loading method of distributed file storage system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811166217.4A CN109407983B (en) | 2018-10-08 | 2018-10-08 | Disk loading method of distributed file storage system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN109407983A CN109407983A (en) | 2019-03-01 |
| CN109407983B true CN109407983B (en) | 2021-09-28 |
Family
ID=65466789
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201811166217.4A Active CN109407983B (en) | 2018-10-08 | 2018-10-08 | Disk loading method of distributed file storage system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109407983B (en) |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101556557A (en) * | 2009-05-14 | 2009-10-14 | 浙江大学 | Object file organization method based on object storage device |
| CN107436735A (en) * | 2017-07-28 | 2017-12-05 | 郑州云海信息技术有限公司 | State of memory cells update method in a kind of distributed file system |
| CN107526544A (en) * | 2017-08-16 | 2017-12-29 | 国家电网公司 | A kind of distributed storage Ceph clusters hardware selection design method |
| CN107577441A (en) * | 2017-10-17 | 2018-01-12 | 郑州云海信息技术有限公司 | A kind of OSD slow disk processing method, system, device and computer-readable storage medium |
| CN107678923A (en) * | 2017-09-29 | 2018-02-09 | 郑州云海信息技术有限公司 | A kind of optimization method of distributed file system Message Processing |
Family Cites Families (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20030200548A1 (en) * | 2001-12-27 | 2003-10-23 | Paul Baran | Method and apparatus for viewer control of digital TV program start time |
| US8200062B2 (en) * | 2006-04-21 | 2012-06-12 | Panasonic Corporation | Playback apparatus, program, and playback method |
| JP4730289B2 (en) * | 2006-12-01 | 2011-07-20 | 株式会社日立製作所 | Information recording / reproducing device |
-
2018
- 2018-10-08 CN CN201811166217.4A patent/CN109407983B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101556557A (en) * | 2009-05-14 | 2009-10-14 | 浙江大学 | Object file organization method based on object storage device |
| CN107436735A (en) * | 2017-07-28 | 2017-12-05 | 郑州云海信息技术有限公司 | State of memory cells update method in a kind of distributed file system |
| CN107526544A (en) * | 2017-08-16 | 2017-12-29 | 国家电网公司 | A kind of distributed storage Ceph clusters hardware selection design method |
| CN107678923A (en) * | 2017-09-29 | 2018-02-09 | 郑州云海信息技术有限公司 | A kind of optimization method of distributed file system Message Processing |
| CN107577441A (en) * | 2017-10-17 | 2018-01-12 | 郑州云海信息技术有限公司 | A kind of OSD slow disk processing method, system, device and computer-readable storage medium |
Non-Patent Citations (1)
| Title |
|---|
| 基于Ceph文件系统的元数据缓存备份;詹玲，方协云等;《计算机工程》;20170430;第43卷(第4期);67-72页 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN109407983A (en) | 2019-03-01 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN102955720B (en) | A kind of method improving ext file system stability | |
| US20170031948A1 (en) | File synchronization method, server, and terminal | |
| CN104951474A (en) | Method and device for acquiring MySQL binlog incremental logs | |
| CN109918234B (en) | Metadata recovery method, device, equipment and medium based on SSD | |
| CN105376277A (en) | Data synchronization method and device | |
| CN106446197A (en) | Data storage method, device and system | |
| US10628298B1 (en) | Resumable garbage collection | |
| CN101763433B (en) | Data storage system and method | |
| CN107241444B (en) | Distributed cache data management system, method and device | |
| CN102117287A (en) | Distributed file system access method, a metadata server and client side | |
| CN109144790A (en) | The synthesized backup method and device of MySQL database | |
| CN110399096B (en) | Method, device and equipment for deleting metadata cache of distributed file system again | |
| US20150169623A1 (en) | Distributed File System, File Access Method and Client Device | |
| CN112579550B (en) | Metadata information synchronization method and system of distributed file system | |
| CN106446038A (en) | Hybrid database-based data access control system and method | |
| CN111125002B (en) | Data backup archiving method and system based on distributed storage | |
| CN102142010A (en) | Method and equipment for inputting data to multimedia service database on embedded equipment | |
| CN110895545B (en) | Shared data synchronization method and device | |
| CN111008181A (en) | Method, system, terminal and storage medium for switching storage strategies of distributed file system | |
| US20110302213A1 (en) | Storage system | |
| CN108304144B (en) | Data writing-in and reading method and system, and data reading-writing system | |
| CN102385624B (en) | DFS (distributed file system)-oriented log data organization method | |
| CN109407983B (en) | Disk loading method of distributed file storage system | |
| CN109753381A (en) | Continuous data protection method based on object storage | |
| CN106980618A (en) | File memory method and system based on MongoDB distributed type assemblies frameworks |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |