CN113031879A - Cluster storage method based on LVM logic - Google Patents
Cluster storage method based on LVM logic Download PDFInfo
- Publication number
- CN113031879A CN113031879A CN202110561937.6A CN202110561937A CN113031879A CN 113031879 A CN113031879 A CN 113031879A CN 202110561937 A CN202110561937 A CN 202110561937A CN 113031879 A CN113031879 A CN 113031879A
- Authority
- CN
- China
- Prior art keywords
- lvm
- logic
- hard disk
- logic area
- new
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0668—Interfaces specially adapted for storage systems adopting a particular infrastructure
- G06F3/067—Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
- G06F3/0604—Improving or facilitating administration, e.g. storage management
- G06F3/0607—Improving or facilitating administration, e.g. storage management by facilitating the process of upgrading existing storage systems, e.g. for improving compatibility between host and storage device
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
- G06F3/0629—Configuration or reconfiguration of storage systems
Abstract
The invention discloses a cluster storage method based on LVM logic, which comprises the following steps: forming an LVM logic area by a plurality of hard disks, and carrying out mirror image processing on each LVM logic area; installing an OSD program on the LVM logic area, and mounting the LVM logic area on a CEPH cluster storage system; if any hard disk in the LVM logic area sends a damage condition, or any hard disk needs to be actively replaced, the hard disk is replaced to obtain a new hard disk, and the LVM logic mirror corresponding to the LVM logic area performs mirroring operation on the new hard disk for data recovery; and when a hard disk needs to be newly added in the LVM logic area, performing LVM logic on the newly added hard disk and obtaining a new LVM logic area. The method and the device can enable the ceph cluster to perform capacity expansion and hard disk removal without perception.
Description
Technical Field
The invention relates to the technical field of distributed storage, in particular to a cluster storage method based on LVM logic.
Background
With the development of cloud computing in the internet, distributed ceph storage is recognized and widely used by people, and when capacity expansion is performed on a ceph cluster which is deployed at present, each factory enterprise has a self-owned mode to perform capacity expansion.
The Ceph cluster is a uniform distributed object storage, and for a deployed storage cluster, capacity expansion is needed if the space is insufficient, or capacity expansion is needed after elimination if a disk is bad.
In the prior art, the operations of expanding a hard disk or removing the hard disk all result in the process of performing data balanced migration on the existing ceph cluster, so that the pressure of a data disk is increased, and the flow of data migration performs resource preemption (such as network bandwidth and disk performance) with the normal service data flow.
Disclosure of Invention
In order to solve one of the problems, the invention provides a cluster storage method based on LVM logic, which forms an LVM logic area by performing LVM logic processing on a hard disk, solves the problem of sudden performance increase caused by the replacement or addition of the hard disk of a subsequent ceph cluster, and can expand the capacity and remove the hard disk of the ceph cluster without perception.
In order to solve the technical problems, the invention provides the following technical scheme: a cluster storage method based on LVM logic comprises the following steps:
performing LVM logic processing on a plurality of hard disks to form an LVM logic area, and performing mirror image processing on each LVM logic area to obtain an LVM logic mirror image corresponding to each LVM logic area;
installing an OSD program on the LVM logic area, and mounting the LVM logic area on a CEPH cluster storage system; the CEPH cluster storage system comprises a plurality of LVM logical zones.
Further, the cluster storage method based on the LVM logic further includes the steps of:
if any hard disk in the LVM logic area sends a damage condition, the damaged hard disk is replaced by a new hard disk, and the LVM logic mirror corresponding to the LVM logic area performs mirroring operation on the new hard disk for recovering data;
or, if any hard disk in the LVM logic area needs to be actively replaced, the hard disk is replaced to obtain a new hard disk, and the LVM logic mirror corresponding to the LVM logic area performs a mirroring operation on the new hard disk for data recovery.
Further, the cluster storage method based on the LVM logic further includes the steps of:
when a new hard disk is needed to be added in the LVM logic area, performing LVM logic on the added hard disk to obtain a new LVM logic area, and performing mirror image processing on the corresponding LVM logic mirror image of the added hard disk.
After the technical scheme is adopted, the invention at least has the following beneficial effects: according to the invention, the LVM logic processing is carried out on the hard disk to form an LVM logic area, so that the Ceph cluster layer can carry out hard disk capacity expansion or damaged hard disk replacement without perception or in a seamless manner, and the storage efficiency of the Ceph cluster is greatly improved.
Drawings
Fig. 1 is a flowchart illustrating steps of a cluster storage method based on LVM logic according to the present invention.
Detailed Description
It should be noted that, in the present application, the embodiments and features of the embodiments may be combined with each other without conflict, and the present application is further described in detail with reference to the drawings and specific embodiments.
Example 1
As shown in fig. 1, this embodiment provides a cluster storage method based on LVM logic, which includes the steps of:
step S1, performing LVM logic processing on the plurality of hard disks to form an LVM logic area, and performing mirror image processing on each LVM logic area to obtain an LVM logic mirror image corresponding to each LVM logic area; here, a plurality of hard disks on the device are combined into an LVM, and an LVM mirror mode is configured (when a plurality of hard disks synchronize data, even if a disk is lost, the disk data is guaranteed to be redundant due to the mirror mode); in addition, LVM refers to: the LVM is a shorthand of Logical Volume Manager (Logical Volume management), and is a mechanism for managing disk partitions in a Linux environment, and is implemented by Heinz mauelhagen on a Linux 2.4 kernel, and the latest version at present is: stable version 1.0.5, development version 1.1.0-rc2, and LVM2 development version;
step S2, installing an OSD program on the LVM logic area, and mounting the LVM logic area on a CEPH cluster storage system; the CEPH cluster storage system comprises a plurality of LVM logic areas;
step S3, if any hard disk in the LVM logic area sends a damage condition, the damaged hard disk is replaced by a new hard disk, and the LVM logic mirror corresponding to the LVM logic area performs mirror image operation on the new hard disk for data recovery;
or if any hard disk in the LVM logic area needs to be actively replaced, replacing the hard disk to obtain a new hard disk, and performing mirroring operation on the new hard disk by using the LVM logic mirror corresponding to the LVM logic area for data recovery;
step S4, when a new hard disk needs to be added to the LVM logic area, performing LVM logic on the new hard disk to obtain a new LVM logic area, and performing mirror image processing on the corresponding LVM logic mirror image of the new hard disk.
In this embodiment, by increasing the logical protection of the LVM, the ceph cluster is seamlessly docked to expand/reduce the capacity (reject the hard disk, reduce the hard disk), so that the performance sudden increase caused by the data synchronization required by the ceph cluster due to the hard disk problem is avoided.
Although embodiments of the present invention have been shown and described, it will be appreciated by those skilled in the art that various equivalent changes, modifications, substitutions and alterations can be made herein without departing from the principles and spirit of the invention, the scope of which is defined by the appended claims and their equivalents.
Claims (3)
1. A cluster storage method based on LVM logic is characterized by comprising the following steps:
performing LVM logic processing on a plurality of hard disks to form an LVM logic area, and performing mirror image processing on each LVM logic area to obtain an LVM logic mirror image corresponding to each LVM logic area;
installing an OSD program on the LVM logic area, and mounting the LVM logic area on a CEPH cluster storage system; the CEPH cluster storage system comprises a plurality of LVM logical zones.
2. The cluster storage method based on LVM logic according to claim 1, further comprising the steps of:
if any hard disk in the LVM logic area sends a damage condition, the damaged hard disk is replaced by a new hard disk, and the LVM logic mirror corresponding to the LVM logic area performs mirroring operation on the new hard disk for recovering data;
or, if any hard disk in the LVM logic area needs to be actively replaced, the hard disk is replaced to obtain a new hard disk, and the LVM logic mirror corresponding to the LVM logic area performs a mirroring operation on the new hard disk for data recovery.
3. The cluster storage method based on LVM logic according to claim 2, further comprising the steps of:
when a new hard disk is needed to be added in the LVM logic area, performing LVM logic on the added hard disk to obtain a new LVM logic area, and performing mirror image processing on the corresponding LVM logic mirror image of the added hard disk.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202110561937.6A CN113031879A (en) | 2021-05-24 | 2021-05-24 | Cluster storage method based on LVM logic |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202110561937.6A CN113031879A (en) | 2021-05-24 | 2021-05-24 | Cluster storage method based on LVM logic |
Publications (1)
Publication Number | Publication Date |
---|---|
CN113031879A true CN113031879A (en) | 2021-06-25 |
Family
ID=76455510
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN202110561937.6A Pending CN113031879A (en) | 2021-05-24 | 2021-05-24 | Cluster storage method based on LVM logic |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN113031879A (en) |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN116680114A (en) * | 2023-08-04 | 2023-09-01 | 浙江鹏信信息科技股份有限公司 | LVM fault data quick recovery method, system and computer readable storage medium |
Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
TWI307026B (en) * | 2005-12-30 | 2009-03-01 | Ind Tech Res Inst | System and method for storage management |
CN104850469A (en) * | 2015-05-12 | 2015-08-19 | 浪潮电子信息产业股份有限公司 | LV mirror image-based method for realizing data backup, recovery and migration in linux system |
CN105068894A (en) * | 2015-09-10 | 2015-11-18 | 浪潮(北京)电子信息产业有限公司 | Method and device for achieving high availability of Linux system storage device on basis of LVM mirror image |
CN111857577A (en) * | 2020-06-29 | 2020-10-30 | 烽火通信科技股份有限公司 | Method and device for managing physical hard disk in distributed storage system |
US10887167B2 (en) * | 2018-04-30 | 2021-01-05 | At&T Intellectual Property I, L.P. | Adaptive software-defined storage for cloud storage workloads |
-
2021
- 2021-05-24 CN CN202110561937.6A patent/CN113031879A/en active Pending
Patent Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
TWI307026B (en) * | 2005-12-30 | 2009-03-01 | Ind Tech Res Inst | System and method for storage management |
CN104850469A (en) * | 2015-05-12 | 2015-08-19 | 浪潮电子信息产业股份有限公司 | LV mirror image-based method for realizing data backup, recovery and migration in linux system |
CN105068894A (en) * | 2015-09-10 | 2015-11-18 | 浪潮(北京)电子信息产业有限公司 | Method and device for achieving high availability of Linux system storage device on basis of LVM mirror image |
US10887167B2 (en) * | 2018-04-30 | 2021-01-05 | At&T Intellectual Property I, L.P. | Adaptive software-defined storage for cloud storage workloads |
CN111857577A (en) * | 2020-06-29 | 2020-10-30 | 烽火通信科技股份有限公司 | Method and device for managing physical hard disk in distributed storage system |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN116680114A (en) * | 2023-08-04 | 2023-09-01 | 浙江鹏信信息科技股份有限公司 | LVM fault data quick recovery method, system and computer readable storage medium |
CN116680114B (en) * | 2023-08-04 | 2023-10-31 | 浙江鹏信信息科技股份有限公司 | LVM fault data quick recovery method, system and computer readable storage medium |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
AU2014218837B2 (en) | Deduplication storage system with efficient reference updating and space reclamation | |
US8924358B1 (en) | Change tracking of individual virtual disk files | |
US8127174B1 (en) | Method and apparatus for performing transparent in-memory checkpointing | |
US10055300B2 (en) | Disk group based backup | |
CN106776130B (en) | Log recovery method, storage device and storage node | |
US20140136803A1 (en) | Backing up Method, Device, and System for Virtual Machine | |
CN110633325B (en) | Docker-based database cluster capacity expansion method and device | |
CN104994168A (en) | distributed storage method and distributed storage system | |
CN116680256B (en) | Database node upgrading method and device and computer equipment | |
CN110489494B (en) | Online expansion method and device for distributed database | |
JP6663995B2 (en) | System and method for backing up a large-scale distributed scale-out data system | |
WO2018113484A1 (en) | Method and apparatus for recovering multi-replica data | |
US20180349233A1 (en) | File synchronization using delta bitmaps | |
CN111966526A (en) | Virtual machine backup method and device based on cloud platform data center | |
CN113031879A (en) | Cluster storage method based on LVM logic | |
US11128708B2 (en) | Managing remote replication in storage systems | |
CN111045602B (en) | Cluster system control method and cluster system | |
JP2007140777A (en) | Computer system, management computer and data recovery method | |
CN111240901A (en) | Node dynamic expansion system, method and equipment of distributed block storage system | |
CN113051030A (en) | Virtual machine recovery system and method based on fusion computer virtualization platform | |
US11055263B2 (en) | Information processing device and information processing system for synchronizing data between storage devices | |
US10649862B1 (en) | Reducing failback performance duration in data replication systems | |
CN115098300B (en) | Database backup method, disaster recovery method, device and equipment | |
US10423494B2 (en) | Trimming unused blocks from a versioned image backup of a source storage that is stored in a sparse storage | |
WO2023050665A1 (en) | Cross-node cloning method and apparatus for storage volume, and device and storage medium |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
RJ01 | Rejection of invention patent application after publication |
Application publication date: 20210625 |
|
RJ01 | Rejection of invention patent application after publication |