CN113031879A - Cluster storage method based on LVM logic - Google Patents

Cluster storage method based on LVM logic Download PDF

Info

Publication number
CN113031879A
CN113031879A CN202110561937.6A CN202110561937A CN113031879A CN 113031879 A CN113031879 A CN 113031879A CN 202110561937 A CN202110561937 A CN 202110561937A CN 113031879 A CN113031879 A CN 113031879A
Authority
CN
China
Prior art keywords
lvm
logic
hard disk
logic area
new
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202110561937.6A
Other languages
Chinese (zh)
Inventor
梁润强
曾宪力
史伟
闵宇
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Guangdong Eflycloud Computing Co Ltd
Original Assignee
Guangdong Eflycloud Computing Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Guangdong Eflycloud Computing Co Ltd filed Critical Guangdong Eflycloud Computing Co Ltd
Priority to CN202110561937.6A priority Critical patent/CN113031879A/en
Publication of CN113031879A publication Critical patent/CN113031879A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601Interfaces specially adapted for storage systems
    • G06F3/0668Interfaces specially adapted for storage systems adopting a particular infrastructure
    • G06F3/067Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601Interfaces specially adapted for storage systems
    • G06F3/0602Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
    • G06F3/0604Improving or facilitating administration, e.g. storage management
    • G06F3/0607Improving or facilitating administration, e.g. storage management by facilitating the process of upgrading existing storage systems, e.g. for improving compatibility between host and storage device
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601Interfaces specially adapted for storage systems
    • G06F3/0628Interfaces specially adapted for storage systems making use of a particular technique
    • G06F3/0629Configuration or reconfiguration of storage systems

Abstract

The invention discloses a cluster storage method based on LVM logic, which comprises the following steps: forming an LVM logic area by a plurality of hard disks, and carrying out mirror image processing on each LVM logic area; installing an OSD program on the LVM logic area, and mounting the LVM logic area on a CEPH cluster storage system; if any hard disk in the LVM logic area sends a damage condition, or any hard disk needs to be actively replaced, the hard disk is replaced to obtain a new hard disk, and the LVM logic mirror corresponding to the LVM logic area performs mirroring operation on the new hard disk for data recovery; and when a hard disk needs to be newly added in the LVM logic area, performing LVM logic on the newly added hard disk and obtaining a new LVM logic area. The method and the device can enable the ceph cluster to perform capacity expansion and hard disk removal without perception.

Description

Cluster storage method based on LVM logic
Technical Field
The invention relates to the technical field of distributed storage, in particular to a cluster storage method based on LVM logic.
Background
With the development of cloud computing in the internet, distributed ceph storage is recognized and widely used by people, and when capacity expansion is performed on a ceph cluster which is deployed at present, each factory enterprise has a self-owned mode to perform capacity expansion.
The Ceph cluster is a uniform distributed object storage, and for a deployed storage cluster, capacity expansion is needed if the space is insufficient, or capacity expansion is needed after elimination if a disk is bad.
In the prior art, the operations of expanding a hard disk or removing the hard disk all result in the process of performing data balanced migration on the existing ceph cluster, so that the pressure of a data disk is increased, and the flow of data migration performs resource preemption (such as network bandwidth and disk performance) with the normal service data flow.
Disclosure of Invention
In order to solve one of the problems, the invention provides a cluster storage method based on LVM logic, which forms an LVM logic area by performing LVM logic processing on a hard disk, solves the problem of sudden performance increase caused by the replacement or addition of the hard disk of a subsequent ceph cluster, and can expand the capacity and remove the hard disk of the ceph cluster without perception.
In order to solve the technical problems, the invention provides the following technical scheme: a cluster storage method based on LVM logic comprises the following steps:
performing LVM logic processing on a plurality of hard disks to form an LVM logic area, and performing mirror image processing on each LVM logic area to obtain an LVM logic mirror image corresponding to each LVM logic area;
installing an OSD program on the LVM logic area, and mounting the LVM logic area on a CEPH cluster storage system; the CEPH cluster storage system comprises a plurality of LVM logical zones.
Further, the cluster storage method based on the LVM logic further includes the steps of:
if any hard disk in the LVM logic area sends a damage condition, the damaged hard disk is replaced by a new hard disk, and the LVM logic mirror corresponding to the LVM logic area performs mirroring operation on the new hard disk for recovering data;
or, if any hard disk in the LVM logic area needs to be actively replaced, the hard disk is replaced to obtain a new hard disk, and the LVM logic mirror corresponding to the LVM logic area performs a mirroring operation on the new hard disk for data recovery.
Further, the cluster storage method based on the LVM logic further includes the steps of:
when a new hard disk is needed to be added in the LVM logic area, performing LVM logic on the added hard disk to obtain a new LVM logic area, and performing mirror image processing on the corresponding LVM logic mirror image of the added hard disk.
After the technical scheme is adopted, the invention at least has the following beneficial effects: according to the invention, the LVM logic processing is carried out on the hard disk to form an LVM logic area, so that the Ceph cluster layer can carry out hard disk capacity expansion or damaged hard disk replacement without perception or in a seamless manner, and the storage efficiency of the Ceph cluster is greatly improved.
Drawings
Fig. 1 is a flowchart illustrating steps of a cluster storage method based on LVM logic according to the present invention.
Detailed Description
It should be noted that, in the present application, the embodiments and features of the embodiments may be combined with each other without conflict, and the present application is further described in detail with reference to the drawings and specific embodiments.
Example 1
As shown in fig. 1, this embodiment provides a cluster storage method based on LVM logic, which includes the steps of:
step S1, performing LVM logic processing on the plurality of hard disks to form an LVM logic area, and performing mirror image processing on each LVM logic area to obtain an LVM logic mirror image corresponding to each LVM logic area; here, a plurality of hard disks on the device are combined into an LVM, and an LVM mirror mode is configured (when a plurality of hard disks synchronize data, even if a disk is lost, the disk data is guaranteed to be redundant due to the mirror mode); in addition, LVM refers to: the LVM is a shorthand of Logical Volume Manager (Logical Volume management), and is a mechanism for managing disk partitions in a Linux environment, and is implemented by Heinz mauelhagen on a Linux 2.4 kernel, and the latest version at present is: stable version 1.0.5, development version 1.1.0-rc2, and LVM2 development version;
step S2, installing an OSD program on the LVM logic area, and mounting the LVM logic area on a CEPH cluster storage system; the CEPH cluster storage system comprises a plurality of LVM logic areas;
step S3, if any hard disk in the LVM logic area sends a damage condition, the damaged hard disk is replaced by a new hard disk, and the LVM logic mirror corresponding to the LVM logic area performs mirror image operation on the new hard disk for data recovery;
or if any hard disk in the LVM logic area needs to be actively replaced, replacing the hard disk to obtain a new hard disk, and performing mirroring operation on the new hard disk by using the LVM logic mirror corresponding to the LVM logic area for data recovery;
step S4, when a new hard disk needs to be added to the LVM logic area, performing LVM logic on the new hard disk to obtain a new LVM logic area, and performing mirror image processing on the corresponding LVM logic mirror image of the new hard disk.
In this embodiment, by increasing the logical protection of the LVM, the ceph cluster is seamlessly docked to expand/reduce the capacity (reject the hard disk, reduce the hard disk), so that the performance sudden increase caused by the data synchronization required by the ceph cluster due to the hard disk problem is avoided.
Although embodiments of the present invention have been shown and described, it will be appreciated by those skilled in the art that various equivalent changes, modifications, substitutions and alterations can be made herein without departing from the principles and spirit of the invention, the scope of which is defined by the appended claims and their equivalents.

Claims (3)

1. A cluster storage method based on LVM logic is characterized by comprising the following steps:
performing LVM logic processing on a plurality of hard disks to form an LVM logic area, and performing mirror image processing on each LVM logic area to obtain an LVM logic mirror image corresponding to each LVM logic area;
installing an OSD program on the LVM logic area, and mounting the LVM logic area on a CEPH cluster storage system; the CEPH cluster storage system comprises a plurality of LVM logical zones.
2. The cluster storage method based on LVM logic according to claim 1, further comprising the steps of:
if any hard disk in the LVM logic area sends a damage condition, the damaged hard disk is replaced by a new hard disk, and the LVM logic mirror corresponding to the LVM logic area performs mirroring operation on the new hard disk for recovering data;
or, if any hard disk in the LVM logic area needs to be actively replaced, the hard disk is replaced to obtain a new hard disk, and the LVM logic mirror corresponding to the LVM logic area performs a mirroring operation on the new hard disk for data recovery.
3. The cluster storage method based on LVM logic according to claim 2, further comprising the steps of:
when a new hard disk is needed to be added in the LVM logic area, performing LVM logic on the added hard disk to obtain a new LVM logic area, and performing mirror image processing on the corresponding LVM logic mirror image of the added hard disk.
CN202110561937.6A 2021-05-24 2021-05-24 Cluster storage method based on LVM logic Pending CN113031879A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202110561937.6A CN113031879A (en) 2021-05-24 2021-05-24 Cluster storage method based on LVM logic

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202110561937.6A CN113031879A (en) 2021-05-24 2021-05-24 Cluster storage method based on LVM logic

Publications (1)

Publication Number Publication Date
CN113031879A true CN113031879A (en) 2021-06-25

Family

ID=76455510

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202110561937.6A Pending CN113031879A (en) 2021-05-24 2021-05-24 Cluster storage method based on LVM logic

Country Status (1)

Country Link
CN (1) CN113031879A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116680114A (en) * 2023-08-04 2023-09-01 浙江鹏信信息科技股份有限公司 LVM fault data quick recovery method, system and computer readable storage medium

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TWI307026B (en) * 2005-12-30 2009-03-01 Ind Tech Res Inst System and method for storage management
CN104850469A (en) * 2015-05-12 2015-08-19 浪潮电子信息产业股份有限公司 LV mirror image-based method for realizing data backup, recovery and migration in linux system
CN105068894A (en) * 2015-09-10 2015-11-18 浪潮(北京)电子信息产业有限公司 Method and device for achieving high availability of Linux system storage device on basis of LVM mirror image
CN111857577A (en) * 2020-06-29 2020-10-30 烽火通信科技股份有限公司 Method and device for managing physical hard disk in distributed storage system
US10887167B2 (en) * 2018-04-30 2021-01-05 At&T Intellectual Property I, L.P. Adaptive software-defined storage for cloud storage workloads

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TWI307026B (en) * 2005-12-30 2009-03-01 Ind Tech Res Inst System and method for storage management
CN104850469A (en) * 2015-05-12 2015-08-19 浪潮电子信息产业股份有限公司 LV mirror image-based method for realizing data backup, recovery and migration in linux system
CN105068894A (en) * 2015-09-10 2015-11-18 浪潮(北京)电子信息产业有限公司 Method and device for achieving high availability of Linux system storage device on basis of LVM mirror image
US10887167B2 (en) * 2018-04-30 2021-01-05 At&T Intellectual Property I, L.P. Adaptive software-defined storage for cloud storage workloads
CN111857577A (en) * 2020-06-29 2020-10-30 烽火通信科技股份有限公司 Method and device for managing physical hard disk in distributed storage system

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116680114A (en) * 2023-08-04 2023-09-01 浙江鹏信信息科技股份有限公司 LVM fault data quick recovery method, system and computer readable storage medium
CN116680114B (en) * 2023-08-04 2023-10-31 浙江鹏信信息科技股份有限公司 LVM fault data quick recovery method, system and computer readable storage medium

Similar Documents

Publication Publication Date Title
AU2014218837B2 (en) Deduplication storage system with efficient reference updating and space reclamation
US8924358B1 (en) Change tracking of individual virtual disk files
US8127174B1 (en) Method and apparatus for performing transparent in-memory checkpointing
US10055300B2 (en) Disk group based backup
CN106776130B (en) Log recovery method, storage device and storage node
US20140136803A1 (en) Backing up Method, Device, and System for Virtual Machine
CN110633325B (en) Docker-based database cluster capacity expansion method and device
CN104994168A (en) distributed storage method and distributed storage system
CN116680256B (en) Database node upgrading method and device and computer equipment
CN110489494B (en) Online expansion method and device for distributed database
JP6663995B2 (en) System and method for backing up a large-scale distributed scale-out data system
WO2018113484A1 (en) Method and apparatus for recovering multi-replica data
US20180349233A1 (en) File synchronization using delta bitmaps
CN111966526A (en) Virtual machine backup method and device based on cloud platform data center
CN113031879A (en) Cluster storage method based on LVM logic
US11128708B2 (en) Managing remote replication in storage systems
CN111045602B (en) Cluster system control method and cluster system
JP2007140777A (en) Computer system, management computer and data recovery method
CN111240901A (en) Node dynamic expansion system, method and equipment of distributed block storage system
CN113051030A (en) Virtual machine recovery system and method based on fusion computer virtualization platform
US11055263B2 (en) Information processing device and information processing system for synchronizing data between storage devices
US10649862B1 (en) Reducing failback performance duration in data replication systems
CN115098300B (en) Database backup method, disaster recovery method, device and equipment
US10423494B2 (en) Trimming unused blocks from a versioned image backup of a source storage that is stored in a sparse storage
WO2023050665A1 (en) Cross-node cloning method and apparatus for storage volume, and device and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20210625

RJ01 Rejection of invention patent application after publication