CN106777394B - Cluster file system - Google Patents

Cluster file system Download PDF

Info

Publication number
CN106777394B
CN106777394B CN201710113470.2A CN201710113470A CN106777394B CN 106777394 B CN106777394 B CN 106777394B CN 201710113470 A CN201710113470 A CN 201710113470A CN 106777394 B CN106777394 B CN 106777394B
Authority
CN
China
Prior art keywords
block
file
nfs
lock
management module
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201710113470.2A
Other languages
Chinese (zh)
Other versions
CN106777394A (en
Inventor
马怀旭
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Suzhou Langchao Intelligent Technology Co Ltd
Original Assignee
Suzhou Langchao Intelligent Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Suzhou Langchao Intelligent Technology Co Ltd filed Critical Suzhou Langchao Intelligent Technology Co Ltd
Priority to CN201710113470.2A priority Critical patent/CN106777394B/en
Publication of CN106777394A publication Critical patent/CN106777394A/en
Application granted granted Critical
Publication of CN106777394B publication Critical patent/CN106777394B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/10File systems; File servers
    • G06F16/18File system types
    • G06F16/182Distributed file systems
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/10File systems; File servers
    • G06F16/11File system administration, e.g. details of archiving or snapshots
    • G06F16/116Details of conversion of file system types or formats

Abstract

The invention discloses a cluster file system, comprising: the lvm management module and the nfs management module; the lvm management module is used for creating corresponding block equipment according to the block equipment creation information and providing the block equipment for the cluster user, so that the cluster user directly performs IO operation in the block equipment; the nfs management module is used for mounting an nfs file system on a node of the mounted lvm storage pool and managing the lvm storage pool through sanlock; the cluster file system provides block equipment to enable the virtual equipment to format the block equipment into a file system required by the virtual equipment according to a required file format, so that the process of IO operation each time is reduced; meanwhile, IO operation with higher speed is provided, the efficiency of the cluster file system is improved, and meanwhile the IO speed of the virtual equipment of the cluster is improved.

Description

Cluster file system
Technical Field
The invention relates to the technical field of computers, in particular to a cluster file system.
Background
With the rapid development of computer technology and network technology, the cluster system gradually becomes the focus of the computer industry with its powerful computing capability and robust fault-tolerant mechanism. However, the development of the cluster file system as a complete set is influenced by the distribution and is slow, and most of the cluster file systems are in a file system format required by the re-creation of the virtual machine on the basis of the original file system. The file system deepens the flow of IO operation each time and reduces the access rate of the file system. Therefore, how to improve the efficiency of the cluster file system is a technical problem to be solved by those skilled in the art.
Disclosure of Invention
The invention aims to provide a cluster file system, which provides block equipment to enable virtual equipment to format the block equipment into a file system required by the virtual equipment according to a required file format, so that the process of IO operation at each time is reduced.
To solve the above technical problem, the present invention provides a cluster file system, including: the lvm management module and the nfs management module; wherein the content of the first and second substances,
the lvm management module is used for creating corresponding block equipment according to the block equipment creation information and providing the block equipment for a cluster user, so that the cluster user directly performs IO operation in the block equipment;
and the nfs management module is used for mounting an nfs file system on a node of the mounted lvm storage pool and managing the lvm storage pool through sanlock.
Optionally, the nfs management module includes:
and the initialization module is used for creating a corresponding lvm storage pool lock information file in the nfs file system when the lvm storage pool is created.
Optionally, the initialization module specifically executes initlockspace through sanlock when the lvm storage pool is created, executes add lockspace operation on each host, creates a file named as uuid of vg, and enables the file to have a resource lock corresponding to the lvm storage pool.
Optionally, the nfs management module includes:
and the metadata consistency unit is used for acquiring the corresponding vg lock resources through sanlock and then executing the corresponding metadata operation if the metadata operation request is received, and releasing the vg lock resources after the metadata operation is completed.
Optionally, the nfs management module includes:
and the block device lock information creating unit is used for creating a corresponding block device lock information file in the nfs file system when creating the block device.
Optionally, the block device lock information creating unit is specifically configured to create, by using sanlock, a file named by uuid of the block device when the block device is created, and execute an init resource operation by using sanlock, so that the file has a resource lock of the block device.
Optionally, the nfs management module includes:
and the block device operation unit is used for acquiring the corresponding lock resource through sanlock and then executing the corresponding block device operation if the block device operation request is received, and releasing the lock resource after the block device operation is completed.
Optionally, the nfs management module includes:
and the block device lock information deleting unit is used for deleting the block device when detecting that the lock resource corresponding to the block device is not occupied through sanlock when the block device deleting request is received, and deleting the block device lock information file corresponding to the block device after the deletion is successful.
Optionally, the scheme further includes:
and the lock information detection module is used for detecting the lock information in the nfs management module and the block device information in the kernel at regular time and deleting the kernel information corresponding to the deleted block device.
The invention provides a cluster file system, comprising: the lvm management module and the nfs management module; the lvm management module is used for creating corresponding block equipment according to the block equipment creation information and providing the block equipment for the cluster user, so that the cluster user directly performs IO operation in the block equipment; the nfs management module is used for mounting an nfs file system on a node of the mounted lvm storage pool and managing the lvm storage pool through sanlock;
therefore, the cluster file system provides the block device, so that the virtual device directly formats the block device into a file system required by the virtual device according to a required file format, namely, a user directly performs IO operation in the block device, the steps of performing IO operation in the file system in the prior art are reduced, and the flow of each IO operation is reduced; meanwhile, IO operation with higher speed is provided, the efficiency of the cluster file system is improved, and meanwhile the IO speed of the virtual equipment of the cluster is improved.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to the provided drawings without creative efforts.
Fig. 1 is a block diagram of a cluster file system according to an embodiment of the present invention;
fig. 2 is a block diagram of another cluster file system according to an embodiment of the present invention.
Detailed Description
The core of the invention is to provide a cluster file system, which provides block devices to enable virtual devices to format the block devices into file systems required by the virtual devices according to required file formats, so that the process of IO operation at each time is reduced.
In order to make the objects, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, but not all, embodiments of the present invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
In this embodiment, lvm is local volume manager, nfs (network file system), and sanlock is a lightweight and flexible distributed lock manager implemented by software, and is applied to open-source virtualization projects such as ovirt and libvirt. In the prior art, the IO operation is performed in the file system at first, and then the file system writes the corresponding IO operation into the block device, that is, the flow of the IO operation is performed twice, so that the IO operation speed is reduced. In this embodiment, the block device is directly provided, so that the block device directly performs IO operation in the block device, thereby saving the flow of the IO operation and improving the speed of the IO operation. Referring to fig. 1 in detail, fig. 1 is a block diagram of a cluster file system according to an embodiment of the present invention; the system may include: the lvm management module 100 and the nfs management module 200; wherein the content of the first and second substances,
the lvm management module 100 is configured to create a corresponding block device according to the block device creation information and provide the block device to a cluster user, so that the cluster user directly performs IO operation in the block device;
specifically, the lvm management module 100 provides a specific block device for the cluster to use, so as to increase the access speed of the cluster file system.
And the nfs management module 200 is used for mounting an nfs file system on a node of the mount lvm storage pool and managing the lvm storage pool through sanlock.
Specifically, the nfs management module 200 provides a dependency file for cluster management, and determines a storage target managed by the sanlock lock through nfs. And the purpose of sanlock management in the nfs management module 200 is to better adapt to cluster management files for lvm, and simultaneously prevent common access of cluster members from causing a split brain phenomenon. Namely, the nfs file system provides storage dependence managed by sanlock, namely, nodes for mounting the lvm storage pool all need to mount the nfs file system, and the lvm storage pool is managed by sanlock, so that the nfs file system is suitable for a cluster file system.
Further, sanlock can not only provide a lock management scheme; meanwhile, the Sanlock can also provide a weak cluster management scheme, namely cluster lvm storage pool access node control. So as to improve the management efficiency and the management reliability of the nfs management module 200.
The system achieves management control of a cluster file system through a lvm management module 100 and an nfs management module 200. The shared readable and writable file is provided by a file system which can be mutually accessed by cluster members provided by nfs, and the exclusive lock operation is provided by sanlock, so that the resource is prevented from being reused by different machines.
Based on the above technical solution, in the cluster file system provided in the embodiments of the present invention, the system provides the virtual device with a specific block file, and the virtual device formats the block file into a file system required by the virtual device according to a required file format, thereby reducing a flow of each IO operation. Meanwhile, IO operation with higher speed is provided, the efficiency of the cluster file system is improved, and meanwhile the IO speed of the virtual equipment of the cluster is improved.
Based on the above embodiment, when creating lv, metadata of lv is operated, because multiple hosts can access and create the lvm storage pool at the same time, in order to ensure security of the metadata of lv, each operation on metadata of lv of a cluster must be mutually exclusive, and therefore, the operation on metadata of the cluster is ensured to be mutually exclusive through sanlock, and therefore, sanlock + nfs provides a vg lock, that is, the operation on metadata must acquire a vg lock through sanlock, then operate, and release the vg lock after the operation is completed. That is, optionally, in this embodiment, the nfs management module 200 may include:
and the initialization module is used for creating a corresponding lvm storage pool lock information file in the nfs file system when the lvm storage pool is created.
Specifically, the initialization module executes initlockspace through sanlock when the lvm storage pool is created, executes add lockspace operation on each host, creates a file named as uuid of vg, and enables the file to have a resource lock corresponding to the lvm storage pool.
That is, the iscsi device or FC block device is configured first, and the LUN can be accessed normally by the host, and an nfs file system that can be accessed by each host is mounted on each host using the LUN. Deploying the sanlock management software, then executing init lockspace (using uuid of vg to be created as lockspace name of the lock information) operation on one host, namely initializing the distributed lock information, then executing addockspace operation on each host, namely executing connection lock operation, and performing lock management operation on each host; create vg (uuid of lockspace name mentioned above), then create lock information for vg (file named uuid of vg) on nfs file system, and then initialize.
And the metadata consistency unit is used for acquiring the corresponding vg lock resource through sanlock and then executing the corresponding metadata operation if the metadata operation request is received, and releasing the vg lock resource after the metadata operation is completed.
The method comprises the steps of connecting a plurality of disk partitions into a whole volume group (vg) to form an lvm storage pool.
Based on the above embodiment, in order to prevent the split brain problem caused by simultaneous access of clusters, the nfs management module in this embodiment may include:
and the block device lock information creating unit is used for creating a corresponding block device lock information file in the nfs file system when the block device is created.
Specifically, the block device lock information creating unit is to create a file named by uuid of the block device through sanlock when the block device is created, and execute an init resource operation through sanlock, so that the file has a resource lock of the block device.
That is, each operation that creates an lv (i.e., block device) must create a file named uuid of the lv on top of the nfs file system, while performing an init resource operation on the file, that is, the file is the lock information of the lv.
And the block device operation unit is used for executing the corresponding block device operation after acquiring the corresponding lock resource through sanlock and releasing the lock resource after the block device operation is completed when the block device operation request is received.
And the block device lock information deleting unit is used for deleting the block device when detecting that the lock resource corresponding to the block device is not occupied through sanlock when the block device deleting request is received, and deleting the block device lock information file corresponding to the block device after the block device is successfully deleted.
Specifically, each time the lv is used, the resource lock of the lv must be acquired, and when the lv is deleted, the resource lock must be deleted at the same time. For the residual data of the lv of the kernel, each operation for creating the lv must create a lock of a resource of the sanlock through the sanlock, that is, resource information named by uuid of the lv, the lock of the lv is acquired each time the lv is used, and then the lv can be normally used; and when the lv can be deleted normally, the deleting operation is executed, and the lock information of the lv is required to be deleted after the lv is deleted, so that the information residue is avoided.
Based on any of the above embodiments, please refer to fig. 2, this embodiment may further include:
and the lock information detection module is used for detecting the lock information in the nfs management module and the block device information in the kernel at regular time and deleting the kernel information corresponding to the deleted block device.
Specifically, other cluster member nodes need to have a timing task to detect the content of the lock information and the kernel lv information, and delete the deleted kernel lv information. Ensuring that system resources are not occupied.
The cluster file system provided by the invention is described in detail above. The principles and embodiments of the present invention are explained herein using specific examples, which are presented only to assist in understanding the method and its core concepts. It should be noted that, for those skilled in the art, it is possible to make various improvements and modifications to the present invention without departing from the principle of the present invention, and those improvements and modifications also fall within the scope of the claims of the present invention.

Claims (7)

1. A clustered file system, comprising: the lvm management module and the nfs management module; wherein the content of the first and second substances,
the lvm management module is used for creating corresponding block equipment according to the block equipment creation information and providing the block equipment for a cluster user, so that the cluster user directly performs IO operation in the block equipment;
the nfs management module is used for mounting an nfs file system on a node of a mounted lvm storage pool and managing the lvm storage pool through sanlock;
the nfs management module comprises:
a block device lock information deleting unit, configured to delete a block device when detecting, through sanlock, that a lock resource corresponding to the block device is not occupied when a block device deletion request is received, and delete a block device lock information file corresponding to the block device after the deletion is successful;
further comprising: and the lock information detection module is used for detecting the lock information in the nfs management module and the block device information in the kernel at regular time and deleting the kernel information corresponding to the deleted block device.
2. The cluster file system of claim 1, wherein the nfs management module comprises:
and the initialization module is used for creating a corresponding lvm storage pool lock information file in the nfs file system when the lvm storage pool is created.
3. The cluster file system of claim 2, wherein the initialization module is specifically configured to execute an init lockspace through sanlock when the lvm storage pool is created, and execute add lockspace operation on each host to create a file named uuid of vg, so that the file has a resource lock corresponding to the lvm storage pool.
4. The cluster file system of claim 3, wherein the nfs management module comprises:
and the metadata consistency unit is used for acquiring the corresponding vg lock resources through sanlock and then executing the corresponding metadata operation if the metadata operation request is received, and releasing the vg lock resources after the metadata operation is completed.
5. The cluster file system of claim 4, wherein the nfs management module comprises:
and the block device lock information creating unit is used for creating a corresponding block device lock information file in the nfs file system when creating the block device.
6. The cluster file system according to claim 5, wherein the block device lock information creating unit is specifically configured to create a file named uuid of the block device by sanlock when creating the block device, and perform an init resource operation by sanlock to make the file have a resource lock of the block device.
7. The cluster file system of claim 6, wherein the nfs management module comprises:
and the block device operation unit is used for acquiring the corresponding lock resource through sanlock and then executing the corresponding block device operation if the block device operation request is received, and releasing the lock resource after the block device operation is completed.
CN201710113470.2A 2017-02-28 2017-02-28 Cluster file system Active CN106777394B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201710113470.2A CN106777394B (en) 2017-02-28 2017-02-28 Cluster file system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201710113470.2A CN106777394B (en) 2017-02-28 2017-02-28 Cluster file system

Publications (2)

Publication Number Publication Date
CN106777394A CN106777394A (en) 2017-05-31
CN106777394B true CN106777394B (en) 2020-09-18

Family

ID=58959799

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201710113470.2A Active CN106777394B (en) 2017-02-28 2017-02-28 Cluster file system

Country Status (1)

Country Link
CN (1) CN106777394B (en)

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107391236B (en) * 2017-09-15 2020-03-06 郑州云海信息技术有限公司 Cluster block storage implementation method and device
CN109240601B (en) * 2018-07-24 2021-08-27 中国建设银行股份有限公司 Storage space processing method and device for cloud storage and storage medium
CN111225020B (en) * 2019-11-07 2021-06-29 苏州浪潮智能科技有限公司 User mode network file system dual-stack access method, device and equipment
CN112988319A (en) * 2019-12-02 2021-06-18 中兴通讯股份有限公司 LVM data processing method and device, computer equipment and computer readable medium

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20120266162A1 (en) * 2011-04-12 2012-10-18 Red Hat Israel, Inc. Mechanism for Storing a Virtual Machine on a File System in a Distributed Environment
CN102664923A (en) * 2012-03-30 2012-09-12 浪潮电子信息产业股份有限公司 Method for realizing shared storage pool by utilizing Linux global file system
CN103731508A (en) * 2014-01-23 2014-04-16 易桂先 Cloud-storage-based network hard disk device and management method thereof
CN105471695A (en) * 2014-08-21 2016-04-06 西安慧泽知识产权运营管理有限公司 Storage area network virtualization management method
CN106201357A (en) * 2016-07-18 2016-12-07 浪潮(北京)电子信息产业有限公司 The construction method of a kind of storage pool and system

Also Published As

Publication number Publication date
CN106777394A (en) 2017-05-31

Similar Documents

Publication Publication Date Title
US9671967B2 (en) Method and system for implementing a distributed operations log
EP3008600B1 (en) Virtual machine backup from storage snapshot
CN106777394B (en) Cluster file system
US9286344B1 (en) Method and system for maintaining consistency for I/O operations on metadata distributed amongst nodes in a ring structure
US9092248B1 (en) Systems and methods for restoring distributed applications within virtual data centers
US7669020B1 (en) Host-based backup for virtual machines
US9678680B1 (en) Forming a protection domain in a storage architecture
US10379759B2 (en) Method and system for maintaining consistency for I/O operations on metadata distributed amongst nodes in a ring structure
US20150095597A1 (en) High performance intelligent virtual desktop infrastructure using volatile memory arrays
US10067692B2 (en) Method and apparatus for backing up and restoring cross-virtual machine application
US9354907B1 (en) Optimized restore of virtual machine and virtual disk data
US8881144B1 (en) Systems and methods for reclaiming storage space from virtual machine disk images
US9354908B2 (en) Instantly restoring virtual machines by providing read/write access to virtual disk before the virtual disk is completely restored
US9336131B1 (en) Systems and methods for enabling virtual environments to mount non-native storage disks
US20170322793A1 (en) Upgrade of an operating system of a virtual machine
US9003139B1 (en) Systems and methods for recovering virtual machines after disaster scenarios
US8615488B2 (en) Physical replication of database subset to improve availability and reduce resource cost in a cloud environment
US9805038B2 (en) Efficient conflict resolution among stateless processes
US8990815B1 (en) Synchronizing allocated blocks of virtual disk files across primary and secondary volumes by excluding unused blocks
JP6663995B2 (en) System and method for backing up a large-scale distributed scale-out data system
WO2019155308A1 (en) Data migration in a hierarchical storage management system
US20200272441A1 (en) Systems and methods for mapping software applications interdependencies
US10831554B2 (en) Cohesive clustering in virtualized computing environment
US9372638B1 (en) Systems and methods for backing up virtual machine data
US11099735B1 (en) Facilitating the recovery of full HCI clusters

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
TA01 Transfer of patent application right

Effective date of registration: 20200821

Address after: 215100 No. 1 Guanpu Road, Guoxiang Street, Wuzhong Economic Development Zone, Suzhou City, Jiangsu Province

Applicant after: SUZHOU LANGCHAO INTELLIGENT TECHNOLOGY Co.,Ltd.

Address before: 450018 Henan province Zheng Dong New District of Zhengzhou City Xinyi Road No. 278 16 floor room 1601

Applicant before: ZHENGZHOU YUNHAI INFORMATION TECHNOLOGY Co.,Ltd.

TA01 Transfer of patent application right
GR01 Patent grant
GR01 Patent grant