CN107391236B - Cluster block storage implementation method and device - Google Patents
Cluster block storage implementation method and device Download PDFInfo
- Publication number
- CN107391236B CN107391236B CN201710830214.5A CN201710830214A CN107391236B CN 107391236 B CN107391236 B CN 107391236B CN 201710830214 A CN201710830214 A CN 201710830214A CN 107391236 B CN107391236 B CN 107391236B
- Authority
- CN
- China
- Prior art keywords
- cluster
- lvm
- management
- corosyn
- virtual machine
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 30
- 230000005540 biological transmission Effects 0.000 claims description 10
- 238000012217 deletion Methods 0.000 claims description 6
- 230000037430 deletion Effects 0.000 claims description 6
- 238000013507 mapping Methods 0.000 claims description 4
- 239000000126 substance Substances 0.000 claims 1
- 238000004891 communication Methods 0.000 description 3
- 238000010586 diagram Methods 0.000 description 3
- 238000005516 engineering process Methods 0.000 description 3
- 238000011161 development Methods 0.000 description 2
- 230000002159 abnormal effect Effects 0.000 description 1
- 230000000903 blocking effect Effects 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000005192 partition Methods 0.000 description 1
- 238000011084 recovery Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/44—Arrangements for executing specific programs
- G06F9/455—Emulation; Interpretation; Software simulation, e.g. virtualisation or emulation of application or operating system execution engines
- G06F9/45533—Hypervisors; Virtual machine monitors
- G06F9/45558—Hypervisor-specific management and integration aspects
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
- G06F3/0604—Improving or facilitating administration, e.g. storage management
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
- G06F3/0614—Improving the reliability of storage systems
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
- G06F3/0638—Organizing or formatting or addressing of data
- G06F3/0644—Management of space entities, e.g. partitions, extents, pools
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
- G06F3/0662—Virtualisation aspects
- G06F3/0665—Virtualisation aspects at area level, e.g. provisioning of virtual or logical volumes
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0668—Interfaces specially adapted for storage systems adopting a particular infrastructure
- G06F3/067—Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/46—Multiprogramming arrangements
- G06F9/54—Interprogram communication
- G06F9/542—Event management; Broadcasting; Multicasting; Notifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/46—Multiprogramming arrangements
- G06F9/54—Interprogram communication
- G06F9/546—Message passing systems or structures, e.g. queues
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/44—Arrangements for executing specific programs
- G06F9/455—Emulation; Interpretation; Software simulation, e.g. virtualisation or emulation of application or operating system execution engines
- G06F9/45533—Hypervisors; Virtual machine monitors
- G06F9/45558—Hypervisor-specific management and integration aspects
- G06F2009/45579—I/O management, e.g. providing access to device drivers or storage
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Software Systems (AREA)
- Human Computer Interaction (AREA)
- Multimedia (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The embodiment of the invention discloses a cluster block storage implementation method and a device, wherein the method comprises the following steps: providing a block device to a virtual machine by a Logical Volume Management (LVM) so that the virtual machine can create a file system required by the virtual machine; and performing cluster management by adopting a corosyn cluster management system, so that the host master selected by the corosyn cluster executes the resource operation of the LVM storage pool. The embodiment of the invention reduces the flow of IO operation each time, can improve the efficiency of the cluster file system, simultaneously improves the IO speed of the virtual machine of the cluster, and optimizes the storage performance of the cluster.
Description
Technical Field
The present invention relates to cloud computing technologies, and in particular, to a method and an apparatus for implementing cluster block storage.
Background
With the rapid development of computer technology and network technology, the cluster system gradually becomes the focus of the computer industry with its powerful computing capability and robust fault-tolerant mechanism. However, the development of the cluster file system as a complete set is influenced by the distribution and is slow, and most of the cluster file systems are in a file system format required by the re-creation of the virtual machine on the basis of the original file system. The file system deepens the process of input and output IO operation every time and reduces the access rate of the file system.
Disclosure of Invention
In order to solve the above technical problems, embodiments of the present invention provide a method and an apparatus for implementing cluster block storage, which can reduce a flow of each IO operation, improve efficiency of a cluster file system, and improve an IO speed of a virtual machine of a cluster.
In order to achieve the object of the present invention, in one aspect, an embodiment of the present invention provides a method for implementing cluster block storage, including:
providing a block device to a virtual machine by a Logical Volume Management (LVM) so that the virtual machine can create a file system required by the virtual machine;
and performing cluster management by adopting a corosyn cluster management system, so that the host master selected by the corosyn cluster executes the resource operation of the LVM storage pool.
Further, selecting the host master by a corosyn cluster comprises:
when Corosync selects master node, the selection is decided according to the IO delay of the current host computer to the physical hard disk.
Further, the method further comprises:
and providing the logic volume LV through the LVM, and mapping all IO operations to the LV to a corresponding physical hard disk.
Further, the method further comprises:
when each virtual machine performs IO operation, only the physical hard disk corresponding to the logical volume LV of the virtual machine is operated.
Further, the resource operation on the LVM storage pool includes:
when the LVM storage pool providing the block device is created, selecting storage which can be accessed by all hosts in the cluster, and executing LVM creation operation on one host which can access the storage;
and when the LVM storage pool is mounted, managing a host mounted with the LVM storage pool through a cluster management additional module of a mounting node, wherein the cluster management additional module is a module for compiling management of all operations of a corosync cluster.
Further, the method further comprises:
when the creation and deletion operation of the volume of the storage pool is issued, the written cluster management additional module takes over the operation, the operation is sent to the master node through the corosyn, the master node executes the operation, and the operation result is returned after the execution.
Further, the method further comprises:
the corosync provides a ring network redundancy protocol RRP mode, and a corosync cluster is formed through a redundant network.
Further, the method further comprises:
the corosyn provides a redundant message transmission mechanism, each corosyn cluster node receives the message and then transmits the message to all other nodes through broadcasting, and the message is sent to each cluster member through a ring network of the corosyn.
On the other hand, an embodiment of the present invention further provides a cluster block storage implementation apparatus, including:
the system comprises a providing module, a storage module and a control module, wherein the providing module is used for providing block equipment to a virtual machine by a Logical Volume Management (LVM) so as to enable the virtual machine to create a file system required by the virtual machine;
and the management module is used for performing cluster management by adopting a corosyn cluster management system, so that the host master selected by the corosyn cluster is used for executing resource operation on the LVM storage pool.
Further, the management module is further configured to:
when Corosync selects master node, the selection is decided according to the IO delay of the current host computer to the physical hard disk.
And providing the logic volume LV through the LVM, and mapping all IO operations to the LV to a corresponding physical hard disk.
Further, the apparatus further comprises:
when each virtual machine performs IO operation, only the physical hard disk corresponding to the logical volume LV of the virtual machine is operated.
Further, the management module is further configured to:
when the LVM storage pool providing the block device is created, selecting storage which can be accessed by all hosts in the cluster, and executing LVM creation operation on one host which can access the storage;
and when the LVM storage pool is mounted, managing a host mounted with the LVM storage pool through a cluster management additional module of a mounting node, wherein the cluster management additional module is a module for compiling management of all operations of a corosync cluster.
Further, the apparatus further comprises:
when the creation and deletion operation of the volume of the storage pool is issued, the written cluster management additional module takes over the operation, the operation is sent to the master node through the corosyn, the master node executes the operation, and the operation result is returned after the execution.
Further, the apparatus further comprises:
the corosync provides a ring network redundancy protocol RRP mode, and a corosync cluster is formed through a redundant network.
Further, the apparatus further comprises:
the corosyn provides a redundant message transmission mechanism, each corosyn cluster node receives the message and then transmits the message to all other nodes through broadcasting, and the message is sent to each cluster member through a ring network of the corosyn.
Compared with the prior art, the embodiment of the invention provides the block device to the virtual machine through the logical volume management LVM, so that the virtual machine creates the file system required by the virtual machine; and performing cluster management by adopting a corosyn cluster management system, so that the host master selected by the corosyn cluster executes the resource operation of the LVM storage pool. The embodiment of the invention reduces the flow of IO operation each time, can improve the efficiency of the cluster file system, simultaneously improves the IO speed of the virtual machine of the cluster, and optimizes the storage performance of the cluster.
Additional features and advantages of the invention will be set forth in the description which follows, and in part will be obvious from the description, or may be learned by practice of the invention. The objectives and other advantages of the invention will be realized and attained by the structure particularly pointed out in the written description and claims hereof as well as the appended drawings.
Drawings
The accompanying drawings are included to provide a further understanding of the invention and are incorporated in and constitute a part of this specification, illustrate embodiments of the invention and together with the example serve to explain the principles of the invention and not to limit the invention.
FIG. 1 is a flow chart of a cluster block storage implementation method according to an embodiment of the present invention;
fig. 2 is a structural diagram of a cluster block storage implementation apparatus according to an embodiment of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention more apparent, embodiments of the present invention will be described in detail below with reference to the accompanying drawings. It should be noted that the embodiments and features of the embodiments in the present application may be arbitrarily combined with each other without conflict.
The steps illustrated in the flow charts of the figures may be performed in a computer system such as a set of computer-executable instructions. Also, while a logical order is shown in the flow diagrams, in some cases, the steps shown or described may be performed in an order different than here.
Fig. 1 is a flowchart of a cluster block storage implementation method according to an embodiment of the present invention, and as shown in fig. 1, the method according to the embodiment of the present invention includes the following steps:
step 100: providing a block device to a virtual machine by a Logical Volume Management (LVM) so that the virtual machine can create a file system required by the virtual machine;
in the embodiment of the invention, the LVM provides the block device for the virtual machine, and the virtual machine creates the file system required by the virtual machine, so that the IO operation speed of the virtual machine can be increased, and the storage performance of the virtual machine can be improved.
Step 101: and performing cluster management by adopting a corosyn cluster management system, so that the host master selected by the corosyn cluster executes the resource operation of the LVM storage pool.
The cluster management system is provided through the corosyn, a master agent function is provided through the corosyn, file system operation is carried out through the master, and the data inconsistency caused by multi-computer operation is avoided by using the master operation file system.
Further, selecting the host master by a corosyn cluster comprises:
when Corosync selects master node, the selection is decided according to the IO delay of the current host computer to the physical hard disk.
Specifically, a default IO speed value is set, and when the IO speed of the master host is smaller than the current value, the host with the minimum IO speed is reselected through the corosync to perform metadata operation.
Further, the method further comprises:
and providing the logic volume LV through the LVM, and mapping all IO operations to the LV to a corresponding physical hard disk.
Further, the method further comprises:
when each virtual machine performs IO operation, only the physical hard disk corresponding to the logical volume LV of the virtual machine is operated.
Further, the resource operation on the LVM storage pool includes:
when the LVM storage pool providing the block device is created, selecting storage which can be accessed by all hosts in the cluster, and executing LVM creation operation on one host which can access the storage;
and when the LVM storage pool is mounted, managing a host mounted with the LVM storage pool through a cluster management additional module of a mounting node, wherein the cluster management additional module is a module for compiling management of all operations of a corosync cluster.
Further, the method further comprises:
when the creation and deletion operation of the volume of the storage pool is issued, the written cluster management additional module takes over the operation, the operation is sent to the master node through the corosyn, the master node executes the operation, and the operation result is returned after the execution.
Further, the method further comprises:
the corosync provides a ring network redundancy protocol RRP mode, and a corosync cluster is formed through a redundant network.
Further, the method further comprises:
the corosyn provides a redundant message transmission mechanism, each corosyn cluster node receives the message and then transmits the message to all other nodes through broadcasting, and the message is sent to each cluster member through a ring network of the corosyn.
The embodiment of the invention provides the block device to the virtual machine through the logical volume management LVM, so that the virtual machine creates a file system required by the virtual machine; and performing cluster management by adopting a corosyn cluster management system, so that the host master selected by the corosyn cluster executes the resource operation of the LVM storage pool. The embodiment of the invention reduces the flow of IO operation each time, can improve the efficiency of the cluster file system, simultaneously improves the IO speed of the virtual machine of the cluster, and optimizes the storage performance of the cluster.
The method of the embodiments of the present invention will be described in detail in principle below:
the invention provides a cluster block storage implementation scheme. The cluster-based block device file system is called a research center of the existing cluster file system, and provides a virtual machine with specific block devices, the virtual machine formats the block devices into a file system required by the virtual machine according to a required file format, and when the virtual machine uses the block devices, the virtual machine directly transmits the block devices to a block device provider through the formatted file system, so that the process of IO operation at each time is reduced. Meanwhile, high-speed IO operation is provided, the efficiency of the cluster file system is improved, and the IO speed of the virtual machine of the cluster is improved.
The implementation scheme of the embodiment of the invention ensures cluster members by adopting a corosyn cluster management system, ensures the consistency of messages in a cluster by adopting the corosyn, provides specific block equipment by Logical Volume Manager (LVM), ensures the uniqueness of LVM operation by adopting the corosyn, and realizes the cluster block storage scheme by matching the corosyn and the LVM. For a cluster file system, it is also a requirement of the cluster file system to ensure that a plurality of nodes access together and operate simultaneously.
According to the embodiment of the invention, the block device is provided through the LVM, the block device is provided for the virtual machine, and the virtual machine creates the file system required by the virtual machine, so that the IO operation speed of the virtual machine is increased, and the storage performance of the virtual machine is improved. The cluster management system is provided through the corosyn, a master agent function is provided through the corosyn, file system operation is carried out through the master, a master operation file system is used, data inconsistency caused by multi-computer operation is avoided, and when each virtual machine carries out IO operation, only a disk corresponding to the logic volume LV of the virtual machine is operated, and data conflict cannot be caused. The LVM operation is a metadata operation, and the problem of inconsistent metadata is easily caused when a plurality of machines are operated. Group communication is provided by corosyn.
The embodiment of the invention carries out cluster communication through the corosyn, carries out cluster management, provides block equipment through the LVM, improves the IO performance of the virtual disk, and simultaneously achieves the use of a local block storage cluster through the cluster communication.
When the Corosync selects the master node, the selection needs to be carried out according to the IO delay of the current host computer to the disk, a default IO speed value is set, and when the IO speed of the master host computer is smaller than the current value, the host computer with the minimum IO speed is reselected through the Corosync to carry out metadata operation.
The technical scheme of the embodiment of the invention is implemented as follows:
firstly, all hosts deploy corosyn to form a corosyn cluster, a cluster management additional module is written, messages are transmitted through the corosyn, and meanwhile, the conditions of other nodes are obtained from the corosyn.
When a cluster block storage pool is created, firstly, all hosts in a cluster need to be selected to see the storage, when the storage pool is created, one host which can see the storage is needed, the LVM creation operation is executed on the host, and when the storage pool is mounted, the host mounted with the storage pool is managed through a cluster management additional module of a mounting node;
when the creation and deletion operations of the volumes of the storage pool are issued to the storage pool, the cluster management additional module takes over the operations, sends the operations to the master node through corosyn, the master node executes the operations, and returns the operation results after the execution is finished, so that the operations are finished.
The invention adopts the corosyn cluster and the LVM logical volume management, and adds a cluster additional module, can carry out cluster management by a redundancy network through the corosyn, simultaneously, all nodes can keep the consistency of messages through the property of the corosyn cluster to achieve the effect of one master and multiple standby, can keep the stability of the cluster and the stability of a storage pool to the maximum extent, the LVM provides the logical volume management, and the storage provided by the upper layer is directly mapped to the bottom layer hardware through the management of the logical volume, so that the IO efficiency of the provided storage can be ensured to the maximum capacity.
The embodiment of the invention provides logical volume management through the LVM, and provides redundant cluster management and a redundant message transmission mechanism through the corosyn c to ensure the stability of the cluster and the reliability of cluster operation; logical volume management is provided externally through the LVM, the LV is provided, all IO operations for the LV are directly mapped to the physical hard disk, and the IO speed of the disk is improved; the cluster additional module is used for carrying out master selection operation on the cluster, namely, master nodes are operated and processed, so that the phenomenon that multiple hosts operate metadata of the LVM at the same time is avoided, and the inconsistency of the metadata is avoided.
Further, the corosyn provides a Ring Redundancy Protocol (RRP) mode, and a cluster is formed by Redundant networks, so that the stability of the cluster when the network is abnormal can be ensured to the greatest extent.
Furthermore, the corosyn c provides a redundant message transmission mechanism, each corosyn cluster node receives the message and then transmits the message to all other nodes through broadcasting, and then the message is sent to each cluster member through the ring network of the corosyn c, so that the consistency of all messages of the cluster and the easiness in recovery when the message transmission fails can be maintained.
Furthermore, the LVM provides logical volume management, including that the LVs provided by the LVM directly face the physical devices on the bottom layer, each LV has its own corresponding logical volume, IO operations on the LVs can only be within its own divided range, it is ensured that IO of each LV does not affect each other, and at the same time, because the LVs directly map the physical devices on the bottom layer, it is ensured that the maximum performance of the bottom layer storage is provided.
Further, the LVM provides logical volume management, further comprising: the partition information of all the physical devices is recorded in the metadata area, when all the hosts map the physical disk of the bottom layer, the physical devices can be operated, when multiple hosts operate, the metadata data inconsistency is easily caused, the storage pool is easily damaged, therefore, one host is required to be specially responsible for the metadata operation, all the operations can be performed only one at the same time, and other hosts perform data refreshing after completing the operations, namely all the data can be seen.
Furthermore, only one host can carry out metadata operation, master selection operation is carried out in a corosyn cluster, namely the cluster additional module manages all operations of the cluster, main selection operation is carried out through the cluster additional module, IO performance of the current host is monitored, and when performance reaches bottleneck blocking metadata operation, main selection is carried out again, so that optimal operation performance is achieved, and metadata operation is completed.
The embodiment of the invention ensures the stability of the cluster and the reliability of the operation to the maximum extent through a corosync redundant network management and redundant message transmission mechanism. Logical volume management is carried out through the LVM, all IO operations are directly issued to the disk without passing through the layer of the file system, IO performance of the disk can be improved to the maximum extent, and therefore IO performance of the storage pool is improved.
Fig. 2 is a structural diagram of an apparatus for implementing cluster block storage according to an embodiment of the present invention, and as shown in fig. 2, another aspect of the apparatus for implementing cluster block storage according to an embodiment of the present invention includes:
a providing module 201, configured to provide, by a logical volume management LVM, a block device to a virtual machine, so that the virtual machine creates a file system required by the virtual machine;
and the management module 202 is configured to perform cluster management by using a corosyn cluster management system, so that a host master selected by a corosyn cluster executes resource operations on the LVM storage pool.
Further, the management module 202 is further configured to:
when Corosync selects master node, the selection is decided according to the IO delay of the current host computer to the physical hard disk.
Further, the apparatus further comprises:
when each virtual machine performs IO operation, only the physical hard disk corresponding to the logical volume LV of the virtual machine is operated.
Further, the management module 202 is further configured to:
when the LVM storage pool providing the block device is created, selecting storage which can be accessed by all hosts in the cluster, and executing LVM creation operation on one host which can access the storage;
and when the LVM storage pool is mounted, managing a host mounted with the LVM storage pool through a cluster management additional module of a mounting node, wherein the cluster management additional module is a module for compiling management of all operations of a corosync cluster.
Further, the apparatus further comprises:
when the creation and deletion operation of the volume of the storage pool is issued, the written cluster management additional module takes over the operation, the operation is sent to the master node through the corosyn, the master node executes the operation, and the operation result is returned after the execution.
Further, the apparatus further comprises:
the corosync provides a ring network redundancy protocol RRP mode, and a corosync cluster is formed through a redundant network.
Further, the apparatus further comprises:
the corosyn provides a redundant message transmission mechanism, each corosyn cluster node receives the message and then transmits the message to all other nodes through broadcasting, and the message is sent to each cluster member through a ring network of the corosyn.
The embodiment of the invention can improve the cluster storage performance and cluster stability through a cluster block storage scheme, wherein the cluster block storage implementation scheme ensures the data consistency and the cluster stability through a redundant network and a redundant message transmission mechanism, and improves the IO performance of cluster storage through logical volume management. Therefore, the cluster storage performance is optimized by improving the cluster storage performance.
Although the embodiments of the present invention have been described above, the above description is only for the convenience of understanding the present invention, and is not intended to limit the present invention. It will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the spirit and scope of the invention as defined by the appended claims.
Claims (9)
1. A cluster block storage implementation method is characterized by comprising the following steps:
providing a block device to a virtual machine by a Logical Volume Management (LVM) so that the virtual machine can create a file system required by the virtual machine;
cluster management is carried out by adopting a corosyn cluster management system, so that the host master selected by the corosyn cluster is used for executing resource operation of the LVM storage pool; wherein the content of the first and second substances,
the resource operation for the LVM storage pool comprises the following steps:
when the LVM storage pool providing the block device is created, selecting storage which can be accessed by all hosts in the cluster, and executing LVM creation operation on one host which can access the storage;
and when the LVM storage pool is mounted, managing a host mounted with the LVM storage pool through a cluster management additional module of a mounting node, wherein the cluster management additional module is a module for compiling management of all operations of a corosync cluster.
2. The cluster block storage implementation method of claim 1, wherein selecting the host master by a corosyn cluster comprises:
when Corosync selects master node, the selection is decided according to the IO delay of the current host computer to the physical hard disk.
3. The cluster block storage implementation method of claim 1, further comprising:
and providing the logic volume LV through the LVM, and mapping all IO operations to the LV to a corresponding physical hard disk.
4. The cluster block storage implementation method of claim 3, further comprising:
when each virtual machine performs IO operation, only the physical hard disk corresponding to the logical volume LV of the virtual machine is operated.
5. The cluster block storage implementation method of claim 1, further comprising:
when the creation and deletion operation of the volume of the storage pool is issued, the written cluster management additional module takes over the operation, the operation is sent to the master node through the corosyn, the master node executes the operation, and the operation result is returned after the execution.
6. The cluster block storage implementation method of claim 1, further comprising:
the corosync provides a ring network redundancy protocol RRP mode, and a corosync cluster is formed through a redundant network.
7. The cluster block storage implementation method of claim 6, further comprising:
the corosyn provides a redundant message transmission mechanism, each corosyn cluster node receives the message and then transmits the message to all other nodes through broadcasting, and the message is sent to each cluster member through a ring network of the corosyn.
8. A cluster block storage implementation apparatus, comprising:
the system comprises a providing module, a storage module and a control module, wherein the providing module is used for providing block equipment to a virtual machine by a Logical Volume Management (LVM) so as to enable the virtual machine to create a file system required by the virtual machine;
a management module, configured to perform cluster management by using a corosyn cluster management system, so that a host master selected by a corosyn cluster executes resource operations on an LVM storage pool, where the management module is further configured to:
when the LVM storage pool providing the block device is created, selecting storage which can be accessed by all hosts in the cluster, and executing LVM creation operation on one host which can access the storage;
and when the LVM storage pool is mounted, managing a host mounted with the LVM storage pool through a cluster management additional module of a mounting node, wherein the cluster management additional module is a module for compiling management of all operations of a corosync cluster.
9. The apparatus as claimed in claim 8, wherein the management module is further configured to:
when Corosync selects master node, the selection is decided according to the IO delay of the current host computer to the physical hard disk.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710830214.5A CN107391236B (en) | 2017-09-15 | 2017-09-15 | Cluster block storage implementation method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710830214.5A CN107391236B (en) | 2017-09-15 | 2017-09-15 | Cluster block storage implementation method and device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN107391236A CN107391236A (en) | 2017-11-24 |
| CN107391236B true CN107391236B (en) | 2020-03-06 |
Family
ID=60351788
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710830214.5A Active CN107391236B (en) | 2017-09-15 | 2017-09-15 | Cluster block storage implementation method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107391236B (en) |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US9047018B1 (en) * | 2012-03-20 | 2015-06-02 | Emc Corporation | Method and system for zero-copy disk IO using sector unaligned buffers |
| CN105407087A (en) * | 2015-10-28 | 2016-03-16 | 杭州数梦工场科技有限公司 | Message sending method and device |
| CN106777394A (en) * | 2017-02-28 | 2017-05-31 | 郑州云海信息技术有限公司 | A kind of cluster file system |
| CN106919346A (en) * | 2017-02-21 | 2017-07-04 | 无锡华云数据技术服务有限公司 | A kind of shared Storage Virtualization implementation method based on CLVM |
-
2017
- 2017-09-15 CN CN201710830214.5A patent/CN107391236B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US9047018B1 (en) * | 2012-03-20 | 2015-06-02 | Emc Corporation | Method and system for zero-copy disk IO using sector unaligned buffers |
| CN105407087A (en) * | 2015-10-28 | 2016-03-16 | 杭州数梦工场科技有限公司 | Message sending method and device |
| CN106919346A (en) * | 2017-02-21 | 2017-07-04 | 无锡华云数据技术服务有限公司 | A kind of shared Storage Virtualization implementation method based on CLVM |
| CN106777394A (en) * | 2017-02-28 | 2017-05-31 | 郑州云海信息技术有限公司 | A kind of cluster file system |
Also Published As
| Publication number | Publication date |
|---|---|
| CN107391236A (en) | 2017-11-24 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11042311B2 (en) | Cluster system with calculation and storage converged | |
| US10545823B2 (en) | Accelerating erasure code replication in distributed systems | |
| US10209908B2 (en) | Optimization of in-memory data grid placement | |
| CN110663019B (en) | File system for Shingled Magnetic Recording (SMR) | |
| US10129357B2 (en) | Managing data storage in distributed virtual environment | |
| US11262916B2 (en) | Distributed storage system, data processing method, and storage node | |
| US20130198472A1 (en) | Performing volume expansion in storage management system | |
| US20150178117A1 (en) | Selecting cloud computing resource based on fault tolerance and network efficiency | |
| CN102316043B (en) | Port virtualization method, switch and communication system | |
| US11262918B1 (en) | Data storage system with uneven drive wear reduction | |
| WO2019062856A1 (en) | Data reconstruction method and apparatus, and data storage system | |
| JP2021524104A (en) | Master / Standby Container System Switching | |
| US10936217B2 (en) | Providing virtual volume flexibility on a storage device cluster | |
| CN112148219A (en) | Design method and device for ceph type distributed storage cluster | |
| CN105260377A (en) | Updating method and system based on hierarchical storage | |
| US8990815B1 (en) | Synchronizing allocated blocks of virtual disk files across primary and secondary volumes by excluding unused blocks | |
| EP3806389A1 (en) | Virtual subnet constructing method and device, and storage medium | |
| IL295006A (en) | Virtual machine perfect forward secrecy | |
| US8583852B1 (en) | Adaptive tap for full virtual machine protection | |
| CN107391236B (en) | Cluster block storage implementation method and device | |
| EP4318257A1 (en) | Method and apparatus for processing data, reduction server, and mapping server | |
| CN107515725B (en) | Method and device for sharing disk by core network virtualization system and network management MANO system | |
| CN110795210B (en) | Bare equipment management system and method | |
| US10809927B1 (en) | Online conversion of storage layout | |
| US10712959B2 (en) | Method, device and computer program product for storing data |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |