CN109614040B - Storage method, storage medium, electronic device and system with multiple storage pools - Google Patents
Storage method, storage medium, electronic device and system with multiple storage pools Download PDFInfo
- Publication number
- CN109614040B CN109614040B CN201811418268.1A CN201811418268A CN109614040B CN 109614040 B CN109614040 B CN 109614040B CN 201811418268 A CN201811418268 A CN 201811418268A CN 109614040 B CN109614040 B CN 109614040B
- Authority
- CN
- China
- Prior art keywords
- storage
- data
- sub
- pool
- storage pool
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
- G06F3/0638—Organizing or formatting or addressing of data
- G06F3/0644—Management of space entities, e.g. partitions, extents, pools
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
- G06F3/0629—Configuration or reconfiguration of storage systems
- G06F3/0631—Configuration or reconfiguration of storage systems by allocating resources to storage systems
Abstract
The invention discloses a storage method, a storage medium, electronic equipment and a system with multiple storage pools, which relate to the technical field of data storage, wherein the method comprises a storage preset process and a data storage process, and the storage pool preset process comprises the following steps: dividing a storage pool into at least 2 sub-storage pools; configuring a storage data type to the sub-storage pool; distributing storage drives corresponding to the storage data types to the sub storage pools according to the storage data types of the sub storage pools; the data storage process comprises the following steps: selecting a corresponding storage data type according to the data type of the target data to be stored; selecting a sub-storage pool corresponding to the storage data type according to the storage data type corresponding to the target data; storing the target data into the sub-storage pool. According to the invention, the storage pool is partitioned according to different data storage types, so that a more convenient data storage structure is provided for workers, and various working requirements of the workers in subsequent data extraction and storage work are met.
Description
Technical Field
The invention relates to the technical field of data storage, in particular to a storage method with multiple storage pools, a storage medium, electronic equipment and a system.
Background
In the current data storage field, particularly when a public cloud and a private cloud are built by using OpenStack, mirror image services interact with corresponding storage back ends according to drivers provided by different types of storage, so that the requirements of users on mirror image use are met;
however, under the existing conditions, for most types of storage backend, the mirror image service can only use one configured storage pool, but cannot use a plurality of storage pools for data storage at the same time, and cannot adapt to various data storage requirements;
therefore, a new storage method is urgently needed to solve the above problems.
Disclosure of Invention
Aiming at the defects in the prior art, the invention aims to provide a storage method, a storage medium, an electronic device and a system with multiple storage pools.
In order to achieve the above purposes, the technical scheme adopted by the invention is as follows:
in a first aspect, the present invention provides a storage method with multiple storage pools, which includes a storage presetting process and a data storage process, wherein the storage pool presetting process includes the following steps:
dividing the storage pool into at least 2 sub-storage pools which are independently operated for storage;
configuring a storage data type to the sub-storage pool;
according to the storage data type of the sub-storage pools, allocating storage drives corresponding to the storage data type to each sub-storage pool, wherein the storage drives are rbq, VMware or oVirt;
the data storage process comprises the steps of:
selecting a corresponding storage data type according to the data type of target data to be stored;
selecting the sub-storage pool corresponding to the storage data type according to the storage data type corresponding to the target data;
storing the target data into the sub-storage pool; wherein the content of the first and second substances,
the storage pool presetting process further comprises the steps of:
setting a data access interface, wherein the data access interface is used for accessing each sub-storage pool and reading the storage data type of each sub-storage pool;
the storage drive of the sub-storage pool exists in a server side of the storage pool, and is used for carrying out data communication and management on the sub-storage pool of the storage pool and also used for carrying out capacity expansion or upgrading on the sub-storage pool;
rbd is a block device driver provided in distributed storage Ceph and used for connecting with a Glance component, and a block storage pool provided in the distributed storage Ceph is connected with the Ceph;
the VMware is a drive for the VMware to interface with a Glance component, and the VMware is interfaced with a storage pool for storing mirror image data through the drive;
oVirt is the drive provided by oVirt to interface with the Glance component, by which Glance interfaces with the storage pool provided by oVirt.
On the basis of the technical scheme, the data storage process comprises the following steps:
acquiring each storage data type by using the data access interface;
selecting a corresponding storage data type according to the data type of target data to be stored;
selecting the sub-storage pool corresponding to the storage data type according to the storage data type corresponding to the target data;
storing the target data to the sub-storage pool using the data access interface.
On the basis of the above technical solution, the storing the target data in the sub-storage pool by using the data access interface specifically includes the following steps:
acquiring the size of the residual storage space of the sub-storage pool by using the data access interface;
when the size of the residual storage space is larger than that of the target data, storing the target data into the sub-storage pool by using the data access interface;
and stopping data storage work when the size of the residual storage space is smaller than that of the target data.
In a second aspect, the present invention further provides a storage medium having a computer program stored thereon, where the computer program is executed by a processor to implement the storage method with multiple storage pools of the first aspect.
In a third aspect, the present invention further provides an electronic device, which includes a memory and a processor, where the memory stores a computer program running on the processor, and the processor executes the computer program to implement the storage method with multiple storage pools of the first aspect.
In a fourth aspect, the present invention further provides a storage system with multiple storage pools, which includes a storage provisioning unit and a data storage unit, where the storage provisioning unit specifically includes:
a storage pool dividing subunit, configured to divide the storage pool into at least 2 sub-storage pools for performing storage operations individually;
an information configuration subunit, configured to configure a storage data type to the sub-storage pool;
a drive configuration subunit, configured to allocate, to each of the sub-storage pools, a storage drive corresponding to the storage data type according to the storage data type of the sub-storage pool, where the storage drive is rbq, VMware, or oVirt;
the data storage unit specifically includes:
the type matching subunit is used for selecting the corresponding storage data type according to the data type of the target data needing to be stored;
a sub-storage pool selection sub-unit, configured to select the sub-storage pool corresponding to the storage data type according to the storage data type corresponding to the target data;
a data storage subunit for storing the target data into the sub-storage pool; wherein the content of the first and second substances,
the storage preset unit further includes:
a data access interface for accessing each of the sub-storage pools and reading the storage data type of each of the sub-storage pools;
the storage drive of the sub-storage pool exists in a server side of the storage pool, and is used for carrying out data communication and management on the sub-storage pool of the storage pool and also used for carrying out capacity expansion or upgrading on the sub-storage pool;
rbd is a block device driver provided in distributed storage Ceph and used for connecting with a Glance component, and a block storage pool provided in the distributed storage Ceph is connected with the Ceph;
the VMware is a drive for the VMware to interface with a Glance component, and the VMware is interfaced with a storage pool for storing mirror image data through the drive;
oVirt is the drive provided by oVirt to interface with the Glance component, by which Glance interfaces with the storage pool provided by oVirt.
On the basis of the above technical solution, the type matching subunit is configured to acquire each storage data type by using the data access interface, and further select the storage data type corresponding to the data type of the target data to be stored according to the data type of the target data;
the data storage subunit is used for storing the target data to the sub-storage pool by utilizing the data access interface.
On the basis of the above technical solution, the data storage unit further includes:
a remaining storage space size obtaining subunit, configured to obtain a remaining storage space size of the sub-storage pool by using the data access interface;
the data storage subunit is configured to store the target data into the sub-storage pool by using the data access interface when the size of the remaining storage space is larger than the size of the target data, and stop data storage operation when the size of the remaining storage space is smaller than the size of the target data.
Compared with the prior art, the invention has the advantages that:
according to the invention, the storage pool is partitioned according to different data storage types, and each sub-storage pool corresponds to one storage data type, so that a more convenient data storage structure is provided for workers, and various working requirements of the workers in subsequent data extraction and storage work are met.
Drawings
Fig. 1 is a flowchart illustrating steps of a storage pool presetting process of a storage method with multiple storage pools according to a first embodiment and a second embodiment of the present invention;
FIG. 2 is a flowchart illustrating steps of a data storage process of a storage method with multiple storage pools according to a first embodiment of the present invention;
FIG. 3 is a flowchart illustrating steps of a storage pool presetting process when a storage method with multiple storage pools is based on a data access interface according to a first embodiment and a second embodiment of the present invention;
FIG. 4 is a flowchart illustrating steps of storing target data in a sub-storage pool by using a data access interface according to a first or second embodiment of the present invention;
fig. 5 is a block diagram illustrating a storage default unit of a storage system having multiple storage pools according to a third embodiment of the present invention;
FIG. 6 is a block diagram illustrating a data storage unit of a storage system having multiple storage pools according to a third embodiment of the present invention;
in the figure: 1. a storage preset unit; 10. a storage pool partitioning subunit; 11. an information configuration subunit; 12. a drive configuration subunit; 13. a data access interface; 2. a data storage unit; 20. a type matching subunit; 21. selecting a child unit from the child storage pool; 22. a data storage subunit; 23. and acquiring the size of the residual storage space.
Detailed Description
Embodiments of the present invention will be described in further detail below with reference to the accompanying drawings.
The embodiment of the invention provides a storage method, a storage medium, electronic equipment and a system with multiple storage pools.
In order to achieve the technical effects, the general idea of the application is as follows:
a storage method having a plurality of storage pools, comprising a storage provisioning process and a data storage process, the storage pool provisioning process comprising the steps of:
a1, dividing the storage pool into at least 2 sub-storage pools;
a2, configuring the storage data type to the sub-storage pool;
a3, distributing storage drives corresponding to the storage data types to the sub storage pools according to the storage data types of the sub storage pools;
the data storage process comprises the following steps:
b1, selecting a corresponding storage data type according to the data type of the target data to be stored;
b2, selecting a sub storage pool corresponding to the storage data type according to the storage data type corresponding to the target data;
and B3, storing the target data into the sub-storage pool.
According to the embodiment of the invention, the storage pool is partitioned according to different data storage types, and each sub-storage pool corresponds to one storage data type, so that a more convenient data storage structure is provided for workers, and various working requirements of the workers in subsequent data extraction and storage work are met.
Example one
Referring to fig. 1 to 4, an embodiment of the present invention provides a storage method having multiple storage pools, which includes a storage presetting process and a data storage process, wherein the storage pool presetting process includes the following steps:
a1, dividing the storage pool into at least 2 sub-storage pools;
a2, configuring the storage data type to the sub-storage pool;
a3, distributing storage drives corresponding to the storage data types to the sub storage pools according to the storage data types of the sub storage pools;
the data storage process comprises the following steps:
b1, selecting a corresponding storage data type according to the data type of the target data to be stored;
b2, selecting a sub storage pool corresponding to the storage data type according to the storage data type corresponding to the target data;
and B3, storing the target data into the sub-storage pool.
In the embodiment of the present invention, in step a1, a storage pool is divided, so as to partition storage areas that are required to meet different storage requirements, and each sub-storage pool is respectively used for a respective storage task, thereby avoiding mutual confusion of respective stored data;
then, in step a2, configuring a storage data type to the sub-storage pool, where the storage data type is a data type of data stored in the sub-storage pool, and each sub-storage pool is used to store data that is consistent with the corresponding storage data type;
in the last step of the storage presetting process, that is, step a3, since each sub-storage pool stores different types of data, it is necessary to allocate a storage drive corresponding to the type of the storage data to each sub-storage pool according to the type of the storage data in the sub-storage pool, so that each sub-storage pool can complete its data storage operation;
in the data storage process, firstly step B1, the sub-storage pool corresponding to the target data needs to be selected, so that the storage data type corresponding to the target data needs to be selected according to the data type of the target data, then step B2 is carried out, the sub-storage pool corresponding to the storage data type is selected according to the storage data type corresponding to the target data, and finally step B3, the target data is stored in the sub-storage pool, thereby completing the data storage step.
According to the embodiment of the invention, the storage pool is partitioned according to different data storage types, and each sub-storage pool corresponds to one storage data type, so that a more convenient data storage structure is provided for workers, and various working requirements of the workers in subsequent data extraction and storage work are met.
It should be noted that the storage driver of each sub-storage pool exists at the server side of the storage pool, and is used for performing data communication and management on each sub-storage pool of the storage pool, and facilitating capacity expansion or upgrade processing on the sub-storage pool at a later stage.
In the embodiment of the present invention, the storage pool presetting process further includes the following steps:
setting a data access interface, wherein the data access interface is used for accessing each sub-storage pool and reading the storage data type of each sub-storage pool;
the data access interface is used for carrying out data communication with each sub-storage pool in the storage pool and reading the storage data type of each sub-storage pool, on one hand, working personnel can know the storage data type corresponding to each sub-storage pool conveniently, so that the working personnel can know which type of data is stored in each sub-storage pool, and on the other hand, the data access interface can carry out read-write operation on the data in each sub-storage pool.
In the embodiment of the invention, the data storage process comprises the following steps:
c1, acquiring each storage data type by using the data access interface;
c2, selecting a corresponding storage data type according to the data type of the target data to be stored;
c3, selecting a sub-storage pool corresponding to the storage data type according to the storage data type corresponding to the target data;
c4, storing the target data to the sub-storage pool by using the data access interface;
in the data storage process, the data access interface is mainly used for completing the acquisition of the storage data type, so that the sub-storage pool corresponding to the data type of the target data is searched according to the data type of the target data, and the selected work of the sub-storage pool is completed.
In the embodiment of the present invention, storing target data in a sub-storage pool by using a data access interface specifically includes the following steps:
d1, acquiring the size of the residual storage space of the sub-storage pool by using the data access interface;
d2, when the size of the residual storage space is larger than the size of the target data, storing the target data into the sub-storage pool by using the data access interface;
d3, stopping the data storage work when the size of the residual storage space is smaller than that of the target data;
namely, in the data storage process, the data access interface is mainly utilized to complete the storage work of the target data.
It should be noted that the target data is specifically stored in a storage space of the server in the storage pool, and this storage space refers to a storage medium available to the server, such as a hard disk, an external storage, a shared storage, and so on.
Example two
Referring to fig. 1 to 4, an embodiment of the present invention provides a storage method with multiple storage pools, which specifically includes a storage presetting process and a data storage process, where the storage pool presetting process includes the following steps:
a1, dividing the storage pool into at least 2 sub-storage pools;
a2, configuring the storage data type to the sub-storage pool;
a3, distributing storage drives corresponding to the storage data types to the sub storage pools according to the storage data types of the sub storage pools;
the data storage process comprises the following steps:
b1, selecting a corresponding storage data type according to the data type of the target data to be stored;
b2, selecting a sub storage pool corresponding to the storage data type according to the storage data type corresponding to the target data;
and B3, storing the target data into the sub-storage pool.
In the embodiment of the present invention, in step a1, a storage pool is divided, so as to partition storage areas that are required to meet different storage requirements, and each sub-storage pool is respectively used for a respective storage task, thereby avoiding mutual confusion of respective stored data;
then, in step a2, configuring a storage data type to the sub-storage pool, where the storage data type is a data type of data stored in the sub-storage pool, and each sub-storage pool is used to store data that is consistent with the corresponding storage data type;
in the last step of the storage presetting process, that is, step a3, since each sub-storage pool stores different types of data, it is necessary to allocate a storage drive corresponding to the type of the storage data to each sub-storage pool according to the type of the storage data in the sub-storage pool, so that each sub-storage pool can complete its data storage operation;
in the data storage process, firstly step B1, the sub-storage pool corresponding to the target data needs to be selected, so that the storage data type corresponding to the target data needs to be selected according to the data type of the target data, then step B2 is carried out, the sub-storage pool corresponding to the storage data type is selected according to the storage data type corresponding to the target data, and finally step B3, the target data is stored in the sub-storage pool, thereby completing the data storage step.
According to the embodiment of the invention, the storage pool is partitioned according to different data storage types, and each sub-storage pool corresponds to one storage data type, so that a more convenient data storage structure is provided for workers, and various working requirements of the workers in subsequent data extraction and storage work are met.
The embodiment of the invention can be applied to the field of multi-storage back ends of OpenStack mirror image services, and the specific operation is as follows:
firstly, configuring a storage pool according to storage requirements, setting the storage pool as a plurality of sub-storage pools capable of performing storage operation independently, and allocating storage drives to the storage pools, wherein the storage drives can be rbq, VMware and oVirt;
wherein, rbd is a block device driver for interfacing with a Glance component provided in the distributed storage Ceph and can interface with a block storage pool provided by the Ceph storage;
the VMware is a drive provided by the VMware and used for docking a Glance component, and a storage pool used for storing mirror image data can be docked through the drive;
the oVirt is a drive provided by the oVirt and used for connecting with a Glance component, and the Glance can connect with a storage pool provided by the oVirt through the drive;
during specific operation, a user initiates an image uploading request to an image service in OpenStack through an interface or a command line, a brightness-api module in the image service receives and processes the request, and then selects corresponding drive according to the type of data to be stored, and stores the image data into a sub-storage pool of a specified type;
here, it should be noted that the storage driver of each sub-storage pool exists at the server side of the storage pool, and is used for performing data communication and management on each sub-storage pool of the storage pool, and further facilitating capacity expansion or upgrade processing on the sub-storage pool at a later stage.
It should be noted that OpenStack is a free software and open source code project authorized by Apache license, OpenStack is an open source cloud computing management platform project, and several main components are combined to complete specific work;
OpenStack supports almost all types of cloud environments, and the project aims to provide a cloud computing management platform which is simple to implement, can be expanded in a large scale, is rich and has a unified standard. OpenStack provides a solution for infrastructure as a service (IaaS) through various complementary services, each providing an API for integration.
In the embodiment of the present invention, the storage pool presetting process further includes the following steps:
setting a data access interface, wherein the data access interface is used for accessing each sub-storage pool and reading the storage data type of each sub-storage pool;
the data access interface is used for carrying out data communication with each sub-storage pool in the storage pool and reading the storage data type of each sub-storage pool, on one hand, working personnel can know the storage data type corresponding to each sub-storage pool conveniently, so that the working personnel can know which type of data is stored in each sub-storage pool, and on the other hand, the data access interface can carry out read-write operation on the data in each sub-storage pool.
In the embodiment of the invention, the data storage process comprises the following steps:
c1, acquiring each storage data type by using the data access interface;
c2, selecting a corresponding storage data type according to the data type of the target data to be stored;
c3, selecting a sub-storage pool corresponding to the storage data type according to the storage data type corresponding to the target data;
c4, storing the target data to the sub-storage pool by using the data access interface;
in the data storage process, the data access interface is mainly used for completing the acquisition of the storage data type, so that the sub-storage pool corresponding to the data type of the target data is searched according to the data type of the target data, and the selected work of the sub-storage pool is completed.
In the embodiment of the present invention, storing target data in a sub-storage pool by using a data access interface specifically includes the following steps:
d1, acquiring the size of the residual storage space of the sub-storage pool by using the data access interface;
d2, when the size of the residual storage space is larger than the size of the target data, storing the target data into the sub-storage pool by using the data access interface;
d3, stopping the data storage work when the size of the residual storage space is smaller than that of the target data;
namely, in the data storage process, the data access interface is mainly utilized to complete the storage work of the target data.
Based on the same inventive concept, the application provides an embodiment of a storage system with multiple storage pools corresponding to the embodiment, and the detailed description is given in the third embodiment
EXAMPLE III
As shown in fig. 5 and 6, a third embodiment of the present invention provides a storage system with multiple storage pools, which includes a storage provisioning unit 1 and a data storage unit 2, where the storage provisioning unit 1 specifically includes:
a storage pool partitioning subunit 10 for partitioning a storage pool into at least 2 sub-storage pools;
an information configuration subunit 11, configured to configure the storage data type to the sub-storage pool;
a drive configuration subunit 12, configured to allocate a storage drive corresponding to the storage data type to each sub-storage pool according to the storage data type of the sub-storage pool;
the data storage unit 2 specifically includes:
a type matching subunit 20, configured to select, according to a data type of target data to be stored, a storage data type corresponding to the target data;
a sub-storage pool selecting subunit 21 configured to select a sub-storage pool corresponding to the storage data type according to the storage data type corresponding to the target data;
a data storage subunit 22 for storing the target data into the sub-storage pool.
On the basis of the above technical solution, the storing preset unit 1 specifically further includes:
and a data access interface 13 for accessing each sub-storage pool and reading the storage data type of each sub-storage pool.
On the basis of the above technical solution, the type matching subunit 20 is configured to acquire each storage data type by using the data access interface 13, and further select a storage data type corresponding to the data type of the target data to be stored according to the data type of the target data;
a data storage subunit 22 for storing the target data to the sub-storage pool using the data access interface 13.
On the basis of the above technical solution, the data storage unit 2 further includes:
a remaining memory size obtaining subunit 23, configured to obtain a remaining memory size of the sub-memory pool by using the data access interface 13.
And a data storage subunit 22, configured to store the target data into the sub-storage pool by using the data access interface 13 when the size of the remaining storage space is larger than the size of the target data, and stop the data storage operation when the size of the remaining storage space is smaller than the size of the target data.
Based on the same inventive concept, the application provides an embodiment of a storage medium corresponding to the embodiment, which is detailed in the fourth embodiment
Example four
A fourth embodiment of the invention provides a computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, carries out all or part of the method steps of the first embodiment.
The present invention can implement all or part of the flow in the first embodiment, and can also be implemented by using a computer program to instruct related hardware, where the computer program can be stored in a computer-readable storage medium, and when the computer program is executed by a processor, the steps of the above-mentioned method embodiments can be implemented. Wherein the computer program comprises computer program code, which may be in the form of source code, object code, an executable file or some intermediate form, etc. The computer readable medium may include: any entity or device capable of carrying computer program code, recording medium, U.S. disk, removable hard disk, magnetic disk, optical disk, computer Memory, Read-Only Memory (ROM), Random Access Memory (RAM), electrical carrier wave signals, telecommunications signals, software distribution media, and the like. It should be noted that the computer readable medium may contain other components which may be suitably increased or decreased as required by legislation and patent practice in jurisdictions, for example, in some jurisdictions, in accordance with legislation and patent practice, the computer readable medium does not include electrical carrier signals and telecommunications signals.
Based on the same inventive concept, the present application provides an embodiment of an electronic device corresponding to the first embodiment, which is detailed in the fourth embodiment
EXAMPLE five
The fifth embodiment of the present invention further provides an electronic device, which includes a memory and a processor, wherein the memory stores a computer program running on the processor, and the processor executes the computer program to implement all or part of the method steps in the first embodiment.
The Processor may be a Central Processing Unit (CPU), other general purpose Processor, a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), an off-the-shelf Programmable Gate Array (FPGA) or other Programmable logic device, discrete Gate or transistor logic, discrete hardware components, etc. The general purpose processor may be a microprocessor or the processor may be any conventional processor or the like, the processor being the control center of the computer device and the various interfaces and lines connecting the various parts of the overall computer device.
The memory may be used to store computer programs and/or modules, and the processor may implement various functions of the computer device by executing or executing the computer programs and/or modules stored in the memory, as well as by invoking data stored in the memory. The memory may mainly include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application program required by at least one function (such as a sound playing function, an image playing function, etc.), and the like; the storage data area may store data (such as audio data, video data, etc.) created according to the use of the cellular phone, etc. In addition, the memory may include high speed random access memory, and may also include non-volatile memory, such as a hard disk, a memory, a plug-in hard disk, a Smart Media Card (SMC), a Secure Digital (SD) Card, a Flash memory Card (Flash Card), at least one magnetic disk storage device, a Flash memory device, or other volatile solid state storage device.
As will be appreciated by one skilled in the art, embodiments of the present invention may be provided as a method, system, server, or computer program product. Accordingly, the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present invention may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, optical storage, and the like) having computer-usable program code embodied therein.
The present invention has been described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), servers and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
It will be apparent to those skilled in the art that various changes and modifications may be made in the present invention without departing from the spirit and scope of the invention. Thus, if such modifications and variations of the present invention fall within the scope of the claims of the present invention and their equivalents, the present invention is also intended to include such modifications and variations.
Claims (8)
1. A storage method having multiple storage pools, comprising a storage provisioning process and a data storage process, wherein the storage pool provisioning process comprises the steps of:
dividing the storage pool into at least 2 sub-storage pools which are independently operated for storage;
configuring a storage data type to the sub-storage pool;
according to the storage data type of the sub-storage pools, allocating storage drives corresponding to the storage data type to each sub-storage pool, wherein the storage drives are rbq, VMware or oVirt;
the data storage process comprises the steps of:
selecting a corresponding storage data type according to the data type of target data to be stored;
selecting the sub-storage pool corresponding to the storage data type according to the storage data type corresponding to the target data;
storing the target data into the sub-storage pool; wherein the content of the first and second substances,
the storage pool presetting process further comprises the steps of:
setting a data access interface, wherein the data access interface is used for accessing each sub-storage pool and reading the storage data type of each sub-storage pool;
the storage drive of the sub-storage pool exists in a server side of the storage pool, and is used for carrying out data communication and management on the sub-storage pool of the storage pool and also used for carrying out capacity expansion or upgrading on the sub-storage pool;
rbd is a block device driver provided in distributed storage Ceph and used for connecting with a Glance component, and a block storage pool provided in the distributed storage Ceph is connected with the Ceph;
the VMware is a drive for the VMware to interface with a Glance component, and the VMware is interfaced with a storage pool for storing mirror image data through the drive;
oVirt is the drive provided by oVirt to interface with the Glance component, by which Glance interfaces with the storage pool provided by oVirt.
2. The method of claim 1, wherein the data storage process comprises the steps of:
acquiring each storage data type by using the data access interface;
selecting a corresponding storage data type according to the data type of target data to be stored;
selecting the sub-storage pool corresponding to the storage data type according to the storage data type corresponding to the target data;
storing the target data to the sub-storage pool using the data access interface.
3. The method of claim 2, wherein said storing said target data to said sub-storage pool using said data access interface, comprises the steps of:
acquiring the size of the residual storage space of the sub-storage pool by using the data access interface;
when the size of the residual storage space is larger than that of the target data, storing the target data into the sub-storage pool by using the data access interface;
and stopping data storage work when the size of the residual storage space is smaller than that of the target data.
4. A storage medium having a computer program stored thereon, characterized in that: the computer program, when executed by a processor, implements the method of any of claims 1 to 3.
5. An electronic device comprising a memory and a processor, the memory having stored thereon a computer program that runs on the processor, characterized in that: the processor, when executing the computer program, implements the method of any of claims 1 to 3.
6. A storage system with multiple storage pools is characterized by comprising a storage presetting unit and a data storage unit, wherein the storage presetting unit specifically comprises:
a storage pool dividing subunit, configured to divide the storage pool into at least 2 sub-storage pools for performing storage operations individually;
an information configuration subunit, configured to configure a storage data type to the sub-storage pool;
a drive configuration subunit, configured to allocate, to each of the sub-storage pools, a storage drive corresponding to the storage data type according to the storage data type of the sub-storage pool, where the storage drive is rbq, VMware, or oVirt;
the data storage unit specifically includes:
the type matching subunit is used for selecting the corresponding storage data type according to the data type of the target data needing to be stored;
a sub-storage pool selection sub-unit, configured to select the sub-storage pool corresponding to the storage data type according to the storage data type corresponding to the target data;
a data storage subunit for storing the target data into the sub-storage pool; wherein the content of the first and second substances,
the storage preset unit further includes:
a data access interface for accessing each of the sub-storage pools and reading the storage data type of each of the sub-storage pools;
the storage drive of the sub-storage pool exists in a server side of the storage pool, and is used for carrying out data communication and management on the sub-storage pool of the storage pool and also used for carrying out capacity expansion or upgrading on the sub-storage pool;
rbd is a block device driver provided in distributed storage Ceph and used for connecting with a Glance component, and a block storage pool provided in the distributed storage Ceph is connected with the Ceph;
the VMware is a drive for the VMware to interface with a Glance component, and the VMware is interfaced with a storage pool for storing mirror image data through the drive;
oVirt is the drive provided by oVirt to interface with the Glance component, by which Glance interfaces with the storage pool provided by oVirt.
7. The system of claim 6, wherein:
the type matching subunit is configured to acquire each storage data type by using the data access interface, and further select the storage data type corresponding to the data type according to the data type of the target data to be stored;
the data storage subunit is used for storing the target data to the sub-storage pool by utilizing the data access interface.
8. The system of claim 7, wherein the data storage unit further comprises:
a remaining storage space size obtaining subunit, configured to obtain a remaining storage space size of the sub-storage pool by using the data access interface;
the data storage subunit is configured to store the target data into the sub-storage pool by using the data access interface when the size of the remaining storage space is larger than the size of the target data, and stop data storage operation when the size of the remaining storage space is smaller than the size of the target data.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811418268.1A CN109614040B (en) | 2018-11-26 | 2018-11-26 | Storage method, storage medium, electronic device and system with multiple storage pools |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811418268.1A CN109614040B (en) | 2018-11-26 | 2018-11-26 | Storage method, storage medium, electronic device and system with multiple storage pools |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN109614040A CN109614040A (en) | 2019-04-12 |
| CN109614040B true CN109614040B (en) | 2022-04-29 |
Family
ID=66003601
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201811418268.1A Active CN109614040B (en) | 2018-11-26 | 2018-11-26 | Storage method, storage medium, electronic device and system with multiple storage pools |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109614040B (en) |
Families Citing this family (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110471862A (en) * | 2019-07-16 | 2019-11-19 | 杭州电子科技大学 | A kind of the address of variable distribution system and method for programmable controller |
| CN111444152A (en) * | 2020-03-30 | 2020-07-24 | 北京小米移动软件有限公司 | File system, file system access method, electronic device, and storage medium |
| CN111427666B (en) * | 2020-04-01 | 2022-04-12 | 浪潮云信息技术股份公司 | Method and system for quickly importing virtual machine image in OpenStack environment |
| CN113741790A (en) * | 2020-05-29 | 2021-12-03 | 杭州海康威视数字技术股份有限公司 | Multi-video-recording-plan storage method and device for video data and storage medium |
| CN111831232A (en) * | 2020-07-22 | 2020-10-27 | 浙江大华技术股份有限公司 | Data storage method and device, storage medium and electronic device |
| CN113660180B (en) * | 2021-07-30 | 2023-11-28 | 鹏城实验室 | Data storage method, device, terminal and storage medium |
| CN113721855A (en) * | 2021-09-01 | 2021-11-30 | 中国建设银行股份有限公司 | Storage method and device of storage resources, electronic equipment and computer storage medium |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102301355A (en) * | 2008-12-31 | 2011-12-28 | 英特尔公司 | Providing Differentiated I/o Services Within A Hardware Storage Controller |
| US8473678B1 (en) * | 2010-06-29 | 2013-06-25 | Emc Corporation | Managing multi-tiered storage pool provisioning |
| US8732354B1 (en) * | 2005-09-30 | 2014-05-20 | Symantec Operating Corporation | Method and apparatus for controlling access to a storage area network |
| CN104881259A (en) * | 2015-06-29 | 2015-09-02 | 联想(北京)有限公司 | Data processing method and device and storage device |
| CN104991736A (en) * | 2015-06-15 | 2015-10-21 | 联想(北京)有限公司 | Method and device for typing in data and storage equipment |
| CN106354431A (en) * | 2016-08-26 | 2017-01-25 | 浪潮(北京)电子信息产业有限公司 | Data storage method and device |
| CN107908372A (en) * | 2017-12-14 | 2018-04-13 | 南京云创大数据科技股份有限公司 | A kind of more fusion storage methods of strange land isomery |
Family Cites Families (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP4806556B2 (en) * | 2005-10-04 | 2011-11-02 | 株式会社日立製作所 | Storage system and configuration change method |
| US8037279B2 (en) * | 2008-06-12 | 2011-10-11 | Oracle America, Inc. | Method and system for cross-domain data sharing |
| US8370835B2 (en) * | 2009-03-12 | 2013-02-05 | Arend Erich Dittmer | Method for dynamically generating a configuration for a virtual machine with a virtual hard disk in an external storage device |
| JP2015532985A (en) * | 2012-09-06 | 2015-11-16 | ピーアイ−コーラル、インク． | Large-scale data storage and delivery system |
| US9733849B2 (en) * | 2014-11-21 | 2017-08-15 | Security First Corp. | Gateway for cloud-based secure storage |
| CN106708430A (en) * | 2016-11-30 | 2017-05-24 | 浪潮软件集团有限公司 | Cloud hard disk implementation method under cloud computing architecture |
-
2018
- 2018-11-26 CN CN201811418268.1A patent/CN109614040B/en active Active
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8732354B1 (en) * | 2005-09-30 | 2014-05-20 | Symantec Operating Corporation | Method and apparatus for controlling access to a storage area network |
| CN102301355A (en) * | 2008-12-31 | 2011-12-28 | 英特尔公司 | Providing Differentiated I/o Services Within A Hardware Storage Controller |
| US8473678B1 (en) * | 2010-06-29 | 2013-06-25 | Emc Corporation | Managing multi-tiered storage pool provisioning |
| CN104991736A (en) * | 2015-06-15 | 2015-10-21 | 联想(北京)有限公司 | Method and device for typing in data and storage equipment |
| CN104881259A (en) * | 2015-06-29 | 2015-09-02 | 联想(北京)有限公司 | Data processing method and device and storage device |
| CN106354431A (en) * | 2016-08-26 | 2017-01-25 | 浪潮(北京)电子信息产业有限公司 | Data storage method and device |
| CN107908372A (en) * | 2017-12-14 | 2018-04-13 | 南京云创大数据科技股份有限公司 | A kind of more fusion storage methods of strange land isomery |
Also Published As
| Publication number | Publication date |
|---|---|
| CN109614040A (en) | 2019-04-12 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109614040B (en) | Storage method, storage medium, electronic device and system with multiple storage pools | |
| US20230153144A1 (en) | Platform independent gpu profiles for more efficient utilization of gpu resources | |
| US9588797B2 (en) | Returning terminated virtual machines to a pool of available virtual machines to be reused thereby optimizing cloud resource usage and workload deployment time | |
| US20200356806A1 (en) | Container image management | |
| CN101650660B (en) | Booting a computer system from central storage | |
| US20160283273A1 (en) | Dynamic workload deployment for data integration services | |
| CN107733985A (en) | A kind of cloud computing system functional unit dispositions method and device | |
| CN104104705B (en) | The cut-in method and equipment of distributed memory system | |
| EP3637252A1 (en) | Virtual machine deployment method and omm virtual machine | |
| CN104834627B (en) | Semiconductor equipment, processor system and its control method | |
| CN107742066A (en) | Account authority configuring method, device, terminal device and computer-readable storage medium | |
| CN112667228A (en) | Application program construction method and device and computer equipment | |
| CN112783640A (en) | Method and apparatus for pre-allocating memory, circuit, electronic device and medium | |
| US11526473B2 (en) | Database upgrade in a distributed database cluster | |
| CN114443058A (en) | Method for creating private mirror image in public cloud and related equipment | |
| CN111104178A (en) | Dynamic library loading method, terminal device and storage medium | |
| CN109165723B (en) | Method and apparatus for processing data | |
| WO2016078326A1 (en) | Method, apparatus and system for displaying names of virtual machine | |
| CN109688180A (en) | A kind of cloud service method for upgrading software and device based on mirror image | |
| CN108920249B (en) | Speed limiting method based on multi-host multi-virtual machine system | |
| CN115576627A (en) | Middleware configuration management method, device, equipment, storage medium and operating machine | |
| US20170090820A1 (en) | Method and device for operating a many-core system | |
| CN112073505B (en) | Method for unloading on cloud server, control device and storage medium | |
| CN108984426B (en) | Method and apparatus for processing data | |
| CN114115864A (en) | Interface generation method and device and electronic equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |