CN116594563A - Distributed storage capacity expansion method and device, electronic equipment and storage medium - Google Patents
Distributed storage capacity expansion method and device, electronic equipment and storage medium Download PDFInfo
- Publication number
- CN116594563A CN116594563A CN202310572577.9A CN202310572577A CN116594563A CN 116594563 A CN116594563 A CN 116594563A CN 202310572577 A CN202310572577 A CN 202310572577A CN 116594563 A CN116594563 A CN 116594563A
- Authority
- CN
- China
- Prior art keywords
- storage
- storage unit
- information
- distributed
- capacity expansion
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 48
- 238000004590 computer program Methods 0.000 claims description 18
- 230000006835 compression Effects 0.000 claims description 11
- 238000007906 compression Methods 0.000 claims description 11
- 239000004973 liquid crystal related substance Substances 0.000 claims description 9
- 238000001514 detection method Methods 0.000 claims description 5
- 238000013507 mapping Methods 0.000 claims description 3
- 238000004891 communication Methods 0.000 description 8
- 230000003287 optical effect Effects 0.000 description 6
- 238000012545 processing Methods 0.000 description 6
- 238000010586 diagram Methods 0.000 description 5
- 230000008569 process Effects 0.000 description 5
- 238000013500 data storage Methods 0.000 description 2
- 230000006870 function Effects 0.000 description 2
- 230000003993 interaction Effects 0.000 description 2
- 238000007726 management method Methods 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000012544 monitoring process Methods 0.000 description 2
- 239000013307 optical fiber Substances 0.000 description 2
- 230000000644 propagated effect Effects 0.000 description 2
- 239000004065 semiconductor Substances 0.000 description 2
- 238000003491 array Methods 0.000 description 1
- 238000013473 artificial intelligence Methods 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000001413 cellular effect Effects 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 239000000835 fiber Substances 0.000 description 1
- 239000011521 glass Substances 0.000 description 1
- 238000010801 machine learning Methods 0.000 description 1
- 230000001953 sensory effect Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
- G06F3/0638—Organizing or formatting or addressing of data
- G06F3/0644—Management of space entities, e.g. partitions, extents, pools
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
- G06F3/0608—Saving storage space on storage systems
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
- G06F3/0629—Configuration or reconfiguration of storage systems
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0668—Interfaces specially adapted for storage systems adopting a particular infrastructure
- G06F3/067—Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D10/00—Energy efficient computing, e.g. low power processors, power management or thermal management
Abstract
The invention discloses a distributed storage capacity expansion method, a distributed storage capacity expansion device, electronic equipment and a storage medium. The method is characterized by comprising the following steps: under the condition that storage load information of a distributed storage unit in a storage pool is detected to reach a preset capacity expansion load, the distributed storage unit is determined to be a first storage unit to be expanded; acquiring target storage information of a plurality of distributed storage units in the storage pool, and determining the distributed storage units, in which the target storage information in the storage pool meets a preset capacity expansion condition, as second storage units; and carrying out storage expansion on the first storage unit according to the second storage unit. The storage space expansion of the distributed storage unit is realized, and the problem that storage cannot be performed when the storage load of the storage unit is high is prevented, so that the use experience of a user is influenced.
Description
Technical Field
The present invention relates to the field of distributed storage, and in particular, to a distributed storage capacity expansion method, apparatus, electronic device, and storage medium.
Background
At present, consistent hash algorithm is generally adopted in distributed storage to distribute and position multi-copy data, but consistent hash cannot ensure that the data can be completely and uniformly distributed, so that the storage space load rate of a distributed storage unit is 100% in a storage pool of the distributed storage, the situation that individual distributed storage units are fully loaded occurs, and the storage space load rates of other distributed storage units are lower, and a lot of storage space can be utilized. Because the distributed storage pool can reach full load because of the storage space load rate of a certain distributed storage unit, it is considered that all the distributed storage units of the distributed storage pool are in a full load state, so that the distributed storage pool cannot continuously read and write new data, and interruption of customer service is caused. The prior art generally expands the storage space of the distributed storage pool, so that the storage space of the distributed storage pool is improved, the storage space utilization rate of the distributed storage pool is further reduced, and the operation cost of the distributed storage pool is increased.
Disclosure of Invention
The invention provides a distributed storage capacity expansion method, a device, electronic equipment and a storage medium, which are used for improving the utilization rate of storage space of a distributed storage pool.
According to an aspect of the present invention, there is provided a distributed storage capacity expansion method, including:
under the condition that storage load information of a distributed storage unit in a storage pool is detected to reach a preset capacity expansion load, the distributed storage unit is determined to be a first storage unit to be expanded;
acquiring target storage information of a plurality of distributed storage units in the storage pool, and determining the distributed storage units, in which the target storage information in the storage pool meets a preset capacity expansion condition, as second storage units;
and carrying out storage expansion on the first storage unit according to the second storage unit.
According to another aspect of the present invention, there is provided a distributed storage capacity expansion apparatus, including:
the storage unit load detection module is used for determining the distributed storage unit as a first storage unit to be expanded under the condition that storage load information of the distributed storage unit in the storage pool reaches a preset expansion load;
the second storage unit selection module is used for acquiring target storage information of a plurality of distributed storage units in the storage pool and determining the distributed storage units, in which the target storage information in the storage pool meets a preset capacity expansion condition, as second storage units;
and the storage capacity expansion module is used for carrying out storage capacity expansion on the first storage unit according to the second storage unit.
According to another aspect of the present invention, there is provided an electronic apparatus including:
at least one processor; and
a memory communicatively coupled to the at least one processor; wherein, the liquid crystal display device comprises a liquid crystal display device,
the memory stores a computer program executable by the at least one processor to enable the at least one processor to perform the distributed storage capacity expansion method of any of the embodiments of the present invention.
According to another aspect of the present invention, there is provided a computer readable storage medium storing computer instructions for causing a processor to implement a distributed storage capacity expansion method according to any of the embodiments of the present invention when executed.
According to the technical scheme, under the condition that the storage load information of the distributed storage units in the storage pool is detected to reach the preset capacity expansion load, the distributed storage units are determined to be the first storage units to be expanded, when the load of the distributed storage units is too high, the influence on the storage service of the storage pool is prevented, the capacity of the high-load distributed storage units is expanded, and the storage experience of a user is improved; acquiring target storage information of a plurality of distributed storage units in the storage pool, determining the distributed storage units, which meet the preset capacity expansion conditions, in the storage pool as second storage units, and selecting the distributed storage units, which meet the preset capacity expansion conditions, for capacity expansion, so that the storage space utilization rate in the distributed storage pool is improved; according to the second storage unit, the first storage unit is subjected to storage expansion, the distributed storage units in the distributed storage pool are selected for expansion, the storage cost of expansion is reduced on the basis of meeting the expansion demand, the technical problems of low storage space utilization rate and high expansion cost in the distributed storage in the prior art are solved, and the phenomenon that a user cannot interrupt in the process of using the distributed storage is guaranteed.
It should be understood that the description in this section is not intended to identify key or critical features of the embodiments of the invention or to delineate the scope of the invention. Other features of the present invention will become apparent from the description that follows.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings required for the description of the embodiments will be briefly described below, and it is apparent that the drawings in the following description are only some embodiments of the present invention, and other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.
Fig. 1 is a flowchart of a distributed storage capacity expansion method according to a first embodiment of the present invention;
FIG. 2 is a flow chart of another distributed storage capacity expansion method according to a second embodiment of the present invention;
fig. 3 is a schematic structural diagram of a distributed storage capacity expansion device according to a third embodiment of the present invention;
fig. 4 is a schematic structural diagram of an electronic device implementing a distributed storage capacity expansion method according to an embodiment of the present invention.
Detailed Description
In order that those skilled in the art will better understand the present invention, a technical solution in the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in which it is apparent that the described embodiments are only some embodiments of the present invention, not all embodiments. All other embodiments, which can be made by those skilled in the art based on the embodiments of the present invention without making any inventive effort, shall fall within the scope of the present invention.
Example 1
Fig. 1 is a flowchart of a distributed storage capacity expansion method according to an embodiment of the present invention, where the method may be performed by a distributed storage capacity expansion device, and the distributed storage capacity expansion device may be implemented in a form of hardware and/or software, and the distributed storage capacity expansion device may be configured in an electronic device. As shown in fig. 1, the method includes:
s110, under the condition that storage load information of the distributed storage units in the storage pool reaches a preset capacity expansion load, determining the distributed storage units as first storage units to be expanded.
The storage pool can be a management unit in distributed storage, and the storage pool comprises a plurality of distributed storage units.
Wherein, the distributed storage unit can be a basic unit for storing data in the distributed storage; multiple distributed storage units are interconnected to form a storage pool.
The storage load information may be a usage rate of a storage space of the distributed storage unit.
The preset capacity expansion load may be preset to determine whether the storage load information of the distributed storage unit meets the storage capacity expansion condition. The pre-expansion load may be, for example, 90% of the storage load information of the distributed storage unit, so as to obtain the storage load information of the distributed storage unit, determine whether the storage load information of the distributed storage unit is greater than 90%, and if the storage load information of the distributed storage unit is greater than 90%, consider that the storage load information of the current distributed storage unit reaches the preset expansion load.
The first storage unit may be a distributed storage unit to be expanded.
Specifically, storage load information of each distributed storage unit in the storage pool is detected, whether the storage load information of each distributed storage unit is larger than a preset capacity expansion load is judged, if the storage load information of the distributed storage unit is detected to be larger than the preset capacity expansion load, the storage load information of the distributed storage unit reaches the preset capacity expansion load, and the distributed storage unit with the storage load information reaching the preset capacity expansion load is determined to be a first storage unit to be expanded.
Optionally, a certain time detection interval is set in the storage pool to sequentially detect storage load information of the distributed storage units, and when the storage load information of the distributed storage units reaches a preset capacity expansion load, warning information is sent out.
Optionally, the storage load information of each distributed storage unit is continuously obtained through the storage pool monitoring system, the storage load information of each distributed storage unit is displayed in the storage monitoring system, the distributed storage units with the storage load information reaching the preset capacity expansion load are marked red, and the distributed storage units are reminded of overhigh load and are required to be stored and expanded.
S120, acquiring target storage information of a plurality of distributed storage units in the storage pool, and determining the distributed storage units, of which the target storage information meets a preset capacity expansion condition, in the storage pool as second storage units.
The target storage information may be usage information of a storage space of the distributed storage unit.
The second storage unit may be a distributed storage unit that expands a capacity of the distributed storage unit.
The preset capacity expansion condition may be a condition preset to determine whether the distributed storage unit can be used for capacity expansion.
Specifically, target storage information of other distributed storage units except the first storage unit in the storage pool is sequentially acquired, whether the target storage information of the distributed storage units meets a preset capacity expansion condition is judged, and if the target storage information of the distributed storage units meets the preset capacity expansion condition, the distributed storage units meeting the preset capacity expansion condition are determined to be the second storage units.
Optionally, in another optional embodiment of the present invention, the method further includes:
if the distributed storage units with target storage information meeting the preset capacity expansion condition do not exist in the storage pool, creating a continuous storage pool, and determining a third storage unit in the continuous storage pool;
and carrying out storage expansion on the first storage unit according to the third storage unit.
The third storage unit may be a distributed storage unit in the continuation storage pool for expanding the first storage unit.
Specifically, target storage information of other distributed storage units except the first storage unit in the storage pool is sequentially acquired, whether the target storage information of the distributed storage units meets a preset capacity expansion condition is judged, if the target storage information of the distributed storage units does not meet the preset capacity expansion condition, it is indicated that a second storage unit capable of being used for expanding the first storage unit does not exist in the current storage pool, a continuous storage pool is created, and a third storage unit used for expanding and storing the first storage unit is determined from the continuous storage pool.
S130, performing storage expansion on the first storage unit according to the second storage unit.
Specifically, the second storage unit is used as the expansion space of the first storage unit to store and expand the capacity of the first storage unit.
Optionally, the performing storage expansion on the first storage unit according to the second storage unit includes:
acquiring storage load information of a second storage unit;
determining the expansion storage space of the first storage unit according to the storage load information;
and mapping the capacity expansion storage space into the storage space of the first storage unit, and carrying out storage capacity expansion on the first storage unit.
The expansion storage space may be a storage space in which the second storage unit can be used for expansion. It should be noted that, the storage load information of the second storage unit may feed back the remaining storage space of the second storage unit, and use the remaining storage control of the second storage unit as the expansion storage space of the first storage unit.
Specifically, storage load information of the second storage unit is obtained, the load condition of the second storage unit is determined, further, the remaining storage space capable of being used for capacity expansion is determined according to the storage load information, the remaining storage space of the second storage unit is determined to be the capacity expansion storage space of the first storage unit, the capacity expansion storage space is mapped to the storage space of the first storage unit, and the first storage unit is subjected to storage capacity expansion.
Optionally, in another optional embodiment of the present invention, after the determining the distributed storage unit as the first storage unit to be expanded, the method further includes:
and acquiring the storage data of the first storage unit, uploading the storage data to a cloud server, and compressing the storage data of the first storage unit.
Wherein the stored data may be data that the first memory unit is currently storing.
The cloud server may be a server connected to the storage pool.
Specifically, the storage data stored in the first storage unit is obtained, the storage data is uploaded to a cloud server connected with the storage pool, and the storage data stored in the first storage unit is compressed.
According to the technical scheme, under the condition that the storage load information of the distributed storage units in the storage pool is detected to reach the preset capacity expansion load, the distributed storage units are determined to be the first storage units to be expanded, when the load of the distributed storage units is too high, the influence on the storage service of the storage pool is prevented, the capacity of the high-load distributed storage units is expanded, and the storage experience of a user is improved; acquiring target storage information of a plurality of distributed storage units in the storage pool, determining the distributed storage units, which meet the preset capacity expansion conditions, in the storage pool as second storage units, and selecting the distributed storage units, which meet the preset capacity expansion conditions, for capacity expansion, so that the storage space utilization rate in the distributed storage pool is improved; according to the second storage unit, the first storage unit is subjected to storage expansion, the distributed storage units in the distributed storage pool are selected for expansion, the storage cost of expansion is reduced on the basis of meeting the expansion demand, the technical problems of low storage space utilization rate and high expansion cost in the distributed storage in the prior art are solved, and the phenomenon that a user cannot interrupt in the process of using the distributed storage is guaranteed.
Example two
FIG. 2 is a flowchart of another distributed storage capacity expansion method according to a second embodiment of the present invention, where the relationship between the present embodiment and the above embodiments is a specific method for determining a second storage unit in a storage pool; in the embodiment of the invention, the target storage information comprises residual storage space information and historical use information; the preset capacity expansion conditions comprise available space conditions and stored information conditions. As shown in fig. 2, the distributed storage capacity expansion method includes:
s210, under the condition that storage load information of the distributed storage units in the storage pool reaches a preset capacity expansion load, determining the distributed storage units as first storage units to be expanded.
S220, acquiring the distributed storage units with residual storage space information meeting the available space conditions in the storage pool, and determining the acquired distributed storage units as candidate storage units.
The remaining storage space information may be unused storage space remaining in the distributed storage unit.
The available space condition may be a condition for determining whether remaining storage space information in the distributed storage unit is a candidate storage unit.
The candidate storage units may be distributed storage units in which the remaining storage space information in the storage pool satisfies the available space condition.
Specifically, the remaining storage space information of other distributed storage units except the first storage unit in the storage pool is sequentially acquired, whether the remaining storage space information of the distributed storage unit meets the available space condition is judged, and if the remaining storage space information of the distributed storage unit meets the available space condition, the acquired distributed storage unit is determined to be a candidate storage unit.
S230, acquiring the candidate storage units of which the history use information meets the storage information condition, and determining the acquired candidate storage units as second storage units.
Wherein the history usage information may be history information of usage of the distributed storage unit.
The stored information condition may be a condition for judging whether or not the history use information in the candidate storage unit is the second storage unit.
Wherein the history use information includes capacity expansion flag information and compression record information; the capacity expansion mark information can be standard information for marking the distributed storage unit as the capacity expansion being stored; the compressed record information may be record information in which stored data of the distributed storage unit is compressed.
Specifically, the history information of the candidate storage units is sequentially acquired, whether the history information of the candidate storage units meets the storage information condition is judged, and if the history information of the candidate storage units meets the storage information condition, the candidate storage units with the history information meeting the storage information condition are determined to be the second storage units.
Optionally, in another optional embodiment of the present invention, the candidate storage unit, if there is the history usage information that satisfies a storage information condition, includes:
and if the candidate storage unit does not have the expansion mark information and/or the compression record information, determining that the history use information meets the storage information condition.
Specifically, historical record information of the candidate storage units is obtained, whether the candidate storage units have expansion sign information and/or compression record information is judged, if the candidate storage units have the expansion sign information, the candidate storage units are indicated to expand and store for other distributed storage units, and the expansion and the storage cannot be carried out for the first storage unit; if the candidate storage unit has compressed record information, the candidate storage unit is a distributed storage unit which is expanded and stored, and expansion and storage can not be carried out for the first storage unit; if the candidate storage unit does not have the expansion flag information and/or the compression record information, the candidate storage unit can perform storage expansion for the first storage unit, and the candidate storage unit is determined to be the second storage unit.
S240, performing storage expansion on the first storage unit according to the second storage unit.
Specifically, the second storage unit is used as the expansion space of the first storage unit to store and expand the capacity of the first storage unit.
Optionally, in another optional embodiment of the present invention, the determining a third storage unit in the continuation storage pool includes:
acquiring historical use information and/or compressed record information of a plurality of distributed storage units in the continuous storage pool; and if the capacity expansion mark information does not exist in the history use information of the distributed storage unit, determining the distributed storage unit as a third storage unit.
Specifically, historical record information of a plurality of distributed storage units in a continuous storage pool is obtained, whether each distributed storage unit has expansion sign information and/or compression record information is judged, if the distributed storage unit has the expansion sign information, the distributed storage unit is stated to expand and store for other distributed storage units, and the first storage unit cannot expand and store; if the distributed storage unit has compressed record information, the distributed storage unit is a distributed storage unit which is stored in a capacity-expanding manner, and the capacity-expanding storage cannot be performed for the first storage unit; if the distributed storage unit does not have the expansion mark information and/or the compression record information, the distributed storage unit can perform storage expansion for the first storage unit, and the candidate storage unit is determined to be a third storage unit.
According to the technical scheme, under the condition that the storage load information of the distributed storage units in the storage pool is detected to reach the preset capacity expansion load, the distributed storage units are determined to be the first storage units to be expanded, when the load of the distributed storage units is too high, the influence on the storage service of the storage pool is prevented, the capacity of the high-load distributed storage units is expanded, and the storage experience of a user is improved; acquiring target storage information of a plurality of distributed storage units in the storage pool, determining the distributed storage units, which meet the preset capacity expansion conditions, in the storage pool as second storage units, and selecting the distributed storage units, which meet the preset capacity expansion conditions, for capacity expansion, so that the storage space utilization rate in the distributed storage pool is improved; according to the second storage unit, the first storage unit is subjected to storage expansion, the distributed storage units in the distributed storage pool are selected for expansion, the storage cost of expansion is reduced on the basis of meeting the expansion demand, the technical problems of low storage space utilization rate and high expansion cost in the distributed storage in the prior art are solved, and the phenomenon that a user cannot interrupt in the process of using the distributed storage is guaranteed.
Example III
Fig. 3 is a schematic structural diagram of a distributed storage capacity expansion device according to a third embodiment of the present invention. As shown in fig. 3, the apparatus includes: a storage unit load detection module 310, a second storage unit selection module 320, and a storage expansion module 330, wherein,
the storage unit load detection module 310 is configured to determine, when it is detected that storage load information of a distributed storage unit in a storage pool reaches a preset capacity expansion load, the distributed storage unit as a first storage unit to be expanded;
a second storage unit selection module 320, configured to obtain target storage information of a plurality of distributed storage units in the storage pool, and determine, as a second storage unit, the distributed storage units in the storage pool for which the target storage information meets a preset capacity expansion condition;
and the storage capacity expansion module 330 is configured to perform storage capacity expansion on the first storage unit according to the second storage unit.
According to the technical scheme, under the condition that the storage load information of the distributed storage units in the storage pool is detected to reach the preset capacity expansion load, the distributed storage units are determined to be the first storage units to be expanded, when the load of the distributed storage units is too high, the influence on the storage service of the storage pool is prevented, the capacity of the high-load distributed storage units is expanded, and the storage experience of a user is improved; acquiring target storage information of a plurality of distributed storage units in the storage pool, determining the distributed storage units, which meet the preset capacity expansion conditions, in the storage pool as second storage units, and selecting the distributed storage units, which meet the preset capacity expansion conditions, for capacity expansion, so that the storage space utilization rate in the distributed storage pool is improved; according to the second storage unit, the first storage unit is subjected to storage expansion, the distributed storage units in the distributed storage pool are selected for expansion, the storage cost of expansion is reduced on the basis of meeting the expansion demand, the technical problems of low storage space utilization rate and high expansion cost in the distributed storage in the prior art are solved, and the phenomenon that a user cannot interrupt in the process of using the distributed storage is guaranteed.
Optionally, the second storage unit selection module is specifically configured to:
acquiring the distributed storage units with residual storage space information meeting the available space conditions in the storage pool, and determining the acquired distributed storage units as candidate storage units;
and acquiring the candidate storage units of which the history use information meets the storage information condition, and determining the acquired candidate storage units as second storage units.
Optionally, the second storage unit selection module is specifically further configured to:
and if the candidate storage unit does not have the expansion mark information and/or the compression record information, determining that the history use information meets the storage information condition.
Optionally, the storage capacity expansion module is specifically configured to:
acquiring storage load information of a second storage unit;
determining the expansion storage space of the first storage unit according to the storage load information;
and mapping the capacity expansion storage space into the storage space of the first storage unit, and carrying out storage capacity expansion on the first storage unit.
Optionally, the apparatus further includes: a continuation storage determining module and a continuation storage capacity expansion module; wherein, the liquid crystal display device comprises a liquid crystal display device,
the continuous storage determining module is used for creating a continuous storage pool and determining a third storage unit in the continuous storage pool if the distributed storage unit with target storage information meeting the preset capacity expansion condition does not exist in the storage pool;
and the continuous storage capacity expansion module is used for carrying out storage capacity expansion on the first storage unit according to the third storage unit.
Optionally, the continuous storage capacity expansion module is specifically configured to:
acquiring historical use information of a plurality of distributed storage units in the continuous storage pool;
and if the capacity expansion mark information and/or the compression record information do not exist in the history use information of the distributed storage unit, determining the distributed storage unit as a third storage unit.
Optionally, the apparatus further includes: a data storage module; wherein, the liquid crystal display device comprises a liquid crystal display device,
the data storage module is used for acquiring the storage data of the first storage unit, uploading the storage data to a cloud server and compressing the storage data of the first storage unit.
The distributed storage capacity expansion device provided by the embodiment of the invention can execute the distributed storage capacity expansion method provided by any embodiment of the invention, and has the corresponding functional modules and beneficial effects of the execution method.
Example IV
Fig. 4 shows a schematic diagram of the structure of an electronic device 10 that may be used to implement an embodiment of the invention. Electronic devices are intended to represent various forms of digital computers, such as laptops, desktops, workstations, personal digital assistants, servers, blade servers, mainframes, and other appropriate computers. Electronic equipment may also represent various forms of mobile devices, such as personal digital processing, cellular telephones, smartphones, wearable devices (e.g., helmets, glasses, watches, etc.), and other similar computing devices. The components shown herein, their connections and relationships, and their functions, are meant to be exemplary only, and are not meant to limit implementations of the inventions described and/or claimed herein.
As shown in fig. 4, the electronic device 10 includes at least one processor 11, and a memory, such as a Read Only Memory (ROM) 12, a Random Access Memory (RAM) 13, etc., communicatively connected to the at least one processor 11, in which the memory stores a computer program executable by the at least one processor, and the processor 11 may perform various appropriate actions and processes according to the computer program stored in the Read Only Memory (ROM) 12 or the computer program loaded from the storage unit 18 into the Random Access Memory (RAM) 13. In the RAM 13, various programs and data required for the operation of the electronic device 10 may also be stored. The processor 11, the ROM 12 and the RAM 13 are connected to each other via a bus 14. An input/output (I/O) interface 15 is also connected to bus 14.
Various components in the electronic device 10 are connected to the I/O interface 15, including: an input unit 16 such as a keyboard, a mouse, etc.; an output unit 17 such as various types of displays, speakers, and the like; a storage unit 18 such as a magnetic disk, an optical disk, or the like; and a communication unit 19 such as a network card, modem, wireless communication transceiver, etc. The communication unit 19 allows the electronic device 10 to exchange information/data with other devices via a computer network, such as the internet, and/or various telecommunication networks.
The processor 11 may be a variety of general and/or special purpose processing components having processing and computing capabilities. Some examples of processor 11 include, but are not limited to, a Central Processing Unit (CPU), a Graphics Processing Unit (GPU), various specialized Artificial Intelligence (AI) computing chips, various processors running machine learning model algorithms, digital Signal Processors (DSPs), and any suitable processor, controller, microcontroller, etc. The processor 11 performs the various methods and processes described above, such as a distributed storage capacity expansion method.
In some embodiments, the distributed storage capacity expansion method may be implemented as a computer program tangibly embodied on a computer-readable storage medium, such as the storage unit 18. In some embodiments, part or all of the computer program may be loaded and/or installed onto the electronic device 10 via the ROM 12 and/or the communication unit 19. When the computer program is loaded into RAM 13 and executed by processor 11, one or more steps of the distributed storage capacity expansion method described above may be performed. Alternatively, in other embodiments, the processor 11 may be configured to perform the distributed storage expansion method in any other suitable way (e.g., by means of firmware).
Various implementations of the systems and techniques described here above may be implemented in digital electronic circuitry, integrated circuit systems, field Programmable Gate Arrays (FPGAs), application Specific Integrated Circuits (ASICs), application Specific Standard Products (ASSPs), systems On Chip (SOCs), load programmable logic devices (CPLDs), computer hardware, firmware, software, and/or combinations thereof. These various embodiments may include: implemented in one or more computer programs, the one or more computer programs may be executed and/or interpreted on a programmable system including at least one programmable processor, which may be a special purpose or general-purpose programmable processor, that may receive data and instructions from, and transmit data and instructions to, a storage system, at least one input device, and at least one output device.
A computer program for carrying out methods of the present invention may be written in any combination of one or more programming languages. These computer programs may be provided to a processor of a general purpose computer, special purpose computer, or other programmable data processing apparatus, such that the computer programs, when executed by the processor, cause the functions/acts specified in the flowchart and/or block diagram block or blocks to be implemented. The computer program may execute entirely on the machine, partly on the machine, as a stand-alone software package, partly on the machine and partly on a remote machine or entirely on the remote machine or server.
In the context of the present invention, a computer-readable storage medium may be a tangible medium that can contain, or store a computer program for use by or in connection with an instruction execution system, apparatus, or device. The computer readable storage medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing. Alternatively, the computer readable storage medium may be a machine readable signal medium. More specific examples of a machine-readable storage medium would include an electrical connection based on one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.
To provide for interaction with a user, the systems and techniques described here can be implemented on an electronic device having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to a user; and a keyboard and a pointing device (e.g., a mouse or a trackball) through which a user can provide input to the electronic device. Other kinds of devices may also be used to provide for interaction with a user; for example, feedback provided to the user may be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user may be received in any form, including acoustic input, speech input, or tactile input.
The systems and techniques described here can be implemented in a computing system that includes a background component (e.g., as a data server), or that includes a middleware component (e.g., an application server), or that includes a front-end component (e.g., a user computer having a graphical user interface or a web browser through which a user can interact with an implementation of the systems and techniques described here), or any combination of such background, middleware, or front-end components. The components of the system can be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: local Area Networks (LANs), wide Area Networks (WANs), blockchain networks, and the internet.
The computing system may include clients and servers. The client and server are typically remote from each other and typically interact through a communication network. The relationship of client and server arises by virtue of computer programs running on the respective computers and having a client-server relationship to each other. The server can be a cloud server, also called a cloud computing server or a cloud host, and is a host product in a cloud computing service system, so that the defects of high management difficulty and weak service expansibility in the traditional physical hosts and VPS service are overcome.
It should be appreciated that various forms of the flows shown above may be used to reorder, add, or delete steps. For example, the steps described in the present invention may be performed in parallel, sequentially, or in a different order, so long as the desired results of the technical solution of the present invention are achieved, and the present invention is not limited herein.
Example five
The present embodiment provides a computer readable storage medium having stored thereon a computer program which when executed by a processor implements the distributed storage capacity expansion method steps as provided by any embodiment of the present invention, the method comprising:
under the condition that storage load information of a distributed storage unit in a storage pool is detected to reach a preset capacity expansion load, the distributed storage unit is determined to be a first storage unit to be expanded;
acquiring target storage information of a plurality of distributed storage units in the storage pool, and determining the distributed storage units, in which the target storage information in the storage pool meets a preset capacity expansion condition, as second storage units;
and carrying out storage expansion on the first storage unit according to the second storage unit.
The computer storage media of embodiments of the invention may take the form of any combination of one or more computer-readable media. The computer readable medium may be a computer readable signal medium or a computer readable storage medium. The computer readable storage medium may be, for example, but not limited to: an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or a combination of any of the foregoing. More specific examples (a non-exhaustive list) of the computer-readable storage medium would include the following: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In this document, a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device.
The computer readable signal medium may include a propagated data signal with computer readable program code embodied therein, either in baseband or as part of a carrier wave. Such a propagated data signal may take any of a variety of forms, including, but not limited to, electro-magnetic, optical, or any suitable combination of the foregoing. A computer readable signal medium may also be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device.
Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to: wireless, wire, fiber optic cable, RF, etc., or any suitable combination of the foregoing.
Computer program code for carrying out operations of the present invention may be written in one or more programming languages, including an object oriented programming language such as Java, smalltalk, C ++ and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any kind of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or may be connected to an external computer (for example, through the Internet using an Internet service provider).
It will be appreciated by those of ordinary skill in the art that the modules or steps of the invention described above may be implemented in a general purpose computing device, they may be centralized on a single computing device, or distributed over a network of computing devices, or they may alternatively be implemented in program code executable by a computer device, such that they are stored in a memory device and executed by the computing device, or they may be separately fabricated as individual integrated circuit modules, or multiple modules or steps within them may be fabricated as a single integrated circuit module. Thus, the present invention is not limited to any specific combination of hardware and software.
It should be appreciated that various forms of the flows shown above may be used to reorder, add, or delete steps. For example, the steps described in the present invention may be performed in parallel, sequentially, or in a different order, so long as the desired results of the technical solution of the present invention are achieved, and the present invention is not limited herein.
The above embodiments do not limit the scope of the present invention. It will be apparent to those skilled in the art that various modifications, combinations, sub-combinations and alternatives are possible, depending on design requirements and other factors. Any modifications, equivalent substitutions and improvements made within the spirit and principles of the present invention should be included in the scope of the present invention.
Claims (10)
1. A distributed storage capacity expansion method, comprising:
under the condition that storage load information of a distributed storage unit in a storage pool is detected to reach a preset capacity expansion load, the distributed storage unit is determined to be a first storage unit to be expanded;
acquiring target storage information of a plurality of distributed storage units in the storage pool, and determining the distributed storage units, in which the target storage information in the storage pool meets a preset capacity expansion condition, as second storage units;
and carrying out storage expansion on the first storage unit according to the second storage unit.
2. The method of claim 1, wherein the target storage information includes remaining storage space information and historical usage information; the preset capacity expansion conditions comprise available space conditions and stored information conditions; the determining, as a second storage unit, the distributed storage unit in the storage pool in which the target storage information meets a preset capacity expansion condition includes:
acquiring the distributed storage units with residual storage space information meeting the available space conditions in the storage pool, and determining the acquired distributed storage units as candidate storage units;
and acquiring the candidate storage units of which the history use information meets the storage information condition, and determining the acquired candidate storage units as second storage units.
3. The method of claim 2, wherein the history use information includes capacity expansion flag information and compression record information; the obtaining the candidate storage unit that the history use information satisfies a storage information condition includes:
and if the candidate storage unit does not have the expansion mark information and/or the compression record information, determining that the history use information meets the storage information condition.
4. The method of claim 1, wherein said performing storage expansion on said first storage unit according to said second storage unit comprises:
acquiring storage load information of a second storage unit;
determining the expansion storage space of the first storage unit according to the storage load information;
and mapping the capacity expansion storage space into the storage space of the first storage unit, and carrying out storage capacity expansion on the first storage unit.
5. The method as recited in claim 1, further comprising:
if the distributed storage units with target storage information meeting the preset capacity expansion condition do not exist in the storage pool, creating a continuous storage pool, and determining a third storage unit in the continuous storage pool;
and carrying out storage expansion on the first storage unit according to the third storage unit.
6. The method of claim 5, wherein the determining a third storage unit in the continuation storage pool comprises:
acquiring historical use information of a plurality of distributed storage units in the continuous storage pool;
and if the capacity expansion mark information and/or the compression record information do not exist in the history use information of the distributed storage unit, determining the distributed storage unit as a third storage unit.
7. The method of claim 1, further comprising, after the determining the distributed storage unit as the first storage unit to be expanded:
and acquiring the storage data of the first storage unit, uploading the storage data to a cloud server, and compressing the storage data of the first storage unit.
8. A distributed storage capacity expansion device, comprising:
the storage unit load detection module is used for determining the distributed storage unit as a first storage unit to be expanded under the condition that storage load information of the distributed storage unit in the storage pool reaches a preset expansion load;
the second storage unit selection module is used for acquiring target storage information of a plurality of distributed storage units in the storage pool and determining the distributed storage units, in which the target storage information in the storage pool meets a preset capacity expansion condition, as second storage units;
and the storage capacity expansion module is used for carrying out storage capacity expansion on the first storage unit according to the second storage unit.
9. An electronic device, the electronic device comprising:
at least one processor; and
a memory communicatively coupled to the at least one processor; wherein, the liquid crystal display device comprises a liquid crystal display device,
the memory stores a computer program executable by the at least one processor to enable the at least one processor to perform the distributed storage capacity expansion method of any of claims 1-7.
10. A computer readable storage medium storing computer instructions for causing a processor to implement the distributed storage expansion method of any of claims 1-7 when executed.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310572577.9A CN116594563A (en) | 2023-05-19 | 2023-05-19 | Distributed storage capacity expansion method and device, electronic equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310572577.9A CN116594563A (en) | 2023-05-19 | 2023-05-19 | Distributed storage capacity expansion method and device, electronic equipment and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN116594563A true CN116594563A (en) | 2023-08-15 |
Family
ID=87604190
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202310572577.9A Pending CN116594563A (en) | 2023-05-19 | 2023-05-19 | Distributed storage capacity expansion method and device, electronic equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN116594563A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117082083A (en) * | 2023-08-30 | 2023-11-17 | 杭州浩联智能科技有限公司 | Data storage method, device and medium based on distributed Internet of things architecture |
-
2023
- 2023-05-19 CN CN202310572577.9A patent/CN116594563A/en active Pending
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117082083A (en) * | 2023-08-30 | 2023-11-17 | 杭州浩联智能科技有限公司 | Data storage method, device and medium based on distributed Internet of things architecture |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN112988727B (en) | Data annotation method, device, equipment, storage medium and computer program product | |
| CN116594563A (en) | Distributed storage capacity expansion method and device, electronic equipment and storage medium | |
| CN113778644B (en) | Task processing method, device, equipment and storage medium | |
| CN113760982A (en) | Data processing method and device | |
| CN114564149B (en) | Data storage method, device, equipment and storage medium | |
| CN115905322A (en) | Service processing method and device, electronic equipment and storage medium | |
| CN113676531B (en) | E-commerce flow peak clipping method and device, electronic equipment and readable storage medium | |
| CN113139891B (en) | Image processing method, device, electronic equipment and storage medium | |
| CN115543416A (en) | Configuration updating method and device, electronic equipment and storage medium | |
| CN115438007A (en) | File merging method and device, electronic equipment and medium | |
| CN112887426B (en) | Information stream pushing method and device, electronic equipment and storage medium | |
| CN113377295A (en) | Data storage and reading method, device and equipment for multi-producer single-consumer | |
| CN114138358A (en) | Application program starting optimization method, device, equipment and storage medium | |
| CN113220230B (en) | Data export method and device, electronic equipment and storage medium | |
| CN113326890B (en) | Labeling data processing method, related device and computer program product | |
| CN116954922A (en) | Distributed storage method, device, equipment and medium | |
| CN115718608A (en) | Parameter updating method and device, electronic equipment and storage medium | |
| CN117608879A (en) | Message queue processing method and device, electronic equipment and storage medium | |
| CN115802438A (en) | Data processing method, device, equipment and medium | |
| CN116450915A (en) | Application degradation method, device, electronic equipment and storage medium | |
| CN115344637A (en) | Data management system, method, device, electronic equipment and storage medium | |
| CN115840645A (en) | Method, device, storage medium and electronic equipment for predicting load index | |
| CN115190097A (en) | Message pushing method, device, equipment and storage medium | |
| CN115801718A (en) | Message processing method and device, electronic equipment and message processing system | |
| CN117453628A (en) | Application file management method, device equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |