CN109947531B - Storage capacity expansion method and device of super-fusion all-in-one machine and storage medium - Google Patents
Storage capacity expansion method and device of super-fusion all-in-one machine and storage medium Download PDFInfo
- Publication number
- CN109947531B CN109947531B CN201910145614.1A CN201910145614A CN109947531B CN 109947531 B CN109947531 B CN 109947531B CN 201910145614 A CN201910145614 A CN 201910145614A CN 109947531 B CN109947531 B CN 109947531B
- Authority
- CN
- China
- Prior art keywords
- fusion
- super
- machine
- storage
- storage module
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Abstract
The invention relates to the technical field of data storage, and provides a method and a device for expanding storage capacity of a super-fusion all-in-one machine, the super-fusion all-in-one machine and a computer readable storage medium. The method for expanding the storage capacity of the super-fusion all-in-one machine comprises the following steps: analyzing the resource use information in a computing module and a storage module in the super-fusion all-in-one machine to obtain corresponding resource occupation information; the resource use information comprises the operation use rate of the computing module and the storage occupancy rate of the storage module; determining whether the storage capacity needs to be expanded or not according to the resource occupation information, and performing longitudinal capacity expansion or transverse capacity expansion on the external storage capacity when the storage capacity needs to be expanded; the longitudinal capacity expansion is: data backup and/or data migration are/is carried out among a plurality of super-fusion all-in-one machines in the same super-fusion node; the lateral capacity is expanded to: and when the number of the super-fusion nodes is more than one, carrying out data migration between different super-fusion nodes.
Description
Technical Field
The invention belongs to the technical field of communication, and particularly relates to a storage capacity expansion method and device of a super-convergence all-in-one machine, the super-convergence all-in-one machine and a computer readable storage medium.
Background
The data center architecture based on the virtualization technology is called a mainstream of the data center in the last decades, but is still a traditional three-layer architecture formed by overlapping three components, namely a server, a storage network and a storage device, as shown in fig. 1.
With the rapid increase of the application and the number of users, the three-layer architecture in fig. 1 exposes many problems in the data center construction and operation and maintenance process, and the fundamental reason is that the performance of centralized shared storage cannot really realize capacity expansion as required along with the service development. For example, the memory controller determines the overall performance of the memory device, and cannot achieve lateral expansion because it is embedded in the memory device. When the number of virtual machines and the demand of I/O (Input/Output) interfaces increase greatly, a huge amount of data access requests may cause congestion of a controller, which causes a performance bottleneck. Therefore, when a new application needs to be online, the performance bottleneck problem of the storage device can be solved only by purchasing a new storage device, which causes a high cost of storage capacity expansion. Therefore, the prior art has the problem of high expansion cost.
Disclosure of Invention
In view of this, embodiments of the present invention provide a method and an apparatus for expanding storage capacity of a super-fusion all-in-one machine, and a computer-readable storage medium, so as to solve the problem in the prior art that capacity expansion cost is high.
The first aspect of the embodiment of the invention provides a capacity expansion method applied to a super-fusion all-in-one machine, wherein a plurality of super-fusion all-in-one machines belong to a super-fusion node; the storage capacity expansion method comprises the following steps:
analyzing the resource use information in a computing module and a storage module in the super-fusion all-in-one machine to obtain corresponding resource occupation information; the resource usage information comprises the operation usage rate of the computing module and the storage occupancy rate of the storage module.
And determining whether the storage capacity needs to be expanded or not according to the resource occupation information, and performing longitudinal capacity expansion or transverse capacity expansion on the external storage capacity when the storage capacity needs to be expanded.
The longitudinal capacity expansion is: and data backup and/or data migration are/is carried out among a plurality of super-fusion all-in-one machines in the same super-fusion node.
The lateral capacity is expanded to: and when the number of the super-fusion nodes is more than one, carrying out data migration between different super-fusion nodes.
A second aspect of the embodiments of the present invention provides a storage capacity expansion apparatus for a super-fusion all-in-one machine, including:
the analysis unit is used for analyzing the resource use information in the calculation module and the storage module in the super-fusion all-in-one machine to obtain corresponding resource occupation information; the resource usage information comprises the operation usage rate of the computing module and the storage occupancy rate of the storage module.
And the expansion unit is used for determining whether the storage capacity needs to be expanded or not according to the resource occupation information and performing longitudinal capacity expansion or transverse capacity expansion on the external storage capacity when the storage capacity needs to be expanded.
A third aspect of the embodiments of the present invention provides a super-fusion all-in-one machine, including a memory, a processor, and a computer program stored in the memory and executable on the processor, where the processor implements the following steps when executing the computer program:
analyzing the resource use information in a computing module and a storage module in the super-fusion all-in-one machine to obtain corresponding resource occupation information; the resource usage information comprises the operation usage rate of the computing module and the storage occupancy rate of the storage module.
And determining whether the storage capacity needs to be expanded or not according to the resource occupation information, and performing longitudinal capacity expansion or transverse capacity expansion on the external storage capacity when the storage capacity needs to be expanded.
The longitudinal capacity expansion is: and data backup and/or data migration are/is carried out among a plurality of super-fusion all-in-one machines in the same super-fusion node.
The lateral capacity is expanded to: and when the number of the super-fusion nodes is more than one, carrying out data migration between different super-fusion nodes.
A fourth aspect of embodiments of the present invention provides a computer-readable storage medium storing a computer program which, when executed by a processor, implements the steps of:
analyzing the resource use information in a computing module and a storage module in the super-fusion all-in-one machine to obtain corresponding resource occupation information; the resource usage information comprises the operation usage rate of the computing module and the storage occupancy rate of the storage module.
And determining whether the storage capacity needs to be expanded or not according to the resource occupation information, and performing longitudinal capacity expansion or transverse capacity expansion on the external storage capacity when the storage capacity needs to be expanded.
The longitudinal capacity expansion is: and data backup and/or data migration are/is carried out among a plurality of super-fusion all-in-one machines in the same super-fusion node.
The lateral capacity is expanded to: and when the number of the super-fusion nodes is more than one, carrying out data migration between different super-fusion nodes.
The embodiment of the invention provides a storage capacity expansion method of a super-fusion all-in-one machine, wherein a plurality of super-fusion all-in-one machines belong to a super-fusion node, and firstly, resource use information in a calculation module and a storage module in the super-fusion all-in-one machine is analyzed to obtain corresponding resource occupation information; the resource use information comprises the operation use rate of the computing module and the storage occupancy rate of the storage module; then, determining whether the storage capacity needs to be expanded or not according to the resource occupation information, and performing longitudinal capacity expansion or transverse capacity expansion on the external storage capacity when the storage capacity needs to be expanded; the longitudinal capacity expansion is: data backup and/or data migration are/is carried out among a plurality of super-fusion all-in-one machines in the same super-fusion node; the lateral capacity is expanded to: when the number of the super fusion nodes is more than one, data migration performed between different super fusion nodes can be expanded as required, the capacity expansion mode is flexible, new storage equipment is not required to be added, the capacity expansion cost is low, the problem of high capacity expansion cost is solved, and the method has high practicability and usability.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings needed to be used in the embodiments or the prior art descriptions will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without inventive exercise.
FIG. 1 is a diagram illustrating a conventional three-tier architecture according to an embodiment of the present invention;
fig. 2 is a schematic structural diagram of a super-fusion node according to an embodiment of the present invention;
fig. 3 is a schematic flow chart illustrating an implementation of a capacity expansion method of the ultra-fusion all-in-one machine according to an embodiment of the present invention;
fig. 4 is a schematic structural diagram of a capacity expansion device of a super-fusion all-in-one machine according to a second embodiment of the present invention;
fig. 5 is a schematic diagram of a hyper-fusion all-in-one machine provided by the third embodiment of the invention.
Detailed Description
In the following description, for purposes of explanation and not limitation, specific details are set forth, such as particular system structures, techniques, etc. in order to provide a thorough understanding of the embodiments of the invention. It will be apparent, however, to one skilled in the art that the present invention may be practiced in other embodiments that depart from these specific details. In other instances, detailed descriptions of well-known systems, devices, circuits, and methods are omitted so as not to obscure the description of the present invention with unnecessary detail.
In order to explain the technical means of the present invention, the following description will be given by way of specific examples.
The first embodiment is as follows:
fig. 2 is a schematic diagram illustrating a super-fusion node according to an embodiment of the present invention. Fig. 3 is a schematic flow chart illustrating an implementation process of the capacity expansion method of the ultra-fusion all-in-one machine according to an embodiment of the present invention. As shown in fig. 3, the capacity expansion method applied to the ultra-fusion all-in-one machine specifically includes the following steps 101 to 102.
Step 101: analyzing the resource use information in a computing module and a storage module in the super-fusion all-in-one machine to obtain corresponding resource occupation information; the resource usage information comprises the operation usage rate of the computing module and the storage occupancy rate of the storage module.
Wherein, the execution main body of the step is a first super-integration all-in-one machine.
Step 102: and determining whether the storage capacity needs to be expanded or not according to the resource occupation information, and performing longitudinal capacity expansion or transverse capacity expansion on the external storage capacity when the storage capacity needs to be expanded.
Wherein the longitudinal capacity expansion is: and data backup and/or data migration are/is carried out among a plurality of super-fusion all-in-one machines in the same super-fusion node.
The lateral capacity is expanded to: and when the number of the super-fusion nodes is more than one, carrying out data migration between different super-fusion nodes.
Optionally, the computing module is configured to analyze resource usage conditions in the computing module and the storage module to obtain corresponding resource occupation information, and specifically includes:
and determining the comprehensive resource occupancy rate of the operation utilization rate of the computing module and the storage occupancy rate of the storage module, and taking the comprehensive resource occupancy rate as the corresponding resource occupancy information.
Furthermore, corresponding weights can be set for the operation utilization rate and the storage occupancy rate of the storage module respectively according to the analysis requirement. For example, the weight of the operation usage rate is W1, and the storage occupancy rate of the storage module is W2, then the resource integrated occupancy rate is the operation usage rate W1+ the storage occupancy rate W2. For example, if the calculation usage rate is 60% (i.e., 0.6), the weight of the calculation usage rate is W1 ═ 0.6, the storage occupancy is 70% (i.e., 0.7), and the storage occupancy W2 is 0.4, then the resource integrated occupancy is 0.6 × 0.6+0.7 ═ 0.4 ═ 0.64.
Optionally, the control module is configured to determine whether the super-fusion all-in-one machine needs to perform storage capacity expansion according to the resource occupation information, and perform longitudinal capacity expansion or lateral capacity expansion to the outside sequentially through the network module and the data exchange device when the storage capacity expansion needs to be performed, specifically:
step 201: and determining the comprehensive resource occupancy rate of the current super-fusion all-in-one machine according to the resource use information.
Step 202: and when the comprehensive occupancy rate of the resources is greater than the preset occupancy rate, judging whether the super-fusion all-in-one machines except the current super-fusion all-in-one machine in the super-fusion node meet longitudinal extension conditions, if so, executing a step 203, and if not, executing a step 204.
Step 203: and controlling the storage module to perform longitudinal capacity expansion on the super-fusion all-in-one machines except the current super-fusion all-in-one machine in the super-fusion node.
Step 204: and controlling the storage module to perform transverse capacity expansion on the external super-fusion node.
For steps 201 and 202, for example, the super-fusion cloud computing system includes two super-fusion nodes, each super-fusion node includes 3 super-fusion all-in-one machines, and when the storage module of the super-fusion all-in-one machine in each super-fusion node cannot meet the longitudinal expansion requirement, it is determined that the configuration of the storage module of the super-fusion all-in-one machine in the current super-fusion node cannot meet the longitudinal expansion requirement. If the storage module of the super-fusion all-in-one machine in one super-fusion node cannot meet the longitudinal extension requirement, judging whether the storage module of the super-fusion all-in-one machine in the other super-fusion node can meet the longitudinal extension requirement or not, and if the storage module of the super-fusion all-in-one machine in the other super-fusion node cannot meet the longitudinal extension requirement, in the first super-fusion all-in-one machine of the super-fusion node, controlling the storage module to transversely extend to the external super-fusion node through the network module and the data exchange equipment in sequence by the control module. It can be understood that if the storage module of the super-fusion all-in-one machine in another super-fusion node can meet the requirement of longitudinal expansion, the longitudinal expansion is performed.
Wherein the longitudinal capacity expansion specifically comprises:
migrating data in a storage module of a first super-fusion all-in-one machine to a storage module of a second super-fusion all-in-one machine for backup, and migrating the data backed up to the storage module of the second super-fusion all-in-one machine to the storage module of the first super-fusion all-in-one machine after the capacity of the storage module of the first super-fusion all-in-one machine is expanded; the first super-fusion all-in-one machine and the at least one second super-fusion all-in-one machine belong to a super-fusion node.
Optionally, the migrations are all online thermomigrations. The capacity expansion includes, but is not limited to, hardware upgrade of the CPU core number, the memory, and the disk, for example, the CPU core number of the current super-fusion all-in-one machine is 8 cores, the memory is 2TB, the upgraded CPU core number is 16 cores, and the memory is 8 TB.
Wherein the lateral capacity expansion specifically is:
migrating data in a storage module of a first super-fusion all-in-one machine to a storage module of a second super-fusion all-in-one machine; the first super-fusion all-in-one machine and the second super-fusion all-in-one machine belong to a super-fusion node.
For example, the ultra-fusion cloud computing system comprises an ultra-fusion node A, wherein the ultra-fusion node A comprises 3 ultra-fusion kiosks a1, a2 and a3, when the lateral expansion is needed, at least one ultra-fusion node is added according to the need of the lateral expansion, and if the ultra-fusion node B is added and comprises the ultra-fusion kiosks B1, B2 and B3, data in the storage modules of the fusion kiosks a1, a2 and/or a3 are migrated to the storage modules in the ultra-fusion kiosks B1, B2 and/or B3. It can be understood that when the requirement of the lateral expansion is the first requirement, the data in the storage module of one fusion kiosk (a1, a2 or a3) in the super-fusion node a can be migrated to the storage module in the super-fusion kiosk b1, b2 or b 3; when the requirement of the transverse expansion is a second requirement, the data in the storage modules of the two fusion unified machines (a1, a 2; a1, a2 or a2, a3) in the super-fusion node A can be migrated to the storage modules in the super-fusion unified machines b1, b2 or b 3; when the requirement for lateral expansion is a third requirement, the data in the storage modules of the three super-fusion unions (a1, a2 and a3) in the super-fusion node a can be migrated to the storage modules in the super-fusion unions b1, b2 or b3 together; when the requirement for lateral expansion is a fourth requirement, data in storage modules of two super-fusion all-in-one machines (a1, a 2; a1, a3 or a2, a3) in the super-fusion node a can be migrated to storage modules of two super-fusion all-in-one machines (b1, b 2; b1, b3 or b2, b3) correspondingly, for example, data in a storage module of the super-fusion all-in-one machine a1 in the super-fusion node a is migrated to a storage module of the super-fusion all-in-one machine b1, data in a storage module of the super-fusion all-in-one machine 63a 2 in the super-fusion node a is migrated to a storage module of the super-fusion all-in-one machine b2, and data in a storage module of the super-fusion all-in-one machine a3 in the super-fusion node a is not migrated. When the requirement of the transverse expansion is a fifth requirement, data in the storage modules of the three super-fusion all-in-one machines (a1, a2, and a3) in the super-fusion node a can be respectively and correspondingly migrated to the storage modules of the three super-fusion all-in-one machines (b1, b2, and b3), for example, data in the storage module of the super-fusion all-in-one machine a1 is respectively and correspondingly migrated to the storage module of the super-fusion all-in-one machine b1, data in the storage module of the super-fusion all-in-one machine a2 is respectively and correspondingly migrated to the storage module of the super-fusion all-in-one machine b2, and data in the storage module of the super-fusion all-in-one machine a3 is respectively and correspondingly migrated to the storage module of the super-.
It should be noted that the first requirement, the second requirement, the third requirement, the fourth requirement, and the fifth requirement are different requirements, and optionally, the first requirement, the second requirement, the third requirement, the fourth requirement, and the fifth requirement are sequentially increased. Optionally, the calculation module is further configured to calculate an access frequency of data in the storage module.
According to the storage capacity expansion method of the super-fusion all-in-one machine, a plurality of super-fusion all-in-one machines belong to one super-fusion node, firstly, resource use information in a computing module and a storage module in each super-fusion all-in-one machine is analyzed, and corresponding resource occupation information is obtained; the resource use information comprises the operation use rate of the computing module and the storage occupancy rate of the storage module; then, determining whether the storage capacity needs to be expanded or not according to the resource occupation information, and performing longitudinal capacity expansion or transverse capacity expansion on the external storage capacity when the storage capacity needs to be expanded; the longitudinal capacity expansion is: data backup and/or data migration are/is carried out among a plurality of super-fusion all-in-one machines in the same super-fusion node; the lateral capacity is expanded to: when the number of the super fusion nodes is more than one, data migration performed between different super fusion nodes can be expanded as required, the capacity expansion mode is flexible, new storage equipment is not required to be added, the capacity expansion cost is low, the problem of high capacity expansion cost is solved, and the method has high practicability and usability.
Optionally, after step 102, further comprising:
step 103: calculating the access frequency of the data in the storage module;
step 104: and migrating the data with the access frequency lower than the preset frequency in the storage module to an external hyper-fusion all-in-one machine.
For steps 103 and 104, the access frequency refers to the number of accesses within a preset period of time. For example, if the preset frequency is 2 accesses within 60 days, the data with the access frequency (for example, 1 access within 60 days) lower than the preset frequency (2 accesses within 60 days) in the storage module needs to be migrated, and the data is migrated to the storage module of the external super-convergence all-in-one machine through the network module and the data exchange device. It should be noted that the storage module of the external super-fusion all-in-one machine refers to a super-fusion all-in-one machine other than the current super-fusion all-in-one machine, including a super-fusion all-in-one machine with the same super-fusion node and a super-fusion all-in-one machine with different super-fusion nodes.
Optionally, the storage module is a plurality of magnetic disks for storing data.
Optionally, the super-fusion node includes at least three super-fusion all-in-one machines. It can be understood that each super-fusion node may further include four super-fusion integrators, or a part of super-fusion nodes includes three super-fusion integrators, and a part of super-fusion nodes includes four super-fusion integrators, which is not limited herein.
Example two:
referring to fig. 4, a block diagram of a capacity expansion apparatus of a super-fusion all-in-one machine according to a second embodiment of the present invention is shown. The capacity expansion device 40 of the super-fusion all-in-one machine includes: an analysis unit 41 and an extension unit 42. The specific functions of each unit are as follows:
the analysis unit 41 is configured to analyze resource usage information in a calculation module and a storage module in the super-fusion all-in-one machine to obtain corresponding resource occupation information; the resource usage information comprises the operation usage rate of the computing module and the storage occupancy rate of the storage module.
An expanding unit 42, configured to determine whether storage capacity expansion is needed according to the resource occupation information, and perform vertical capacity expansion or horizontal capacity expansion to the outside when storage capacity expansion is needed.
The longitudinal capacity expansion is: data backup and/or data migration are/is carried out among a plurality of super-fusion all-in-one machines in the same super-fusion node;
the lateral capacity is expanded to: and when the number of the super-fusion nodes is more than one, carrying out data migration between different super-fusion nodes.
Optionally, the extension unit comprises:
the determining subunit is used for determining the comprehensive resource occupancy rate of the current super-fusion all-in-one machine according to the resource use information;
the judging subunit is used for judging whether the super-fusion all-in-one machines except the current super-fusion all-in-one machine in the super-fusion node meet longitudinal extension conditions or not when the comprehensive occupancy rate of the resources is greater than a preset occupancy rate;
the longitudinal capacity expansion subunit is used for controlling the storage module to perform longitudinal capacity expansion on the super-fusion all-in-one machines except the current super-fusion all-in-one machine in the super-fusion node if the capacity expansion subunit is in the longitudinal capacity expansion state;
and the transverse capacity expansion subunit is used for controlling the storage module to perform transverse capacity expansion on the external super-fusion node if the storage module does not perform transverse capacity expansion on the external super-fusion node.
Optionally, the method further comprises:
and the calculating unit is used for calculating the access frequency of the data in the storage module.
And the migration unit is used for migrating the data with the access frequency lower than the preset frequency in the storage module to an external hyper-fusion all-in-one machine.
The embodiment of the invention provides a storage capacity expansion device of a super-fusion all-in-one machine, wherein a plurality of super-fusion all-in-one machines belong to a super-fusion node, and firstly, resource use information in a calculation module and a storage module in the super-fusion all-in-one machine is analyzed to obtain corresponding resource occupation information; the resource use information comprises the operation use rate of the computing module and the storage occupancy rate of the storage module; then, determining whether the storage capacity needs to be expanded or not according to the resource occupation information, and performing longitudinal capacity expansion or transverse capacity expansion on the external storage capacity when the storage capacity needs to be expanded; the longitudinal capacity expansion is: data backup and/or data migration are/is carried out among a plurality of super-fusion all-in-one machines in the same super-fusion node; the lateral capacity is expanded to: when the number of the super fusion nodes is more than one, data migration performed between different super fusion nodes can be expanded as required, the capacity expansion mode is flexible, new storage equipment is not required to be added, the capacity expansion cost is low, the problem of high capacity expansion cost is solved, and the method has high practicability and usability.
Example three:
fig. 5 is a schematic diagram of a hyper-fusion all-in-one machine provided by the third embodiment of the invention. As shown in fig. 5, the super-fusion all-in-one machine 5 of this embodiment includes: a processor 50, a memory 51 and a computer program 52 stored in said memory 51 and executable on said processor 50, such as a capacity expansion method program applied to a super-fusion integrator. The processor 50, when executing the computer program 52, implements the above-mentioned steps in each embodiment of the capacity expansion method applied to the super-fusion all-in-one machine, such as steps 101 to 102 shown in fig. 3. Alternatively, the processor 50, when executing the computer program 52, implements the functions of the units in the above-described device embodiments, such as the functions of the modules 41 to 42 shown in fig. 4.
Illustratively, the computer program 52 may be partitioned into one or more modules/units that are stored in the memory 51 and executed by the processor 50 to implement the present invention. The one or more modules/units may be a series of computer program instruction segments capable of performing specific functions, which are used to describe the execution process of the computer program 52 in the capacity expansion apparatus 5 of the super-fusion kiosk. For example, the computer program 52 may be divided into an analysis unit and an extension unit, and the specific functions of each unit are as follows:
the analysis unit is used for analyzing the resource use information in the calculation module and the storage module in the super-fusion all-in-one machine to obtain corresponding resource occupation information; the resource usage information comprises the operation usage rate of the computing module and the storage occupancy rate of the storage module.
And the expansion unit is used for determining whether the storage capacity needs to be expanded or not according to the resource occupation information and performing longitudinal capacity expansion or transverse capacity expansion on the external storage capacity when the storage capacity needs to be expanded.
Wherein the longitudinal capacity expansion is: data backup and/or data migration are/is carried out among a plurality of super-fusion all-in-one machines in the same super-fusion node; the lateral capacity is expanded to: and when the number of the super-fusion nodes is more than one, carrying out data migration between different super-fusion nodes.
The capacity expansion device 5 of the super-fusion all-in-one machine can be a desktop computer, a notebook computer, a palm computer, a cloud server and other computing equipment. The capacity expansion device of the super-fusion all-in-one machine can include, but is not limited to, a processor 50 and a memory 51. Those skilled in the art will appreciate that fig. 5 is only an example of the capacity expansion apparatus of the super-convergence all-in-one machine, and does not constitute a limitation to the capacity expansion apparatus of the super-convergence all-in-one machine, and may include more or less components than those shown in the drawings, or combine some components, or different components, for example, the capacity expansion apparatus of the super-convergence all-in-one machine may further include an input/output device, a network access device, a bus, and the like.
The Processor 50 may be a Central Processing Unit (CPU), other general purpose Processor, a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), an off-the-shelf Programmable Gate Array (FPGA) or other Programmable logic device, discrete Gate or transistor logic, discrete hardware components, etc. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like.
The memory 51 may be an internal storage unit of the capacity expansion device 5 of the super-convergence all-in-one machine, for example, a hard disk or a memory of the capacity expansion device 5 of the super-convergence all-in-one machine. The memory 51 may also be an external storage device of the capacity expansion device 5 of the super-convergence all-in-one machine, for example, a plug-in hard disk, a Smart Media Card (SMC), a Secure Digital (SD) Card, a Flash memory Card (Flash Card), and the like, which are equipped on the capacity expansion device 5 of the super-convergence all-in-one machine. Further, the memory 51 may also include both an internal storage unit and an external storage device of the capacity expansion apparatus 5 of the super-fusion all-in-one machine. The memory 51 is used for storing the computer program and other programs and data required by the capacity expansion device of the super-fusion all-in-one machine. The memory 51 may also be used to temporarily store data that has been output or is to be output.
It should be understood that, the sequence numbers of the steps in the foregoing embodiments do not imply an execution sequence, and the execution sequence of each process should be determined by its function and inherent logic, and should not constitute any limitation to the implementation process of the embodiments of the present invention.
It will be apparent to those skilled in the art that, for convenience and brevity of description, only the above-mentioned division of the functional units and modules is illustrated, and in practical applications, the above-mentioned function distribution may be performed by different functional units and modules according to needs, that is, the internal structure of the apparatus is divided into different functional units or modules to perform all or part of the above-mentioned functions. Each functional unit and module in the embodiments may be integrated in one processing unit, or each unit may exist alone physically, or two or more units are integrated in one unit, and the integrated unit may be implemented in a form of hardware, or in a form of software functional unit. In addition, specific names of the functional units and modules are only for convenience of distinguishing from each other, and are not used for limiting the protection scope of the present application. The specific working processes of the units and modules in the system may refer to the corresponding processes in the foregoing method embodiments, and are not described herein again.
In the above embodiments, the descriptions of the respective embodiments have respective emphasis, and reference may be made to the related descriptions of other embodiments for parts that are not described or illustrated in a certain embodiment.
Those of ordinary skill in the art will appreciate that the various illustrative elements and algorithm steps described in connection with the embodiments disclosed herein may be implemented as electronic hardware or combinations of computer software and electronic hardware. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the implementation. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present invention.
In the embodiments provided in the present invention, it should be understood that the disclosed apparatus/terminal device and method may be implemented in other ways. For example, the above-described embodiments of the apparatus/terminal device are merely illustrative, and for example, the division of the modules or units is only one logical division, and there may be other divisions when actually implemented, for example, a plurality of units or components may be combined or integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, devices or units, and may be in an electrical, mechanical or other form.
The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.
In addition, functional units in the embodiments of the present invention may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit. The integrated unit can be realized in a form of hardware, and can also be realized in a form of a software functional unit.
The integrated modules/units, if implemented in the form of software functional units and sold or used as separate products, may be stored in a computer readable storage medium. Based on such understanding, all or part of the flow of the method according to the embodiments of the present invention may also be implemented by a computer program, which may be stored in a computer-readable storage medium, and when the computer program is executed by a processor, the steps of the method embodiments may be implemented. Wherein the computer program comprises computer program code, which may be in the form of source code, object code, an executable file or some intermediate form, etc. The computer-readable medium may include: any entity or device capable of carrying the computer program code, recording medium, usb disk, removable hard disk, magnetic disk, optical disk, computer Memory, Read-Only Memory (ROM), Random Access Memory (RAM), electrical carrier wave signals, telecommunications signals, software distribution medium, and the like. It should be noted that the computer readable medium may contain content that is subject to appropriate increase or decrease as required by legislation and patent practice in jurisdictions, for example, in some jurisdictions, computer readable media does not include electrical carrier signals and telecommunications signals as is required by legislation and patent practice.
The above-mentioned embodiments are only used for illustrating the technical solutions of the present invention, and not for limiting the same; although the present invention has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some technical features may be equivalently replaced; such modifications and substitutions do not substantially depart from the spirit and scope of the embodiments of the present invention, and are intended to be included within the scope of the present invention.
Claims (7)
1. A storage capacity expansion method of a super-fusion all-in-one machine is characterized in that a plurality of super-fusion all-in-one machines belong to a super-fusion node; the storage capacity expansion method is characterized by comprising the following steps:
analyzing the resource use information in a computing module and a storage module in the super-fusion all-in-one machine to obtain corresponding resource occupation information; the resource use information comprises the operation use rate of the computing module and the storage occupancy rate of the storage module; determining whether the storage capacity needs to be expanded or not according to the resource occupation information, and performing longitudinal capacity expansion or transverse capacity expansion on the external storage capacity when the storage capacity needs to be expanded;
the longitudinal capacity expansion is: migrating data in a storage module of a first super-fusion all-in-one machine to a storage module of a second super-fusion all-in-one machine for backup, and migrating the data backed up to the storage module of the second super-fusion all-in-one machine to the storage module of the first super-fusion all-in-one machine after the capacity of the storage module of the first super-fusion all-in-one machine is expanded; the first super-fusion all-in-one machine and at least one second super-fusion all-in-one machine belong to a super-fusion node;
the lateral capacity is expanded to: and when the number of the super-fusion nodes is more than one, calculating the access frequency of the data in the storage module, and migrating the data with the access frequency lower than the preset frequency in the storage module to an external super-fusion all-in-one machine.
2. The method for expanding the storage capacity according to claim 1, wherein the determining whether the super-fusion all-in-one machine needs to perform storage capacity expansion according to the resource occupation information, and performing longitudinal capacity expansion or transverse capacity expansion on the super-fusion all-in-one machine when the storage capacity expansion is needed, specifically:
determining the comprehensive resource occupancy rate of the current super-fusion all-in-one machine according to the resource use information;
when the comprehensive resource occupancy rate is greater than the preset occupancy rate, judging whether the super-fusion all-in-one machines except the current super-fusion all-in-one machine in the super-fusion node meet longitudinal extension conditions or not;
if so, controlling the storage module to perform longitudinal capacity expansion on the super-fusion all-in-one machines except the current super-fusion all-in-one machine in the super-fusion node;
and if not, controlling the storage module to perform transverse capacity expansion on the external super-fusion node.
3. A storage capacity expansion method according to claim 1 or 2, characterized in that the lateral capacity expansion is specifically:
migrating data in a storage module of a first super-fusion all-in-one machine to a storage module of a second super-fusion all-in-one machine; the first super-fusion all-in-one machine and the second super-fusion all-in-one machine belong to a super-fusion node.
4. A storage capacity expansion device of a super-fusion all-in-one machine comprises:
the analysis unit is used for analyzing the resource use information in the calculation module and the storage module in the super-fusion all-in-one machine to obtain corresponding resource occupation information; the resource use information comprises the operation use rate of the computing module and the storage occupancy rate of the storage module;
the expansion unit is used for determining whether the storage capacity needs to be expanded or not according to the resource occupation information and performing longitudinal capacity expansion or transverse capacity expansion on the external storage capacity when the storage capacity needs to be expanded;
the extension unit further includes: the computing unit is used for computing the access frequency of the data in the storage module;
the migration unit is used for migrating the data with the access frequency lower than the preset frequency in the storage module to an external hyper-fusion all-in-one machine;
the longitudinal capacity expansion is: migrating data in a storage module of a first super-fusion all-in-one machine to a storage module of a second super-fusion all-in-one machine for backup, migrating the data backed up to the storage module of the second super-fusion all-in-one machine to the storage module of the first super-fusion all-in-one machine after capacity amplification after the capacity of the storage module of the first super-fusion all-in-one machine is amplified, wherein the first super-fusion all-in-one machine and at least one second super-fusion all-in-one machine belong to a super-fusion node;
the lateral capacity is expanded to: calculating the access frequency of the data in the storage module; and migrating the data with the access frequency lower than the preset frequency in the storage module to an external hyper-fusion all-in-one machine.
5. The device for expanding the storage capacity of the hyper-fusion integrated machine according to claim 4, wherein the expanding unit comprises:
the determining subunit is used for determining the comprehensive resource occupancy rate of the current super-fusion all-in-one machine according to the resource use information;
the judging subunit is used for judging whether the super-fusion all-in-one machines except the current super-fusion all-in-one machine in the super-fusion node meet longitudinal extension conditions or not when the comprehensive occupancy rate of the resources is greater than a preset occupancy rate;
the longitudinal capacity expansion subunit is used for controlling the storage module to perform longitudinal capacity expansion on the super-fusion all-in-one machines except the current super-fusion all-in-one machine in the super-fusion node if the capacity expansion subunit is in the longitudinal capacity expansion state;
and the transverse capacity expansion subunit is used for controlling the storage module to perform transverse capacity expansion on the external super-fusion node if the storage module does not perform transverse capacity expansion on the external super-fusion node.
6. A hyper-fusion kiosk comprising a memory, a processor and a computer program stored in said memory and executable on said processor, characterized in that said processor implements the steps of the method according to any of claims 1 to 3 when executing said computer program.
7. A computer-readable storage medium, in which a computer program is stored which, when being executed by a processor, carries out the steps of the method according to any one of claims 1 to 3.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910145614.1A CN109947531B (en) | 2019-02-27 | 2019-02-27 | Storage capacity expansion method and device of super-fusion all-in-one machine and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910145614.1A CN109947531B (en) | 2019-02-27 | 2019-02-27 | Storage capacity expansion method and device of super-fusion all-in-one machine and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN109947531A CN109947531A (en) | 2019-06-28 |
| CN109947531B true CN109947531B (en) | 2021-05-07 |
Family
ID=67007028
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910145614.1A Active CN109947531B (en) | 2019-02-27 | 2019-02-27 | Storage capacity expansion method and device of super-fusion all-in-one machine and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109947531B (en) |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112532440B (en) * | 2020-11-24 | 2022-10-21 | 北京金山云网络技术有限公司 | Super-fusion node expansion method and device, storage medium and electronic equipment |
| CN114924880B (en) * | 2022-05-20 | 2023-03-24 | 创新科信息技术(北京)有限公司 | Workload distribution method, device, equipment and readable storage medium |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105847352A (en) * | 2016-03-22 | 2016-08-10 | 青岛海信传媒网络技术有限公司 | Distributed cache system-based capacity expansion method, device and distributed cache system |
| CN105892952A (en) * | 2016-04-22 | 2016-08-24 | 深圳市深信服电子科技有限公司 | Hyper-converged system and longitudinal extension method thereof |
| CN107037985A (en) * | 2017-02-14 | 2017-08-11 | 中山大学 | The super fusion integrated machine system of one kind and its horizontal and vertical expansion method |
| CN107145393A (en) * | 2017-04-27 | 2017-09-08 | 努比亚技术有限公司 | A kind of load regulation method, equipment and computer-readable recording medium |
| CN107357896A (en) * | 2017-07-13 | 2017-11-17 | 北京小度信息科技有限公司 | Expansion method, device, system and the data base cluster system of data-base cluster |
Family Cites Families (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104317638A (en) * | 2014-10-17 | 2015-01-28 | 华为技术有限公司 | Application stretching management method and device |
| CN106326002B (en) * | 2015-07-10 | 2020-10-20 | 阿里巴巴集团控股有限公司 | Resource scheduling method, device and equipment |
-
2019
- 2019-02-27 CN CN201910145614.1A patent/CN109947531B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105847352A (en) * | 2016-03-22 | 2016-08-10 | 青岛海信传媒网络技术有限公司 | Distributed cache system-based capacity expansion method, device and distributed cache system |
| CN105892952A (en) * | 2016-04-22 | 2016-08-24 | 深圳市深信服电子科技有限公司 | Hyper-converged system and longitudinal extension method thereof |
| CN107037985A (en) * | 2017-02-14 | 2017-08-11 | 中山大学 | The super fusion integrated machine system of one kind and its horizontal and vertical expansion method |
| CN107145393A (en) * | 2017-04-27 | 2017-09-08 | 努比亚技术有限公司 | A kind of load regulation method, equipment and computer-readable recording medium |
| CN107357896A (en) * | 2017-07-13 | 2017-11-17 | 北京小度信息科技有限公司 | Expansion method, device, system and the data base cluster system of data-base cluster |
Also Published As
| Publication number | Publication date |
|---|---|
| CN109947531A (en) | 2019-06-28 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN104270416B (en) | Control method for equalizing load and management node | |
| CN105159610B (en) | Large-scale data processing system and method | |
| US8898422B2 (en) | Workload-aware distributed data processing apparatus and method for processing large data based on hardware acceleration | |
| EP3852335A1 (en) | Method and system for modifying blockchain network configuration | |
| CN108549583A (en) | Big data processing method, device, server and readable storage medium storing program for executing | |
| US20120323821A1 (en) | Methods for billing for data storage in a tiered data storage system | |
| CN109947531B (en) | Storage capacity expansion method and device of super-fusion all-in-one machine and storage medium | |
| CN104461698A (en) | Dynamic virtual disk mounting method, virtual disk management device and distributed storage system | |
| CN104571956A (en) | Data writing method and splitting device | |
| CN108665272A (en) | Block chain data processing method, device, equipment and storage medium | |
| CN105808443A (en) | Data migration method, apparatus and system | |
| CN104243531A (en) | Data processing method, device and system | |
| CN115880132A (en) | Graphics processor, matrix multiplication task processing method, device and storage medium | |
| CN105302536A (en) | Configuration method and apparatus for related parameters of MapReduce application | |
| US9104496B2 (en) | Submitting operations to a shared resource based on busy-to-success ratios | |
| US11023825B2 (en) | Platform as a service cloud server and machine learning data processing method thereof | |
| CN104468240A (en) | Cloud terminal management method and device | |
| CN104969167A (en) | Control device and control method | |
| CN109951531B (en) | Super-fusion cloud computing system | |
| CN104268089B (en) | The method, apparatus and system of a kind of information updating | |
| CN104657216A (en) | Resource allocation method and device for resource pool | |
| CN111722923A (en) | Heterogeneous resource calling method and device and computer readable storage medium | |
| CN107301459A (en) | A kind of method and system that genetic algorithm is run based on FPGA isomeries | |
| US9372636B1 (en) | Tiered-storage design | |
| CN105471986A (en) | Data center construction scale assessment method and apparatus |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |