CN113590029B - Disk space allocation method, system, storage medium and equipment - Google Patents
Disk space allocation method, system, storage medium and equipment Download PDFInfo
- Publication number
- CN113590029B CN113590029B CN202110739003.7A CN202110739003A CN113590029B CN 113590029 B CN113590029 B CN 113590029B CN 202110739003 A CN202110739003 A CN 202110739003A CN 113590029 B CN113590029 B CN 113590029B
- Authority
- CN
- China
- Prior art keywords
- module
- modules
- preset
- data
- storage module
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 38
- 238000013500 data storage Methods 0.000 claims abstract description 61
- 238000012544 monitoring process Methods 0.000 claims description 10
- 238000004590 computer program Methods 0.000 claims description 7
- 230000004044 response Effects 0.000 abstract description 10
- 238000007726 management method Methods 0.000 description 10
- 238000005516 engineering process Methods 0.000 description 8
- 238000010586 diagram Methods 0.000 description 6
- 230000006870 function Effects 0.000 description 6
- 230000008569 process Effects 0.000 description 6
- 230000008901 benefit Effects 0.000 description 4
- 238000012545 processing Methods 0.000 description 4
- 238000004458 analytical method Methods 0.000 description 3
- 238000005192 partition Methods 0.000 description 3
- 230000001360 synchronised effect Effects 0.000 description 3
- 230000000694 effects Effects 0.000 description 2
- 230000014509 gene expression Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000012546 transfer Methods 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 238000007405 data analysis Methods 0.000 description 1
- 238000007418 data mining Methods 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 239000000835 fiber Substances 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 238000012423 maintenance Methods 0.000 description 1
- 238000005065 mining Methods 0.000 description 1
- 238000010295 mobile communication Methods 0.000 description 1
- 238000000638 solvent extraction Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
- G06F3/0604—Improving or facilitating administration, e.g. storage management
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
- G06F3/0638—Organizing or formatting or addressing of data
- G06F3/0644—Management of space entities, e.g. partitions, extents, pools
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0668—Interfaces specially adapted for storage systems adopting a particular infrastructure
- G06F3/067—Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D10/00—Energy efficient computing, e.g. low power processors, power management or thermal management
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention provides a disk space allocation method, a system, a storage medium and equipment, wherein the method comprises the following steps: acquiring names of a plurality of modules of a storage cluster, and acquiring respective preset allocation proportions based on the names of the modules; in response to the acquired name of the data storage module and the preset allocation proportion thereof, judging whether the data storage module needs a high-speed data pool or not according to the service scene of the data storage module; responding to the requirement of the data storage module on the high-speed data pool, and acquiring a preset allocation proportion of the high-speed data pool; in response to the names of other modules and the preset allocation proportion thereof, selecting corresponding levels according to the use scenes of the other modules and acquiring the preset allocation proportion corresponding to the levels; and distributing the disk space based on the preset distribution proportion corresponding to the level of the obtained high-speed data pool and other modules. The invention comprehensively distributes the storage resources in the storage clusters, provides effective support for the deployment of the disk resources, and achieves the purposes of fully utilizing the disk resources and improving the performance of the storage system.
Description
Technical Field
The present invention relates to the field of storage technologies, and in particular, to a method, a system, a storage medium, and an apparatus for allocating disk space.
Background
Distributed storage is currently a widely used storage technology. Distributed storage is a data storage technology that uses disk space on each machine in an enterprise over a network and forms these dispersed storage resources into a virtual storage device, with data being stored dispersed at various corners of the enterprise. The distributed network storage system adopts an expandable system structure, utilizes a plurality of storage servers to share the storage load, and utilizes the position servers to position the storage information, thereby improving the reliability, availability and access efficiency of the system and being easy to expand.
In the current distributed storage deployment process, because the high-speed disk resources of each node in the storage cluster are limited, deployment personnel are required to manually divide each high-speed disk partition, and then each high-speed disk partition is allocated to a part requiring the use of the high-speed resources for use. However, the use scenarios of the storage systems are different, and the specific partitioning scheme of the high-speed disk is often a difficult task to determine in the deployment process. At present, a plurality of fixed division schemes are mainly provided, and division is selected according to the main use scene of the storage system, so that great inconvenience is brought to management of the storage system.
Disclosure of Invention
In view of the above, the present invention aims to provide a disk space allocation method, a system, a storage medium and a device, which are used for solving the problem of improper disk resource management in the storage cluster deployment process in the prior art.
Based on the above object, the present invention provides a disk space allocation method, comprising the following steps:
acquiring names of a plurality of modules of a storage cluster, and acquiring respective preset allocation proportions based on the names of the modules;
in response to the acquired name of the data storage module and the preset allocation proportion thereof, judging whether the data storage module needs a high-speed data pool or not according to the service scene of the data storage module;
responding to the requirement of the data storage module on the high-speed data pool, and acquiring a preset allocation proportion of the high-speed data pool;
in response to the names of other modules and the preset allocation proportion thereof, selecting corresponding levels according to the use scenes of the other modules and acquiring the preset allocation proportion corresponding to the levels;
and distributing the disk space based on the preset distribution proportion corresponding to the level of the obtained high-speed data pool and other modules.
In some embodiments, determining whether the data storage module requires a high-speed data pool based on its service scenario includes:
judging whether the service scene of the data storage module aims at file storage, object storage or block storage;
responding to the service scene of the data storage module to store files or objects, and confirming that the data storage module needs a high-speed data pool;
in response to a service scenario of the data storage module being for block storage, it is confirmed that the data storage module does not require a high-speed data pool.
In some embodiments, the other modules include a monitoring module and/or a data caching module and/or a logging module.
In some embodiments, selecting a corresponding level according to the usage scenario of the other module and obtaining a preset allocation proportion corresponding to the level includes:
judging whether an application scene of the monitoring module belongs to big data, virtualization or cloud computing;
and selecting a corresponding level based on the judging result and acquiring a corresponding preset distribution proportion.
In some embodiments, selecting a corresponding level according to the usage scenario of the other module and obtaining the preset allocation proportion corresponding to the level further includes:
judging whether the data media type of the data cache module belongs to text, pictures, audio or video;
and selecting a corresponding level based on the judging result and acquiring a corresponding preset distribution proportion.
In some embodiments, selecting a corresponding level according to the usage scenario of the other module and obtaining the preset allocation proportion corresponding to the level further includes:
and acquiring a corresponding preset distribution proportion according to the preset data level to which the data quantity recorded by the log module belongs.
In some embodiments, allocating disk space based on the level-corresponding preset allocation proportion of the acquired high-speed data pool and other modules comprises:
and distributing the disk space of the disk with the rotating speed exceeding a preset threshold value based on the preset distribution proportion corresponding to the level of the obtained high-speed data pool and other modules.
In another aspect of the present invention, there is also provided a disk space allocation system, including:
the first acquisition module is configured to acquire names of a plurality of modules of the storage cluster, and acquire respective preset allocation proportions based on the names of the modules;
the judging module is configured to respond to the acquired name of the data storage module and the preset allocation proportion thereof, and judge whether the data storage module needs a high-speed data pool or not according to the service scene of the data storage module;
the second acquisition module is configured to acquire a preset allocation proportion of the high-speed data pool in response to the high-speed data pool needed by the data storage module;
the third acquisition module is configured to respond to the acquired names and preset allocation proportions of other modules, select corresponding levels according to the use scenes of the other modules and acquire the preset allocation proportions corresponding to the levels; and
and the disk space allocation module is configured to allocate disk space based on the preset allocation proportion corresponding to the level of the acquired high-speed data pool and other modules.
In yet another aspect of the present invention, there is also provided a computer readable storage medium storing computer program instructions which, when executed, implement any of the methods described above.
In yet another aspect of the present invention, there is also provided a computer device comprising a memory and a processor, the memory storing a computer program which, when executed by the processor, performs any of the methods described above.
The invention has at least the following beneficial technical effects:
the invention sets a plurality of modules with management functions in the storage cluster in advance, sets the allocation proportion of the disk space for each module in advance, and selects the corresponding preset allocation proportion through different application scenes of each module so as to comprehensively allocate and manage the storage resources in the storage cluster, thereby providing effective support for the deployment work of the disk resources and further achieving the purposes of fully utilizing the disk resources and improving the read-write performance of the storage system.
Drawings
In order to more clearly illustrate the embodiments of the invention or the technical solutions in the prior art, the drawings that are necessary for the description of the embodiments or the prior art will be briefly described, it being obvious that the drawings in the following description are only some embodiments of the invention and that other embodiments may be obtained according to these drawings without inventive effort for a person skilled in the art.
FIG. 1 is a schematic diagram of a disk space allocation method according to an embodiment of the present invention;
FIG. 2 is a schematic diagram of a disk space allocation system according to an embodiment of the present invention;
FIG. 3 is a schematic diagram of a computer readable storage medium implementing a disk space allocation method according to an embodiment of the present invention;
fig. 4 is a schematic hardware structure of a computer device for performing a disk space allocation method according to an embodiment of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention more apparent, the following embodiments of the present invention will be described in further detail with reference to the accompanying drawings.
It should be noted that, in the embodiments of the present invention, all the expressions "first" and "second" are used to distinguish two non-identical entities with the same name or non-identical parameters, and it is noted that the "first" and "second" are only used for convenience of expression, and should not be construed as limiting the embodiments of the present invention. Furthermore, the terms "comprise" and "have," and any variations thereof, are intended to cover a non-exclusive inclusion, such as a process, method, system, article, or other step or unit that comprises a list of steps or units.
In view of the above object, a first aspect of the embodiments of the present invention proposes an embodiment of a disk space allocation method. Fig. 1 is a schematic diagram of an embodiment of a disk space allocation method provided by the present invention. As shown in fig. 1, the embodiment of the present invention includes the following steps:
step S10, acquiring names of a plurality of modules of a storage cluster, and acquiring respective preset allocation proportions based on the names of the modules;
step S20, judging whether the data storage module needs a high-speed data pool or not according to the service scene of the data storage module in response to the acquired name of the data storage module and the preset distribution proportion thereof;
step S30, responding to the requirement of the data storage module for the high-speed data pool, and acquiring a preset allocation proportion of the high-speed data pool;
step S40, responding to the obtained names of other modules and the preset allocation proportion thereof, selecting corresponding levels according to the use scenes of the other modules and obtaining the preset allocation proportion corresponding to the levels;
and S50, distributing the disk space based on the preset distribution proportion corresponding to the level of the acquired high-speed data pool and other modules.
The embodiment of the invention is mainly applied to a distributed storage cluster, and a storage system is built by adopting a cluster storage mode. The cluster storage mode is to aggregate storage spaces in a plurality of storage devices into a storage pool capable of providing a unified access interface and a management interface for an application server, and the application can access and utilize the disks on all the storage devices through the access interface transparently, so that the performance and the disk utilization rate of the storage devices can be fully exerted, and data can be stored and read from the plurality of storage devices according to a certain rule, so that higher concurrent access performance is obtained.
In a storage cluster, disk resources may be applied to management aspects of a storage system in addition to storing data by a user. The embodiment of the invention sets a plurality of modules with management functions in the storage cluster in advance, sets the allocation proportion of the disk space for each module in advance, and selects the corresponding preset allocation proportion through different application scenes of each module so as to comprehensively allocate and manage the storage resources in the storage cluster, thereby providing effective support for the deployment work of the disk resources and further achieving the aims of fully utilizing the disk resources and improving the read-write performance of the storage system.
In some embodiments, determining whether the data storage module requires a high-speed data pool based on its service scenario includes: judging whether the service scene of the data storage module aims at file storage, object storage or block storage; responding to the service scene of the data storage module to store files or objects, and confirming that the data storage module needs a high-speed data pool; in response to a service scenario of the data storage module being for block storage, it is confirmed that the data storage module does not require a high-speed data pool.
In this embodiment, metadata needs to be written in file storage and object storage, and metadata is written in a high-speed data pool, so that storage efficiency can be improved. The block storage does not require a high-speed data pool.
The data of the block store is stored in a fixed length block or blocks, the block store is suitable for use in an enterprise storage environment and typically uses a fibre channel or iSCSI interface, the block store requires an application to map the locations on the storage device where the data blocks are stored. The storage of blocks in storage area networks and software defined storage systems is virtual, which is an abstract logical device on a shared hardware infrastructure that is created and exists on servers, virtual servers, or running on a hypervisor based on protocols like SCSI, SATA, etc. Block storage partitions a single storage volume (e.g., a virtual or cloud storage node, or an old hard disk) into separate entities called blocks. Each block exists independently and can be formatted with its own data transfer protocol and operating system. Since the block storage system is not responsible for file lookup responsibilities like a file storage system, block storage is a very fast storage system.
File storage uses a file system to map storage locations for data on a storage device. It needs to do two things: the data is organized and presented to the user. When file storage is used, the storage mode of the data on the server side is identical to that seen by the client user. This allows the user to request a file via some unique identifier (like a file name, location, or URL) and communicate with the storage system using a specific data transfer protocol. The result is a hierarchical file structure that enables browsing from top to bottom. The file store is above the block store, allowing users to view and access data such as files, folders, but is restricted from accessing blocks of data that underlie those files and folders. File storage is commonly used on shared file systems where many servers, such as NFS and CIFS/SMB, access over IP networks.
Object storage provides a repository for unstructured data that separates content from an index and allows multiple files to be attached to an object. An object is a block of data paired with any associated metadata that provides the context of the bytes contained in the object (e.g., data creation time and data size, etc.). That is, the data and metadata constitute one object. One benefit of object storage is that each data block is associated with a unique identifier. Accessing the data requires a unique identifier and does not require the application or user to know the actual storage location of the data. The object data is accessed through the API. The data stored in the object is uncompressed and encrypted, and the object itself is organized in object stores (a central repository filled with other objects) or containers (a package containing all files needed for application execution). In contrast to the hierarchical structure of file storage systems, objects, object stores, and containers are planar in nature, which makes them very fast to access when the storage scale is large.
In some embodiments, the other modules include a monitoring module and/or a data caching module and/or a logging module.
In some embodiments, selecting a corresponding level according to the usage scenario of the other module and obtaining a preset allocation proportion corresponding to the level includes: judging whether an application scene of the monitoring module belongs to big data, virtualization or cloud computing; and selecting a corresponding level based on the judging result and acquiring a corresponding preset distribution proportion.
In this embodiment, the big data application scenario uses a big data technology, which is a business model and a technical platform for managing and utilizing big data, and is responsible for solving the requirements of multiple aspects of collection, classification, processing, analysis, presentation, and the like of all data types. To achieve processing requirements for various aspects of collection, classification, analysis, presentation, etc. of large data, relying on hardware expansion to improve performance is very limited. At this time, cloud computing may be used. Cloud computing helps a big data platform to reduce complexity, simplify operation and maintenance, and improve resource activity and utilization efficiency. Cloud computing fuses the infrastructure such as hardware into intangible IT resources through service delivery based on a network, and realizes seamless, customized and telescopic delivery of IT services by means of load balancing, distributed computing, parallel computing, virtualization, network storage, unified management and other technical means. Cloud computing, like big data, has applications based on distributed computing. However, the big data is more demanding with the high performance computing and storage expansion (both horizontal and vertical) that clusters bring. By means of the cloud computing distributed system and the virtualized flexible allocation resources, the cloud computing distributed system can help various analysis, processing and mining of big data to provide efficient and flexible IT service support, and meets the requirements of user personalized/customized big data mining and analysis. The virtualization technology has strong correlation with the cloud computing technology, and the cloud computing technology depends on the virtualization technology to virtualize various resources and decouple hardware so as to facilitate management.
In some embodiments, selecting a corresponding level according to the usage scenario of the other module and obtaining the preset allocation proportion corresponding to the level further includes: judging whether the data media type of the data cache module belongs to text, pictures, audio or video; and selecting a corresponding level based on the judging result and acquiring a corresponding preset distribution proportion.
In this embodiment, the disk space used by the text, picture, audio and video media types increases sequentially, so that the preset allocation proportion of the corresponding level increases sequentially.
In some embodiments, selecting a corresponding level according to the usage scenario of the other module and obtaining the preset allocation proportion corresponding to the level further includes: and acquiring a corresponding preset distribution proportion according to the preset data level to which the data quantity recorded by the log module belongs.
In this embodiment, the data level includes millions, tens of millions, and billions. Millions of data amounts refer to the ability of a database to process transactions per second, i.e., to process millions of incremental and incremental data records per second.
In some embodiments, allocating disk space based on the level-corresponding preset allocation proportion of the acquired high-speed data pool and other modules comprises: and distributing the disk space of the disk with the rotating speed exceeding a preset threshold value based on the preset distribution proportion corresponding to the level of the obtained high-speed data pool and other modules.
In this embodiment, the allocation of the disk space specifically refers to allocation of the disk space of the high-speed disk. The disk with spin rate exceeding the preset threshold is set as a high speed disk, and the preset threshold may be 5400rpm, 7200rpm (revolutions per minute), or other spin rate value. The spin rate of a disk is the rotational speed of the spindle of the motor in the disk, i.e., the maximum number of revolutions that a disk platter can complete in one minute. The speed of rotation is one of the important parameters for marking the grade of the magnetic disk, and is one of the key factors for determining the internal transmission rate of the hard disk, so that the speed of the magnetic disk is directly influenced to a great extent. In the embodiment, the high-speed data pool, the monitoring module, the data cache module and the log module of the data storage module all need high-speed magnetic disks, so that high-performance resources of the storage cluster are effectively utilized, and the management performance of the storage cluster is further improved.
In a second aspect of the embodiment of the present invention, a disk space allocation system is also provided. FIG. 2 is a schematic diagram of an embodiment of a disk space allocation system provided by the present invention. As shown in fig. 2, a disk space allocation system includes: a first obtaining module 10, configured to obtain names of a plurality of modules of the storage cluster, and obtain respective preset allocation proportions based on the names of the modules; the judging module 20 is configured to respond to the acquired name of the data storage module and the preset allocation proportion thereof, and judge whether the data storage module needs a high-speed data pool according to the service scene of the data storage module; a second obtaining module 30 configured to obtain a preset allocation proportion of the high-speed data pool in response to the data storage module requiring the high-speed data pool; a third obtaining module 40, configured to respond to obtaining the names of other modules and the preset allocation proportion thereof, select a corresponding level according to the usage scenario of the other modules and obtain the preset allocation proportion corresponding to the level; and a disk space allocation module 50 configured to allocate disk space based on the obtained high-speed data pool and the preset allocation proportion corresponding to the level of the other modules.
According to the disk space distribution system provided by the embodiment of the invention, the plurality of modules with the management function in the storage cluster are preset, the distribution proportion of the disk space is preset for each module, and the corresponding preset distribution proportion is selected according to different application scenes of each module, so that the storage resources in the storage cluster are comprehensively distributed, the effective support is provided for the deployment work of the disk resources, and the purposes of fully utilizing the disk resources and improving the read-write performance of the storage system are further achieved.
In some embodiments, the determining module 20 includes a high-speed data pool determining module configured to determine whether a service scenario of the data storage module is for file storage, object storage, or block storage; responding to the service scene of the data storage module to store files or objects, and confirming that the data storage module needs a high-speed data pool; in response to a service scenario of the data storage module being for block storage, it is confirmed that the data storage module does not require a high-speed data pool.
In some embodiments, the other modules include a monitoring module and/or a data caching module and/or a logging module.
The third obtaining module 40 includes a monitoring module judging module configured to judge whether an application scenario of the monitoring module belongs to big data, virtualization, or cloud computing; and selecting a corresponding level based on the judging result and acquiring a corresponding preset distribution proportion.
In some embodiments, the third obtaining module 40 further includes a data buffer module determining module configured to determine whether the data media type of the data buffer module belongs to text, picture, audio or video; and selecting a corresponding level based on the judging result and acquiring a corresponding preset distribution proportion.
In some embodiments, the third obtaining module 40 further includes a log module determining module configured to obtain a corresponding preset allocation proportion according to a preset data level to which the data amount recorded by the log module belongs.
In some embodiments, the disk space allocation module 50 is further configured to allocate disk space for disks having a spin rate exceeding a preset threshold based on the obtained high-speed data pool and the preset allocation ratio corresponding to the level of other modules.
In a third aspect of the embodiment of the present invention, a computer readable storage medium is provided, and fig. 3 is a schematic diagram of a computer readable storage medium for implementing a disk space allocation method according to an embodiment of the present invention. As shown in fig. 3, the computer-readable storage medium 3 stores computer program instructions 31, which computer program instructions 31, when executed by a processor, implement the method of any of the embodiments described above.
It should be appreciated that all of the embodiments, features and advantages set forth above with respect to the disk space allocation method according to the present invention apply equally to the disk space allocation system and storage medium according to the present invention, without conflicting therewith.
In a fourth aspect of the embodiments of the present invention, there is also provided a computer device comprising a memory 402 and a processor 401, the memory storing a computer program which, when executed by the processor, implements the method of any of the embodiments described above.
Fig. 4 is a schematic hardware structure of an embodiment of a computer device for performing the disk space allocation method according to the present invention. Taking the example of a computer device as shown in fig. 4, a processor 401 and a memory 402 are included in the computer device, and may further include: an input device 403 and an output device 404. The processor 401, memory 402, input device 403, and output device 404 may be connected by a bus or otherwise, for example in fig. 4. The input device 403 may receive input numeric or character information and generate key signal inputs related to user settings and function control of the disk space allocation system. The output 404 may include a display device such as a display screen.
The memory 402 is used as a non-volatile computer readable storage medium, and may be used to store a non-volatile software program, a non-volatile computer executable program, and modules, such as program instructions/modules corresponding to the disk space allocation method in the embodiments of the present application. Memory 402 may include a storage program area that may store an operating system, at least one application program required for functionality, and a storage data area; the storage data area may store data created using the disk space allocation method, and the like. In addition, memory 402 may include high-speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other non-volatile solid-state storage device. In some embodiments, memory 402 may optionally include memory located remotely from processor 401, which may be connected to the local module via a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.
The processor 401 executes various functional applications of the server and data processing, that is, implements the disk space allocation method of the above-described method embodiment, by running nonvolatile software programs, instructions, and modules stored in the memory 402.
Finally, it should be noted that the computer-readable storage media (e.g., memory) herein can be either volatile memory or nonvolatile memory, or can include both volatile and nonvolatile memory. By way of example, and not limitation, nonvolatile memory can include Read Only Memory (ROM), programmable ROM (PROM), electrically Programmable ROM (EPROM), electrically Erasable Programmable ROM (EEPROM), or flash memory. Volatile memory can include Random Access Memory (RAM), which acts as external cache memory. By way of example, and not limitation, RAM may be available in a variety of forms such as synchronous RAM (DRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double data rate SDRAM (DDR SDRAM), enhanced SDRAM (ESDRAM), synchronous Link DRAM (SLDRAM), and Direct Rambus RAM (DRRAM). The storage devices of the disclosed aspects are intended to comprise, without being limited to, these and other suitable types of memory.
Those of skill would further appreciate that the various illustrative logical blocks, modules, circuits, and algorithm steps described in connection with the disclosure herein may be implemented as electronic hardware, computer software, or combinations of both. To clearly illustrate this interchangeability of hardware and software, various illustrative components, blocks, modules, circuits, and steps have been described above generally in terms of their functionality. Whether such functionality is implemented as software or hardware depends upon the particular application and design constraints imposed on the overall system. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present disclosure.
The various illustrative logical blocks, modules, and circuits described in connection with the disclosure herein may be implemented or performed with the following components designed to perform the functions herein: a general purpose processor, a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), a Field Programmable Gate Array (FPGA) or other programmable logic device, discrete gate or transistor logic, discrete hardware components, or any combination thereof. A general purpose processor may be a microprocessor, but in the alternative, the processor may be any conventional processor, controller, microcontroller, or state machine. A processor may also be implemented as a combination of computing devices, e.g., a combination of a DSP and a microprocessor, a plurality of microprocessors, one or more microprocessors in conjunction with a DSP and/or any other such configuration.
The foregoing is an exemplary embodiment of the present disclosure, but it should be noted that various changes and modifications could be made herein without departing from the scope of the disclosure as defined by the appended claims. The functions, steps and/or actions of the method claims in accordance with the disclosed embodiments described herein need not be performed in any particular order. Furthermore, although elements of the disclosed embodiments may be described or claimed in the singular, the plural is contemplated unless limitation to the singular is explicitly stated.
It should be understood that as used herein, the singular forms "a", "an", and "the" are intended to include the plural forms as well, unless the context clearly supports the exception. It should also be understood that "and/or" as used herein is meant to include any and all possible combinations of one or more of the associated listed items. The foregoing embodiment of the present invention has been disclosed with reference to the number of embodiments for the purpose of description only, and does not represent the advantages or disadvantages of the embodiments.
Those of ordinary skill in the art will appreciate that: the above discussion of any embodiment is merely exemplary and is not intended to imply that the scope of the disclosure of embodiments of the invention, including the claims, is limited to such examples; combinations of features of the above embodiments or in different embodiments are also possible within the idea of an embodiment of the invention, and many other variations of the different aspects of the embodiments of the invention as described above exist, which are not provided in detail for the sake of brevity. Therefore, any omission, modification, equivalent replacement, improvement, etc. of the embodiments should be included in the protection scope of the embodiments of the present invention.
Claims (8)
1. A disk space allocation method, comprising the steps of:
acquiring names of a plurality of modules of a storage cluster, and acquiring respective preset allocation proportions based on the names of the modules;
responding to the acquired name of the data storage module and the preset allocation proportion thereof, and judging whether the data storage module needs a high-speed data pool or not according to the service scene of the data storage module;
responding to the data storage module requiring a high-speed data pool, and acquiring a preset allocation proportion of the high-speed data pool;
responding to the obtained names of other modules and the preset allocation proportion thereof, selecting corresponding levels according to the use scenes of the other modules and obtaining the preset allocation proportion corresponding to the levels;
distributing disk space based on the obtained preset distribution proportion corresponding to the levels of the high-speed data pool and other modules;
wherein, judging whether the data storage module needs a high-speed data pool according to the service scene of the data storage module comprises: judging whether the service scene of the data storage module aims at file storage, object storage or block storage; responding to the service scene of the data storage module to aim at file storage or object storage, and confirming that the data storage module needs a high-speed data pool; responsive to a service scenario of the data storage module for block storage, confirming that the data storage module does not require a high-speed data pool;
the allocation of the disk space based on the obtained preset allocation proportion corresponding to the level of the high-speed data pool and other modules comprises the following steps: and distributing the disk space of the disk with the rotating speed exceeding a preset threshold value based on the obtained preset distribution proportion corresponding to the levels of the high-speed data pool and other modules.
2. The method according to claim 1, wherein the other modules comprise a monitoring module and/or a data caching module and/or a logging module.
3. The method of claim 2, wherein selecting a corresponding level according to the usage scenario of the other module and obtaining a preset allocation proportion corresponding to the level comprises:
judging whether an application scene of the monitoring module belongs to big data, virtualization or cloud computing;
and selecting a corresponding level based on the judging result and acquiring a corresponding preset distribution proportion.
4. The method of claim 2, wherein selecting a corresponding level according to the usage scenario of the other module and obtaining a preset allocation proportion corresponding to the level further comprises:
judging whether the data media type of the data cache module belongs to text, pictures, audio or video;
and selecting a corresponding level based on the judging result and acquiring a corresponding preset distribution proportion.
5. The method of claim 2, wherein selecting a corresponding level according to the usage scenario of the other module and obtaining a preset allocation proportion corresponding to the level further comprises:
and acquiring a corresponding preset distribution proportion according to the preset data level to which the data quantity recorded by the log module belongs.
6. A disk space allocation system, comprising:
the first acquisition module is configured to acquire names of a plurality of modules of the storage cluster, and acquire respective preset allocation proportions based on the names of the modules;
the judging module is configured to respond to the acquired name of the data storage module and the preset allocation proportion thereof, and judge whether the data storage module needs a high-speed data pool or not according to the service scene of the data storage module;
the second acquisition module is configured to respond to the high-speed data pool required by the data storage module and acquire the preset allocation proportion of the high-speed data pool;
the third acquisition module is configured to respond to the acquired names and preset allocation proportions of other modules, select corresponding levels according to the use scenes of the other modules and acquire the preset allocation proportions corresponding to the levels; and
the disk space allocation module is configured to allocate disk space based on the obtained preset allocation proportion corresponding to the levels of the high-speed data pool and other modules;
wherein, judging whether the data storage module needs a high-speed data pool according to the service scene of the data storage module comprises: judging whether the service scene of the data storage module aims at file storage, object storage or block storage; responding to the service scene of the data storage module to aim at file storage or object storage, and confirming that the data storage module needs a high-speed data pool; responsive to a service scenario of the data storage module for block storage, confirming that the data storage module does not require a high-speed data pool;
the allocation of the disk space based on the obtained preset allocation proportion corresponding to the level of the high-speed data pool and other modules comprises the following steps: and distributing the disk space of the disk with the rotating speed exceeding a preset threshold value based on the obtained preset distribution proportion corresponding to the levels of the high-speed data pool and other modules.
7. A computer readable storage medium, characterized in that computer program instructions are stored, which when executed implement the method of any of claims 1-5.
8. A computer device comprising a memory and a processor, wherein the memory has stored therein a computer program which, when executed by the processor, performs the method of any of claims 1-5.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110739003.7A CN113590029B (en) | 2021-06-30 | 2021-06-30 | Disk space allocation method, system, storage medium and equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110739003.7A CN113590029B (en) | 2021-06-30 | 2021-06-30 | Disk space allocation method, system, storage medium and equipment |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113590029A CN113590029A (en) | 2021-11-02 |
| CN113590029B true CN113590029B (en) | 2023-12-22 |
Family
ID=78245316
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110739003.7A Active CN113590029B (en) | 2021-06-30 | 2021-06-30 | Disk space allocation method, system, storage medium and equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113590029B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114579060A (en) * | 2022-03-22 | 2022-06-03 | 浙江大华技术股份有限公司 | Configuration method and device of disk quota, storage medium and electronic device |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103116552A (en) * | 2013-03-18 | 2013-05-22 | 华为技术有限公司 | Method and device for distributing storage space in distributed type storage system |
| CN110989936A (en) * | 2019-12-06 | 2020-04-10 | 深信服科技股份有限公司 | Storage space allocation method and device and storage medium |
Family Cites Families (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US9613052B2 (en) * | 2012-06-05 | 2017-04-04 | International Business Machines Corporation | Establishing trust within a cloud computing system |
| US10061528B2 (en) * | 2016-05-22 | 2018-08-28 | Vmware, Inc. | Disk assignment for multiple distributed computing clusters in a virtualized computing environment |
-
2021
- 2021-06-30 CN CN202110739003.7A patent/CN113590029B/en active Active
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103116552A (en) * | 2013-03-18 | 2013-05-22 | 华为技术有限公司 | Method and device for distributing storage space in distributed type storage system |
| CN110989936A (en) * | 2019-12-06 | 2020-04-10 | 深信服科技股份有限公司 | Storage space allocation method and device and storage medium |
Non-Patent Citations (1)
| Title |
|---|
| 分布式存储系统中用户磁盘空间分配策略;谭子军;何连跃;;计算机工程(09);全文 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113590029A (en) | 2021-11-02 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US9052962B2 (en) | Distributed storage of data in a cloud storage system | |
| US9348842B2 (en) | Virtualized data storage system optimizations | |
| CN102571916B (en) | A kind of framework of renting software of cloud memory space and method of operation | |
| US20170206025A1 (en) | Mapping systems and methods of an accelerated application-oriented middleware layer | |
| US11048591B1 (en) | Efficient name space organization in a global name space cluster | |
| US8996837B1 (en) | Providing multi-tenancy within a data storage apparatus | |
| US9727578B2 (en) | Coordinated access to a file system's shared storage using dynamic creation of file access layout | |
| AU2014311782B2 (en) | Scalable distributed storage architecture | |
| US10671606B2 (en) | Materialized query tables with shared data | |
| US10102210B2 (en) | Systems and methods for multi-threaded shadow migration | |
| CN105144121A (en) | Caching content addressable data chunks for storage virtualization | |
| US9612766B2 (en) | Systems and methods for shadow migration progress estimation | |
| US10579597B1 (en) | Data-tiering service with multiple cold tier quality of service levels | |
| US11442927B1 (en) | Storage performance-based distribution of deduplicated data to nodes within a clustered storage environment | |
| JP7004184B2 (en) | Computer implementation methods, computer program products, and systems for offloading tape processing to object storage. | |
| CN108427677B (en) | Object access method and device and electronic equipment | |
| US20170153909A1 (en) | Methods and Devices for Acquiring Data Using Virtual Machine and Host Machine | |
| CN111949210A (en) | Metadata storage method, system and storage medium in distributed storage system | |
| US10949107B1 (en) | Fragment filling for storage system with in-line compression | |
| CN113590029B (en) | Disk space allocation method, system, storage medium and equipment | |
| US11580078B2 (en) | Providing enhanced security for object access in object-based datastores | |
| US10452482B2 (en) | Systems and methods for continuously available network file system (NFS) state data | |
| CN114730307A (en) | Intelligent data pool | |
| CN114979114B (en) | Cloud application processing method and system | |
| US20200242086A1 (en) | Distribution of global namespace to achieve performance and capacity linear scaling in cluster filesystems |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |