CN108829352B - User quota method and system for distributed storage system - Google Patents
User quota method and system for distributed storage system Download PDFInfo
- Publication number
- CN108829352B CN108829352B CN201810573139.3A CN201810573139A CN108829352B CN 108829352 B CN108829352 B CN 108829352B CN 201810573139 A CN201810573139 A CN 201810573139A CN 108829352 B CN108829352 B CN 108829352B
- Authority
- CN
- China
- Prior art keywords
- user
- quota
- setting
- capacity
- user group
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 25
- 230000009471 action Effects 0.000 claims abstract description 33
- 238000012544 monitoring process Methods 0.000 claims abstract description 9
- 238000001514 detection method Methods 0.000 claims description 8
- 230000006872 improvement Effects 0.000 description 5
- 230000008569 process Effects 0.000 description 5
- 238000010586 diagram Methods 0.000 description 4
- 230000007246 mechanism Effects 0.000 description 2
- 230000008859 change Effects 0.000 description 1
- 238000012217 deletion Methods 0.000 description 1
- 230000037430 deletion Effects 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 238000007726 management method Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004044 response Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
- G06F3/0629—Configuration or reconfiguration of storage systems
- G06F3/0631—Configuration or reconfiguration of storage systems by allocating resources to storage systems
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
- G06F3/0629—Configuration or reconfiguration of storage systems
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0668—Interfaces specially adapted for storage systems adopting a particular infrastructure
- G06F3/067—Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention relates to the technical field of storage, and provides a user quota method and a user quota system for a distributed storage system, wherein the method comprises the following steps: dynamically monitoring the usage amount of the storage space of the storage system by a user/user group; judging whether the used storage space is larger than a preset space capacity quota threshold or not, or the number of files contained in a user/user group is larger than a file number threshold; if so, judging whether the user/user group quota is opened; when the file is not opened, the file uploading action is continuously executed; when the file is opened, limiting the file uploading action of the user; when the value is less than or equal to the preset threshold value, the file uploading action is continuously executed, so that the problem of uneven use space of multiple users is solved, the overall utilization rate of storage system resources is improved, and the storage space is saved.
Description
Technical Field
The invention belongs to the technical field of storage, and particularly relates to a user quota method and a user quota system for a distributed storage system.
Background
A distributed storage system is used for storing data on a plurality of independent devices in a distributed mode. The traditional network storage system adopts a centralized storage server to store all data, the storage server becomes the bottleneck of the system performance, is also the focus of reliability and safety, and cannot meet the requirement of large-scale storage application. The distributed network storage system adopts an expandable system structure, utilizes a plurality of storage servers to share the storage load, and utilizes the position server to position the storage information, thereby not only improving the reliability, the availability and the access efficiency of the system, but also being easy to expand.
At present, the capacity of the whole distributed storage system is huge, and in the process of daily use of the storage system by users, the situation that individual users overuse storage resources to influence the use of other users often occurs.
Disclosure of Invention
The invention aims to provide a user quota method of a distributed storage system, and aims to solve the problems that in the prior art, the capacity of the whole distributed storage system is huge, and the situation that individual users excessively use storage resources to influence the use of other users frequently occurs in the daily use process of the storage system by the users.
The invention is realized in this way, a user quota method for a distributed storage system, the method comprising the following steps:
when a file uploading request of a user is received, dynamically monitoring the usage amount of a storage space of a storage system by the user/user group;
judging whether the storage space of the storage system used by the user/user group is larger than a preset space capacity quota threshold value or whether the number of files contained by the user/user group is larger than a preset file number threshold value;
when the storage space of the storage system used by the user/user group is judged to be larger than a preset space capacity quota threshold value, or the number of files contained by the user/user group is judged to be larger than a preset file number threshold value, judging whether the user/user group quota is opened;
when the user/user group quota is not opened, continuing to execute the uploading action of the file;
when the user/user group quota is opened, limiting the file uploading action of the user;
and when the storage space of the storage system used by the user/user group is judged to be less than or equal to a preset space capacity quota threshold value, or the number of files contained by the user/user group is judged to be less than or equal to a preset file number threshold value, continuing to execute the file uploading action.
As an improvement, the method further comprises the steps of:
quota setting is performed on the data volume or the number of files which can be written by the user/user group.
As an improved scheme, the step of setting a quota for a data volume or a file number writable by a user/user group specifically includes the following steps:
carrying out capacity quota setting on a user/user group, wherein the capacity quota setting is suitable for a large file scene;
setting a file number quota for a user/user group, wherein the file number quota setting is suitable for a small file scene;
the volume quota device and the file number quota setting comprise user quota setting and quota setting of a user group where the user is located.
As an improved scheme, when a user and one of user groups in which the user is located perform quota setting, only one quota detection is performed;
when the user and the user group in which the user is located are both quota set, quota detection is performed on both the user and the user group in which the user is located, and the quota is achieved to be effective firstly.
As an improvement, the method further comprises the steps of:
when the file uploading action of the user is limited, a quota increasing application request is sent to a metadata server;
and receiving the quota increasing application request at the metadata server, and increasing the quota by modifying a quota value.
Another object of the present invention is to provide a user quota system of a distributed storage system, the system comprising:
the usage dynamic monitoring module is used for dynamically monitoring the usage of the storage space of the storage system by the user/user group when receiving a file uploading request of the user;
a threshold judgment module, configured to judge whether a storage space of the storage system used by the user/user group is greater than a preset space quota threshold, or whether the number of files included in the user/user group is greater than a preset file number threshold;
the quota starting judging module is used for judging whether the user/user group quota is started or not when the storage space of the storage system used by the user/user group is judged to be larger than a preset space capacity quota threshold value or the number of files contained by the user/user group is judged to be larger than a preset file number threshold value;
the file uploading module is used for continuously executing the uploading action of the file when the user/user group quota is not opened;
the uploading action limiting module is used for limiting the file uploading action of the user when the user/user group quota is opened;
and when the storage space of the storage system used by the user/user group is judged to be less than or equal to a preset space capacity quota threshold value, or the number of files contained by the user/user group is judged to be less than or equal to a preset file number threshold value, continuing the file uploading action of the file uploading module.
As an improvement, the system further comprises:
and the quota setting module is used for carrying out quota setting on the writable data volume or the file number of the user/user group.
As an improved scheme, the quota setting module specifically includes:
the system comprises a capacity quota setting module, a capacity quota setting module and a capacity quota setting module, wherein the capacity quota setting module is used for setting a capacity quota for a user/user group, and the setting of the capacity quota is suitable for a large file scene;
the file number quota setting module is used for setting file number quotas for users/user groups, and the file number quota setting is suitable for small file scenes;
the volume quota device and the file number quota setting comprise user quota setting and quota setting of a user group where the user is located.
As an improved scheme, when a user and one of user groups in which the user is located perform quota setting, only one quota detection is performed;
when the user and the user group in which the user is located are both quota set, quota detection is performed on both the user and the user group in which the user is located, and the quota is achieved to be effective firstly.
As an improvement, the system further comprises:
a quota increasing request module, configured to send a quota increasing application request to the metadata server when limiting a file uploading action of the user;
and the quota increasing operation module is used for receiving the quota increasing application request at the metadata server and increasing the quota by modifying a quota value.
In the embodiment of the invention, the usage amount of the storage space of the storage system is dynamically monitored by a user/user group; judging whether the used storage space is larger than a preset space capacity quota threshold or not, or the number of files contained in a user/user group is larger than a file number threshold; if so, judging whether the user/user group quota is opened; when the file is not opened, the file uploading action is continuously executed; when the file is opened, limiting the file uploading action of the user; when the value is less than or equal to the preset threshold value, the file uploading action is continuously executed, so that the problem of uneven use space of multiple users is solved, the overall utilization rate of storage system resources is improved, and the storage space is saved.
Drawings
FIG. 1 is a flowchart illustrating an implementation of a user quota method for a distributed storage system according to the present invention;
FIG. 2 is a schematic diagram of a quota synchronization mechanism provided by the present invention;
fig. 3 is a block diagram illustrating a user quota system of a distributed storage system according to the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention more apparent, the present invention is described in further detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.
Fig. 1 shows a flowchart of an implementation of a user quota method of a distributed storage system provided in the present invention, which specifically includes the following steps:
in step S101, when a file upload request of a user is received, the usage amount of the storage space of the storage system is dynamically monitored for the user/user group.
In step S102, it is determined whether the storage space of the storage system used by the user/user group is greater than a preset space quota threshold, or the number of files included in the user/user group is greater than a preset threshold, if yes, step S103 is executed, otherwise, step S106 is executed.
In step S103, when it is determined that the storage space of the storage system used by the user/user group is greater than the preset space capacity quota threshold, or the number of files included in the user/user group is greater than the preset file number threshold, it is determined whether the user/user group quota is open, if so, step S104 is executed, otherwise, step S105 is executed.
In step S104, when the user/user group quota is not opened, the file uploading operation is continuously performed.
In step S105, when the user/user group quota is open, the file upload action of the user is limited.
In step S106, when it is determined that the storage space of the storage system used by the user/user group is less than or equal to the preset space quota threshold, or the number of files included in the user/user group is less than or equal to the preset file number threshold, the file uploading operation is continuously performed.
In this embodiment, before executing the above step S101, the following steps are also required to be executed:
carrying out quota setting on the writable data volume or the number of files of a user/user group, wherein the quota setting is the basis for effectively and efficiently managing the storage space of the distributed storage system, and the quota setting is developed from the following two aspects:
carrying out capacity quota setting on a user/user group, wherein the capacity quota setting is suitable for a large file scene;
setting a file number quota for a user/user group, wherein the file number quota setting is suitable for a small file scene;
the volume quota device and the file number quota setting comprise user quota setting and quota setting of a user group where the user is located.
In this embodiment, with reference to fig. 2, after the quota setting is performed on the storage capacity or the number of files, a corresponding quota synchronization mechanism needs to be performed, which is specifically implemented as follows:
(1) when the quota of the client A is changed or the user usage amount is reported, the client A sends a request to a metadata node;
(2) after receiving a request sent by a client A and modifying a quota value in a cache of a metadata node, the metadata node returns a response message to A; broadcasting the new quota value to other clients B and C to update the quota value, and controlling the quota value in a pre-application manner under other conditions without broadcasting;
(3) and in the application deletion process, the quota value is updated in a broadcasting mode, and the rest conditions are updated through file data change.
Based on the above understanding, for ease of understanding, a specific quota setting scheme for storage capacity of a storage system is given below:
1. rational planning of storage space for users/groups of users
Assuming that the total capacity of the storage space is 100TB, the administrator performs rational planning and allocates the storage space to the user group qutota _ group1 (meanwhile, the administrator may also perform quota setting for users in the user group, such as qutota _ guser1 and qutota _ guser2 … … qutota _ guser in the user group qutota _ group 1) 40TB, and reasonably plans capacity quotas of the users qutota _ user1, qutota _ user2 and qutota _ user3 … … qutota _ user and the like in the user group, so that the sum of all user quotas is less than or equal to 40TB, and resource control is achieved.
2. Managing storage space for users/user groups
When the quota is found to be insufficient in the using process of the user/user group, an application can be made to an administrator, and the administrator can modify the quota value to increase the quota.
3. Counting and viewing used memory space of users/user groups
The administrator can check the hard threshold, the soft threshold, the reporting precision and the current used amount (MB) of the current user/user group capacity quota, and count the related variable quantity.
Wherein the hard threshold HardLimit is the disk space most used by the user and is not allowed to exceed the value. When the user uses the disk space to reach the hard threshold, the system immediately limits the data writing and reports the alarm information to the system log; soft threshold SoftLimit: when the disk space used by the user exceeds the soft threshold, the system sends out alarm information; the reporting Accuracy is the reporting limit of the user disk space usage.
In the embodiment, the user/user group capacity quota allows setting of non-empty users/user groups, and only incremental statistics is performed on capacity statistics;
setting a capacity quota for a non-empty user/user group, counting a newly added capacity space by taking the moment of setting the quota as a reference, wherein the space occupied before the capacity quota is not set cannot be counted;
and after canceling the set capacity quota for a user/user group with a quota, resetting the user/user group quota, and carrying out statistics again on the user/user group with the capacity quota.
In this embodiment, only the user/user group capacity quota is set, and when the client uses the user (or the user in the user group) to view the system capacity, the user/user group capacity quota value is displayed;
setting user capacity quota, setting user group capacity quota of user, displaying user capacity quota value when using user to check system capacity through client;
and setting a catalog quota, simultaneously setting a user/user group capacity quota, mounting a quota-set catalog by the client, and displaying the quota value as a catalog quota value when the client uses the user (or a user in the user group) to check the system capacity. Namely, a user for checking the system capacity at the client also has a user/user group capacity quota, and the system capacity preferentially displays a directory quota value;
setting self-simplification, setting user/user group capacity quota, mounting the self-simplified directory on the client, and displaying the self-simplified set value when the client uses the user (or the user in the user group) to check the system capacity. Namely, the user whose client views the system capacity also has the user/user group capacity quota, and the system capacity preferentially displays the self-simplification setting value.
Based on the above understanding, for ease of understanding, a specific quota setting scheme for the number of storage system files is given below:
1. the number of user/user group files is reasonably planned.
The administrator sets a user group quota _ group1 (meanwhile, the administrator may also set quotas for users in the user group, for example, quota _ guser1 and quota _ guser2 … … quota _ guser of the users in the user group quota _ group 1) with a quota of 400, and reasonably plans quotas of users quota _ user1, quota _ user2 and quota _ user3 … … quota _ user in the user group, so that the sum of file quotas of all users is less than or equal to 400, and resource control is realized.
2. The number of files of a user/user group is managed.
When the quota is found to be insufficient in the using process of the user/user group, an application can be made to an administrator, and the administrator can modify the quota value to increase the quota.
Fig. 3 is a block diagram illustrating a user quota system of a distributed storage system provided in the present invention, where, for convenience of explanation, only the parts related to the embodiment of the present invention are shown in the diagram.
The user quota system of the distributed storage system specifically includes:
the usage dynamic monitoring module 1 is used for dynamically monitoring the usage of the storage space of the storage system by a user/user group when receiving a file uploading request of the user;
a threshold judgment module 2, configured to judge whether a storage space of the storage system used by the user/user group is greater than a preset space quota threshold, or whether the number of files included in the user/user group is greater than a preset file number threshold;
the quota opening judging module 3 is configured to judge whether the user/user group quota is opened or not when it is judged that the storage space of the storage system used by the user/user group is larger than a preset space capacity quota threshold value or the number of files included in the user/user group is larger than a preset file number threshold value;
the file uploading module 4 is used for continuously executing the uploading action of the file when the user/user group quota is not opened;
the uploading action limiting module 5 is used for limiting the file uploading action of the user when the user/user group quota is opened;
and when the storage space of the storage system used by the user/user group is judged to be less than or equal to the preset space capacity quota threshold value, or the number of files contained by the user/user group is judged to be less than or equal to the preset file number threshold value, continuing the file uploading action of the file uploading module 4.
The quota setting module 6 is configured to perform quota setting on a writable data volume or a file number of a user/user group.
The quota setting module 6 specifically includes:
the volume quota setting module 7 is used for setting a volume quota for a user/user group, and the setting of the volume quota is suitable for a large file scene;
the file number quota setting module 8 is used for setting file number quotas for users/user groups, and the file number quota setting is suitable for small file scenes;
the volume quota device and the file number quota setting comprise user quota setting and quota setting of a user group where the user is located.
In an embodiment of the present invention, the user quota system of the distributed storage system further includes:
a quota increase request module 9, configured to send a quota increase application request to the metadata server when limiting the file upload action of the user;
a quota increasing operation module 10, configured to receive, at the metadata server, the quota increasing application request, and increase the quota by modifying a quota value.
The functions of the modules are described in the above embodiments, and are not described herein again.
In the embodiment of the invention, the usage amount of the storage space of the storage system is dynamically monitored by a user/user group; judging whether the used storage space is larger than a preset space capacity quota threshold or not, or the number of files contained in a user/user group is larger than a file number threshold; if so, judging whether the user/user group quota is opened; when the file is not opened, the file uploading action is continuously executed; when the file is opened, limiting the file uploading action of the user; when the value is less than or equal to the preset threshold value, the file uploading action is continuously executed, and the following technical effects are achieved:
the problem of uneven use space of multiple users can be solved, so that the multiple users can fairly and reasonably use the file system resources;
in the aspect of improving the overall utilization rate of system resources, the management and control of file system resources can be realized at a user/user group layer, and a storage space is allocated to a user/user group according to requirements, so that the phenomenon that the use of other users is influenced due to the excessive use of resources by individual users is avoided;
in the aspect of saving user cost, the storage space is saved, so that the storage space is effectively utilized, and the minimum cost can be spent on storage.
The above description is only for the purpose of illustrating the preferred embodiments of the present invention and is not to be construed as limiting the invention, and any modifications, equivalents and improvements made within the spirit and principle of the present invention are intended to be included within the scope of the present invention.
Claims (6)
1. A user quota method for a distributed storage system, the method comprising the steps of:
when a file uploading request of a user is received, dynamically monitoring the usage amount of a storage space of a storage system by the user/user group;
judging whether the storage space of the storage system used by the user/user group is larger than a preset space capacity quota threshold value or whether the number of files contained by the user/user group is larger than a preset file number threshold value;
when the storage space of the storage system used by the user/user group is judged to be larger than a preset space capacity quota threshold value, or the number of files contained by the user/user group is judged to be larger than a preset file number threshold value, judging whether the user/user group quota is opened;
when the user/user group quota is not opened, continuing to execute the uploading action of the file;
when the user/user group quota is opened, limiting the file uploading action of the user;
when the storage space of the storage system used by the user/user group is judged to be smaller than or equal to a preset space capacity quota threshold value, or the number of files contained by the user/user group is judged to be smaller than or equal to a preset file number threshold value, continuing to execute the file uploading action;
the method further comprises the steps of:
quota setting is carried out on the writable data volume or the number of files of the user/user group;
the step of setting quota for the data volume or file number writable by the user/user group specifically includes the following steps:
carrying out capacity quota setting on a user/user group, wherein the capacity quota setting is suitable for a large file scene, and the step of carrying out capacity quota setting on the user/user group comprises the steps of reasonably planning the storage space of the user/user group, controlling the storage space of the user/user group and counting and checking the used storage space of the user/user group;
setting a file number quota for a user/user group, wherein the file number quota setting is suitable for small file scenes, and the step of setting the file number quota for the user/user group comprises the steps of reasonably planning the file number of the user/user group and controlling the file number of the user/user group;
the capacity quota setting and the file number quota setting comprise user quota setting and quota setting of a user group where the user is located;
only setting user/user group capacity quota, displaying the capacity quota value as a user/user group capacity quota value when the client uses the user or the user in the user group to check the system capacity;
setting user capacity quota, setting user group capacity quota of user, displaying user capacity quota value when using user to check system capacity through client;
setting a directory quota, simultaneously setting a user/user group capacity quota, mounting a quota-set directory by a client, displaying the quota as a directory quota value when the client uses the user or a user in the user group to check the system capacity, namely the user for checking the system capacity by the client also has the user/user group capacity quota, and displaying the directory quota value by the system capacity preferentially;
the method comprises the steps of setting self-simplification, setting user/user group capacity quota, mounting a self-simplified directory on a client, displaying a self-simplified setting value when the client uses the user or a user in the user group to check the system capacity, namely, the user of the client checking the system capacity also has the user/user group capacity quota, and displaying the self-simplified setting value by the system capacity preferentially.
2. The user quota method of the distributed storage system according to claim 1, wherein when a quota is set for one of the user and the user group in which the user is located, only one quota detection is performed;
when the user and the user group in which the user is located are both quota set, quota detection is performed on both the user and the user group in which the user is located, and the quota is achieved to be effective firstly.
3. The user quota method for a distributed storage system as claimed in claim 2, wherein said method further comprises the steps of:
when the file uploading action of the user is limited, a quota increasing application request is sent to a metadata server;
and receiving the quota increasing application request at the metadata server, and increasing the quota by modifying a quota value.
4. A user quota system for a distributed storage system, the system comprising:
the usage dynamic monitoring module is used for dynamically monitoring the usage of the storage space of the storage system by the user/user group when receiving a file uploading request of the user;
a threshold judgment module, configured to judge whether a storage space of the storage system used by the user/user group is greater than a preset space quota threshold, or whether the number of files included in the user/user group is greater than a preset file number threshold;
the quota starting judging module is used for judging whether the user/user group quota is started or not when the storage space of the storage system used by the user/user group is judged to be larger than a preset space capacity quota threshold value or the number of files contained by the user/user group is judged to be larger than a preset file number threshold value;
the file uploading module is used for continuously executing the uploading action of the file when the user/user group quota is not opened;
the uploading action limiting module is used for limiting the file uploading action of the user when the user/user group quota is opened;
when the storage space of the storage system used by the user/user group is judged to be smaller than or equal to a preset space capacity quota threshold value, or the number of files contained by the user/user group is judged to be smaller than or equal to a preset file number threshold value, continuing the file uploading action of the file uploading module;
the system further comprises:
the quota setting module is used for carrying out quota setting on the writable data volume or file number of the user/user group;
the quota setting module specifically includes:
the system comprises a capacity quota setting module, a capacity quota setting module and a capacity quota setting module, wherein the capacity quota setting module is used for setting a capacity quota for a user/user group, the setting of the capacity quota is suitable for a large file scene, and the step of setting the capacity quota for the user/user group comprises the steps of reasonably planning a storage space of the user/user group, controlling the storage space of the user/user group and counting and checking the used storage space of the user/user group;
the file number quota setting module is used for setting file number quotas for users/user groups, the file number quota setting is suitable for small file scenes, and the step of setting the file number quotas for the users/user groups comprises the steps of reasonably planning the file numbers of the users/user groups and controlling the file numbers of the users/user groups;
the capacity quota setting and the file number quota setting comprise user quota setting and quota setting of a user group where the user is located;
only setting user/user group capacity quota, displaying the capacity quota value as a user/user group capacity quota value when the client uses the user or the user in the user group to check the system capacity;
setting user capacity quota, setting user group capacity quota of user, displaying user capacity quota value when using user to check system capacity through client;
setting a directory quota, simultaneously setting a user/user group capacity quota, mounting a quota-set directory by a client, displaying the quota as a directory quota value when the client uses the user or a user in the user group to check the system capacity, namely the user for checking the system capacity by the client also has the user/user group capacity quota, and displaying the directory quota value by the system capacity preferentially;
the method comprises the steps of setting self-simplification, setting user/user group capacity quota, mounting a self-simplified directory on a client, displaying a self-simplified setting value when the client uses the user or a user in the user group to check the system capacity, namely, the user of the client checking the system capacity also has the user/user group capacity quota, and displaying the self-simplified setting value by the system capacity preferentially.
5. The user quota system of the distributed storage system of claim 4, wherein when one of the user and the user group in which the user is located performs quota setting, only one of the quota detection is performed;
when the user and the user group in which the user is located are both quota set, quota detection is performed on both the user and the user group in which the user is located, and the quota is achieved to be effective firstly.
6. The user quota system of the distributed storage system of claim 5, wherein said system further comprises:
a quota increasing request module, configured to send a quota increasing application request to the metadata server when limiting a file uploading action of the user;
and the quota increasing operation module is used for receiving the quota increasing application request at the metadata server and increasing the quota by modifying a quota value.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810573139.3A CN108829352B (en) | 2018-06-06 | 2018-06-06 | User quota method and system for distributed storage system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810573139.3A CN108829352B (en) | 2018-06-06 | 2018-06-06 | User quota method and system for distributed storage system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN108829352A CN108829352A (en) | 2018-11-16 |
| CN108829352B true CN108829352B (en) | 2021-03-30 |
Family
ID=64144446
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810573139.3A Active CN108829352B (en) | 2018-06-06 | 2018-06-06 | User quota method and system for distributed storage system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108829352B (en) |
Families Citing this family (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109542727B (en) * | 2018-11-19 | 2021-10-29 | 郑州云海信息技术有限公司 | Information prompting method and device |
| CN109634759A (en) * | 2018-12-12 | 2019-04-16 | 浪潮(北京)电子信息产业有限公司 | A kind of quota management method of distributed memory system, system and associated component |
| CN110569637A (en) * | 2019-08-07 | 2019-12-13 | 苏州浪潮智能科技有限公司 | Visualization system and method for managing HDFS space resources |
| US20210042165A1 (en) * | 2019-08-09 | 2021-02-11 | Oracle International Corporation | System and method for supporting a quota policy language in a cloud infrastructure environment |
| CN112748850B (en) | 2019-10-29 | 2024-04-19 | 伊姆西Ip控股有限责任公司 | Method, apparatus and computer program product for storage management |
| CN111552677B (en) * | 2020-05-13 | 2021-01-26 | 重庆紫光华山智安科技有限公司 | Quota management method, device, management node and storage medium |
| CN112000280A (en) * | 2020-07-30 | 2020-11-27 | 浪潮电子信息产业股份有限公司 | Quota control method and system |
| CN113806081B (en) * | 2021-08-31 | 2024-02-13 | 济南浪潮数据技术有限公司 | Quota function optimization method and system for object storage |
| CN115617747B (en) * | 2022-12-16 | 2023-03-28 | 新华三信息技术有限公司 | File storage method, device and equipment |
| CN116701382B (en) * | 2023-08-03 | 2023-10-20 | 成都数默科技有限公司 | Automatic efficient data rollback method based on clickhouse database |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105868389A (en) * | 2016-04-15 | 2016-08-17 | 北京思特奇信息技术股份有限公司 | Method and system for implementing data sandbox based on mongoDB |
| CN105893138A (en) * | 2014-12-19 | 2016-08-24 | 伊姆西公司 | Resource management method and device based on quota |
Family Cites Families (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20130311597A1 (en) * | 2012-05-16 | 2013-11-21 | Apple Inc. | Locally backed cloud-based storage |
| CN102917052A (en) * | 2012-10-18 | 2013-02-06 | 曙光信息产业(北京)有限公司 | Method for distributing resources in cloud computing system |
| CN103729236B (en) * | 2013-12-29 | 2017-04-05 | 国云科技股份有限公司 | A kind of method for limiting cloud computing user resources using amount |
| US10749956B2 (en) * | 2015-06-08 | 2020-08-18 | Microsoft Technology Licensing, Llc | Aggregated access to storage subsystem |
-
2018
- 2018-06-06 CN CN201810573139.3A patent/CN108829352B/en active Active
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105893138A (en) * | 2014-12-19 | 2016-08-24 | 伊姆西公司 | Resource management method and device based on quota |
| CN105868389A (en) * | 2016-04-15 | 2016-08-17 | 北京思特奇信息技术股份有限公司 | Method and system for implementing data sandbox based on mongoDB |
Also Published As
| Publication number | Publication date |
|---|---|
| CN108829352A (en) | 2018-11-16 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108829352B (en) | User quota method and system for distributed storage system | |
| CN107241281B (en) | Data processing method and device | |
| EP3367251B1 (en) | Storage system and solid state hard disk | |
| CN107426274B (en) | Method and system for service application and monitoring, analyzing and scheduling based on time sequence | |
| US20190108069A1 (en) | Distributed resource allocation method, allocation node, and access node | |
| US11392497B1 (en) | Low latency access to data sets using shared data set portions | |
| US9860317B1 (en) | Throughput throttling for distributed file storage services with varying connection characteristics | |
| US20140052953A1 (en) | Mass storage system and methods of controlling resources thereof | |
| US11550713B1 (en) | Garbage collection in distributed systems using life cycled storage roots | |
| US20200050479A1 (en) | Blockchain network and task scheduling method therefor | |
| US8706858B2 (en) | Method and apparatus for controlling flow of management tasks to management system databases | |
| US10705876B2 (en) | Operation management system and operation management method | |
| CN112016030B (en) | Message pushing method, device, server and computer storage medium | |
| CN106933868A (en) | A kind of method and data server for adjusting data fragmentation distribution | |
| US11593270B1 (en) | Fast distributed caching using erasure coded object parts | |
| CN111131841A (en) | Live indirect access method and device, electronic equipment and storage medium | |
| CN112685499A (en) | Method, device and equipment for synchronizing process data of work service flow | |
| Hsieh et al. | The incremental load balance cloud algorithm by using dynamic data deployment | |
| CN110795041A (en) | Quota method, quota device, server and storage medium of distributed file system | |
| CN109871365A (en) | A kind of distributed file system | |
| CN113965587A (en) | Data acquisition method, device, equipment and medium of artificial intelligence platform | |
| CN110471897B (en) | File management method and device | |
| CN110825732A (en) | Data query method and device, computer equipment and readable storage medium | |
| CN107766001A (en) | A kind of storage quota method based on groups of users | |
| CN112286695A (en) | Server resource allocation method and edge data center |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |