CN106815342A - A kind of distributed file system user quota system and method - Google Patents
A kind of distributed file system user quota system and method Download PDFInfo
- Publication number
- CN106815342A CN106815342A CN201710024827.XA CN201710024827A CN106815342A CN 106815342 A CN106815342 A CN 106815342A CN 201710024827 A CN201710024827 A CN 201710024827A CN 106815342 A CN106815342 A CN 106815342A
- Authority
- CN
- China
- Prior art keywords
- quota
- user
- file system
- information
- data
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/11—File system administration, e.g. details of archiving or snapshots
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/18—File system types
- G06F16/182—Distributed file systems
- G06F16/1824—Distributed file systems implemented using Network-attached Storage [NAS] architecture
- G06F16/183—Provision of network file services by network file servers, e.g. by using NFS, CIFS
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Databases & Information Systems (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention discloses a kind of distributed file system user quota system, including：The data management operations of user are monitored by CIFS protocol layers, the quota information for obtaining user from file system api layer using the quota information；The file system api layer, for the data management operations according to user, the operation amount information of counting user, and sends to meta data server；The meta data server, for being updated to the quota information of user according to the operation amount information, and the quota information after renewal is shared to other clients；It can be seen that, in this programme, by CIFS protocol layers, file system api layer and meta data server, use space that can be effectively to user is managed, and improves the efficiency that space uses；The invention also discloses a kind of distributed file system user quota method, above-mentioned technique effect can be equally realized.
Description
Technical field
The present invention relates to user's quota technology field, more specifically to a kind of distributed file system user quota
System and method.
Background technology
At present, the generally node of distributed file system cluster storage system 3~60, total memory space is up to 108T
~2160T, even more high.When memory space is distributed to client, memory space is typically given into department in the form of file
Or personal use, to avoid certain department or personal excessively use from causing public resource to waste, it is necessary to hold to department or user
Amount limitation.
Therefore, how to realize memory space is that those skilled in the art need to solve with volume function.
The content of the invention
It is an object of the invention to provide a kind of distributed file system user quota system and method, to realize that storage is empty
Between with volume function.
To achieve the above object, the embodiment of the invention provides following technical scheme：
A kind of distributed file system user quota system, including：
CIFS protocol layers, for from file system api layer obtain user quota information, using the quota information to
The data management operations at family are monitored；
File system api layer, for the data management operations according to user, the operation amount information of counting user,
And send to meta data server；
The meta data server, for being updated to the quota information of user according to the operation amount information, and
Quota information after renewal is shared to other clients.
Wherein, the meta data server, including：
Quota pre-authorization module, for when the data management operations are data write operation, according to the user's
Remaining amount, the amount information is distributed to the user.
Wherein, the meta data server, also includes：
Memory module, for being that interval stores to disk the current quota information of user with scheduled duration.
Wherein, the CIFS protocol layers, also include：
Monitoring module, be for when the data management operations are data write operation, detecting the data of user's write-in
The no quota value beyond the quota information；
Reminding module, when the data for being write in user exceed the quota value, sends alarm prompt.
Wherein, the CIFS protocol layers, also include：
Display module, for showing the quota information in Disk Properties.
Wherein, the file system api layer, is additionally operable to provide a user with quota operate interface, so that user is according to described
Quota operate interface performs quotas administered operation.
Wherein, quotas administered operation includes any one in following operation：
Quota information sets operation, and quota information modification is operated, quota information inquiry operation, quota information inquiry operation,
Quota information deletion action.
A kind of distributed file system user quota method, including：
CIFS protocol layers obtain the quota information of user from file system api layer, using the quota information to user's
Data management operations are monitored；
File system api layer sends according to the data management operations of user, the operation amount information of counting user
To meta data server；
The meta data server is updated according to the operation amount information to the quota information of user, and will update
Quota information afterwards is shared to other clients.
Wherein, also include：
When the data management operations are data write operation, whether the data of detection user's write-in exceed the quota
The quota value of information；
If the data of user's write-in exceed the quota value, alarm prompt is sent.
Wherein, also include：
The file system api layer provides a user with quota operate interface, so that user is according to the quota operate interface
Perform quotas administered operation.
By above scheme, a kind of distributed file system user quota system provided in an embodiment of the present invention, bag
Include：CIFS protocol layers, the quota information for obtaining user from file system api layer, using the quota information to user's
Data management operations are monitored；The file system api layer, for the data management operations according to user, counting user
Operation amount information, and send to meta data server；The meta data server, for according to the operation amount information pair
The quota information of user is updated, and the quota information after renewal is shared to other clients；It can be seen that, in this programme,
By CIFS protocol layers, file system api layer and meta data server, use space that can be effectively to user is managed,
Improve the efficiency that space uses；The invention also discloses a kind of distributed file system user quota method, can equally realize
State technique effect.
Brief description of the drawings
In order to illustrate more clearly about the embodiment of the present invention or technical scheme of the prior art, below will be to embodiment or existing
The accompanying drawing to be used needed for having technology description is briefly described, it should be apparent that, drawings in the following description are only this
Some embodiments of invention, for those of ordinary skill in the art, on the premise of not paying creative work, can be with
Other accompanying drawings are obtained according to these accompanying drawings.
Fig. 1 is a kind of distributed file system user quota system structure diagram disclosed in the embodiment of the present invention；
Fig. 2 is a kind of distributed file system user quota method flow schematic diagram disclosed in the embodiment of the present invention.
Specific embodiment
Below in conjunction with the accompanying drawing in the embodiment of the present invention, the technical scheme in the embodiment of the present invention is carried out clear, complete
Site preparation is described, it is clear that described embodiment is only a part of embodiment of the invention, rather than whole embodiments.It is based on
Embodiment in the present invention, it is every other that those of ordinary skill in the art are obtained under the premise of creative work is not made
Embodiment, belongs to the scope of protection of the invention.
The embodiment of the invention discloses a kind of distributed file system user quota system and method, to realize memory space
With volume function.
Referring to Fig. 1, a kind of distributed file system user quota system provided in an embodiment of the present invention, including：
CIFS protocol layers 100, the quota information for obtaining user from file system api layer, using the quota information
Data management operations to user are monitored；
Wherein, the CIFS protocol layers, also include：
Monitoring module, be for when the data management operations are data write operation, detecting the data of user's write-in
The no quota value beyond the quota information；
Reminding module, when the data for being write in user exceed the quota value, sends alarm prompt.
Specifically, opening user's quota switch, account setup user quota of the user with volume function is needed to believe to certain
Breath, when client logs in distributed file system by the account carries out write-in data, if the data for detecting write-in reach
During the quota value that user is set, can be alerted, it is achieved thereby that the monitoring to data management operations；It should be noted that this
Data management operations in embodiment include data write operation, also including data deletion action, data query operation etc., then this
It is not specific to limit.
Wherein, the CIFS protocol layers, also include：
Display module, for showing the quota information in Disk Properties.
Specifically, file system api layer 200 is that the shared client offers of NAS obtain user's quota to CIFS protocol layers 100
The interface of information, CIFS protocol layers 100 call these interface captures user quota informations, and show that user matches somebody with somebody in Disk Properties
Volume size, while whether the use space for judging user according to these information transfinites, if exceeding authority, is alarmed.
The file system api layer 200, for the data management operations according to user, the operation amount of counting user is believed
Breath, and send to meta data server；
Wherein, the file system api layer, is additionally operable to provide a user with quota operate interface, so that user is according to described
Quota operate interface performs quotas administered operation.
Quotas administered operation includes any one in following operation：
Quota information sets operation, and quota information modification is operated, quota information inquiry operation, quota information inquiry operation,
Quota information deletion action.
Specifically, file system api layer 200 provide user interface realize the setting of quota information, modification, inquiry,
Delete etc. sequence of operations, but perform quotas administered operate when, for increase or deletion to quota etc. operation, it is necessary to
Certain authority could be performed.And the command result of all data management operations is reported metadata by file system api layer 200
Server 300, meta data server 300 is responsible for these data, and gives other clients by these data sharings.
For example：User writes the data of 20M to the memory space of account, then the operation amount information of user is addition
20M, then file system api layer 200 sends to meta data server 300, metadata clothes the operation amount information for adding 20M
After business device 300 receives the information, the quota information to the account is updated, for example：The amount of original account is 100M,
After so updating, the amount of the account is 80M.
The meta data server 300, for being updated to the quota information of user according to the operation amount information,
And share to other clients the quota information after renewal.
Wherein, the meta data server, including：
Quota pre-authorization module, for when the data management operations are data write operation, according to the user's
Remaining amount, the amount information is distributed to the user.
Specifically, meta data server 300 can realize quota pre-authorization function.I.e.：User carries out data by client
During write-in, it is necessary first to which Metadata Service end carries out quota pre-authorization operation to it, data write-in can be just carried out after only authorizing,
Avoid multiple client from writing data to the memory space of the account simultaneously, and cause multiple client to write failure.
Wherein, the meta data server, also includes：
Memory module, for being that interval stores to disk the current quota information of user with scheduled duration.
Specifically, meta data server 300 realizes quota Sharing Management, including residual memory space statistics with update,
Quota information is managed, and quota information is shared, and quota information is preserved and quota pre-authorization function, when quota information is preserved, unit
These user's quota datas periodically can be saved in disk by data server 300.
User's quota method provided in an embodiment of the present invention is introduced below, user's quota method described below with
Above-described user's quota system can be with cross-referenced.
Referring to Fig. 2, a kind of distributed file system user quota method provided in an embodiment of the present invention, including：
S101, CIFS protocol layer from file system api layer obtain user quota information, using the quota information to
The data management operations at family are monitored；
S102, file system api layer according to the data management operations of user, the operation amount information of counting user,
And send to meta data server；
S103, the meta data server are updated according to the operation amount information to the quota information of user, and
Quota information after renewal is shared to other clients.
Based on above-described embodiment, the present embodiment also includes：
When the data management operations are data write operation, whether the data of detection user's write-in exceed the quota
The quota value of information；
If the data of user's write-in exceed the quota value, alarm prompt is sent.
Based on above-described embodiment, the present embodiment also includes：
The file system api layer provides a user with quota operate interface, so that user is according to the quota operate interface
Perform quotas administered operation.
A kind of distributed file system user quota system provided in an embodiment of the present invention, including：CIFS protocol layers, are used for
The quota information of user is obtained from file system api layer, the data management operations of user are supervised using the quota information
Control；The file system api layer, for the data management operations according to user, the operation amount information of counting user, and sends
To meta data server；The meta data server, for being carried out to the quota information of user according to the operation amount information
Update, and the quota information after renewal is shared to other clients；It can be seen that, in this programme, by CIFS protocol layers, file
System api layer and meta data server, use space that can be effectively to user are managed, and improve the efficiency that space uses；
The invention also discloses a kind of distributed file system user quota method, above-mentioned technique effect can be equally realized.
Each embodiment is described by the way of progressive in this specification, and what each embodiment was stressed is and other
The difference of embodiment, between each embodiment identical similar portion mutually referring to.
The foregoing description of the disclosed embodiments, enables professional and technical personnel in the field to realize or uses the present invention.
Various modifications to these embodiments will be apparent for those skilled in the art, as defined herein
General Principle can be realized in other embodiments without departing from the spirit or scope of the present invention.Therefore, the present invention
The embodiments shown herein is not intended to be limited to, and is to fit to and principles disclosed herein and features of novelty phase one
The scope most wide for causing.
Claims (10)
1. a kind of distributed file system user quota system, it is characterised in that including：
CIFS protocol layers, the quota information for obtaining user from file system api layer, using the quota information to user's
Data management operations are monitored；
File system api layer, for the data management operations according to user, the operation amount information of counting user, concurrently
Deliver to meta data server；
The meta data server, for being updated to the quota information of user according to the operation amount information, and will more
Quota information after new is shared to other clients.
2. distributed file system user quota system according to claim 1, it is characterised in that the Metadata Service
Device, including：
Quota pre-authorization module, for when the data management operations are data write operation, according to the residue of the user
Amount, the amount information is distributed to the user.
3. distributed file system user quota system according to claim 2, it is characterised in that the Metadata Service
Device, also includes：
Memory module, for being that interval stores to disk the current quota information of user with scheduled duration.
4. distributed file system user quota system according to claim 1, it is characterised in that the CIFS agreements
Layer, also includes：
Monitoring module, for when the data management operations are data write operation, whether the data of detection user's write-in to surpass
Go out the quota value of the quota information；
Reminding module, when the data for being write in user exceed the quota value, sends alarm prompt.
5. distributed file system user quota system according to claim 4, it is characterised in that the CIFS agreements
Layer, also includes：
Display module, for showing the quota information in Disk Properties.
6. the distributed file system user's quota system according to any one in claim 1-5, it is characterised in that institute
File system api layer is stated, is additionally operable to provide a user with quota operate interface, so that user performs according to the quota operate interface
Quotas administered is operated.
7. distributed file system user quota system according to claim 6, it is characterised in that the quotas administered behaviour
Work includes any one in following operation：
Quota information sets operation, quota information modification operation, quota information inquiry operation, quota information inquiry operation, quota
Information deletion is operated.
8. a kind of distributed file system user quota method, it is characterised in that including：
CIFS protocol layers obtain the quota information of user from file system api layer, using the quota information to the data of user
Management operation is monitored；
File system api layer is sent to unit according to the data management operations of user, the operation amount information of counting user
Data server；
The meta data server is updated according to the operation amount information to the quota information of user, and by after renewal
Quota information is shared to other clients.
9. distributed file system user quota method according to claim 8, it is characterised in that also include：
When the data management operations are data write operation, whether the data of detection user's write-in exceed the quota information
Quota value；
If the data of user's write-in exceed the quota value, alarm prompt is sent.
10. distributed file system user's quota method according to claim 8 or claim 9, it is characterised in that also include：
The file system api layer provides a user with quota operate interface, so that user performs according to the quota operate interface
Quotas administered is operated.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710024827.XA CN106815342A (en) | 2017-01-13 | 2017-01-13 | A kind of distributed file system user quota system and method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710024827.XA CN106815342A (en) | 2017-01-13 | 2017-01-13 | A kind of distributed file system user quota system and method |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN106815342A true CN106815342A (en) | 2017-06-09 |
Family
ID=59110788
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710024827.XA Pending CN106815342A (en) | 2017-01-13 | 2017-01-13 | A kind of distributed file system user quota system and method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106815342A (en) |
Cited By (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107426321A (en) * | 2017-07-31 | 2017-12-01 | 郑州云海信息技术有限公司 | A kind of distributed memory system quota allotment approach and device |
| CN107506242A (en) * | 2017-08-30 | 2017-12-22 | 郑州云海信息技术有限公司 | A kind of quota application method and system |
| CN107562386A (en) * | 2017-09-13 | 2018-01-09 | 郑州云海信息技术有限公司 | A kind of method for writing data and device of distributed storage cluster |
| CN107729417A (en) * | 2017-09-27 | 2018-02-23 | 郑州云海信息技术有限公司 | A kind of quota gives back implementation method, device, equipment and computer-readable storage medium |
| CN107885859A (en) * | 2017-11-20 | 2018-04-06 | 郑州云海信息技术有限公司 | A kind of method, apparatus and computer-readable recording medium of file number quota |
| CN110795041A (en) * | 2019-10-28 | 2020-02-14 | 柏科数据技术（深圳）股份有限公司 | Quota method, quota device, server and storage medium of distributed file system |
| CN113449876A (en) * | 2021-06-11 | 2021-09-28 | 北京四维图新科技股份有限公司 | Processing method, system and storage medium for deep learning training data |
| CN115242818A (en) * | 2022-07-22 | 2022-10-25 | 济南浪潮数据技术有限公司 | Quota management method, device, equipment and medium |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102447736A (en) * | 2011-11-17 | 2012-05-09 | 华中科技大学 | Management and control method for user quota in multi-network storage system |
| CN103559231A (en) * | 2013-10-23 | 2014-02-05 | 华为技术有限公司 | File system quota managing method, device and system |
| CN105677789A (en) * | 2015-12-31 | 2016-06-15 | 浪潮(北京)电子信息产业有限公司 | Method and system for managing directory capacity of distributed file system |
| CN106210026A (en) * | 2016-07-05 | 2016-12-07 | 浪潮(北京)电子信息产业有限公司 | The control method of distributed file system multi-client catalogue quota precision and system |
| CN106326013A (en) * | 2016-08-25 | 2017-01-11 | 浪潮(北京)电子信息产业有限公司 | Disk quota management system and method for distributed file system |
-
2017
- 2017-01-13 CN CN201710024827.XA patent/CN106815342A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102447736A (en) * | 2011-11-17 | 2012-05-09 | 华中科技大学 | Management and control method for user quota in multi-network storage system |
| CN103559231A (en) * | 2013-10-23 | 2014-02-05 | 华为技术有限公司 | File system quota managing method, device and system |
| CN105677789A (en) * | 2015-12-31 | 2016-06-15 | 浪潮(北京)电子信息产业有限公司 | Method and system for managing directory capacity of distributed file system |
| CN106210026A (en) * | 2016-07-05 | 2016-12-07 | 浪潮(北京)电子信息产业有限公司 | The control method of distributed file system multi-client catalogue quota precision and system |
| CN106326013A (en) * | 2016-08-25 | 2017-01-11 | 浪潮(北京)电子信息产业有限公司 | Disk quota management system and method for distributed file system |
Cited By (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107426321A (en) * | 2017-07-31 | 2017-12-01 | 郑州云海信息技术有限公司 | A kind of distributed memory system quota allotment approach and device |
| CN107506242A (en) * | 2017-08-30 | 2017-12-22 | 郑州云海信息技术有限公司 | A kind of quota application method and system |
| CN107562386A (en) * | 2017-09-13 | 2018-01-09 | 郑州云海信息技术有限公司 | A kind of method for writing data and device of distributed storage cluster |
| CN107729417A (en) * | 2017-09-27 | 2018-02-23 | 郑州云海信息技术有限公司 | A kind of quota gives back implementation method, device, equipment and computer-readable storage medium |
| CN107885859A (en) * | 2017-11-20 | 2018-04-06 | 郑州云海信息技术有限公司 | A kind of method, apparatus and computer-readable recording medium of file number quota |
| CN107885859B (en) * | 2017-11-20 | 2021-10-15 | 郑州云海信息技术有限公司 | Method and device for file number quota and computer readable storage medium |
| CN110795041A (en) * | 2019-10-28 | 2020-02-14 | 柏科数据技术（深圳）股份有限公司 | Quota method, quota device, server and storage medium of distributed file system |
| CN113449876A (en) * | 2021-06-11 | 2021-09-28 | 北京四维图新科技股份有限公司 | Processing method, system and storage medium for deep learning training data |
| CN115242818A (en) * | 2022-07-22 | 2022-10-25 | 济南浪潮数据技术有限公司 | Quota management method, device, equipment and medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106815342A (en) | A kind of distributed file system user quota system and method | |
| CN104715001B (en) | The method and system of write operation is performed for the shared resource in the cluster to data handling system | |
| US9959280B1 (en) | Garbage collection of data tiered to cloud storage | |
| US9588977B1 (en) | Data and metadata structures for use in tiering data to cloud storage | |
| CN108829352B (en) | User quota method and system for distributed storage system | |
| US8625757B1 (en) | Monitoring services and service consumers | |
| CN101404789B (en) | Method and apparatus for processing data | |
| US7716177B2 (en) | Proactive space allocation in a database system | |
| US10067836B1 (en) | Configuration based intelligent protection modeling | |
| CN110515748B (en) | Message processing method and related device | |
| US9075815B2 (en) | Records declaration filesystem monitoring | |
| CN105472002A (en) | Session synchronization method based on instant copying among cluster nodes | |
| CN106326013A (en) | Disk quota management system and method for distributed file system | |
| CN106919346A (en) | A kind of shared Storage Virtualization implementation method based on CLVM | |
| CN108268211B (en) | Data processing method and device | |
| CN106936623A (en) | The management method of distributed cache system and cache cluster | |
| CN102902583A (en) | Managing processes within suspend states and execution states | |
| CN102984267B (en) | A kind of method and system that realize distributed caching node and dynamically update client | |
| US10795579B2 (en) | Methods, apparatuses, system and computer program products for reclaiming storage units | |
| CN108920271A (en) | Application cache method for cleaning, device, storage medium and terminal | |
| CN102999384A (en) | Managing processes within suspend states and execution states | |
| CN103595566A (en) | Method and device for detecting idle IP addresses | |
| CN109753360A (en) | Lightweight data management system and method towards fringe node in electric system | |
| CN105912280A (en) | Storage terminal capable of performing data classification | |
| CN109471989A (en) | A kind of page request processing method and relevant apparatus |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20170609 |