CN107766001B - Storage quota method based on user group - Google Patents

Storage quota method based on user group Download PDF

Info

Publication number
CN107766001B
CN107766001B CN201710973398.0A CN201710973398A CN107766001B CN 107766001 B CN107766001 B CN 107766001B CN 201710973398 A CN201710973398 A CN 201710973398A CN 107766001 B CN107766001 B CN 107766001B
Authority
CN
China
Prior art keywords
storage
quota
user
users
pool
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201710973398.0A
Other languages
Chinese (zh)
Other versions
CN107766001A (en
Inventor
陈孙浩
王熙
温序铭
张洁
王炜
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Chengdu Sobey Digital Technology Co Ltd
Original Assignee
Chengdu Sobey Digital Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Chengdu Sobey Digital Technology Co Ltd filed Critical Chengdu Sobey Digital Technology Co Ltd
Priority to CN201710973398.0A priority Critical patent/CN107766001B/en
Publication of CN107766001A publication Critical patent/CN107766001A/en
Application granted granted Critical
Publication of CN107766001B publication Critical patent/CN107766001B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601Interfaces specially adapted for storage systems
    • G06F3/0628Interfaces specially adapted for storage systems making use of a particular technique
    • G06F3/0629Configuration or reconfiguration of storage systems
    • G06F3/0631Configuration or reconfiguration of storage systems by allocating resources to storage systems
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601Interfaces specially adapted for storage systems
    • G06F3/0628Interfaces specially adapted for storage systems making use of a particular technique
    • G06F3/0629Configuration or reconfiguration of storage systems
    • G06F3/0637Permissions

Abstract

The invention provides a storage quota method based on a user group, which relates to the technical field of computer storage. The method of the invention can not only store quota for users of the service layer, but also carry out quota for all users under departments and roles, and combines the concepts of users, departments and roles on the service with the storage space quota, thereby achieving the effect of dynamic and elastic use of quota, being capable of adapting to various management modes of bottom storage, and having strong universality and good flexibility.

Description

Storage quota method based on user group
Technical Field
The invention relates to the technical field of computer storage, in particular to a storage quota method based on a user group.
Background
With the explosive increase of information quantity, the network storage technology is continuously developed and widely applied. In many network storage systems, metadata and data are separated, each managed by a separate server, referred to as a metadata server and a data server, respectively. The user stores own data on the data server and uses a certain amount of system resources. When multiple users share the system, the system must provide a method for each user to reasonably and effectively use the system resources, so that the limited system resources are efficiently utilized, i.e., a quota storage method.
The existing storage quota method is based on physical storage users, and the storage quota is realized from users, departments and roles in a service level. In summary, the existing storage quota method has the following three disadvantages: (1) single user quota: the objects of many storage quota methods at present are storage users, which cannot manage storage quotas of users, departments and roles in a user group from a business level, and cannot control storage resource quotas of the users, the departments and the roles; (2) the universality is weak: with continuous innovation of various storage manufacturers on the management characteristics of storage, various underlying storage management modes exist, the existing storage quota method can only match the management characteristics of a specific storage manufacturer, and when the storage of other manufacturers needs to be accessed, customized development needs to be carried out, so that the universality is weak; (3) poor flexibility: the existing storage quota method can only distribute the storage capacity of the storage user, and cannot uniformly carry out storage quota for departments and roles to realize shared storage use of all users under the departments and the roles, so that the flexibility is poor.
Disclosure of Invention
The invention aims to: in order to solve the problems that the existing storage quota method can only carry out quota aiming at a single user, and is weak in universality and poor in flexibility, the invention provides a user group-based storage quota method.
The specific scheme of the invention is as follows:
a storage quota method based on a user group is characterized in that storage is logically packaged according to users, departments and roles in a service management program, the binding relation between the users, the departments or the roles and the storage is configured, so that the users can use the storage exclusively or in a shared mode, the corresponding relation between the storage in a logic layer and the storage in a physical layer is established, and the content users in the service layer and the storage users are bound one by one.
Specifically, the step of storing the quota is as follows:
the method comprises the following steps: creating exclusive Pool for content user of service level, creating shared Pool for department and role, storing in database; the Pool belongs to the logical level Pool concept.
Step two: creating a storage Unit for the exclusive Pool and the shared Pool, and storing the storage Unit in a database; the Unit belongs to the memory Unit concept of the logic level.
Step three: creating a storage user on the physical storage, and creating a Unit folder; a physical directory is formed.
Step four: and allocating quotas and setting permissions for the Unit folders.
Step five: and establishing a corresponding relation between the storage Unit Unit in the step two and the Unit folder in the step three.
Step six: and binding the content users and the storage users on the service level one by one, and completing the storage quota of the users, departments and roles.
Specifically, in the step one, the exclusive Pool can only bind to a unique user, the binding relationship can only be a user, the shared Pool can bind to a certain role or organization department, and each user accesses the own exclusive Pool or authorized shared Pool.
Specifically, in the fourth step, the default Unit folder creator has access right to the Unit folder, and the access right to set the Unit folder may be changed.
Furthermore, the storage quota of the user, the department and the role can be modified at any time, the storage quota of the user under the exclusive Pool is only allowed to be used by the user, the storage quota of the department under the shared Pool is allowed to be commonly used by all users under the department, and the storage quota of the role under the shared Pool is allowed to be commonly used by all users under the role.
Further, in the storage operation of the user, the department or the role, when the file is deleted, the release space is timely recovered. Maintaining proper management of quota usage.
Specifically, the total size of the storage quota and the size of the used space of the user, the department and the role are obtained through the interface, and the quota space is counted in real time.
After the scheme is adopted, the invention has the beneficial effects that:
(1) group quota: the Pool is divided into exclusive Pool and shared Pool, the user has own memory directory for exclusive Pool, and the department and the role have corresponding memory directories for shared Pool, so that the quota storage method can not only be used for a single user in a service level, but also be used for managing the user group memory quota under the department and the role, and controlling the quota of the memory resources for the user, the department and the role.
(2) The universality is strong: pool resource pooling is realized in a space management program, the space management program adapts to various management modes of bottom storage, most storage manufacturers are adapted, customized development is not needed according to the management characteristics of each storage manufacturer, and the space management program has strong universality.
(3) The flexibility is good: the storage is logically packaged, namely after Pool resource pooling is realized, flexible allocation, dynamic adjustment and quota limitation are conveniently carried out on the storage capacity of a user, a department and a role, the user can use the unique quota of the user, and can also use the shared quota under the affiliated department and role, and the method has the advantage of dynamic and flexible use. In addition, the quota is based on physical quota, and the accuracy of statistics is guaranteed.
Drawings
FIG. 1 is a schematic diagram illustrating a storage quota method process of the present invention;
FIG. 2 is an architecture diagram of the present invention for logically encapsulating physical storage with a space manager;
FIG. 3 is a diagram of logical object relationships for pool pooling implemented by the space management program according to the present invention.
Detailed Description
The present invention will be described more clearly and completely with reference to the following specific embodiments.
In order to realize the quota storage for the users of the service layer and the quota storage for all the users under the departments and the roles, the concepts of the users, the departments and the roles on the service are combined with the storage space quota, so that the dynamic and flexible use effect of the quota is achieved, and the management method can be adapted to various bottom storage management modes. In the storage quota method based on the user group according to this embodiment, the storage is logically encapsulated according to the user, the department, and the role in the service management program, a correspondence is established between the storage in the logical layer and the storage in the physical layer, and the content users in the service layer are bound with the storage users one by one. The storage quota based on the user group in the invention means that a storage space quota can be allocated to a user, a department and a role, the user has a storage directory exclusive to Pool, the department and the role have corresponding storage directories sharing the Pool, and the quota of the directories is set for storage through an interface.
As shown in fig. 2, the whole storage quota method is regarded as a space management program, and as can be seen from fig. 2, Pool is divided into exclusive Pool and shared Pool, where exclusive Pool can only bind to a unique user, and the binding relationship can only be a user, shared Pool can bind to a certain role or organization department, and each user accesses its own work area Pool or a shared area Pool with authority; in the space management program, space division and user authorization are carried out, and an unauthorized user cannot access any file in the other Poo 1; the access control module performs real-time read-write authorized space control on user operation physical storage, and the authorized user drives the file to actively cut off any IO of the operating system to the file after the Pool reaches a quota; the user can "share" the file in the Pool to other pools, and at this time, the Pool management layer will automatically call HardLink to make the shared file available to other users. At this time, the shared file appears to the user as a "real" file, but it is just a file pointer, so that it does not occupy physical space, and the sharing process is also at the second level (in the same volume).
FIG. 3 is a logical object relationship diagram for pool pooling implemented by the space management program according to the present invention, wherein the English symbols in the diagram are specifically explained as follows: user: a user; pool: a storage pool; poolcode: a storage pool identification; name: a storage pool name; TypeDef: a type description; state: a state; poolunits: a storage pool unit; unit: a storage unit; code: a storage unit identifier; name: a storage unit name; capacity: capacity; CurrentCapacity: (ii) used capacity; CurrentLogicCapacity: a logical reference capacity; buffersize: buffer size; UNCMountDef: UNC access mode description; MountName: mounting a directory name; ReadonlyUser: a read-only user; access Path: an access path; FTPMountDef: describing an FTP access mode; OSSMountDef: OSS access mode description; StoragePath: storing the path; access rule: an access rule; OSSAccess: OSS access; FTPASccess: FTP access; ArchivePolicy: an archiving policy; PolicyName: a policy name; LifetimeSetting: setting a life cycle; nellineaccessinfo: near line access information; FileRecord: recording the file; FilePath: a file path; FileSize: the size of the file; the figure is an E-R diagram, and numbers on a line represent the corresponding relationship of two entities, for example, 1 and n on a line represent that the two entities are in one-to-many relationship, and 1 and 0-1 on a line represent that there is no relationship or one-to-one correspondence.
Thus, as can be seen in the figure, Pool is a relational bridge structure of users and units, which associates a plurality of units, each of which needs to be "formatted" at the capacity of the total space and set the access capacity. One or more users share a set of units through a unique Pool. The final logical space interaction identity for a certain user or group of users is Pool. The space management can manage/divide the capacity of a plurality of storage bodies according to the Pool, and can dynamically increase the physical storage to the Pool/expand the total space of the Pool in a Unit mode to support the network disk. The total volume of Pool is the sum of the volumes of the units, and the space usage is counted in Pool units.
Units and physical directories are in one-to-one exclusive relationship, and each Unit can only obtain the residual physical capacity of the current storage (or disk) when being initialized. Each Unit must correspond to a non-repeatable directory not containing relationships under UNC, FTP, OSS type root paths.
Specifically, the procedure of storing the quota in this embodiment is as follows:
in the following steps, it is assumed that the user, department and role have been created at the service manager side, and the user has been assigned to the department and role.
The method comprises the following steps: creating exclusive Pool for content user of service level, creating shared Pool for department and role, storing in database, the Pool belonging to storage Pool concept of logic level. The exclusive Pool can only bind to a unique user, the binding relationship can only be a user, the shared Pool can bind to a certain role or organization department, and each user accesses the own exclusive Pool or authorized shared Pool.
Step two: and creating a storage Unit for the exclusive Pool and the shared Pool, and storing the storage Unit in a database, wherein the Unit belongs to the storage Unit concept of the logic level.
Step three: a storage user is created on a physical storage, a Unit folder is created, and a physical directory is formed, so that the user has a storage directory of an exclusive pool, a department and a role have corresponding storage directories of a shared pool, and different storage directories have different quotas.
Step four: allocating quota and setting authority for the Unit folder; and defaulting the creator of the Unit folder to have access right to the Unit folder, and changing the access right of the Unit folder.
Step five: establishing a corresponding relation between the storage Unit Unit in the step two and the Unit folder in the step three;
step six: and binding the content users and the storage users on the service level one by one, and completing the storage quota of the users, departments and roles.
The storage quota of the user, the department and the role can be modified at any time, the storage quota under exclusive Pool of the user is only allowed to be used by the user, the storage quota under shared Pool of the department is allowed to be commonly used by all users under the department, and the storage quota under shared Pool of the role is allowed to be commonly used by all users under the role. In the storage operation of a user, a department or a role, when a file is deleted, the released space is recovered in time, so that the correct management of quota use condition is maintained.
And when the quota space is counted in real time, the total size of the storage quota and the size of the use space of the user, the department and the role are obtained through the interface.

Claims (5)

1. A storage quota method based on user group is characterized in that the method logically packages storage according to users, departments and roles in a service management program, achieves the purpose that the users can exclusively or share the storage by configuring the binding relationship between the users, the departments or the roles and the storage, establishes the corresponding relationship between the storage of a logic layer and the storage of a physical layer at the bottom layer, and finally binds content users of the service layer and the storage users one by one to finish the storage quota; the method comprises the following specific steps:
the method comprises the following steps: creating exclusive Pool for content users of a service level, and creating shared Pool for departments and roles respectively;
step two: creating a storage Unit for the exclusive Pool and the shared Pool;
step three: creating a storage user on the physical storage, and creating a Unit folder;
step four: allocating quota and setting authority for the Unit folder;
step five: establishing a corresponding relation between the storage Unit Unit in the step two and the Unit folder in the step three;
step six: binding the content users and the storage users on the service level one by one, and completing the storage quota of the users, departments and roles;
the exclusive Pool can only bind to a unique user, the binding relationship can only be a user, the shared Pool can bind to a certain role or organization department, and each user accesses the own exclusive Pool or authorized shared Pool.
2. The method according to claim 1, wherein in step four, the default Unit folder creator has access right to the Unit folder, and the access right to set the Unit folder can be changed.
3. The storage quota method based on the user group, according to claim 1, wherein the storage quota size of the user, the department, and the role can be modified at any time, the storage quota under the exclusive Pool of the user is only allowed to be used by the user, the storage quota under the shared Pool of the department is allowed to be commonly used by all users under the department, and the storage quota under the shared Pool of the role is allowed to be commonly used by all users under the role.
4. The method according to claim 1, wherein when a file is deleted during a storage operation of a user, a department, or a role, the system can timely recover the released space, and after Pool reaches the quota, the user, the department, or the role cannot perform any IO operation on the file.
5. The storage quota method based on the user group as claimed in claim 1, wherein the total size of the storage quota of the user, the department and the role and the size of the used space are obtained through an interface, and quota space is counted in real time.
CN201710973398.0A 2017-10-18 2017-10-18 Storage quota method based on user group Active CN107766001B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201710973398.0A CN107766001B (en) 2017-10-18 2017-10-18 Storage quota method based on user group

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201710973398.0A CN107766001B (en) 2017-10-18 2017-10-18 Storage quota method based on user group

Publications (2)

Publication Number Publication Date
CN107766001A CN107766001A (en) 2018-03-06
CN107766001B true CN107766001B (en) 2021-05-25

Family

ID=61268781

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201710973398.0A Active CN107766001B (en) 2017-10-18 2017-10-18 Storage quota method based on user group

Country Status (1)

Country Link
CN (1) CN107766001B (en)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108804709B (en) * 2018-06-22 2021-01-01 新华三云计算技术有限公司 Method and device for processing lock management message of shared file system and server
CN109308422A (en) * 2018-08-29 2019-02-05 北京航天云路有限公司 Build the sub- account system of enterprise-oriented multistage and method

Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1829962A (en) * 2003-08-01 2006-09-06 甲骨文国际公司 Dynamic reassignment of data ownership
CN101459597A (en) * 2007-12-14 2009-06-17 华为技术有限公司 Method and system for using logic resource
CN102340533A (en) * 2011-06-17 2012-02-01 中兴通讯股份有限公司 Multi-tenant system and method for accessing data thereof
CN102945139A (en) * 2011-09-12 2013-02-27 微软公司 Storage device drivers and cluster participation
CN104348881A (en) * 2013-08-08 2015-02-11 中国电信股份有限公司 Method and device for user resource partitioning in cloud management platform
CN105550854A (en) * 2016-01-26 2016-05-04 中标软件有限公司 Access control device of cloud environment management platform
CN106293521A (en) * 2016-08-02 2017-01-04 华中科技大学 A kind of mapping granule adaptive flash translation layer (FTL) management method
CN106385329A (en) * 2016-08-31 2017-02-08 华为数字技术(成都)有限公司 Processing method and device of resource pool and equipment
CN106843772A (en) * 2017-02-14 2017-06-13 郑州云海信息技术有限公司 A kind of system and method based on uniformity bus extension nonvolatile memory

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8327353B2 (en) * 2005-08-30 2012-12-04 Microsoft Corporation Hierarchical virtualization with a multi-level virtualization mechanism
CN102981929B (en) * 2012-11-05 2015-11-25 曙光云计算技术有限公司 The management method of disk mirroring and system
EP3040860A1 (en) * 2014-12-29 2016-07-06 NTT DoCoMo, Inc. Resource management in cloud systems
US10466922B2 (en) * 2015-12-07 2019-11-05 Netapp, Inc. Accelerating concurrent access to a file in a memory-based file system

Patent Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1829962A (en) * 2003-08-01 2006-09-06 甲骨文国际公司 Dynamic reassignment of data ownership
CN101459597A (en) * 2007-12-14 2009-06-17 华为技术有限公司 Method and system for using logic resource
CN102340533A (en) * 2011-06-17 2012-02-01 中兴通讯股份有限公司 Multi-tenant system and method for accessing data thereof
CN102945139A (en) * 2011-09-12 2013-02-27 微软公司 Storage device drivers and cluster participation
CN104348881A (en) * 2013-08-08 2015-02-11 中国电信股份有限公司 Method and device for user resource partitioning in cloud management platform
CN105550854A (en) * 2016-01-26 2016-05-04 中标软件有限公司 Access control device of cloud environment management platform
CN106293521A (en) * 2016-08-02 2017-01-04 华中科技大学 A kind of mapping granule adaptive flash translation layer (FTL) management method
CN106385329A (en) * 2016-08-31 2017-02-08 华为数字技术(成都)有限公司 Processing method and device of resource pool and equipment
CN106843772A (en) * 2017-02-14 2017-06-13 郑州云海信息技术有限公司 A kind of system and method based on uniformity bus extension nonvolatile memory

Also Published As

Publication number Publication date
CN107766001A (en) 2018-03-06

Similar Documents

Publication Publication Date Title
US10148743B2 (en) Optimization of computer system logical partition migrations in a multiple computer system environment
CN107667363B (en) Object-based storage cluster with multiple selectable data processing policies
US9122575B2 (en) Processing system having memory partitioning
Shoshani et al. Storage resource managers: Essential components for the grid
CN101997918B (en) Method for allocating mass storage resources according to needs in heterogeneous SAN (Storage Area Network) environment
US8515904B1 (en) Providing file sytem quota support for a file system having separated data and metadata
CN102934094B (en) Hierarchical allocation for file system storage device
US11609884B2 (en) Intelligent file system with transparent storage tiering
US10871911B2 (en) Reducing data amplification when replicating objects across different sites
US7325017B2 (en) Method of implementation of data storage quota
CN111651305B (en) Virtual machine backup method, virtual machine backup assembly and cloud computing system
US20240053886A1 (en) File operations in a distributed storage system
CN106570113B (en) Mass vector slice data cloud storage method and system
CN113190529A (en) Multi-tenant data sharing storage system suitable for MongoDB database
KR20210022121A (en) Methods and systems for maintaining storage device failure tolerance in a configurable infrastructure
CN107766001B (en) Storage quota method based on user group
US7958097B1 (en) Method and system for implementation of data storage quota
CN108304142A (en) A kind of data managing method and device
CN107566405B (en) Storage resource pooling method for quick access and copy
CN109558082B (en) Distributed file system
CN116340266A (en) Fine-grained file system and file read-write method
US11580078B2 (en) Providing enhanced security for object access in object-based datastores
CN113742030A (en) Cross-region service configuration method, device and storage medium
US11853616B2 (en) Identity-based access to volume objects
CN115600185B (en) Resource operation method and system of cloud native platform

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant