CN108170777A - A kind of distributed file system - Google Patents
A kind of distributed file system Download PDFInfo
- Publication number
- CN108170777A CN108170777A CN201711432663.0A CN201711432663A CN108170777A CN 108170777 A CN108170777 A CN 108170777A CN 201711432663 A CN201711432663 A CN 201711432663A CN 108170777 A CN108170777 A CN 108170777A
- Authority
- CN
- China
- Prior art keywords
- tenant
- user
- management module
- file
- catalogue
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/18—File system types
- G06F16/182—Distributed file systems
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/11—File system administration, e.g. details of archiving or snapshots
Abstract
The invention discloses a kind of distributed file system, including：Tenant's grade management module, for being directed to tenant, creates tenant's catalogue corresponding with tenant；User-level management module for being directed to the user of belonging tenant, creates User Catalog corresponding with the user under the corresponding tenant's catalogue of the tenant；Container levels management module for being directed to the storage container of belonging user, creates container catalogue corresponding with the storage container under the corresponding User Catalog of the user；File-level management module, for being directed to the data being stored in storage container, establishment file and write-in/deletion data into file under the corresponding container catalogue of the storage container.Distributed file system of the present invention is represented the logical construction of object storage with the bibliographic structure of file system, realizes that the data stored in distributed file system to object are managed.It realizes and is docked in distributed file system with object storage.
Description
Technical field
The present invention relates to distributed memory system technical field, more particularly to a kind of distributed file system.
Background technology
Distributed file system Ceph is a kind of current widely used distributed memory system, it supports block simultaneously
Storage, object storage and three kinds of storage modes of file system, the outstanding advantages such as have high-performance, can expand.Wherein, file system
It is that tissue and distribution are carried out to the space of file-storage device, is responsible for storage file and the file of deposit is protected and retrieved
System；Object storage is a kind of emerging storage mode, suitable for unstructured datas such as storage picture, videos, with mutual
The application and development of networking, internet data amount are continuously increased, and object storage will play a greater and greater role.Since object is deposited
Storage has the characteristics that the high speed of block storage simultaneously and file storage be conducive to it is shared, therefore more and more enterprises be more willing to using pair
As storage mode.
However docked in distributed file system with object storage end, it is convenient that object is deposited in distributed file system
Data management, migration or the access of storage are a more scabrous problems.
Invention content
In consideration of it, the present invention provides a kind of distributed file system, represent that object stores with the bibliographic structure of file system
Logical construction, to object storage data be managed, realize and docked in distributed file system with object storage.
To achieve the above object, the present invention provides following technical solution：
A kind of distributed file system, including：
Tenant's grade management module, for being directed to tenant, creates tenant's catalogue corresponding with tenant；
User-level management module for being directed to the user of belonging tenant, is created under the corresponding tenant's catalogue of the tenant
Build User Catalog corresponding with the user；
Container levels management module, for being directed to the storage container of belonging user, in the corresponding User Catalog of the user
It is lower to create container catalogue corresponding with the storage container；
File-level management module, for being directed to the data being stored in storage container, in the corresponding appearance of the storage container
Establishment file and write-in/deletion data into file under device catalogue.
Optionally, tenant grade management module be specifically used for receive client transmission for creating/delete rent
During the instruction at family, tenant's catalogue corresponding with the tenant is created/deletes according to described instruction.
Optionally, the user-level management module be specifically used for receive client transmission for creating/delete institute
When belonging to the instruction of the user of tenant, according to described instruction under the corresponding tenant's catalogue of the tenant establishment/deletion with it is described
The corresponding User Catalog of user.
Optionally, the container levels management module be specifically used for receive client transmission for creating/delete institute
When belonging to the instruction of the storage container of user, according to described instruction under the corresponding User Catalog of the user establishment/deletion with
The corresponding container catalogue of the storage container.
Optionally, the file-level management module be specifically used for receive client transmission be used in specified storage
In container during the instruction of write-in/deletion data, be written/delete under the corresponding container catalogue of the storage container according to described instruction
Except data.
Optionally, tenant's grade management module, the user-level management module, the container levels management module pass through tune
Catalogue is corresponded to, and pass through the function in calling interface library for deltreeing with the function creation for being used to create directory in interface library
Delete corresponding catalogue；
The file-level management module by calling interface library be used for create and open file function creation file or
Person opens file, and passes through in calling interface library and delete file for deleting the function of file；
The file-level management module is by being used to be written the function of data into file into file in calling interface library
Data are written.
Optionally, including Ceph distributed file systems.
As shown from the above technical solution, distributed file system provided by the present invention including tenant's grade management module, is used
Family grade management module, container levels management module and file-level management module, wherein, tenant's grade management module is used for for tenant,
Tenant's catalogue corresponding with tenant is created, user-level management module is used for the user for belonging tenant, corresponding in tenant
User Catalog corresponding to the user is created under tenant's catalogue, container levels management module is used to hold for the storage of belonging user
Device, creates container catalogue corresponding with storage container under the corresponding User Catalog of user, and file-level management module is used to be directed to
The data being stored in storage container establishment file and are write under the corresponding container catalogue of the storage container into file
Enter/delete data.
As it can be seen that distributed file system of the present invention, the logical construction of object storage is represented with the bibliographic structure of file system,
It realizes and the data of object storage is managed in distributed file system.Realize in distributed file system with object
Storage docking.
Description of the drawings
In order to illustrate more clearly about the embodiment of the present invention or technical scheme of the prior art, to embodiment or will show below
There is attached drawing needed in technology description to be briefly described, it should be apparent that, the accompanying drawings in the following description is only this
Some embodiments of invention, for those of ordinary skill in the art, without creative efforts, can be with
Other attached drawings are obtained according to these attached drawings.
Fig. 1 is a kind of schematic diagram of distributed file system provided in an embodiment of the present invention；
Fig. 2 is the logical construction schematic diagram of object storage mode in an embodiment；
Fig. 3 is with the schematic diagram of file storage catalogue representation object memory hierarchy in one embodiment of the invention.
Specific embodiment
In order to which those skilled in the art is made to more fully understand the technical solution in the present invention, below in conjunction with of the invention real
The attached drawing in example is applied, the technical solution in the embodiment of the present invention is clearly and completely described, it is clear that described implementation
Example is only part of the embodiment of the present invention, instead of all the embodiments.Based on the embodiments of the present invention, this field is common
Technical staff's all other embodiments obtained without making creative work, should all belong to protection of the present invention
Range.
It please refers to Fig.1, a kind of distributed file system provided in an embodiment of the present invention, including：
Tenant's grade management module 10, for being directed to tenant, creates tenant's catalogue corresponding with tenant；
User-level management module 11, for being directed to the user of belonging tenant, under the corresponding tenant's catalogue of the tenant
Create User Catalog corresponding with the user；
Container levels management module 12, for being directed to the storage container of belonging user, in the corresponding user's mesh of the user
Record is lower to create container catalogue corresponding with the storage container；
File-level management module 13, it is corresponding in the storage container for being directed to the data being stored in storage container
Establishment file and write-in/deletion data into file under container catalogue.
This distributed file system support target stores, and can refer to Fig. 2, is the logic of object storage mode in an embodiment
Structure diagram, the logical construction having for object storage mode are：It is divided into three layers of tenant, user and storage container, wherein
Storage container is used to store user data.Such as in logical construction schematic diagram shown in Fig. 2, user 1 and the belonging rent of user 2
Family 1 includes storage container 1 and storage container 2 corresponding to user 1, the number of storage user 1 in storage container 1 and storage container 2
According to；Storage container 3 and storage container 4 are included corresponding to user 2, the number of storage user 2 in storage container 3 and storage container 4
According to.
In this distributed file system, this tri-level logic knot of object storage is represented using the bibliographic structure of file system
Structure please refers to Fig.3, and is with the schematic diagram of file storage catalogue representation object memory hierarchy, object in an embodiment
The hierarchical structure of storage mode includes group family, user, storage container and object, corresponding, with the catalogue of document storage mode
The logical construction of representation object storage mode：Correspondence tenant creates tenant's catalogue, and the user of tenant is renting belonging to correspondence
User Catalog is created under the catalogue of family, the storage container of user belonging to correspondence creates container catalogue under User Catalog, and correspondence is deposited
It stores up the object in storage container establishment file, corresponding objects data under container catalogue and data is written in file.
In distributed file system described in the present embodiment, by tenant's grade management module 10 for tenant, establishment and tenant
Corresponding tenant's catalogue.Specifically, tenant grade management module 10 be specifically used for, receive client transmission for create/
When deleting the instruction of tenant, tenant's catalogue corresponding with the tenant is created/deletes according to described instruction.
User-level management module 11 is used for the user for belonging tenant, is created under the corresponding tenant's catalogue of the tenant
Build User Catalog corresponding with the user.Specifically, user-level management module 11 is specifically used for, sent receiving client
For creating/deleting the instruction of the user of belonging tenant when, according to described instruction in the corresponding tenant's catalogue of the tenant
Lower establishment/deletion User Catalog corresponding with the user.
Container levels management module 12 is used for the storage container for belonging user, in the corresponding User Catalog of the user
It is lower to create container catalogue corresponding with the storage container, specifically, the container levels management module 12 is specifically used for, receiving
To client send for creating/deleting the instruction of the storage container of belonging user when, according to described instruction in the use
Establishment/deletion container catalogue corresponding with the storage container under the corresponding User Catalog in family.
File-level management module 13 is used for for the data being stored in storage container, in the corresponding appearance of the storage container
Establishment file and write-in/deletion data into file under device catalogue.Specifically, file-level management module described in this system 13
It is specifically used for, is receiving when being used for the instruction of write-in/deletion data in specified storage container of client transmission, according to
Described instruction write-in/deletion data in the file under the corresponding container catalogue of the storage container.
Therefore the present embodiment distributed file system, realizes and is docked in distributed file system with object storage, energy
Enough client is stored by object to be written to file system or read file and the operations such as create directory, realize and be distributed
The data of object storage are managed in formula file system, facilitate the data stored in distributed file system to object
Management, migration access, and overcome the drawbacks of storage is unable to intercommunication between object storage and file system in the prior art.
In the specific implementation, can by calling interface library function realize create/deltree, establishment/deletion file and
The operation of data is written/deleted hereof.Specifically, tenant grade management module 10, the user-level management module 11,
The container levels management module 12 corresponds to catalogue, and pass through calling by the function creation for being used to create directory in calling interface library
The corresponding catalogue of function deletion in interface library for deltreeing.
The file-level management module 13 creates and opens the function creation file of file by being used in calling interface library
Or file is opened, and pass through in calling interface library and delete file for deleting the function of file.The file-level management module
13 data are written into file by being used to be written the function of data in calling interface library into file.
The present embodiment distributed file system can be applied to Ceph distributed file systems.Illustratively, actually should
Libcephfs interface libraries can be used with middle distributed file system, respective function therein is called to perform establishment/deletion mesh
The operation of data is deleted in record, establishment/deletion file and be written hereof/.This certain distributed file system can also answer
For other types of distributed file system.
A kind of distributed file system provided by the present invention is described in detail above.It is used herein specifically
A example is expounded the principle of the present invention and embodiment, and the explanation of above example is only intended to help to understand the present invention
Method and its core concept.It should be pointed out that for those skilled in the art, original of the invention is not being departed from
Under the premise of reason, can also to the present invention some improvement and modification can also be carried out, these improvement and modification also fall into right of the present invention will
In the protection domain asked.
Claims (7)
1. a kind of distributed file system, which is characterized in that including：
Tenant's grade management module, for being directed to tenant, creates tenant's catalogue corresponding with tenant；
User-level management module, for being directed to the user of belonging tenant, created under the corresponding tenant's catalogue of the tenant with
The corresponding User Catalog of the user；
Container levels management module for being directed to the storage container of belonging user, is created under the corresponding User Catalog of the user
Build container catalogue corresponding with the storage container；
File-level management module, for being directed to the data being stored in storage container, in the corresponding container mesh of the storage container
The lower establishment file of record and write-in/deletion data into file.
2. distributed file system according to claim 1, which is characterized in that tenant's grade management module is specifically used for
When being used to creating/deleting the instruction of tenant of client transmission is being received, is creating/deletes and the tenant according to described instruction
Corresponding tenant's catalogue.
3. distributed file system according to claim 1, which is characterized in that the user-level management module is specifically used for
In the instruction for the user for being used to create/delete belonging tenant for receiving client transmission, according to described instruction described
Establishment/deletion User Catalog corresponding with the user under the corresponding tenant's catalogue of tenant.
4. distributed file system according to claim 1, which is characterized in that the container levels management module is specifically used for
In the instruction for the storage container for being used to create/delete belonging user for receiving client transmission, existed according to described instruction
Establishment/deletion container catalogue corresponding with the storage container under the corresponding User Catalog of the user.
5. distributed file system according to claim 1, which is characterized in that the file-level management module is specifically used for
When being used for the instruction of write-in/deletion data in specified storage container of client transmission is being received, according to described instruction
Write-in/deletion data under the corresponding container catalogue of the storage container.
6. according to claim 1-5 any one of them distributed file systems, which is characterized in that tenant's grade management mould
Block, the user-level management module, the container levels management module are created by the function for being used to create directory in calling interface library
Corresponding catalogue is built, and passes through the corresponding catalogue of function deletion in calling interface library for deltreeing；
The file-level management module in calling interface library by being used to creating and opening the function creation file of file or beat
Open file, and pass through in calling interface library and delete file for deleting the function of file；
The file-level management module is written by being used to be written the function of data in calling interface library into file into file
Data.
7. distributed file system according to claim 1, which is characterized in that including Ceph distributed file systems.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711432663.0A CN108170777A (en) | 2017-12-26 | 2017-12-26 | A kind of distributed file system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711432663.0A CN108170777A (en) | 2017-12-26 | 2017-12-26 | A kind of distributed file system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN108170777A true CN108170777A (en) | 2018-06-15 |
Family
ID=62520986
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201711432663.0A Pending CN108170777A (en) | 2017-12-26 | 2017-12-26 | A kind of distributed file system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108170777A (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109002730A (en) * | 2018-07-26 | 2018-12-14 | 郑州云海信息技术有限公司 | A kind of file system directories right management method, device, equipment and storage medium |
| CN109408467A (en) * | 2018-11-19 | 2019-03-01 | 郑州云海信息技术有限公司 | A kind of method and device for realizing data storage |
| CN112434321A (en) * | 2020-12-01 | 2021-03-02 | 武汉绿色网络信息服务有限责任公司 | Data storage method and device, computer equipment and storage medium |
| CN112631739A (en) * | 2021-03-09 | 2021-04-09 | 北京世纪好未来教育科技有限公司 | Container control method and device, medium and computer equipment |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103064927A (en) * | 2012-12-21 | 2013-04-24 | 曙光信息产业(北京)有限公司 | Data access method and device of distributed file system |
| CN103605698A (en) * | 2013-11-06 | 2014-02-26 | 广东电子工业研究院有限公司 | Cloud database system used for distributed heterogeneous data resource integration |
| US20140101098A1 (en) * | 2008-10-31 | 2014-04-10 | Arnaud Robert | System and Method for Updating Digital Media Content |
| CN104506487A (en) * | 2014-11-21 | 2015-04-08 | 北京工业大学 | Credible execution method for privacy policy in cloud environment |
| CN105045656A (en) * | 2015-06-30 | 2015-11-11 | 深圳清华大学研究院 | Virtual container based big data storage and management method |
| CN107070946A (en) * | 2017-05-19 | 2017-08-18 | 济南浪潮高新科技投资发展有限公司 | The cloud storage system realized based on openstack |
| CN107391669A (en) * | 2017-07-20 | 2017-11-24 | 郑州云海信息技术有限公司 | A kind of multi version file management method and device based on file system |
-
2017
- 2017-12-26 CN CN201711432663.0A patent/CN108170777A/en active Pending
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20140101098A1 (en) * | 2008-10-31 | 2014-04-10 | Arnaud Robert | System and Method for Updating Digital Media Content |
| CN103064927A (en) * | 2012-12-21 | 2013-04-24 | 曙光信息产业(北京)有限公司 | Data access method and device of distributed file system |
| CN103605698A (en) * | 2013-11-06 | 2014-02-26 | 广东电子工业研究院有限公司 | Cloud database system used for distributed heterogeneous data resource integration |
| CN104506487A (en) * | 2014-11-21 | 2015-04-08 | 北京工业大学 | Credible execution method for privacy policy in cloud environment |
| CN105045656A (en) * | 2015-06-30 | 2015-11-11 | 深圳清华大学研究院 | Virtual container based big data storage and management method |
| CN107070946A (en) * | 2017-05-19 | 2017-08-18 | 济南浪潮高新科技投资发展有限公司 | The cloud storage system realized based on openstack |
| CN107391669A (en) * | 2017-07-20 | 2017-11-24 | 郑州云海信息技术有限公司 | A kind of multi version file management method and device based on file system |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109002730A (en) * | 2018-07-26 | 2018-12-14 | 郑州云海信息技术有限公司 | A kind of file system directories right management method, device, equipment and storage medium |
| CN109408467A (en) * | 2018-11-19 | 2019-03-01 | 郑州云海信息技术有限公司 | A kind of method and device for realizing data storage |
| CN112434321A (en) * | 2020-12-01 | 2021-03-02 | 武汉绿色网络信息服务有限责任公司 | Data storage method and device, computer equipment and storage medium |
| WO2022116847A1 (en) * | 2020-12-01 | 2022-06-09 | 武汉绿色网络信息服务有限责任公司 | Data storage method and apparatus, computer device, and storage medium |
| CN112631739A (en) * | 2021-03-09 | 2021-04-09 | 北京世纪好未来教育科技有限公司 | Container control method and device, medium and computer equipment |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108170777A (en) | A kind of distributed file system | |
| CN104731921B (en) | Storage and processing method of the Hadoop distributed file systems for log type small documents | |
| US11321275B2 (en) | Technologies for migrating content items from a server on a network to an online content management system | |
| EP2310958B1 (en) | A novel media file access and storage solution for multi-workstation/multi-platform non-linear video editing systems | |
| CN108389118A (en) | The asset management system, method and device, electronic equipment | |
| CN107172168A (en) | A kind of mixed cloud data storage moving method and system | |
| CN113077171B (en) | Single sign-on management information system for multiplexing collaboration between organizations | |
| US20180089033A1 (en) | Performing data backups using snapshots | |
| CN103514249B (en) | A kind of automatic data reduction and system and storage device | |
| CN101315621A (en) | Method for implementing document sharing editting | |
| CN105550246B (en) | The system and method for load networks picture under Android platform | |
| CN106406765B (en) | Heterogeneous distributed storage system and its file management method based on file link | |
| CN102377827A (en) | Multilevel cloud storage system and storage method thereof | |
| CN107291889A (en) | A kind of date storage method and system | |
| CN106775446A (en) | Based on the distributed file system small documents access method that solid state hard disc accelerates | |
| US11463446B2 (en) | Team member transfer tool | |
| CN101398823A (en) | Method and system for implementing remote storage by virtual file systems technology | |
| CN106462631A (en) | Consistent views of partitioned data in eventually consistent systems | |
| CN109002730A (en) | A kind of file system directories right management method, device, equipment and storage medium | |
| CN107832392A (en) | A kind of metadata management system | |
| CN106330996A (en) | Cloud desktop roaming method, device and system | |
| CN106802955A (en) | A kind of image data caching method | |
| CN113010479A (en) | File management method, device and medium | |
| CN103036952B (en) | A kind of enterprise-level isomery merges storage management system | |
| CN109753360A (en) | Lightweight data management system and method towards fringe node in electric system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20180615 |