CN106919713A - A kind of cluster file system and distributed file system multi-client document control method - Google Patents
A kind of cluster file system and distributed file system multi-client document control method Download PDFInfo
- Publication number
- CN106919713A CN106919713A CN201710146257.1A CN201710146257A CN106919713A CN 106919713 A CN106919713 A CN 106919713A CN 201710146257 A CN201710146257 A CN 201710146257A CN 106919713 A CN106919713 A CN 106919713A
- Authority
- CN
- China
- Prior art keywords
- function
- file system
- client
- call back
- file
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 25
- 230000006870 function Effects 0.000 description 82
- 239000011800 void material Substances 0.000 description 33
- 101150026173 ARG2 gene Proteins 0.000 description 11
- 101100005166 Hypocrea virens cpa1 gene Proteins 0.000 description 10
- 101100379634 Xenopus laevis arg2-b gene Proteins 0.000 description 10
- 101100379633 Xenopus laevis arg2-a gene Proteins 0.000 description 9
- 101150088826 arg1 gene Proteins 0.000 description 9
- 101100323865 Xenopus laevis arg1 gene Proteins 0.000 description 2
- 238000004590 computer program Methods 0.000 description 2
- 238000010586 diagram Methods 0.000 description 2
- WGZDBVOTUVNQFP-UHFFFAOYSA-N N-(1-phthalazinylamino)carbamic acid ethyl ester Chemical compound C1=CC=C2C(NNC(=O)OCC)=NN=CC2=C1 WGZDBVOTUVNQFP-UHFFFAOYSA-N 0.000 description 1
- VQLYBLABXAHUDN-UHFFFAOYSA-N bis(4-fluorophenyl)-methyl-(1,2,4-triazol-1-ylmethyl)silane;methyl n-(1h-benzimidazol-2-yl)carbamate Chemical compound C1=CC=C2NC(NC(=O)OC)=NC2=C1.C=1C=C(F)C=CC=1[Si](C=1C=CC(F)=CC=1)(C)CN1C=NC=N1 VQLYBLABXAHUDN-UHFFFAOYSA-N 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 235000013399 edible fruits Nutrition 0.000 description 1
- 239000004744 fabric Substances 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000008569 process Effects 0.000 description 1
- 230000000638 stimulation Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/18—File system types
- G06F16/182—Distributed file systems
- G06F16/1824—Distributed file systems implemented using Network-attached Storage [NAS] architecture
- G06F16/183—Provision of network file services by network file servers, e.g. by using NFS, CIFS
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Databases & Information Systems (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The present invention provides a kind of new cluster file system and distributed file system multi-client document control method.The present invention is by way of registered callbacks function, when the file of client operation distributed file system, the client of all file system of warp-wise registrations can all receive the operation of this document, and then perform call back function, corresponding operation is performed, so as to reach the control of multi-client.The present invention realizes simply, can be good at being controlled the operation of file.
Description
Technical field
The present invention relates to computer realm, and in particular to a kind of cluster file system and distributed file system multi-client
Document control method.
Background technology
Into after the information age, with continuing to develop for technology, in all trades and professions, the demand for storing is in geometry
Trend is incremented by, and this results in conventional local file system cannot meet the demand of business.Then, in the stimulation of application demand
Under, various types of distributed file system is arisen at the historic moment, such as CEPH, Lustre, GPFS, Google FS.
For distributed file system, due to its client distribution on different physical machines, therefore it is different
Client is mutually sightless for the operation of file system metadata and data.Common client protection NFS, FUSE,
CIFS etc..For the client for having caching, client can hold documentary reference count after establishment file, at this time such as
The other clients of fruit are gone to delete this document, and by the reference count of file is held by other clients, then file is deleted not
Success, space does not discharge.
Therefore a kind of new cluster file system and distributed file system multi-client document control method are that have must
Want.
The content of the invention
In order to solve the above technical problems, technical scheme is as follows：
The present invention provides a kind of cluster file system, including distributed file system and is mounted to cluster file system
Multiple client, is added with readjustment registration function in distributed file system, the treatment to call back function, Duo Geke are provided respectively
The call back function for oneself defining is registered in family end by interface to file system respectively, after client executing file operation, distribution
Formula file system receives request, after treatment, performs readjustment and deletes all of call back function in function queue, and corresponding client is held
The registered function of row, in the attribute information of more new file to the caching of oneself.
Further, the readjustment registration function added in distributed file system is by stating function pointer, one, statement
Structure comprising the function pointer, the registration interface for defining call back function are realized.
Further, multiple client registers the call back function for oneself defining by sound by interface to file system respectively
A bright function pointer, the actual call back function for performing of definition, by function pointer initialization, by interface function to file system
The call back function of oneself definition is registered to realize.
Further, the function that corresponding client executing is registered is file_op_update.
Further, client be NFS clients, CIFS clients, FUSE clients, NFS-Ganesha clients it
One.
In addition the present invention also provides a kind of method of distributed file system multi-client document control, including following step
Suddenly：
SS1：Readjustment registration function is added in distributed file system, the treatment to call back function is provided respectively；
SS2：Client registers the call back function for oneself defining by interface to file system respectively；
SS3：Client executing file operation, distributed file system receives request, after treatment, performs readjustment and deletes function
All of call back function in queue, the attribute information of the function that corresponding client executing is registered, more new file to oneself
In caching.
Further, step SS1 specifically includes following steps：
1) statement function pointer client_ino_callback_t
2) statement function pointer client_dentry_callback_t
3) statement function pointer client_remount_callback_t
4) statement function pointer client_getgroups_callback_t
5) structure is stated, comprising 1) -4) four function pointers
6) registration interface of call back function is defined.
Further, step SS2 specifically includes following steps：
1) a function pointer file_op_callback is stated
2) the actual call back function file_op_update for performing is defined
3) function pointer args is initialized as file_op_update
4) and then by interface function nfs_reg_cb the call back function for oneself defining is registered to file system.
Further, the function that corresponding client executing is registered in step SS3 is file_op_update.
Further, client can be NFS clients, CIFS clients, FUSE clients, NFS-Ganesha client
One of end.
By cluster file system of the invention and the document control method of the multi-client of distributed file system, point
Cloth file system provides readjustment registration function, and client wants distributed file system registers the call back function of oneself, when other
When client executing is operated, the client function for performing all registered callbacks can be adjusted back.So complete distributed file system
File under multi-client is accurately controlled.
Brief description of the drawings
Fig. 1 shows cluster file system structured flowchart of the present invention.
Fig. 2 shows that the present invention realizes the method flow diagram of distributed file system multi-client document control.
Specific embodiment
Technical scheme is further illustrated below in conjunction with Figure of description and specific embodiment.It should be appreciated that this
The described specific embodiment in place is only used to explain the present invention, is not intended to limit the present invention.
The present invention proposes a kind of new cluster file system and distributed file system multi-client document control side
Method, the purpose of the present invention is to realize that distributed file system is accurately controlled to file under multi-client.
The invention is characterized in that providing readjustment registration function in distributed file system, client is to distributed file system
The call back function of oneself is registered, when other client executings are operated, the client function for performing all registered callbacks can be adjusted back.
Implement process as follows：
Fig. 1 shows cluster file system structured flowchart of the present invention.
As shown in figure 1, cluster file system according to embodiments of the present invention, including：Distributed file system and carry
Readjustment registration function is added with to the multiple client of cluster file system, in distributed file system, provides right respectively
The treatment of inode, dentry, mount, groups call back function, multiple client is registered by interface to file system respectively
The call back function of oneself definition, after client executing file operation, distributed file system receives request, after treatment, performs
Readjustment deletes all of call back function, the attribute of the function that corresponding client executing is registered, more new file in function queue
Information is in the caching of oneself.
In one embodiment of the invention, client can for NFS clients, CIFS clients, FUSE clients,
NFS-Ganesha clients etc..
In one embodiment of the invention, the readjustment registration function added in distributed file system is by stating function
Pointer, one structure comprising the function pointer of statement, the registration interface for defining call back function are realized.
In one embodiment of the invention, multiple client registers what oneself was defined by interface to file system respectively
Call back function by stating the actual call back function for performing of function pointer, definition, function pointer is initialized, by interface
Function is realized to the call back function that file system registers oneself definition.
In one embodiment of the invention, the function that corresponding client executing is registered is file_op_update.
Fig. 2 is one embodiment of the invention for realizing distributed file system many clients in above-mentioned cluster file system
Hold the method flow diagram of document control.
As shown in Fig. 2 according to embodiments of the present invention realizes distributed file system multi-client document control method, bag
Include：
SS1：Readjustment registration function is added in distributed file system, the treatment to call back function is provided respectively；
SS2：Client registers the call back function for oneself defining by interface to file system respectively；
SS3：Client executing file operation, distributed file system receives request, after treatment, performs readjustment and deletes function
All of call back function in queue, the attribute information of the function that corresponding client executing is registered, more new file to oneself
In caching.
In one embodiment of the invention, client can for NFS clients, CIFS clients, FUSE clients,
NFS-Ganesha clients etc..
In one embodiment of the invention, step SS1 specifically includes following steps：
1) statement function pointer client_ino_callback_t
Typedef void (* client_ino_callback_t) (void*arg1, void*arg2, void*arg3,
void*arg4)；
// state a pointer client_ino_callback_t, the pointer point to parameter be argl, arg2, arg3,
Arg4, return value is the function of void.
2) statement function pointer client_dentry_callback_t
Typedef void (* client_dentry_callback_t) (void*arg1, void*arg2, void*
Arg3, void*arg4)；
// state a pointer client_dentry_callback_t, the pointer point to parameter be arg1, arg2,
Arg3, arg4, return value are the function of void.
3) statement function pointer client_remount_callback_t
Typedef void (* client_remount_callback_t) (void*arg1, void*arg2, void*
Arg3, void*arg4)；
// state a pointer client_remount_callback_t, the pointer point to parameter be arg1, arg2,
Arg3, arg4, return value are the function of void.
4) statement function pointer client_getgroups_callback_t
Typedef void (* client_getgroups_callback_t) (void*arg1, void*arg2, void*
Arg3, void*arg4)；
// state a pointer client_getgroups_callback_t, the pointer point to parameter be arg1,
Arg2, arg3, arg4, return value are the function of void.
5) structure is stated, comprising 1) -4) four function pointers
6) registration interface of call back function is defined
In one embodiment of the invention, step SS2 specifically includes following steps：
1) a function pointer file_op_callback is stated
Typedefvoid (* file_op_callback) (void*argl, void*arg2, void*arg3, void*
arg4)；
2) the actual call back function file_op_update for performing is defined
Void file_op_update (void*arg1, void*arg2, void*arg3, void*arg4)
Update_file_attrs (arg1, arg2, arg3, arg4)；
}
// actual the operation for performing, the i.e. operation of more new file
3) function pointer args is initialized as file_op_update
File_op_callback args=file_op_update；//
4) call back function for oneself defining and then by interface function nfs_reg_cb is registered to file system, nfs_ is performed
Reg_cb (cmount, args)；
In one embodiment of the invention, the function that corresponding client executing is registered in step SS3 is file_
op_update。
The present invention by way of registered callbacks function, when the file of client operation distributed file system,
The client of all file system of warp-wise registrations can all receive the operation of this document, and then perform call back function, perform correspondence
Operation.So as to reach the control of multi-client.
This patent is realized simply, can be good at being controlled the operation of file.
Although in terms of having been described for some in the context of device, it is apparent that these aspects also illustrate that corresponding method
Description, the feature of wherein block or apparatus and method for step or method and step is corresponding.Similarly, in the context of method and step
Described in each side also illustrate that corresponding piece or project or corresponding intrument feature description.Can be by (or use)
Hardware unit such as microprocessor, programmable calculator or electronic circuit etc is some or all of in method and step to perform.
Can be performed by such device in most important method and step some or it is multiple.
The realization can using hardware or using software or can using such as floppy disk, DVD, blue light, CD, ROM,
PROM, EPROM, EEPROM's or flash memory etc is situated between with the stored digital for being stored in electronically readable control signal thereon
Matter is performed, and the electronically readable control signal coordinates (or can coordinate with it) to cause to perform with programmable computer system
Corresponding method.The data medium with electronically readable control signal can be provided, the electronically readable control signal can be with
Programmable computer system coordinates to cause to perform approach described herein.
The realization can also work as computer program product in the form of the computer program product with program code
When running on computers, program code is operated to perform the method.Can in machine-readable carrier storage program generation
Code.
Described above be only it is illustrative, and it is to be understood that it is described herein arrangement and details modification and
Change will be apparent to those skilled in the art.It is therefore intended that only by scope of the following claims rather than by
The specific detail that is presented is limited above description and by way of explaining.
Claims (10)
1. a kind of cluster file system, including distributed file system and the multiple client of cluster file system is mounted to,
Characterized in that, being added with readjustment registration function in distributed file system, the treatment to call back function, Duo Geke are provided respectively
The call back function for oneself defining is registered in family end by interface to file system respectively, after client executing file operation, distribution
Formula file system receives request, after treatment, performs readjustment and deletes all of call back function in function queue, and corresponding client is held
The registered function of row, in the attribute information of more new file to the caching of oneself.
2. cluster file system according to claim 1, it is characterised in that the readjustment note added in distributed file system
Volume function is by the registration interface stating function pointer, one structure comprising the function pointer of statement, define call back function
To realize.
3. cluster file system according to claim 2, it is characterised in that multiple client is respectively by interface to file
The call back function of system registry oneself definition is by stating the actual call back function for performing of function pointer, definition, by function
Pointer initialization, the call back function for oneself defining is registered to file system by interface function realize.
4. cluster file system according to claim 3, it is characterised in that the function that corresponding client executing is registered
It is file_op_update.
5. cluster file system according to claim 1, it is characterised in that client is NFS clients, CIFS client
One of end, FUSE clients, NFS-Ganesha clients.
6. a kind of method of distributed file system multi-client document control, it is characterised in that comprise the following steps：
SS1：Readjustment registration function is added in distributed file system, the treatment to call back function is provided respectively；
SS2：Client registers the call back function for oneself defining by interface to file system respectively；
SS3：Client executing file operation, distributed file system receives request, after treatment, performs readjustment and deletes function queue
In all of call back function, the attribute information of the function that corresponding client executing is registered, more new file to the caching of oneself
In.
7. method according to claim 6, it is characterised in that step SS1 specifically includes following steps：
1) statement function pointer client_ino_callback_t
2) statement function pointer client_dentry_callback_t
3) statement function pointer client_remount_callback_t
4) statement function pointer client_getgroups_callback_t
5) structure is stated, comprising 1) -4) four function pointers
6) registration interface of call back function is defined.
8. method according to claim 7, it is characterised in that step SS2 specifically includes following steps：
1) a function pointer file_op_callback is stated
2) the actual call back function file_op_update for performing is defined
3) function pointer args is initialized as file_op_update
4) and then by interface function nfs_reg_cb the call back function for oneself defining is registered to file system.
9. method according to claim 8, it is characterised in that the letter that corresponding client executing is registered in step SS3
Number is file_op_update.
10. method according to claim 6, it is characterised in that client can for NFS clients, CIFS clients,
One of FUSE clients, NFS-Ganesha clients.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710146257.1A CN106919713B (en) | 2017-03-13 | 2017-03-13 | Cluster file system and distributed file system multi-client file control method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710146257.1A CN106919713B (en) | 2017-03-13 | 2017-03-13 | Cluster file system and distributed file system multi-client file control method |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN106919713A true CN106919713A (en) | 2017-07-04 |
| CN106919713B CN106919713B (en) | 2021-03-16 |
Family
ID=59462157
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710146257.1A Active CN106919713B (en) | 2017-03-13 | 2017-03-13 | Cluster file system and distributed file system multi-client file control method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106919713B (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108900607A (en) * | 2018-06-28 | 2018-11-27 | 郑州云海信息技术有限公司 | A kind of processing method, device and the server of SMB agreement request |
Citations (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102387204A (en) * | 2011-10-21 | 2012-03-21 | 中国科学院计算技术研究所 | Method and system for maintaining consistency of cluster caching |
| CN102541984A (en) * | 2011-10-25 | 2012-07-04 | 曙光信息产业(北京)有限公司 | File system of distributed type file system client side |
| CN103853613A (en) * | 2012-12-04 | 2014-06-11 | 中山大学深圳研究院 | Method for reading data based on digital family content under distributed storage |
| CN103873523A (en) * | 2012-12-14 | 2014-06-18 | 北京东方通科技股份有限公司 | Client cluster access method and device |
| CN103995752A (en) * | 2014-06-16 | 2014-08-20 | 上海斐讯数据通信技术有限公司 | Intermodule notification callback method and module interaction structure |
| CN104113587A (en) * | 2014-06-23 | 2014-10-22 | 华中科技大学 | Client metadata buffer optimization method of distributed file system |
| CN104601702A (en) * | 2015-01-19 | 2015-05-06 | 迈普通信技术股份有限公司 | Cluster remote procedure call method and system |
| CN105700939A (en) * | 2016-04-21 | 2016-06-22 | 北京京东尚科信息技术有限公司 | Method and system for multi-thread synchronization in distributed system |
| CN106130868A (en) * | 2016-06-02 | 2016-11-16 | 腾讯科技（深圳）有限公司 | A kind of processing method adjusting back message and queue management system |
| US20170011055A1 (en) * | 2005-09-09 | 2017-01-12 | William M Pitts | Presentation of search results |
| CN106357723A (en) * | 2016-08-15 | 2017-01-25 | 杭州古北电子科技有限公司 | Synchronous system and method for multi-cluster information caching based on cloud host |
-
2017
- 2017-03-13 CN CN201710146257.1A patent/CN106919713B/en active Active
Patent Citations (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20170011055A1 (en) * | 2005-09-09 | 2017-01-12 | William M Pitts | Presentation of search results |
| CN102387204A (en) * | 2011-10-21 | 2012-03-21 | 中国科学院计算技术研究所 | Method and system for maintaining consistency of cluster caching |
| CN102541984A (en) * | 2011-10-25 | 2012-07-04 | 曙光信息产业(北京)有限公司 | File system of distributed type file system client side |
| CN103853613A (en) * | 2012-12-04 | 2014-06-11 | 中山大学深圳研究院 | Method for reading data based on digital family content under distributed storage |
| CN103873523A (en) * | 2012-12-14 | 2014-06-18 | 北京东方通科技股份有限公司 | Client cluster access method and device |
| CN103995752A (en) * | 2014-06-16 | 2014-08-20 | 上海斐讯数据通信技术有限公司 | Intermodule notification callback method and module interaction structure |
| CN104113587A (en) * | 2014-06-23 | 2014-10-22 | 华中科技大学 | Client metadata buffer optimization method of distributed file system |
| CN104601702A (en) * | 2015-01-19 | 2015-05-06 | 迈普通信技术股份有限公司 | Cluster remote procedure call method and system |
| CN105700939A (en) * | 2016-04-21 | 2016-06-22 | 北京京东尚科信息技术有限公司 | Method and system for multi-thread synchronization in distributed system |
| CN106130868A (en) * | 2016-06-02 | 2016-11-16 | 腾讯科技（深圳）有限公司 | A kind of processing method adjusting back message and queue management system |
| CN106357723A (en) * | 2016-08-15 | 2017-01-25 | 杭州古北电子科技有限公司 | Synchronous system and method for multi-cluster information caching based on cloud host |
Non-Patent Citations (1)
| Title |
|---|
| 王涌: "面向PB级存储系统的元数据集群管理容错方法研究与实现", 《中国优秀硕士学位论文全文数据库 信息科技辑》 * |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108900607A (en) * | 2018-06-28 | 2018-11-27 | 郑州云海信息技术有限公司 | A kind of processing method, device and the server of SMB agreement request |
Also Published As
| Publication number | Publication date |
|---|---|
| CN106919713B (en) | 2021-03-16 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US8683156B2 (en) | Format-preserving deduplication of data | |
| CN109409121B (en) | Desensitization processing method and device and server | |
| US8615499B2 (en) | Estimating data reduction in storage systems | |
| CN107577420B (en) | File processing method and device and server | |
| US20170031563A1 (en) | Method and apparatus for display control and electronic device | |
| DE202014004555U1 (en) | Device for generating user interfaces from a template | |
| CN107977396B (en) | Method and device for updating data table of KeyValue database | |
| CN109522332A (en) | Customer profile data merging method, device, equipment and readable storage medium storing program for executing | |
| US20190391961A1 (en) | Storing Data Files in a File System | |
| CN111865970A (en) | Method and apparatus for implementing interface idempotency | |
| CN106294549A (en) | A kind of image processing method and terminal | |
| JP6193406B2 (en) | Serialization for differential encoding | |
| US10303655B1 (en) | Storage array compression based on the structure of the data being compressed | |
| CN108363727B (en) | Data storage method and device based on ZFS file system | |
| CN106919713A (en) | A kind of cluster file system and distributed file system multi-client document control method | |
| EP3477462A2 (en) | Tenant aware, variable length, deduplication of stored data | |
| CN112272137A (en) | Mass data management in communication applications through multiple mailboxes | |
| TW201619801A (en) | Method and system for displaying files | |
| CN109063215B (en) | Data retrieval method and device | |
| CN111104382A (en) | File default naming method and device and electronic equipment | |
| WO2019104923A1 (en) | Database separation design method and apparatus, database calling method and apparatus, terminal device, and readable storage medium | |
| US9111015B1 (en) | System and method for generating a point-in-time copy of a subset of a collectively-managed set of data items | |
| CN111241099A (en) | Industrial big data storage method and device | |
| CN108804533B (en) | Heterogeneous big data information filtering method and device | |
| CN103902686A (en) | Data duplicate removing method and data duplicate removing device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| TA01 | Transfer of patent application right | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20210207 Address after: Building 9, No.1, guanpu Road, Guoxiang street, Wuzhong Economic Development Zone, Wuzhong District, Suzhou City, Jiangsu Province Applicant after: SUZHOU LANGCHAO INTELLIGENT TECHNOLOGY Co.,Ltd. Address before: Room 1601, 16 / F, 278 Xinyi Road, Zhengdong New District, Zhengzhou City, Henan Province, 450000 Applicant before: ZHENGZHOU YUNHAI INFORMATION TECHNOLOGY Co.,Ltd. |
|
| GR01 | Patent grant | ||
| GR01 | Patent grant |