CN101079053A - ContextFS based file management method - Google Patents

ContextFS based file management method Download PDF

Info

Publication number
CN101079053A
CN101079053A CN 200710069838 CN200710069838A CN101079053A CN 101079053 A CN101079053 A CN 101079053A CN 200710069838 CN200710069838 CN 200710069838 CN 200710069838 A CN200710069838 A CN 200710069838A CN 101079053 A CN101079053 A CN 101079053A
Authority
CN
China
Prior art keywords
file
user
context
copy
write
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN 200710069838
Other languages
Chinese (zh)
Inventor
杨建华
汤斯亮
吴朝晖
陶美军
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Zhejiang University ZJU
Original Assignee
Zhejiang University ZJU
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Zhejiang University ZJU filed Critical Zhejiang University ZJU
Priority to CN 200710069838 priority Critical patent/CN101079053A/en
Publication of CN101079053A publication Critical patent/CN101079053A/en
Pending legal-status Critical Current

Links

Images

Abstract

The invention relates to a method of file administration based on the context file system ( ContextFS), which comprises the following steps: the user copy: dissolving the conflicts with the method of the user copy in the context file system if a plurality of users read and write the same file and maintaining the consistency of name space; the file saving: determining the final saving position of the new creating user file and copy according to user self defining, the current context, and user' s fancy; filing: filing and saving the long term no using file. The invention has the advantages: 1. dissolving the conflicts that a plurality of users read and write the same file, and maintaining the he consistency of name space; 2. determining the optimum saving position in order to guarantee getting file quickly; 3. filing and saving the long term no using file in order to reduce the saving value.

Description

A kind of file management method based on the ContextFS context file systems
Technical field
The present invention relates to the file management field, mainly is a kind of file management method based on the ContextFS context file systems.
Background technology
In some scene of context file systems, the situation that a plurality of users of the unavoidable generation of meeting read and write same file, the present invention need solve these conflicts, keeps the consistance of NameSpace simultaneously again; In addition owing to only provide virtual directory and virtual file based on the ContextFS context file systems, final user file can disperse to be stored in the backstage file server in the whole space, the present invention also needs to solve the memory location of how determining an optimum by the document storage method, to guarantee the problem of obtaining fast of file; Consider the finiteness of device storage capacity in the system at last, also need long-term obsolete file is promptly filed stores processor to the file that is in unused state for a long time.
Summary of the invention
The present invention will solve the existing defective of above-mentioned technology, a kind of file management method based on the ContextFS context file systems is provided, utilizing context to drive provides the characteristic of taking the initiative in offering a hand, different storage and management strategies is adopted in file management in the ContextFS system, to improve performance, reduce storing cost, and safeguard the consistance of NameSpace.
The technical solution adopted for the present invention to solve the technical problems: this file management method based on the ContextFS context file systems comprises the steps:
1.1), user's copy: in context file systems,, adopt the method for user's copy to solve these conflicts, keep the consistance of NameSpace simultaneously again if produce the situation that a plurality of users read and write same file;
1.2), document storage: according to User Defined, current context, a plurality of factors of user preference, decide the user file of new establishment and the final deposit position of copy;
1.3), archive: to long-term obsolete file, promptly the file that is in unused state is for a long time filed storage.
The method of the copy of user described in the present invention comprises the steps:
2.1), user A sends the request of reading to file F in the presents system, its authority of systems inspection is not if having read right then return reading failure; If read right is arranged, then read request can return to user A with the data of asking immediately;
2.2.1), user A sends the request of writing to file F in the presents system, its authority of systems inspection is not if having write permission then return and write failure; If write permission is arranged, judge then whether the owner of file F is user A, if then returning, the file of user A writes success;
2.2.2), if not the file of user A, then create user's copy, file F is duplicated into file F.A, the metadata of file F.A is written into the file metadata storehouse, this copy except the physical location of the owner, storage with original is different, other file metadata is all consistent with original, file system is set the file F.A that preferential explicit user self is created, the operation map of file F in file F.A, is write data and returns and write success to user A in file F.A.
The method of document storage described in the present invention comprises the steps:
3.1), User Defined has limit priority, if User Defined the memory location of file, then deposit the file of generation according to self-defining position;
3.2) if the user does not have the deposit position of self-defined file, or owing to other reasons 3.1 can't satisfy, adopt this user's current context information to decide the deposit position of file, be system according to the positional information in the current context, select to deposit user file near user's background devices in the space;
3.3.1) if when occurring a plurality of alternative backstages file server in the space, optimal device will further be selected according to the contextual information in the current environment by system, storage means is according to user's file type decision, if temporary file is deposited according to the performance principle of priority, big file is deposited according to network bandwidth principle of priority, and small documents is then deposited according to the principle of memory capacity balance;
3.3.2) if when not having selectable backstage file server in the space, according to the user preference in the historical context, select user's place group or the current role of user to select a remote server that meets user preference to store.
The method of archive described in the present invention comprises the steps:
4.1), system is according to the capacity and the price of the backstage file server end memory device that ContextFS has been installed, and they are divided into from low to high a plurality of grades, the corresponding time of filing T of each grade;
4.2), surpass time of filing T when the time that this file A that is in certain grade is in unused state, then system promptly moves to A on the memory device that belongs to next grade automatically automatically to its filing of demoting;
4.3), read-only by the file filed, in case carry out write operation then produce new user's copy, archive file is deleted automatically.
The effect that the present invention is useful is: 1, adopt copy and corresponding management measure to solve a plurality of users same file is read and write the conflict of generation, keep the consistance of NameSpace simultaneously again.2,, determine the memory location of an optimum, to guarantee obtaining fast of file according to factors such as User Defined, current context, user preferences.3, the file that is in unused state is for a long time filed storage, reduce storing cost.
Description of drawings
Fig. 1 is that replica management of the present invention reads the process data process flow diagram;
Fig. 2 is a replica management ablation process data flowchart of the present invention;
Fig. 3 is a context of the invention file system architectural schematic;
Embodiment
The invention will be described further below in conjunction with drawings and Examples:
This copy management method based on the ContextFS context file systems of the present invention mainly comprises file read-write method, document storage method and archive method.
One, file read-write method
In some scene of context file systems, the situation that a plurality of users of the unavoidable generation of meeting read and write same file, native system adopts the method for user's copy to solve these conflicts, keeps the consistance of NameSpace simultaneously again.
1.1), user A sends the request of reading (request of reading is to begin to read the Y byte from skew X) to file F in the presents system, its authority of systems inspection is not if having read right then return reading failure; If read right is arranged, then read request can return to user A with the data of asking immediately;
1.2.1), user A sends the request of writing (request of writing is to begin to read the Y byte from skew X) to file F in the presents system, its authority of systems inspection is not if having write permission then return and write failure; If write permission is arranged, judge then whether the owner of file F is user A, if then returning, the file of user A writes success;
1.2.2), if not the file of user A, then create user's copy, file F is duplicated into file F.A, the metadata of file F.A is written into the file metadata storehouse, this copy except the physical location of the owner, storage with original is different, other file metadata is all consistent with original, file system is set the file F.A that preferential explicit user self is created, the operation map of file F in file F.A, is write data and returns and write success to user A in file F.A.
As depicted in figs. 1 and 2, when user A to the presents system in file F when carrying out read operation owing to there is not collision problem, read request can be returned immediately; Yet when user A when file F writes data, because the owner of file F and the user name of A do not conform to (owner who supposes F is public), at this moment context file systems can be created a new duplicate of the document, the owner except this copy, the physical location of storage is with outside original is different, other file metadata is all consistent with original, because two files are of the same name, file system is the file of explicit user self establishment preferentially, so file F conductively-closed in the virtual directory of user A, user A can only see copy F.A, and at this moment all operation natures to file F are mapped among the file F.A by context file systems.Each user will create new one's own wave file as long as nonself file made amendment, this wave file can be stored in user's appointed positions and preserve, only change file F.A content, and do not change the metadata of F.A, F can not reproduce, this has just solved the problem of multi-user's write conflict, keeps the consistance of NameSpace simultaneously again.
Two, document storage method
Because file system only provides virtual directory and virtual file, final user file can disperse to be stored in the backstage file server in the whole space (as Fig. 3), the document storage method of native system will be determined the memory location of an optimum, to guarantee obtaining fast of file.
The new user file of creating and the deposit position of copy are by multiple factor decision.Mainly according to factors such as User Defined, current context, user preferences, decide the final deposit position of file based on the document storage strategy of ContextFS context file systems.The document storage method is specific as follows:
2.1), User Defined has limit priority, if User Defined the memory location of file, then deposit the file of generation according to self-defining position.As user A is self-defined his file storage location is in the file server of backstage certain file server (IP address), the All Files and the copy that generate of A can preferentially be saved on this station server so.
2.2) if the user does not have the deposit position of self-defined file, or because other reasons 2.1 can't satisfy (server space deficiency etc.), native system adopts this user's current context information to decide the deposit position of file so.System selects to deposit user file near user's background devices in the space according to the positional information in the current context.As; User A uses a wireless notebook N, and the client that this notebook N had both installed ContextFS has been installed the backstage file server end of ContextFS again, so this equipment is the front-end equipment in the User Access Layer, also is the backstage file server.If user A has produced new user file in using the process of N, then under the situation that self-defined preference is not provided, preferentially deposit on the server N near the user.If the equipment that the user carries does not have the file storage ability, then file can be stored in the space near the user and have on the file server of storage capacity.
2.3.1) if when occurring a plurality of alternative backstages file server in the space, optimal device will further be selected according to the contextual information in the current environment by system, at this moment the context of Kao Lving comprises the performance of server, the network bandwidth, many-sides such as memory capacity.Storage policy is according to user's file type decision, if temporary file is deposited according to the performance principle of priority, big file is deposited according to network bandwidth principle of priority, and small documents is then deposited according to the principle of memory capacity balance.
2.3.2) if when not having selectable backstage file server in the space, according to the user preference in the historical context, select user's place group or the current role of user to select a remote server that meets user preference to store.As doctor A on motorbus, utilize the portable equipment of oneself to create file F, not having on the car can be for other equipment of storage F, and A does not have the memory location of self-defined file yet, system can be according to the role doctor of A and document storage custom (example of successfully depositing among the 2.3.1) at ordinary times thereof so, creates F on his computer of workplace (hospital).
Three, archive
Consider the finiteness of device storage capacity in the system, need promptly file storage to the file that is in unused state for a long time to long-term obsolete file, the archive strategy is specific as follows:
3.1), system is according to the capacity and the price of the backstage file server end memory device that ContextFS has been installed, and they are divided into from low to high a plurality of grades, the corresponding time of filing T of each grade.
3.2), surpass time of filing T when the time that this file A that is in certain grade is in unused state (not chosen by the corresponding virtual file), then system is automatically to its filing of demoting.Promptly automatically A is moved on the memory device that belongs to next grade.
3.3), read-only by the file filed, in case carry out write operation then produce new user's copy, archive file is deleted automatically.

Claims (4)

1, a kind of file management method based on the ContextFS context file systems is characterized in that:
1.1), user's copy: in context file systems,, adopt the method for user's copy to solve these conflicts, keep the consistance of NameSpace simultaneously again if produce the situation that a plurality of users read and write same file;
1.2), document storage: according to User Defined, current context, a plurality of factors of user preference, decide the user file of new establishment and the final deposit position of copy;
1.3), archive: to long-term obsolete file, promptly the file that is in unused state is for a long time filed storage.
2, the file management method based on the ContextFS context file systems according to claim 1, it is characterized in that: the method for described user's copy comprises the steps:
2.1), user A sends the request of reading to file F in the presents system, its authority of systems inspection is not if having read right then return reading failure; If read right is arranged, then read request can return to user A with the data of asking immediately;
2.2.1), user A sends the request of writing to file F in the presents system, its authority of systems inspection is not if having write permission then return and write failure; If write permission is arranged, judge then whether the owner of file F is user A, if then returning, the file of user A writes success;
2.2.2), if not the file of user A, then create user's copy, file F is duplicated into file F.A, the metadata of file F.A is written into the file metadata storehouse, this copy except the physical location of the owner, storage with original is different, other file metadata is all consistent with original, file system is set the file F.A that preferential explicit user self is created, the operation map of file F in file F.A, is write data and returns and write success to user A in file F.A.
3, the file management method based on the ContextFS context file systems according to claim 1 is characterized in that: described document storage method comprises the steps:
3.1), User Defined has limit priority, if User Defined the memory location of file, then deposit the file of generation according to self-defining position;
3.2) if the user does not have the deposit position of self-defined file, or owing to other reasons 3.1 can't satisfy, adopt this user's current context information to decide the deposit position of file, be system according to the positional information in the current context, select to deposit user file near user's background devices in the space;
3.3.1) if when occurring a plurality of alternative backstages file server in the space, optimal device will further be selected according to the contextual information in the current environment by system, storage means is according to user's file type decision, if temporary file is deposited according to the performance principle of priority, big file is deposited according to network bandwidth principle of priority, and small documents is then deposited according to the principle of memory capacity balance;
3.3.2) if when not having selectable backstage file server in the space, according to the user preference in the historical context, select user's place group or the current role of user to select a remote server that meets user preference to store.
4, the file management method based on the ContextFS context file systems according to claim 1 is characterized in that: described archive method comprises the steps:
4.1), system is according to the capacity and the price of the backstage file server end memory device that ContextFS has been installed, and they are divided into from low to high a plurality of grades, the corresponding time of filing T of each grade;
4.2), surpass time of filing T when the time that this file A that is in certain grade is in unused state, then system promptly moves to A on the memory device that belongs to next grade automatically automatically to its filing of demoting;
4.3), read-only by the file filed, in case carry out write operation then produce new user's copy, archive file is deleted automatically.
CN 200710069838 2007-07-02 2007-07-02 ContextFS based file management method Pending CN101079053A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN 200710069838 CN101079053A (en) 2007-07-02 2007-07-02 ContextFS based file management method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN 200710069838 CN101079053A (en) 2007-07-02 2007-07-02 ContextFS based file management method

Publications (1)

Publication Number Publication Date
CN101079053A true CN101079053A (en) 2007-11-28

Family

ID=38906532

Family Applications (1)

Application Number Title Priority Date Filing Date
CN 200710069838 Pending CN101079053A (en) 2007-07-02 2007-07-02 ContextFS based file management method

Country Status (1)

Country Link
CN (1) CN101079053A (en)

Cited By (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101236569B (en) * 2008-02-01 2010-06-02 浙江大学 Highly effective dynamic path analysis method based on ContextFS
CN101840419A (en) * 2009-03-19 2010-09-22 赛门铁克公司 Be used for from the method for integral body backup restore data
CN104395898A (en) * 2012-04-27 2015-03-04 网络装置公司 Virtual storage appliance gateway
CN105528443A (en) * 2015-12-23 2016-04-27 北京金山安全软件有限公司 Application management method and device and electronic equipment
CN105704218A (en) * 2016-01-19 2016-06-22 国家电网公司 Data storage and management method in cloud computing platform
CN105740134A (en) * 2016-01-29 2016-07-06 浪潮(北京)电子信息产业有限公司 File based testing method and apparatus
CN108806773A (en) * 2018-05-21 2018-11-13 上海熙业信息科技有限公司 Medical image cloud storage platform designing method
CN109725997A (en) * 2018-08-17 2019-05-07 平安普惠企业管理有限公司 File open method, terminal and the storage medium of terminal applies

Cited By (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101236569B (en) * 2008-02-01 2010-06-02 浙江大学 Highly effective dynamic path analysis method based on ContextFS
CN101840419A (en) * 2009-03-19 2010-09-22 赛门铁克公司 Be used for from the method for integral body backup restore data
CN101840419B (en) * 2009-03-19 2015-03-25 赛门铁克公司 Method for restoring data from a monolithic backup
CN104395898A (en) * 2012-04-27 2015-03-04 网络装置公司 Virtual storage appliance gateway
CN105528443A (en) * 2015-12-23 2016-04-27 北京金山安全软件有限公司 Application management method and device and electronic equipment
CN105704218A (en) * 2016-01-19 2016-06-22 国家电网公司 Data storage and management method in cloud computing platform
CN105704218B (en) * 2016-01-19 2019-04-05 国家电网公司 Data storage and management method in cloud computing platform
CN105740134A (en) * 2016-01-29 2016-07-06 浪潮(北京)电子信息产业有限公司 File based testing method and apparatus
CN108806773A (en) * 2018-05-21 2018-11-13 上海熙业信息科技有限公司 Medical image cloud storage platform designing method
CN109725997A (en) * 2018-08-17 2019-05-07 平安普惠企业管理有限公司 File open method, terminal and the storage medium of terminal applies
CN109725997B (en) * 2018-08-17 2023-11-03 顺维(重庆)科技有限公司 File opening method for terminal application, terminal and storage medium

Similar Documents

Publication Publication Date Title
CN101079053A (en) ContextFS based file management method
US8892846B2 (en) Metadata management for virtual volumes
US7882304B2 (en) System and method for efficient updates of sequential block storage
EP1569085B1 (en) Method and apparatus for increasing data storage capacity
US9710535B2 (en) Object storage system with local transaction logs, a distributed namespace, and optimized support for user directories
US9274717B2 (en) Deduplication of data blocks on storage devices
US8706971B1 (en) Caching and deduplication of data blocks in cache memory
CN103229173B (en) Metadata management method and system
CN107180092B (en) File system control method and device and terminal
CN103067461B (en) A kind of metadata management system of file and metadata management method
US9507799B1 (en) Distributed object store for network-based content repository
CN109376156B (en) Method for reading hybrid index with storage awareness
US20080010325A1 (en) Data migration apparatus, method, and program
CN106790434B (en) Network data management method, network attached storage gateway and storage service system
CN107844269A (en) A kind of layering mixing storage system and method based on uniformity Hash
CN102541983B (en) Method for synchronously caching by multiple clients in distributed file system
US8219749B2 (en) System and method for efficient updates of sequential block storage
US8090924B2 (en) Method for the allocation of data on physical media by a file system which optimizes power consumption
US9165006B2 (en) Method and system for managing data storage and access on a client device
CN103530387A (en) Improved method aimed at small files of HDFS
CN103034684A (en) Optimizing method for storing virtual machine mirror images based on CAS (content addressable storage)
WO2019015479A1 (en) Method for achieving data copying in ftl of solid state drive, system and solid state drive
CN103488685B (en) Fragmented-file storage method based on distributed storage system
CN103888499A (en) Distributed object processing method and system
CN101916289A (en) Method for establishing digital library storage system supporting mass small files and dynamic backup number

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C12 Rejection of a patent application after its publication
RJ01 Rejection of invention patent application after publication

Open date: 20071128