CN102456049A - Data migration method and device, and object-oriented distributed file system - Google Patents
Data migration method and device, and object-oriented distributed file system Download PDFInfo
- Publication number
- CN102456049A CN102456049A CN2010105273897A CN201010527389A CN102456049A CN 102456049 A CN102456049 A CN 102456049A CN 2010105273897 A CN2010105273897 A CN 2010105273897A CN 201010527389 A CN201010527389 A CN 201010527389A CN 102456049 A CN102456049 A CN 102456049A
- Authority
- CN
- China
- Prior art keywords
- file
- storage server
- object storage
- data
- file object
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Landscapes
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention discloses a data migration method and device, and an object-oriented distributed file system, wherein the data migration method comprises the following steps of: when a file object stored in a source object storage server needs to be migrated to a target object storage server, creating an empty file object in the target object storage server, and then establishing a data transmission channel between the file object in the source object storage server and the empty file object in the target object storage server. In this way, the file object data can be directly migrated to the empty file object of the target object storage server from the file object in the source object storage server without the involvement of a client; therefore, the problems of long transmission path and easy occurrence of data transmission errors during the existing data migration operation are solved.
Description
Technical field
The present invention relates to technical field of data processing, more particularly, relate to a kind of data migration method, device and OO distributed file system.
Background technology
Along with supercomputer develops towards distribution and clustered direction, also increasingly high to high capacity, the requirement highly reliable, high bandwidth of storage, a kind of novel object-oriented memory file system is proposed at present.
As shown in Figure 1, this document system comprises client 101, meta data server 102 and object storage server 103, and wherein, meta data server 102 is in order to the metadata information of memory file system file; Storage server 103 is connected to data storage device, and in order to the data message of storage file, client 101 is accesses meta-data server 102 and object storage server 103 directly.
Yet existing object-oriented memory file system has the low problem of data management efficiency, for example: during operations such as execution data migtation; Client initiates to obtain request of data; Data transfer to client by the source object storage server, transmit it to the destination object storage server by client again, like this; The transmission path of data is longer, occurs the problem of data transmission fault easily.
Summary of the invention
In view of this, the present invention provides a kind of data migration method, device and OO distributed file system, and during with solution available data migration operation, the problem of data transmission fault is grown and be prone to transmission path.
For addressing the above problem, the existing scheme that proposes is following:
A kind of data migration method comprises:
The file status of monitoring file;
If said file status changes, obtain the property value after this document changes;
When the property value of judging this document triggers the condition of execute file object migration operation; As the source object storage server, the object storage server of migration back storage file file object is as the destination object storage server with the current object storage server that stores said file file object;
In said destination object storage server, create the empty file object;
Set up the data transmission channel between said source object storage server file object and the destination object storage server empty file object, with the file object data by said source object storage server file object transfer to said destination object storage server hollow file object.
Preferably, said monitoring file status is the state of the pre-conditioned file of unmet in the monitoring listed files, also comprises before the monitoring file status:
The file path of cache file or file name;
Satisfy the said file path of rank order or the file name of pre-conditioned degree according to file, form listed files.
Preferably, also comprise after said file object data transmission finishes:
Read the data of the predeterminated position that is stored in said source object storage server file object and destination object storage server file object respectively;
Whether identical, then obtain the transmission success result as if identical, otherwise obtain the bust this result if comparing said data.
Preferably, said data migration method also comprises: detect and obtain file object data transmission fails reason.
Preferably, after said file object data transmission finishes, also comprise:
Make transmission reporting instrument as a result, this transmission contains file object data transmission object information or file object data transmission fails cause information in the reporting instrument as a result.
A kind of data migration device comprises:
First monitoring unit is used to monitor the file status of file;
The first file attribute value acquiring unit is used for if said file status changes, and obtains the property value after this document changes;
First judging unit is used to judge whether the property value of the file that gets access to satisfies threshold value;
The first object storage server classification is confirmed the unit; Be used for satisfying threshold value when the property value of judging this document; When needing the operation of execute file object migration; As the source object storage server, the object storage server of migration back storage file file object is as the destination object storage server with the current object storage server that stores said file file object;
The first empty file Object Creation unit is used for creating the empty file object at the destination object storage server of confirming;
The first file object migration units; Be used to set up the data transmission channel between said source object storage server file object and the destination object storage server empty file object, with the file object data by said source object storage server file object transfer to said destination object storage server empty file object.
Preferably, said data migration device also comprises:
The first file data reading unit is used for after the file object data transmission finishes, and reads the data that are stored in said source object storage server file object and destination object storage server file object predeterminated position respectively;
First transmission is identifying unit as a result, and whether be used to compare said data identical, then obtains the transmission success result as if identical, otherwise obtains the bust this result.
Preferably, said data migration device also comprises: the unit is made in first transmission reporting instrument as a result, is used to make file object data transmission reporting instrument as a result.
A kind of data migration method comprises:
When receiving the steering order of the execute file object migration operation that client sends; As the source object storage server, the object storage server of migration back storage file file object is as the destination object storage server with the current object storage server that stores said file file object;
In said destination object storage server, create the empty file object;
Set up the data transmission channel between said source object storage server file object and the destination object storage server empty file object, with the file object data by said source object storage server file object transfer to said destination object storage server hollow file object.
Preferably, also comprise after said file object data transmission finishes:
Read the data of the predeterminated position that is stored in said source object storage server file object and destination object storage server file object respectively;
Whether identical, then obtain the transmission success result as if identical, otherwise obtain the bust this result if comparing said data.
A kind of data migration device comprises:
The second object storage server classification is confirmed the unit; Be used for when receiving the steering order of the execute file object migration operation that client sends; As the source object storage server, the object storage server of migration back storage file file object is as the destination object storage server with the current object storage server that stores said file file object;
The second empty file Object Creation unit is used for creating the empty file object at said destination object storage server;
The second file object migration units; Be used to set up the data transmission channel between said source object storage server file object and the destination object storage server empty file object, with the file object data by said source object storage server file object transfer to said destination object storage server empty file object.
Preferably, said data migration device also comprises:
The second file data reading unit is used for after the file object data transmission finishes, and reads the data of the predeterminated position that is stored in said source object storage server file object and destination object storage server file object respectively;
Second transmission is identifying unit as a result, and whether be used to compare said data identical, then obtains the transmission success result as if identical, otherwise obtains the bust this result.
A kind of OO distributed file system comprises: client, meta data server and object storage server, wherein:
Said client comprises the steering order transmitting element, and this unit is used for sending controling instruction to said meta data server;
Said meta data server comprises:
Monitoring unit is used to monitor the file status of file and the steering order of client;
File attribute value acquiring unit is used for if said file status changes, and obtains the property value after this document changes;
Judging unit, the property value that is used to judge the file that gets access to are enough to satisfy threshold value;
Object storage server classification is confirmed the unit; Be used for satisfying threshold value when the property value of judging this document; When needing the operation of execute file object migration, perhaps, when the steering order of said client is operated for the execute file object migration; As the source object storage server, the object storage server of migration back storage file file object is as the destination object storage server with the current object storage server that stores said file file object;
Empty file Object Creation unit is used for creating the empty file object at said destination object storage server;
The file object migration units; Be used to set up the data transmission channel between said source object storage server file object and the destination object storage server hollow file object, with the file object data by said source object storage server file object transfer to said destination object storage server hollow file object.
Can find out from above-mentioned technical scheme; In the data migration method disclosed by the invention; When needs with source object storage server files stored object migration to the destination object storage server time; In the destination object storage server, create the empty file object, set up the data transmission channel between said source object storage server file object and the destination object storage server empty file object again, like this; Just can be with the file object data directly by in source object storage server file object migration to the destination object storage server empty file object; Do not need client to participate in, when having solved the available data migration operation, the problem of data transmission fault is grown and be prone to transmission path.
Description of drawings
In order to be illustrated more clearly in the embodiment of the invention or technical scheme of the prior art; To do to introduce simply to the accompanying drawing of required use in embodiment or the description of the Prior Art below; Obviously, the accompanying drawing in describing below only is some embodiments of the present invention, for those of ordinary skills; Under the prerequisite of not paying creative work, can also obtain other accompanying drawing according to these accompanying drawings.
Fig. 1 is the structural representation of object-oriented memory file system in the prior art;
Fig. 2 is the process flow diagram of the disclosed a kind of data migration method of the embodiment of the invention;
Fig. 3 is the process flow diagram of the disclosed a kind of data migration method of yet another embodiment of the invention;
Fig. 4 is the structural representation of the disclosed a kind of data migration device of the embodiment of the invention;
Fig. 5 is the structural representation of the disclosed a kind of data migration device of yet another embodiment of the invention;
Fig. 6 is the process flow diagram of the disclosed a kind of data migration method of yet another embodiment of the invention;
Fig. 7 is the structural representation of the disclosed a kind of data migration device of yet another embodiment of the invention;
Fig. 8 is the structural representation of the disclosed a kind of data migration device of yet another embodiment of the invention;
Fig. 9 is the structural representation of the disclosed a kind of OO distributed file system of the embodiment of the invention.
Embodiment
To combine the accompanying drawing in the embodiment of the invention below, the technical scheme in the embodiment of the invention is carried out clear, intactly description, obviously, described embodiment only is the present invention's part embodiment, rather than whole embodiment.Based on the embodiment among the present invention, those of ordinary skills are not making the every other embodiment that is obtained under the creative work prerequisite, all belong to the scope of the present invention's protection.
The embodiment of the invention discloses a kind of data migration method, device and OO distributed file system, during with solution available data migration operation, the problem of data transmission fault is grown and be prone to transmission path.
Following elder generation does some related notions in the embodiment of the invention once and explains:
The disclosed data migration method of the embodiment of the invention, data migtation are divided into two kinds, and a kind of is that data are sheared, after promptly data migtation finishes, and the file of deletion original storage data; Another kind is that data are duplicated, and after promptly data migtation finishes, keeps the file of original storage data.
The file of explaining in the embodiment of the invention is the file of preserving in the disclosed OO distributed file system of present embodiment.
The file object of explaining in the embodiment of the invention is the minimum unit of composing document, and each file object can be deposited in the different object storage servers, can leave in the identical object storage server.
As shown in Figure 2, the disclosed a kind of data migration method of one embodiment of the invention comprises:
The file status of step S11, monitoring file;
Concrete, said monitoring file status is the base attribute of monitoring this document, and its base attribute comprises that document time attribute, file size attribute, file are by access frequency etc.
Step S12, if said file status changes, the property value after obtaining this document and changing;
Concrete, along with data constantly write file, file becomes greatly gradually, and the storage space that takies increases gradually, and the size attribute of file changes thereupon; Perhaps, passage of time at any time, the time attribute of file also can change.
Step S13, satisfy threshold value when the property value of judging this document; When needing the operation of execute file object migration; As the source object storage server, the object storage server of migration back storage file file object is as the destination object storage server with the current object storage server that stores said file file object;
Concrete, the property value of file satisfy threshold value can for: file size surpasses threshold value, and the file storage document storage time surpasses threshold value or file is not reached threshold value by the access time.Wherein, the user is the threshold value of enactment document property value as required, and for example, the time that file is not visited is 30 days.
And, include the memory location, source and the target storage position that need the file object of migration in the file in the file object migration operation, promptly need to confirm the source object storage server and the destination object storage server of migrated file object.
Step S14, in said destination object storage server, create the empty file object;
Concrete; This empty file object can have the title of source file object; And have the extended attribute that points to title same, is stored in the file object in the source object storage server, move by the file object in the source object storage server so that indicate the data in this document with it.
Step S15, set up the data transmission channel between said source object storage server file object and the destination object storage server empty file object, with the file object data by said source object storage server file object transfer to said destination object storage server hollow file object.
In the disclosed data migration method of present embodiment; When needs with source object storage server files stored object migration to the destination object storage server time; In the destination object storage server, create the empty file object, set up the data transmission channel between said source object storage server file object and the destination object storage server empty file object again, like this; Just can be with the file object data directly by in object storage server file object migration to the destination object storage server empty file object; Do not need client to participate in, when having solved the available data migration operation, the problem of data transmission fault is grown and be prone to transmission path.
And; Owing to preestablished the condition that triggers the file object migration; When the property value of judging file satisfies this when pre-conditioned; Just automatically perform the file object migration operation, not only can solve data transfer path length that occurs in the prior art and the problem that is prone to data transmission fault, also improved work efficiency.
In the foregoing description; Because quantity of documents is more; And its component units file object possibly be stored in the different object storage servers, if only after the attribute of each file changes, judge whether to satisfy pre-conditioned one by one, efficient can be very low so; For addressing the above problem, so another embodiment of the present invention also provides a kind of data migration method.
The disclosed data migration method of present embodiment, as shown in Figure 3, comprising:
The file path of step S21, cache file or file name;
Step S22, satisfy the said file path of rank order or the file name of pre-conditioned degree, form listed files according to file;
The state of the pre-conditioned file of unmet in step S23, the said listed files of monitoring;
Step S24, if said file status changes, the property value after obtaining this document and changing;
Step S25, satisfy threshold value when the property value of judging this document; When needing the operation of execute file object migration; As the source object storage server, the object storage server of migration back storage file file object is as the destination object storage server with the current object storage server that stores said file file object;
Step S26, in said destination object storage server, create the empty file object;
Step S27, set up the data transmission channel between said source object storage server file object and the destination object storage server empty file object, with the file object data by said source object storage server file object transfer to said destination object storage server hollow file object.
Among the step S22 of the disclosed data migration method of this embodiment; According to file satisfy pre-conditioned degree rank order file specifically can for pre-conditioned according to satisfying, do not satisfy pre-conditioned series arrangement file; Also can for pre-conditioned according to not satisfying, satisfy pre-conditioned series arrangement file; Form listed files, in addition, the content of the disclosed step S24-S27 of present embodiment is identical with the disclosed content of the disclosed step S11-S14 of the foregoing description; See also the disclosed content of the foregoing description, repeat no more here.
In the disclosed data migration method of present embodiment; Only need the state of the pre-conditioned file of unmet in the above-mentioned listed files of monitoring; Data transfer path length that occurs in the prior art and the problem that is prone to data transmission fault have not only been solved; Also shorten data processing time, accelerated data processing speed.
Among above-mentioned two embodiment; Because in the migration operation of file object data; For example have that factor such as network middle-end, version change possibly cause the imperfect or inconsistent of data migtation, therefore, after the file object data migtation finishes; Also need the content that be stored in the destination object storage server be detected, concrete operations are following:
Read the data of the predeterminated position that is stored in said source object storage server file object and destination object storage server file object respectively;
Whether identical, then obtain the transmission success result as if identical, otherwise obtain the bust this result if comparing said data.
Read the data of source object storage server file object and destination object storage server file object same position, if the success of file object data transmission, the data of two positions should be identical, if unsuccessful, the data of two positions then can be different.
And, before detecting, all can set several position at random at every turn, the position here is unfixing, avoids occurring the problem that data are faked and forged.For big file object, the position of setting is also more, and for the small documents object, the position of setting can be a little less.
When judging the file transfer failure, comprise also and detect the reason that obtains file output failure that concrete operations are following:
After the file object migration is accomplished, the transmission time of rreturn value, file object and the size of file object in the log file object migration process, wherein said rreturn value generally comprises: (1) resource is busy; (2) insufficient memory; (3) file destination locking; (4) connection makes mistakes; (5) be interrupted;
Utilize above information just can obtain the reason of file transfer failure:
(1) if the file destination object less than the source file object, then reports network wrong;
(2), then report transmission link wrong if the file destination contents of object is different with the source file object;
(3) if the file destination object transfer time is too of a specified duration, it is too many to depart from empirical value, then reports network transmission link wrong; If it is busy that rreturn value is a resource, then report file destination object place memory device wrong;
(4), then report the memory device insufficient space at file destination object place if rreturn value is an insufficient memory;
(5) if the file destination object is locked, then newspaper exists a plurality of processes to manage simultaneously;
(6) if rreturn value is made mistakes for connecting, then report transmission link wrong;
(7) if the value of putting back to for being interrupted, then reports transmission link wrong.
Behind the file object end of transmission; Also to make transmission reporting instrument as a result, gather the execution result that this file object migration operation is arranged in this table, concrete; If transmission success; Then the operation of display file migrating objects runs succeeded in table, if bust this, then the reason with above-mentioned bust this writes in this table.
After making finishes, can directly export this table, concrete, as to adopt screen display method also can be stored it, when waiting user to carry out call operation, again with its demonstration.
The embodiment of the invention also discloses a kind of data migration device; As shown in Figure 4; Comprise: first monitoring unit 201, the first file attribute value acquiring unit 202, first judging unit 203, the first object storage server classification are confirmed unit 204, the first empty file Object Creation unit 205 and the first file object migration units 206, wherein:
The first file attribute value acquiring unit 202 is used for if said file status changes, and obtains the property value after this document changes;
First judging unit 203 is used to judge whether the property value of the file that gets access to satisfies threshold value;
The first object storage server classification is confirmed unit 204; Be used for satisfying threshold value when the property value of judging this document; When needing the operation of execute file object migration; As the source object storage server, the object storage server of migration back storage file file object is as the destination object storage server with the current object storage server that stores said file file object;
The first empty file Object Creation unit 205 is used for creating the empty file object at the destination object storage server of confirming;
The first file object migration units 206; Be used to set up the data transmission channel between said source object storage server file object and the destination object storage server empty file object, with the file object data by said source object storage server file object transfer to said destination object storage server empty file object.
After file transfer finishes, the laser propagation effect of file object is detected, as shown in Figure 5, the disclosed data migration device of yet another embodiment of the invention also comprises:
The first file data reading unit 207 is used for after the file object data transmission finishes, and reads the data that are stored in said source object storage server file object and destination object storage server file object predeterminated position respectively;
First transmission is identifying unit 208 as a result, and whether be used to compare said data identical, then obtains the transmission success result as if identical, otherwise obtains the bust this result.
First transmission reporting instrument making as a result unit 209 is used for making transmission reporting instrument as a result, and this transmission is preserved file object transmission result in the reporting instrument as a result, when file object transmission result is bust this, also preserves the reason of file object bust this.
Concrete, the work of above-mentioned two disclosed data migration device of embodiment such as above-mentioned three disclosed contents of the disclosed data migration method of embodiment see also disclosed content in the above-mentioned data migration method, repeat no more here.
When the property value unmet of file triggers the condition of execute file object migration operation; Be not to this document object execute file migration operation, still, if the user needs the migrated file object; Can pass through the direct sending controling instruction of client, the operation of execute file object migration.Specifically see also the disclosed data migration method of following examples.
The disclosed a kind of data migration method of the embodiment of the invention, as shown in Figure 6, comprising:
Step S31, when receiving the steering order of the execute file object migration operation that client sends; As the source object storage server, the object storage server of migration back storage file file object is as the destination object storage server with the current object storage server that stores said file file object;
Step S32, in said destination object storage server, create the empty file object;
Step S33, set up the data transmission channel between said source object storage server file object and the destination object storage server empty file object, with the file object data by said source object storage server file object transfer to said destination object storage server hollow file object.
Equally, the disclosed data migration method of present embodiment is behind the file object end of transmission; Need the laser propagation effect of file object be detected, and, when the file object bust this; Also to obtain file object bust this reason, the final transmission reporting instrument as a result of making.
Concrete, the detection method of file object laser propagation effect is:
Read the data of the predeterminated position that is stored in said source object storage server file object and destination object storage server file object respectively;
Whether identical, then obtain the transmission success result as if identical, otherwise obtain the bust this result if comparing said data.
Equally, concrete testing process such as the disclosed content of above-mentioned data migration method embodiment repeat no more here.
Another embodiment of the present invention discloses a kind of data migration device, and is as shown in Figure 7, comprising:
The second object storage server classification is confirmed unit 301; Be used for when receiving the steering order of the execute file object migration operation that client sends; As the source object storage server, the object storage server of migration back storage file file object is as the destination object storage server with the current object storage server that stores said file file object;
The second empty file Object Creation unit 302 is used for creating the empty file object at said destination object storage server;
The second file object migration units 303; Be used to set up the data transmission channel between said source object storage server file object and the destination object storage server empty file object, with the file object data by said source object storage server file object transfer to said destination object storage server empty file object.
Equally; As shown in Figure 8; Another embodiment of the present invention also discloses a kind of data migration device, confirms also to comprise unit 301, the second empty file Object Creation unit 302 and the second file object migration units 303 except that comprising the second object storage server classification:
The second file data reading unit 304 is used for after the file object data transmission finishes, and reads the data of the predeterminated position that is stored in said source object storage server file object and destination object storage server file object respectively;
Second transmission is identifying unit 305 as a result, and whether be used to compare said data identical, then obtains the transmission success result as if identical, otherwise obtains the bust this result.
The data migtation work of above-mentioned two disclosed data migration device of embodiment is identical with the disclosed content of the foregoing description, sees also the disclosed content of the foregoing description, repeats no more here.
The embodiment of the invention also discloses a kind of OO distributed file system, as shown in Figure 9, comprising: client 401, meta data server 402 and object storage server 403, wherein:
Monitoring unit 21 is used to monitor the file status of this system's storage file and the steering order of client 401;
File attribute value acquiring unit 22 is used for if said file status changes, and obtains the property value after this document changes;
Judging unit 23 is used to judge whether the property value of the file that gets access to satisfies threshold value;
Object storage server classification is confirmed unit 24; Be used for satisfying threshold value when the property value of judging this document; When needing the operation of execute file object migration, perhaps, when the steering order of client 401 is operated for the execute file object migration; As the source object storage server, the object storage server of migration back storage file file object is as the destination object storage server with the current object storage server that stores said file file object;
Empty file Object Creation unit 25 is used for creating the empty file object at said destination object storage server;
File object migration units 26; Be used to set up the data transmission channel between said source object storage server file object and the destination object storage server hollow file object, with the file object data by said source object storage server file object transfer to said destination object storage server hollow file object.
In the OO distributed file system; Comprise at least one object storage server, client can directly be visited said object storage server, sending controling instruction; Control its executable operations, the migrating objects storage server file Object Operations that is not limited to explain in the present embodiment.
Each embodiment adopts the mode of going forward one by one to describe in this instructions, and what each embodiment stressed all is and the difference of other embodiment that identical similar part is mutually referring to getting final product between each embodiment.
To the above-mentioned explanation of the disclosed embodiments, make this area professional and technical personnel can realize or use the present invention.Multiple modification to these embodiment will be conspicuous concerning those skilled in the art, and defined General Principle can realize under the situation that does not break away from the spirit or scope of the present invention in other embodiments among this paper.Therefore, the present invention will can not be restricted to these embodiment shown in this paper, but will meet and principle disclosed herein and features of novelty the wideest corresponding to scope.
Claims (13)
1. a data migration method is characterized in that, comprising:
The file status of monitoring file;
If said file status changes, obtain the property value after this document changes;
When the property value of judging this document satisfies threshold value; When needing the operation of execute file object migration; As the source object storage server, the object storage server of migration back storage file file object is as the destination object storage server with the current object storage server that stores said file file object;
In said destination object storage server, create the empty file object;
Set up the data transmission channel between said source object storage server file object and the destination object storage server empty file object, with the file object data by said source object storage server file object transfer to said destination object storage server hollow file object.
2. method according to claim 1 is characterized in that, said monitoring file status is the state of the pre-conditioned file of unmet in the monitoring listed files, also comprises before the monitoring file status:
The file path of cache file or file name;
Satisfy the said file path of rank order or the file name of pre-conditioned degree according to file, form listed files.
3. method according to claim 1 is characterized in that, also comprises after said file object data transmission finishes:
Read the data of the predeterminated position that is stored in said source object storage server file object and destination object storage server file object respectively;
Whether identical, then obtain the transmission success result as if identical, otherwise obtain the bust this result if comparing said data.
4. method according to claim 3 is characterized in that, also comprises: detect and obtain file object data transmission fails reason.
5. method according to claim 4 is characterized in that, after said file object data transmission finishes, also comprises:
Make transmission reporting instrument as a result, this transmission contains file object data transmission object information or file object data transmission fails cause information in the reporting instrument as a result.
6. a data migration device is characterized in that, comprising:
First monitoring unit is used to monitor the file status of file;
The first file attribute value acquiring unit is used for if said file status changes, and obtains the property value after this document changes;
First judging unit is used to judge whether the property value of the file that gets access to satisfies threshold value;
The first object storage server classification is confirmed the unit; Be used for satisfying threshold value when the property value of judging this document; When needing the operation of execute file object migration; As the source object storage server, the object storage server of migration back storage file file object is as the destination object storage server with the current object storage server that stores said file file object;
The first empty file Object Creation unit is used for creating the empty file object at the destination object storage server of confirming;
The first file object migration units; Be used to set up the data transmission channel between said source object storage server file object and the destination object storage server empty file object, with the file object data by said source object storage server file object transfer to said destination object storage server empty file object.
7. device according to claim 6 is characterized in that, also comprises:
The first file data reading unit is used for after the file object data transmission finishes, and reads the data that are stored in said source object storage server file object and destination object storage server file object predeterminated position respectively;
First transmission is identifying unit as a result, and whether be used to compare said data identical, then obtains the transmission success result as if identical, otherwise obtains the bust this result.
8. device according to claim 6 is characterized in that, also comprises: the unit is made in first transmission reporting instrument as a result, is used to make file object data transmission reporting instrument as a result.
9. a data migration method is characterized in that, comprising:
When receiving the steering order of the execute file object migration operation that client sends; As the source object storage server, the object storage server of migration back storage file file object is as the destination object storage server with the current object storage server that stores said file file object;
In said destination object storage server, create the empty file object;
Set up the data transmission channel between said source object storage server file object and the destination object storage server empty file object, with the file object data by said source object storage server file object transfer to said destination object storage server hollow file object.
10. method according to claim 9 is characterized in that, also comprises after said file object data transmission finishes:
Read the data of the predeterminated position that is stored in said source object storage server file object and destination object storage server file object respectively;
Whether identical, then obtain the transmission success result as if identical, otherwise obtain the bust this result if comparing said data.
11. a data migration device is characterized in that, comprising:
The second object storage server classification is confirmed the unit; Be used for when receiving the steering order of the execute file object migration operation that client sends; As the source object storage server, the object storage server of migration back storage file file object is as the destination object storage server with the current object storage server that stores said file file object;
The second empty file Object Creation unit is used for creating the empty file object at said destination object storage server;
The second file object migration units; Be used to set up the data transmission channel between said source object storage server file object and the destination object storage server empty file object, with the file object data by said source object storage server file object transfer to said destination object storage server empty file object.
12. device according to claim 11 is characterized in that, also comprises:
The second file data reading unit is used for after the file object data transmission finishes, and reads the data of the predeterminated position that is stored in said source object storage server file object and destination object storage server file object respectively;
Second transmission is identifying unit as a result, and whether be used to compare said data identical, then obtains the transmission success result as if identical, otherwise obtains the bust this result.
13. an OO distributed file system is characterized in that, comprising: client, meta data server and object storage server, wherein:
Said client comprises the steering order transmitting element, and this unit is used for sending controling instruction to said meta data server;
Said meta data server comprises:
Monitoring unit is used to monitor the file status of file and the steering order of client;
File attribute value acquiring unit is used for if said file status changes, and obtains the property value after this document changes;
Judging unit, the property value that is used to judge the file that gets access to are enough to satisfy threshold value;
Object storage server classification is confirmed the unit; Be used for satisfying threshold value when the property value of judging this document; When needing the operation of execute file object migration, perhaps, when the steering order of said client is operated for the execute file object migration; As the source object storage server, the object storage server of migration back storage file file object is as the destination object storage server with the current object storage server that stores said file file object;
Empty file Object Creation unit is used for creating the empty file object at said destination object storage server;
The file object migration units; Be used to set up the data transmission channel between said source object storage server file object and the destination object storage server hollow file object, with the file object data by said source object storage server file object transfer to said destination object storage server hollow file object.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2010105273897A CN102456049A (en) | 2010-10-28 | 2010-10-28 | Data migration method and device, and object-oriented distributed file system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2010105273897A CN102456049A (en) | 2010-10-28 | 2010-10-28 | Data migration method and device, and object-oriented distributed file system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN102456049A true CN102456049A (en) | 2012-05-16 |
Family
ID=46039246
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN2010105273897A Pending CN102456049A (en) | 2010-10-28 | 2010-10-28 | Data migration method and device, and object-oriented distributed file system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN102456049A (en) |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103078933A (en) * | 2012-12-29 | 2013-05-01 | 深圳先进技术研究院 | Method and device for determining data migration time |
| CN107908727A (en) * | 2017-11-14 | 2018-04-13 | 郑州云海信息技术有限公司 | Storage object cloning process, device, equipment and computer-readable recording medium |
| CN108021647A (en) * | 2017-11-30 | 2018-05-11 | 郑州云海信息技术有限公司 | A kind of file migration method, system, medium and equipment |
| WO2019061132A1 (en) * | 2017-09-28 | 2019-04-04 | 深圳清华大学研究院 | Hybrid file system architecture, file storage, dynamic migration, and application thereof |
| CN112003944A (en) * | 2020-08-26 | 2020-11-27 | 北京浪潮数据技术有限公司 | Method, system, equipment and storage medium for uploading object file |
| CN112711562A (en) * | 2020-12-31 | 2021-04-27 | 珠海豹趣科技有限公司 | File migration method and device, electronic equipment and storage medium |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1570842A (en) * | 2003-03-27 | 2005-01-26 | 株式会社日立制作所 | Storage device |
| CN101079902A (en) * | 2007-06-29 | 2007-11-28 | 清华大学 | A great magnitude of data hierarchical storage method |
| CN101460934A (en) * | 2006-05-29 | 2009-06-17 | 微软公司 | Creating frequent application-consistent backups efficiently |
| CN101582787A (en) * | 2008-05-16 | 2009-11-18 | 中兴通讯股份有限公司 | Double-computer backup system and backup method |
| CN101621535A (en) * | 2009-06-19 | 2010-01-06 | 许继集团有限公司 | Network communication method and device of real-time monitoring system |
-
2010
- 2010-10-28 CN CN2010105273897A patent/CN102456049A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1570842A (en) * | 2003-03-27 | 2005-01-26 | 株式会社日立制作所 | Storage device |
| CN101460934A (en) * | 2006-05-29 | 2009-06-17 | 微软公司 | Creating frequent application-consistent backups efficiently |
| CN101079902A (en) * | 2007-06-29 | 2007-11-28 | 清华大学 | A great magnitude of data hierarchical storage method |
| CN101582787A (en) * | 2008-05-16 | 2009-11-18 | 中兴通讯股份有限公司 | Double-computer backup system and backup method |
| CN101621535A (en) * | 2009-06-19 | 2010-01-06 | 许继集团有限公司 | Network communication method and device of real-time monitoring system |
Cited By (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103078933A (en) * | 2012-12-29 | 2013-05-01 | 深圳先进技术研究院 | Method and device for determining data migration time |
| CN103078933B (en) * | 2012-12-29 | 2015-12-02 | 深圳先进技术研究院 | A kind of method and apparatus determining data migration time |
| WO2019061132A1 (en) * | 2017-09-28 | 2019-04-04 | 深圳清华大学研究院 | Hybrid file system architecture, file storage, dynamic migration, and application thereof |
| US10810169B1 (en) | 2017-09-28 | 2020-10-20 | Research Institute Of Tsinghua University In Shenzhen | Hybrid file system architecture, file storage, dynamic migration, and application thereof |
| CN107908727A (en) * | 2017-11-14 | 2018-04-13 | 郑州云海信息技术有限公司 | Storage object cloning process, device, equipment and computer-readable recording medium |
| CN107908727B (en) * | 2017-11-14 | 2021-06-29 | 郑州云海信息技术有限公司 | Storage object cloning method, device, equipment and computer readable storage medium |
| CN108021647A (en) * | 2017-11-30 | 2018-05-11 | 郑州云海信息技术有限公司 | A kind of file migration method, system, medium and equipment |
| CN108021647B (en) * | 2017-11-30 | 2020-10-16 | 苏州浪潮智能科技有限公司 | File migration method, system, medium and equipment |
| CN112003944A (en) * | 2020-08-26 | 2020-11-27 | 北京浪潮数据技术有限公司 | Method, system, equipment and storage medium for uploading object file |
| CN112003944B (en) * | 2020-08-26 | 2023-02-28 | 北京浪潮数据技术有限公司 | Method, system, equipment and storage medium for uploading object file |
| CN112711562A (en) * | 2020-12-31 | 2021-04-27 | 珠海豹趣科技有限公司 | File migration method and device, electronic equipment and storage medium |
| CN112711562B (en) * | 2020-12-31 | 2024-03-26 | 珠海豹趣科技有限公司 | File migration method and device, electronic equipment and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN102456049A (en) | Data migration method and device, and object-oriented distributed file system | |
| US9753954B2 (en) | Data node fencing in a distributed file system | |
| RU2595493C2 (en) | Large-scale data storage system | |
| CN101741730B (en) | Method and equipment for downloading file and method and system for providing file downloading service | |
| CN102790771A (en) | File transmission method and system | |
| CN102629268A (en) | Data synchronization method, system and date access device | |
| CN107015884B (en) | Data storage method and device | |
| CN102668516A (en) | Method and apparatus for realizing message passing amid cloud information service | |
| US8214428B1 (en) | Optimized prepopulation of a client side cache in a deduplication environment | |
| CN110069210B (en) | Storage system, and method and device for allocating storage resources | |
| CN104092719A (en) | File transmission method, device and distributed cluster file system | |
| CN102088490A (en) | Data storage method, device and system | |
| CN106294386B (en) | Task distribution executes method and system | |
| CN103699495A (en) | Transmission device and transmission system for splitting data | |
| CN110198346A (en) | Method for reading data, device, electronic equipment and readable storage medium storing program for executing | |
| CN106790378A (en) | The full synchronous method of data of equipment room, apparatus and system | |
| JP5268589B2 (en) | Information processing apparatus and information processing apparatus operating method | |
| CN108614750A (en) | The restoration methods and device of delay machine data | |
| CN104426968A (en) | Data management method and device | |
| CN105354102A (en) | File system maintenance and repairing method and apparatus | |
| CN103297477B (en) | A kind of data acquisition reporting system and data processing method and proxy server | |
| CN110457114A (en) | Application cluster dispositions method and device | |
| CN110532202A (en) | A kind of storage cluster system, data transmission method and device | |
| CN109783463A (en) | File synchronisation method, device and computer readable storage medium | |
| CN112437160B (en) | Method and system for realizing real-time transmission processing of large file based on redis |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C12 | Rejection of a patent application after its publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20120516 |