CN109522281A - A kind of method of Distributed File System Data rapid copy - Google Patents
A kind of method of Distributed File System Data rapid copy Download PDFInfo
- Publication number
- CN109522281A CN109522281A CN201811444651.4A CN201811444651A CN109522281A CN 109522281 A CN109522281 A CN 109522281A CN 201811444651 A CN201811444651 A CN 201811444651A CN 109522281 A CN109522281 A CN 109522281A
- Authority
- CN
- China
- Prior art keywords
- data
- copy
- information
- request
- service end
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Withdrawn
Links
Abstract
The invention discloses a kind of methods of Distributed File System Data rapid copy, comprising the following steps: the data information copied will be needed to transmit a request to Metadata Service end；After Metadata Service termination is requested, prepare target object, sends data copy and request to data service end；The copy of source file object data to file destination object data is realized at data service end, and returns to implementing result.The method of Distributed File System Data rapid copy disclosed by the invention realizes the rapid copy of mass data by shortening the I/O path of data transmission.
Description
Technical field
The present invention relates to technical field of memory more particularly to a kind of methods of Distributed File System Data rapid copy.
Background technique
With ever-increasing data storage requirement, so that the file data amount of business administration is consequently increased.Work as business
When needing to carry out copy cp to the data in file system, data content is read from source file in client, then will be counted
According to being then written in file destination, such processing mode I/O path is long, data copy low efficiency.
Based on the above issues, therefore, to those skilled in the art, distributed file system magnanimity number how is realized
According to rapid copy, the technical issues of being urgent need to resolve.
Summary of the invention
Technical problems based on background technology, the invention proposes a kind of Distributed File System Data rapid copies
Method, by shorten data transmission I/O path, realize the rapid copy of mass data.
A kind of method of Distributed File System Data rapid copy proposed by the present invention, comprising the following steps:
The data information copied will be needed to transmit a request to Metadata Service end；
After Metadata Service termination is requested, prepare target object, sends data copy and request to data service end；
The copy of source file object data to file destination object data is realized at data service end, and returns to implementing result.
Preferably, the data information copied will be needed to transmit a request to Metadata Service end, specifically includes the following steps:
It is packaged copy information, wherein copy information includes file destination information and source file information；
Copy information is sent to Metadata Service end.
Preferably, after Metadata Service termination is requested, prepare target object, send data copy and request to data service
End, specifically includes the following steps:
After Metadata Service termination is by copy request, source file file is identified, file destination is prepared；
After metadata operation success, prepare data copy request: source object information and target object information, and request is sent out
It send to data service end.
Preferably, the copy of source file object data to file destination object data is realized at data service end, and is returned and held
Row as a result, specifically includes the following steps:
After data service termination is requested, source object and target object are identified；
By source object data copy into target object；
Return to implementing result.
A kind of method of Distributed File System Data rapid copy provided in the present invention is sent by that will copy request
To Metadata Service end, Metadata Service end executes metadata and prepares, and carries out data object copy function by data service end；
It can effectively shorten I/O path, improve copy efficiency.
Detailed description of the invention
Fig. 1 is a kind of flow chart of the method for Distributed File System Data rapid copy proposed by the present invention.
Specific embodiment
As shown in FIG. 1, FIG. 1 is a kind of processes of the method for Distributed File System Data rapid copy proposed by the present invention
Figure.
The present invention is described in detail below with reference to the accompanying drawings and embodiments.
A kind of method of Distributed File System Data rapid copy, comprising the following steps:
S1: it is packaged copy information, wherein copy information includes file destination information and source file information；
S2: copy information is sent to Metadata Service end；
S3: after Metadata Service termination is by copy request, identifying source file file, carries out to file destination quasi-
It is standby；
S4: after metadata operation success, prepare data copy request: source object information and target object information, and will ask
It asks and is sent to data service end；
S5: after data service termination is requested, source object and target object are identified；
S6: source object data copy into target object, is returned to implementing result by data service end.
The foregoing is only a preferred embodiment of the present invention, but scope of protection of the present invention is not limited thereto,
Anyone skilled in the art in the technical scope disclosed by the present invention, according to the technique and scheme of the present invention and its
Inventive concept is subject to equivalent substitution or change, should be covered by the protection scope of the present invention.
Claims (4)
1. a kind of method of Distributed File System Data rapid copy, which comprises the following steps:
The data information copied will be needed to transmit a request to Metadata Service end；
After Metadata Service termination is requested, prepare target object, sends data copy and request to data service end；
The copy of source file object data to file destination object data is realized at data service end, and returns to implementing result.
2. the method for Distributed File System Data rapid copy according to claim 1, which is characterized in that copy needs
The data information of shellfish transmit a request to Metadata Service end, specifically includes the following steps:
It is packaged copy information, wherein copy information includes file destination information and source file information；
Copy information is sent to Metadata Service end.
3. the method for Distributed File System Data rapid copy according to claim 2, which is characterized in that metadata clothes
After business termination is requested, prepare target object, sends data copy and request to data service end, specifically includes the following steps:
After Metadata Service termination is by copy request, source file file is identified, file destination is prepared；
After metadata operation success, prepare data copy request: source object information and target object information, and send the request to
Data service end.
4. the method for Distributed File System Data rapid copy according to claim 1, which is characterized in that data service
The copy of source file object data to file destination object data is realized at end, and returns to implementing result, specifically includes the following steps:
After data service termination is requested, source object and target object are identified；
By source object data copy into target object；
Return to implementing result.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811444651.4A CN109522281A (en) | 2018-11-29 | 2018-11-29 | A kind of method of Distributed File System Data rapid copy |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811444651.4A CN109522281A (en) | 2018-11-29 | 2018-11-29 | A kind of method of Distributed File System Data rapid copy |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN109522281A true CN109522281A (en) | 2019-03-26 |
Family
ID=65794595
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201811444651.4A Withdrawn CN109522281A (en) | 2018-11-29 | 2018-11-29 | A kind of method of Distributed File System Data rapid copy |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109522281A (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110688147A (en) * | 2019-09-29 | 2020-01-14 | 山东浪潮通软信息科技有限公司 | Method for packing and analyzing metadata |
| CN111143126A (en) * | 2019-12-20 | 2020-05-12 | 浪潮电子信息产业股份有限公司 | Data copying method, system and related components of distributed file system |
| CN113806107A (en) * | 2021-08-25 | 2021-12-17 | 济南浪潮数据技术有限公司 | Object copying method, device, equipment and storage medium |
-
2018
- 2018-11-29 CN CN201811444651.4A patent/CN109522281A/en not_active Withdrawn
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110688147A (en) * | 2019-09-29 | 2020-01-14 | 山东浪潮通软信息科技有限公司 | Method for packing and analyzing metadata |
| CN111143126A (en) * | 2019-12-20 | 2020-05-12 | 浪潮电子信息产业股份有限公司 | Data copying method, system and related components of distributed file system |
| CN113806107A (en) * | 2021-08-25 | 2021-12-17 | 济南浪潮数据技术有限公司 | Object copying method, device, equipment and storage medium |
| CN113806107B (en) * | 2021-08-25 | 2024-02-13 | 济南浪潮数据技术有限公司 | Object copying method, device, equipment and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US7596659B2 (en) | Method and system for balanced striping of objects | |
| US7647449B1 (en) | Method, system, and computer readable medium for maintaining the order of write-commands issued to a data storage | |
| US11397668B2 (en) | Data read/write method and apparatus, and storage server | |
| CN109522281A (en) | A kind of method of Distributed File System Data rapid copy | |
| US8850116B2 (en) | Data prefetch for SCSI referrals | |
| US10055150B1 (en) | Writing volatile scattered memory metadata to flash device | |
| CN103095758B (en) | A kind of method processing file data in distributed file system and this system | |
| KR102414075B1 (en) | Effective transaction table with page bitmap | |
| CN105912425B (en) | Snapshot image foundation, rollback method and device | |
| WO2019218976A1 (en) | Data processing method and apparatus, and computer-readable storage medium | |
| US20190114178A1 (en) | Installing of operating system | |
| KR20210040864A (en) | File directory traversal method, apparatus, device, and medium | |
| CN104035728A (en) | Hard disk hot plug handling method, device and node | |
| CN105446794A (en) | Disc operation method, apparatus and system based on virtual machine | |
| CN104102725A (en) | Method and system for dynamically creating duplicates of hotspot data files in HDFS (Hadoop distributed file system) | |
| CN104079600A (en) | File storage method, file storage device, file access client and metadata server system | |
| US9619336B2 (en) | Managing production data | |
| CN106383667A (en) | Method and apparatus for LUN migration in business operation | |
| US20100174880A1 (en) | Method for fast format of a fully allocated volume when copied from a space efficient volume | |
| CN101526959B (en) | Data storing method and device | |
| US9003129B1 (en) | Techniques for inter-storage-processor cache communication using tokens | |
| US10725877B2 (en) | System, method and computer program product for performing a data protection operation | |
| JP6287308B2 (en) | Replication control system, replication control method, and replication control program | |
| CN104850548B (en) | A kind of method and system for realizing big data platform input/output processing | |
| CN108021448B (en) | Kernel space optimization method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WW01 | Invention patent application withdrawn after publication |
Application publication date: 20190326 |
|
| WW01 | Invention patent application withdrawn after publication |