CN111143126A - Data copying method, system and related components of distributed file system - Google Patents
Data copying method, system and related components of distributed file system Download PDFInfo
- Publication number
- CN111143126A CN111143126A CN201911330447.4A CN201911330447A CN111143126A CN 111143126 A CN111143126 A CN 111143126A CN 201911330447 A CN201911330447 A CN 201911330447A CN 111143126 A CN111143126 A CN 111143126A
- Authority
- CN
- China
- Prior art keywords
- metadata
- data structure
- client
- target data
- file system
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Withdrawn
Links
- 238000000034 method Methods 0.000 title claims abstract description 42
- 230000004048 modification Effects 0.000 claims abstract description 28
- 238000012986 modification Methods 0.000 claims abstract description 28
- 238000004590 computer program Methods 0.000 claims description 8
- 230000009286 beneficial effect Effects 0.000 abstract description 2
- 230000008569 process Effects 0.000 description 7
- 230000009471 action Effects 0.000 description 6
- 230000007246 mechanism Effects 0.000 description 6
- 238000010586 diagram Methods 0.000 description 4
- 238000012790 confirmation Methods 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000000750 progressive effect Effects 0.000 description 1
- 230000010076 replication Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
- G06F11/14—Error detection or correction of the data by redundancy in operation
- G06F11/1402—Saving, restoring, recovering or retrying
- G06F11/1446—Point-in-time backing up or restoration of persistent data
- G06F11/1448—Management of the data involved in backup or backup restore
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Quality & Reliability (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The application discloses a data copying method of a distributed file system, which comprises the steps of receiving a copying request sent by a client, and determining a target data structure corresponding to the copying request; generating metadata of the target data structure, and associating the metadata of the target data structure with metadata of a source file in the distributed file system to obtain an association relation; and modifying the source file according to the data modification instruction sent by the client, and executing copy-on-write operation on the target data structure in the client according to the incidence relation. The data copying efficiency can be improved. The application also discloses a data copying system of the distributed file system, an electronic device and a storage medium, and the data copying system, the electronic device and the storage medium have the beneficial effects.
Description
Technical Field
The present application relates to the field of computer technologies, and in particular, to a data copying method and system for a distributed file system, an electronic device, and a storage medium.
Background
With the ever-increasing data storage requirements, the amount of file data managed by enterprises is also increasing. When a business needs to copy mass data in a file system, a client needs to read data from a server to the client, the client sends the data to the server again to be written, and various IO (input/output) confirmations (eg: lookup and the like) are carried out in the period. The data copying mode has long IO path and low data copying efficiency.
Therefore, how to improve the data copying efficiency is a technical problem that needs to be solved by those skilled in the art at present.
Disclosure of Invention
The application aims to provide a data copying method and system of a distributed file system, an electronic device and a storage medium, which can improve the data copying efficiency.
In order to solve the above technical problem, the present application provides a data copying method for a distributed file system, where the data copying method includes:
receiving a copy request sent by a client, and determining a target data structure corresponding to the copy request;
generating metadata of the target data structure, and associating the metadata of the target data structure with metadata of a source file in the distributed file system to obtain an association relation;
and modifying the source file according to the data modification instruction sent by the client, and executing copy-on-write operation on the target data structure in the client according to the incidence relation.
Optionally, after associating the metadata of the target data structure with the metadata of the source file in the distributed file system to obtain an association relationship, the method further includes:
and returning prompt information of successful association to the client.
Optionally, after associating the metadata of the target data structure with the metadata of the source file in the distributed file system to obtain an association relationship, the method further includes:
and sending the incidence relation to the client so that the client can generate a data modification instruction according to the incidence relation.
Optionally, the method further includes:
generating an association ID of metadata of the target data structure with metadata of the source file;
correspondingly, sending the association relationship to the client includes:
and sending the association ID to the client.
Optionally, determining the target data structure corresponding to the copy request includes:
and analyzing the copy request to obtain a target directory and/or a target file, and setting the target directory and/or the target file as a target data structure.
Optionally, associating the metadata of the target data structure with metadata of a source file in the distributed file system, including:
and associating the metadata of the target data structure with the metadata of the source file in the distributed file system in a hard link mode.
The present application further provides a data copy system of a distributed file system, the data copy system including:
the request receiving module is used for receiving a copy request sent by a client and determining a target data structure corresponding to the copy request;
the association module is used for generating metadata of the target data structure and associating the metadata of the target data structure with the metadata of the source file in the distributed file system to obtain an association relation;
and the copying module is used for modifying the source file according to the data modification instruction sent by the client and executing copy-on-write operation on the target data structure in the client according to the incidence relation.
Optionally, the method further includes:
and the prompt module is used for returning prompt information of successful association to the client after the metadata of the target data structure is associated with the metadata of the source file in the distributed file system to obtain an association relationship.
The present application also provides a storage medium having a computer program stored thereon, which when executed, implements the steps performed by the data copying method of the distributed file system described above.
The application also provides an electronic device, which comprises a memory and a processor, wherein the memory stores a computer program, and the processor realizes the steps executed by the data copying method of the distributed file system when calling the computer program in the memory.
The application provides a data copying method of a distributed file system, which comprises the steps of receiving a copying request sent by a client, and determining a target data structure corresponding to the copying request; generating metadata of the target data structure, and associating the metadata of the target data structure with metadata of a source file in the distributed file system to obtain an association relation; and modifying the source file according to the data modification instruction sent by the client, and executing copy-on-write operation on the target data structure in the client according to the incidence relation.
After a copy request sent by a client is received, metadata of a target data structure corresponding to the copy request is generated, and the metadata of the target data structure and the metadata of a source file in a distributed file system are combined. When a data modification instruction sent by a client is received, copy-on-write operation corresponding to the data modification instruction can be executed on a source file and a target data structure in the distributed file system according to the association relationship. According to the method and the device, the copy-on-write mechanism is added, the data reuse rate is improved on the premise of ensuring the data consistency, and the data copy efficiency can be improved. The application also provides a data copying system of the distributed file system, an electronic device and a storage medium, which have the beneficial effects and are not repeated herein.
Drawings
In order to more clearly illustrate the embodiments of the present application, the drawings needed for the embodiments will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present application, and that other drawings can be obtained by those skilled in the art without inventive effort.
Fig. 1 is a flowchart of a data copying method of a distributed file system according to an embodiment of the present application;
FIG. 2 is a schematic diagram of a file copying principle provided in an embodiment of the present application;
fig. 3 is a schematic structural diagram of a data copying system of a distributed file system according to an embodiment of the present application.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present application clearer, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are some embodiments of the present application, but not all embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
Referring to fig. 1, fig. 1 is a flowchart of a data copying method of a distributed file system according to an embodiment of the present application.
The specific steps may include:
s101: receiving a copy request sent by a client, and determining a target data structure corresponding to the copy request;
the embodiment can be applied to a distributed file system, and the physical storage resources of the distributed file system can be connected with the nodes through a computer network. Before this step, there may be an operation of sending a copy request by the client, and the present implementation may determine a target data structure in the client according to the received copy request, so as to copy the data in the distributed file system to the target data structure. The target data structure in this embodiment may include a target directory or a target file, and it should be noted that the target data structure is a virtual space structure, and the target data structure may not include actual data before this step. The client-generated copy request may include the following information: a source directory and a target directory, or a source file and a target file; and the original file is a file in the distributed file system.
As a possible implementation manner, this embodiment may parse the copy request to obtain a target directory and/or a target file, and set the target directory and/or the target file as a target data structure. The target data structure may include a target directory, may include a target file, and may include both a target directory and a target file.
S102: generating metadata of the target data structure, and associating the metadata of the target data structure with metadata of a source file in the distributed file system to obtain an association relation;
after determining the target data structure that the client needs to copy, the present embodiment may utilize the metadata server to generate metadata of the target data structure, and associate the metadata of the target data structure with metadata of a source file in the distributed file system. After the association operation in this step is performed, the source file in the distributed file system is associated with the target data structure, that is, when the source file in the distributed file system is modified, a copy-on-write operation may be performed on the target data structure according to the association relationship, so as to complete the copy. As a possible implementation manner, in this embodiment, the metadata of the target data structure and the metadata of the source file in the distributed file system may be associated in a hard link manner.
Further, after associating the metadata of the target data structure with the metadata of the source file in the distributed file system, the metadata server may also return prompt information of successful association to the client, so that the client sends a data modification instruction after receiving the prompt information of successful association.
S103: and modifying the source file according to the data modification instruction sent by the client, and executing copy-on-write operation on the target data structure in the client according to the incidence relation.
After receiving a data modification instruction sent by a client, modification operation can be performed on a source file in the distributed file system according to the data modification instruction, and a target data structure in the client performs copy-on-write operation according to the modification of the source file, so that data copy is completed. For example, in the above process, the client creates the folder a, sends a copy request to the metadata server, and the metadata server creates metadata for the folder a, and associates the metadata of the folder a with metadata of a source file in the distributed file system. When the client sends a data 1 modification instruction to the distributed file system, a source file in the data server can be modified, and the folder A in the client copies the modified data 1 to the client based on copy-on-write operation. Specifically, the data modification instruction is used to modify a target data structure in a certain data server in the distributed file system, and other data servers and the target data structure may perform copy-on-write operations based on an association relationship between the metadata and the target data structure, so as to complete replication. In the embodiment, the copy request is sent to the metadata server when the file is copied, the metadata is associated with the target file and the source file to complete the copy action, the modified data enters a COW flow when the file is modified, and other data are still shared.
In this embodiment, after receiving a copy request sent by a client, metadata of a target data structure corresponding to the copy request is generated, and the metadata of the target data structure and metadata of a source file in a distributed file system are combined. When a data modification instruction sent by a client is received, copy-on-write operation corresponding to the data modification instruction can be executed on a source file and a target data structure in the distributed file system according to the association relationship. According to the embodiment, by adding the copy-on-write mechanism, the data reuse rate is improved on the premise of ensuring the data consistency, and the data copy efficiency can be improved.
As a further introduction to the corresponding embodiment of fig. 1, after associating the metadata of the target data structure with the metadata of the source file in the distributed file system, the association relationship may also be sent to the client, so that the client generates a data modification instruction according to the association relationship. Further, after associating the metadata of the target data structure with the metadata of the target data structure of the metadata of the source file in the distributed file system, a prompt message that the association is successful may be returned to the client.
As a further introduction to the corresponding embodiment of fig. 1, after associating the metadata of the target data structure with the metadata of the source file in the distributed file system, this embodiment may further generate an association ID of the metadata of the target data structure and the metadata of the source file, and the association ID may be sent to the client while sending the association relationship between the metadata and the target data structure to the client.
The flow described in the above embodiment is explained below by an embodiment in practical use. Please refer to fig. 2, and fig. 2 is a schematic diagram illustrating a file copying principle provided in an embodiment of the present application, where in the embodiment, by adding a COW mechanism of a file, on the premise of ensuring data consistency, the data reuse rate is improved as much as possible, IO paths can be effectively reduced, a copying speed is increased, a capacity utilization rate is improved, and fast copying of mass data is achieved. The specific implementation process is as follows:
the client sends a request for the data information to be copied to the metadata server. Bulk files are supported by default in units of directories. After receiving the copy request, the metadata server creates metadata of a new target file for the target directory/file, associates the metadata of the new target file with the data of the original file, and generates an association ID, and uses the same data as the source file (the process is similar to hard linking). And returning success to the client after the association is successful. When the client modifies the data, the client sends a modification request to the data server, and all the data servers can perform copy-on-write (COW) according to the associated ID and the object size, and after the COW is completed, the client returns success.
Specifically, the data requested by the copy request sent by the client to the metadata server may be a directory or a batch file. After receiving the copy request, the metadata server creates metadata of a new target file aiming at the target directory/file, associates the new metadata with the data of the original file, generates an association ID, and uses the same data as the source file. When the client modifies the data, the client carries out COW on the object with the specified size according to the association ID, and other parts of data are still shared.
In the embodiment, the copy action is converted into the copy request and is sent to the metadata server, and the metadata server completes the copy action after executing the associated operation of the file, so that no data operation exists in the whole process. According to the embodiment, by adding the COW mechanism of the file, on the premise of ensuring data consistency, the data reuse rate is improved as much as possible, IO paths can be effectively reduced, the copying speed is increased, the capacity utilization rate is improved, and rapid copying of mass data is realized.
Referring to fig. 3, fig. 3 is a schematic structural diagram of a data copying system of a distributed file system according to an embodiment of the present application;
the system may include:
a request receiving module 100, configured to receive a copy request sent by a client, and determine a target data structure corresponding to the copy request;
an association module 200, configured to generate metadata of the target data structure, and associate the metadata of the target data structure with metadata of a source file in the distributed file system to obtain an association relationship;
the copying module 300 is configured to modify the source file according to the data modification instruction sent by the client, and perform copy-on-write operation on the target data structure in the client according to the association relationship.
In this embodiment, after receiving a copy request sent by a client, metadata of a target data structure corresponding to the copy request is generated, and the metadata of the target data structure and metadata of a source file in a distributed file system are combined. When a data modification instruction sent by a client is received, copy-on-write operation corresponding to the data modification instruction can be executed on a source file and a target data structure in the distributed file system according to the association relationship. According to the embodiment, by adding the copy-on-write mechanism, the data reuse rate is improved on the premise of ensuring the data consistency, and the data copy efficiency can be improved.
Optionally, the method further includes:
and the prompt module is used for returning prompt information of successful association to the client after the metadata of the target data structure is associated with the metadata of the source file in the distributed file system to obtain an association relationship.
Further, the method also comprises the following steps:
and the incidence relation sending module is used for sending the incidence relation to the client so that the client can generate a data modification instruction according to the incidence relation.
Further, the method also comprises the following steps:
and the ID generation module is used for generating the association ID of the metadata of the target data structure and the metadata of the source file and sending the association ID to the client.
Further, the request receiving module 100 includes:
and the structure setting unit is used for analyzing the copy request to obtain a target directory and/or a target file and setting the target directory and/or the target file as a target data structure.
Further, the associating module 200 is specifically a module for associating the metadata of the target data structure with the metadata of the source file in the distributed file system in a hard link manner.
The embodiment provides a copy scheme of a distributed file system based on COW, and by adding a COW mechanism of a file, on the premise of ensuring data consistency, the reuse rate of the data is improved as much as possible, IO paths can be effectively reduced, the copy speed is increased, the capacity utilization rate is improved, and rapid copy of mass data is realized.
Since the embodiment of the system part corresponds to the embodiment of the method part, the embodiment of the system part is described with reference to the embodiment of the method part, and is not repeated here.
The present application also provides a storage medium having a computer program stored thereon, which when executed, may implement the steps provided by the above-described embodiments. The storage medium may include: various media capable of storing program codes, such as a usb disk, a removable hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk, or an optical disk.
The application further provides an electronic device, which may include a memory and a processor, where the memory stores a computer program, and the processor may implement the steps provided by the foregoing embodiments when calling the computer program in the memory. Of course, the electronic device may also include various network interfaces, power supplies, and the like.
The embodiments are described in a progressive manner in the specification, each embodiment focuses on differences from other embodiments, and the same and similar parts among the embodiments are referred to each other. For the system disclosed by the embodiment, the description is relatively simple because the system corresponds to the method disclosed by the embodiment, and the relevant points can be referred to the method part for description. It should be noted that, for those skilled in the art, it is possible to make several improvements and modifications to the present application without departing from the principle of the present application, and such improvements and modifications also fall within the scope of the claims of the present application.
It is further noted that, in the present specification, relational terms such as first and second, and the like are used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in a process, method, article, or apparatus that comprises the element.
Claims (10)
1. A data copying method of a distributed file system is characterized by comprising the following steps:
receiving a copy request sent by a client, and determining a target data structure corresponding to the copy request;
generating metadata of the target data structure, and associating the metadata of the target data structure with metadata of a source file in the distributed file system to obtain an association relation;
and modifying the source file according to the data modification instruction sent by the client, and executing copy-on-write operation on the target data structure in the client according to the incidence relation.
2. The data copying method of claim 1, further comprising, after associating the metadata of the target data structure with metadata of a source file in the distributed file system to obtain an association relationship:
and returning prompt information of successful association to the client.
3. The data copying method of claim 1, further comprising, after associating the metadata of the target data structure with metadata of a source file in the distributed file system to obtain an association relationship:
and sending the incidence relation to the client so that the client can generate a data modification instruction according to the incidence relation.
4. The data copying method of claim 3, further comprising:
generating an association ID of metadata of the target data structure with metadata of the source file;
correspondingly, sending the association relationship to the client includes:
and sending the association ID to the client.
5. The data copying method of claim 1, wherein determining the target data structure corresponding to the copy request comprises:
and analyzing the copy request to obtain a target directory and/or a target file, and setting the target directory and/or the target file as a target data structure.
6. A data copying method according to any one of claims 1 to 5, wherein associating metadata of the target data structure with metadata of a source file in the distributed file system comprises:
and associating the metadata of the target data structure with the metadata of the source file in the distributed file system in a hard link mode.
7. A data copy system for a distributed file system, comprising:
the request receiving module is used for receiving a copy request sent by a client and determining a target data structure corresponding to the copy request;
the association module is used for generating metadata of the target data structure and associating the metadata of the target data structure with the metadata of the source file in the distributed file system to obtain an association relation;
and the copying module is used for modifying the source file according to the data modification instruction sent by the client and executing copy-on-write operation on the target data structure in the client according to the incidence relation.
8. The data copying system of claim 7, further comprising:
and the prompt module is used for returning prompt information of successful association to the client after the metadata of the target data structure is associated with the metadata of the source file in the distributed file system to obtain an association relationship.
9. An electronic device, comprising a memory in which a computer program is stored and a processor, wherein the processor implements the steps of the data copy method of the distributed file system according to any one of claims 1 to 6 when calling the computer program in the memory.
10. A storage medium having stored thereon computer-executable instructions which, when loaded and executed by a processor, carry out the steps of a method for data copying of a distributed file system as claimed in any one of claims 1 to 6.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911330447.4A CN111143126A (en) | 2019-12-20 | 2019-12-20 | Data copying method, system and related components of distributed file system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911330447.4A CN111143126A (en) | 2019-12-20 | 2019-12-20 | Data copying method, system and related components of distributed file system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN111143126A true CN111143126A (en) | 2020-05-12 |
Family
ID=70519234
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201911330447.4A Withdrawn CN111143126A (en) | 2019-12-20 | 2019-12-20 | Data copying method, system and related components of distributed file system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111143126A (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111737223A (en) * | 2020-06-28 | 2020-10-02 | 浪潮电子信息产业股份有限公司 | File copying method, device, equipment and storage medium |
| CN113806107A (en) * | 2021-08-25 | 2021-12-17 | 济南浪潮数据技术有限公司 | Object copying method, device, equipment and storage medium |
| WO2022012044A1 (en) * | 2020-07-17 | 2022-01-20 | 苏州浪潮智能科技有限公司 | Thin-provisioned file copying method, apparatus and device, and readable storage medium |
Citations (14)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1542626A (en) * | 2003-04-29 | 2004-11-03 | 国际商业机器公司 | Method and system for implementing copy-on-write of a file |
| CN102073739A (en) * | 2011-01-25 | 2011-05-25 | 中国科学院计算技术研究所 | Method for reading and writing data in distributed file system with snapshot function |
| US20110219201A1 (en) * | 2010-03-02 | 2011-09-08 | Symantec Corporation | Copy on write storage conservation systems and methods |
| US20150066852A1 (en) * | 2013-08-27 | 2015-03-05 | Netapp, Inc. | Detecting out-of-band (oob) changes when replicating a source file system using an in-line system |
| CN104714755A (en) * | 2013-12-13 | 2015-06-17 | 华为技术有限公司 | Snapshoot management method and device |
| US20150169668A1 (en) * | 2013-12-18 | 2015-06-18 | Quantum Corporation | Single Pass File System Repair With Copy On Write |
| US20150234712A1 (en) * | 2014-02-18 | 2015-08-20 | Ca, Inc. | Methods of synchronizing files including synchronized hash map linked lists and related data processing nodes |
| US20150269214A1 (en) * | 2014-03-19 | 2015-09-24 | Red Hat, Inc. | Identifying files in change logs using file content location identifiers |
| WO2015184925A1 (en) * | 2014-10-24 | 2015-12-10 | 中兴通讯股份有限公司 | Data processing method for distributed file system and distributed file system |
| CN106575309A (en) * | 2014-08-29 | 2017-04-19 | 微软技术许可有限责任公司 | File system with data block sharing |
| CN107436952A (en) * | 2017-08-15 | 2017-12-05 | 郑州云海信息技术有限公司 | A kind of document copying method and device based on distributed memory system |
| CN109522281A (en) * | 2018-11-29 | 2019-03-26 | 郑州云海信息技术有限公司 | A kind of method of Distributed File System Data rapid copy |
| CN110008197A (en) * | 2019-04-12 | 2019-07-12 | 苏州浪潮智能科技有限公司 | A kind of data processing method, system and electronic equipment and storage medium |
| CN110032541A (en) * | 2019-04-12 | 2019-07-19 | 苏州浪潮智能科技有限公司 | A kind of writeable snapshot implementing method and system |
-
2019
- 2019-12-20 CN CN201911330447.4A patent/CN111143126A/en not_active Withdrawn
Patent Citations (14)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1542626A (en) * | 2003-04-29 | 2004-11-03 | 国际商业机器公司 | Method and system for implementing copy-on-write of a file |
| US20110219201A1 (en) * | 2010-03-02 | 2011-09-08 | Symantec Corporation | Copy on write storage conservation systems and methods |
| CN102073739A (en) * | 2011-01-25 | 2011-05-25 | 中国科学院计算技术研究所 | Method for reading and writing data in distributed file system with snapshot function |
| US20150066852A1 (en) * | 2013-08-27 | 2015-03-05 | Netapp, Inc. | Detecting out-of-band (oob) changes when replicating a source file system using an in-line system |
| CN104714755A (en) * | 2013-12-13 | 2015-06-17 | 华为技术有限公司 | Snapshoot management method and device |
| US20150169668A1 (en) * | 2013-12-18 | 2015-06-18 | Quantum Corporation | Single Pass File System Repair With Copy On Write |
| US20150234712A1 (en) * | 2014-02-18 | 2015-08-20 | Ca, Inc. | Methods of synchronizing files including synchronized hash map linked lists and related data processing nodes |
| US20150269214A1 (en) * | 2014-03-19 | 2015-09-24 | Red Hat, Inc. | Identifying files in change logs using file content location identifiers |
| CN106575309A (en) * | 2014-08-29 | 2017-04-19 | 微软技术许可有限责任公司 | File system with data block sharing |
| WO2015184925A1 (en) * | 2014-10-24 | 2015-12-10 | 中兴通讯股份有限公司 | Data processing method for distributed file system and distributed file system |
| CN107436952A (en) * | 2017-08-15 | 2017-12-05 | 郑州云海信息技术有限公司 | A kind of document copying method and device based on distributed memory system |
| CN109522281A (en) * | 2018-11-29 | 2019-03-26 | 郑州云海信息技术有限公司 | A kind of method of Distributed File System Data rapid copy |
| CN110008197A (en) * | 2019-04-12 | 2019-07-12 | 苏州浪潮智能科技有限公司 | A kind of data processing method, system and electronic equipment and storage medium |
| CN110032541A (en) * | 2019-04-12 | 2019-07-19 | 苏州浪潮智能科技有限公司 | A kind of writeable snapshot implementing method and system |
Non-Patent Citations (2)
| Title |
|---|
| 董晓明等: "分布式文件系统的写性能优化", 《微型电脑应用》 * |
| 陶润东: "针对拷贝因子的云存储负载均衡技术", 《信息技术》 * |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111737223A (en) * | 2020-06-28 | 2020-10-02 | 浪潮电子信息产业股份有限公司 | File copying method, device, equipment and storage medium |
| CN111737223B (en) * | 2020-06-28 | 2023-02-28 | 浪潮电子信息产业股份有限公司 | File copying method, device, equipment and storage medium |
| WO2022012044A1 (en) * | 2020-07-17 | 2022-01-20 | 苏州浪潮智能科技有限公司 | Thin-provisioned file copying method, apparatus and device, and readable storage medium |
| CN113806107A (en) * | 2021-08-25 | 2021-12-17 | 济南浪潮数据技术有限公司 | Object copying method, device, equipment and storage medium |
| CN113806107B (en) * | 2021-08-25 | 2024-02-13 | 济南浪潮数据技术有限公司 | Object copying method, device, equipment and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US9405483B1 (en) | Optimized write performance at block-based storage during volume snapshot operations | |
| CN101217571B (en) | Write/read document operation method applied in multi-copy data grid system | |
| CN111143126A (en) | Data copying method, system and related components of distributed file system | |
| CN107016016B (en) | Data processing method and device | |
| US11354050B2 (en) | Data processing method, apparatus, and computing device | |
| CN113220729A (en) | Data storage method and device, electronic equipment and computer readable storage medium | |
| EP3384384A1 (en) | Methods and devices for acquiring data using virtual machine and host machine | |
| CN105160018A (en) | Method, device and system for image copy/paste | |
| CN110764930B (en) | Request or response processing method and device based on message mode | |
| JP2014522017A (en) | Presentation software automation service | |
| WO2010097848A1 (en) | Storage system | |
| CN109710454A (en) | A kind of cloud host snapshot method and device | |
| CN110049133B (en) | Method and device for issuing full amount of DNS zone files | |
| US20140365430A1 (en) | Information processing apparatus, system, and control method | |
| CN115586872A (en) | Container mirror image management method, device, equipment and storage medium | |
| CN111737223B (en) | File copying method, device, equipment and storage medium | |
| CN115150392A (en) | Remote file copying method, system, computing equipment and storage medium | |
| CN111625397B (en) | Service log backup method, cluster, device, electronic equipment and storage medium | |
| CN103605795A (en) | Metadata-based file storage method and device | |
| CN109491987B (en) | Data management method and device | |
| US6834281B1 (en) | Method and apparatus to support multi-node direct access to file system data | |
| CN109918178B (en) | Transaction submitting method and related device | |
| US20090006942A1 (en) | Embedded markup resources | |
| CN112084123B (en) | Data processing method and device and data processing system | |
| CN110837536B (en) | Information processing method, device and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WW01 | Invention patent application withdrawn after publication | ||
| WW01 | Invention patent application withdrawn after publication |
Application publication date: 20200512 |