CN113806295A - File migration method, system, equipment and computer readable storage medium - Google Patents
File migration method, system, equipment and computer readable storage medium Download PDFInfo
- Publication number
- CN113806295A CN113806295A CN202111093200.2A CN202111093200A CN113806295A CN 113806295 A CN113806295 A CN 113806295A CN 202111093200 A CN202111093200 A CN 202111093200A CN 113806295 A CN113806295 A CN 113806295A
- Authority
- CN
- China
- Prior art keywords
- file
- snapshot
- target file
- metadata
- storage system
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 230000005012 migration Effects 0.000 title claims abstract description 62
- 238000013508 migration Methods 0.000 title claims abstract description 62
- 238000000034 method Methods 0.000 title claims abstract description 57
- GOLXNESZZPUPJE-UHFFFAOYSA-N spiromesifen Chemical compound CC1=CC(C)=CC(C)=C1C(C(O1)=O)=C(OC(=O)CC(C)(C)C)C11CCCC1 GOLXNESZZPUPJE-UHFFFAOYSA-N 0.000 claims abstract description 20
- 238000004590 computer program Methods 0.000 claims description 26
- 230000008569 process Effects 0.000 claims description 24
- 238000012546 transfer Methods 0.000 claims description 2
- 239000002699 waste material Substances 0.000 abstract description 6
- 230000001276 controlling effect Effects 0.000 description 22
- 238000004891 communication Methods 0.000 description 7
- 238000005516 engineering process Methods 0.000 description 6
- 238000010586 diagram Methods 0.000 description 5
- 230000000875 corresponding effect Effects 0.000 description 4
- 230000009471 action Effects 0.000 description 3
- 230000008859 change Effects 0.000 description 3
- 230000002776 aggregation Effects 0.000 description 2
- 238000004220 aggregation Methods 0.000 description 2
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012545 processing Methods 0.000 description 1
- 230000001960 triggered effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/11—File system administration, e.g. details of archiving or snapshots
- G06F16/119—Details of migration of file systems
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/11—File system administration, e.g. details of archiving or snapshots
- G06F16/128—Details of file system snapshots on the file-level, e.g. snapshot creation, administration, deletion
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/18—File system types
- G06F16/182—Distributed file systems
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D10/00—Energy efficient computing, e.g. low power processors, power management or thermal management
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Databases & Information Systems (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The application discloses a file migration method, a system, equipment and a computer readable storage medium, which are applied to a client in a distributed file storage system and used for determining a target file to be migrated to a low-speed storage pool in a high-speed storage pool; controlling a metadata server in the distributed file storage system to prohibit the metadata of the snapshot target file; and controlling an object storage cluster in the distributed file storage system to forbid the snapshot of the target file in the high-speed storage pool. In the method, after the client determines the target file to be migrated, the client needs to control the metadata server in the distributed file storage system to prohibit the metadata of the snapshot target file, so that invalid snapshots of the metadata of the target file can be prevented from occupying storage resources; the object storage cluster in the distributed file storage system needs to be controlled to forbid the snapshot of the target file in the high-speed storage pool, so that the invalid snapshot of the target file can be prevented from occupying storage resources; resource waste in a distributed file storage system can be reduced.
Description
Technical Field
The present application relates to the field of distributed file storage technologies, and in particular, to a file migration method, system, device, and computer-readable storage medium.
Background
At present, in a distributed file storage system, snapshot and cache aggregation operations exist, where a snapshot is a read-only mirror image of all data at a certain time, and a state before the data can be checked or restored according to the snapshot; the cache aggregation is to create small files into a high-level storage pool, and migrate the small files into a low-speed storage pool after the small files meet migration conditions. However, in a distributed file storage system, there are resource wasting situations when snapshots and cache aggregates work together.
In summary, how to reduce the waste of resources in the distributed file storage system is an urgent problem to be solved by those skilled in the art.
Disclosure of Invention
The application aims to provide a file migration method which can solve the technical problem of reducing resource waste in a distributed file storage system to a certain extent. The application also provides a file migration system, equipment and a computer readable storage medium.
In order to achieve the above purpose, the present application provides the following technical solutions:
a file migration method is applied to a client in a distributed file storage system and comprises the following steps:
determining a target file to be migrated to a slow storage pool in a high-speed storage pool;
controlling a metadata server in the distributed file storage system to prohibit the snapshot of the metadata of the target file;
and controlling an object storage cluster in the distributed file storage system to forbid snapshot of the target file in the high-speed storage pool.
Preferably, the controlling the metadata server in the distributed file storage system to prohibit the snapshot of the metadata of the target file includes:
and sending identification information representing file migration to the metadata server in the distributed file storage system, so that the metadata server skips the snapshot of the metadata of the target file after receiving the identification information.
Preferably, the controlling the object storage cluster in the distributed file storage system to prohibit the snapshot of the target file in the high-speed storage pool includes:
and in the process of calling an object storage cluster in the distributed file storage system to delete the target file in the high-speed storage pool, emptying the snapshot domain of the target file so that the object storage cluster skips the snapshot of the target file in the high-speed storage pool based on the emptied snapshot domain.
Preferably, after determining that the target file in the high-speed storage pool is to be migrated to the low-speed storage pool, before controlling the metadata server in the distributed file storage system to prohibit the snapshot of the metadata of the target file, the method further includes:
and transferring the snapshot domain of the target file to be empty in the process of calling the object storage cluster to write the target file into the slow storage pool.
A file migration system is applied to a client in a distributed file storage system and comprises:
the first determining module is used for determining a target file to be migrated to the slow storage pool in the high-speed storage pool;
the first control module is used for controlling a metadata server in the distributed file storage system to forbid the metadata of the snapshot target file;
and the second control module is used for controlling the object storage cluster in the distributed file storage system to forbid the snapshot of the target file in the high-speed storage pool.
Preferably, the first control module includes:
the first sending unit is configured to send identification information representing file migration to the metadata server in the distributed file storage system, so that the metadata server skips a snapshot of metadata of the target file after receiving the identification information.
Preferably, the second control module includes:
a second sending unit, configured to transfer the snapshot domain of the target file to be empty in a process of calling an object storage cluster in the distributed file storage system to delete the target file in the high-speed storage pool, so that the object storage cluster skips a snapshot of the target file in the high-speed storage pool based on the snapshot domain that is transferred to be empty.
Preferably, the method further comprises the following steps:
a third sending unit, configured to, after the first determining module determines that the target file in the high-speed storage pool is to be migrated to the low-speed storage pool, call the object storage cluster to write the target file into the low-speed storage pool in a process of emptying the snapshot domain of the target file before the first control module controls the metadata server in the distributed file storage system to prohibit the snapshot of the metadata of the target file.
A file migration apparatus comprising:
a memory for storing a computer program;
a processor for implementing the steps of the file migration method as described in any one of the above when executing the computer program.
A computer readable storage medium having a computer program stored therein, which when executed by a processor implements the steps of a file migration method as described in any one of the above.
The file migration method is applied to a client in a distributed file storage system, and determines a target file to be migrated to a low-speed storage pool in a high-speed storage pool; controlling a metadata server in the distributed file storage system to prohibit the metadata of the snapshot target file; and controlling an object storage cluster in the distributed file storage system to forbid the snapshot of the target file in the high-speed storage pool. In the method, after the client determines the target file to be migrated, considering that the migration does not change the target file, the metadata server in the distributed file storage system needs to be controlled to prohibit the metadata of the snapshot target file, so that invalid snapshots of the metadata of the target file can be prevented from occupying storage resources; the object storage cluster in the distributed file storage system needs to be controlled to forbid the snapshot of the target file in the high-speed storage pool, so that the invalid snapshot of the target file can be prevented from occupying storage resources; resource waste in a distributed file storage system can be reduced. The file migration system, the file migration equipment and the computer readable storage medium solve the corresponding technical problems.
Drawings
In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings needed to be used in the description of the embodiments or the prior art will be briefly introduced below, it is obvious that the drawings in the following description are only embodiments of the present application, and for those skilled in the art, other drawings can be obtained according to the provided drawings without creative efforts.
Fig. 1 is a flowchart of a file migration method according to an embodiment of the present application;
fig. 2 is a schematic structural diagram of a file migration system according to an embodiment of the present application;
fig. 3 is a schematic structural diagram of a file migration apparatus according to an embodiment of the present application;
fig. 4 is another schematic structural diagram of a file migration apparatus according to an embodiment of the present application.
Detailed Description
The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
Referring to fig. 1, fig. 1 is a flowchart of a file migration method according to an embodiment of the present disclosure.
The file migration method provided by the embodiment of the application is applied to a client in a distributed file storage system, and can comprise the following steps:
step S101: and determining a target file to be migrated to the slow storage pool in the high-speed storage pool.
In practical application, the client may first determine a target file to be migrated to the slow storage pool in the high-speed storage pool, the type, content, and the like of the target file may be determined according to actual needs, and the determination manner of the target file may also be determined according to actual needs, for example, a file with the lowest access frequency in the high-speed storage pool may be used as the target file, and the like, which is not specifically limited herein.
Step S102: and controlling a metadata server in the distributed file storage system to prohibit the metadata of the snapshot target file.
Step S103: and controlling an object storage cluster in the distributed file storage system to forbid the snapshot of the target file in the high-speed storage pool.
In practical application, considering that the file itself is not changed during file migration, and a triggering condition of a snapshot guarantees file migration, but at this time, when the migrated file is subjected to snapshot, data change is not brought, that is, the snapshot at this time is an invalid snapshot, so that if the migrated file is subjected to snapshot, the data after snapshot additionally occupies resources of the distributed file storage system, which causes resource waste, in order to avoid this situation, a client needs to control a Metadata server (MDS) in the distributed file storage system to prohibit the Metadata of a snapshot target file, so as to avoid the invalid snapshot of the Metadata of the target file from occupying storage resources; an Object storage cluster (OSD) in the distributed file storage system is controlled to prohibit the snapshot of the target file in the high-speed storage pool, so as to avoid the invalid snapshot of the target file occupying the storage resource.
The file migration method is applied to a client in a distributed file storage system, and determines a target file to be migrated to a low-speed storage pool in a high-speed storage pool; controlling a metadata server in the distributed file storage system to prohibit the metadata of the snapshot target file; and controlling an object storage cluster in the distributed file storage system to forbid the snapshot of the target file in the high-speed storage pool. In the method, after the client determines the target file to be migrated, considering that the migration does not change the target file, the metadata server in the distributed file storage system needs to be controlled to prohibit the metadata of the snapshot target file, so that invalid snapshots of the metadata of the target file can be prevented from occupying storage resources; the object storage cluster in the distributed file storage system needs to be controlled to forbid the snapshot of the target file in the high-speed storage pool, so that the invalid snapshot of the target file can be prevented from occupying storage resources; resource waste in a distributed file storage system can be reduced.
The file migration method provided by the embodiment of the application is applied to a client in a distributed file storage system, and can send identification information representing file migration to a metadata server in the distributed file storage system in the process of controlling the metadata server in the distributed file storage system to forbid snapshot of metadata of a target file, so that the metadata server skips snapshot of the metadata of the target file after receiving the identification information. Of course, there may be other methods for controlling the metadata server in the distributed file storage system to prohibit the metadata of the snapshot target file, for example, directly sending the information of the metadata of the snapshot target file to the metadata server, and the like, which is not specifically limited herein.
It should be noted that, in the file migration process, after determining a target file to be migrated, the client needs to write the target file in the slow storage pool by means of the object storage cluster; sending a setttr message to the metadata server to inform the metadata server of modifying the metadata information of the target file; and finally deleting the target file in the high-speed storage pool by virtue of the object storage cluster. Therefore, in the process of sending the identification information representing the file migration to the metadata server in the distributed file storage system, the identification information may be added to the settr message, and the settr message sends the identification information to the metadata server.
The file migration method provided by the embodiment of the application is applied to the client in the distributed file storage system, in the process of controlling the object storage cluster in the distributed file storage system to forbid the snapshot of the target file in the high-speed storage pool, considering that the snapshot process can generate the snapshot domain of the file, namely the ID of the snapshot file, and the snapshot operation is triggered only if the value of the new snapshot domain of the file is greater than the value of the old snapshot domain, therefore, the value of the snapshot domain can be flexibly set to avoid the occurrence of snapshot operation, namely, in the process of calling the object storage cluster in the distributed file storage system to delete the target file in the high-speed storage pool, the snapshot domain of the target file may be transferred empty, such that the empty snapshot domain of the target file may be smaller than the previous old snapshot domain, the object storage cluster may skip the snapshot of the target file in the high-speed storage pool based on the snapshot domain that is empty.
In a specific application scenario, after a target file to be migrated to a low-speed storage pool in a high-speed storage pool is determined, before a metadata server in a distributed file storage system is controlled to prohibit the metadata of a snapshot target file, a snapshot domain of the target file can be emptied in the process of calling an object storage cluster to write the target file into the low-speed storage pool, so that if a subsequent target file changes, the target file can be directly snapshot based on a new snapshot domain, and the snapshot accuracy is ensured.
Referring to fig. 2, fig. 2 is a schematic structural diagram of a file migration system according to an embodiment of the present application.
The file migration system provided by the embodiment of the present application is applied to a client in a distributed file storage system, and may include:
a first determining module 101, configured to determine a target file to be migrated to a slow storage pool in a high-speed storage pool;
the first control module 102 is configured to control a metadata server in the distributed file storage system to prohibit metadata of a snapshot target file;
and the second control module 103 is configured to control the object storage cluster in the distributed file storage system to prohibit the target file in the snapshot high-speed storage pool.
The file migration system provided by the embodiment of the application is applied to a client in a distributed file storage system, and the first control module comprises:
the first sending unit is used for sending the identification information representing the file migration to a metadata server in the distributed file storage system, so that the metadata server skips the snapshot of the metadata of the target file after receiving the identification information.
The file migration system provided by the embodiment of the application is applied to a client in a distributed file storage system, and the second control module comprises:
and the second sending unit is used for transferring the snapshot domain of the target file to be null in the process of calling the object storage cluster in the distributed file storage system to delete the target file in the high-speed storage pool, so that the object storage cluster skips the snapshot of the target file in the high-speed storage pool based on the snapshot domain transferred to be null.
The file migration system provided in the embodiment of the present application is applied to a client in a distributed file storage system, and further includes:
and the third sending unit is used for transferring the snapshot domain of the target file to be emptied in the process of calling the object storage cluster to write the target file into the slow storage pool before the first control module controls the metadata server in the distributed file storage system to forbid the metadata of the snapshot target file after the first determining module determines that the target file to be migrated to the low storage pool in the high storage pool.
The application also provides file migration equipment and a computer readable storage medium, which have corresponding effects of the file migration method provided by the embodiment of the application. Referring to fig. 3, fig. 3 is a schematic structural diagram of a file migration apparatus according to an embodiment of the present application.
The file migration device provided by the embodiment of the application comprises a memory 201 and a processor 202, wherein a computer program is stored in the memory 201, and the processor 202 implements the following steps when executing the computer program:
determining a target file to be migrated to a slow storage pool in a high-speed storage pool;
controlling a metadata server in the distributed file storage system to prohibit the metadata of the snapshot target file;
and controlling an object storage cluster in the distributed file storage system to forbid the snapshot of the target file in the high-speed storage pool.
The file migration device provided by the embodiment of the application comprises a memory 201 and a processor 202, wherein a computer program is stored in the memory 201, and the processor 202 implements the following steps when executing the computer program: and sending identification information representing file migration to a metadata server in the distributed file storage system, so that the metadata server skips the snapshot of the metadata of the target file after receiving the identification information.
The file migration device provided by the embodiment of the application comprises a memory 201 and a processor 202, wherein a computer program is stored in the memory 201, and the processor 202 implements the following steps when executing the computer program: and in the process of calling the object storage cluster in the distributed file storage system to delete the target file in the high-speed storage pool, emptying the snapshot domain of the target file so that the object storage cluster skips the snapshot of the target file in the high-speed storage pool based on the emptied snapshot domain.
The file migration device provided by the embodiment of the application comprises a memory 201 and a processor 202, wherein a computer program is stored in the memory 201, and the processor 202 implements the following steps when executing the computer program: after determining that the target file in the high-speed storage pool is to be migrated to the low-speed storage pool, and before controlling a metadata server in the distributed file storage system to forbid the metadata of the snapshot target file, transferring the snapshot domain of the target file to be empty in the process of calling the object storage cluster to write the target file into the low-speed storage pool.
Referring to fig. 4, another file migration device provided in the embodiment of the present application may further include: an input port 203 connected to the processor 202, for transmitting externally input commands to the processor 202; a display unit 204 connected to the processor 202, for displaying the processing result of the processor 202 to the outside; and the communication module 205 is connected with the processor 202 and is used for realizing the communication between the file migration device and the outside world. The display unit 204 may be a display panel, a laser scanning display, or the like; the communication method adopted by the communication module 205 includes, but is not limited to, mobile high definition link technology (HML), Universal Serial Bus (USB), High Definition Multimedia Interface (HDMI), and wireless connection: wireless fidelity technology (WiFi), bluetooth communication technology, bluetooth low energy communication technology, ieee802.11s based communication technology.
A computer-readable storage medium is provided in an embodiment of the present application, in which a computer program is stored, and when the computer program is executed by a processor, the computer program implements the following steps:
determining a target file to be migrated to a slow storage pool in a high-speed storage pool;
controlling a metadata server in the distributed file storage system to prohibit the metadata of the snapshot target file;
and controlling an object storage cluster in the distributed file storage system to forbid the snapshot of the target file in the high-speed storage pool.
A computer-readable storage medium is provided in an embodiment of the present application, in which a computer program is stored, and when the computer program is executed by a processor, the computer program implements the following steps: and sending identification information representing file migration to a metadata server in the distributed file storage system, so that the metadata server skips the snapshot of the metadata of the target file after receiving the identification information.
A computer-readable storage medium is provided in an embodiment of the present application, in which a computer program is stored, and when the computer program is executed by a processor, the computer program implements the following steps: and in the process of calling the object storage cluster in the distributed file storage system to delete the target file in the high-speed storage pool, emptying the snapshot domain of the target file so that the object storage cluster skips the snapshot of the target file in the high-speed storage pool based on the emptied snapshot domain.
A computer-readable storage medium is provided in an embodiment of the present application, in which a computer program is stored, and when the computer program is executed by a processor, the computer program implements the following steps: after determining that the target file in the high-speed storage pool is to be migrated to the low-speed storage pool, and before controlling a metadata server in the distributed file storage system to forbid the metadata of the snapshot target file, transferring the snapshot domain of the target file to be empty in the process of calling the object storage cluster to write the target file into the low-speed storage pool.
The computer-readable storage media to which this application relates include Random Access Memory (RAM), memory, Read Only Memory (ROM), electrically programmable ROM, electrically erasable programmable ROM, registers, hard disk, a removable disk, a CD-ROM, or any other form of storage media known in the art.
For a description of a relevant part in the file migration system, the device, and the computer-readable storage medium provided in the embodiments of the present application, reference is made to detailed descriptions of corresponding parts in the file migration method provided in the embodiments of the present application, and details are not repeated here. In addition, parts of the above technical solutions provided in the embodiments of the present application, which are consistent with the implementation principles of corresponding technical solutions in the prior art, are not described in detail so as to avoid redundant description.
It is further noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in a process, method, article, or apparatus that comprises the element.
The previous description of the disclosed embodiments is provided to enable any person skilled in the art to make or use the present application. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other embodiments without departing from the spirit or scope of the application. Thus, the present application is not intended to be limited to the embodiments shown herein but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.
Claims (10)
1. A file migration method is applied to a client in a distributed file storage system and comprises the following steps:
determining a target file to be migrated to a slow storage pool in a high-speed storage pool;
controlling a metadata server in the distributed file storage system to prohibit the snapshot of the metadata of the target file;
and controlling an object storage cluster in the distributed file storage system to forbid snapshot of the target file in the high-speed storage pool.
2. The method of claim 1, wherein the controlling the metadata server in the distributed file storage system to prohibit the snapshot of the metadata of the target file comprises:
and sending identification information representing file migration to the metadata server in the distributed file storage system, so that the metadata server skips the snapshot of the metadata of the target file after receiving the identification information.
3. The method of claim 1, wherein said controlling an object storage cluster in the distributed file storage system to disallow snapshots of the target file in the high-speed storage pool comprises:
and in the process of calling an object storage cluster in the distributed file storage system to delete the target file in the high-speed storage pool, emptying the snapshot domain of the target file so that the object storage cluster skips the snapshot of the target file in the high-speed storage pool based on the emptied snapshot domain.
4. The method according to any one of claims 1 to 3, wherein after determining that the target file in the high-speed storage pool is to be migrated to the low-speed storage pool, before controlling the metadata server in the distributed file storage system to prohibit the snapshot of the metadata of the target file, further comprising:
and transferring the snapshot domain of the target file to be empty in the process of calling the object storage cluster to write the target file into the slow storage pool.
5. A file migration system, applied to a client in a distributed file storage system, includes:
the first determining module is used for determining a target file to be migrated to the slow storage pool in the high-speed storage pool;
the first control module is used for controlling a metadata server in the distributed file storage system to forbid the metadata of the snapshot target file;
and the second control module is used for controlling the object storage cluster in the distributed file storage system to forbid the snapshot of the target file in the high-speed storage pool.
6. The file migration system according to claim 5, wherein said first control module comprises:
the first sending unit is configured to send identification information representing file migration to the metadata server in the distributed file storage system, so that the metadata server skips a snapshot of metadata of the target file after receiving the identification information.
7. The file migration system according to claim 5, wherein said second control module comprises:
a second sending unit, configured to transfer the snapshot domain of the target file to be empty in a process of calling an object storage cluster in the distributed file storage system to delete the target file in the high-speed storage pool, so that the object storage cluster skips a snapshot of the target file in the high-speed storage pool based on the snapshot domain that is transferred to be empty.
8. The file migration system according to any one of claims 5 to 7, further comprising:
a third sending unit, configured to, after the first determining module determines that the target file in the high-speed storage pool is to be migrated to the low-speed storage pool, call the object storage cluster to write the target file into the low-speed storage pool in a process of emptying the snapshot domain of the target file before the first control module controls the metadata server in the distributed file storage system to prohibit the snapshot of the metadata of the target file.
9. A file migration apparatus, comprising:
a memory for storing a computer program;
a processor for implementing the steps of the file migration method according to any one of claims 1 to 4 when executing the computer program.
10. A computer-readable storage medium, in which a computer program is stored, which, when being executed by a processor, carries out the steps of the file migration method according to any one of claims 1 to 4.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111093200.2A CN113806295B (en) | 2021-09-17 | 2021-09-17 | File migration method, system, equipment and computer readable storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111093200.2A CN113806295B (en) | 2021-09-17 | 2021-09-17 | File migration method, system, equipment and computer readable storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113806295A true CN113806295A (en) | 2021-12-17 |
| CN113806295B CN113806295B (en) | 2024-02-23 |
Family
ID=78895799
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111093200.2A Active CN113806295B (en) | 2021-09-17 | 2021-09-17 | File migration method, system, equipment and computer readable storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113806295B (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117591495A (en) * | 2024-01-18 | 2024-02-23 | 中核武汉核电运行技术股份有限公司 | Data storage method and system for nuclear power historical data migration |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20090228532A1 (en) * | 2008-03-07 | 2009-09-10 | Hitachi, Ltd | Storage System |
| CN106777225A (en) * | 2016-12-26 | 2017-05-31 | 腾讯科技（深圳）有限公司 | The moving method and system of a kind of data |
| CN107704550A (en) * | 2017-09-26 | 2018-02-16 | 深圳前海微众银行股份有限公司 | File migration method, apparatus and computer-readable recording medium |
| CN111104404A (en) * | 2019-12-04 | 2020-05-05 | 星辰天合（北京）数据科技有限公司 | Data storage method and device based on distributed objects |
-
2021
- 2021-09-17 CN CN202111093200.2A patent/CN113806295B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20090228532A1 (en) * | 2008-03-07 | 2009-09-10 | Hitachi, Ltd | Storage System |
| CN106777225A (en) * | 2016-12-26 | 2017-05-31 | 腾讯科技（深圳）有限公司 | The moving method and system of a kind of data |
| CN107704550A (en) * | 2017-09-26 | 2018-02-16 | 深圳前海微众银行股份有限公司 | File migration method, apparatus and computer-readable recording medium |
| CN111104404A (en) * | 2019-12-04 | 2020-05-05 | 星辰天合（北京）数据科技有限公司 | Data storage method and device based on distributed objects |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117591495A (en) * | 2024-01-18 | 2024-02-23 | 中核武汉核电运行技术股份有限公司 | Data storage method and system for nuclear power historical data migration |
| CN117591495B (en) * | 2024-01-18 | 2024-05-03 | 中核武汉核电运行技术股份有限公司 | Data storage method and system for nuclear power historical data migration |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113806295B (en) | 2024-02-23 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US20200311026A1 (en) | File processing method and server | |
| US10620871B1 (en) | Storage scheme for a distributed storage system | |
| CN102968380B (en) | The management method of memory partitioning and device in memory file system | |
| CN110888844A (en) | Data deleting method, system, equipment and computer readable storage medium | |
| WO2018000300A1 (en) | Data operation method for electronic device, and electronic device | |
| CN110968417B (en) | Method, apparatus, system and computer storage medium for managing storage units | |
| US20140297927A1 (en) | Information processing apparatus, information processing method, and recording medium | |
| CN113806295A (en) | File migration method, system, equipment and computer readable storage medium | |
| CN112783868A (en) | Distributed database table structure gray scale upgrading method, device and system | |
| CN111352647A (en) | Virtual machine upgrading method, device, equipment and storage medium | |
| US20150242224A1 (en) | Disk resize of a virtual machine | |
| WO2021018052A1 (en) | Garbage collection method and apparatus | |
| CN108287793B (en) | Response message buffering method and server | |
| CN112241398A (en) | Data migration method and system | |
| US10678453B2 (en) | Method and device for checking false sharing in data block deletion using a mapping pointer and weight bits | |
| CN112632032B (en) | Data migration method and device, storage medium and terminal equipment | |
| CN109284237B (en) | Garbage recovery method and system in full flash memory array | |
| CN112463027B (en) | I/O processing method, system, equipment and computer readable storage medium | |
| CN108345431B (en) | Data reading method and device | |
| CN111176571A (en) | Method, device, equipment and medium for managing local object | |
| CN112463028A (en) | I/O processing method, system, equipment and computer readable storage medium | |
| CN104461382A (en) | Internal writing method for file server operating multiple file systems and server | |
| CN108304200B (en) | Method and device for upgrading driving program and electronic equipment | |
| CN112783804A (en) | Data access method, device and storage medium | |
| CN111090627A (en) | Log storage method and device based on pooling, computer equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |