CN112860188A - Data migration method, system, device and medium - Google Patents
Data migration method, system, device and medium Download PDFInfo
- Publication number
- CN112860188A CN112860188A CN202110176463.3A CN202110176463A CN112860188A CN 112860188 A CN112860188 A CN 112860188A CN 202110176463 A CN202110176463 A CN 202110176463A CN 112860188 A CN112860188 A CN 112860188A
- Authority
- CN
- China
- Prior art keywords
- data
- access heat
- data objects
- migration
- heat table
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
- G06F3/0646—Horizontal data movement in storage systems, i.e. moving data in between storage devices or systems
- G06F3/0647—Migration mechanisms
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
- G06F3/0604—Improving or facilitating administration, e.g. storage management
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0668—Interfaces specially adapted for storage systems adopting a particular infrastructure
- G06F3/067—Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]
Abstract
The invention discloses a data migration method, which comprises the following steps: creating an access hotlist in the source volume; recording the ID corresponding to the data object with the access frequency larger than the threshold value in the source volume into the access heat table; acquiring the ID of the data object in the access heat table in response to receiving the instruction of data migration; and migrating the corresponding data object to the target volume according to the ID of the data object in the access heat table. The invention also discloses a system, a computer device and a readable storage medium. According to the scheme provided by the invention, the frequently accessed data is preferentially selected for migration, so that the hierarchical migration of the data can be realized, the data migration time is shortened, the influence of the data migration on the reading and writing of other data volumes in the distributed storage is reduced, and the efficient normal operation of data access services of a data center is ensured.
Description
Technical Field
The present invention relates to the field of data migration, and in particular, to a data migration method, system, device, and storage medium.
Background
The normal reading and writing of the data volume can be influenced in the migration process of the data volume, so that the reading and writing IOPS and the bandwidth of the data volume are reduced. If the data volume has a large amount of data, the data migration time is also prolonged, and the reading and writing of the data volume are seriously affected. At present, the existing research mainly focuses on the implementation of the migration algorithm of the data volume, and does not consider the influence on the reading and writing of other data volumes in the data migration process.
Disclosure of Invention
In view of the above, in order to overcome at least one aspect of the above problems, an embodiment of the present invention provides a data migration method, including the following steps:
creating an access hotlist in the source volume;
recording the ID corresponding to the data object with the access frequency larger than the threshold value in the source volume into the access heat table;
acquiring the ID of the data object in the access heat table in response to receiving the instruction of data migration;
and migrating the corresponding data object to the target volume according to the ID of the data object in the access heat table.
In some embodiments, migrating the corresponding data object to the target volume according to the ID of the data object in the access heat table further includes:
judging whether the number of the IDs of the data objects in the access heat meter is larger than a preset value or not;
responding to the fact that the number of the data objects is larger than the preset value, and migrating according to the ID of the data objects in the access heat table;
and in response to the fact that the number of the IDs of the data objects in the access heat table is not larger than the preset value, waiting for a preset time period, and if the number of the IDs of the data objects in the access heat table is larger than the preset value in the period or the preset time period is over, migrating according to the IDs of the data objects in the access heat table.
In some embodiments, further comprising:
deleting the data objects which are migrated to the target volume in the source volume and the corresponding ID in the access heat table;
and after responding to the data object migration, the number of the IDs of the data objects in the access heat table is larger than the preset value again, and the corresponding data objects are migrated to the target volume again according to the current IDs of the data objects in the access heat table.
In some embodiments, further comprising:
and migrating the residual data objects in the source volume to the target volume in response to the fact that the resource utilization rate of the current system is smaller than the preset utilization rate.
Based on the same inventive concept, according to another aspect of the present invention, an embodiment of the present invention further provides a data migration system, including:
a creation module configured to create an access heat table in a source volume;
a recording module configured to record an ID corresponding to a data object in the source volume, which is accessed more frequently than a threshold, into the access heat table;
an obtaining module configured to obtain, in response to receiving a data migration instruction, an ID of a data object in the access hotlist;
and the migration module is configured to migrate the corresponding data object to the target volume according to the ID of the data object in the access heat table.
In some embodiments, the migration module is further configured to:
judging whether the number of the IDs of the data objects in the access heat meter is larger than a preset value or not;
responding to the fact that the number of the data objects is larger than the preset value, and migrating according to the ID of the data objects in the access heat table;
and in response to the fact that the number of the IDs of the data objects in the access heat table is not larger than the preset value, waiting for a preset time period, and if the number of the IDs of the data objects in the access heat table is larger than the preset value in the period or the preset time period is over, migrating according to the IDs of the data objects in the access heat table.
In some embodiments, the migration module is further configured to:
deleting the data objects which are migrated to the target volume in the source volume and the corresponding ID in the access heat table;
and after responding to the data object migration, the number of the IDs of the data objects in the access heat table is larger than the preset value again, and the corresponding data objects are migrated to the target volume again according to the current IDs of the data objects in the access heat table.
In some embodiments, further comprising a second migration module configured to:
and migrating the residual data objects in the source volume to the target volume in response to the fact that the resource utilization rate of the current system is smaller than the preset utilization rate.
Based on the same inventive concept, according to another aspect of the present invention, an embodiment of the present invention further provides a computer apparatus, including:
at least one processor; and
a memory storing a computer program operable on the processor, wherein the processor executes the program to perform any of the steps of the data migration method described above.
Based on the same inventive concept, according to another aspect of the present invention, an embodiment of the present invention further provides a computer-readable storage medium storing a computer program which, when executed by a processor, performs the steps of any of the data migration methods described above.
The invention has one of the following beneficial technical effects: according to the scheme provided by the invention, the frequently accessed data is preferentially selected for migration, so that the hierarchical migration of the data can be realized, the data migration time is shortened, the influence of the data migration on the reading and writing of other data volumes in the distributed storage is reduced, and the efficient normal operation of data access services of a data center is ensured.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art that other embodiments can be obtained by using the drawings without creative efforts.
FIG. 1 is a flow chart illustrating a data migration method according to an embodiment of the present invention;
FIG. 2 is a schematic structural diagram of a data migration system according to an embodiment of the present invention;
FIG. 3 is a schematic structural diagram of a computer device provided in an embodiment of the present invention;
fig. 4 is a schematic structural diagram of a computer-readable storage medium according to an embodiment of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention more apparent, the following embodiments of the present invention are described in further detail with reference to the accompanying drawings.
It should be noted that all expressions using "first" and "second" in the embodiments of the present invention are used for distinguishing two entities with the same name but different names or different parameters, and it should be noted that "first" and "second" are merely for convenience of description and should not be construed as limitations of the embodiments of the present invention, and they are not described in any more detail in the following embodiments.
According to an aspect of the present invention, an embodiment of the present invention proposes a data migration method, as shown in fig. 1, which may include the steps of:
s1, creating an access heat table in the source volume;
s2, recording the ID corresponding to the data object with the access frequency larger than the threshold value in the source volume into the access heat table;
s3, in response to the received data migration instruction, acquiring the ID of the data object in the access heat table;
and S4, migrating the corresponding data object to the target volume according to the ID of the data object in the access heat table.
According to the scheme provided by the invention, the frequently accessed data is preferentially selected for migration, so that the hierarchical migration of the data can be realized, the data migration time is shortened, the influence of the data migration on the reading and writing of other data volumes in the distributed storage is reduced, and the efficient normal operation of data access services of a data center is ensured.
In some embodiments, in step S1, an access heat table is created in the source volume, and in particular, the access heat table may be created at the time of volume initialization creation, for example, a new data structure, a data object access heat table, may be added to the metadata of the data volume, and then recorded according to the frequency of access of the data objects.
In some embodiments, the access hot access table may be added and deleted by the LRU algorithm to record frequently accessed data objects in the data volume. For example, when a data object in the source volume is accessed, the data object ID is recorded, then the data object access heat table is traversed, and if the data object ID exists, the substitution to the table tail exists, and if the data object ID does not exist, the substitution is added. If the data object access heat table is not full, directly adding the data object access heat table; if the data object access heat table is full, the data object ID held in the header in the table is added and removed.
In some embodiments, a data migration priority ratio may be set, which represents a ratio of a migration priority data amount to a volume size, that is, a length of the access heat table is equal to a number of data objects in the source volume multiplied by a preset migration priority ratio. Therefore, when the subsequent migration is carried out, the data with the set proportion is preferentially migrated, so that when the system is busy (namely, the utilization rate is greater than the threshold value), the data migration time is shortened, the influence of the data migration on the reading and writing of other data volumes in the distributed storage is reduced, and the efficient and normal operation of data access services of the data center is ensured.
In some embodiments, migrating the corresponding data object to the target volume according to the ID of the data object in the access heat table further includes:
judging whether the number of the IDs of the data objects in the access heat meter is larger than a preset value or not;
responding to the fact that the number of the data objects is larger than the preset value, and migrating according to the ID of the data objects in the access heat table;
and in response to the fact that the number of the IDs of the data objects in the access heat table is not larger than the preset value, waiting for a preset time period, and if the number of the IDs of the data objects in the access heat table is larger than the preset value in the period or the preset time period is over, migrating according to the IDs of the data objects in the access heat table.
Specifically, in order to further reduce the influence on other data volumes in the data migration process, before the migration, it may be determined whether the number of IDs of the data objects in the access hotlist is greater than a preset value, if the number of IDs is greater than the preset value, the migration is performed, if the number of IDs is not greater than the preset value, a timer may be started, and if the time that is not greater than the preset value continuously reaches a time threshold, the data migration is directly performed, so as to avoid that the data migration cannot be performed for a long time.
In some embodiments, further comprising:
deleting the data objects which are migrated to the target volume in the source volume and the corresponding ID in the access heat table;
and after responding to the data object migration, the number of the IDs of the data objects in the access heat table is larger than the preset value again, and the corresponding data objects are migrated to the target volume again according to the current IDs of the data objects in the access heat table.
Specifically, migration parameters, such as the number of times of migration or a time period, may be preset, and as long as the current number of times of migration is less than the set number of times of migration, or the migration duration is less than the set time period, after data object migration is performed once, when the number of data object IDs in the access heat table is again greater than a preset value, the data object corresponding to the ID of the current data object in the access heat table is migrated to the target volume again. Therefore, the frequently accessed data objects in the source volume can be guaranteed to be timely migrated to the target volume.
In some embodiments, after receiving the MIGRATION instruction, the STATEs of the source volume and the target volume may be updated to migratio _ STATE _ execution, and when the preset number of times of MIGRATION is reached or a set time period is reached, the data of the source volume is migrated to the target volume by using the CopyUP mechanism. In the migration process, when the data object of the target volume is read, if the data object of the target volume does not exist, the data object of the source volume is read, otherwise, the data object of the target volume is read; when writing the data object of the target volume, if the data object of the target volume does not exist, reading the data object of the source volume and storing the data object of the source volume to the target volume, then writing the data object of the target volume, otherwise, directly writing the data object of the target volume.
In some embodiments, further comprising:
and migrating the residual data objects in the source volume to the target volume in response to the fact that the resource utilization rate of the current system is smaller than the preset utilization rate.
Specifically, when the system is in a non-busy period, the migration instruction may be issued again to migrate the remaining data objects in the source volume to the target volume.
According to the scheme provided by the invention, the frequently accessed data is preferentially selected for migration, so that the hierarchical migration of the data can be realized, the data migration time is shortened, the influence of the data migration on the reading and writing of other data volumes in the distributed storage is reduced, and the efficient normal operation of data access services of a data center is ensured. And finally, when the system is in an idle state, performing subsequent migration on the infrequently accessed data.
Based on the same inventive concept, according to another aspect of the present invention, an embodiment of the present invention further provides a data migration system 400, as shown in fig. 2, including:
a creation module 401, the creation module 401 configured to create an access heat table in a source volume;
a recording module 402, wherein the recording module 402 is configured to record the ID corresponding to the data object in the source volume whose access frequency is greater than the threshold value into the access heat table;
an obtaining module 403, where the obtaining module 403 is configured to obtain, in response to receiving the instruction of data migration, an ID of the data object in the access heat table;
a migration module 404, wherein the migration module 404 is configured to migrate the corresponding data object to the target volume according to the ID of the data object in the access heat table.
In some embodiments, the migration module 404 is further configured to:
judging whether the number of the IDs of the data objects in the access heat meter is larger than a preset value or not;
responding to the fact that the number of the data objects is larger than the preset value, and migrating according to the ID of the data objects in the access heat table;
and in response to the fact that the number of the IDs of the data objects in the access heat table is not larger than the preset value, waiting for a preset time period, and if the number of the IDs of the data objects in the access heat table is larger than the preset value in the period or the preset time period is over, migrating according to the IDs of the data objects in the access heat table.
In some embodiments, the migration module is further configured to:
deleting the data objects which are migrated to the target volume in the source volume and the corresponding ID in the access heat table;
and after responding to the data object migration, the number of the IDs of the data objects in the access heat table is larger than the preset value again, and the corresponding data objects are migrated to the target volume again according to the current IDs of the data objects in the access heat table.
In some embodiments, further comprising a second migration module configured to:
and migrating the residual data objects in the source volume to the target volume in response to the fact that the resource utilization rate of the current system is smaller than the preset utilization rate.
Based on the same inventive concept, according to another aspect of the present invention, as shown in fig. 3, an embodiment of the present invention further provides a computer apparatus 501, comprising:
at least one processor 520; and
the memory 510, the memory 510 storing a computer program 511 executable on the processor, the processor 520 executing the program to perform the steps of any of the data migration methods as described above.
Based on the same inventive concept, according to another aspect of the present invention, as shown in fig. 4, an embodiment of the present invention further provides a computer-readable storage medium 601, where the computer-readable storage medium 601 stores computer program instructions 610, and the computer program instructions 610, when executed by a processor, perform the steps of any of the data migration methods as above.
Finally, it should be noted that, as will be understood by those skilled in the art, all or part of the processes of the methods of the above embodiments may be implemented by a computer program, which may be stored in a computer-readable storage medium, and when executed, may include the processes of the embodiments of the methods described above.
Further, it should be appreciated that the computer-readable storage media (e.g., memory) herein can be either volatile memory or nonvolatile memory, or can include both volatile and nonvolatile memory.
Those of skill would further appreciate that the various illustrative logical blocks, modules, circuits, and algorithm steps described in connection with the disclosure herein may be implemented as electronic hardware, computer software, or combinations of both. To clearly illustrate this interchangeability of hardware and software, various illustrative components, blocks, modules, circuits, and steps have been described above generally in terms of their functionality. Whether such functionality is implemented as software or hardware depends upon the particular application and design constraints imposed on the overall system. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the disclosed embodiments of the present invention.
The foregoing is an exemplary embodiment of the present disclosure, but it should be noted that various changes and modifications could be made herein without departing from the scope of the present disclosure as defined by the appended claims. The functions, steps and/or actions of the method claims in accordance with the disclosed embodiments described herein need not be performed in any particular order. Furthermore, although elements of the disclosed embodiments of the invention may be described or claimed in the singular, the plural is contemplated unless limitation to the singular is explicitly stated.
It should be understood that, as used herein, the singular forms "a", "an" and "the" are intended to include the plural forms as well, unless the context clearly supports the exception. It should also be understood that "and/or" as used herein is meant to include any and all possible combinations of one or more of the associated listed items.
The numbers of the embodiments disclosed in the embodiments of the present invention are merely for description, and do not represent the merits of the embodiments.
It will be understood by those skilled in the art that all or part of the steps of implementing the above embodiments may be implemented by hardware, or may be implemented by a program instructing relevant hardware, and the program may be stored in a computer-readable storage medium, and the above-mentioned storage medium may be a read-only memory, a magnetic disk or an optical disk, etc.
Those of ordinary skill in the art will understand that: the discussion of any embodiment above is meant to be exemplary only, and is not intended to intimate that the scope of the disclosure, including the claims, of embodiments of the invention is limited to these examples; within the idea of an embodiment of the invention, also technical features in the above embodiment or in different embodiments may be combined and there are many other variations of the different aspects of the embodiments of the invention as described above, which are not provided in detail for the sake of brevity. Therefore, any omissions, modifications, substitutions, improvements, and the like that may be made without departing from the spirit and principles of the embodiments of the present invention are intended to be included within the scope of the embodiments of the present invention.
Claims (10)
1. A method of data migration, comprising the steps of:
creating an access hotlist in the source volume;
recording the ID corresponding to the data object with the access frequency larger than the threshold value in the source volume into the access heat table;
acquiring the ID of the data object in the access heat table in response to receiving the instruction of data migration;
and migrating the corresponding data object to the target volume according to the ID of the data object in the access heat table.
2. The method of claim 1, wherein migrating the corresponding data object to the target volume according to the ID of the data object in the access hotlist, further comprises:
judging whether the number of the IDs of the data objects in the access heat meter is larger than a preset value or not;
responding to the fact that the number of the data objects is larger than the preset value, and migrating according to the ID of the data objects in the access heat table;
and in response to the fact that the number of the IDs of the data objects in the access heat table is not larger than the preset value, waiting for a preset time period, and if the number of the IDs of the data objects in the access heat table is larger than the preset value in the period or the preset time period is over, migrating according to the IDs of the data objects in the access heat table.
3. The method of claim 2, further comprising:
deleting the data objects which are migrated to the target volume in the source volume and the corresponding ID in the access heat table;
and after responding to the data object migration, the number of the IDs of the data objects in the access heat table is larger than the preset value again, and the corresponding data objects are migrated to the target volume again according to the current IDs of the data objects in the access heat table.
4. The method of claim 3, further comprising:
and migrating the residual data objects in the source volume to the target volume in response to the fact that the resource utilization rate of the current system is smaller than the preset utilization rate.
5. A data migration system, comprising:
a creation module configured to create an access heat table in a source volume;
a recording module configured to record an ID corresponding to a data object in the source volume, which is accessed more frequently than a threshold, into the access heat table;
an obtaining module configured to obtain, in response to receiving a data migration instruction, an ID of a data object in the access hotlist;
and the migration module is configured to migrate the corresponding data object to the target volume according to the ID of the data object in the access heat table.
6. The system of claim 5, wherein the migration module is further configured to:
judging whether the number of the IDs of the data objects in the access heat meter is larger than a preset value or not;
responding to the fact that the number of the data objects is larger than the preset value, and migrating according to the ID of the data objects in the access heat table;
and in response to the fact that the number of the IDs of the data objects in the access heat table is not larger than the preset value, waiting for a preset time period, and if the number of the IDs of the data objects in the access heat table is larger than the preset value in the period or the preset time period is over, migrating according to the IDs of the data objects in the access heat table.
7. The system of claim 6, wherein the migration module is further configured to:
deleting the data objects which are migrated to the target volume in the source volume and the corresponding ID in the access heat table;
and after responding to the data object migration, the number of the IDs of the data objects in the access heat table is larger than the preset value again, and the corresponding data objects are migrated to the target volume again according to the current IDs of the data objects in the access heat table.
8. The system of claim 7, further comprising a second migration module configured to:
and migrating the residual data objects in the source volume to the target volume in response to the fact that the resource utilization rate of the current system is smaller than the preset utilization rate.
9. A computer device, comprising:
at least one processor; and
memory storing a computer program operable on the processor, characterized in that the processor executes the program to perform the steps of the method according to any of claims 1-4.
10. A computer-readable storage medium, in which a computer program is stored which, when being executed by a processor, is adapted to carry out the steps of the method according to any one of claims 1-4.
Priority Applications (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202110176463.3A CN112860188A (en) | 2021-02-09 | 2021-02-09 | Data migration method, system, device and medium |
PCT/CN2022/074431 WO2022171000A1 (en) | 2021-02-09 | 2022-01-27 | Data transfer method and system, and device and medium |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202110176463.3A CN112860188A (en) | 2021-02-09 | 2021-02-09 | Data migration method, system, device and medium |
Publications (1)
Publication Number | Publication Date |
---|---|
CN112860188A true CN112860188A (en) | 2021-05-28 |
Family
ID=75989449
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN202110176463.3A Pending CN112860188A (en) | 2021-02-09 | 2021-02-09 | Data migration method, system, device and medium |
Country Status (2)
Country | Link |
---|---|
CN (1) | CN112860188A (en) |
WO (1) | WO2022171000A1 (en) |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2022171000A1 (en) * | 2021-02-09 | 2022-08-18 | 山东英信计算机技术有限公司 | Data transfer method and system, and device and medium |
CN117591039A (en) * | 2024-01-18 | 2024-02-23 | 济南浪潮数据技术有限公司 | Distributed storage method, system, equipment and medium |
Citations (10)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN101079902A (en) * | 2007-06-29 | 2007-11-28 | 清华大学 | A great magnitude of data hierarchical storage method |
CN102510390A (en) * | 2011-09-28 | 2012-06-20 | 北京飞杰信息技术有限公司 | Method and device for instructing data migration by hard disk temperature self-detection |
CN103078933A (en) * | 2012-12-29 | 2013-05-01 | 深圳先进技术研究院 | Method and device for determining data migration time |
CN103106047A (en) * | 2013-01-29 | 2013-05-15 | 浪潮(北京)电子信息产业有限公司 | Storage system based on object and storage method thereof |
CN105653591A (en) * | 2015-12-22 | 2016-06-08 | 浙江中控研究院有限公司 | Hierarchical storage and migration method of industrial real-time data |
CN109471836A (en) * | 2018-11-01 | 2019-03-15 | 浪潮电子信息产业股份有限公司 | A kind of data migration method, device and system |
CN110175163A (en) * | 2019-05-24 | 2019-08-27 | 江西尚通科技发展股份有限公司 | More library separation methods, system and medium based on business function intelligently parsing |
CN110399100A (en) * | 2019-07-05 | 2019-11-01 | 苏州浪潮智能科技有限公司 | A kind of method, apparatus of migration process, computer storage medium and terminal |
CN111124304A (en) * | 2019-12-19 | 2020-05-08 | 北京浪潮数据技术有限公司 | Data migration method and device, electronic equipment and storage medium |
CN112015347A (en) * | 2020-08-28 | 2020-12-01 | 北京浪潮数据技术有限公司 | Data migration method and device and related equipment |
Family Cites Families (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2010257094A (en) * | 2009-04-23 | 2010-11-11 | Hitachi Ltd | Method for clipping migration candidate file in hierarchical storage management system |
JP6028415B2 (en) * | 2012-06-28 | 2016-11-16 | 日本電気株式会社 | Data migration control device, method and system for virtual server environment |
CN102882928A (en) * | 2012-08-31 | 2013-01-16 | 浪潮电子信息产业股份有限公司 | Hierarchical storage management method of cloud storing system |
CN104462240A (en) * | 2014-11-18 | 2015-03-25 | 浪潮(北京)电子信息产业有限公司 | Method and system for realizing hierarchical storage and management in cloud storage |
CN105892952A (en) * | 2016-04-22 | 2016-08-24 | 深圳市深信服电子科技有限公司 | Hyper-converged system and longitudinal extension method thereof |
US10042578B2 (en) * | 2016-11-08 | 2018-08-07 | International Business Machines Corporation | Extent migration in multi-tier storage systems |
CN112860188A (en) * | 2021-02-09 | 2021-05-28 | 山东英信计算机技术有限公司 | Data migration method, system, device and medium |
-
2021
- 2021-02-09 CN CN202110176463.3A patent/CN112860188A/en active Pending
-
2022
- 2022-01-27 WO PCT/CN2022/074431 patent/WO2022171000A1/en active Application Filing
Patent Citations (10)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN101079902A (en) * | 2007-06-29 | 2007-11-28 | 清华大学 | A great magnitude of data hierarchical storage method |
CN102510390A (en) * | 2011-09-28 | 2012-06-20 | 北京飞杰信息技术有限公司 | Method and device for instructing data migration by hard disk temperature self-detection |
CN103078933A (en) * | 2012-12-29 | 2013-05-01 | 深圳先进技术研究院 | Method and device for determining data migration time |
CN103106047A (en) * | 2013-01-29 | 2013-05-15 | 浪潮(北京)电子信息产业有限公司 | Storage system based on object and storage method thereof |
CN105653591A (en) * | 2015-12-22 | 2016-06-08 | 浙江中控研究院有限公司 | Hierarchical storage and migration method of industrial real-time data |
CN109471836A (en) * | 2018-11-01 | 2019-03-15 | 浪潮电子信息产业股份有限公司 | A kind of data migration method, device and system |
CN110175163A (en) * | 2019-05-24 | 2019-08-27 | 江西尚通科技发展股份有限公司 | More library separation methods, system and medium based on business function intelligently parsing |
CN110399100A (en) * | 2019-07-05 | 2019-11-01 | 苏州浪潮智能科技有限公司 | A kind of method, apparatus of migration process, computer storage medium and terminal |
CN111124304A (en) * | 2019-12-19 | 2020-05-08 | 北京浪潮数据技术有限公司 | Data migration method and device, electronic equipment and storage medium |
CN112015347A (en) * | 2020-08-28 | 2020-12-01 | 北京浪潮数据技术有限公司 | Data migration method and device and related equipment |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2022171000A1 (en) * | 2021-02-09 | 2022-08-18 | 山东英信计算机技术有限公司 | Data transfer method and system, and device and medium |
CN117591039A (en) * | 2024-01-18 | 2024-02-23 | 济南浪潮数据技术有限公司 | Distributed storage method, system, equipment and medium |
Also Published As
Publication number | Publication date |
---|---|
WO2022171000A1 (en) | 2022-08-18 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
RU2671049C2 (en) | Flushing in file system | |
CN108647151A (en) | It is a kind of to dodge system metadata rule method, apparatus, equipment and storage medium entirely | |
TW201520889A (en) | Hybrid storage | |
CN107704203B (en) | Deletion method, device and equipment for aggregated large file and computer storage medium | |
CN111881135A (en) | Data aggregation method, device, equipment and computer readable storage medium | |
CN107807797B (en) | Data writing method and device and server | |
CN112860188A (en) | Data migration method, system, device and medium | |
CN111208934B (en) | Data storage method and device | |
CN113282249B (en) | Data processing method, system, device and medium | |
CN109558456A (en) | A kind of file migration method, apparatus, equipment and readable storage medium storing program for executing | |
US20220164316A1 (en) | Deduplication method and apparatus | |
CN106844491B (en) | Temporary data writing and reading method and device | |
CN111625203A (en) | Method, system, device and medium for hierarchical storage | |
CN115114232A (en) | Method, device and medium for enumerating historical version objects | |
CN113608695A (en) | Data processing method, system, device and medium | |
CN105808451B (en) | Data caching method and related device | |
CN110955639A (en) | Data processing method and device | |
US9395930B2 (en) | Information processing system, control method of information processing system, and recording medium | |
KR20150103886A (en) | Data processing apparatus for pipeline execution acceleration and method thereof | |
CN112000971B (en) | File permission recording method, system and related device | |
CN109254958A (en) | Distributed data reading/writing method, equipment and system | |
CN112486831A (en) | Test system, test method, electronic equipment and storage medium | |
CN112463073A (en) | Object storage distributed quota method, system, equipment and storage medium | |
CN114579061B (en) | Data storage method, device, equipment and medium | |
CN112286448B (en) | Object access method and device, electronic equipment and machine-readable storage medium |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination |