CN112860188A - Data migration method, system, device and medium - Google Patents

Data migration method, system, device and medium Download PDF

Info

Publication number
CN112860188A
CN112860188A CN202110176463.3A CN202110176463A CN112860188A CN 112860188 A CN112860188 A CN 112860188A CN 202110176463 A CN202110176463 A CN 202110176463A CN 112860188 A CN112860188 A CN 112860188A
Authority
CN
China
Prior art keywords
data
access heat
data objects
migration
heat table
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202110176463.3A
Other languages
Chinese (zh)
Inventor
张廷雷
何营
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shandong Yingxin Computer Technology Co Ltd
Original Assignee
Shandong Yingxin Computer Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shandong Yingxin Computer Technology Co Ltd filed Critical Shandong Yingxin Computer Technology Co Ltd
Priority to CN202110176463.3A priority Critical patent/CN112860188A/en
Publication of CN112860188A publication Critical patent/CN112860188A/en
Priority to PCT/CN2022/074431 priority patent/WO2022171000A1/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601Interfaces specially adapted for storage systems
    • G06F3/0628Interfaces specially adapted for storage systems making use of a particular technique
    • G06F3/0646Horizontal data movement in storage systems, i.e. moving data in between storage devices or systems
    • G06F3/0647Migration mechanisms
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601Interfaces specially adapted for storage systems
    • G06F3/0602Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
    • G06F3/0604Improving or facilitating administration, e.g. storage management
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601Interfaces specially adapted for storage systems
    • G06F3/0668Interfaces specially adapted for storage systems adopting a particular infrastructure
    • G06F3/067Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]

Abstract

The invention discloses a data migration method, which comprises the following steps: creating an access hotlist in the source volume; recording the ID corresponding to the data object with the access frequency larger than the threshold value in the source volume into the access heat table; acquiring the ID of the data object in the access heat table in response to receiving the instruction of data migration; and migrating the corresponding data object to the target volume according to the ID of the data object in the access heat table. The invention also discloses a system, a computer device and a readable storage medium. According to the scheme provided by the invention, the frequently accessed data is preferentially selected for migration, so that the hierarchical migration of the data can be realized, the data migration time is shortened, the influence of the data migration on the reading and writing of other data volumes in the distributed storage is reduced, and the efficient normal operation of data access services of a data center is ensured.

Description

Data migration method, system, device and medium
Technical Field
The present invention relates to the field of data migration, and in particular, to a data migration method, system, device, and storage medium.
Background
The normal reading and writing of the data volume can be influenced in the migration process of the data volume, so that the reading and writing IOPS and the bandwidth of the data volume are reduced. If the data volume has a large amount of data, the data migration time is also prolonged, and the reading and writing of the data volume are seriously affected. At present, the existing research mainly focuses on the implementation of the migration algorithm of the data volume, and does not consider the influence on the reading and writing of other data volumes in the data migration process.
Disclosure of Invention
In view of the above, in order to overcome at least one aspect of the above problems, an embodiment of the present invention provides a data migration method, including the following steps:
creating an access hotlist in the source volume;
recording the ID corresponding to the data object with the access frequency larger than the threshold value in the source volume into the access heat table;
acquiring the ID of the data object in the access heat table in response to receiving the instruction of data migration;
and migrating the corresponding data object to the target volume according to the ID of the data object in the access heat table.
In some embodiments, migrating the corresponding data object to the target volume according to the ID of the data object in the access heat table further includes:
judging whether the number of the IDs of the data objects in the access heat meter is larger than a preset value or not;
responding to the fact that the number of the data objects is larger than the preset value, and migrating according to the ID of the data objects in the access heat table;
and in response to the fact that the number of the IDs of the data objects in the access heat table is not larger than the preset value, waiting for a preset time period, and if the number of the IDs of the data objects in the access heat table is larger than the preset value in the period or the preset time period is over, migrating according to the IDs of the data objects in the access heat table.
In some embodiments, further comprising:
deleting the data objects which are migrated to the target volume in the source volume and the corresponding ID in the access heat table;
and after responding to the data object migration, the number of the IDs of the data objects in the access heat table is larger than the preset value again, and the corresponding data objects are migrated to the target volume again according to the current IDs of the data objects in the access heat table.
In some embodiments, further comprising:
and migrating the residual data objects in the source volume to the target volume in response to the fact that the resource utilization rate of the current system is smaller than the preset utilization rate.
Based on the same inventive concept, according to another aspect of the present invention, an embodiment of the present invention further provides a data migration system, including:
a creation module configured to create an access heat table in a source volume;
a recording module configured to record an ID corresponding to a data object in the source volume, which is accessed more frequently than a threshold, into the access heat table;
an obtaining module configured to obtain, in response to receiving a data migration instruction, an ID of a data object in the access hotlist;
and the migration module is configured to migrate the corresponding data object to the target volume according to the ID of the data object in the access heat table.
In some embodiments, the migration module is further configured to:
judging whether the number of the IDs of the data objects in the access heat meter is larger than a preset value or not;
responding to the fact that the number of the data objects is larger than the preset value, and migrating according to the ID of the data objects in the access heat table;
and in response to the fact that the number of the IDs of the data objects in the access heat table is not larger than the preset value, waiting for a preset time period, and if the number of the IDs of the data objects in the access heat table is larger than the preset value in the period or the preset time period is over, migrating according to the IDs of the data objects in the access heat table.
In some embodiments, the migration module is further configured to:
deleting the data objects which are migrated to the target volume in the source volume and the corresponding ID in the access heat table;
and after responding to the data object migration, the number of the IDs of the data objects in the access heat table is larger than the preset value again, and the corresponding data objects are migrated to the target volume again according to the current IDs of the data objects in the access heat table.
In some embodiments, further comprising a second migration module configured to:
and migrating the residual data objects in the source volume to the target volume in response to the fact that the resource utilization rate of the current system is smaller than the preset utilization rate.
Based on the same inventive concept, according to another aspect of the present invention, an embodiment of the present invention further provides a computer apparatus, including:
at least one processor; and
a memory storing a computer program operable on the processor, wherein the processor executes the program to perform any of the steps of the data migration method described above.
Based on the same inventive concept, according to another aspect of the present invention, an embodiment of the present invention further provides a computer-readable storage medium storing a computer program which, when executed by a processor, performs the steps of any of the data migration methods described above.
The invention has one of the following beneficial technical effects: according to the scheme provided by the invention, the frequently accessed data is preferentially selected for migration, so that the hierarchical migration of the data can be realized, the data migration time is shortened, the influence of the data migration on the reading and writing of other data volumes in the distributed storage is reduced, and the efficient normal operation of data access services of a data center is ensured.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art that other embodiments can be obtained by using the drawings without creative efforts.
FIG. 1 is a flow chart illustrating a data migration method according to an embodiment of the present invention;
FIG. 2 is a schematic structural diagram of a data migration system according to an embodiment of the present invention;
FIG. 3 is a schematic structural diagram of a computer device provided in an embodiment of the present invention;
fig. 4 is a schematic structural diagram of a computer-readable storage medium according to an embodiment of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention more apparent, the following embodiments of the present invention are described in further detail with reference to the accompanying drawings.
It should be noted that all expressions using "first" and "second" in the embodiments of the present invention are used for distinguishing two entities with the same name but different names or different parameters, and it should be noted that "first" and "second" are merely for convenience of description and should not be construed as limitations of the embodiments of the present invention, and they are not described in any more detail in the following embodiments.
According to an aspect of the present invention, an embodiment of the present invention proposes a data migration method, as shown in fig. 1, which may include the steps of:
s1, creating an access heat table in the source volume;
s2, recording the ID corresponding to the data object with the access frequency larger than the threshold value in the source volume into the access heat table;
s3, in response to the received data migration instruction, acquiring the ID of the data object in the access heat table;
and S4, migrating the corresponding data object to the target volume according to the ID of the data object in the access heat table.
According to the scheme provided by the invention, the frequently accessed data is preferentially selected for migration, so that the hierarchical migration of the data can be realized, the data migration time is shortened, the influence of the data migration on the reading and writing of other data volumes in the distributed storage is reduced, and the efficient normal operation of data access services of a data center is ensured.
In some embodiments, in step S1, an access heat table is created in the source volume, and in particular, the access heat table may be created at the time of volume initialization creation, for example, a new data structure, a data object access heat table, may be added to the metadata of the data volume, and then recorded according to the frequency of access of the data objects.
In some embodiments, the access hot access table may be added and deleted by the LRU algorithm to record frequently accessed data objects in the data volume. For example, when a data object in the source volume is accessed, the data object ID is recorded, then the data object access heat table is traversed, and if the data object ID exists, the substitution to the table tail exists, and if the data object ID does not exist, the substitution is added. If the data object access heat table is not full, directly adding the data object access heat table; if the data object access heat table is full, the data object ID held in the header in the table is added and removed.
In some embodiments, a data migration priority ratio may be set, which represents a ratio of a migration priority data amount to a volume size, that is, a length of the access heat table is equal to a number of data objects in the source volume multiplied by a preset migration priority ratio. Therefore, when the subsequent migration is carried out, the data with the set proportion is preferentially migrated, so that when the system is busy (namely, the utilization rate is greater than the threshold value), the data migration time is shortened, the influence of the data migration on the reading and writing of other data volumes in the distributed storage is reduced, and the efficient and normal operation of data access services of the data center is ensured.
In some embodiments, migrating the corresponding data object to the target volume according to the ID of the data object in the access heat table further includes:
judging whether the number of the IDs of the data objects in the access heat meter is larger than a preset value or not;
responding to the fact that the number of the data objects is larger than the preset value, and migrating according to the ID of the data objects in the access heat table;
and in response to the fact that the number of the IDs of the data objects in the access heat table is not larger than the preset value, waiting for a preset time period, and if the number of the IDs of the data objects in the access heat table is larger than the preset value in the period or the preset time period is over, migrating according to the IDs of the data objects in the access heat table.
Specifically, in order to further reduce the influence on other data volumes in the data migration process, before the migration, it may be determined whether the number of IDs of the data objects in the access hotlist is greater than a preset value, if the number of IDs is greater than the preset value, the migration is performed, if the number of IDs is not greater than the preset value, a timer may be started, and if the time that is not greater than the preset value continuously reaches a time threshold, the data migration is directly performed, so as to avoid that the data migration cannot be performed for a long time.
In some embodiments, further comprising:
deleting the data objects which are migrated to the target volume in the source volume and the corresponding ID in the access heat table;
and after responding to the data object migration, the number of the IDs of the data objects in the access heat table is larger than the preset value again, and the corresponding data objects are migrated to the target volume again according to the current IDs of the data objects in the access heat table.
Specifically, migration parameters, such as the number of times of migration or a time period, may be preset, and as long as the current number of times of migration is less than the set number of times of migration, or the migration duration is less than the set time period, after data object migration is performed once, when the number of data object IDs in the access heat table is again greater than a preset value, the data object corresponding to the ID of the current data object in the access heat table is migrated to the target volume again. Therefore, the frequently accessed data objects in the source volume can be guaranteed to be timely migrated to the target volume.
In some embodiments, after receiving the MIGRATION instruction, the STATEs of the source volume and the target volume may be updated to migratio _ STATE _ execution, and when the preset number of times of MIGRATION is reached or a set time period is reached, the data of the source volume is migrated to the target volume by using the CopyUP mechanism. In the migration process, when the data object of the target volume is read, if the data object of the target volume does not exist, the data object of the source volume is read, otherwise, the data object of the target volume is read; when writing the data object of the target volume, if the data object of the target volume does not exist, reading the data object of the source volume and storing the data object of the source volume to the target volume, then writing the data object of the target volume, otherwise, directly writing the data object of the target volume.
In some embodiments, further comprising:
and migrating the residual data objects in the source volume to the target volume in response to the fact that the resource utilization rate of the current system is smaller than the preset utilization rate.
Specifically, when the system is in a non-busy period, the migration instruction may be issued again to migrate the remaining data objects in the source volume to the target volume.
According to the scheme provided by the invention, the frequently accessed data is preferentially selected for migration, so that the hierarchical migration of the data can be realized, the data migration time is shortened, the influence of the data migration on the reading and writing of other data volumes in the distributed storage is reduced, and the efficient normal operation of data access services of a data center is ensured. And finally, when the system is in an idle state, performing subsequent migration on the infrequently accessed data.
Based on the same inventive concept, according to another aspect of the present invention, an embodiment of the present invention further provides a data migration system 400, as shown in fig. 2, including:
a creation module 401, the creation module 401 configured to create an access heat table in a source volume;
a recording module 402, wherein the recording module 402 is configured to record the ID corresponding to the data object in the source volume whose access frequency is greater than the threshold value into the access heat table;
an obtaining module 403, where the obtaining module 403 is configured to obtain, in response to receiving the instruction of data migration, an ID of the data object in the access heat table;
a migration module 404, wherein the migration module 404 is configured to migrate the corresponding data object to the target volume according to the ID of the data object in the access heat table.
In some embodiments, the migration module 404 is further configured to:
judging whether the number of the IDs of the data objects in the access heat meter is larger than a preset value or not;
responding to the fact that the number of the data objects is larger than the preset value, and migrating according to the ID of the data objects in the access heat table;
and in response to the fact that the number of the IDs of the data objects in the access heat table is not larger than the preset value, waiting for a preset time period, and if the number of the IDs of the data objects in the access heat table is larger than the preset value in the period or the preset time period is over, migrating according to the IDs of the data objects in the access heat table.
In some embodiments, the migration module is further configured to:
deleting the data objects which are migrated to the target volume in the source volume and the corresponding ID in the access heat table;
and after responding to the data object migration, the number of the IDs of the data objects in the access heat table is larger than the preset value again, and the corresponding data objects are migrated to the target volume again according to the current IDs of the data objects in the access heat table.
In some embodiments, further comprising a second migration module configured to:
and migrating the residual data objects in the source volume to the target volume in response to the fact that the resource utilization rate of the current system is smaller than the preset utilization rate.
Based on the same inventive concept, according to another aspect of the present invention, as shown in fig. 3, an embodiment of the present invention further provides a computer apparatus 501, comprising:
at least one processor 520; and
the memory 510, the memory 510 storing a computer program 511 executable on the processor, the processor 520 executing the program to perform the steps of any of the data migration methods as described above.
Based on the same inventive concept, according to another aspect of the present invention, as shown in fig. 4, an embodiment of the present invention further provides a computer-readable storage medium 601, where the computer-readable storage medium 601 stores computer program instructions 610, and the computer program instructions 610, when executed by a processor, perform the steps of any of the data migration methods as above.
Finally, it should be noted that, as will be understood by those skilled in the art, all or part of the processes of the methods of the above embodiments may be implemented by a computer program, which may be stored in a computer-readable storage medium, and when executed, may include the processes of the embodiments of the methods described above.
Further, it should be appreciated that the computer-readable storage media (e.g., memory) herein can be either volatile memory or nonvolatile memory, or can include both volatile and nonvolatile memory.
Those of skill would further appreciate that the various illustrative logical blocks, modules, circuits, and algorithm steps described in connection with the disclosure herein may be implemented as electronic hardware, computer software, or combinations of both. To clearly illustrate this interchangeability of hardware and software, various illustrative components, blocks, modules, circuits, and steps have been described above generally in terms of their functionality. Whether such functionality is implemented as software or hardware depends upon the particular application and design constraints imposed on the overall system. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the disclosed embodiments of the present invention.
The foregoing is an exemplary embodiment of the present disclosure, but it should be noted that various changes and modifications could be made herein without departing from the scope of the present disclosure as defined by the appended claims. The functions, steps and/or actions of the method claims in accordance with the disclosed embodiments described herein need not be performed in any particular order. Furthermore, although elements of the disclosed embodiments of the invention may be described or claimed in the singular, the plural is contemplated unless limitation to the singular is explicitly stated.
It should be understood that, as used herein, the singular forms "a", "an" and "the" are intended to include the plural forms as well, unless the context clearly supports the exception. It should also be understood that "and/or" as used herein is meant to include any and all possible combinations of one or more of the associated listed items.
The numbers of the embodiments disclosed in the embodiments of the present invention are merely for description, and do not represent the merits of the embodiments.
It will be understood by those skilled in the art that all or part of the steps of implementing the above embodiments may be implemented by hardware, or may be implemented by a program instructing relevant hardware, and the program may be stored in a computer-readable storage medium, and the above-mentioned storage medium may be a read-only memory, a magnetic disk or an optical disk, etc.
Those of ordinary skill in the art will understand that: the discussion of any embodiment above is meant to be exemplary only, and is not intended to intimate that the scope of the disclosure, including the claims, of embodiments of the invention is limited to these examples; within the idea of an embodiment of the invention, also technical features in the above embodiment or in different embodiments may be combined and there are many other variations of the different aspects of the embodiments of the invention as described above, which are not provided in detail for the sake of brevity. Therefore, any omissions, modifications, substitutions, improvements, and the like that may be made without departing from the spirit and principles of the embodiments of the present invention are intended to be included within the scope of the embodiments of the present invention.

Claims (10)

1. A method of data migration, comprising the steps of:
creating an access hotlist in the source volume;
recording the ID corresponding to the data object with the access frequency larger than the threshold value in the source volume into the access heat table;
acquiring the ID of the data object in the access heat table in response to receiving the instruction of data migration;
and migrating the corresponding data object to the target volume according to the ID of the data object in the access heat table.
2. The method of claim 1, wherein migrating the corresponding data object to the target volume according to the ID of the data object in the access hotlist, further comprises:
judging whether the number of the IDs of the data objects in the access heat meter is larger than a preset value or not;
responding to the fact that the number of the data objects is larger than the preset value, and migrating according to the ID of the data objects in the access heat table;
and in response to the fact that the number of the IDs of the data objects in the access heat table is not larger than the preset value, waiting for a preset time period, and if the number of the IDs of the data objects in the access heat table is larger than the preset value in the period or the preset time period is over, migrating according to the IDs of the data objects in the access heat table.
3. The method of claim 2, further comprising:
deleting the data objects which are migrated to the target volume in the source volume and the corresponding ID in the access heat table;
and after responding to the data object migration, the number of the IDs of the data objects in the access heat table is larger than the preset value again, and the corresponding data objects are migrated to the target volume again according to the current IDs of the data objects in the access heat table.
4. The method of claim 3, further comprising:
and migrating the residual data objects in the source volume to the target volume in response to the fact that the resource utilization rate of the current system is smaller than the preset utilization rate.
5. A data migration system, comprising:
a creation module configured to create an access heat table in a source volume;
a recording module configured to record an ID corresponding to a data object in the source volume, which is accessed more frequently than a threshold, into the access heat table;
an obtaining module configured to obtain, in response to receiving a data migration instruction, an ID of a data object in the access hotlist;
and the migration module is configured to migrate the corresponding data object to the target volume according to the ID of the data object in the access heat table.
6. The system of claim 5, wherein the migration module is further configured to:
judging whether the number of the IDs of the data objects in the access heat meter is larger than a preset value or not;
responding to the fact that the number of the data objects is larger than the preset value, and migrating according to the ID of the data objects in the access heat table;
and in response to the fact that the number of the IDs of the data objects in the access heat table is not larger than the preset value, waiting for a preset time period, and if the number of the IDs of the data objects in the access heat table is larger than the preset value in the period or the preset time period is over, migrating according to the IDs of the data objects in the access heat table.
7. The system of claim 6, wherein the migration module is further configured to:
deleting the data objects which are migrated to the target volume in the source volume and the corresponding ID in the access heat table;
and after responding to the data object migration, the number of the IDs of the data objects in the access heat table is larger than the preset value again, and the corresponding data objects are migrated to the target volume again according to the current IDs of the data objects in the access heat table.
8. The system of claim 7, further comprising a second migration module configured to:
and migrating the residual data objects in the source volume to the target volume in response to the fact that the resource utilization rate of the current system is smaller than the preset utilization rate.
9. A computer device, comprising:
at least one processor; and
memory storing a computer program operable on the processor, characterized in that the processor executes the program to perform the steps of the method according to any of claims 1-4.
10. A computer-readable storage medium, in which a computer program is stored which, when being executed by a processor, is adapted to carry out the steps of the method according to any one of claims 1-4.
CN202110176463.3A 2021-02-09 2021-02-09 Data migration method, system, device and medium Pending CN112860188A (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN202110176463.3A CN112860188A (en) 2021-02-09 2021-02-09 Data migration method, system, device and medium
PCT/CN2022/074431 WO2022171000A1 (en) 2021-02-09 2022-01-27 Data transfer method and system, and device and medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202110176463.3A CN112860188A (en) 2021-02-09 2021-02-09 Data migration method, system, device and medium

Publications (1)

Publication Number Publication Date
CN112860188A true CN112860188A (en) 2021-05-28

Family

ID=75989449

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202110176463.3A Pending CN112860188A (en) 2021-02-09 2021-02-09 Data migration method, system, device and medium

Country Status (2)

Country Link
CN (1) CN112860188A (en)
WO (1) WO2022171000A1 (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2022171000A1 (en) * 2021-02-09 2022-08-18 山东英信计算机技术有限公司 Data transfer method and system, and device and medium
CN117591039A (en) * 2024-01-18 2024-02-23 济南浪潮数据技术有限公司 Distributed storage method, system, equipment and medium

Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101079902A (en) * 2007-06-29 2007-11-28 清华大学 A great magnitude of data hierarchical storage method
CN102510390A (en) * 2011-09-28 2012-06-20 北京飞杰信息技术有限公司 Method and device for instructing data migration by hard disk temperature self-detection
CN103078933A (en) * 2012-12-29 2013-05-01 深圳先进技术研究院 Method and device for determining data migration time
CN103106047A (en) * 2013-01-29 2013-05-15 浪潮(北京)电子信息产业有限公司 Storage system based on object and storage method thereof
CN105653591A (en) * 2015-12-22 2016-06-08 浙江中控研究院有限公司 Hierarchical storage and migration method of industrial real-time data
CN109471836A (en) * 2018-11-01 2019-03-15 浪潮电子信息产业股份有限公司 A kind of data migration method, device and system
CN110175163A (en) * 2019-05-24 2019-08-27 江西尚通科技发展股份有限公司 More library separation methods, system and medium based on business function intelligently parsing
CN110399100A (en) * 2019-07-05 2019-11-01 苏州浪潮智能科技有限公司 A kind of method, apparatus of migration process, computer storage medium and terminal
CN111124304A (en) * 2019-12-19 2020-05-08 北京浪潮数据技术有限公司 Data migration method and device, electronic equipment and storage medium
CN112015347A (en) * 2020-08-28 2020-12-01 北京浪潮数据技术有限公司 Data migration method and device and related equipment

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2010257094A (en) * 2009-04-23 2010-11-11 Hitachi Ltd Method for clipping migration candidate file in hierarchical storage management system
JP6028415B2 (en) * 2012-06-28 2016-11-16 日本電気株式会社 Data migration control device, method and system for virtual server environment
CN102882928A (en) * 2012-08-31 2013-01-16 浪潮电子信息产业股份有限公司 Hierarchical storage management method of cloud storing system
CN104462240A (en) * 2014-11-18 2015-03-25 浪潮(北京)电子信息产业有限公司 Method and system for realizing hierarchical storage and management in cloud storage
CN105892952A (en) * 2016-04-22 2016-08-24 深圳市深信服电子科技有限公司 Hyper-converged system and longitudinal extension method thereof
US10042578B2 (en) * 2016-11-08 2018-08-07 International Business Machines Corporation Extent migration in multi-tier storage systems
CN112860188A (en) * 2021-02-09 2021-05-28 山东英信计算机技术有限公司 Data migration method, system, device and medium

Patent Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101079902A (en) * 2007-06-29 2007-11-28 清华大学 A great magnitude of data hierarchical storage method
CN102510390A (en) * 2011-09-28 2012-06-20 北京飞杰信息技术有限公司 Method and device for instructing data migration by hard disk temperature self-detection
CN103078933A (en) * 2012-12-29 2013-05-01 深圳先进技术研究院 Method and device for determining data migration time
CN103106047A (en) * 2013-01-29 2013-05-15 浪潮(北京)电子信息产业有限公司 Storage system based on object and storage method thereof
CN105653591A (en) * 2015-12-22 2016-06-08 浙江中控研究院有限公司 Hierarchical storage and migration method of industrial real-time data
CN109471836A (en) * 2018-11-01 2019-03-15 浪潮电子信息产业股份有限公司 A kind of data migration method, device and system
CN110175163A (en) * 2019-05-24 2019-08-27 江西尚通科技发展股份有限公司 More library separation methods, system and medium based on business function intelligently parsing
CN110399100A (en) * 2019-07-05 2019-11-01 苏州浪潮智能科技有限公司 A kind of method, apparatus of migration process, computer storage medium and terminal
CN111124304A (en) * 2019-12-19 2020-05-08 北京浪潮数据技术有限公司 Data migration method and device, electronic equipment and storage medium
CN112015347A (en) * 2020-08-28 2020-12-01 北京浪潮数据技术有限公司 Data migration method and device and related equipment

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2022171000A1 (en) * 2021-02-09 2022-08-18 山东英信计算机技术有限公司 Data transfer method and system, and device and medium
CN117591039A (en) * 2024-01-18 2024-02-23 济南浪潮数据技术有限公司 Distributed storage method, system, equipment and medium

Also Published As

Publication number Publication date
WO2022171000A1 (en) 2022-08-18

Similar Documents

Publication Publication Date Title
RU2671049C2 (en) Flushing in file system
CN108647151A (en) It is a kind of to dodge system metadata rule method, apparatus, equipment and storage medium entirely
TW201520889A (en) Hybrid storage
CN107704203B (en) Deletion method, device and equipment for aggregated large file and computer storage medium
CN111881135A (en) Data aggregation method, device, equipment and computer readable storage medium
CN107807797B (en) Data writing method and device and server
CN112860188A (en) Data migration method, system, device and medium
CN111208934B (en) Data storage method and device
CN113282249B (en) Data processing method, system, device and medium
CN109558456A (en) A kind of file migration method, apparatus, equipment and readable storage medium storing program for executing
US20220164316A1 (en) Deduplication method and apparatus
CN106844491B (en) Temporary data writing and reading method and device
CN111625203A (en) Method, system, device and medium for hierarchical storage
CN115114232A (en) Method, device and medium for enumerating historical version objects
CN113608695A (en) Data processing method, system, device and medium
CN105808451B (en) Data caching method and related device
CN110955639A (en) Data processing method and device
US9395930B2 (en) Information processing system, control method of information processing system, and recording medium
KR20150103886A (en) Data processing apparatus for pipeline execution acceleration and method thereof
CN112000971B (en) File permission recording method, system and related device
CN109254958A (en) Distributed data reading/writing method, equipment and system
CN112486831A (en) Test system, test method, electronic equipment and storage medium
CN112463073A (en) Object storage distributed quota method, system, equipment and storage medium
CN114579061B (en) Data storage method, device, equipment and medium
CN112286448B (en) Object access method and device, electronic equipment and machine-readable storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination