CN111090399A - Online migration method, device, equipment and medium for disk data - Google Patents
Online migration method, device, equipment and medium for disk data Download PDFInfo
- Publication number
- CN111090399A CN111090399A CN201911284461.5A CN201911284461A CN111090399A CN 111090399 A CN111090399 A CN 111090399A CN 201911284461 A CN201911284461 A CN 201911284461A CN 111090399 A CN111090399 A CN 111090399A
- Authority
- CN
- China
- Prior art keywords
- snapshot
- migration
- data
- disk
- temporary
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Withdrawn
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
- G06F3/0608—Saving storage space on storage systems
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
- G06F3/0638—Organizing or formatting or addressing of data
- G06F3/064—Management of blocks
- G06F3/0641—De-duplication techniques
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
- G06F3/0646—Horizontal data movement in storage systems, i.e. moving data in between storage devices or systems
- G06F3/0647—Migration mechanisms
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
- G06F3/0662—Virtualisation aspects
- G06F3/0667—Virtualisation aspects at data level, e.g. file, record or object virtualisation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0668—Interfaces specially adapted for storage systems adopting a particular infrastructure
- G06F3/0671—In-line storage system
- G06F3/0673—Single storage device
- G06F3/0674—Disk device
- G06F3/0676—Magnetic disk device
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention discloses an online migration method of disk data, which comprises the following steps: when migration information is received, a temporary snapshot is created for the current disk file; creating a dirty data table for recording all data generated in the running of the virtual machine from the moment of creating the temporary snapshot; and migrating the difference data and the dirty data table which are different from the history snapshot in the history snapshot and the temporary snapshot to the destination storage pool. Therefore, only historical snapshots are migrated, data and all dirty data are distinguished, and migration of a large amount of repeated data is avoided while all currently stored data in the virtual machine is completely completed, so that the flow occupied during migration is greatly reduced; and the storage space occupied in the target storage pool after the migration is reduced, and the resource waste is avoided. In addition, the online migration device, the online migration equipment and the online migration medium of the disk data correspond to the method.
Description
Technical Field
The present invention relates to the field of computer technologies, and in particular, to a method, an apparatus, a device, and a medium for online migration of disk data.
Background
With the rapid development of computer technology and internet technology, virtualization platforms are widely applied, and great resource integration advantages are shown. Hardware such as a CPU, a memory, a disk and the like is changed into a resource pool which can be dynamically managed, so that the utilization rate of resources is improved, and system management is simplified. The snapshot technique of the virtual machine disk is a copy of the virtual machine disk file at a certain time. The method is used for restoring the disk file system to the previous environment by using the recovery snapshot when the system crashes or is abnormal, and plays an important role in carrying out snapshot on the disk file.
In practical applications, virtual platform online snapshot file migration is a very common operation at present. In the prior art, when an online migration operation is performed on a disk file with a snapshot, the snapshot file needs to be migrated to a destination storage pool first, and meanwhile, in order to ensure the integrity of migration data, a current disk file containing newly-added data needs to be migrated to the destination storage pool, so that migration of all disk files on a virtual platform is completed.
However, since the snapshot file is a copy of the previous disk file, there is a large amount of data that is duplicated with the current disk file; the occupied flow during the migration is large, and a large amount of storage space is also occupied in the target storage pool after the migration, so that resource waste is generated.
Disclosure of Invention
The invention aims to provide a method, a device, equipment and a medium for online migration of disk data, wherein only the data which is different from the historical snapshot in the historical snapshot and the temporary snapshot and a dirty data table are moved to a target storage pool, so that the migration of a large amount of repeated data is avoided while the currently stored all data in a virtual machine is completely completed, and the flow occupied during the migration is greatly reduced; and the storage space occupied in the target storage pool after the migration is reduced, and the resource waste is avoided.
In order to solve the above technical problem, the present invention provides an online migration method of disk data, including:
when migration information is received, a temporary snapshot is created for the current disk file;
creating a dirty data table for recording all data generated in the running of the virtual machine from the moment of creating the temporary snapshot;
and migrating the historical snapshot, the difference data in the temporary snapshot, which is different from the historical snapshot, and the dirty data table to a destination storage pool.
Preferably, the method further comprises the following steps:
and sending deletion information to delete the temporary snapshot.
Preferably, the method further comprises the following steps:
and generating a log for recording the historical snapshot, the distinguishing data and the migration progress of the dirty data table.
Preferably, the method further comprises the following steps:
judging whether the historical snapshot, the temporary snapshot and the migration operation of the dirty data table are completed within preset time or not according to the migration progress recorded in the log;
if not, determining that the migration is abnormal, and performing alarm prompt in the log.
Preferably, the method further comprises the following steps:
and informing the operation and maintenance personnel to process abnormal conditions according to the pre-stored contact information of the operation and maintenance personnel.
Preferably, before migrating the difference data in the history snapshot and the temporary snapshot, which is different from the history snapshot, and the dirty data table to the destination storage pool, the method further includes:
judging whether notification information for deleting the historical snapshot is received or not;
and if so, deleting the corresponding history snapshot according to the notification information.
Preferably, the creating a temporary snapshot of the current disk file specifically includes:
and creating a temporary snapshot for the current disk file in a reflink mode.
In order to solve the above technical problem, the present invention further provides an online migration apparatus for disk data, including:
the first creating module is used for creating a temporary snapshot for the current disk file when the migration information is received;
the second creating module is used for creating a dirty data table used for recording all data generated in the virtual machine operation from the moment of creating the temporary snapshot;
and the migration module is used for migrating the difference data which are different from the history snapshot in the history snapshot and the temporary snapshot and the dirty data table to a target storage pool.
In order to solve the above technical problem, the present invention further provides an online migration device for disk data, including a memory for storing a computer program;
a processor for implementing the steps of the online migration method of disk data according to any one of the above items when executing the computer program.
In order to solve the above technical problem, the present invention further provides a computer-readable storage medium, having a computer program stored thereon, where the computer program is executed by a processor to implement the steps of the online migration method of disk data according to any one of the above embodiments.
The invention provides an online migration method of disk data, which comprises the following steps: when migration information is received, a temporary snapshot is created for the current disk file; creating a dirty data table for recording all data generated in the running of the virtual machine from the moment of creating the temporary snapshot; the dirty data table ensures that the newly generated data can be synchronously migrated and not lost during the migration process. And migrating the difference data and the dirty data table which are different from the history snapshot in the history snapshot and the temporary snapshot to the target storage pool. Therefore, only historical snapshots are migrated, data and all dirty data are distinguished, and migration of a large amount of repeated data is avoided while all currently stored data in the virtual machine is completely completed, so that the flow occupied during migration is greatly reduced; and the storage space occupied in the target storage pool after the migration is reduced, and the resource waste is avoided.
In addition, the online migration device, the equipment and the medium of the disk data correspond to the method, and have the same beneficial effects.
Drawings
In order to illustrate the embodiments of the present invention more clearly, the drawings that are needed in the embodiments will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and that other drawings can be obtained by those skilled in the art without inventive effort.
Fig. 1 is a flowchart of an online migration method of disk data according to an embodiment of the present invention;
FIG. 2 is a flowchart of another online migration method for disk data according to an embodiment of the present invention;
FIG. 3 is a block diagram of an online migration apparatus for disk data according to an embodiment of the present invention;
fig. 4 is a structural diagram of an online migration apparatus for disk data according to an embodiment of the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments obtained by a person of ordinary skill in the art based on the embodiments of the present invention without any creative work belong to the protection scope of the present invention.
The core of the invention is to provide a method, a device, equipment and a medium for online migration of disk data, wherein only the data which is different from the historical snapshot in the historical snapshot and the temporary snapshot and the dirty data table are migrated into a target storage pool, so that the migration of a large amount of repeated data is avoided while the currently stored all data in a virtual machine is completely completed, and the flow occupied during the migration is greatly reduced; and the storage space occupied in the target storage pool after the migration is reduced, and the resource waste is avoided.
In order that those skilled in the art will better understand the disclosure, the invention will be described in further detail with reference to the accompanying drawings and specific embodiments.
Fig. 1 is a flowchart of an online migration method of disk data according to an embodiment of the present invention; as shown in fig. 1, an online migration method for disk data provided in an embodiment of the present invention includes steps S101 to S103:
step S101: when migration information is received, a temporary snapshot is created for the current disk file;
step S102: creating a dirty data table for recording all data generated in the running of the virtual machine from the moment of creating the temporary snapshot;
step S103: and migrating the difference data and the dirty data table which are different from the history snapshot in the history snapshot and the temporary snapshot to the destination storage pool.
In one embodiment, when migration information is received, which indicates that all data in the source storage pool where the virtual machine is located needs to be migrated to the destination storage pool, a temporary snapshot may be created for the current disk file. In a specific implementation, creating a temporary snapshot of the current disk file may be accomplished by reflink. For a person skilled in the art to refer to the prior art, detailed technology of the reflink mode is omitted for the embodiment of the present invention. Further, while the temporary snapshot is created, a dirty data table is created to record all dirty data generated in the virtual machine running after the temporary snapshot is created.
In a specific implementation, the differential data and the dirty data table in the history snapshot and the temporary snapshot, which are different from the history snapshot, are migrated to the destination storage pool, so that the history snapshot and the differential data are migrated to the destination storage pool first, and then the dirty data table is migrated to the destination storage pool. It is to be understood that the history snapshot is a snapshot created for the disk before the migration information is received, and the history snapshot may be one or multiple snapshots. Those skilled in the art can determine the number of history snapshots to be migrated according to the actual application. In one embodiment, the migration of the history snapshot, the difference data and the dirty data table is completed by means of a drive-mirror. Further, when the difference data different from the historical snapshots in the temporary snapshot is migrated, firstly, the historical snapshots migrated to the destination storage pool are copied by a reflink method to generate difference snapshots; and comparing the historical snapshot with the temporary snapshot in the source storage pool to obtain the difference data between the historical snapshot and the temporary snapshot, and migrating the difference data to write the difference data into the difference snapshot in the target storage pool, so that a complete temporary snapshot is formed in the target storage pool. When the dirty data table is migrated, the temporary snapshot can be copied in the target storage pool through a reflink method to generate a dirty data snapshot, and the dirty data table is migrated to the dirty data snapshot, so that the disk file data in the target storage pool is ensured to be the same as the disk file data in the source storage pool.
In one embodiment, before migrating the differentiated data in the history snapshot and the temporary snapshot, which is different from the history snapshot, and the dirty data table into the destination storage pool, the method further includes:
judging whether notification information for deleting the historical snapshot is received or not;
and if so, deleting the corresponding history snapshot according to the notification information.
Specifically, since a plurality of history snapshots may be stored in the source storage pool, in order to avoid performing a migration operation on history snapshots that do not need to be migrated, confirmation information may be sent in advance to confirm whether all history snapshots are to be migrated, and when notification information for deleting history snapshots is received, corresponding history snapshots may be deleted according to the notification information. Therefore, only the residual historical snapshots need to be migrated, the flow occupied by migration is reduced, and the storage capacity of the target storage pool is also reduced.
Specifically, after the migration operation of the differentiated data in the history snapshot and the temporary snapshot, which is different from the history snapshot, is completed, the history snapshot includes the same data as the temporary snapshot in the target storage pool, the temporary snapshot is formed by the differentiated data, and a newly added disk file is created for the temporary snapshot in the target storage pool in a reflink manner. In one embodiment, the dirty data table is migrated to the new disk file in the destination storage pool in a drive-mirror manner, thereby completing the migration operation of all data in the source storage pool.
The invention provides an online migration method of disk data, which comprises the following steps: when migration information is received, a temporary snapshot is created for the current disk file; creating a dirty data table for recording all data generated in the running of the virtual machine from the moment of creating the temporary snapshot; the dirty data table ensures that the newly generated data can be synchronously migrated and not lost during the migration process. And migrating the difference data and the dirty data table which are different from the history snapshot in the history snapshot and the temporary snapshot to the target storage pool. Therefore, only historical snapshots are migrated, data and all dirty data are distinguished, and migration of a large amount of repeated data is avoided while all currently stored data in the virtual machine is completely completed, so that the flow occupied during migration is greatly reduced; and the storage space occupied in the target storage pool after the migration is reduced, and the resource waste is avoided.
FIG. 2 is a flowchart of another online migration method for disk data according to an embodiment of the present invention; as shown in fig. 2, the online migration method for disk data according to the embodiment of the present invention further includes step S104: and sending deletion information to delete the temporary snapshot.
Specifically, when the migration operation is completed, deletion information may be sent to delete the temporary snapshot in the destination storage pool. It can be understood that the temporary snapshot includes metadata and other redundant data generated when the temporary snapshot is created; after the migration operation is completed, the corresponding deletion can be performed, so that the data in the target storage pool is ensured to be complete, meanwhile, the storage of unnecessary data is reduced, and the storage space is saved.
As shown in fig. 2, the online migration method for disk data according to the embodiment of the present invention further includes step S105:
step S105: and generating a log for recording historical snapshots and distinguishing migration progress of data and a dirty data table.
Specifically, in the migration operation process, a migration progress used for recording a historical snapshot and distinguishing data from a dirty data table can be generated; according to the migration progress recorded in the log, the operation and maintenance personnel can know the current online migration condition and can more specifically master the migration process of the disk data.
As shown in fig. 2, the online migration method for disk data according to the embodiment of the present invention further includes step S106:
step S106: judging whether the historical snapshot, the temporary snapshot and the migration operation of the dirty data table are completed within preset time or not according to the migration progress recorded in the log; if not, go to step S107;
step S107: and determining that the migration is abnormal, and performing alarm prompt in the log.
Specifically, whether all migration operations can be completed within a preset time can be judged through the migration progress recorded in the log. The preset time may be the time required for completing the migration operation under a general condition, and a person skilled in the art may set the preset time according to an actual application condition. When the preset time is over, and the migration operation is still not completed, the abnormality of the migration operation can be determined, an alarm prompt is given in the log, operation and maintenance personnel can find the abnormality of the current migration operation in time by checking the log conveniently, the abnormality is analyzed and correspondingly processed, and therefore the online migration operation of the disk data can be ensured to be continued.
As shown in fig. 2, the online migration method for disk data according to the embodiment of the present invention further includes step S108:
step S108: and informing the operation and maintenance personnel to process the abnormal situation according to the pre-stored contact information of the operation and maintenance personnel.
Specifically, the contact information of the operation and maintenance personnel, such as a mailbox or a telephone number, may be stored in advance. When the historical snapshot, the distinguishing data and the dirty data table are determined to be abnormal in the migration operation process, the abnormal condition can be notified to operation and maintenance personnel according to the contact way, so that the operation and maintenance personnel can find the problem in time and perform corresponding treatment. Meanwhile, operation and maintenance personnel do not need to observe the online migration process of the disk data all the time, and the time of the operation and maintenance personnel is saved.
The invention also provides an online migration device of the disk data and an embodiment corresponding to the online migration device of the disk data. It should be noted that the present invention describes the embodiments from two perspectives, one is based on the functional module, and the other is based on the hardware.
FIG. 3 is a block diagram of an online migration apparatus for disk data according to an embodiment of the present invention; as shown in fig. 3, an online migration apparatus for disk data according to an embodiment of the present invention includes:
a first creating module 10, configured to create a temporary snapshot for a current disk file when migration information is received;
a second creating module 11, configured to create a dirty data table for recording all data generated in the virtual machine operation from the time when the temporary snapshot is created;
and the migration module 12 is configured to migrate the difference data and the dirty data table, which are different from the history snapshot, in the history snapshot and the temporary snapshot to the destination storage pool.
The online migration device for disk data provided by the embodiment of the invention further comprises:
and the deleting module is used for sending deleting information to delete the temporary snapshot.
And the generating module is used for generating a log for recording the historical snapshot, the distinguishing data and the migration progress of the dirty data table.
The first judging module is used for judging whether the historical snapshot, the temporary snapshot and the migration operation of the dirty data table are completed within preset time or not according to the migration progress recorded in the log; if not, determining that the migration is abnormal, and performing alarm prompt in the log.
And the notification module is used for notifying the operation and maintenance personnel to process the abnormal situation according to the pre-stored contact information of the operation and maintenance personnel.
A second judging module, configured to judge whether notification information for deleting the history snapshot is received before migrating the difference data, which is different from the history snapshot, in the history snapshot and the temporary snapshot, and the dirty data table to a destination storage pool; and if so, deleting the corresponding history snapshot according to the notification information.
Since the embodiments of this section correspond to the embodiments of the method section, reference is made to the description of the embodiments of the method section for the embodiments of this section, and details are not repeated here.
The invention provides an online migration device of disk data, which comprises: when migration information is received, a temporary snapshot is created for the current disk file; creating a dirty data table for recording all data generated in the running of the virtual machine from the moment of creating the temporary snapshot; the dirty data table ensures that the newly generated data can be synchronously migrated and not lost during the migration process. And migrating the difference data and the dirty data table which are different from the history snapshot in the history snapshot and the temporary snapshot to the target storage pool. Therefore, only historical snapshots are migrated, data and all dirty data are distinguished, and migration of a large amount of repeated data is avoided while all currently stored data in the virtual machine is completely completed, so that the flow occupied during migration is greatly reduced; and the storage space occupied in the target storage pool after the migration is reduced, and the resource waste is avoided.
Fig. 4 is a structural diagram of an online migration apparatus for disk data according to an embodiment of the present invention. As shown in fig. 4, an online migration apparatus for disk data according to an embodiment of the present invention includes a memory 20 for storing a computer program;
a processor 21, configured to implement the steps of the online migration method of disk data as described in any one of the above when executing the computer program.
The processor 21 may include one or more processing cores, such as a 4-core processor, an 8-core processor, and the like. The processor 21 may also include a main processor and a coprocessor, where the main processor is a processor for Processing data in an awake state, and is also called a Central Processing Unit (CPU); a coprocessor is a low power processor for processing data in a standby state. In some embodiments, the processor 21 may be integrated with a GPU (Graphics Processing Unit), which is responsible for rendering and drawing the content required to be displayed by the display screen. In some embodiments, the processor 21 may further include an AI (Artificial Intelligence) processor for processing a calculation operation related to machine learning.
The memory 20 may include one or more computer-readable storage media, which may be non-transitory. Memory 20 may also include high speed random access memory, as well as non-volatile memory, such as one or more magnetic disk storage devices, flash memory storage devices. In this embodiment, the memory 20 is at least used for storing the following computer program 201, wherein after being loaded and executed by the processor 21, the computer program can implement relevant steps in the online migration method of disk data disclosed in any of the foregoing embodiments. In addition, the resources stored in the memory 20 may also include an operating system 202, data 203, and the like, and the storage manner may be a transient storage manner or a permanent storage manner. Operating system 202 may include, among other things, Unix, Linux, and the like.
In some embodiments, the online migration device of disk data may further include an input/output interface 22, a communication interface 23, a power supply 24, and a communication bus 25.
Those skilled in the art will appreciate that the architecture shown in FIG. 4 does not constitute a limitation of an online migration apparatus for disk data, and may include more or fewer components than those shown.
Since the embodiment of the part corresponds to the embodiment of the method part, please refer to the description of the embodiment of the method part for the embodiment of the part, which is not repeated here. In some embodiments of the invention, the processor and memory may be connected by a bus or other means.
The online migration equipment of the disk data provided by the invention can realize the following method: when migration information is received, a temporary snapshot is created for the current disk file; creating a dirty data table for recording all data generated in the running of the virtual machine from the moment of creating the temporary snapshot; the dirty data table ensures that the newly generated data can be synchronously migrated and not lost during the migration process. And migrating the difference data and the dirty data table which are different from the history snapshot in the history snapshot and the temporary snapshot to the target storage pool. Therefore, only historical snapshots are migrated, data and all dirty data are distinguished, and migration of a large amount of repeated data is avoided while all currently stored data in the virtual machine is completely completed, so that the flow occupied during migration is greatly reduced; and the storage space occupied in the target storage pool after the migration is reduced, and the resource waste is avoided.
Finally, the invention also provides a corresponding embodiment of the computer readable storage medium. The computer-readable storage medium has stored thereon a computer program which, when being executed by a processor, carries out the steps as set forth in the above-mentioned method embodiments.
It is to be understood that if the method in the above embodiments is implemented in the form of software functional units and sold or used as a stand-alone product, it can be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present invention may be embodied in the form of a software product, which is stored in a storage medium and performs all or part of the steps of the methods according to the embodiments of the present invention, or all or part of the technical solution. And the aforementioned storage medium includes: various media capable of storing program codes, such as a usb disk, a removable hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk, or an optical disk.
The method, device, equipment and medium for online migration of disk data provided by the invention are described in detail above. The embodiments are described in a progressive manner in the specification, each embodiment focuses on differences from other embodiments, and the same and similar parts among the embodiments are referred to each other. The device disclosed by the embodiment corresponds to the method disclosed by the embodiment, so that the description is simple, and the relevant points can be referred to the method part for description. It should be noted that, for those skilled in the art, it is possible to make various improvements and modifications to the present invention without departing from the principle of the present invention, and those improvements and modifications also fall within the scope of the claims of the present invention.
It is further noted that, in the present specification, relational terms such as first and second, and the like are used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in a process, method, article, or apparatus that comprises the element.
Claims (10)
1. An online migration method of disk data is characterized by comprising the following steps:
when migration information is received, a temporary snapshot is created for the current disk file;
creating a dirty data table for recording all data generated in the running of the virtual machine from the moment of creating the temporary snapshot;
and migrating the historical snapshot, the difference data in the temporary snapshot, which is different from the historical snapshot, and the dirty data table to a destination storage pool.
2. The method for online migrating of disk data according to claim 1, further comprising:
and sending deletion information to delete the temporary snapshot.
3. The online migration method of disk data according to claim 1, further comprising:
and generating a log for recording the historical snapshot, the distinguishing data and the migration progress of the dirty data table.
4. The online migration method of disk data according to claim 3, further comprising:
judging whether the historical snapshot, the temporary snapshot and the migration operation of the dirty data table are completed within preset time or not according to the migration progress recorded in the log;
if not, determining that the migration is abnormal, and performing alarm prompt in the log.
5. The online migration method of disk data according to claim 4, further comprising:
and informing the operation and maintenance personnel to process abnormal conditions according to the pre-stored contact information of the operation and maintenance personnel.
6. The online migration method of disk data according to claim 1, further comprising, before migrating the difference data in the history snapshot and the temporary snapshot, which is different from the history snapshot, and the dirty data table to the destination storage pool:
judging whether notification information for deleting the historical snapshot is received or not;
and if so, deleting the corresponding history snapshot according to the notification information.
7. The online migration method of disk data according to claim 1, wherein the creating a temporary snapshot of the current disk file specifically includes:
and creating a temporary snapshot for the current disk file in a reflink mode.
8. An apparatus for online migration of disk data, comprising:
the first creating module is used for creating a temporary snapshot for the current disk file when the migration information is received;
the second creating module is used for creating a dirty data table used for recording all data generated in the virtual machine operation from the moment of creating the temporary snapshot;
and the migration module is used for migrating the difference data which are different from the history snapshot in the history snapshot and the temporary snapshot and the dirty data table to a target storage pool.
9. An online migration device of disk data is characterized by comprising a memory for storing a computer program;
a processor for implementing the steps of the online migration method of disk data according to any one of claims 1 to 7 when executing the computer program.
10. A computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, carries out the steps of the online migration method of disk data according to any one of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911284461.5A CN111090399A (en) | 2019-12-13 | 2019-12-13 | Online migration method, device, equipment and medium for disk data |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911284461.5A CN111090399A (en) | 2019-12-13 | 2019-12-13 | Online migration method, device, equipment and medium for disk data |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN111090399A true CN111090399A (en) | 2020-05-01 |
Family
ID=70395245
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201911284461.5A Withdrawn CN111090399A (en) | 2019-12-13 | 2019-12-13 | Online migration method, device, equipment and medium for disk data |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111090399A (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112181589A (en) * | 2020-09-25 | 2021-01-05 | 苏州浪潮智能科技有限公司 | Optimization method for realizing post-snapshot migration of KVM (Kernel-based virtual machine) based on reflink |
| WO2022021856A1 (en) * | 2020-07-30 | 2022-02-03 | 苏州浪潮智能科技有限公司 | Method and apparatus for online migration of multi-disk virtual machine into different storage pools |
| CN114675791A (en) * | 2022-05-27 | 2022-06-28 | 苏州浪潮智能科技有限公司 | Disk processing method and system and electronic equipment |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20120209812A1 (en) * | 2011-02-16 | 2012-08-16 | Microsoft Corporation | Incremental virtual machine backup supporting migration |
| CN107122223A (en) * | 2016-02-25 | 2017-09-01 | 深圳市深信服电子科技有限公司 | Data migration method and device |
| CN109165210A (en) * | 2018-09-04 | 2019-01-08 | 山东浪潮云投信息科技有限公司 | A kind of method and device of cluster Hbase Data Migration |
| CN109542686A (en) * | 2018-11-22 | 2019-03-29 | 郑州云海信息技术有限公司 | Storage method and system are simplified in a kind of data backup |
| CN109684271A (en) * | 2018-12-13 | 2019-04-26 | 杭州宏杉科技股份有限公司 | Snapshot data management method, device, electronic equipment and machine readable storage medium |
| CN110019139A (en) * | 2017-12-29 | 2019-07-16 | 中国移动通信集团内蒙古有限公司 | Method, apparatus, electronic equipment and the storage medium of Data Migration |
| CN110196758A (en) * | 2018-05-10 | 2019-09-03 | 腾讯科技（深圳）有限公司 | Data processing method and device, storage medium and electronic device |
| US20190340003A1 (en) * | 2018-05-01 | 2019-11-07 | Vmware, Inc. | Live migration of virtual machines across heterogeneous virtual machine management domains |
-
2019
- 2019-12-13 CN CN201911284461.5A patent/CN111090399A/en not_active Withdrawn
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20120209812A1 (en) * | 2011-02-16 | 2012-08-16 | Microsoft Corporation | Incremental virtual machine backup supporting migration |
| CN107122223A (en) * | 2016-02-25 | 2017-09-01 | 深圳市深信服电子科技有限公司 | Data migration method and device |
| CN110019139A (en) * | 2017-12-29 | 2019-07-16 | 中国移动通信集团内蒙古有限公司 | Method, apparatus, electronic equipment and the storage medium of Data Migration |
| US20190340003A1 (en) * | 2018-05-01 | 2019-11-07 | Vmware, Inc. | Live migration of virtual machines across heterogeneous virtual machine management domains |
| CN110196758A (en) * | 2018-05-10 | 2019-09-03 | 腾讯科技（深圳）有限公司 | Data processing method and device, storage medium and electronic device |
| CN109165210A (en) * | 2018-09-04 | 2019-01-08 | 山东浪潮云投信息科技有限公司 | A kind of method and device of cluster Hbase Data Migration |
| CN109542686A (en) * | 2018-11-22 | 2019-03-29 | 郑州云海信息技术有限公司 | Storage method and system are simplified in a kind of data backup |
| CN109684271A (en) * | 2018-12-13 | 2019-04-26 | 杭州宏杉科技股份有限公司 | Snapshot data management method, device, electronic equipment and machine readable storage medium |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2022021856A1 (en) * | 2020-07-30 | 2022-02-03 | 苏州浪潮智能科技有限公司 | Method and apparatus for online migration of multi-disk virtual machine into different storage pools |
| US11740925B2 (en) | 2020-07-30 | 2023-08-29 | Inspur Suzhou Intelligent Technology Co., Ltd. | Method and apparatus for online migration of multi-disk virtual machine into different storage pools |
| CN112181589A (en) * | 2020-09-25 | 2021-01-05 | 苏州浪潮智能科技有限公司 | Optimization method for realizing post-snapshot migration of KVM (Kernel-based virtual machine) based on reflink |
| CN112181589B (en) * | 2020-09-25 | 2022-12-27 | 苏州浪潮智能科技有限公司 | Optimization method for KVM virtual machine to realize post-snapshot transfer based on reflink |
| CN114675791A (en) * | 2022-05-27 | 2022-06-28 | 苏州浪潮智能科技有限公司 | Disk processing method and system and electronic equipment |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111090399A (en) | Online migration method, device, equipment and medium for disk data | |
| US10884645B2 (en) | Virtual machine hot migration method, host machine and storage medium | |
| US11093162B2 (en) | Method and apparatus for deleting cascaded snapshot | |
| JP6186374B2 (en) | System and method for secure migration to a virtualized platform | |
| CN113626256A (en) | Virtual machine disk data backup method, device, terminal and storage medium | |
| CN111666266A (en) | Data migration method and related equipment | |
| CN107391226A (en) | The method and apparatus of backup virtual machine under a kind of open storehouse Openstack platforms | |
| CN104407806B (en) | The amending method and device of RAID group hard disc information | |
| CN107402839A (en) | A kind of method and system of Backup Data | |
| CN107783826A (en) | A kind of virtual machine migration method, apparatus and system | |
| CN116483274A (en) | Online migration method, device, equipment and medium for distributed block storage volume | |
| CN103455420A (en) | Test data construction method and equipment | |
| CN115454958A (en) | Data processing method, device, equipment, system and medium based on artificial intelligence | |
| CN114721876A (en) | Data backup method, device and medium | |
| CN114995958A (en) | Virtualization platform information consistency control method, device and medium | |
| CN110704241B (en) | Method, device, equipment and medium for recovering file metadata | |
| CN114443356A (en) | Container cluster processing method and system | |
| CN116113931A (en) | Freeing a data storage track while maintaining logical corruption protection | |
| CN112463228A (en) | Storage pool hybrid deployment method and device | |
| CN111176572B (en) | Method, device, equipment and medium for protecting stored data | |
| CN104461382A (en) | Internal writing method for file server operating multiple file systems and server | |
| CN115617576A (en) | Method, device and medium for recovering copy data | |
| EP4109288A1 (en) | Data migration method and apparatus for database | |
| CN107678838B (en) | Method and device for tracking operation of virtual machine and virtual machine management platform | |
| CN113626259A (en) | Firmware version recovery method, device and medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WW01 | Invention patent application withdrawn after publication |
Application publication date: 20200501 |
|
| WW01 | Invention patent application withdrawn after publication |