CN111966449A - Virtual machine backup management method, system, terminal and storage medium - Google Patents
Virtual machine backup management method, system, terminal and storage medium Download PDFInfo
- Publication number
- CN111966449A CN111966449A CN202010693786.5A CN202010693786A CN111966449A CN 111966449 A CN111966449 A CN 111966449A CN 202010693786 A CN202010693786 A CN 202010693786A CN 111966449 A CN111966449 A CN 111966449A
- Authority
- CN
- China
- Prior art keywords
- backup
- virtual machine
- time
- pool
- trend
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000007726 management method Methods 0.000 title claims abstract description 24
- 238000000034 method Methods 0.000 claims abstract description 29
- 230000008859 change Effects 0.000 claims description 38
- 238000012544 monitoring process Methods 0.000 claims description 17
- 238000004891 communication Methods 0.000 claims description 16
- 238000012216 screening Methods 0.000 claims description 13
- 230000000737 periodic effect Effects 0.000 claims description 11
- 238000012545 processing Methods 0.000 claims description 9
- 238000004364 calculation method Methods 0.000 claims description 6
- 230000001174 ascending effect Effects 0.000 claims description 5
- 230000000630 rising effect Effects 0.000 claims description 5
- 238000004590 computer program Methods 0.000 claims description 3
- 238000010586 diagram Methods 0.000 description 8
- 230000005012 migration Effects 0.000 description 4
- 238000013508 migration Methods 0.000 description 4
- 230000008569 process Effects 0.000 description 4
- 230000008878 coupling Effects 0.000 description 3
- 238000010168 coupling process Methods 0.000 description 3
- 238000005859 coupling reaction Methods 0.000 description 3
- 239000011159 matrix material Substances 0.000 description 3
- 230000003287 optical effect Effects 0.000 description 3
- 238000006467 substitution reaction Methods 0.000 description 3
- 238000005516 engineering process Methods 0.000 description 2
- 230000006870 function Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 230000009467 reduction Effects 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000008901 benefit Effects 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 230000007812 deficiency Effects 0.000 description 1
- 238000012217 deletion Methods 0.000 description 1
- 230000037430 deletion Effects 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 230000007246 mechanism Effects 0.000 description 1
- 238000011084 recovery Methods 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
- 230000007704 transition Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/44—Arrangements for executing specific programs
- G06F9/455—Emulation; Interpretation; Software simulation, e.g. virtualisation or emulation of application or operating system execution engines
- G06F9/45533—Hypervisors; Virtual machine monitors
- G06F9/45558—Hypervisor-specific management and integration aspects
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
- G06F11/14—Error detection or correction of the data by redundancy in operation
- G06F11/1402—Saving, restoring, recovering or retrying
- G06F11/1446—Point-in-time backing up or restoration of persistent data
- G06F11/1458—Management of the backup or restore process
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
- G06F3/0638—Organizing or formatting or addressing of data
- G06F3/0644—Management of space entities, e.g. partitions, extents, pools
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
- G06F3/0646—Horizontal data movement in storage systems, i.e. moving data in between storage devices or systems
- G06F3/0647—Migration mechanisms
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
- G06F3/0662—Virtualisation aspects
- G06F3/0664—Virtualisation aspects at device level, e.g. emulation of a storage device or system
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/44—Arrangements for executing specific programs
- G06F9/455—Emulation; Interpretation; Software simulation, e.g. virtualisation or emulation of application or operating system execution engines
- G06F9/45533—Hypervisors; Virtual machine monitors
- G06F9/45558—Hypervisor-specific management and integration aspects
- G06F2009/45562—Creating, deleting, cloning virtual machine instances
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/44—Arrangements for executing specific programs
- G06F9/455—Emulation; Interpretation; Software simulation, e.g. virtualisation or emulation of application or operating system execution engines
- G06F9/45533—Hypervisors; Virtual machine monitors
- G06F9/45558—Hypervisor-specific management and integration aspects
- G06F2009/45595—Network integration; Enabling network access in virtual machine instances
Abstract
The invention provides a virtual machine backup management method, a system, a terminal and a storage medium, comprising the following steps: receiving a backup cycle sent by a target virtual machine, wherein the target virtual machine is any virtual machine in a cluster; acquiring the resource utilization rate of a target virtual machine in a backup period; predicting the moment with the minimum operating pressure in the backup time range of the period according to the resource utilization rate by utilizing a Markov chain; and at the moment of the minimum operating pressure, selecting a backup pool with matched state according to the data volume to be backed up of the target virtual machine to back up the target virtual machine. According to the method and the device, the running state of the virtual machine is analyzed and calculated, the appropriate storage medium and the appropriate storage strategy are automatically selected for the virtual machine, manual intervention is reduced, backup efficiency is improved, the load of a backup storage pool is balanced, backup can be performed when the running pressure of the virtual machine is high, backup time is shortened, and the risk of data loss is reduced.
Description
Technical Field
The invention relates to the technical field of virtual machine clusters, in particular to a virtual machine backup management method, a virtual machine backup management system, a virtual machine backup management terminal and a storage medium.
Background
In a virtualization platform, a virtual machine is the most active subject and core, and smooth running of the virtual machine and safety and integrity of data are more concerns for users. The virtualization platform generally provides multiple technologies such as HA, snapshot, and the like to maintain continuity and stability of virtual machine service operation, but still cannot avoid data loss caused by accidents, such as virtual machine medium damage, false deletion, data accidental coverage, and the like. The virtual machine backup can store data and states of any snapshot point of the virtual machine, can store the data locally or in different places, and can recover by using the original data when a disaster or manual operation failure occurs in a production environment, so that loss is reduced. Therefore, backup has been an indispensable solution for protecting virtual machines by a virtualization platform.
The backup technology is widely applied to virtualization and cloud products, a user can backup a virtual machine according to self requirements, on-time backup, daily backup or manual operation is adopted for immediate backup, and a system automatically selects full or incremental backup according to the configuration, state and backup condition of the virtual machine. The backup system of the virtualization platform generally consists of the following five parts: backup data, backup media, backup channels, backup engines, backup policies. The backup data is the data file to be backed up. The backup medium is the physical medium on which the backup data is ultimately stored. The backup channel is connected with the backup data and the backup medium, the backup data is written into the backup medium through the backup engine, and the backup strategy determines the backup starting time, the backup type and the like.
The existing backup mechanism can guarantee the integrity of virtual machine data, but there are two problems in managing backup:
firstly, there are many backup media, different media have different applicable scenarios according to their characteristics (e.g., backup all-in-one machine has the characteristics of high concurrency, no transmission rate limitation, and suitability for small files, and disk library has the characteristics of faster data recovery and permanent data storage), and managers need to clearly know the characteristics and advantages and disadvantages of each media, and select an optimal backup scheme for the virtual machine, so as to improve backup efficiency. If the backup environment is complex and the number of virtual machines is large, managing backup is complex; secondly, the existing backup strategy is monotonous, for example, the virtual machine is backed up at a fixed time interval, the current virtual machine state and the use conditions of a CPU, a memory, and the like are not considered, and executing backup when the use pressure is high may cause a long backup time and easily lose data.
Disclosure of Invention
In view of the above-mentioned deficiencies of the prior art, the present invention provides a method, a system, a terminal and a storage medium for managing backup of a virtual machine, so as to solve the above-mentioned technical problems.
In a first aspect, the present invention provides a virtual machine backup management method, including:
receiving a backup cycle sent by a target virtual machine, wherein the target virtual machine is any virtual machine in a cluster;
acquiring the resource utilization rate of a target virtual machine in a backup period;
predicting the moment with the minimum operating pressure in the backup time range of the period according to the resource utilization rate by utilizing a Markov chain;
and at the moment of the minimum operating pressure, selecting a backup pool with matched state according to the data volume to be backed up of the target virtual machine to back up the target virtual machine.
Further, the predicting, by using a markov chain, a time when the operating pressure within the backup time range of the present period is the minimum according to the resource utilization rate includes:
setting a monitoring time interval, setting an adjustable range of backup time, and generating a periodic backup time range according to periodic backup time and the adjustable range;
dividing a backup period into a plurality of monitoring time intervals, and acquiring the resource occupancy rate of each time interval, wherein the resource occupancy rate comprises the CPU utilization rate, the memory utilization rate and the disk utilization rate;
recording the resource occupancy rate change trends of two adjacent time intervals in one backup period, wherein the change trends comprise an ascending trend, a leveling trend and a descending trend;
counting the occurrence probability of various change trends in the backup period, and generating a Markov chain model according to the occurrence probability of various change trends;
predicting the occurrence probability of various change trends of the resource occupancy rates of all adjacent time intervals in the period backup time range by using the Markov model, and marking the change trend of the resource utilization rates of the adjacent time intervals with the rising trend occurrence probability lower than a preset threshold as appropriate backups;
and screening more than two target adjacent time intervals with resource utilization rate change trends marked as suitable backups, extracting the interval time of the target adjacent time intervals, and outputting the interval time as the time with the minimum operating pressure.
Further, the selecting a backup pool with a matched state according to the data volume to be backed up of the target virtual machine to back up the target virtual machine includes:
acquiring the backup media types of the backup pools and marking the backup media types of the backup pools;
selecting a matched backup medium type according to the data amount to be backed up of the target virtual machine;
and screening the backup pool according to the matched backup media type and the backup pool mark.
Further, the method further comprises:
regularly collecting the available space capacity of each backup pool and the backup waiting time of each backup pool;
calculating the average value of the available space capacity of all the backup pools, and marking the backup pools of which the available space capacity does not exceed the average value as capacity to be adjusted;
calculating the average value of the backup waiting time of all the backup pools, and marking the backup pools with the backup waiting time above the average value as time waiting to be adjusted;
and detecting the communication pressure between the cluster virtual machine and the backup pool, migrating the backup data in the backup pool with the capacity to-be-adjusted mark and the time to-be-adjusted mark when the communication pressure is lower than a preset threshold value, and migrating the migrated data into the backup pool without the to-be-adjusted mark.
In a second aspect, the present invention provides a virtual machine backup management system, including:
the task receiving unit is configured to receive a backup cycle sent by a target virtual machine, wherein the target virtual machine is any virtual machine in a cluster;
the information acquisition unit is configured to acquire the resource utilization rate of the target virtual machine in a backup period;
the trend prediction unit is configured for predicting the moment with the minimum operating pressure in the backup time range of the period according to the resource utilization rate by utilizing the Markov chain;
and the backup execution unit is configured to select a backup pool with a matched state according to the data volume to be backed up of the target virtual machine to back up the target virtual machine at the moment when the operating pressure is minimum.
Further, the trend prediction unit includes:
the interval setting module is configured for setting a monitoring time interval, setting an adjustable range of backup time, and generating a periodic backup time range according to periodic backup time and the adjustable range;
the system comprises a parameter acquisition module, a data acquisition module and a data processing module, wherein the parameter acquisition module is configured to divide a backup period into a plurality of monitoring time intervals and acquire the resource occupancy rate of each time interval, and the resource occupancy rate comprises a CPU (Central processing Unit) utilization rate, a memory utilization rate and a disk utilization rate;
the trend recording module is configured to record resource occupancy rate change trends of two adjacent time intervals in one backup period, wherein the change trends comprise an ascending trend, a leveling trend and a descending trend;
the probability statistic module is configured to count the occurrence probability of various change trends in the backup period and generate a Markov chain model according to the occurrence probability of various change trends;
the trend prediction module is configured to predict the occurrence probability of various change trends of the resource occupancy rates of all adjacent time intervals in the period backup time range by using the Markov model, and mark the change trend of the resource utilization rates of the adjacent time intervals with the rising trend occurrence probability lower than a preset threshold as appropriate backups;
and the time screening module is configured to screen out target adjacent time intervals with more than two resource utilization rate change trends marked as suitable backups, extract interval time of the target adjacent time intervals, and output the interval time as the time with the minimum operating pressure.
Further, the backup execution unit includes:
the type acquisition module is configured to acquire the backup media types of the backup pools and mark the backup media types of the backup pools;
the type matching module is configured to select a matched backup media type according to the data volume to be backed up of the target virtual machine;
and the backup screening module is configured for screening the backup pool according to the matched backup media type and the backup pool mark.
Further, the system further comprises:
the regular monitoring unit is configured for regularly acquiring the available space capacity of each backup pool and the backup waiting time of each backup pool;
the capacity calculation unit is configured for calculating the average value of the available space capacities of all the backup pools, and marking the backup pools of which the available space capacities do not exceed the average value as the capacities to be adjusted;
the time calculation unit is configured for calculating the average value of the backup waiting time of all the backup pools, and marking the backup pools with the backup waiting time above the average value as time waiting to be adjusted;
and the data balancing unit is configured to detect the communication pressure between the cluster virtual machine and the backup pool, migrate the backup data in the backup pool with the capacity to-be-adjusted mark and the time to-be-adjusted mark simultaneously when the communication pressure is lower than a preset threshold value, and migrate the migrated data into the backup pool without the to-be-adjusted mark.
In a third aspect, a terminal is provided, including:
a processor, a memory, wherein,
the memory is used for storing a computer program which,
the processor is used for calling and running the computer program from the memory so as to make the terminal execute the method of the terminal.
In a fourth aspect, a computer storage medium is provided having stored therein instructions that, when executed on a computer, cause the computer to perform the method of the above aspects.
The beneficial effect of the invention is that,
according to the virtual machine backup management method, the virtual machine backup management system, the virtual machine backup management terminal and the virtual machine backup management storage medium, the moment when the operating pressure of the virtual machine is minimum is intelligently predicted, and then the matched backup pool is automatically screened for the virtual machine to perform virtual machine backup. According to the method and the device, the running state of the virtual machine is analyzed and calculated, the appropriate storage medium and the appropriate storage strategy are automatically selected for the virtual machine, manual intervention is reduced, backup efficiency is improved, the load of a backup storage pool is balanced, backup can be performed when the running pressure of the virtual machine is high, backup time is shortened, and the risk of data loss is reduced.
In addition, the invention has reliable design principle, simple structure and very wide application prospect.
Drawings
In order to more clearly illustrate the embodiments or technical solutions in the prior art of the present invention, the drawings used in the description of the embodiments or prior art will be briefly described below, and it is obvious for those skilled in the art that other drawings can be obtained based on these drawings without creative efforts.
FIG. 1 is a schematic flow diagram of a method of one embodiment of the invention.
FIG. 2 is a schematic flow diagram of a virtual machine backup of a method of one embodiment of the invention.
Figure 3 is a schematic diagram of a markov chain model of a method of one embodiment of the present invention.
FIG. 4 is a schematic flow chart diagram of dynamically adjusting backup pool load for a method of one embodiment of the present invention.
FIG. 5 is a schematic block diagram of a system of one embodiment of the present invention.
Fig. 6 is a schematic structural diagram of a terminal according to an embodiment of the present invention.
Detailed Description
In order to make those skilled in the art better understand the technical solution of the present invention, the technical solution in the embodiment of the present invention will be clearly and completely described below with reference to the drawings in the embodiment of the present invention, and it is obvious that the described embodiment is only a part of the embodiment of the present invention, and not all embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
FIG. 1 is a schematic flow diagram of a method of one embodiment of the invention. The execution subject in fig. 1 may be a virtual machine backup management system.
As shown in fig. 1, the method 100 includes:
and 140, selecting a backup pool with a matched state according to the data volume to be backed up of the target virtual machine to back up the target virtual machine at the moment when the operating pressure is minimum.
Specifically, the virtual machine backup management method includes:
referring to fig. 2, the process of virtual machine backup includes the following steps:
(1) a backup management node is created.
A special virtual machine (backup management node) is created on a cloud platform, different backup storage pools are created after different backup media are added to the cloud platform, and the backup management virtual machine monitors information such as connection states and available capacity of the backup storage pools. In other embodiments of the invention, the backup management solution may be a physical machine.
(2) Monitoring all backup storage pools in the cloud platform, and recording the available space and the waiting time of the backup.
(3) And the virtual machine to be backed up issues a periodic backup plan, and the expected backup period duration is set.
(4) And monitoring the running conditions of a CPU, a memory, a disk I/O and the like of the virtual machine in the backup period time period, and calculating the Markov model of the virtual machine.
And recording a CPU (Central processing Unit), a memory, a disk IO (input/output) and the like of the virtual machine by the backup management node within a period of time of a backup period, predicting the time with low operating pressure of the virtual machine by using a Markov chain, and dynamically finely adjusting and executing the backup time.
The process of calculating the prediction is described below using a CPU as an example.
And setting a smaller time interval t0, and recording the pressure change trend of the CPU, the memory and the disk I/O of the virtual machine in the backup period. Assuming that the current CPU usage is Ut, the usage of the previous time interval is Ut-t0, and the CPU usage of the virtual machine of the next time interval is Ut + t0, the CPU usage status has the following conditions: ut-t0> Ut records that the current state trend is the decrease of the utilization rate, Ut-t0 ═ Ut records that the current state trend is the leveling of the utilization rate, and Ut-t0< Ut records that the current state trend is the increase of the utilization rate;
| statenow in current state | |
| Ut-t0>Ut | Reduction of utilization (DOWN) |
| Ut-t0＝Ut | Usage rate keeping level (FLAT) |
| Ut-t0<Ut | Increased usage rate (UP) |
Similarly, according to Ut+t0And UtThe usage rate next state trend is determined as follows:
| state of the next Statenext | |
| Ut+t0>Ut | Increased usage rate (UP) |
| Ut+t0＝Ut | Usage rate keeping level (FLAT) |
| Ut+t0<Ut | Reduction of utilization (DOWN) |
Recording the change trend from the current state Statenow to the next state stateext for each time interval t0, and after approaching a backup period, counting the probability of each change trend to form a simple markov chain model and its state transition matrix, which is shown in fig. 3.
According to the Markov chain model, the state matrix is converted into the following state matrix:
supposing that the scheduled backup point is time Ti, allowing a deviation range a to start backup in advance or back backup, and calculating the utilization rate trend of the virtual machine CPU at the next time interval at intervals of a small time interval t; according to the characteristics of the Markov chain, the trend of the usage rate at a certain moment depends on the previous state, i.e. on
P(Ti+t|Ti-a,…,Ti-2t,Ti-t,Ti)
＝P(Ti+t|Ti)P(Ti+t|Ti-a，…，Ti-2t，Ti-t，Ti)＝P(Ti+t|Tt)
Given an initial value, the probability of a trend in virtual machine CPU usage status around the scheduled backup point in time may be calculated. And when the CPU utilization rate is leveled or the probability of the descending trend is greater than a set threshold value, setting a mark VMCPU state to represent proper backup.
And the same step, calculating the memory utilization rate of the virtual machine and the Markov model of disk I/O, marking the states of the VMRAM and the VMdisk, starting backup when at least two states exist at the same moment and are marked as proper backup, and recalculating the state of the next time interval until the trend is met.
Before the backup time point of the scheduled period comes, starting to calculate whether the pressure of the virtual machine is low and is suitable for backup, if the pressure is suitable for backup, selecting a backup pool to send a backup task according to the increment of the disk data of the virtual machine, completing the backup, if the pressure is not suitable for backup, pushing a time interval back, continuing to calculate until the time is pushed back to a time suitable for backup, and starting to backup.
(5) And evaluating the state of the backup pool, selecting a proper backup medium according to the size of the data volume written into the disk, and selecting backup storage with larger available backup space and smaller backup pressure to write backup data into the same medium.
In addition, in step (2), besides monitoring each backup pool, all backup pools are dynamically adjusted. The process of dynamically adjusting the backup pool load is shown in fig. 4:
monitoring by a backup management node, and recording the size of usable space of a sequential backup pool and the waiting time of a virtual machine backed up in the backup pool at intervals;
the average available space for the backup pool is calculated over time, and the average wait time is required. Inquiring the network load of the cloud platform, when the load is low, selecting a high-load backup pool according to the method in the technical scheme, and migrating a part of backup to a low-load backup pool; if the network load of the platform is higher, the platform load is inquired again after a period of time is postponed until the platform starts to migrate when the load is lower, and the specific migration method comprises the following steps:
setting A (i, space) to represent the usable space of the backup pool i, marking the smaller than average value as 1, and marking the larger than or equal to the average value as 0, and setting A (i)，wt)Representing that the waiting time of the virtual machine is backed up in the backup pool i, wherein the mark of the waiting time is 1 when the waiting time is larger than the average waiting time, and the mark of the waiting time is 0 when the waiting time is smaller than or equal to the average waiting time; the demand for the backup storage pool i is shown as N(i.n),
N(i.n)＝A(i，space)+A(i，wt)
Detecting the communication pressure between each host and storage of the cloud platform, and when the pressure is low, checking N by the backup management node(i.n)Selecting backup migration in the backup pool with the lowest available space according to the ranking of the available space from low to high in the backup storage pool of 2, and performing migration in N(i.n)And selecting backup pools with higher available space from the backup pools with the volume less than or equal to 1 for migration.
As shown in fig. 5, the system 500 includes:
a task receiving unit 510, configured to receive a backup cycle sent by a target virtual machine, where the target virtual machine is any virtual machine in a cluster;
the information acquisition unit 520 is configured to acquire the resource utilization rate of the target virtual machine in a backup period;
a trend prediction unit 530 configured to predict, according to the resource utilization, a time when the operating pressure within the backup time range of the present period is minimum by using a markov chain;
and the backup execution unit 540 is configured to select a backup pool with a matched state according to the amount of data to be backed up of the target virtual machine to backup the target virtual machine at the time when the operating pressure is minimum.
Optionally, as an embodiment of the present invention, the trend prediction unit includes:
the interval setting module is configured for setting a monitoring time interval, setting an adjustable range of backup time, and generating a periodic backup time range according to periodic backup time and the adjustable range;
the system comprises a parameter acquisition module, a data acquisition module and a data processing module, wherein the parameter acquisition module is configured to divide a backup period into a plurality of monitoring time intervals and acquire the resource occupancy rate of each time interval, and the resource occupancy rate comprises a CPU (Central processing Unit) utilization rate, a memory utilization rate and a disk utilization rate;
the trend recording module is configured to record resource occupancy rate change trends of two adjacent time intervals in one backup period, wherein the change trends comprise an ascending trend, a leveling trend and a descending trend;
the probability statistic module is configured to count the occurrence probability of various change trends in the backup period and generate a Markov chain model according to the occurrence probability of various change trends;
the trend prediction module is configured to predict the occurrence probability of various change trends of the resource occupancy rates of all adjacent time intervals in the period backup time range by using the Markov model, and mark the change trend of the resource utilization rates of the adjacent time intervals with the rising trend occurrence probability lower than a preset threshold as appropriate backups;
and the time screening module is configured to screen out target adjacent time intervals with more than two resource utilization rate change trends marked as suitable backups, extract interval time of the target adjacent time intervals, and output the interval time as the time with the minimum operating pressure.
Optionally, as an embodiment of the present invention, the backup execution unit includes:
the type acquisition module is configured to acquire the backup media types of the backup pools and mark the backup media types of the backup pools;
the type matching module is configured to select a matched backup media type according to the data volume to be backed up of the target virtual machine;
and the backup screening module is configured for screening the backup pool according to the matched backup media type and the backup pool mark.
Optionally, as an embodiment of the present invention, the system further includes:
the regular monitoring unit is configured for regularly acquiring the available space capacity of each backup pool and the backup waiting time of each backup pool;
the capacity calculation unit is configured for calculating the average value of the available space capacities of all the backup pools, and marking the backup pools of which the available space capacities do not exceed the average value as the capacities to be adjusted;
the time calculation unit is configured for calculating the average value of the backup waiting time of all the backup pools, and marking the backup pools with the backup waiting time above the average value as time waiting to be adjusted;
and the data balancing unit is configured to detect the communication pressure between the cluster virtual machine and the backup pool, migrate the backup data in the backup pool with the capacity to-be-adjusted mark and the time to-be-adjusted mark simultaneously when the communication pressure is lower than a preset threshold value, and migrate the migrated data into the backup pool without the to-be-adjusted mark.
Fig. 6 is a schematic structural diagram of a terminal 600 according to an embodiment of the present invention, where the terminal 600 may be used to execute the virtual machine backup management method according to the embodiment of the present invention.
The terminal 600 may include: a processor 610, a memory 620, and a communication unit 630. The components communicate via one or more buses, and those skilled in the art will appreciate that the architecture of the servers shown in the figures is not intended to be limiting, and may be a bus architecture, a star architecture, a combination of more or less components than those shown, or a different arrangement of components.
The memory 620 may be used for storing instructions executed by the processor 610, and the memory 620 may be implemented by any type of volatile or non-volatile storage terminal or combination thereof, such as Static Random Access Memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic disk or optical disk. The executable instructions in memory 620, when executed by processor 610, enable terminal 600 to perform some or all of the steps in the method embodiments described below.
The processor 610 is a control center of the storage terminal, connects various parts of the entire electronic terminal using various interfaces and lines, and performs various functions of the electronic terminal and/or processes data by operating or executing software programs and/or modules stored in the memory 620 and calling data stored in the memory. The processor may be composed of an Integrated Circuit (IC), for example, a single packaged IC, or a plurality of packaged ICs connected with the same or different functions. For example, the processor 610 may include only a Central Processing Unit (CPU). In the embodiment of the present invention, the CPU may be a single operation core, or may include multiple operation cores.
A communication unit 630, configured to establish a communication channel so that the storage terminal can communicate with other terminals. And receiving user data sent by other terminals or sending the user data to other terminals.
The present invention also provides a computer storage medium, wherein the computer storage medium may store a program, and the program may include some or all of the steps in the embodiments provided by the present invention when executed. The storage medium may be a magnetic disk, an optical disk, a read-only memory (ROM) or a Random Access Memory (RAM).
Therefore, the technical effects achieved by the present embodiment of the invention can be referred to the above description, and are not described herein again.
Those skilled in the art will readily appreciate that the techniques of the embodiments of the present invention may be implemented as software plus a required general purpose hardware platform. Based on such understanding, the technical solutions in the embodiments of the present invention may be embodied in the form of a software product, where the computer software product is stored in a storage medium, such as a usb disk, a removable hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk, and the like, and the storage medium can store program codes, and includes instructions for enabling a computer terminal (which may be a personal computer, a server, or a second terminal, a network terminal, and the like) to perform all or part of the steps of the method in the embodiments of the present invention.
The same and similar parts in the various embodiments in this specification may be referred to each other. Especially, for the terminal embodiment, since it is basically similar to the method embodiment, the description is relatively simple, and the relevant points can be referred to the description in the method embodiment.
In the embodiments provided in the present invention, it should be understood that the disclosed system and method can be implemented in other ways. For example, the above-described system embodiments are merely illustrative, and for example, the division of the units is only one logical functional division, and other divisions may be realized in practice, for example, a plurality of units or components may be combined or integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, systems or units, and may be in an electrical, mechanical or other form.
The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.
In addition, functional units in the embodiments of the present invention may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit.
Although the present invention has been described in detail by referring to the drawings in connection with the preferred embodiments, the present invention is not limited thereto. Various equivalent modifications or substitutions can be made on the embodiments of the present invention by those skilled in the art without departing from the spirit and scope of the present invention, and these modifications or substitutions are within the scope of the present invention/any person skilled in the art can easily conceive of the changes or substitutions within the technical scope of the present invention. Therefore, the protection scope of the present invention shall be subject to the protection scope of the claims.
Claims (10)
1. A virtual machine backup management method is characterized by comprising the following steps:
receiving a backup cycle sent by a target virtual machine, wherein the target virtual machine is any virtual machine in a cluster;
acquiring the resource utilization rate of a target virtual machine in a backup period;
predicting the moment with the minimum operating pressure in the backup time range of the period according to the resource utilization rate by utilizing a Markov chain;
and at the moment of the minimum operating pressure, selecting a backup pool with matched state according to the data volume to be backed up of the target virtual machine to back up the target virtual machine.
2. The method of claim 1, wherein the predicting, by using a markov chain, a time at which the operating pressure within the backup time range of the present cycle is minimum according to the resource utilization rate comprises:
setting a monitoring time interval, setting an adjustable range of backup time, and generating a periodic backup time range according to periodic backup time and the adjustable range;
dividing a backup period into a plurality of monitoring time intervals, and acquiring the resource occupancy rate of each time interval, wherein the resource occupancy rate comprises the CPU utilization rate, the memory utilization rate and the disk utilization rate;
recording the resource occupancy rate change trends of two adjacent time intervals in one backup period, wherein the change trends comprise an ascending trend, a leveling trend and a descending trend;
counting the occurrence probability of various change trends in the backup period, and generating a Markov chain model according to the occurrence probability of various change trends;
predicting the occurrence probability of various change trends of the resource occupancy rates of all adjacent time intervals in the period backup time range by using the Markov model, and marking the change trend of the resource utilization rates of the adjacent time intervals with the rising trend occurrence probability lower than a preset threshold as appropriate backups;
and screening more than two target adjacent time intervals with resource utilization rate change trends marked as suitable backups, extracting the interval time of the target adjacent time intervals, and outputting the interval time as the time with the minimum operating pressure.
3. The method according to claim 1, wherein the selecting a backup pool with a matched state according to the amount of data to be backed up of the target virtual machine to back up the target virtual machine comprises:
acquiring the backup media types of the backup pools and marking the backup media types of the backup pools;
selecting a matched backup medium type according to the data amount to be backed up of the target virtual machine;
and screening the backup pool according to the matched backup media type and the backup pool mark.
4. The method of claim 1, further comprising:
regularly collecting the available space capacity of each backup pool and the backup waiting time of each backup pool;
calculating the average value of the available space capacity of all the backup pools, and marking the backup pools of which the available space capacity does not exceed the average value as capacity to be adjusted;
calculating the average value of the backup waiting time of all the backup pools, and marking the backup pools with the backup waiting time above the average value as time waiting to be adjusted;
and detecting the communication pressure between the cluster virtual machine and the backup pool, migrating the backup data in the backup pool with the capacity to-be-adjusted mark and the time to-be-adjusted mark when the communication pressure is lower than a preset threshold value, and migrating the migrated data into the backup pool without the to-be-adjusted mark.
5. A virtual machine backup management system, comprising:
the task receiving unit is configured to receive a backup cycle sent by a target virtual machine, wherein the target virtual machine is any virtual machine in a cluster;
the information acquisition unit is configured to acquire the resource utilization rate of the target virtual machine in a backup period;
the trend prediction unit is configured for predicting the moment with the minimum operating pressure in the backup time range of the period according to the resource utilization rate by utilizing the Markov chain;
and the backup execution unit is configured to select a backup pool with a matched state according to the data volume to be backed up of the target virtual machine to back up the target virtual machine at the moment when the operating pressure is minimum.
6. The system of claim 5, wherein the trend prediction unit comprises:
the interval setting module is configured for setting a monitoring time interval, setting an adjustable range of backup time, and generating a periodic backup time range according to periodic backup time and the adjustable range;
the system comprises a parameter acquisition module, a data acquisition module and a data processing module, wherein the parameter acquisition module is configured to divide a backup period into a plurality of monitoring time intervals and acquire the resource occupancy rate of each time interval, and the resource occupancy rate comprises a CPU (Central processing Unit) utilization rate, a memory utilization rate and a disk utilization rate;
the trend recording module is configured to record resource occupancy rate change trends of two adjacent time intervals in one backup period, wherein the change trends comprise an ascending trend, a leveling trend and a descending trend;
the probability statistic module is configured to count the occurrence probability of various change trends in the backup period and generate a Markov chain model according to the occurrence probability of various change trends;
the trend prediction module is configured to predict the occurrence probability of various change trends of the resource occupancy rates of all adjacent time intervals in the period backup time range by using the Markov model, and mark the change trend of the resource utilization rates of the adjacent time intervals with the rising trend occurrence probability lower than a preset threshold as appropriate backups;
and the time screening module is configured to screen out target adjacent time intervals with more than two resource utilization rate change trends marked as suitable backups, extract interval time of the target adjacent time intervals, and output the interval time as the time with the minimum operating pressure.
7. The system of claim 5, wherein the backup execution unit comprises:
the type acquisition module is configured to acquire the backup media types of the backup pools and mark the backup media types of the backup pools;
the type matching module is configured to select a matched backup media type according to the data volume to be backed up of the target virtual machine;
and the backup screening module is configured for screening the backup pool according to the matched backup media type and the backup pool mark.
8. The system of claim 5, further comprising:
the regular monitoring unit is configured for regularly acquiring the available space capacity of each backup pool and the backup waiting time of each backup pool;
the capacity calculation unit is configured for calculating the average value of the available space capacities of all the backup pools, and marking the backup pools of which the available space capacities do not exceed the average value as the capacities to be adjusted;
the time calculation unit is configured for calculating the average value of the backup waiting time of all the backup pools, and marking the backup pools with the backup waiting time above the average value as time waiting to be adjusted;
and the data balancing unit is configured to detect the communication pressure between the cluster virtual machine and the backup pool, migrate the backup data in the backup pool with the capacity to-be-adjusted mark and the time to-be-adjusted mark simultaneously when the communication pressure is lower than a preset threshold value, and migrate the migrated data into the backup pool without the to-be-adjusted mark.
9. A terminal, comprising:
a processor;
a memory for storing instructions for execution by the processor;
wherein the processor is configured to perform the method of any one of claims 1-4.
10. A computer-readable storage medium, in which a computer program is stored which, when being executed by a processor, carries out the method according to any one of claims 1-4.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010693786.5A CN111966449B (en) | 2020-07-17 | 2020-07-17 | Virtual machine backup management method, system, terminal and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010693786.5A CN111966449B (en) | 2020-07-17 | 2020-07-17 | Virtual machine backup management method, system, terminal and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111966449A true CN111966449A (en) | 2020-11-20 |
| CN111966449B CN111966449B (en) | 2022-05-31 |
Family
ID=73360549
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010693786.5A Active CN111966449B (en) | 2020-07-17 | 2020-07-17 | Virtual machine backup management method, system, terminal and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111966449B (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112306758A (en) * | 2020-12-24 | 2021-02-02 | 深圳市科力锐科技有限公司 | Backup success rate prediction method, device, equipment and storage medium |
| CN113778649A (en) * | 2021-09-14 | 2021-12-10 | 杭州沃趣科技股份有限公司 | Multi-backup task dynamic scheduling method, device, equipment and medium |
| CN114003065A (en) * | 2021-10-15 | 2022-02-01 | 湖北三江航天红林探控有限公司 | Dual-pressure transmitter redundancy design algorithm based on air pressure prediction |
| WO2022247219A1 (en) * | 2021-05-25 | 2022-12-01 | 深圳前海微众银行股份有限公司 | Information backup method, device, and platform |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20120323853A1 (en) * | 2011-06-17 | 2012-12-20 | Microsoft Corporation | Virtual machine snapshotting and analysis |
| CN109272047A (en) * | 2018-09-27 | 2019-01-25 | 山东理工大学 | It is a kind of to meet the Hidden Markov Model state construction and parameter training method that light multicast resource is predicted |
| CN110187990A (en) * | 2019-05-31 | 2019-08-30 | 东北大学 | A kind of virtual machine mixing for standby use dynamic reliability appraisal procedure based on mode shifts |
| CN111352700A (en) * | 2020-02-29 | 2020-06-30 | 苏州浪潮智能科技有限公司 | Method, system, terminal and storage medium for online migration of virtual machine across clouds |
-
2020
- 2020-07-17 CN CN202010693786.5A patent/CN111966449B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20120323853A1 (en) * | 2011-06-17 | 2012-12-20 | Microsoft Corporation | Virtual machine snapshotting and analysis |
| CN109272047A (en) * | 2018-09-27 | 2019-01-25 | 山东理工大学 | It is a kind of to meet the Hidden Markov Model state construction and parameter training method that light multicast resource is predicted |
| CN110187990A (en) * | 2019-05-31 | 2019-08-30 | 东北大学 | A kind of virtual machine mixing for standby use dynamic reliability appraisal procedure based on mode shifts |
| CN111352700A (en) * | 2020-02-29 | 2020-06-30 | 苏州浪潮智能科技有限公司 | Method, system, terminal and storage medium for online migration of virtual machine across clouds |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112306758A (en) * | 2020-12-24 | 2021-02-02 | 深圳市科力锐科技有限公司 | Backup success rate prediction method, device, equipment and storage medium |
| WO2022247219A1 (en) * | 2021-05-25 | 2022-12-01 | 深圳前海微众银行股份有限公司 | Information backup method, device, and platform |
| CN113778649A (en) * | 2021-09-14 | 2021-12-10 | 杭州沃趣科技股份有限公司 | Multi-backup task dynamic scheduling method, device, equipment and medium |
| CN114003065A (en) * | 2021-10-15 | 2022-02-01 | 湖北三江航天红林探控有限公司 | Dual-pressure transmitter redundancy design algorithm based on air pressure prediction |
| CN114003065B (en) * | 2021-10-15 | 2024-03-19 | 湖北三江航天红林探控有限公司 | Dual-pressure transmitter redundancy design method based on air pressure prediction |
Also Published As
| Publication number | Publication date |
|---|---|
| CN111966449B (en) | 2022-05-31 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111966449B (en) | Virtual machine backup management method, system, terminal and storage medium | |
| CN108090225B (en) | Database instance running method, device and system and computer readable storage medium | |
| JP4896593B2 (en) | Performance monitoring method, computer and computer system | |
| EP4068090A1 (en) | Container scheduling method and apparatus, and non-volatile computer-readable storage medium | |
| US8024542B1 (en) | Allocating background workflows in a data storage system using historical data | |
| CN109358947B (en) | Method and system for realizing virtual machine snapshot | |
| US10282095B2 (en) | Method and device for managing performance of storage apparatus | |
| CN112434938A (en) | Resource capacity management method and device | |
| CN112667405B (en) | Information processing method, device, equipment and storage medium | |
| CN112256433B (en) | Partition migration method and device based on Kafka cluster | |
| US8140775B1 (en) | Allocating background workflows in a data storage system using autocorrelation | |
| CN111666266A (en) | Data migration method and related equipment | |
| CN115291806A (en) | Processing method, processing device, electronic equipment and storage medium | |
| CN110377664B (en) | Data synchronization method, device, server and storage medium | |
| CN114185675A (en) | Resource management method, device, electronic equipment and storage medium | |
| CN107203256A (en) | Energy-conservation distribution method and device under a kind of network function virtualization scene | |
| CN111338579B (en) | Read-write cache optimization method, system, terminal and storage medium based on storage pool | |
| CN110347546B (en) | Dynamic adjustment method, device, medium and electronic equipment for monitoring task | |
| CN112732408A (en) | Method for computing node resource optimization | |
| US20140122403A1 (en) | Loading prediction method and electronic device using the same | |
| CN110806918A (en) | Virtual machine operation method and device based on deep learning neural network | |
| CN107368355B (en) | Dynamic scheduling method and device of virtual machine | |
| CN115993932A (en) | Data processing method, device, storage medium and electronic equipment | |
| CN115168042A (en) | Management method and device of monitoring cluster, computer storage medium and electronic equipment | |
| CN113885803A (en) | Data storage method and device, electronic equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |